Sep 15 09:12:11.073110 ip-10-0-141-235 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 15 09:12:11.073121 ip-10-0-141-235 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 15 09:12:11.073128 ip-10-0-141-235 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 15 09:12:11.073462 ip-10-0-141-235 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 15 09:12:21.181493 ip-10-0-141-235 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 15 09:12:21.181513 ip-10-0-141-235 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot deb8a24337fb4980aa2cf5c996f75198 --
Sep 15 09:14:13.884930 ip-10-0-141-235 systemd[1]: Starting Kubernetes Kubelet...
Sep 15 09:14:14.243506 ip-10-0-141-235 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 09:14:14.243506 ip-10-0-141-235 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 15 09:14:14.243506 ip-10-0-141-235 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 09:14:14.243506 ip-10-0-141-235 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 15 09:14:14.243506 ip-10-0-141-235 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 09:14:14.244511 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.244441    2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 15 09:14:14.248352 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248338    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 09:14:14.248352 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248352    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 09:14:14.248418 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248357    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 09:14:14.248418 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248361    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 09:14:14.248418 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248364    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 09:14:14.248418 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248367    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 09:14:14.248418 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248371    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 09:14:14.248418 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248374    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 09:14:14.248418 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248377    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 09:14:14.248418 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248380    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 09:14:14.248418 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248383    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 09:14:14.248418 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248386    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 09:14:14.248418 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248389    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 09:14:14.248418 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248391    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 09:14:14.248418 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248394    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 09:14:14.248418 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248396    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 09:14:14.248418 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248399    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 09:14:14.248418 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248403    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 09:14:14.248418 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248405    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 09:14:14.248418 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248408    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 09:14:14.248418 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248410    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 09:14:14.248418 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248413    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 09:14:14.248947 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248416    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 09:14:14.248947 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248418    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 09:14:14.248947 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248421    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 09:14:14.248947 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248424    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 09:14:14.248947 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248426    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 09:14:14.248947 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248429    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 09:14:14.248947 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248432    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 09:14:14.248947 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248435    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 09:14:14.248947 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248437    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 09:14:14.248947 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248440    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 09:14:14.248947 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248443    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 09:14:14.248947 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248445    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 09:14:14.248947 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248448    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 09:14:14.248947 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248451    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 09:14:14.248947 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248453    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 09:14:14.248947 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248456    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 09:14:14.248947 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248458    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 09:14:14.248947 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248461    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 09:14:14.248947 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248463    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 09:14:14.248947 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248468    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 09:14:14.249653 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248472    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 09:14:14.249653 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248474    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 09:14:14.249653 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248477    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 09:14:14.249653 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248480    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 09:14:14.249653 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248483    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 09:14:14.249653 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248485    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 09:14:14.249653 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248488    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 09:14:14.249653 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248491    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 09:14:14.249653 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248494    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 09:14:14.249653 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248497    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 09:14:14.249653 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248500    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 09:14:14.249653 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248503    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 09:14:14.249653 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248505    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 09:14:14.249653 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248508    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 09:14:14.249653 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248512    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 09:14:14.249653 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248514    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 09:14:14.249653 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248517    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 09:14:14.249653 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248519    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 09:14:14.249653 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248522    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 09:14:14.249653 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248524    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 09:14:14.250191 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248527    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 09:14:14.250191 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248529    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 09:14:14.250191 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248532    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 09:14:14.250191 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248534    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 09:14:14.250191 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248537    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 09:14:14.250191 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248539    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 09:14:14.250191 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248542    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 09:14:14.250191 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248545    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 09:14:14.250191 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248549    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 09:14:14.250191 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248554    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 09:14:14.250191 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248558    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 09:14:14.250191 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248561    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 09:14:14.250191 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248564    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 09:14:14.250191 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248567    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 09:14:14.250191 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248570    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 09:14:14.250191 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248572    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 09:14:14.250191 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248575    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 09:14:14.250191 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248578    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 09:14:14.250644 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248580    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 09:14:14.250644 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248583    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 09:14:14.250644 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248585    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 09:14:14.250644 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248588    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 09:14:14.250644 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248591    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 09:14:14.250644 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248594    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 09:14:14.250644 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248596    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 09:14:14.250644 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248600    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 09:14:14.250644 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248603    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 09:14:14.250644 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248606    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 09:14:14.250644 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248608    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 09:14:14.250644 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248611    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 09:14:14.250644 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248613    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 09:14:14.250644 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248616    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 09:14:14.250644 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248619    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 09:14:14.250644 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248633    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 09:14:14.250644 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248636    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 09:14:14.250644 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248638    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 09:14:14.250644 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.248641    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 09:14:14.252129 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252113    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 09:14:14.252129 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252129    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 09:14:14.252187 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252133    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 09:14:14.252187 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252136    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 09:14:14.252187 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252140    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 09:14:14.252187 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252143    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 09:14:14.252187 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252147    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 09:14:14.252187 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252152    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 09:14:14.252187 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252156    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 09:14:14.252187 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252159    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 09:14:14.252187 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252163    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 09:14:14.252187 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252166    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 09:14:14.252187 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252168    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 09:14:14.252187 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252171    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 09:14:14.252187 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252174    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 09:14:14.252187 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252177    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 09:14:14.252187 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252180    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 09:14:14.252187 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252182    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 09:14:14.252187 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252185    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 09:14:14.252187 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252189    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 09:14:14.252187 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252191    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 09:14:14.252187 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252194    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 09:14:14.252713 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252197    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 09:14:14.252713 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252200    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 09:14:14.252713 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252203    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 09:14:14.252713 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252205    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 09:14:14.252713 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252208    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 09:14:14.252713 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252210    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 09:14:14.252713 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252213    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 09:14:14.252713 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252215    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 09:14:14.252713 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252219    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 09:14:14.252713 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252223    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 09:14:14.252713 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252225    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 09:14:14.252713 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252228    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 09:14:14.252713 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252231    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 09:14:14.252713 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252233    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 09:14:14.252713 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252236    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 09:14:14.252713 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252238    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 09:14:14.252713 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252241    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 09:14:14.252713 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252243    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 09:14:14.252713 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252246    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 09:14:14.252713 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252248    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 09:14:14.253195 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252251    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 09:14:14.253195 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252253    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 09:14:14.253195 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252256    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 09:14:14.253195 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252258    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 09:14:14.253195 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252261    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 09:14:14.253195 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252263    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 09:14:14.253195 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252266    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 09:14:14.253195 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252269    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 09:14:14.253195 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252272    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 09:14:14.253195 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252275    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 09:14:14.253195 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252277    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 09:14:14.253195 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252280    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 09:14:14.253195 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252283    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 09:14:14.253195 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252286    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 09:14:14.253195 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252289    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 09:14:14.253195 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252291    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 09:14:14.253195 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252294    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 09:14:14.253195 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252297    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 09:14:14.253195 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252299    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 09:14:14.253195 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252302    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 09:14:14.253702 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252304    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 09:14:14.253702 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252307    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 09:14:14.253702 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252309    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 09:14:14.253702 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252312    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 09:14:14.253702 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252314    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 09:14:14.253702 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252317    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 09:14:14.253702 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252319    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 09:14:14.253702 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252322    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 09:14:14.253702 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252325    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 09:14:14.253702 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252327    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 09:14:14.253702 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252329    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 09:14:14.253702 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252332    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 09:14:14.253702 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252334    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 09:14:14.253702 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252337    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 09:14:14.253702 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252339    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 09:14:14.253702 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252342    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 09:14:14.253702 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252346    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 09:14:14.253702 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252348    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 09:14:14.253702 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252351    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 09:14:14.253702 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252353    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 09:14:14.254200 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252356    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 09:14:14.254200 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252367    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 09:14:14.254200 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252370    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 09:14:14.254200 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252375    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 09:14:14.254200 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252378    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 09:14:14.254200 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252382    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 09:14:14.254200 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252385    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 09:14:14.254200 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252388    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 09:14:14.254200 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252391    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 09:14:14.254200 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252394    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 09:14:14.254200 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252397    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 09:14:14.254200 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252400    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 09:14:14.254200 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252402    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 09:14:14.254200 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252405    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 09:14:14.254200 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252407    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 09:14:14.254200 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252410    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 09:14:14.254200 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252428    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 09:14:14.254200 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252803    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 09:14:14.254200 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252809    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 09:14:14.254683 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252812    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 09:14:14.254683 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252815    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 09:14:14.254683 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252819    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 09:14:14.254683 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252822    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 09:14:14.254683 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252824    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 09:14:14.254683 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252827    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 09:14:14.254683 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252830    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 09:14:14.254683 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252833    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 09:14:14.254683 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252835    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 09:14:14.254683 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252839    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 09:14:14.254683 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252842    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 09:14:14.254683 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252844    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 09:14:14.254683 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252847    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 09:14:14.254683 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252850    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 09:14:14.254683 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252853    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 09:14:14.254683 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252856    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 09:14:14.254683 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252859    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 09:14:14.254683 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252862    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 09:14:14.254683 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252864    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 09:14:14.255139 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252868    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 09:14:14.255139 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252870    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 09:14:14.255139 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252873    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 09:14:14.255139 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252875    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 09:14:14.255139 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252878    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 09:14:14.255139 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252880    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 09:14:14.255139 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252883    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 09:14:14.255139 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252886    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 09:14:14.255139 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252888    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 09:14:14.255139 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252891    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 09:14:14.255139 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252893    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 09:14:14.255139 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252895    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 09:14:14.255139 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252898    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 09:14:14.255139 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252901    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 09:14:14.255139 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252903    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 09:14:14.255139 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252906    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 09:14:14.255139 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252908    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 09:14:14.255139 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252911    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 09:14:14.255139 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252914    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 09:14:14.255139 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252916    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 09:14:14.255648 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252919    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 09:14:14.255648 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252921    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 09:14:14.255648 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252926    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 09:14:14.255648 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252929    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 09:14:14.255648 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252932    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 09:14:14.255648 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252934    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 09:14:14.255648 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252937    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 09:14:14.255648 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252939    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 09:14:14.255648 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252942    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 09:14:14.255648 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252947    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 09:14:14.255648 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252952    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 09:14:14.255648 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252955    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 09:14:14.255648 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252958    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 09:14:14.255648 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252960    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 09:14:14.255648 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252963    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 09:14:14.255648 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252966    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 09:14:14.255648 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252968    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 09:14:14.255648 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252971    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 09:14:14.255648 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252974    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 09:14:14.256132 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252976    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 09:14:14.256132 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252979    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 09:14:14.256132 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252981    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 09:14:14.256132 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252983    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 09:14:14.256132 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252986    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 09:14:14.256132 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252989    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 09:14:14.256132 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252991    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 09:14:14.256132 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252994    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 09:14:14.256132 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252996    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 09:14:14.256132 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.252999    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 09:14:14.256132 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253001    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 09:14:14.256132 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253004    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 09:14:14.256132 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253006    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 09:14:14.256132 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253009    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 09:14:14.256132 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253011    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 09:14:14.256132 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253016    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 09:14:14.256132 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253018    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 09:14:14.256132 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253021    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 09:14:14.256132 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253023    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 09:14:14.256132 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253026    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 09:14:14.256132 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253028    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 09:14:14.256653 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253030    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 09:14:14.256653 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253034    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 09:14:14.256653 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253037    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 09:14:14.256653 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253040    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 09:14:14.256653 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253042    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 09:14:14.256653 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253045    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 09:14:14.256653 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253047    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 09:14:14.256653 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253051    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 09:14:14.256653 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253055    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 09:14:14.256653 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253058    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 09:14:14.256653 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253062    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 09:14:14.256653 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253065    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 09:14:14.256653 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253067    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 09:14:14.256653 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253070    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 09:14:14.256653 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253072    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 09:14:14.256653 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253075    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 09:14:14.256653 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253077    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 09:14:14.256653 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253080    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 09:14:14.256653 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253153    2578 flags.go:64] FLAG: --address="0.0.0.0"
Sep 15 09:14:14.256653 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253187    2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 15 09:14:14.257231 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253193    2578 flags.go:64] FLAG: --anonymous-auth="true"
Sep 15 09:14:14.257231 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253197    2578 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 15 09:14:14.257231 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253201    2578 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 15 09:14:14.257231 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253205    2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 15 09:14:14.257231 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253209    2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 15 09:14:14.257231 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253213    2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 15 09:14:14.257231 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253217    2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 15 09:14:14.257231 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253220    2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 15 09:14:14.257231 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253223    2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 15 09:14:14.257231 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253227    2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 15 09:14:14.257231 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253230    2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 15 09:14:14.257231 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253234    2578 flags.go:64] FLAG: --cgroup-root=""
Sep 15 09:14:14.257231 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253236    2578 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 15 09:14:14.257231 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253239    2578 flags.go:64] FLAG: --client-ca-file=""
Sep 15 09:14:14.257231 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253243    2578 flags.go:64] FLAG: --cloud-provider="external"
Sep 15 09:14:14.257231 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253246    2578 flags.go:64] FLAG: --cluster-dns="[]"
Sep 15 09:14:14.257231 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253251    2578 flags.go:64] FLAG: --cluster-domain=""
Sep 15 09:14:14.257231 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253253    2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 15 09:14:14.257231 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253257    2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 15 09:14:14.257231 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253260    2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 15 09:14:14.257231 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253263    2578 flags.go:64] FLAG: --container-log-max-files="5"
Sep 15 09:14:14.257231 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253267    2578 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 15 09:14:14.257231 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253270    2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 15 09:14:14.257828 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253273    2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 15 09:14:14.257828 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253276    2578 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 15 09:14:14.257828 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253279    2578 flags.go:64] FLAG: --contention-profiling="false"
Sep 15 09:14:14.257828 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253282    2578 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 15 09:14:14.257828 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253285    2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 15 09:14:14.257828 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253288    2578 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 15 09:14:14.257828 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253291    2578 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 15 09:14:14.257828 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253294    2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 15 09:14:14.257828 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253297    2578 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 15 09:14:14.257828 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253300    2578 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 15 09:14:14.257828 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253303    2578 flags.go:64] FLAG: --enable-load-reader="false"
Sep 15 09:14:14.257828 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253306    2578 flags.go:64] FLAG: --enable-server="true"
Sep 15 09:14:14.257828 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253309    2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 15 09:14:14.257828 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253313    2578 flags.go:64] FLAG: --event-burst="100"
Sep 15 09:14:14.257828 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253316    2578 flags.go:64] FLAG: --event-qps="50"
Sep 15 09:14:14.257828 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253319    2578 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 15 09:14:14.257828 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253322    2578 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 15 09:14:14.257828 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253325    2578 flags.go:64] FLAG: --eviction-hard=""
Sep 15 09:14:14.257828 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253329    2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 15 09:14:14.257828 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253332    2578 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 15 09:14:14.257828 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253335    2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 15 09:14:14.257828 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253338    2578 flags.go:64] FLAG: --eviction-soft=""
Sep 15 09:14:14.257828 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253341    2578 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 15 09:14:14.257828 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253344    2578 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 15 09:14:14.257828 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253349    2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 15 09:14:14.258458 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253352    2578 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 15 09:14:14.258458 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253355    2578 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 15 09:14:14.258458 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253358    2578 flags.go:64] FLAG: --fail-swap-on="true"
Sep 15 09:14:14.258458 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253360    2578 flags.go:64] FLAG: --feature-gates=""
Sep 15 09:14:14.258458 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253364    2578 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 15 09:14:14.258458 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253367    2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 15 09:14:14.258458 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253371    2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 15 09:14:14.258458 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253374    2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 15 09:14:14.258458 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253377    2578 flags.go:64] FLAG: --healthz-port="10248"
Sep 15 09:14:14.258458 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253380    2578 flags.go:64] FLAG: --help="false"
Sep 15 09:14:14.258458 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253383    2578 flags.go:64] FLAG: --hostname-override="ip-10-0-141-235.ec2.internal"
Sep 15 09:14:14.258458 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253386    2578 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 15 09:14:14.258458 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253390    2578 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 15 09:14:14.258458 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253392    2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 15 09:14:14.258458 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253396    2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 15 09:14:14.258458 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253399    2578 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 15 09:14:14.258458 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253402    2578 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 15 09:14:14.258458 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253405    2578 flags.go:64] FLAG: --image-service-endpoint=""
Sep 15 09:14:14.258458 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253408    2578 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 15 09:14:14.258458 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253411    2578 flags.go:64] FLAG: --kube-api-burst="100"
Sep 15 09:14:14.258458 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253414    2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 15 09:14:14.258458 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253417    2578 flags.go:64] FLAG: --kube-api-qps="50"
Sep 15 09:14:14.258458 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253420    2578 flags.go:64] FLAG: --kube-reserved=""
Sep 15 09:14:14.258458 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253423    2578 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 15 09:14:14.259092 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253426    2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 15 09:14:14.259092 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253429    2578 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 15 09:14:14.259092 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253432    2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 15 09:14:14.259092 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253435    2578 flags.go:64] FLAG: --lock-file=""
Sep 15 09:14:14.259092 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253437    2578 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 15 09:14:14.259092 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253443    2578 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 15 09:14:14.259092 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253446    2578 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 15 09:14:14.259092 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253451    2578 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 15 09:14:14.259092 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253455    2578 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 15 09:14:14.259092 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253458    2578 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 15 09:14:14.259092 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253460    2578 flags.go:64] FLAG: --logging-format="text"
Sep 15 09:14:14.259092 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253463    2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 15 09:14:14.259092 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253467    2578 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 15 09:14:14.259092 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253470    2578 flags.go:64] FLAG: --manifest-url=""
Sep 15 09:14:14.259092 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253473    2578 flags.go:64] FLAG: --manifest-url-header=""
Sep 15 09:14:14.259092 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253477    2578 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 15 09:14:14.259092 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253480    2578 flags.go:64] FLAG: --max-open-files="1000000"
Sep 15 09:14:14.259092 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253484    2578 flags.go:64] FLAG: --max-pods="110"
Sep 15 09:14:14.259092 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253487    2578 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 15 09:14:14.259092 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253490    2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 15 09:14:14.259092 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253493    2578 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 15 09:14:14.259092 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253496    2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 15 09:14:14.259092 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253499    2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 15 09:14:14.259092 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253501    2578 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 15 09:14:14.259092 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253504    2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 15 09:14:14.259756 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253512    2578 flags.go:64] FLAG: --node-status-max-images="50"
Sep 15 09:14:14.259756 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253515    2578 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 15 09:14:14.259756 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253519    2578 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 15 09:14:14.259756 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253522    2578 flags.go:64] FLAG: --pod-cidr=""
Sep 15 09:14:14.259756 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253525    2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 15 09:14:14.259756 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253530    2578 flags.go:64] FLAG: --pod-manifest-path=""
Sep 15 09:14:14.259756 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253533    2578 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 15 09:14:14.259756 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253537    2578 flags.go:64] FLAG: --pods-per-core="0"
Sep 15 09:14:14.259756 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253539    2578 flags.go:64] FLAG: --port="10250"
Sep 15 09:14:14.259756 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253542    2578 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 15 09:14:14.259756 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253545    2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-081c20eee851a5de4"
Sep 15 09:14:14.259756 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253549    2578 flags.go:64] FLAG: --qos-reserved=""
Sep 15 09:14:14.259756 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253552    2578 flags.go:64] FLAG: --read-only-port="10255"
Sep 15 09:14:14.259756 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253556    2578 flags.go:64] FLAG: --register-node="true"
Sep 15 09:14:14.259756 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253559    2578 flags.go:64] FLAG: --register-with-taints=""
Sep 15 09:14:14.259756 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253567    2578 flags.go:64] FLAG: --registry-burst="10"
Sep 15 09:14:14.259756 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253570    2578 flags.go:64] FLAG: --registry-qps="5"
Sep 15 09:14:14.259756 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253573    2578 flags.go:64] FLAG: --reserved-cpus=""
Sep 15 09:14:14.259756 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253576    2578 flags.go:64] FLAG: --reserved-memory=""
Sep 15 09:14:14.259756 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253579    2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 15 09:14:14.259756 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253582    2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 15 09:14:14.259756 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253585    2578 flags.go:64] FLAG: --rotate-certificates="false"
Sep 15 09:14:14.259756 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253588    2578 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 15 09:14:14.259756 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253591    2578 flags.go:64] FLAG: --runonce="false"
Sep 15 09:14:14.259756 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253594    2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 15 09:14:14.260374 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253597    2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 15 09:14:14.260374 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253600    2578 flags.go:64] FLAG: --seccomp-default="false"
Sep 15 09:14:14.260374 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253603    2578 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 15 09:14:14.260374 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253605    2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 15 09:14:14.260374 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253608    2578 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 15 09:14:14.260374 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253611    2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 15 09:14:14.260374 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253614    2578 flags.go:64] FLAG: --storage-driver-password="root"
Sep 15 09:14:14.260374 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253617    2578 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 15 09:14:14.260374 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253633    2578 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 15 09:14:14.260374 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253636    2578 flags.go:64] FLAG: --storage-driver-user="root"
Sep 15 09:14:14.260374 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253639    2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 15 09:14:14.260374 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253642    2578 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 15 09:14:14.260374 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253646    2578 flags.go:64] FLAG: --system-cgroups=""
Sep 15 09:14:14.260374 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253650    2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 15 09:14:14.260374 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253655    2578 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 15 09:14:14.260374 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253658    2578 flags.go:64] FLAG: --tls-cert-file=""
Sep 15 09:14:14.260374 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253660    2578 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 15 09:14:14.260374 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253664    2578 flags.go:64] FLAG: --tls-min-version=""
Sep 15 09:14:14.260374 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253667    2578 flags.go:64] FLAG: --tls-private-key-file=""
Sep 15 09:14:14.260374 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253670    2578 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 15 09:14:14.260374 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253675    2578 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 15 09:14:14.260374 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253678    2578 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 15 09:14:14.260374 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253681    2578 flags.go:64] FLAG: --v="2"
Sep 15 09:14:14.260374 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253684    2578 flags.go:64] FLAG: --version="false"
Sep 15 09:14:14.260374 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253688    2578 flags.go:64] FLAG: --vmodule=""
Sep 15 09:14:14.261007 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253692    2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 15 09:14:14.261007 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.253695    2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 15 09:14:14.261007 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253820    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 09:14:14.261007 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253824    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 09:14:14.261007 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253827    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 09:14:14.261007 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253830    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 09:14:14.261007 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253833    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 09:14:14.261007 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253836    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 09:14:14.261007 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253838    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 09:14:14.261007 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253841    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 09:14:14.261007 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253843    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 09:14:14.261007 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253846    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 09:14:14.261007 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253849    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 09:14:14.261007 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253852    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 09:14:14.261007 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253854    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 09:14:14.261007 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253857    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 09:14:14.261007 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253860    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 09:14:14.261007 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253862    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 09:14:14.261007 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253865    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 09:14:14.261007 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253868    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 09:14:14.261500 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253871    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 09:14:14.261500 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253874    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 09:14:14.261500 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253878    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 09:14:14.261500 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253882    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 09:14:14.261500 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253885    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 09:14:14.261500 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253888    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 09:14:14.261500 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253891    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 09:14:14.261500 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253895    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 09:14:14.261500 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253897    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 09:14:14.261500 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253900    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 09:14:14.261500 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253903    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 09:14:14.261500 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253906    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 09:14:14.261500 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253909    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 09:14:14.261500 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253912    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 09:14:14.261500 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253915    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 09:14:14.261500 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253918    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 09:14:14.261500 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253921    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 09:14:14.261500 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253924    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 09:14:14.261500 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253926    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 09:14:14.261500 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253929    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 09:14:14.262013 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253931    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 09:14:14.262013 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253934    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 09:14:14.262013 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253937    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 09:14:14.262013 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253940    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 09:14:14.262013 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253942    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 09:14:14.262013 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253945    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 09:14:14.262013 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253947    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 09:14:14.262013 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253950    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 09:14:14.262013 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253952    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 09:14:14.262013 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253955    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 09:14:14.262013 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253957    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 09:14:14.262013 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253961    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 09:14:14.262013 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253964    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 09:14:14.262013 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253967    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 09:14:14.262013 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253971    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 09:14:14.262013 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253974    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 09:14:14.262013 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253977    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 09:14:14.262013 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253980    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 09:14:14.262013 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253983    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 09:14:14.262485 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253986    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 09:14:14.262485 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253989    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 09:14:14.262485 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253992    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 09:14:14.262485 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253994    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 09:14:14.262485 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.253997    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 09:14:14.262485 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.254000    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 09:14:14.262485 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.254003    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 09:14:14.262485 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.254006    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 09:14:14.262485 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.254008    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 09:14:14.262485 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.254011    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 09:14:14.262485 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.254013    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 09:14:14.262485 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.254016    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 09:14:14.262485 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.254018    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 09:14:14.262485 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.254021    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 09:14:14.262485 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.254024    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 09:14:14.262485 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.254027    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 09:14:14.262485 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.254031    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 09:14:14.262485 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.254033    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 09:14:14.262485 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.254036    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 09:14:14.262974 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.254039    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 09:14:14.262974 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.254041    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 09:14:14.262974 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.254044    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 09:14:14.262974 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.254046    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 09:14:14.262974 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.254049    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 09:14:14.262974 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.254053    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 09:14:14.262974 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.254055    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 09:14:14.262974 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.254058    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 09:14:14.262974 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.254061    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 09:14:14.262974 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.254063    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 09:14:14.262974 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.254066    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 09:14:14.262974 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.254068    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 09:14:14.262974 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.254071    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 09:14:14.262974 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.254075    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 09:14:14.262974 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.254077    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 09:14:14.262974 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.254080    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 09:14:14.262974 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.254083    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 09:14:14.262974 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.254085    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 09:14:14.262974 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.254088    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 09:14:14.262974 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.254090    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 09:14:14.263488 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.254093    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 09:14:14.263488 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.254096    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 09:14:14.263488 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.254099    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 09:14:14.263488 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.254104    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 09:14:14.263488 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.260446    2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 15 09:14:14.263488 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.260461    2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 15 09:14:14.263488 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.261711    2578 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 15 09:14:14.263488 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.261729    2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 15 09:14:14.263488 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261786    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 09:14:14.263488 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261791    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 09:14:14.263488 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261795    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 09:14:14.263488 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261798    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 09:14:14.263488 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261801    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 09:14:14.263488 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261803    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 09:14:14.263488 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261806    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 09:14:14.263888 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261809    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 09:14:14.263888 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261812    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 09:14:14.263888 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261815    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 09:14:14.263888 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261818    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 09:14:14.263888 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261821    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 09:14:14.263888 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261823    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 09:14:14.263888 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261826    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 09:14:14.263888 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261829    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 09:14:14.263888 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261831    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 09:14:14.263888 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261834    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 09:14:14.263888 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261837    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 09:14:14.263888 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261839    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 09:14:14.263888 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261842    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 09:14:14.263888 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261845    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 09:14:14.263888 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261848    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 09:14:14.263888 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261851    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 09:14:14.263888 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261854    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 09:14:14.263888 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261856    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 09:14:14.263888 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261859    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 09:14:14.263888 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261862    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 09:14:14.264366 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261865    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 09:14:14.264366 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261867    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 09:14:14.264366 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261871    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 09:14:14.264366 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261874    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 09:14:14.264366 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261876    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 09:14:14.264366 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261879    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 09:14:14.264366 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261882    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 09:14:14.264366 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261884    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 09:14:14.264366 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261887    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 09:14:14.264366 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261889    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 09:14:14.264366 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261892    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 09:14:14.264366 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261895    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 09:14:14.264366 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261897    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 09:14:14.264366 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261900    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 09:14:14.264366 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261902    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 09:14:14.264366 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261905    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 09:14:14.264366 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261908    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 09:14:14.264366 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261910    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 09:14:14.264366 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261913    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 09:14:14.264848 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261916    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 09:14:14.264848 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261918    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 09:14:14.264848 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261921    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 09:14:14.264848 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261923    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 09:14:14.264848 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261926    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 09:14:14.264848 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261929    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 09:14:14.264848 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261932    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 09:14:14.264848 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261934    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 09:14:14.264848 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261937    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 09:14:14.264848 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261939    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 09:14:14.264848 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261942    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 09:14:14.264848 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261945    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 09:14:14.264848 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261948    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 09:14:14.264848 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261950    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 09:14:14.264848 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261953    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 09:14:14.264848 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261956    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 09:14:14.264848 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261959    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 09:14:14.264848 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261962    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 09:14:14.264848 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261965    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 09:14:14.265303 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261969    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 09:14:14.265303 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261973    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 09:14:14.265303 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261976    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 09:14:14.265303 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261978    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 09:14:14.265303 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261981    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 09:14:14.265303 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261984    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 09:14:14.265303 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261987    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 09:14:14.265303 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261990    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 09:14:14.265303 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261994    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 09:14:14.265303 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.261998    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 09:14:14.265303 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262001    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 09:14:14.265303 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262004    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 09:14:14.265303 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262008    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 09:14:14.265303 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262011    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 09:14:14.265303 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262013    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 09:14:14.265303 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262016    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 09:14:14.265303 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262019    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 09:14:14.265303 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262021    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 09:14:14.265303 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262024    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 09:14:14.265797 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262027    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 09:14:14.265797 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262030    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 09:14:14.265797 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262032    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 09:14:14.265797 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262035    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 09:14:14.265797 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262038    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 09:14:14.265797 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262040    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 09:14:14.265797 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262044    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 09:14:14.265797 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262047    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 09:14:14.265797 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262051    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 09:14:14.265797 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262054    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 09:14:14.265797 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262057    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 09:14:14.265797 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262060    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 09:14:14.265797 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262063    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 09:14:14.265797 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262065    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 09:14:14.265797 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262068    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 09:14:14.266151 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.262073    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 09:14:14.266151 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262180    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 09:14:14.266151 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262183    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 09:14:14.266151 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262186    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 09:14:14.266151 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262189    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 09:14:14.266151 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262192    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 09:14:14.266151 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262195    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 09:14:14.266151 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262213    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 09:14:14.266151 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262218    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 09:14:14.266151 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262221    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 09:14:14.266151 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262224    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 09:14:14.266151 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262227    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 09:14:14.266151 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262230    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 09:14:14.266151 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262233    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 09:14:14.266151 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262236    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 09:14:14.266526 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262238    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 09:14:14.266526 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262241    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 09:14:14.266526 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262243    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 09:14:14.266526 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262246    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 09:14:14.266526 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262249    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 09:14:14.266526 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262251    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 09:14:14.266526 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262254    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 09:14:14.266526 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262257    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 09:14:14.266526 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262259    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 09:14:14.266526 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262262    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 09:14:14.266526 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262265    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 09:14:14.266526 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262268    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 09:14:14.266526 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262270    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 09:14:14.266526 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262273    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 09:14:14.266526 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262276    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 09:14:14.266526 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262279    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 09:14:14.266526 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262281    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 09:14:14.266526 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262284    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 09:14:14.266526 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262286    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 09:14:14.266526 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262289    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 09:14:14.267072 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262291    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 09:14:14.267072 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262294    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 09:14:14.267072 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262296    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 09:14:14.267072 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262299    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 09:14:14.267072 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262301    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 09:14:14.267072 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262304    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 09:14:14.267072 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262308    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 09:14:14.267072 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262311    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 09:14:14.267072 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262314    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 09:14:14.267072 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262317    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 09:14:14.267072 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262319    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 09:14:14.267072 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262322    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 09:14:14.267072 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262324    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 09:14:14.267072 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262327    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 09:14:14.267072 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262329    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 09:14:14.267072 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262332    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 09:14:14.267072 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262334    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 09:14:14.267072 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262336    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 09:14:14.267072 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262339    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 09:14:14.267534 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262342    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 09:14:14.267534 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262344    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 09:14:14.267534 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262347    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 09:14:14.267534 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262350    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 09:14:14.267534 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262353    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 09:14:14.267534 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262355    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 09:14:14.267534 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262357    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 09:14:14.267534 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262360    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 09:14:14.267534 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262363    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 09:14:14.267534 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262365    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 09:14:14.267534 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262368    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 09:14:14.267534 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262370    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 09:14:14.267534 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262373    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 09:14:14.267534 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262375    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 09:14:14.267534 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262378    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 09:14:14.267534 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262381    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 09:14:14.267534 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262383    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 09:14:14.267534 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262386    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 09:14:14.267534 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262388    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 09:14:14.267534 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262391    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 09:14:14.268012 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262393    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 09:14:14.268012 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262395    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 09:14:14.268012 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262398    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 09:14:14.268012 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262400    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 09:14:14.268012 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262403    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 09:14:14.268012 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262405    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 09:14:14.268012 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262408    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 09:14:14.268012 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262411    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 09:14:14.268012 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262413    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 09:14:14.268012 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262415    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 09:14:14.268012 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262418    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 09:14:14.268012 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262421    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 09:14:14.268012 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262423    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 09:14:14.268012 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262427    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 09:14:14.268012 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262430    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 09:14:14.268012 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262434    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 09:14:14.268012 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262437    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 09:14:14.268012 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262440    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 09:14:14.268012 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262443    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 09:14:14.268467 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262446    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 09:14:14.268467 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262448    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 09:14:14.268467 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262451    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 09:14:14.268467 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262454    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 09:14:14.268467 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262456    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 09:14:14.268467 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262459    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 09:14:14.268467 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:14.262461    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 09:14:14.268467 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.262466    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 09:14:14.268467 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.262559    2578 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 15 09:14:14.268467 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.264406    2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 15 09:14:14.268467 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.265193    2578 server.go:1019] "Starting client certificate rotation"
Sep 15 09:14:14.268467 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.265297    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 15 09:14:14.268467 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.265876    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 15 09:14:14.268853 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.267561    2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 15 09:14:14.268853 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.268633    2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 15 09:14:14.278805 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.278790    2578 log.go:25] "Validated CRI v1 runtime API"
Sep 15 09:14:14.282974 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.282957    2578 log.go:25] "Validated CRI v1 image API"
Sep 15 09:14:14.283806 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.283792    2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 15 09:14:14.287994 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.287970    2578 fs.go:135] Filesystem UUIDs: map[3c56c5d8-c954-4249-a4d2-4b8ac882eb62:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 865509a3-39bb-43c8-9734-d9b1850cef69:/dev/nvme0n1p4]
Sep 15 09:14:14.288051 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.287994    2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 15 09:14:14.292284 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.292267    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 15 09:14:14.293549 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.293442    2578 manager.go:216] Machine: {Timestamp:2026-09-15 09:14:14.292252905 +0000 UTC m=+0.301021329 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100995 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b68270a04b16f4066f0617d2aa70f SystemUUID:ec2b6827-0a04-b16f-4066-f0617d2aa70f BootID:deb8a243-37fb-4980-aa2c-f5c996f75198 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:fb:0d:a2:e7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:fb:0d:a2:e7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:aa:ad:d6:f5:bf:e8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 15 09:14:14.293549 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.293543    2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 15 09:14:14.293682 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.293612    2578 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 15 09:14:14.296296 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.296269    2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 15 09:14:14.296427 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.296299    2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-235.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 15 09:14:14.297609 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.297600    2578 topology_manager.go:138] "Creating topology manager with none policy"
Sep 15 09:14:14.297658 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.297612    2578 container_manager_linux.go:309] "Creating device plugin manager"
Sep 15 09:14:14.297658 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.297619    2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 15 09:14:14.298244 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.298234    2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 15 09:14:14.298893 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.298884    2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 15 09:14:14.303056 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.303045    2578 state_mem.go:36] "Initialized new in-memory state store"
Sep 15 09:14:14.303165 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.303156    2578 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 15 09:14:14.303199 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.303183    2578 kubelet.go:486] "Attempting to sync node with API server"
Sep 15 09:14:14.303199 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.303192    2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 15 09:14:14.303252 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.303206    2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 15 09:14:14.303252 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.303214    2578 kubelet.go:398] "Adding apiserver pod source"
Sep 15 09:14:14.303252 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.303223    2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 15 09:14:14.303537 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.303526    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 15 09:14:14.303570 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.303546    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 15 09:14:14.306253 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.306236    2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 15 09:14:14.308177 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.308164    2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 15 09:14:14.308218 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.308194    2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 15 09:14:14.309809 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.309796    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 15 09:14:14.309852 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.309815    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 15 09:14:14.309852 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.309821    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 15 09:14:14.309852 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.309826    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 15 09:14:14.309852 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.309837    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 15 09:14:14.309852 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.309847    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 15 09:14:14.309981 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.309864    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 15 09:14:14.309981 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.309870    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 15 09:14:14.309981 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.309878    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 15 09:14:14.309981 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.309884    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 15 09:14:14.309981 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.309893    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 15 09:14:14.309981 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.309898    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 15 09:14:14.310588 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.310578    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 15 09:14:14.310635 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.310589    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 15 09:14:14.314523 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.314487    2578 server.go:1268] "Started kubelet"
Sep 15 09:14:14.314616 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.314540    2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 15 09:14:14.314703 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.314657    2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 15 09:14:14.314750 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.314731    2578 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 15 09:14:14.314989 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:14.314968    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 15 09:14:14.314989 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.314980    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-235.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 15 09:14:14.315121 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:14.315069    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-235.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 15 09:14:14.315495 ip-10-0-141-235 systemd[1]: Started Kubernetes Kubelet.
Sep 15 09:14:14.315951 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.315934    2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 15 09:14:14.316640 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.316599    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wsg5k"
Sep 15 09:14:14.318056 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.317472    2578 server.go:310] "Adding debug handlers to kubelet server"
Sep 15 09:14:14.318967 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:14.318613    2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 15 09:14:14.321023 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.321009    2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 15 09:14:14.321084 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.321026    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 15 09:14:14.321084 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:14.320158    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-235.ec2.internal.18d573b66de2c300  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-235.ec2.internal,UID:ip-10-0-141-235.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-235.ec2.internal,},FirstTimestamp:2026-09-15 09:14:14.314459904 +0000 UTC m=+0.323228316,LastTimestamp:2026-09-15 09:14:14.314459904 +0000 UTC m=+0.323228316,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-235.ec2.internal,}"
Sep 15 09:14:14.321320 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:14.321296    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-235.ec2.internal\" not found"
Sep 15 09:14:14.322346 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.321955    2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 15 09:14:14.322436 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.322417    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wsg5k"
Sep 15 09:14:14.322570 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.322556    2578 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 15 09:14:14.322680 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.322662    2578 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 15 09:14:14.322897 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.322873    2578 reconstruct.go:97] "Volume reconstruction finished"
Sep 15 09:14:14.322979 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.322969    2578 reconciler.go:29] "Reconciler: start to sync state"
Sep 15 09:14:14.323046 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.323017    2578 factory.go:55] Registering systemd factory
Sep 15 09:14:14.323099 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.323056    2578 factory.go:223] Registration of the systemd container factory successfully
Sep 15 09:14:14.323327 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.323310    2578 factory.go:153] Registering CRI-O factory
Sep 15 09:14:14.323327 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.323327    2578 factory.go:223] Registration of the crio container factory successfully
Sep 15 09:14:14.323464 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.323376    2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 15 09:14:14.323464 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.323396    2578 factory.go:103] Registering Raw factory
Sep 15 09:14:14.323464 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.323410    2578 manager.go:1196] Started watching for new ooms in manager
Sep 15 09:14:14.323860 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.323844    2578 manager.go:349] Starting recovery of all containers
Sep 15 09:14:14.328856 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:14.328821    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 15 09:14:14.328856 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:14.328801    2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-235.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 15 09:14:14.334984 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.334967    2578 manager.go:354] Recovery completed
Sep 15 09:14:14.339475 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.339368    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 09:14:14.342221 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.342206    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-235.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 09:14:14.342296 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.342237    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-235.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 09:14:14.342296 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.342252    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-235.ec2.internal" event="NodeHasSufficientPID"
Sep 15 09:14:14.342921 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.342908    2578 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 15 09:14:14.342921 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.342918    2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 15 09:14:14.343058 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.342935    2578 state_mem.go:36] "Initialized new in-memory state store"
Sep 15 09:14:14.343058 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.342942    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 09:14:14.343645 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.343610    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-235.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 09:14:14.343707 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.343654    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-235.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 09:14:14.343707 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.343664    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-235.ec2.internal" event="NodeHasSufficientPID"
Sep 15 09:14:14.344984 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.344973    2578 policy_none.go:49] "None policy: Start"
Sep 15 09:14:14.345026 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.344988    2578 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 15 09:14:14.345026 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.344998    2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 15 09:14:14.346904 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.346894    2578 policy_none.go:47] "Start"
Sep 15 09:14:14.372290 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.372271    2578 manager.go:337] "Starting Device Plugin manager"
Sep 15 09:14:14.372384 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:14.372302    2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 15 09:14:14.372384 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.372311    2578 server.go:87] "Starting device plugin registration server"
Sep 15 09:14:14.372595 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.372584    2578 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 15 09:14:14.372667 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.372596    2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 15 09:14:14.372724 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.372710    2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 15 09:14:14.372816 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.372784    2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 15 09:14:14.372816 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.372793    2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 15 09:14:14.374397 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:14.373330    2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 15 09:14:14.374397 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:14.373380    2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-235.ec2.internal\" not found"
Sep 15 09:14:14.443346 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.443323    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 15 09:14:14.444441 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.444422    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 15 09:14:14.444522 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.444473    2578 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 15 09:14:14.444522 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.444491    2578 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 15 09:14:14.444617 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:14.444552    2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 15 09:14:14.446846 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.446828    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 09:14:14.473585 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.473566    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 09:14:14.474357 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.474336    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-235.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 09:14:14.474422 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.474366    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-235.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 09:14:14.474422 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.474380    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-235.ec2.internal" event="NodeHasSufficientPID"
Sep 15 09:14:14.474422 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.474405    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-235.ec2.internal"
Sep 15 09:14:14.483140 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.483126    2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-235.ec2.internal"
Sep 15 09:14:14.483217 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:14.483145    2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-235.ec2.internal\": node \"ip-10-0-141-235.ec2.internal\" not found"
Sep 15 09:14:14.497512 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:14.497456    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-235.ec2.internal\" not found"
Sep 15 09:14:14.545390 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.544838    2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-235.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-235.ec2.internal"]
Sep 15 09:14:14.545466 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.545423    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 09:14:14.546187 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.546174    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-235.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 09:14:14.546256 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.546200    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-235.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 09:14:14.546256 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.546215    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-235.ec2.internal" event="NodeHasSufficientPID"
Sep 15 09:14:14.548485 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.548473    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 09:14:14.548605 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.548592    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-235.ec2.internal"
Sep 15 09:14:14.548655 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.548638    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 09:14:14.549134 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.549119    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-235.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 09:14:14.549209 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.549141    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-235.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 09:14:14.549209 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.549142    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-235.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 09:14:14.549209 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.549165    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-235.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 09:14:14.549209 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.549193    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-235.ec2.internal" event="NodeHasSufficientPID"
Sep 15 09:14:14.549355 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.549150    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-235.ec2.internal" event="NodeHasSufficientPID"
Sep 15 09:14:14.551389 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.551374    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-235.ec2.internal"
Sep 15 09:14:14.551444 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.551399    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 09:14:14.552075 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.552062    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-235.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 09:14:14.552160 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.552084    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-235.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 09:14:14.552160 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.552095    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-235.ec2.internal" event="NodeHasSufficientPID"
Sep 15 09:14:14.569135 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:14.569113    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-235.ec2.internal\" not found" node="ip-10-0-141-235.ec2.internal"
Sep 15 09:14:14.572769 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:14.572755    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-235.ec2.internal\" not found" node="ip-10-0-141-235.ec2.internal"
Sep 15 09:14:14.597820 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:14.597803    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-235.ec2.internal\" not found"
Sep 15 09:14:14.624036 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.624020    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/93a9cd305dd93bbe9f79180cbc0e6eaa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-235.ec2.internal\" (UID: \"93a9cd305dd93bbe9f79180cbc0e6eaa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-235.ec2.internal"
Sep 15 09:14:14.624102 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.624041    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93a9cd305dd93bbe9f79180cbc0e6eaa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-235.ec2.internal\" (UID: \"93a9cd305dd93bbe9f79180cbc0e6eaa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-235.ec2.internal"
Sep 15 09:14:14.624102 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.624059    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2b3d6833f74b07abf73dd136dadede80-config\") pod \"kube-apiserver-proxy-ip-10-0-141-235.ec2.internal\" (UID: \"2b3d6833f74b07abf73dd136dadede80\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-235.ec2.internal"
Sep 15 09:14:14.698598 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:14.698575    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-235.ec2.internal\" not found"
Sep 15 09:14:14.724954 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.724934    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2b3d6833f74b07abf73dd136dadede80-config\") pod \"kube-apiserver-proxy-ip-10-0-141-235.ec2.internal\" (UID: \"2b3d6833f74b07abf73dd136dadede80\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-235.ec2.internal"
Sep 15 09:14:14.725023 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.724958    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/93a9cd305dd93bbe9f79180cbc0e6eaa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-235.ec2.internal\" (UID: \"93a9cd305dd93bbe9f79180cbc0e6eaa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-235.ec2.internal"
Sep 15 09:14:14.725023 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.724974    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93a9cd305dd93bbe9f79180cbc0e6eaa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-235.ec2.internal\" (UID: \"93a9cd305dd93bbe9f79180cbc0e6eaa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-235.ec2.internal"
Sep 15 09:14:14.725117 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.725023    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93a9cd305dd93bbe9f79180cbc0e6eaa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-235.ec2.internal\" (UID: \"93a9cd305dd93bbe9f79180cbc0e6eaa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-235.ec2.internal"
Sep 15 09:14:14.725117 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.725028    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2b3d6833f74b07abf73dd136dadede80-config\") pod \"kube-apiserver-proxy-ip-10-0-141-235.ec2.internal\" (UID: \"2b3d6833f74b07abf73dd136dadede80\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-235.ec2.internal"
Sep 15 09:14:14.725117 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.725064    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/93a9cd305dd93bbe9f79180cbc0e6eaa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-235.ec2.internal\" (UID: \"93a9cd305dd93bbe9f79180cbc0e6eaa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-235.ec2.internal"
Sep 15 09:14:14.799233 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:14.799193    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-235.ec2.internal\" not found"
Sep 15 09:14:14.871748 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.871719    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-235.ec2.internal"
Sep 15 09:14:14.874848 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:14.874833    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-235.ec2.internal"
Sep 15 09:14:14.899476 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:14.899458    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-235.ec2.internal\" not found"
Sep 15 09:14:14.999974 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:14.999951    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-235.ec2.internal\" not found"
Sep 15 09:14:16.770755 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:16.770702    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-235.ec2.internal\" not found"
Sep 15 09:14:16.846030 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:16.846006    2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 09:14:16.892719 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:16.892700    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-235.ec2.internal"
Sep 15 09:14:16.902748 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:16.902732    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 15 09:14:16.904370 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:16.904355    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-235.ec2.internal"
Sep 15 09:14:16.912259 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:16.912245    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 15 09:14:16.935440 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:16.935410    2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 15 09:14:16.935822 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:16.935539    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 15 09:14:16.935822 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:16.935585    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 15 09:14:16.973718 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:16.973699    2578 apiserver.go:52] "Watching apiserver"
Sep 15 09:14:16.990048 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:16.990028    2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 15 09:14:16.991517 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:16.991494    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-l8z2g","openshift-dns/node-resolver-6lwmm","openshift-image-registry/node-ca-n5h5g","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-235.ec2.internal","openshift-multus/multus-xqglj","openshift-multus/network-metrics-daemon-fpphv","kube-system/global-pull-secret-syncer-hqkrc","kube-system/kube-apiserver-proxy-ip-10-0-141-235.ec2.internal","openshift-multus/multus-additional-cni-plugins-826mj","openshift-network-diagnostics/network-check-target-pbttq","openshift-network-operator/iptables-alerter-jclv4","openshift-ovn-kubernetes/ovnkube-node-gp58d","kube-system/konnectivity-agent-nhzm4","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvbsm"]
Sep 15 09:14:16.991517 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:16.991514    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 15 09:14:16.993836 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:16.993817    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-l8z2g"
Sep 15 09:14:16.995755 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:16.995724    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6lwmm"
Sep 15 09:14:16.996114 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:16.996089    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 15 09:14:16.996202 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:16.996114    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 15 09:14:16.996202 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:16.996163    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lf54r\""
Sep 15 09:14:16.997296 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:16.997276    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/689f5a38-1aeb-44ed-a218-7217946655d0-run\") pod \"tuned-l8z2g\" (UID: \"689f5a38-1aeb-44ed-a218-7217946655d0\") " pod="openshift-cluster-node-tuning-operator/tuned-l8z2g"
Sep 15 09:14:16.997375 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:16.997308    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/689f5a38-1aeb-44ed-a218-7217946655d0-tmp\") pod \"tuned-l8z2g\" (UID: \"689f5a38-1aeb-44ed-a218-7217946655d0\") " pod="openshift-cluster-node-tuning-operator/tuned-l8z2g"
Sep 15 09:14:16.997375 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:16.997327    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/689f5a38-1aeb-44ed-a218-7217946655d0-etc-modprobe-d\") pod \"tuned-l8z2g\" (UID: \"689f5a38-1aeb-44ed-a218-7217946655d0\") " pod="openshift-cluster-node-tuning-operator/tuned-l8z2g"
Sep 15 09:14:16.997375 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:16.997349    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/689f5a38-1aeb-44ed-a218-7217946655d0-etc-sysconfig\") pod \"tuned-l8z2g\" (UID: \"689f5a38-1aeb-44ed-a218-7217946655d0\") " pod="openshift-cluster-node-tuning-operator/tuned-l8z2g"
Sep 15 09:14:16.997375 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:16.997369    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/689f5a38-1aeb-44ed-a218-7217946655d0-etc-systemd\") pod \"tuned-l8z2g\" (UID: \"689f5a38-1aeb-44ed-a218-7217946655d0\") " pod="openshift-cluster-node-tuning-operator/tuned-l8z2g"
Sep 15 09:14:16.997500 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:16.997370    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-14 09:09:15 +0000 UTC" deadline="2028-04-25 07:58:48.030776553 +0000 UTC"
Sep 15 09:14:16.997500 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:16.997389    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/689f5a38-1aeb-44ed-a218-7217946655d0-var-lib-kubelet\") pod \"tuned-l8z2g\" (UID: \"689f5a38-1aeb-44ed-a218-7217946655d0\") " pod="openshift-cluster-node-tuning-operator/tuned-l8z2g"
Sep 15 09:14:16.997500 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:16.997407    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djnrm\" (UniqueName: \"kubernetes.io/projected/689f5a38-1aeb-44ed-a218-7217946655d0-kube-api-access-djnrm\") pod \"tuned-l8z2g\" (UID: \"689f5a38-1aeb-44ed-a218-7217946655d0\") " pod="openshift-cluster-node-tuning-operator/tuned-l8z2g"
Sep 15 09:14:16.997500 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:16.997391    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14110h44m31.033387893s"
Sep 15 09:14:16.997500 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:16.997422    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/689f5a38-1aeb-44ed-a218-7217946655d0-etc-kubernetes\") pod \"tuned-l8z2g\" (UID: \"689f5a38-1aeb-44ed-a218-7217946655d0\") " pod="openshift-cluster-node-tuning-operator/tuned-l8z2g"
Sep 15 09:14:16.997500 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:16.997436    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/689f5a38-1aeb-44ed-a218-7217946655d0-etc-sysctl-d\") pod \"tuned-l8z2g\" (UID: \"689f5a38-1aeb-44ed-a218-7217946655d0\") " pod="openshift-cluster-node-tuning-operator/tuned-l8z2g"
Sep 15 09:14:16.997500 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:16.997450    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/689f5a38-1aeb-44ed-a218-7217946655d0-etc-sysctl-conf\") pod \"tuned-l8z2g\" (UID: \"689f5a38-1aeb-44ed-a218-7217946655d0\") " pod="openshift-cluster-node-tuning-operator/tuned-l8z2g"
Sep 15 09:14:16.997500 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:16.997464    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/689f5a38-1aeb-44ed-a218-7217946655d0-sys\") pod \"tuned-l8z2g\" (UID: \"689f5a38-1aeb-44ed-a218-7217946655d0\") " pod="openshift-cluster-node-tuning-operator/tuned-l8z2g"
Sep 15 09:14:16.997500 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:16.997476    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/689f5a38-1aeb-44ed-a218-7217946655d0-lib-modules\") pod \"tuned-l8z2g\" (UID: \"689f5a38-1aeb-44ed-a218-7217946655d0\") " pod="openshift-cluster-node-tuning-operator/tuned-l8z2g"
Sep 15 09:14:16.997783 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:16.997489    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/689f5a38-1aeb-44ed-a218-7217946655d0-host\") pod \"tuned-l8z2g\" (UID: \"689f5a38-1aeb-44ed-a218-7217946655d0\") " pod="openshift-cluster-node-tuning-operator/tuned-l8z2g"
Sep 15 09:14:16.997783 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:16.997534    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/689f5a38-1aeb-44ed-a218-7217946655d0-etc-tuned\") pod \"tuned-l8z2g\" (UID: \"689f5a38-1aeb-44ed-a218-7217946655d0\") " pod="openshift-cluster-node-tuning-operator/tuned-l8z2g"
Sep 15 09:14:16.997783 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:16.997770    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 15 09:14:16.997888 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:16.997864    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-42mjt\""
Sep 15 09:14:16.997940 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:16.997866    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-n5h5g"
Sep 15 09:14:16.998275 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:16.998257    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 15 09:14:16.999700 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:16.999683    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 15 09:14:17.000094 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.000069    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 15 09:14:17.000193 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.000077    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-p5bs7\""
Sep 15 09:14:17.000193 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.000143    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xqglj"
Sep 15 09:14:17.000313 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.000077    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 15 09:14:17.001049 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.001029    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 15 09:14:17.003445 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.002382    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 15 09:14:17.003445 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.002474    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wc8sf\""
Sep 15 09:14:17.003445 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.002736    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 15 09:14:17.003445 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.002779    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 15 09:14:17.003445 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.003082    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 15 09:14:17.004054 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.004029    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpphv"
Sep 15 09:14:17.004125 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:17.004108    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fpphv" podUID="5e176b54-2fe2-4b90-ae2b-f66860907acf"
Sep 15 09:14:17.006147 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.006133    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hqkrc"
Sep 15 09:14:17.006209 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:17.006178    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hqkrc" podUID="4d4126b6-996d-46d2-8abe-9fb14423f0ac"
Sep 15 09:14:17.008278 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.008264    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-826mj"
Sep 15 09:14:17.010998 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.010411    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbttq"
Sep 15 09:14:17.010998 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:17.010478    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pbttq" podUID="a457ba28-efbe-4cdf-b186-edbf98e80297"
Sep 15 09:14:17.010998 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.010833    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 15 09:14:17.011162 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.011039    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 15 09:14:17.011162 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.011145    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4qx6q\""
Sep 15 09:14:17.012722 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.012704    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jclv4"
Sep 15 09:14:17.015054 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.015032    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.015512 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.015494    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 15 09:14:17.015635 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.015618    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 15 09:14:17.015773 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.015752    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 15 09:14:17.015814 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.015782    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-nc57z\""
Sep 15 09:14:17.017230 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.017214    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nhzm4"
Sep 15 09:14:17.017864 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.017841    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 15 09:14:17.018094 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.018075    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 15 09:14:17.019238 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.019219    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 15 09:14:17.019337 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.019320    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvbsm"
Sep 15 09:14:17.019397 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.019349    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bv2fs\""
Sep 15 09:14:17.019397 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.019354    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 15 09:14:17.019397 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.019388    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 15 09:14:17.019543 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.019464    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 15 09:14:17.019603 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.019588    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 15 09:14:17.019782 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.019767    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 15 09:14:17.020216 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.020201    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-5zcnz\""
Sep 15 09:14:17.022637 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.022591    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 15 09:14:17.022724 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.022686    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-k4xkq\""
Sep 15 09:14:17.023027 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.023010    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 15 09:14:17.023152 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.023137    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 15 09:14:17.024262 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.024246    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5f86j"
Sep 15 09:14:17.033802 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.033785    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5f86j"
Sep 15 09:14:17.093598 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.093576    2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 15 09:14:17.097937 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.097918    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djnrm\" (UniqueName: \"kubernetes.io/projected/689f5a38-1aeb-44ed-a218-7217946655d0-kube-api-access-djnrm\") pod \"tuned-l8z2g\" (UID: \"689f5a38-1aeb-44ed-a218-7217946655d0\") " pod="openshift-cluster-node-tuning-operator/tuned-l8z2g"
Sep 15 09:14:17.098043 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.097960    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ebbb215c-b019-4a5f-933a-7614daf7e777-ovnkube-script-lib\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.098043 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.097980    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/79960bdd-9148-4e6c-8cec-189f5b35b25f-host-var-lib-cni-bin\") pod \"multus-xqglj\" (UID: \"79960bdd-9148-4e6c-8cec-189f5b35b25f\") " pod="openshift-multus/multus-xqglj"
Sep 15 09:14:17.098043 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.097995    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/79960bdd-9148-4e6c-8cec-189f5b35b25f-multus-conf-dir\") pod \"multus-xqglj\" (UID: \"79960bdd-9148-4e6c-8cec-189f5b35b25f\") " pod="openshift-multus/multus-xqglj"
Sep 15 09:14:17.098043 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.098009    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79960bdd-9148-4e6c-8cec-189f5b35b25f-etc-kubernetes\") pod \"multus-xqglj\" (UID: \"79960bdd-9148-4e6c-8cec-189f5b35b25f\") " pod="openshift-multus/multus-xqglj"
Sep 15 09:14:17.098043 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.098025    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/689f5a38-1aeb-44ed-a218-7217946655d0-etc-sysctl-conf\") pod \"tuned-l8z2g\" (UID: \"689f5a38-1aeb-44ed-a218-7217946655d0\") " pod="openshift-cluster-node-tuning-operator/tuned-l8z2g"
Sep 15 09:14:17.098312 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.098044    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z42gt\" (UniqueName: \"kubernetes.io/projected/5e176b54-2fe2-4b90-ae2b-f66860907acf-kube-api-access-z42gt\") pod \"network-metrics-daemon-fpphv\" (UID: \"5e176b54-2fe2-4b90-ae2b-f66860907acf\") " pod="openshift-multus/network-metrics-daemon-fpphv"
Sep 15 09:14:17.098312 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.098068    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/552c9685-d39f-40b0-8f8d-79ba6b12fee7-agent-certs\") pod \"konnectivity-agent-nhzm4\" (UID: \"552c9685-d39f-40b0-8f8d-79ba6b12fee7\") " pod="kube-system/konnectivity-agent-nhzm4"
Sep 15 09:14:17.098312 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.098108    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/689f5a38-1aeb-44ed-a218-7217946655d0-sys\") pod \"tuned-l8z2g\" (UID: \"689f5a38-1aeb-44ed-a218-7217946655d0\") " pod="openshift-cluster-node-tuning-operator/tuned-l8z2g"
Sep 15 09:14:17.098312 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.098168    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwrpd\" (UniqueName: \"kubernetes.io/projected/ebbb215c-b019-4a5f-933a-7614daf7e777-kube-api-access-jwrpd\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.098312 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.098198    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4e289063-8e66-4409-acff-6154b0ddae94-sys-fs\") pod \"aws-ebs-csi-driver-node-lvbsm\" (UID: \"4e289063-8e66-4409-acff-6154b0ddae94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvbsm"
Sep 15 09:14:17.098312 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.098196    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/689f5a38-1aeb-44ed-a218-7217946655d0-etc-sysctl-conf\") pod \"tuned-l8z2g\" (UID: \"689f5a38-1aeb-44ed-a218-7217946655d0\") " pod="openshift-cluster-node-tuning-operator/tuned-l8z2g"
Sep 15 09:14:17.098312 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.098212    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/689f5a38-1aeb-44ed-a218-7217946655d0-sys\") pod \"tuned-l8z2g\" (UID: \"689f5a38-1aeb-44ed-a218-7217946655d0\") " pod="openshift-cluster-node-tuning-operator/tuned-l8z2g"
Sep 15 09:14:17.098312 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.098225    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b0fcbbe-ae50-4282-ab2f-3d85fc2457a7-tmp-dir\") pod \"node-resolver-6lwmm\" (UID: \"5b0fcbbe-ae50-4282-ab2f-3d85fc2457a7\") " pod="openshift-dns/node-resolver-6lwmm"
Sep 15 09:14:17.098312 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.098250    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/60e02ffe-03b0-4ac9-b5d0-492856f7d07a-host\") pod \"node-ca-n5h5g\" (UID: \"60e02ffe-03b0-4ac9-b5d0-492856f7d07a\") " pod="openshift-image-registry/node-ca-n5h5g"
Sep 15 09:14:17.098312 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.098277    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/689f5a38-1aeb-44ed-a218-7217946655d0-tmp\") pod \"tuned-l8z2g\" (UID: \"689f5a38-1aeb-44ed-a218-7217946655d0\") " pod="openshift-cluster-node-tuning-operator/tuned-l8z2g"
Sep 15 09:14:17.098312 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.098298    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsfjm\" (UniqueName: \"kubernetes.io/projected/60e02ffe-03b0-4ac9-b5d0-492856f7d07a-kube-api-access-lsfjm\") pod \"node-ca-n5h5g\" (UID: \"60e02ffe-03b0-4ac9-b5d0-492856f7d07a\") " pod="openshift-image-registry/node-ca-n5h5g"
Sep 15 09:14:17.098719 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.098331    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/79960bdd-9148-4e6c-8cec-189f5b35b25f-host-run-netns\") pod \"multus-xqglj\" (UID: \"79960bdd-9148-4e6c-8cec-189f5b35b25f\") " pod="openshift-multus/multus-xqglj"
Sep 15 09:14:17.098719 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.098357    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/689f5a38-1aeb-44ed-a218-7217946655d0-etc-modprobe-d\") pod \"tuned-l8z2g\" (UID: \"689f5a38-1aeb-44ed-a218-7217946655d0\") " pod="openshift-cluster-node-tuning-operator/tuned-l8z2g"
Sep 15 09:14:17.098719 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.098379    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/689f5a38-1aeb-44ed-a218-7217946655d0-etc-systemd\") pod \"tuned-l8z2g\" (UID: \"689f5a38-1aeb-44ed-a218-7217946655d0\") " pod="openshift-cluster-node-tuning-operator/tuned-l8z2g"
Sep 15 09:14:17.098719 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.098400    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/621cf06d-684f-4bbb-a194-d944fa6d1752-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-826mj\" (UID: \"621cf06d-684f-4bbb-a194-d944fa6d1752\") " pod="openshift-multus/multus-additional-cni-plugins-826mj"
Sep 15 09:14:17.098719 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.098422    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebbb215c-b019-4a5f-933a-7614daf7e777-host-kubelet\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.098719 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.098444    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ebbb215c-b019-4a5f-933a-7614daf7e777-host-cni-netd\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.098719 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.098466    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/60e02ffe-03b0-4ac9-b5d0-492856f7d07a-serviceca\") pod \"node-ca-n5h5g\" (UID: \"60e02ffe-03b0-4ac9-b5d0-492856f7d07a\") " pod="openshift-image-registry/node-ca-n5h5g"
Sep 15 09:14:17.098719 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.098467    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/689f5a38-1aeb-44ed-a218-7217946655d0-etc-systemd\") pod \"tuned-l8z2g\" (UID: \"689f5a38-1aeb-44ed-a218-7217946655d0\") " pod="openshift-cluster-node-tuning-operator/tuned-l8z2g"
Sep 15 09:14:17.098719 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.098495    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/79960bdd-9148-4e6c-8cec-189f5b35b25f-multus-cni-dir\") pod \"multus-xqglj\" (UID: \"79960bdd-9148-4e6c-8cec-189f5b35b25f\") " pod="openshift-multus/multus-xqglj"
Sep 15 09:14:17.098719 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.098505    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/689f5a38-1aeb-44ed-a218-7217946655d0-etc-modprobe-d\") pod \"tuned-l8z2g\" (UID: \"689f5a38-1aeb-44ed-a218-7217946655d0\") " pod="openshift-cluster-node-tuning-operator/tuned-l8z2g"
Sep 15 09:14:17.098719 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.098518    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/79960bdd-9148-4e6c-8cec-189f5b35b25f-multus-socket-dir-parent\") pod \"multus-xqglj\" (UID: \"79960bdd-9148-4e6c-8cec-189f5b35b25f\") " pod="openshift-multus/multus-xqglj"
Sep 15 09:14:17.098719 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.098543    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/621cf06d-684f-4bbb-a194-d944fa6d1752-cni-binary-copy\") pod \"multus-additional-cni-plugins-826mj\" (UID: \"621cf06d-684f-4bbb-a194-d944fa6d1752\") " pod="openshift-multus/multus-additional-cni-plugins-826mj"
Sep 15 09:14:17.098719 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.098564    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6c49d708-0bbc-445a-baf3-03b239d8dd04-host-slash\") pod \"iptables-alerter-jclv4\" (UID: \"6c49d708-0bbc-445a-baf3-03b239d8dd04\") " pod="openshift-network-operator/iptables-alerter-jclv4"
Sep 15 09:14:17.098719 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.098610    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ebbb215c-b019-4a5f-933a-7614daf7e777-run-ovn\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.098719 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.098615    2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 15 09:14:17.098719 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.098641    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ebbb215c-b019-4a5f-933a-7614daf7e777-ovn-node-metrics-cert\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.098719 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.098664    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/552c9685-d39f-40b0-8f8d-79ba6b12fee7-konnectivity-ca\") pod \"konnectivity-agent-nhzm4\" (UID: \"552c9685-d39f-40b0-8f8d-79ba6b12fee7\") " pod="kube-system/konnectivity-agent-nhzm4"
Sep 15 09:14:17.099541 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.098684    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4e289063-8e66-4409-acff-6154b0ddae94-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lvbsm\" (UID: \"4e289063-8e66-4409-acff-6154b0ddae94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvbsm"
Sep 15 09:14:17.099541 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.098704    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/79960bdd-9148-4e6c-8cec-189f5b35b25f-system-cni-dir\") pod \"multus-xqglj\" (UID: \"79960bdd-9148-4e6c-8cec-189f5b35b25f\") " pod="openshift-multus/multus-xqglj"
Sep 15 09:14:17.099541 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.098729    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/79960bdd-9148-4e6c-8cec-189f5b35b25f-host-run-k8s-cni-cncf-io\") pod \"multus-xqglj\" (UID: \"79960bdd-9148-4e6c-8cec-189f5b35b25f\") " pod="openshift-multus/multus-xqglj"
Sep 15 09:14:17.099541 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.098765    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/689f5a38-1aeb-44ed-a218-7217946655d0-host\") pod \"tuned-l8z2g\" (UID: \"689f5a38-1aeb-44ed-a218-7217946655d0\") " pod="openshift-cluster-node-tuning-operator/tuned-l8z2g"
Sep 15 09:14:17.099541 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.098795    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/689f5a38-1aeb-44ed-a218-7217946655d0-etc-tuned\") pod \"tuned-l8z2g\" (UID: \"689f5a38-1aeb-44ed-a218-7217946655d0\") " pod="openshift-cluster-node-tuning-operator/tuned-l8z2g"
Sep 15 09:14:17.099541 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.098821    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e176b54-2fe2-4b90-ae2b-f66860907acf-metrics-certs\") pod \"network-metrics-daemon-fpphv\" (UID: \"5e176b54-2fe2-4b90-ae2b-f66860907acf\") " pod="openshift-multus/network-metrics-daemon-fpphv"
Sep 15 09:14:17.099541 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.098848    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/621cf06d-684f-4bbb-a194-d944fa6d1752-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-826mj\" (UID: \"621cf06d-684f-4bbb-a194-d944fa6d1752\") " pod="openshift-multus/multus-additional-cni-plugins-826mj"
Sep 15 09:14:17.099541 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.098861    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/689f5a38-1aeb-44ed-a218-7217946655d0-host\") pod \"tuned-l8z2g\" (UID: \"689f5a38-1aeb-44ed-a218-7217946655d0\") " pod="openshift-cluster-node-tuning-operator/tuned-l8z2g"
Sep 15 09:14:17.099541 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.098964    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ebbb215c-b019-4a5f-933a-7614daf7e777-ovnkube-config\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.099541 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.098993    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/79960bdd-9148-4e6c-8cec-189f5b35b25f-multus-daemon-config\") pod \"multus-xqglj\" (UID: \"79960bdd-9148-4e6c-8cec-189f5b35b25f\") " pod="openshift-multus/multus-xqglj"
Sep 15 09:14:17.099541 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.099016    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/79960bdd-9148-4e6c-8cec-189f5b35b25f-host-run-multus-certs\") pod \"multus-xqglj\" (UID: \"79960bdd-9148-4e6c-8cec-189f5b35b25f\") " pod="openshift-multus/multus-xqglj"
Sep 15 09:14:17.099541 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.099043    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/621cf06d-684f-4bbb-a194-d944fa6d1752-system-cni-dir\") pod \"multus-additional-cni-plugins-826mj\" (UID: \"621cf06d-684f-4bbb-a194-d944fa6d1752\") " pod="openshift-multus/multus-additional-cni-plugins-826mj"
Sep 15 09:14:17.099541 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.099066    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ebbb215c-b019-4a5f-933a-7614daf7e777-systemd-units\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.099541 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.099089    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4e289063-8e66-4409-acff-6154b0ddae94-socket-dir\") pod \"aws-ebs-csi-driver-node-lvbsm\" (UID: \"4e289063-8e66-4409-acff-6154b0ddae94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvbsm"
Sep 15 09:14:17.099541 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.099115    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/689f5a38-1aeb-44ed-a218-7217946655d0-etc-sysconfig\") pod \"tuned-l8z2g\" (UID: \"689f5a38-1aeb-44ed-a218-7217946655d0\") " pod="openshift-cluster-node-tuning-operator/tuned-l8z2g"
Sep 15 09:14:17.099541 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.099140    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/689f5a38-1aeb-44ed-a218-7217946655d0-var-lib-kubelet\") pod \"tuned-l8z2g\" (UID: \"689f5a38-1aeb-44ed-a218-7217946655d0\") " pod="openshift-cluster-node-tuning-operator/tuned-l8z2g"
Sep 15 09:14:17.100246 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.099163    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4x8f\" (UniqueName: \"kubernetes.io/projected/621cf06d-684f-4bbb-a194-d944fa6d1752-kube-api-access-c4x8f\") pod \"multus-additional-cni-plugins-826mj\" (UID: \"621cf06d-684f-4bbb-a194-d944fa6d1752\") " pod="openshift-multus/multus-additional-cni-plugins-826mj"
Sep 15 09:14:17.100246 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.099189    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6c49d708-0bbc-445a-baf3-03b239d8dd04-iptables-alerter-script\") pod \"iptables-alerter-jclv4\" (UID: \"6c49d708-0bbc-445a-baf3-03b239d8dd04\") " pod="openshift-network-operator/iptables-alerter-jclv4"
Sep 15 09:14:17.100246 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.099208    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/689f5a38-1aeb-44ed-a218-7217946655d0-etc-sysconfig\") pod \"tuned-l8z2g\" (UID: \"689f5a38-1aeb-44ed-a218-7217946655d0\") " pod="openshift-cluster-node-tuning-operator/tuned-l8z2g"
Sep 15 09:14:17.100246 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.099211    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ebbb215c-b019-4a5f-933a-7614daf7e777-run-systemd\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.100246 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.099226    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/689f5a38-1aeb-44ed-a218-7217946655d0-var-lib-kubelet\") pod \"tuned-l8z2g\" (UID: \"689f5a38-1aeb-44ed-a218-7217946655d0\") " pod="openshift-cluster-node-tuning-operator/tuned-l8z2g"
Sep 15 09:14:17.100246 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.099251    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ebbb215c-b019-4a5f-933a-7614daf7e777-node-log\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.100246 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.099289    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/79960bdd-9148-4e6c-8cec-189f5b35b25f-hostroot\") pod \"multus-xqglj\" (UID: \"79960bdd-9148-4e6c-8cec-189f5b35b25f\") " pod="openshift-multus/multus-xqglj"
Sep 15 09:14:17.100246 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.099329    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/689f5a38-1aeb-44ed-a218-7217946655d0-etc-kubernetes\") pod \"tuned-l8z2g\" (UID: \"689f5a38-1aeb-44ed-a218-7217946655d0\") " pod="openshift-cluster-node-tuning-operator/tuned-l8z2g"
Sep 15 09:14:17.100246 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.099358    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebbb215c-b019-4a5f-933a-7614daf7e777-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.100246 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.099383    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/79960bdd-9148-4e6c-8cec-189f5b35b25f-host-var-lib-cni-multus\") pod \"multus-xqglj\" (UID: \"79960bdd-9148-4e6c-8cec-189f5b35b25f\") " pod="openshift-multus/multus-xqglj"
Sep 15 09:14:17.100246 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.099409    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/689f5a38-1aeb-44ed-a218-7217946655d0-lib-modules\") pod \"tuned-l8z2g\" (UID: \"689f5a38-1aeb-44ed-a218-7217946655d0\") " pod="openshift-cluster-node-tuning-operator/tuned-l8z2g"
Sep 15 09:14:17.100246 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.099446    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d4126b6-996d-46d2-8abe-9fb14423f0ac-original-pull-secret\") pod \"global-pull-secret-syncer-hqkrc\" (UID: \"4d4126b6-996d-46d2-8abe-9fb14423f0ac\") " pod="kube-system/global-pull-secret-syncer-hqkrc"
Sep 15 09:14:17.100246 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.099463    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/689f5a38-1aeb-44ed-a218-7217946655d0-etc-kubernetes\") pod \"tuned-l8z2g\" (UID: \"689f5a38-1aeb-44ed-a218-7217946655d0\") " pod="openshift-cluster-node-tuning-operator/tuned-l8z2g"
Sep 15 09:14:17.100246 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.099474    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/621cf06d-684f-4bbb-a194-d944fa6d1752-tuning-conf-dir\") pod \"multus-additional-cni-plugins-826mj\" (UID: \"621cf06d-684f-4bbb-a194-d944fa6d1752\") " pod="openshift-multus/multus-additional-cni-plugins-826mj"
Sep 15 09:14:17.100246 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.099493    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/689f5a38-1aeb-44ed-a218-7217946655d0-lib-modules\") pod \"tuned-l8z2g\" (UID: \"689f5a38-1aeb-44ed-a218-7217946655d0\") " pod="openshift-cluster-node-tuning-operator/tuned-l8z2g"
Sep 15 09:14:17.100246 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.099504    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebbb215c-b019-4a5f-933a-7614daf7e777-host-run-ovn-kubernetes\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.100866 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.099525    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ebbb215c-b019-4a5f-933a-7614daf7e777-env-overrides\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.100866 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.099544    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4e289063-8e66-4409-acff-6154b0ddae94-registration-dir\") pod \"aws-ebs-csi-driver-node-lvbsm\" (UID: \"4e289063-8e66-4409-acff-6154b0ddae94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvbsm"
Sep 15 09:14:17.100866 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.099565    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4e289063-8e66-4409-acff-6154b0ddae94-etc-selinux\") pod \"aws-ebs-csi-driver-node-lvbsm\" (UID: \"4e289063-8e66-4409-acff-6154b0ddae94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvbsm"
Sep 15 09:14:17.100866 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.099584    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/79960bdd-9148-4e6c-8cec-189f5b35b25f-cnibin\") pod \"multus-xqglj\" (UID: \"79960bdd-9148-4e6c-8cec-189f5b35b25f\") " pod="openshift-multus/multus-xqglj"
Sep 15 09:14:17.100866 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.099605    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/689f5a38-1aeb-44ed-a218-7217946655d0-run\") pod \"tuned-l8z2g\" (UID: \"689f5a38-1aeb-44ed-a218-7217946655d0\") " pod="openshift-cluster-node-tuning-operator/tuned-l8z2g"
Sep 15 09:14:17.100866 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.099626    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9smf\" (UniqueName: \"kubernetes.io/projected/a457ba28-efbe-4cdf-b186-edbf98e80297-kube-api-access-p9smf\") pod \"network-check-target-pbttq\" (UID: \"a457ba28-efbe-4cdf-b186-edbf98e80297\") " pod="openshift-network-diagnostics/network-check-target-pbttq"
Sep 15 09:14:17.100866 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.099646    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ebbb215c-b019-4a5f-933a-7614daf7e777-run-openvswitch\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.100866 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.099664    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5b0fcbbe-ae50-4282-ab2f-3d85fc2457a7-hosts-file\") pod \"node-resolver-6lwmm\" (UID: \"5b0fcbbe-ae50-4282-ab2f-3d85fc2457a7\") " pod="openshift-dns/node-resolver-6lwmm"
Sep 15 09:14:17.100866 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.099683    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbvxb\" (UniqueName: \"kubernetes.io/projected/5b0fcbbe-ae50-4282-ab2f-3d85fc2457a7-kube-api-access-wbvxb\") pod \"node-resolver-6lwmm\" (UID: \"5b0fcbbe-ae50-4282-ab2f-3d85fc2457a7\") " pod="openshift-dns/node-resolver-6lwmm"
Sep 15 09:14:17.100866 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.099668    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/689f5a38-1aeb-44ed-a218-7217946655d0-run\") pod \"tuned-l8z2g\" (UID: \"689f5a38-1aeb-44ed-a218-7217946655d0\") " pod="openshift-cluster-node-tuning-operator/tuned-l8z2g"
Sep 15 09:14:17.100866 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.099709    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/79960bdd-9148-4e6c-8cec-189f5b35b25f-cni-binary-copy\") pod \"multus-xqglj\" (UID: \"79960bdd-9148-4e6c-8cec-189f5b35b25f\") " pod="openshift-multus/multus-xqglj"
Sep 15 09:14:17.100866 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.099761    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4d4126b6-996d-46d2-8abe-9fb14423f0ac-dbus\") pod \"global-pull-secret-syncer-hqkrc\" (UID: \"4d4126b6-996d-46d2-8abe-9fb14423f0ac\") " pod="kube-system/global-pull-secret-syncer-hqkrc"
Sep 15 09:14:17.100866 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.099787    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/79960bdd-9148-4e6c-8cec-189f5b35b25f-host-var-lib-kubelet\") pod \"multus-xqglj\" (UID: \"79960bdd-9148-4e6c-8cec-189f5b35b25f\") " pod="openshift-multus/multus-xqglj"
Sep 15 09:14:17.100866 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.099816    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/689f5a38-1aeb-44ed-a218-7217946655d0-etc-sysctl-d\") pod \"tuned-l8z2g\" (UID: \"689f5a38-1aeb-44ed-a218-7217946655d0\") " pod="openshift-cluster-node-tuning-operator/tuned-l8z2g"
Sep 15 09:14:17.100866 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.099839    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ebbb215c-b019-4a5f-933a-7614daf7e777-var-lib-openvswitch\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.100866 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.099859    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ebbb215c-b019-4a5f-933a-7614daf7e777-host-cni-bin\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.100866 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.099880    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4e289063-8e66-4409-acff-6154b0ddae94-device-dir\") pod \"aws-ebs-csi-driver-node-lvbsm\" (UID: \"4e289063-8e66-4409-acff-6154b0ddae94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvbsm"
Sep 15 09:14:17.101532 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.099902    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgcpf\" (UniqueName: \"kubernetes.io/projected/4e289063-8e66-4409-acff-6154b0ddae94-kube-api-access-cgcpf\") pod \"aws-ebs-csi-driver-node-lvbsm\" (UID: \"4e289063-8e66-4409-acff-6154b0ddae94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvbsm"
Sep 15 09:14:17.101532 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.099930    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4d4126b6-996d-46d2-8abe-9fb14423f0ac-kubelet-config\") pod \"global-pull-secret-syncer-hqkrc\" (UID: \"4d4126b6-996d-46d2-8abe-9fb14423f0ac\") " pod="kube-system/global-pull-secret-syncer-hqkrc"
Sep 15 09:14:17.101532 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.099972    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-865f7\" (UniqueName: \"kubernetes.io/projected/6c49d708-0bbc-445a-baf3-03b239d8dd04-kube-api-access-865f7\") pod \"iptables-alerter-jclv4\" (UID: \"6c49d708-0bbc-445a-baf3-03b239d8dd04\") " pod="openshift-network-operator/iptables-alerter-jclv4"
Sep 15 09:14:17.101532 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.100032    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ebbb215c-b019-4a5f-933a-7614daf7e777-host-slash\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.101532 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.100068    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ebbb215c-b019-4a5f-933a-7614daf7e777-host-run-netns\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.101532 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.100095    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/621cf06d-684f-4bbb-a194-d944fa6d1752-cnibin\") pod \"multus-additional-cni-plugins-826mj\" (UID: \"621cf06d-684f-4bbb-a194-d944fa6d1752\") " pod="openshift-multus/multus-additional-cni-plugins-826mj"
Sep 15 09:14:17.101532 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.100119    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ebbb215c-b019-4a5f-933a-7614daf7e777-etc-openvswitch\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.101532 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.100149    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ebbb215c-b019-4a5f-933a-7614daf7e777-log-socket\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.101532 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.100180    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/689f5a38-1aeb-44ed-a218-7217946655d0-etc-sysctl-d\") pod \"tuned-l8z2g\" (UID: \"689f5a38-1aeb-44ed-a218-7217946655d0\") " pod="openshift-cluster-node-tuning-operator/tuned-l8z2g"
Sep 15 09:14:17.101532 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.100179    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcq27\" (UniqueName: \"kubernetes.io/projected/79960bdd-9148-4e6c-8cec-189f5b35b25f-kube-api-access-fcq27\") pod \"multus-xqglj\" (UID: \"79960bdd-9148-4e6c-8cec-189f5b35b25f\") " pod="openshift-multus/multus-xqglj"
Sep 15 09:14:17.102039 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.101867    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/689f5a38-1aeb-44ed-a218-7217946655d0-tmp\") pod \"tuned-l8z2g\" (UID: \"689f5a38-1aeb-44ed-a218-7217946655d0\") " pod="openshift-cluster-node-tuning-operator/tuned-l8z2g"
Sep 15 09:14:17.102039 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.101967    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/689f5a38-1aeb-44ed-a218-7217946655d0-etc-tuned\") pod \"tuned-l8z2g\" (UID: \"689f5a38-1aeb-44ed-a218-7217946655d0\") " pod="openshift-cluster-node-tuning-operator/tuned-l8z2g"
Sep 15 09:14:17.107556 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.107532    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djnrm\" (UniqueName: \"kubernetes.io/projected/689f5a38-1aeb-44ed-a218-7217946655d0-kube-api-access-djnrm\") pod \"tuned-l8z2g\" (UID: \"689f5a38-1aeb-44ed-a218-7217946655d0\") " pod="openshift-cluster-node-tuning-operator/tuned-l8z2g"
Sep 15 09:14:17.134214 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:17.134189    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b3d6833f74b07abf73dd136dadede80.slice/crio-bcb642bbab43d5c82712ff1fc49f2c39884b7e7f235ba9641d52b5e5b1e42180 WatchSource:0}: Error finding container bcb642bbab43d5c82712ff1fc49f2c39884b7e7f235ba9641d52b5e5b1e42180: Status 404 returned error can't find the container with id bcb642bbab43d5c82712ff1fc49f2c39884b7e7f235ba9641d52b5e5b1e42180
Sep 15 09:14:17.134419 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:17.134398    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93a9cd305dd93bbe9f79180cbc0e6eaa.slice/crio-09992bd6fb22cf5002d34c7085066f9ecea5049bc5bf62f9502308ee28b11ae7 WatchSource:0}: Error finding container 09992bd6fb22cf5002d34c7085066f9ecea5049bc5bf62f9502308ee28b11ae7: Status 404 returned error can't find the container with id 09992bd6fb22cf5002d34c7085066f9ecea5049bc5bf62f9502308ee28b11ae7
Sep 15 09:14:17.138896 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.138882    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 09:14:17.200762 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.200743    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/621cf06d-684f-4bbb-a194-d944fa6d1752-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-826mj\" (UID: \"621cf06d-684f-4bbb-a194-d944fa6d1752\") " pod="openshift-multus/multus-additional-cni-plugins-826mj"
Sep 15 09:14:17.200863 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.200767    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ebbb215c-b019-4a5f-933a-7614daf7e777-ovnkube-config\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.200863 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.200784    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/79960bdd-9148-4e6c-8cec-189f5b35b25f-multus-daemon-config\") pod \"multus-xqglj\" (UID: \"79960bdd-9148-4e6c-8cec-189f5b35b25f\") " pod="openshift-multus/multus-xqglj"
Sep 15 09:14:17.200863 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.200799    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/79960bdd-9148-4e6c-8cec-189f5b35b25f-host-run-multus-certs\") pod \"multus-xqglj\" (UID: \"79960bdd-9148-4e6c-8cec-189f5b35b25f\") " pod="openshift-multus/multus-xqglj"
Sep 15 09:14:17.200863 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.200814    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/621cf06d-684f-4bbb-a194-d944fa6d1752-system-cni-dir\") pod \"multus-additional-cni-plugins-826mj\" (UID: \"621cf06d-684f-4bbb-a194-d944fa6d1752\") " pod="openshift-multus/multus-additional-cni-plugins-826mj"
Sep 15 09:14:17.200863 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.200828    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ebbb215c-b019-4a5f-933a-7614daf7e777-systemd-units\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.200863 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.200844    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4e289063-8e66-4409-acff-6154b0ddae94-socket-dir\") pod \"aws-ebs-csi-driver-node-lvbsm\" (UID: \"4e289063-8e66-4409-acff-6154b0ddae94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvbsm"
Sep 15 09:14:17.201177 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.200870    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4x8f\" (UniqueName: \"kubernetes.io/projected/621cf06d-684f-4bbb-a194-d944fa6d1752-kube-api-access-c4x8f\") pod \"multus-additional-cni-plugins-826mj\" (UID: \"621cf06d-684f-4bbb-a194-d944fa6d1752\") " pod="openshift-multus/multus-additional-cni-plugins-826mj"
Sep 15 09:14:17.201177 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.200888    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/621cf06d-684f-4bbb-a194-d944fa6d1752-system-cni-dir\") pod \"multus-additional-cni-plugins-826mj\" (UID: \"621cf06d-684f-4bbb-a194-d944fa6d1752\") " pod="openshift-multus/multus-additional-cni-plugins-826mj"
Sep 15 09:14:17.201177 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.200904    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ebbb215c-b019-4a5f-933a-7614daf7e777-systemd-units\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.201177 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.200891    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/79960bdd-9148-4e6c-8cec-189f5b35b25f-host-run-multus-certs\") pod \"multus-xqglj\" (UID: \"79960bdd-9148-4e6c-8cec-189f5b35b25f\") " pod="openshift-multus/multus-xqglj"
Sep 15 09:14:17.201177 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.200894    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6c49d708-0bbc-445a-baf3-03b239d8dd04-iptables-alerter-script\") pod \"iptables-alerter-jclv4\" (UID: \"6c49d708-0bbc-445a-baf3-03b239d8dd04\") " pod="openshift-network-operator/iptables-alerter-jclv4"
Sep 15 09:14:17.201177 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.200962    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ebbb215c-b019-4a5f-933a-7614daf7e777-run-systemd\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.201177 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.200987    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ebbb215c-b019-4a5f-933a-7614daf7e777-node-log\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.201177 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201008    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/79960bdd-9148-4e6c-8cec-189f5b35b25f-hostroot\") pod \"multus-xqglj\" (UID: \"79960bdd-9148-4e6c-8cec-189f5b35b25f\") " pod="openshift-multus/multus-xqglj"
Sep 15 09:14:17.201177 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201011    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4e289063-8e66-4409-acff-6154b0ddae94-socket-dir\") pod \"aws-ebs-csi-driver-node-lvbsm\" (UID: \"4e289063-8e66-4409-acff-6154b0ddae94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvbsm"
Sep 15 09:14:17.201177 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201052    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ebbb215c-b019-4a5f-933a-7614daf7e777-run-systemd\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.201177 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201054    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/79960bdd-9148-4e6c-8cec-189f5b35b25f-hostroot\") pod \"multus-xqglj\" (UID: \"79960bdd-9148-4e6c-8cec-189f5b35b25f\") " pod="openshift-multus/multus-xqglj"
Sep 15 09:14:17.201177 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201085    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebbb215c-b019-4a5f-933a-7614daf7e777-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.201177 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201114    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/79960bdd-9148-4e6c-8cec-189f5b35b25f-host-var-lib-cni-multus\") pod \"multus-xqglj\" (UID: \"79960bdd-9148-4e6c-8cec-189f5b35b25f\") " pod="openshift-multus/multus-xqglj"
Sep 15 09:14:17.201177 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201119    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebbb215c-b019-4a5f-933a-7614daf7e777-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.201177 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201090    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ebbb215c-b019-4a5f-933a-7614daf7e777-node-log\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.201177 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201150    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d4126b6-996d-46d2-8abe-9fb14423f0ac-original-pull-secret\") pod \"global-pull-secret-syncer-hqkrc\" (UID: \"4d4126b6-996d-46d2-8abe-9fb14423f0ac\") " pod="kube-system/global-pull-secret-syncer-hqkrc"
Sep 15 09:14:17.201177 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201167    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/79960bdd-9148-4e6c-8cec-189f5b35b25f-host-var-lib-cni-multus\") pod \"multus-xqglj\" (UID: \"79960bdd-9148-4e6c-8cec-189f5b35b25f\") " pod="openshift-multus/multus-xqglj"
Sep 15 09:14:17.201932 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201173    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/621cf06d-684f-4bbb-a194-d944fa6d1752-tuning-conf-dir\") pod \"multus-additional-cni-plugins-826mj\" (UID: \"621cf06d-684f-4bbb-a194-d944fa6d1752\") " pod="openshift-multus/multus-additional-cni-plugins-826mj"
Sep 15 09:14:17.201932 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201198    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebbb215c-b019-4a5f-933a-7614daf7e777-host-run-ovn-kubernetes\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.201932 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201222    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ebbb215c-b019-4a5f-933a-7614daf7e777-env-overrides\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.201932 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:17.201247    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 09:14:17.201932 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201288    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4e289063-8e66-4409-acff-6154b0ddae94-registration-dir\") pod \"aws-ebs-csi-driver-node-lvbsm\" (UID: \"4e289063-8e66-4409-acff-6154b0ddae94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvbsm"
Sep 15 09:14:17.201932 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:17.201313    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d4126b6-996d-46d2-8abe-9fb14423f0ac-original-pull-secret podName:4d4126b6-996d-46d2-8abe-9fb14423f0ac nodeName:}" failed. No retries permitted until 2026-09-15 09:14:17.701295165 +0000 UTC m=+2.039740438 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d4126b6-996d-46d2-8abe-9fb14423f0ac-original-pull-secret") pod "global-pull-secret-syncer-hqkrc" (UID: "4d4126b6-996d-46d2-8abe-9fb14423f0ac") : object "kube-system"/"original-pull-secret" not registered
Sep 15 09:14:17.201932 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201246    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4e289063-8e66-4409-acff-6154b0ddae94-registration-dir\") pod \"aws-ebs-csi-driver-node-lvbsm\" (UID: \"4e289063-8e66-4409-acff-6154b0ddae94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvbsm"
Sep 15 09:14:17.201932 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201326    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebbb215c-b019-4a5f-933a-7614daf7e777-host-run-ovn-kubernetes\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.201932 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201343    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4e289063-8e66-4409-acff-6154b0ddae94-etc-selinux\") pod \"aws-ebs-csi-driver-node-lvbsm\" (UID: \"4e289063-8e66-4409-acff-6154b0ddae94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvbsm"
Sep 15 09:14:17.201932 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201368    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/79960bdd-9148-4e6c-8cec-189f5b35b25f-cnibin\") pod \"multus-xqglj\" (UID: \"79960bdd-9148-4e6c-8cec-189f5b35b25f\") " pod="openshift-multus/multus-xqglj"
Sep 15 09:14:17.201932 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201369    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/621cf06d-684f-4bbb-a194-d944fa6d1752-tuning-conf-dir\") pod \"multus-additional-cni-plugins-826mj\" (UID: \"621cf06d-684f-4bbb-a194-d944fa6d1752\") " pod="openshift-multus/multus-additional-cni-plugins-826mj"
Sep 15 09:14:17.201932 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201391    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9smf\" (UniqueName: \"kubernetes.io/projected/a457ba28-efbe-4cdf-b186-edbf98e80297-kube-api-access-p9smf\") pod \"network-check-target-pbttq\" (UID: \"a457ba28-efbe-4cdf-b186-edbf98e80297\") " pod="openshift-network-diagnostics/network-check-target-pbttq"
Sep 15 09:14:17.201932 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201413    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ebbb215c-b019-4a5f-933a-7614daf7e777-run-openvswitch\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.201932 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201428    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ebbb215c-b019-4a5f-933a-7614daf7e777-ovnkube-config\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.201932 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201434    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5b0fcbbe-ae50-4282-ab2f-3d85fc2457a7-hosts-file\") pod \"node-resolver-6lwmm\" (UID: \"5b0fcbbe-ae50-4282-ab2f-3d85fc2457a7\") " pod="openshift-dns/node-resolver-6lwmm"
Sep 15 09:14:17.201932 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201450    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/79960bdd-9148-4e6c-8cec-189f5b35b25f-multus-daemon-config\") pod \"multus-xqglj\" (UID: \"79960bdd-9148-4e6c-8cec-189f5b35b25f\") " pod="openshift-multus/multus-xqglj"
Sep 15 09:14:17.201932 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201457    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbvxb\" (UniqueName: \"kubernetes.io/projected/5b0fcbbe-ae50-4282-ab2f-3d85fc2457a7-kube-api-access-wbvxb\") pod \"node-resolver-6lwmm\" (UID: \"5b0fcbbe-ae50-4282-ab2f-3d85fc2457a7\") " pod="openshift-dns/node-resolver-6lwmm"
Sep 15 09:14:17.202735 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201452    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4e289063-8e66-4409-acff-6154b0ddae94-etc-selinux\") pod \"aws-ebs-csi-driver-node-lvbsm\" (UID: \"4e289063-8e66-4409-acff-6154b0ddae94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvbsm"
Sep 15 09:14:17.202735 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201428    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/621cf06d-684f-4bbb-a194-d944fa6d1752-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-826mj\" (UID: \"621cf06d-684f-4bbb-a194-d944fa6d1752\") " pod="openshift-multus/multus-additional-cni-plugins-826mj"
Sep 15 09:14:17.202735 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201487    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/79960bdd-9148-4e6c-8cec-189f5b35b25f-cni-binary-copy\") pod \"multus-xqglj\" (UID: \"79960bdd-9148-4e6c-8cec-189f5b35b25f\") " pod="openshift-multus/multus-xqglj"
Sep 15 09:14:17.202735 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201482    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6c49d708-0bbc-445a-baf3-03b239d8dd04-iptables-alerter-script\") pod \"iptables-alerter-jclv4\" (UID: \"6c49d708-0bbc-445a-baf3-03b239d8dd04\") " pod="openshift-network-operator/iptables-alerter-jclv4"
Sep 15 09:14:17.202735 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201505    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/79960bdd-9148-4e6c-8cec-189f5b35b25f-cnibin\") pod \"multus-xqglj\" (UID: \"79960bdd-9148-4e6c-8cec-189f5b35b25f\") " pod="openshift-multus/multus-xqglj"
Sep 15 09:14:17.202735 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201518    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4d4126b6-996d-46d2-8abe-9fb14423f0ac-dbus\") pod \"global-pull-secret-syncer-hqkrc\" (UID: \"4d4126b6-996d-46d2-8abe-9fb14423f0ac\") " pod="kube-system/global-pull-secret-syncer-hqkrc"
Sep 15 09:14:17.202735 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201531    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5b0fcbbe-ae50-4282-ab2f-3d85fc2457a7-hosts-file\") pod \"node-resolver-6lwmm\" (UID: \"5b0fcbbe-ae50-4282-ab2f-3d85fc2457a7\") " pod="openshift-dns/node-resolver-6lwmm"
Sep 15 09:14:17.202735 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201540    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ebbb215c-b019-4a5f-933a-7614daf7e777-run-openvswitch\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.202735 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201544    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/79960bdd-9148-4e6c-8cec-189f5b35b25f-host-var-lib-kubelet\") pod \"multus-xqglj\" (UID: \"79960bdd-9148-4e6c-8cec-189f5b35b25f\") " pod="openshift-multus/multus-xqglj"
Sep 15 09:14:17.202735 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201579    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ebbb215c-b019-4a5f-933a-7614daf7e777-var-lib-openvswitch\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.202735 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201586    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/79960bdd-9148-4e6c-8cec-189f5b35b25f-host-var-lib-kubelet\") pod \"multus-xqglj\" (UID: \"79960bdd-9148-4e6c-8cec-189f5b35b25f\") " pod="openshift-multus/multus-xqglj"
Sep 15 09:14:17.202735 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201601    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ebbb215c-b019-4a5f-933a-7614daf7e777-host-cni-bin\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.202735 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201624    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ebbb215c-b019-4a5f-933a-7614daf7e777-var-lib-openvswitch\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.202735 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201626    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4e289063-8e66-4409-acff-6154b0ddae94-device-dir\") pod \"aws-ebs-csi-driver-node-lvbsm\" (UID: \"4e289063-8e66-4409-acff-6154b0ddae94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvbsm"
Sep 15 09:14:17.202735 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201649    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ebbb215c-b019-4a5f-933a-7614daf7e777-host-cni-bin\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.202735 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201650    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgcpf\" (UniqueName: \"kubernetes.io/projected/4e289063-8e66-4409-acff-6154b0ddae94-kube-api-access-cgcpf\") pod \"aws-ebs-csi-driver-node-lvbsm\" (UID: \"4e289063-8e66-4409-acff-6154b0ddae94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvbsm"
Sep 15 09:14:17.202735 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201602    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4d4126b6-996d-46d2-8abe-9fb14423f0ac-dbus\") pod \"global-pull-secret-syncer-hqkrc\" (UID: \"4d4126b6-996d-46d2-8abe-9fb14423f0ac\") " pod="kube-system/global-pull-secret-syncer-hqkrc"
Sep 15 09:14:17.203417 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201675    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4d4126b6-996d-46d2-8abe-9fb14423f0ac-kubelet-config\") pod \"global-pull-secret-syncer-hqkrc\" (UID: \"4d4126b6-996d-46d2-8abe-9fb14423f0ac\") " pod="kube-system/global-pull-secret-syncer-hqkrc"
Sep 15 09:14:17.203417 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201684    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ebbb215c-b019-4a5f-933a-7614daf7e777-env-overrides\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.203417 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201701    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-865f7\" (UniqueName: \"kubernetes.io/projected/6c49d708-0bbc-445a-baf3-03b239d8dd04-kube-api-access-865f7\") pod \"iptables-alerter-jclv4\" (UID: \"6c49d708-0bbc-445a-baf3-03b239d8dd04\") " pod="openshift-network-operator/iptables-alerter-jclv4"
Sep 15 09:14:17.203417 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201725    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ebbb215c-b019-4a5f-933a-7614daf7e777-host-slash\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.203417 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201686    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4e289063-8e66-4409-acff-6154b0ddae94-device-dir\") pod \"aws-ebs-csi-driver-node-lvbsm\" (UID: \"4e289063-8e66-4409-acff-6154b0ddae94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvbsm"
Sep 15 09:14:17.203417 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201751    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4d4126b6-996d-46d2-8abe-9fb14423f0ac-kubelet-config\") pod \"global-pull-secret-syncer-hqkrc\" (UID: \"4d4126b6-996d-46d2-8abe-9fb14423f0ac\") " pod="kube-system/global-pull-secret-syncer-hqkrc"
Sep 15 09:14:17.203417 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201747    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ebbb215c-b019-4a5f-933a-7614daf7e777-host-run-netns\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.203417 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201793    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ebbb215c-b019-4a5f-933a-7614daf7e777-host-slash\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.203417 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201799    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/621cf06d-684f-4bbb-a194-d944fa6d1752-cnibin\") pod \"multus-additional-cni-plugins-826mj\" (UID: \"621cf06d-684f-4bbb-a194-d944fa6d1752\") " pod="openshift-multus/multus-additional-cni-plugins-826mj"
Sep 15 09:14:17.203417 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201822    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ebbb215c-b019-4a5f-933a-7614daf7e777-etc-openvswitch\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.203417 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201834    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ebbb215c-b019-4a5f-933a-7614daf7e777-host-run-netns\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.203417 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201853    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/621cf06d-684f-4bbb-a194-d944fa6d1752-cnibin\") pod \"multus-additional-cni-plugins-826mj\" (UID: \"621cf06d-684f-4bbb-a194-d944fa6d1752\") " pod="openshift-multus/multus-additional-cni-plugins-826mj"
Sep 15 09:14:17.203417 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201861    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ebbb215c-b019-4a5f-933a-7614daf7e777-etc-openvswitch\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.203417 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201844    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ebbb215c-b019-4a5f-933a-7614daf7e777-log-socket\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.203417 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201896    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcq27\" (UniqueName: \"kubernetes.io/projected/79960bdd-9148-4e6c-8cec-189f5b35b25f-kube-api-access-fcq27\") pod \"multus-xqglj\" (UID: \"79960bdd-9148-4e6c-8cec-189f5b35b25f\") " pod="openshift-multus/multus-xqglj"
Sep 15 09:14:17.203417 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201898    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ebbb215c-b019-4a5f-933a-7614daf7e777-log-socket\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.203417 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201918    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ebbb215c-b019-4a5f-933a-7614daf7e777-ovnkube-script-lib\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.204102 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201958    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/79960bdd-9148-4e6c-8cec-189f5b35b25f-host-var-lib-cni-bin\") pod \"multus-xqglj\" (UID: \"79960bdd-9148-4e6c-8cec-189f5b35b25f\") " pod="openshift-multus/multus-xqglj"
Sep 15 09:14:17.204102 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201985    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/79960bdd-9148-4e6c-8cec-189f5b35b25f-multus-conf-dir\") pod \"multus-xqglj\" (UID: \"79960bdd-9148-4e6c-8cec-189f5b35b25f\") " pod="openshift-multus/multus-xqglj"
Sep 15 09:14:17.204102 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.201987    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/79960bdd-9148-4e6c-8cec-189f5b35b25f-cni-binary-copy\") pod \"multus-xqglj\" (UID: \"79960bdd-9148-4e6c-8cec-189f5b35b25f\") " pod="openshift-multus/multus-xqglj"
Sep 15 09:14:17.204102 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.202007    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79960bdd-9148-4e6c-8cec-189f5b35b25f-etc-kubernetes\") pod \"multus-xqglj\" (UID: \"79960bdd-9148-4e6c-8cec-189f5b35b25f\") " pod="openshift-multus/multus-xqglj"
Sep 15 09:14:17.204102 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.202033    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/79960bdd-9148-4e6c-8cec-189f5b35b25f-host-var-lib-cni-bin\") pod \"multus-xqglj\" (UID: \"79960bdd-9148-4e6c-8cec-189f5b35b25f\") " pod="openshift-multus/multus-xqglj"
Sep 15 09:14:17.204102 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.202051    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79960bdd-9148-4e6c-8cec-189f5b35b25f-etc-kubernetes\") pod \"multus-xqglj\" (UID: \"79960bdd-9148-4e6c-8cec-189f5b35b25f\") " pod="openshift-multus/multus-xqglj"
Sep 15 09:14:17.204102 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.202067    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/79960bdd-9148-4e6c-8cec-189f5b35b25f-multus-conf-dir\") pod \"multus-xqglj\" (UID: \"79960bdd-9148-4e6c-8cec-189f5b35b25f\") " pod="openshift-multus/multus-xqglj"
Sep 15 09:14:17.204102 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.202079    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z42gt\" (UniqueName: \"kubernetes.io/projected/5e176b54-2fe2-4b90-ae2b-f66860907acf-kube-api-access-z42gt\") pod \"network-metrics-daemon-fpphv\" (UID: \"5e176b54-2fe2-4b90-ae2b-f66860907acf\") " pod="openshift-multus/network-metrics-daemon-fpphv"
Sep 15 09:14:17.204102 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.202101    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/552c9685-d39f-40b0-8f8d-79ba6b12fee7-agent-certs\") pod \"konnectivity-agent-nhzm4\" (UID: \"552c9685-d39f-40b0-8f8d-79ba6b12fee7\") " pod="kube-system/konnectivity-agent-nhzm4"
Sep 15 09:14:17.204102 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.202118    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwrpd\" (UniqueName: \"kubernetes.io/projected/ebbb215c-b019-4a5f-933a-7614daf7e777-kube-api-access-jwrpd\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.204102 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.202133    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4e289063-8e66-4409-acff-6154b0ddae94-sys-fs\") pod \"aws-ebs-csi-driver-node-lvbsm\" (UID: \"4e289063-8e66-4409-acff-6154b0ddae94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvbsm"
Sep 15 09:14:17.204102 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.202147    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b0fcbbe-ae50-4282-ab2f-3d85fc2457a7-tmp-dir\") pod \"node-resolver-6lwmm\" (UID: \"5b0fcbbe-ae50-4282-ab2f-3d85fc2457a7\") " pod="openshift-dns/node-resolver-6lwmm"
Sep 15 09:14:17.204102 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.202161    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/60e02ffe-03b0-4ac9-b5d0-492856f7d07a-host\") pod \"node-ca-n5h5g\" (UID: \"60e02ffe-03b0-4ac9-b5d0-492856f7d07a\") " pod="openshift-image-registry/node-ca-n5h5g"
Sep 15 09:14:17.204102 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.202208    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4e289063-8e66-4409-acff-6154b0ddae94-sys-fs\") pod \"aws-ebs-csi-driver-node-lvbsm\" (UID: \"4e289063-8e66-4409-acff-6154b0ddae94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvbsm"
Sep 15 09:14:17.204102 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.202253    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/60e02ffe-03b0-4ac9-b5d0-492856f7d07a-host\") pod \"node-ca-n5h5g\" (UID: \"60e02ffe-03b0-4ac9-b5d0-492856f7d07a\") " pod="openshift-image-registry/node-ca-n5h5g"
Sep 15 09:14:17.204102 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.202285    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsfjm\" (UniqueName: \"kubernetes.io/projected/60e02ffe-03b0-4ac9-b5d0-492856f7d07a-kube-api-access-lsfjm\") pod \"node-ca-n5h5g\" (UID: \"60e02ffe-03b0-4ac9-b5d0-492856f7d07a\") " pod="openshift-image-registry/node-ca-n5h5g"
Sep 15 09:14:17.204102 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.202306    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ebbb215c-b019-4a5f-933a-7614daf7e777-ovnkube-script-lib\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.204102 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.202312    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/79960bdd-9148-4e6c-8cec-189f5b35b25f-host-run-netns\") pod \"multus-xqglj\" (UID: \"79960bdd-9148-4e6c-8cec-189f5b35b25f\") " pod="openshift-multus/multus-xqglj"
Sep 15 09:14:17.204861 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.202337    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/79960bdd-9148-4e6c-8cec-189f5b35b25f-host-run-netns\") pod \"multus-xqglj\" (UID: \"79960bdd-9148-4e6c-8cec-189f5b35b25f\") " pod="openshift-multus/multus-xqglj"
Sep 15 09:14:17.204861 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.202346    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/621cf06d-684f-4bbb-a194-d944fa6d1752-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-826mj\" (UID: \"621cf06d-684f-4bbb-a194-d944fa6d1752\") " pod="openshift-multus/multus-additional-cni-plugins-826mj"
Sep 15 09:14:17.204861 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.202373    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebbb215c-b019-4a5f-933a-7614daf7e777-host-kubelet\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.204861 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.202427    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b0fcbbe-ae50-4282-ab2f-3d85fc2457a7-tmp-dir\") pod \"node-resolver-6lwmm\" (UID: \"5b0fcbbe-ae50-4282-ab2f-3d85fc2457a7\") " pod="openshift-dns/node-resolver-6lwmm"
Sep 15 09:14:17.204861 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.202443    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebbb215c-b019-4a5f-933a-7614daf7e777-host-kubelet\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.204861 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.202430    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ebbb215c-b019-4a5f-933a-7614daf7e777-host-cni-netd\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.204861 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.202461    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ebbb215c-b019-4a5f-933a-7614daf7e777-host-cni-netd\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.204861 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.202476    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/60e02ffe-03b0-4ac9-b5d0-492856f7d07a-serviceca\") pod \"node-ca-n5h5g\" (UID: \"60e02ffe-03b0-4ac9-b5d0-492856f7d07a\") " pod="openshift-image-registry/node-ca-n5h5g"
Sep 15 09:14:17.204861 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.202520    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/79960bdd-9148-4e6c-8cec-189f5b35b25f-multus-cni-dir\") pod \"multus-xqglj\" (UID: \"79960bdd-9148-4e6c-8cec-189f5b35b25f\") " pod="openshift-multus/multus-xqglj"
Sep 15 09:14:17.204861 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.202535    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/79960bdd-9148-4e6c-8cec-189f5b35b25f-multus-socket-dir-parent\") pod \"multus-xqglj\" (UID: \"79960bdd-9148-4e6c-8cec-189f5b35b25f\") " pod="openshift-multus/multus-xqglj"
Sep 15 09:14:17.204861 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.202553    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/621cf06d-684f-4bbb-a194-d944fa6d1752-cni-binary-copy\") pod \"multus-additional-cni-plugins-826mj\" (UID: \"621cf06d-684f-4bbb-a194-d944fa6d1752\") " pod="openshift-multus/multus-additional-cni-plugins-826mj"
Sep 15 09:14:17.204861 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.202579    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6c49d708-0bbc-445a-baf3-03b239d8dd04-host-slash\") pod \"iptables-alerter-jclv4\" (UID: \"6c49d708-0bbc-445a-baf3-03b239d8dd04\") " pod="openshift-network-operator/iptables-alerter-jclv4"
Sep 15 09:14:17.204861 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.202598    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/79960bdd-9148-4e6c-8cec-189f5b35b25f-multus-cni-dir\") pod \"multus-xqglj\" (UID: \"79960bdd-9148-4e6c-8cec-189f5b35b25f\") " pod="openshift-multus/multus-xqglj"
Sep 15 09:14:17.204861 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.202602    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/79960bdd-9148-4e6c-8cec-189f5b35b25f-multus-socket-dir-parent\") pod \"multus-xqglj\" (UID: \"79960bdd-9148-4e6c-8cec-189f5b35b25f\") " pod="openshift-multus/multus-xqglj"
Sep 15 09:14:17.204861 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.202603    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ebbb215c-b019-4a5f-933a-7614daf7e777-run-ovn\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.204861 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.202644    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ebbb215c-b019-4a5f-933a-7614daf7e777-ovn-node-metrics-cert\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.204861 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.202648    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6c49d708-0bbc-445a-baf3-03b239d8dd04-host-slash\") pod \"iptables-alerter-jclv4\" (UID: \"6c49d708-0bbc-445a-baf3-03b239d8dd04\") " pod="openshift-network-operator/iptables-alerter-jclv4"
Sep 15 09:14:17.204861 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.202670    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/552c9685-d39f-40b0-8f8d-79ba6b12fee7-konnectivity-ca\") pod \"konnectivity-agent-nhzm4\" (UID: \"552c9685-d39f-40b0-8f8d-79ba6b12fee7\") " pod="kube-system/konnectivity-agent-nhzm4"
Sep 15 09:14:17.205468 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.202694    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4e289063-8e66-4409-acff-6154b0ddae94-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lvbsm\" (UID: \"4e289063-8e66-4409-acff-6154b0ddae94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvbsm"
Sep 15 09:14:17.205468 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.202738    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ebbb215c-b019-4a5f-933a-7614daf7e777-run-ovn\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.205468 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.202820    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4e289063-8e66-4409-acff-6154b0ddae94-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lvbsm\" (UID: \"4e289063-8e66-4409-acff-6154b0ddae94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvbsm"
Sep 15 09:14:17.205468 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.202907    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/79960bdd-9148-4e6c-8cec-189f5b35b25f-system-cni-dir\") pod \"multus-xqglj\" (UID: \"79960bdd-9148-4e6c-8cec-189f5b35b25f\") " pod="openshift-multus/multus-xqglj"
Sep 15 09:14:17.205468 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.202844    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/79960bdd-9148-4e6c-8cec-189f5b35b25f-system-cni-dir\") pod \"multus-xqglj\" (UID: \"79960bdd-9148-4e6c-8cec-189f5b35b25f\") " pod="openshift-multus/multus-xqglj"
Sep 15 09:14:17.205468 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.202969    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/621cf06d-684f-4bbb-a194-d944fa6d1752-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-826mj\" (UID: \"621cf06d-684f-4bbb-a194-d944fa6d1752\") " pod="openshift-multus/multus-additional-cni-plugins-826mj"
Sep 15 09:14:17.205468 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.202981    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/79960bdd-9148-4e6c-8cec-189f5b35b25f-host-run-k8s-cni-cncf-io\") pod \"multus-xqglj\" (UID: \"79960bdd-9148-4e6c-8cec-189f5b35b25f\") " pod="openshift-multus/multus-xqglj"
Sep 15 09:14:17.205468 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.202996    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/60e02ffe-03b0-4ac9-b5d0-492856f7d07a-serviceca\") pod \"node-ca-n5h5g\" (UID: \"60e02ffe-03b0-4ac9-b5d0-492856f7d07a\") " pod="openshift-image-registry/node-ca-n5h5g"
Sep 15 09:14:17.205468 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.203023    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e176b54-2fe2-4b90-ae2b-f66860907acf-metrics-certs\") pod \"network-metrics-daemon-fpphv\" (UID: \"5e176b54-2fe2-4b90-ae2b-f66860907acf\") " pod="openshift-multus/network-metrics-daemon-fpphv"
Sep 15 09:14:17.205468 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.203038    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/79960bdd-9148-4e6c-8cec-189f5b35b25f-host-run-k8s-cni-cncf-io\") pod \"multus-xqglj\" (UID: \"79960bdd-9148-4e6c-8cec-189f5b35b25f\") " pod="openshift-multus/multus-xqglj"
Sep 15 09:14:17.205468 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.203103    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/621cf06d-684f-4bbb-a194-d944fa6d1752-cni-binary-copy\") pod \"multus-additional-cni-plugins-826mj\" (UID: \"621cf06d-684f-4bbb-a194-d944fa6d1752\") " pod="openshift-multus/multus-additional-cni-plugins-826mj"
Sep 15 09:14:17.205468 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:17.203125    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:14:17.205468 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:17.203182    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e176b54-2fe2-4b90-ae2b-f66860907acf-metrics-certs podName:5e176b54-2fe2-4b90-ae2b-f66860907acf nodeName:}" failed. No retries permitted until 2026-09-15 09:14:17.703167221 +0000 UTC m=+2.041612494 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e176b54-2fe2-4b90-ae2b-f66860907acf-metrics-certs") pod "network-metrics-daemon-fpphv" (UID: "5e176b54-2fe2-4b90-ae2b-f66860907acf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:14:17.205468 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.203206    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/552c9685-d39f-40b0-8f8d-79ba6b12fee7-konnectivity-ca\") pod \"konnectivity-agent-nhzm4\" (UID: \"552c9685-d39f-40b0-8f8d-79ba6b12fee7\") " pod="kube-system/konnectivity-agent-nhzm4"
Sep 15 09:14:17.205468 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.204510    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/552c9685-d39f-40b0-8f8d-79ba6b12fee7-agent-certs\") pod \"konnectivity-agent-nhzm4\" (UID: \"552c9685-d39f-40b0-8f8d-79ba6b12fee7\") " pod="kube-system/konnectivity-agent-nhzm4"
Sep 15 09:14:17.205468 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.204697    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ebbb215c-b019-4a5f-933a-7614daf7e777-ovn-node-metrics-cert\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.207725 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:17.207707    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 09:14:17.207815 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:17.207750    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 09:14:17.207815 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:17.207765    2578 projected.go:196] Error preparing data for projected volume kube-api-access-p9smf for pod openshift-network-diagnostics/network-check-target-pbttq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 09:14:17.207897 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:17.207821    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a457ba28-efbe-4cdf-b186-edbf98e80297-kube-api-access-p9smf podName:a457ba28-efbe-4cdf-b186-edbf98e80297 nodeName:}" failed. No retries permitted until 2026-09-15 09:14:17.7078078 +0000 UTC m=+2.046253071 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-p9smf" (UniqueName: "kubernetes.io/projected/a457ba28-efbe-4cdf-b186-edbf98e80297-kube-api-access-p9smf") pod "network-check-target-pbttq" (UID: "a457ba28-efbe-4cdf-b186-edbf98e80297") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 09:14:17.209747 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.209722    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4x8f\" (UniqueName: \"kubernetes.io/projected/621cf06d-684f-4bbb-a194-d944fa6d1752-kube-api-access-c4x8f\") pod \"multus-additional-cni-plugins-826mj\" (UID: \"621cf06d-684f-4bbb-a194-d944fa6d1752\") " pod="openshift-multus/multus-additional-cni-plugins-826mj"
Sep 15 09:14:17.210494 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.210470    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbvxb\" (UniqueName: \"kubernetes.io/projected/5b0fcbbe-ae50-4282-ab2f-3d85fc2457a7-kube-api-access-wbvxb\") pod \"node-resolver-6lwmm\" (UID: \"5b0fcbbe-ae50-4282-ab2f-3d85fc2457a7\") " pod="openshift-dns/node-resolver-6lwmm"
Sep 15 09:14:17.210941 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.210916    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-865f7\" (UniqueName: \"kubernetes.io/projected/6c49d708-0bbc-445a-baf3-03b239d8dd04-kube-api-access-865f7\") pod \"iptables-alerter-jclv4\" (UID: \"6c49d708-0bbc-445a-baf3-03b239d8dd04\") " pod="openshift-network-operator/iptables-alerter-jclv4"
Sep 15 09:14:17.211419 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.211402    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcq27\" (UniqueName: \"kubernetes.io/projected/79960bdd-9148-4e6c-8cec-189f5b35b25f-kube-api-access-fcq27\") pod \"multus-xqglj\" (UID: \"79960bdd-9148-4e6c-8cec-189f5b35b25f\") " pod="openshift-multus/multus-xqglj"
Sep 15 09:14:17.211553 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.211538    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgcpf\" (UniqueName: \"kubernetes.io/projected/4e289063-8e66-4409-acff-6154b0ddae94-kube-api-access-cgcpf\") pod \"aws-ebs-csi-driver-node-lvbsm\" (UID: \"4e289063-8e66-4409-acff-6154b0ddae94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvbsm"
Sep 15 09:14:17.211606 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.211588    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsfjm\" (UniqueName: \"kubernetes.io/projected/60e02ffe-03b0-4ac9-b5d0-492856f7d07a-kube-api-access-lsfjm\") pod \"node-ca-n5h5g\" (UID: \"60e02ffe-03b0-4ac9-b5d0-492856f7d07a\") " pod="openshift-image-registry/node-ca-n5h5g"
Sep 15 09:14:17.211941 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.211924    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwrpd\" (UniqueName: \"kubernetes.io/projected/ebbb215c-b019-4a5f-933a-7614daf7e777-kube-api-access-jwrpd\") pod \"ovnkube-node-gp58d\" (UID: \"ebbb215c-b019-4a5f-933a-7614daf7e777\") " pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.212182 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.212165    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z42gt\" (UniqueName: \"kubernetes.io/projected/5e176b54-2fe2-4b90-ae2b-f66860907acf-kube-api-access-z42gt\") pod \"network-metrics-daemon-fpphv\" (UID: \"5e176b54-2fe2-4b90-ae2b-f66860907acf\") " pod="openshift-multus/network-metrics-daemon-fpphv"
Sep 15 09:14:17.304340 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.304294    2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 09:14:17.324191 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.324175    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-l8z2g"
Sep 15 09:14:17.333716 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:17.333696    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod689f5a38_1aeb_44ed_a218_7217946655d0.slice/crio-0824cf84a7dd826ad7165684f8de876a3cfa77f728659aef73611aff65bc525f WatchSource:0}: Error finding container 0824cf84a7dd826ad7165684f8de876a3cfa77f728659aef73611aff65bc525f: Status 404 returned error can't find the container with id 0824cf84a7dd826ad7165684f8de876a3cfa77f728659aef73611aff65bc525f
Sep 15 09:14:17.344570 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.344553    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6lwmm"
Sep 15 09:14:17.352198 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:17.352177    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b0fcbbe_ae50_4282_ab2f_3d85fc2457a7.slice/crio-d21fb0990942960db1961d66324a79c0e48b5c179d2fc5cf8db7b261faab6390 WatchSource:0}: Error finding container d21fb0990942960db1961d66324a79c0e48b5c179d2fc5cf8db7b261faab6390: Status 404 returned error can't find the container with id d21fb0990942960db1961d66324a79c0e48b5c179d2fc5cf8db7b261faab6390
Sep 15 09:14:17.356088 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.356069    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-n5h5g"
Sep 15 09:14:17.363643 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:17.363619    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60e02ffe_03b0_4ac9_b5d0_492856f7d07a.slice/crio-aa2335fb7216df5b7d627d040e8256cd48772e0baff79d3402b7b75542321486 WatchSource:0}: Error finding container aa2335fb7216df5b7d627d040e8256cd48772e0baff79d3402b7b75542321486: Status 404 returned error can't find the container with id aa2335fb7216df5b7d627d040e8256cd48772e0baff79d3402b7b75542321486
Sep 15 09:14:17.378201 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.378179    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xqglj"
Sep 15 09:14:17.384217 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.384192    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-826mj"
Sep 15 09:14:17.385594 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:17.385575    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79960bdd_9148_4e6c_8cec_189f5b35b25f.slice/crio-95ae3e2bd2ff993203acf3be2572c3bc378a69dedb7a1c90811348a112cecf8d WatchSource:0}: Error finding container 95ae3e2bd2ff993203acf3be2572c3bc378a69dedb7a1c90811348a112cecf8d: Status 404 returned error can't find the container with id 95ae3e2bd2ff993203acf3be2572c3bc378a69dedb7a1c90811348a112cecf8d
Sep 15 09:14:17.391742 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:17.391727    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod621cf06d_684f_4bbb_a194_d944fa6d1752.slice/crio-64fdb5526514e882a5348e31ffed6bc5f4ba1abc95d1a4ec19a086ac23779771 WatchSource:0}: Error finding container 64fdb5526514e882a5348e31ffed6bc5f4ba1abc95d1a4ec19a086ac23779771: Status 404 returned error can't find the container with id 64fdb5526514e882a5348e31ffed6bc5f4ba1abc95d1a4ec19a086ac23779771
Sep 15 09:14:17.397451 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.397435    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jclv4"
Sep 15 09:14:17.404426 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:17.404407    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c49d708_0bbc_445a_baf3_03b239d8dd04.slice/crio-df8099aa34d7382108c6f5d1e273acd9fa87b5c9873e3bf6c15ae669be40d3b3 WatchSource:0}: Error finding container df8099aa34d7382108c6f5d1e273acd9fa87b5c9873e3bf6c15ae669be40d3b3: Status 404 returned error can't find the container with id df8099aa34d7382108c6f5d1e273acd9fa87b5c9873e3bf6c15ae669be40d3b3
Sep 15 09:14:17.408031 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.408018    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 09:14:17.415985 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.415969    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:17.423265 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:17.423120    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebbb215c_b019_4a5f_933a_7614daf7e777.slice/crio-baccf89c6e61af763092a2c04990dbfc3a926ca4d730af766a4710baed5fe521 WatchSource:0}: Error finding container baccf89c6e61af763092a2c04990dbfc3a926ca4d730af766a4710baed5fe521: Status 404 returned error can't find the container with id baccf89c6e61af763092a2c04990dbfc3a926ca4d730af766a4710baed5fe521
Sep 15 09:14:17.441069 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.441054    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nhzm4"
Sep 15 09:14:17.445775 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.445760    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvbsm"
Sep 15 09:14:17.448586 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:17.448573    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod552c9685_d39f_40b0_8f8d_79ba6b12fee7.slice/crio-ad5c3e6afc43c8fb8c970587862c896c97a704ee555154f995f15e0a99c050c1 WatchSource:0}: Error finding container ad5c3e6afc43c8fb8c970587862c896c97a704ee555154f995f15e0a99c050c1: Status 404 returned error can't find the container with id ad5c3e6afc43c8fb8c970587862c896c97a704ee555154f995f15e0a99c050c1
Sep 15 09:14:17.454005 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:17.453977    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e289063_8e66_4409_acff_6154b0ddae94.slice/crio-0648369f9a310a5f8370dc5101eb37381686c772bd345fd10e0f65e776ac075e WatchSource:0}: Error finding container 0648369f9a310a5f8370dc5101eb37381686c772bd345fd10e0f65e776ac075e: Status 404 returned error can't find the container with id 0648369f9a310a5f8370dc5101eb37381686c772bd345fd10e0f65e776ac075e
Sep 15 09:14:17.707003 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.706915    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e176b54-2fe2-4b90-ae2b-f66860907acf-metrics-certs\") pod \"network-metrics-daemon-fpphv\" (UID: \"5e176b54-2fe2-4b90-ae2b-f66860907acf\") " pod="openshift-multus/network-metrics-daemon-fpphv"
Sep 15 09:14:17.707003 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.706989    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d4126b6-996d-46d2-8abe-9fb14423f0ac-original-pull-secret\") pod \"global-pull-secret-syncer-hqkrc\" (UID: \"4d4126b6-996d-46d2-8abe-9fb14423f0ac\") " pod="kube-system/global-pull-secret-syncer-hqkrc"
Sep 15 09:14:17.707210 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:17.707124    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 09:14:17.707210 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:17.707181    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d4126b6-996d-46d2-8abe-9fb14423f0ac-original-pull-secret podName:4d4126b6-996d-46d2-8abe-9fb14423f0ac nodeName:}" failed. No retries permitted until 2026-09-15 09:14:18.707160403 +0000 UTC m=+3.045605671 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d4126b6-996d-46d2-8abe-9fb14423f0ac-original-pull-secret") pod "global-pull-secret-syncer-hqkrc" (UID: "4d4126b6-996d-46d2-8abe-9fb14423f0ac") : object "kube-system"/"original-pull-secret" not registered
Sep 15 09:14:17.707573 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:17.707553    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:14:17.707658 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:17.707610    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e176b54-2fe2-4b90-ae2b-f66860907acf-metrics-certs podName:5e176b54-2fe2-4b90-ae2b-f66860907acf nodeName:}" failed. No retries permitted until 2026-09-15 09:14:18.707595108 +0000 UTC m=+3.046040367 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e176b54-2fe2-4b90-ae2b-f66860907acf-metrics-certs") pod "network-metrics-daemon-fpphv" (UID: "5e176b54-2fe2-4b90-ae2b-f66860907acf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:14:17.807709 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:17.807672    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9smf\" (UniqueName: \"kubernetes.io/projected/a457ba28-efbe-4cdf-b186-edbf98e80297-kube-api-access-p9smf\") pod \"network-check-target-pbttq\" (UID: \"a457ba28-efbe-4cdf-b186-edbf98e80297\") " pod="openshift-network-diagnostics/network-check-target-pbttq"
Sep 15 09:14:17.807906 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:17.807887    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 09:14:17.807991 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:17.807914    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 09:14:17.807991 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:17.807927    2578 projected.go:196] Error preparing data for projected volume kube-api-access-p9smf for pod openshift-network-diagnostics/network-check-target-pbttq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 09:14:17.808122 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:17.808006    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a457ba28-efbe-4cdf-b186-edbf98e80297-kube-api-access-p9smf podName:a457ba28-efbe-4cdf-b186-edbf98e80297 nodeName:}" failed. No retries permitted until 2026-09-15 09:14:18.807987033 +0000 UTC m=+3.146432292 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-p9smf" (UniqueName: "kubernetes.io/projected/a457ba28-efbe-4cdf-b186-edbf98e80297-kube-api-access-p9smf") pod "network-check-target-pbttq" (UID: "a457ba28-efbe-4cdf-b186-edbf98e80297") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 09:14:18.036529 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:18.036419    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 09:09:17 +0000 UTC" deadline="2028-06-18 22:41:26.18420591 +0000 UTC"
Sep 15 09:14:18.036529 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:18.036480    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15421h27m8.147729639s"
Sep 15 09:14:18.144772 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:18.144572    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nhzm4" event={"ID":"552c9685-d39f-40b0-8f8d-79ba6b12fee7","Type":"ContainerStarted","Data":"ad5c3e6afc43c8fb8c970587862c896c97a704ee555154f995f15e0a99c050c1"}
Sep 15 09:14:18.153655 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:18.153535    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gp58d" event={"ID":"ebbb215c-b019-4a5f-933a-7614daf7e777","Type":"ContainerStarted","Data":"baccf89c6e61af763092a2c04990dbfc3a926ca4d730af766a4710baed5fe521"}
Sep 15 09:14:18.163975 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:18.163930    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6lwmm" event={"ID":"5b0fcbbe-ae50-4282-ab2f-3d85fc2457a7","Type":"ContainerStarted","Data":"d21fb0990942960db1961d66324a79c0e48b5c179d2fc5cf8db7b261faab6390"}
Sep 15 09:14:18.167501 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:18.167475    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-235.ec2.internal" event={"ID":"2b3d6833f74b07abf73dd136dadede80","Type":"ContainerStarted","Data":"bcb642bbab43d5c82712ff1fc49f2c39884b7e7f235ba9641d52b5e5b1e42180"}
Sep 15 09:14:18.190978 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:18.190934    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvbsm" event={"ID":"4e289063-8e66-4409-acff-6154b0ddae94","Type":"ContainerStarted","Data":"0648369f9a310a5f8370dc5101eb37381686c772bd345fd10e0f65e776ac075e"}
Sep 15 09:14:18.197505 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:18.197478    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jclv4" event={"ID":"6c49d708-0bbc-445a-baf3-03b239d8dd04","Type":"ContainerStarted","Data":"df8099aa34d7382108c6f5d1e273acd9fa87b5c9873e3bf6c15ae669be40d3b3"}
Sep 15 09:14:18.211085 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:18.211007    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-826mj" event={"ID":"621cf06d-684f-4bbb-a194-d944fa6d1752","Type":"ContainerStarted","Data":"64fdb5526514e882a5348e31ffed6bc5f4ba1abc95d1a4ec19a086ac23779771"}
Sep 15 09:14:18.222116 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:18.222052    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xqglj" event={"ID":"79960bdd-9148-4e6c-8cec-189f5b35b25f","Type":"ContainerStarted","Data":"95ae3e2bd2ff993203acf3be2572c3bc378a69dedb7a1c90811348a112cecf8d"}
Sep 15 09:14:18.228994 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:18.228969    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-n5h5g" event={"ID":"60e02ffe-03b0-4ac9-b5d0-492856f7d07a","Type":"ContainerStarted","Data":"aa2335fb7216df5b7d627d040e8256cd48772e0baff79d3402b7b75542321486"}
Sep 15 09:14:18.248857 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:18.248796    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-l8z2g" event={"ID":"689f5a38-1aeb-44ed-a218-7217946655d0","Type":"ContainerStarted","Data":"0824cf84a7dd826ad7165684f8de876a3cfa77f728659aef73611aff65bc525f"}
Sep 15 09:14:18.266532 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:18.266477    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-235.ec2.internal" event={"ID":"93a9cd305dd93bbe9f79180cbc0e6eaa","Type":"ContainerStarted","Data":"09992bd6fb22cf5002d34c7085066f9ecea5049bc5bf62f9502308ee28b11ae7"}
Sep 15 09:14:18.309617 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:18.309386    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 09:14:18.718438 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:18.718355    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e176b54-2fe2-4b90-ae2b-f66860907acf-metrics-certs\") pod \"network-metrics-daemon-fpphv\" (UID: \"5e176b54-2fe2-4b90-ae2b-f66860907acf\") " pod="openshift-multus/network-metrics-daemon-fpphv"
Sep 15 09:14:18.718438 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:18.718417    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d4126b6-996d-46d2-8abe-9fb14423f0ac-original-pull-secret\") pod \"global-pull-secret-syncer-hqkrc\" (UID: \"4d4126b6-996d-46d2-8abe-9fb14423f0ac\") " pod="kube-system/global-pull-secret-syncer-hqkrc"
Sep 15 09:14:18.718648 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:18.718575    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 09:14:18.718648 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:18.718634    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d4126b6-996d-46d2-8abe-9fb14423f0ac-original-pull-secret podName:4d4126b6-996d-46d2-8abe-9fb14423f0ac nodeName:}" failed. No retries permitted until 2026-09-15 09:14:20.718615927 +0000 UTC m=+5.057061186 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d4126b6-996d-46d2-8abe-9fb14423f0ac-original-pull-secret") pod "global-pull-secret-syncer-hqkrc" (UID: "4d4126b6-996d-46d2-8abe-9fb14423f0ac") : object "kube-system"/"original-pull-secret" not registered
Sep 15 09:14:18.718763 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:18.718701    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:14:18.718763 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:18.718734    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e176b54-2fe2-4b90-ae2b-f66860907acf-metrics-certs podName:5e176b54-2fe2-4b90-ae2b-f66860907acf nodeName:}" failed. No retries permitted until 2026-09-15 09:14:20.71872182 +0000 UTC m=+5.057167077 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e176b54-2fe2-4b90-ae2b-f66860907acf-metrics-certs") pod "network-metrics-daemon-fpphv" (UID: "5e176b54-2fe2-4b90-ae2b-f66860907acf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:14:18.819559 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:18.819521    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9smf\" (UniqueName: \"kubernetes.io/projected/a457ba28-efbe-4cdf-b186-edbf98e80297-kube-api-access-p9smf\") pod \"network-check-target-pbttq\" (UID: \"a457ba28-efbe-4cdf-b186-edbf98e80297\") " pod="openshift-network-diagnostics/network-check-target-pbttq"
Sep 15 09:14:18.819730 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:18.819674    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 09:14:18.819730 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:18.819693    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 09:14:18.819730 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:18.819706    2578 projected.go:196] Error preparing data for projected volume kube-api-access-p9smf for pod openshift-network-diagnostics/network-check-target-pbttq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 09:14:18.819884 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:18.819760    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a457ba28-efbe-4cdf-b186-edbf98e80297-kube-api-access-p9smf podName:a457ba28-efbe-4cdf-b186-edbf98e80297 nodeName:}" failed. No retries permitted until 2026-09-15 09:14:20.819742434 +0000 UTC m=+5.158187709 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-p9smf" (UniqueName: "kubernetes.io/projected/a457ba28-efbe-4cdf-b186-edbf98e80297-kube-api-access-p9smf") pod "network-check-target-pbttq" (UID: "a457ba28-efbe-4cdf-b186-edbf98e80297") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 09:14:19.036929 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:19.036849    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 09:09:17 +0000 UTC" deadline="2028-05-22 00:01:30.449581753 +0000 UTC"
Sep 15 09:14:19.036929 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:19.036881    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14750h47m11.412704215s"
Sep 15 09:14:19.116030 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:19.115544    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbttq"
Sep 15 09:14:19.116030 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:19.115544    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hqkrc"
Sep 15 09:14:19.116030 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:19.115663    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pbttq" podUID="a457ba28-efbe-4cdf-b186-edbf98e80297"
Sep 15 09:14:19.116030 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:19.115553    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpphv"
Sep 15 09:14:19.116030 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:19.115735    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hqkrc" podUID="4d4126b6-996d-46d2-8abe-9fb14423f0ac"
Sep 15 09:14:19.116030 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:19.115815    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fpphv" podUID="5e176b54-2fe2-4b90-ae2b-f66860907acf"
Sep 15 09:14:19.200192 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:19.200161    2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 09:14:20.736471 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:20.736426    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e176b54-2fe2-4b90-ae2b-f66860907acf-metrics-certs\") pod \"network-metrics-daemon-fpphv\" (UID: \"5e176b54-2fe2-4b90-ae2b-f66860907acf\") " pod="openshift-multus/network-metrics-daemon-fpphv"
Sep 15 09:14:20.736910 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:20.736489    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d4126b6-996d-46d2-8abe-9fb14423f0ac-original-pull-secret\") pod \"global-pull-secret-syncer-hqkrc\" (UID: \"4d4126b6-996d-46d2-8abe-9fb14423f0ac\") " pod="kube-system/global-pull-secret-syncer-hqkrc"
Sep 15 09:14:20.736910 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:20.736593    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:14:20.736910 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:20.736621    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 09:14:20.736910 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:20.736679    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e176b54-2fe2-4b90-ae2b-f66860907acf-metrics-certs podName:5e176b54-2fe2-4b90-ae2b-f66860907acf nodeName:}" failed. No retries permitted until 2026-09-15 09:14:24.736657502 +0000 UTC m=+9.075102774 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e176b54-2fe2-4b90-ae2b-f66860907acf-metrics-certs") pod "network-metrics-daemon-fpphv" (UID: "5e176b54-2fe2-4b90-ae2b-f66860907acf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:14:20.736910 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:20.736701    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d4126b6-996d-46d2-8abe-9fb14423f0ac-original-pull-secret podName:4d4126b6-996d-46d2-8abe-9fb14423f0ac nodeName:}" failed. No retries permitted until 2026-09-15 09:14:24.736691063 +0000 UTC m=+9.075136318 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d4126b6-996d-46d2-8abe-9fb14423f0ac-original-pull-secret") pod "global-pull-secret-syncer-hqkrc" (UID: "4d4126b6-996d-46d2-8abe-9fb14423f0ac") : object "kube-system"/"original-pull-secret" not registered
Sep 15 09:14:20.836873 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:20.836839    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9smf\" (UniqueName: \"kubernetes.io/projected/a457ba28-efbe-4cdf-b186-edbf98e80297-kube-api-access-p9smf\") pod \"network-check-target-pbttq\" (UID: \"a457ba28-efbe-4cdf-b186-edbf98e80297\") " pod="openshift-network-diagnostics/network-check-target-pbttq"
Sep 15 09:14:20.837070 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:20.837047    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 09:14:20.837131 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:20.837073    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 09:14:20.837131 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:20.837083    2578 projected.go:196] Error preparing data for projected volume kube-api-access-p9smf for pod openshift-network-diagnostics/network-check-target-pbttq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 09:14:20.837228 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:20.837134    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a457ba28-efbe-4cdf-b186-edbf98e80297-kube-api-access-p9smf podName:a457ba28-efbe-4cdf-b186-edbf98e80297 nodeName:}" failed. No retries permitted until 2026-09-15 09:14:24.837120193 +0000 UTC m=+9.175565451 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-p9smf" (UniqueName: "kubernetes.io/projected/a457ba28-efbe-4cdf-b186-edbf98e80297-kube-api-access-p9smf") pod "network-check-target-pbttq" (UID: "a457ba28-efbe-4cdf-b186-edbf98e80297") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 09:14:21.115438 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:21.115405    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hqkrc"
Sep 15 09:14:21.115601 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:21.115534    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbttq"
Sep 15 09:14:21.115668 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:21.115652    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pbttq" podUID="a457ba28-efbe-4cdf-b186-edbf98e80297"
Sep 15 09:14:21.115731 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:21.115543    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hqkrc" podUID="4d4126b6-996d-46d2-8abe-9fb14423f0ac"
Sep 15 09:14:21.115731 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:21.115689    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpphv"
Sep 15 09:14:21.115829 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:21.115745    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fpphv" podUID="5e176b54-2fe2-4b90-ae2b-f66860907acf"
Sep 15 09:14:23.115239 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:23.115205    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hqkrc"
Sep 15 09:14:23.115676 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:23.115247    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbttq"
Sep 15 09:14:23.115676 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:23.115204    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpphv"
Sep 15 09:14:23.115676 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:23.115345    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hqkrc" podUID="4d4126b6-996d-46d2-8abe-9fb14423f0ac"
Sep 15 09:14:23.115676 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:23.115440    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fpphv" podUID="5e176b54-2fe2-4b90-ae2b-f66860907acf"
Sep 15 09:14:23.115676 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:23.115510    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pbttq" podUID="a457ba28-efbe-4cdf-b186-edbf98e80297"
Sep 15 09:14:24.770251 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:24.770108    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e176b54-2fe2-4b90-ae2b-f66860907acf-metrics-certs\") pod \"network-metrics-daemon-fpphv\" (UID: \"5e176b54-2fe2-4b90-ae2b-f66860907acf\") " pod="openshift-multus/network-metrics-daemon-fpphv"
Sep 15 09:14:24.770251 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:24.770164    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d4126b6-996d-46d2-8abe-9fb14423f0ac-original-pull-secret\") pod \"global-pull-secret-syncer-hqkrc\" (UID: \"4d4126b6-996d-46d2-8abe-9fb14423f0ac\") " pod="kube-system/global-pull-secret-syncer-hqkrc"
Sep 15 09:14:24.770795 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:24.770269    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:14:24.770795 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:24.770333    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 09:14:24.770795 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:24.770342    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e176b54-2fe2-4b90-ae2b-f66860907acf-metrics-certs podName:5e176b54-2fe2-4b90-ae2b-f66860907acf nodeName:}" failed. No retries permitted until 2026-09-15 09:14:32.770321204 +0000 UTC m=+17.108766473 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e176b54-2fe2-4b90-ae2b-f66860907acf-metrics-certs") pod "network-metrics-daemon-fpphv" (UID: "5e176b54-2fe2-4b90-ae2b-f66860907acf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:14:24.770795 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:24.770401    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d4126b6-996d-46d2-8abe-9fb14423f0ac-original-pull-secret podName:4d4126b6-996d-46d2-8abe-9fb14423f0ac nodeName:}" failed. No retries permitted until 2026-09-15 09:14:32.770383937 +0000 UTC m=+17.108829195 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d4126b6-996d-46d2-8abe-9fb14423f0ac-original-pull-secret") pod "global-pull-secret-syncer-hqkrc" (UID: "4d4126b6-996d-46d2-8abe-9fb14423f0ac") : object "kube-system"/"original-pull-secret" not registered
Sep 15 09:14:24.871007 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:24.870973    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9smf\" (UniqueName: \"kubernetes.io/projected/a457ba28-efbe-4cdf-b186-edbf98e80297-kube-api-access-p9smf\") pod \"network-check-target-pbttq\" (UID: \"a457ba28-efbe-4cdf-b186-edbf98e80297\") " pod="openshift-network-diagnostics/network-check-target-pbttq"
Sep 15 09:14:24.871178 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:24.871135    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 09:14:24.871178 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:24.871155    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 09:14:24.871178 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:24.871167    2578 projected.go:196] Error preparing data for projected volume kube-api-access-p9smf for pod openshift-network-diagnostics/network-check-target-pbttq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 09:14:24.871374 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:24.871218    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a457ba28-efbe-4cdf-b186-edbf98e80297-kube-api-access-p9smf podName:a457ba28-efbe-4cdf-b186-edbf98e80297 nodeName:}" failed. No retries permitted until 2026-09-15 09:14:32.871201942 +0000 UTC m=+17.209647210 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-p9smf" (UniqueName: "kubernetes.io/projected/a457ba28-efbe-4cdf-b186-edbf98e80297-kube-api-access-p9smf") pod "network-check-target-pbttq" (UID: "a457ba28-efbe-4cdf-b186-edbf98e80297") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 09:14:25.116096 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:25.115495    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hqkrc"
Sep 15 09:14:25.116096 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:25.115527    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbttq"
Sep 15 09:14:25.116096 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:25.115632    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hqkrc" podUID="4d4126b6-996d-46d2-8abe-9fb14423f0ac"
Sep 15 09:14:25.116096 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:25.115685    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pbttq" podUID="a457ba28-efbe-4cdf-b186-edbf98e80297"
Sep 15 09:14:25.116096 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:25.115699    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpphv"
Sep 15 09:14:25.116096 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:25.115789    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fpphv" podUID="5e176b54-2fe2-4b90-ae2b-f66860907acf"
Sep 15 09:14:27.115831 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:27.115801    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hqkrc"
Sep 15 09:14:27.116258 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:27.115845    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbttq"
Sep 15 09:14:27.116258 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:27.115912    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpphv"
Sep 15 09:14:27.116258 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:27.115929    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hqkrc" podUID="4d4126b6-996d-46d2-8abe-9fb14423f0ac"
Sep 15 09:14:27.116258 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:27.116017    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fpphv" podUID="5e176b54-2fe2-4b90-ae2b-f66860907acf"
Sep 15 09:14:27.116258 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:27.116093    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pbttq" podUID="a457ba28-efbe-4cdf-b186-edbf98e80297"
Sep 15 09:14:29.115717 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:29.115683    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hqkrc"
Sep 15 09:14:29.116177 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:29.115727    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbttq"
Sep 15 09:14:29.116177 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:29.115686    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpphv"
Sep 15 09:14:29.116177 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:29.115814    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hqkrc" podUID="4d4126b6-996d-46d2-8abe-9fb14423f0ac"
Sep 15 09:14:29.116177 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:29.115927    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pbttq" podUID="a457ba28-efbe-4cdf-b186-edbf98e80297"
Sep 15 09:14:29.116177 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:29.116040    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fpphv" podUID="5e176b54-2fe2-4b90-ae2b-f66860907acf"
Sep 15 09:14:31.115803 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:31.115760    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hqkrc"
Sep 15 09:14:31.116275 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:31.115871    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbttq"
Sep 15 09:14:31.116275 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:31.115888    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hqkrc" podUID="4d4126b6-996d-46d2-8abe-9fb14423f0ac"
Sep 15 09:14:31.116275 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:31.115901    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpphv"
Sep 15 09:14:31.116275 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:31.115994    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pbttq" podUID="a457ba28-efbe-4cdf-b186-edbf98e80297"
Sep 15 09:14:31.116275 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:31.116087    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fpphv" podUID="5e176b54-2fe2-4b90-ae2b-f66860907acf"
Sep 15 09:14:32.828590 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:32.828551    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e176b54-2fe2-4b90-ae2b-f66860907acf-metrics-certs\") pod \"network-metrics-daemon-fpphv\" (UID: \"5e176b54-2fe2-4b90-ae2b-f66860907acf\") " pod="openshift-multus/network-metrics-daemon-fpphv"
Sep 15 09:14:32.829163 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:32.828604    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d4126b6-996d-46d2-8abe-9fb14423f0ac-original-pull-secret\") pod \"global-pull-secret-syncer-hqkrc\" (UID: \"4d4126b6-996d-46d2-8abe-9fb14423f0ac\") " pod="kube-system/global-pull-secret-syncer-hqkrc"
Sep 15 09:14:32.829163 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:32.828729    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 09:14:32.829163 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:32.828786    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d4126b6-996d-46d2-8abe-9fb14423f0ac-original-pull-secret podName:4d4126b6-996d-46d2-8abe-9fb14423f0ac nodeName:}" failed. No retries permitted until 2026-09-15 09:14:48.828774185 +0000 UTC m=+33.167219437 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d4126b6-996d-46d2-8abe-9fb14423f0ac-original-pull-secret") pod "global-pull-secret-syncer-hqkrc" (UID: "4d4126b6-996d-46d2-8abe-9fb14423f0ac") : object "kube-system"/"original-pull-secret" not registered
Sep 15 09:14:32.829163 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:32.828729    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:14:32.829163 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:32.828864    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e176b54-2fe2-4b90-ae2b-f66860907acf-metrics-certs podName:5e176b54-2fe2-4b90-ae2b-f66860907acf nodeName:}" failed. No retries permitted until 2026-09-15 09:14:48.828851245 +0000 UTC m=+33.167296509 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e176b54-2fe2-4b90-ae2b-f66860907acf-metrics-certs") pod "network-metrics-daemon-fpphv" (UID: "5e176b54-2fe2-4b90-ae2b-f66860907acf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:14:32.929046 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:32.929003    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9smf\" (UniqueName: \"kubernetes.io/projected/a457ba28-efbe-4cdf-b186-edbf98e80297-kube-api-access-p9smf\") pod \"network-check-target-pbttq\" (UID: \"a457ba28-efbe-4cdf-b186-edbf98e80297\") " pod="openshift-network-diagnostics/network-check-target-pbttq"
Sep 15 09:14:32.929208 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:32.929179    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 09:14:32.929208 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:32.929210    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 09:14:32.929376 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:32.929223    2578 projected.go:196] Error preparing data for projected volume kube-api-access-p9smf for pod openshift-network-diagnostics/network-check-target-pbttq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 09:14:32.929376 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:32.929272    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a457ba28-efbe-4cdf-b186-edbf98e80297-kube-api-access-p9smf podName:a457ba28-efbe-4cdf-b186-edbf98e80297 nodeName:}" failed. No retries permitted until 2026-09-15 09:14:48.929259409 +0000 UTC m=+33.267704661 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-p9smf" (UniqueName: "kubernetes.io/projected/a457ba28-efbe-4cdf-b186-edbf98e80297-kube-api-access-p9smf") pod "network-check-target-pbttq" (UID: "a457ba28-efbe-4cdf-b186-edbf98e80297") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 09:14:33.115174 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:33.115092    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbttq"
Sep 15 09:14:33.115174 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:33.115133    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hqkrc"
Sep 15 09:14:33.115386 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:33.115191    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpphv"
Sep 15 09:14:33.115386 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:33.115209    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pbttq" podUID="a457ba28-efbe-4cdf-b186-edbf98e80297"
Sep 15 09:14:33.115386 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:33.115268    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fpphv" podUID="5e176b54-2fe2-4b90-ae2b-f66860907acf"
Sep 15 09:14:33.115386 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:33.115333    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hqkrc" podUID="4d4126b6-996d-46d2-8abe-9fb14423f0ac"
Sep 15 09:14:35.115087 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:35.114997    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbttq"
Sep 15 09:14:35.115087 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:35.115036    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpphv"
Sep 15 09:14:35.115592 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:35.115109    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hqkrc"
Sep 15 09:14:35.115592 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:35.115119    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pbttq" podUID="a457ba28-efbe-4cdf-b186-edbf98e80297"
Sep 15 09:14:35.115592 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:35.115238    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hqkrc" podUID="4d4126b6-996d-46d2-8abe-9fb14423f0ac"
Sep 15 09:14:35.115592 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:35.115330    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fpphv" podUID="5e176b54-2fe2-4b90-ae2b-f66860907acf"
Sep 15 09:14:36.315831 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:36.315613    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xqglj" event={"ID":"79960bdd-9148-4e6c-8cec-189f5b35b25f","Type":"ContainerStarted","Data":"afb8e907f424c25dd65e202ab35a637dc20fa7106c24978b1141f542f39821cc"}
Sep 15 09:14:36.317866 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:36.317840    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-l8z2g" event={"ID":"689f5a38-1aeb-44ed-a218-7217946655d0","Type":"ContainerStarted","Data":"b33854793b0f3ded7cda6f39dd1d23dd9f6c511da89b771358dc2a69e2e81faa"}
Sep 15 09:14:36.321107 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:36.320926    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gp58d" event={"ID":"ebbb215c-b019-4a5f-933a-7614daf7e777","Type":"ContainerStarted","Data":"e697369ff7c153dc7246782b6341c6df14a7eaded779bf4fb5151f85a1153ae1"}
Sep 15 09:14:36.321107 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:36.321029    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gp58d" event={"ID":"ebbb215c-b019-4a5f-933a-7614daf7e777","Type":"ContainerStarted","Data":"7f07eb6aaa79c34eebcd56d0f6fe223b3168e21e5ed37bcf8e0098107f33e126"}
Sep 15 09:14:36.323964 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:36.323923    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-235.ec2.internal" event={"ID":"2b3d6833f74b07abf73dd136dadede80","Type":"ContainerStarted","Data":"78ac5762ef07d64793da601e9c28682b9a8bd9be9e8aa220c48d065c4f5fb477"}
Sep 15 09:14:36.350653 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:36.349468    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xqglj" podStartSLOduration=2.061102819 podStartE2EDuration="20.349448839s" totalImagesPullingTime="18.28834602s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:14:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:14:36.333163881 +0000 UTC m=+20.671609157" watchObservedRunningTime="2026-09-15 09:14:36.349448839 +0000 UTC m=+20.687894114"
Sep 15 09:14:36.362878 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:36.362713    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-235.ec2.internal" podStartSLOduration=20.362697721 podStartE2EDuration="20.362697721s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:14:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:14:36.362444384 +0000 UTC m=+20.700889659" watchObservedRunningTime="2026-09-15 09:14:36.362697721 +0000 UTC m=+20.701142995"
Sep 15 09:14:36.363375 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:36.363346    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-l8z2g" podStartSLOduration=2.057561941 podStartE2EDuration="20.363333379s" totalImagesPullingTime="18.305771438s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:14:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:14:36.349383886 +0000 UTC m=+20.687829163" watchObservedRunningTime="2026-09-15 09:14:36.363333379 +0000 UTC m=+20.701778657"
Sep 15 09:14:37.115515 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:37.115478    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hqkrc"
Sep 15 09:14:37.115657 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:37.115568    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hqkrc" podUID="4d4126b6-996d-46d2-8abe-9fb14423f0ac"
Sep 15 09:14:37.115657 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:37.115489    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbttq"
Sep 15 09:14:37.115767 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:37.115586    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpphv"
Sep 15 09:14:37.115767 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:37.115686    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pbttq" podUID="a457ba28-efbe-4cdf-b186-edbf98e80297"
Sep 15 09:14:37.115838 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:37.115762    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fpphv" podUID="5e176b54-2fe2-4b90-ae2b-f66860907acf"
Sep 15 09:14:37.327682 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:37.327608    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvbsm" event={"ID":"4e289063-8e66-4409-acff-6154b0ddae94","Type":"ContainerStarted","Data":"3da591661f5bfa43cdbd56a3afe5aefafe85c4fec59644458eda87e51933d48a"}
Sep 15 09:14:37.329406 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:37.329371    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jclv4" event={"ID":"6c49d708-0bbc-445a-baf3-03b239d8dd04","Type":"ContainerStarted","Data":"7b4aa3b18c321bc54676b9039cdeeafefb94ba0f51e86a14c1be5590e6bc3735"}
Sep 15 09:14:37.330926 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:37.330902    2578 generic.go:356] "Generic (PLEG): container finished" podID="621cf06d-684f-4bbb-a194-d944fa6d1752" containerID="c8d7d20388bb4458de724f3d3f50ab1370c666b9d2476c6f8d4e14dc94b2dde9" exitCode=0
Sep 15 09:14:37.331064 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:37.330981    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-826mj" event={"ID":"621cf06d-684f-4bbb-a194-d944fa6d1752","Type":"ContainerDied","Data":"c8d7d20388bb4458de724f3d3f50ab1370c666b9d2476c6f8d4e14dc94b2dde9"}
Sep 15 09:14:37.332631 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:37.332583    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-n5h5g" event={"ID":"60e02ffe-03b0-4ac9-b5d0-492856f7d07a","Type":"ContainerStarted","Data":"208482e7cb00725d9d5392cef8ae13137ce2aab7ccc3476a9eb6cad2e0a36c01"}
Sep 15 09:14:37.337534 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:37.337511    2578 generic.go:356] "Generic (PLEG): container finished" podID="93a9cd305dd93bbe9f79180cbc0e6eaa" containerID="bcc515081cc78224f957f66470b30a1bcef7627f38a3b694a715523ec4d6abd2" exitCode=0
Sep 15 09:14:37.337641 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:37.337577    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-235.ec2.internal" event={"ID":"93a9cd305dd93bbe9f79180cbc0e6eaa","Type":"ContainerDied","Data":"bcc515081cc78224f957f66470b30a1bcef7627f38a3b694a715523ec4d6abd2"}
Sep 15 09:14:37.339220 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:37.339196    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nhzm4" event={"ID":"552c9685-d39f-40b0-8f8d-79ba6b12fee7","Type":"ContainerStarted","Data":"7f7ce72f1f14b64b425efc03402587434296b6dee27278ab6d6e44579cea1452"}
Sep 15 09:14:37.343170 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:37.342929    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gp58d" event={"ID":"ebbb215c-b019-4a5f-933a-7614daf7e777","Type":"ContainerStarted","Data":"3f4881d8717fc656d4af24bec30c188dd8b1d04159bdac4cf414591bb074fde6"}
Sep 15 09:14:37.343170 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:37.343015    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gp58d" event={"ID":"ebbb215c-b019-4a5f-933a-7614daf7e777","Type":"ContainerStarted","Data":"228a4faccef7ce417ad7485432fb48b7bcb6ba65553df9c9496b886327065ef7"}
Sep 15 09:14:37.343170 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:37.343060    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gp58d" event={"ID":"ebbb215c-b019-4a5f-933a-7614daf7e777","Type":"ContainerStarted","Data":"ac481d70971b139d64bbd87e53363c3e3321bfb675e91cd55e6798a65c9a01a3"}
Sep 15 09:14:37.343170 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:37.343106    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gp58d" event={"ID":"ebbb215c-b019-4a5f-933a-7614daf7e777","Type":"ContainerStarted","Data":"0fb07a72bad6c547cb37b82b7e3e71399e41cdb41f16e4c2f8a160a9f4b13c31"}
Sep 15 09:14:37.346103 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:37.346080    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6lwmm" event={"ID":"5b0fcbbe-ae50-4282-ab2f-3d85fc2457a7","Type":"ContainerStarted","Data":"e1ac7b3669fa5aac7d9351ea03544c348086e37ca73d321a3bdc1043f43d0555"}
Sep 15 09:14:37.363454 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:37.363413    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jclv4" podStartSLOduration=3.129739807 podStartE2EDuration="21.363394923s" totalImagesPullingTime="18.233655116s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:14:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:14:37.343940125 +0000 UTC m=+21.682385403" watchObservedRunningTime="2026-09-15 09:14:37.363394923 +0000 UTC m=+21.701840199"
Sep 15 09:14:37.376109 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:37.376063    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-nhzm4" podStartSLOduration=3.194872861 podStartE2EDuration="21.376041327s" totalImagesPullingTime="18.181168466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:14:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:14:37.375455642 +0000 UTC m=+21.713900917" watchObservedRunningTime="2026-09-15 09:14:37.376041327 +0000 UTC m=+21.714492310"
Sep 15 09:14:37.389773 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:37.389741    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-n5h5g" podStartSLOduration=3.116251787 podStartE2EDuration="21.389729321s" totalImagesPullingTime="18.273477534s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:14:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:14:37.389249267 +0000 UTC m=+21.727694543" watchObservedRunningTime="2026-09-15 09:14:37.389729321 +0000 UTC m=+21.728174596"
Sep 15 09:14:37.416584 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:37.416547    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6lwmm" podStartSLOduration=3.129689019 podStartE2EDuration="21.416534828s" totalImagesPullingTime="18.286845809s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:14:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:14:37.416075678 +0000 UTC m=+21.754520954" watchObservedRunningTime="2026-09-15 09:14:37.416534828 +0000 UTC m=+21.754980102"
Sep 15 09:14:37.685683 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:37.685658    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-nhzm4"
Sep 15 09:14:37.686259 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:37.686242    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-nhzm4"
Sep 15 09:14:37.902053 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:37.902027    2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 15 09:14:38.057653 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:38.057543    2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-15T09:14:37.90204733Z","UUID":"1ed15545-8eba-49e7-9a08-3acd4dab520d","Handler":null,"Name":"","Endpoint":""}
Sep 15 09:14:38.059224 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:38.059197    2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 15 09:14:38.059355 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:38.059236    2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 15 09:14:38.351818 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:38.351784    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvbsm" event={"ID":"4e289063-8e66-4409-acff-6154b0ddae94","Type":"ContainerStarted","Data":"49eccd8dd6076624327ac42d4b19ea4438b0247a66ae73a0089a985b1537029e"}
Sep 15 09:14:38.354549 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:38.354517    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-235.ec2.internal" event={"ID":"93a9cd305dd93bbe9f79180cbc0e6eaa","Type":"ContainerStarted","Data":"4f7b073e359184bee1698493f5d4f22c94375407e8be4aa904d67d862a62d50b"}
Sep 15 09:14:38.355470 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:38.355447    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-nhzm4"
Sep 15 09:14:38.355911 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:38.355891    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nhzm4"
Sep 15 09:14:38.369390 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:38.369336    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-235.ec2.internal" podStartSLOduration=22.369320623 podStartE2EDuration="22.369320623s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:14:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:14:38.368578782 +0000 UTC m=+22.707024058" watchObservedRunningTime="2026-09-15 09:14:38.369320623 +0000 UTC m=+22.707765899"
Sep 15 09:14:39.116094 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:39.115875    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpphv"
Sep 15 09:14:39.116209 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:39.116170    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fpphv" podUID="5e176b54-2fe2-4b90-ae2b-f66860907acf"
Sep 15 09:14:39.116209 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:39.115920    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbttq"
Sep 15 09:14:39.116209 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:39.115889    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hqkrc"
Sep 15 09:14:39.116338 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:39.116253    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pbttq" podUID="a457ba28-efbe-4cdf-b186-edbf98e80297"
Sep 15 09:14:39.116338 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:39.116319    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hqkrc" podUID="4d4126b6-996d-46d2-8abe-9fb14423f0ac"
Sep 15 09:14:39.359982 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:39.359896    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gp58d" event={"ID":"ebbb215c-b019-4a5f-933a-7614daf7e777","Type":"ContainerStarted","Data":"1c934af72cf638805adcd1492de1a967332847aa4b85b5bc84b103ed11607442"}
Sep 15 09:14:39.361938 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:39.361908    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvbsm" event={"ID":"4e289063-8e66-4409-acff-6154b0ddae94","Type":"ContainerStarted","Data":"b061f30d9599981c5afc0c2502e5bf1851d2aa9e042b0acecacf658e8e39b57c"}
Sep 15 09:14:39.378767 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:39.378712    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvbsm" podStartSLOduration=2.759404789 podStartE2EDuration="23.378701973s" totalImagesPullingTime="20.619297184s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:14:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:14:39.378257151 +0000 UTC m=+23.716702436" watchObservedRunningTime="2026-09-15 09:14:39.378701973 +0000 UTC m=+23.717147247"
Sep 15 09:14:41.115265 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:41.115232    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbttq"
Sep 15 09:14:41.115265 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:41.115267    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hqkrc"
Sep 15 09:14:41.115742 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:41.115233    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpphv"
Sep 15 09:14:41.115742 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:41.115347    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pbttq" podUID="a457ba28-efbe-4cdf-b186-edbf98e80297"
Sep 15 09:14:41.115742 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:41.115410    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hqkrc" podUID="4d4126b6-996d-46d2-8abe-9fb14423f0ac"
Sep 15 09:14:41.115742 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:41.115474    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fpphv" podUID="5e176b54-2fe2-4b90-ae2b-f66860907acf"
Sep 15 09:14:43.115521 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:43.115313    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hqkrc"
Sep 15 09:14:43.115890 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:43.115339    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbttq"
Sep 15 09:14:43.115890 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:43.115558    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hqkrc" podUID="4d4126b6-996d-46d2-8abe-9fb14423f0ac"
Sep 15 09:14:43.115890 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:43.115374    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpphv"
Sep 15 09:14:43.115890 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:43.115624    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pbttq" podUID="a457ba28-efbe-4cdf-b186-edbf98e80297"
Sep 15 09:14:43.115890 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:43.115721    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fpphv" podUID="5e176b54-2fe2-4b90-ae2b-f66860907acf"
Sep 15 09:14:43.373580 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:43.373518    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gp58d" event={"ID":"ebbb215c-b019-4a5f-933a-7614daf7e777","Type":"ContainerStarted","Data":"3bdba459c57364f6cb36e79dc8aa2101f77206cbf3440b17b0afc3252387174f"}
Sep 15 09:14:43.373753 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:43.373728    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:43.375313 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:43.375292    2578 generic.go:356] "Generic (PLEG): container finished" podID="621cf06d-684f-4bbb-a194-d944fa6d1752" containerID="5a557df0e9e8bd4e935ab0f6b1c170e451c4ef92e09b9e896a03ccc132502dc1" exitCode=0
Sep 15 09:14:43.375413 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:43.375334    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-826mj" event={"ID":"621cf06d-684f-4bbb-a194-d944fa6d1752","Type":"ContainerDied","Data":"5a557df0e9e8bd4e935ab0f6b1c170e451c4ef92e09b9e896a03ccc132502dc1"}
Sep 15 09:14:43.388892 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:43.388873    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:43.399367 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:43.399331    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gp58d" podStartSLOduration=8.697264625 podStartE2EDuration="27.399319649s" totalImagesPullingTime="18.702055024s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:14:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:14:43.399033122 +0000 UTC m=+27.737478397" watchObservedRunningTime="2026-09-15 09:14:43.399319649 +0000 UTC m=+27.737764924"
Sep 15 09:14:43.956515 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:43.956489    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:44.315814 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:44.315752    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pbttq"]
Sep 15 09:14:44.316495 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:44.315848    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbttq"
Sep 15 09:14:44.316495 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:44.315983    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pbttq" podUID="a457ba28-efbe-4cdf-b186-edbf98e80297"
Sep 15 09:14:44.318689 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:44.318650    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hqkrc"]
Sep 15 09:14:44.318809 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:44.318742    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hqkrc"
Sep 15 09:14:44.318858 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:44.318837    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hqkrc" podUID="4d4126b6-996d-46d2-8abe-9fb14423f0ac"
Sep 15 09:14:44.319270 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:44.319244    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fpphv"]
Sep 15 09:14:44.319345 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:44.319316    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpphv"
Sep 15 09:14:44.319412 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:44.319396    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fpphv" podUID="5e176b54-2fe2-4b90-ae2b-f66860907acf"
Sep 15 09:14:44.377358 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:44.377332    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:44.391631 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:44.391609    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:14:45.381566 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:45.381359    2578 generic.go:356] "Generic (PLEG): container finished" podID="621cf06d-684f-4bbb-a194-d944fa6d1752" containerID="735a107385606cefe4fe9feccb6a4475acb7de46db663b412f5ca21a5f7046ec" exitCode=0
Sep 15 09:14:45.381894 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:45.381435    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-826mj" event={"ID":"621cf06d-684f-4bbb-a194-d944fa6d1752","Type":"ContainerDied","Data":"735a107385606cefe4fe9feccb6a4475acb7de46db663b412f5ca21a5f7046ec"}
Sep 15 09:14:46.116793 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:46.116767    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpphv"
Sep 15 09:14:46.117016 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:46.116855    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fpphv" podUID="5e176b54-2fe2-4b90-ae2b-f66860907acf"
Sep 15 09:14:46.117016 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:46.116881    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hqkrc"
Sep 15 09:14:46.117016 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:46.116887    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbttq"
Sep 15 09:14:46.117016 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:46.116994    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hqkrc" podUID="4d4126b6-996d-46d2-8abe-9fb14423f0ac"
Sep 15 09:14:46.117241 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:46.117045    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pbttq" podUID="a457ba28-efbe-4cdf-b186-edbf98e80297"
Sep 15 09:14:47.390098 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:47.390066    2578 generic.go:356] "Generic (PLEG): container finished" podID="621cf06d-684f-4bbb-a194-d944fa6d1752" containerID="d6ede0e3ab0efcd0c738d3d00d227322b94a1416ae098312cfa03559b240c437" exitCode=0
Sep 15 09:14:47.390541 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:47.390125    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-826mj" event={"ID":"621cf06d-684f-4bbb-a194-d944fa6d1752","Type":"ContainerDied","Data":"d6ede0e3ab0efcd0c738d3d00d227322b94a1416ae098312cfa03559b240c437"}
Sep 15 09:14:48.115386 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:48.115358    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpphv"
Sep 15 09:14:48.115386 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:48.115358    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hqkrc"
Sep 15 09:14:48.115575 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:48.115466    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hqkrc" podUID="4d4126b6-996d-46d2-8abe-9fb14423f0ac"
Sep 15 09:14:48.115575 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:48.115543    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fpphv" podUID="5e176b54-2fe2-4b90-ae2b-f66860907acf"
Sep 15 09:14:48.115642 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:48.115592    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbttq"
Sep 15 09:14:48.115684 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:48.115668    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pbttq" podUID="a457ba28-efbe-4cdf-b186-edbf98e80297"
Sep 15 09:14:48.842379 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:48.842352    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e176b54-2fe2-4b90-ae2b-f66860907acf-metrics-certs\") pod \"network-metrics-daemon-fpphv\" (UID: \"5e176b54-2fe2-4b90-ae2b-f66860907acf\") " pod="openshift-multus/network-metrics-daemon-fpphv"
Sep 15 09:14:48.842835 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:48.842394    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d4126b6-996d-46d2-8abe-9fb14423f0ac-original-pull-secret\") pod \"global-pull-secret-syncer-hqkrc\" (UID: \"4d4126b6-996d-46d2-8abe-9fb14423f0ac\") " pod="kube-system/global-pull-secret-syncer-hqkrc"
Sep 15 09:14:48.842835 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:48.842514    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:14:48.842835 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:48.842541    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 09:14:48.842835 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:48.842577    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e176b54-2fe2-4b90-ae2b-f66860907acf-metrics-certs podName:5e176b54-2fe2-4b90-ae2b-f66860907acf nodeName:}" failed. No retries permitted until 2026-09-15 09:15:20.842557446 +0000 UTC m=+65.181002707 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e176b54-2fe2-4b90-ae2b-f66860907acf-metrics-certs") pod "network-metrics-daemon-fpphv" (UID: "5e176b54-2fe2-4b90-ae2b-f66860907acf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:14:48.842835 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:48.842600    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d4126b6-996d-46d2-8abe-9fb14423f0ac-original-pull-secret podName:4d4126b6-996d-46d2-8abe-9fb14423f0ac nodeName:}" failed. No retries permitted until 2026-09-15 09:15:20.842588481 +0000 UTC m=+65.181033739 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d4126b6-996d-46d2-8abe-9fb14423f0ac-original-pull-secret") pod "global-pull-secret-syncer-hqkrc" (UID: "4d4126b6-996d-46d2-8abe-9fb14423f0ac") : object "kube-system"/"original-pull-secret" not registered
Sep 15 09:14:48.943213 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:48.943186    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9smf\" (UniqueName: \"kubernetes.io/projected/a457ba28-efbe-4cdf-b186-edbf98e80297-kube-api-access-p9smf\") pod \"network-check-target-pbttq\" (UID: \"a457ba28-efbe-4cdf-b186-edbf98e80297\") " pod="openshift-network-diagnostics/network-check-target-pbttq"
Sep 15 09:14:48.943400 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:48.943348    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 09:14:48.943400 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:48.943372    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 09:14:48.943400 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:48.943386    2578 projected.go:196] Error preparing data for projected volume kube-api-access-p9smf for pod openshift-network-diagnostics/network-check-target-pbttq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 09:14:48.943529 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:48.943442    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a457ba28-efbe-4cdf-b186-edbf98e80297-kube-api-access-p9smf podName:a457ba28-efbe-4cdf-b186-edbf98e80297 nodeName:}" failed. No retries permitted until 2026-09-15 09:15:20.943424766 +0000 UTC m=+65.281870020 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-p9smf" (UniqueName: "kubernetes.io/projected/a457ba28-efbe-4cdf-b186-edbf98e80297-kube-api-access-p9smf") pod "network-check-target-pbttq" (UID: "a457ba28-efbe-4cdf-b186-edbf98e80297") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 09:14:49.935896 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:49.935822    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-235.ec2.internal" event="NodeReady"
Sep 15 09:14:49.936376 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:49.935974    2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 15 09:14:49.980187 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:49.980160    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-w6zwc"]
Sep 15 09:14:50.001225 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.001201    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6qsww"]
Sep 15 09:14:50.001381 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.001333    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w6zwc"
Sep 15 09:14:50.004265 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.004238    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 15 09:14:50.004436 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.004356    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 15 09:14:50.004436 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.004254    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-r95hw\""
Sep 15 09:14:50.017284 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.017263    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6qsww"]
Sep 15 09:14:50.017410 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.017299    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-w6zwc"]
Sep 15 09:14:50.017410 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.017327    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xm6vk"]
Sep 15 09:14:50.017410 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.017393    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6qsww"
Sep 15 09:14:50.019836 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.019816    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wcvd7\""
Sep 15 09:14:50.020129 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.020108    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 15 09:14:50.020476 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.020284    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 15 09:14:50.020476 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.020309    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 15 09:14:50.035490 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.035469    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xm6vk"]
Sep 15 09:14:50.035611 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.035585    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xm6vk"
Sep 15 09:14:50.037907 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.037888    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pkv2r\""
Sep 15 09:14:50.038046 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.037929    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 15 09:14:50.038191 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.038171    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 15 09:14:50.038191 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.038196    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 15 09:14:50.038317 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.038199    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 15 09:14:50.107615 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.107593    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6lwmm_5b0fcbbe-ae50-4282-ab2f-3d85fc2457a7/dns-node-resolver/0.log"
Sep 15 09:14:50.115886 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.115862    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbttq"
Sep 15 09:14:50.116026 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.115871    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpphv"
Sep 15 09:14:50.116267 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.116224    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hqkrc"
Sep 15 09:14:50.118483 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.118456    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 15 09:14:50.118483 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.118456    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 15 09:14:50.118638 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.118556    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 15 09:14:50.118807 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.118790    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6rrz2\""
Sep 15 09:14:50.118905 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.118810    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 15 09:14:50.118987 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.118913    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ddxwx\""
Sep 15 09:14:50.150583 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.150560    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5b07bb7-60da-43c0-97b9-5d7e86227ddd-cert\") pod \"ingress-canary-6qsww\" (UID: \"f5b07bb7-60da-43c0-97b9-5d7e86227ddd\") " pod="openshift-ingress-canary/ingress-canary-6qsww"
Sep 15 09:14:50.150686 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.150623    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c97256c-a8d4-44f2-b32d-903189a7cbdf-metrics-tls\") pod \"dns-default-w6zwc\" (UID: \"5c97256c-a8d4-44f2-b32d-903189a7cbdf\") " pod="openshift-dns/dns-default-w6zwc"
Sep 15 09:14:50.150755 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.150695    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-897xx\" (UniqueName: \"kubernetes.io/projected/f5b07bb7-60da-43c0-97b9-5d7e86227ddd-kube-api-access-897xx\") pod \"ingress-canary-6qsww\" (UID: \"f5b07bb7-60da-43c0-97b9-5d7e86227ddd\") " pod="openshift-ingress-canary/ingress-canary-6qsww"
Sep 15 09:14:50.150755 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.150730    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c97256c-a8d4-44f2-b32d-903189a7cbdf-tmp-dir\") pod \"dns-default-w6zwc\" (UID: \"5c97256c-a8d4-44f2-b32d-903189a7cbdf\") " pod="openshift-dns/dns-default-w6zwc"
Sep 15 09:14:50.150857 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.150761    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tccgv\" (UniqueName: \"kubernetes.io/projected/5c97256c-a8d4-44f2-b32d-903189a7cbdf-kube-api-access-tccgv\") pod \"dns-default-w6zwc\" (UID: \"5c97256c-a8d4-44f2-b32d-903189a7cbdf\") " pod="openshift-dns/dns-default-w6zwc"
Sep 15 09:14:50.150857 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.150778    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/78b77780-8e3d-47c9-97ba-16744e7ad8f1-crio-socket\") pod \"insights-runtime-extractor-xm6vk\" (UID: \"78b77780-8e3d-47c9-97ba-16744e7ad8f1\") " pod="openshift-insights/insights-runtime-extractor-xm6vk"
Sep 15 09:14:50.150857 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.150794    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5c97256c-a8d4-44f2-b32d-903189a7cbdf-config-volume\") pod \"dns-default-w6zwc\" (UID: \"5c97256c-a8d4-44f2-b32d-903189a7cbdf\") " pod="openshift-dns/dns-default-w6zwc"
Sep 15 09:14:50.150857 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.150809    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/78b77780-8e3d-47c9-97ba-16744e7ad8f1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xm6vk\" (UID: \"78b77780-8e3d-47c9-97ba-16744e7ad8f1\") " pod="openshift-insights/insights-runtime-extractor-xm6vk"
Sep 15 09:14:50.150857 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.150834    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tndhb\" (UniqueName: \"kubernetes.io/projected/78b77780-8e3d-47c9-97ba-16744e7ad8f1-kube-api-access-tndhb\") pod \"insights-runtime-extractor-xm6vk\" (UID: \"78b77780-8e3d-47c9-97ba-16744e7ad8f1\") " pod="openshift-insights/insights-runtime-extractor-xm6vk"
Sep 15 09:14:50.151117 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.150870    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/78b77780-8e3d-47c9-97ba-16744e7ad8f1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xm6vk\" (UID: \"78b77780-8e3d-47c9-97ba-16744e7ad8f1\") " pod="openshift-insights/insights-runtime-extractor-xm6vk"
Sep 15 09:14:50.151117 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.150894    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/78b77780-8e3d-47c9-97ba-16744e7ad8f1-data-volume\") pod \"insights-runtime-extractor-xm6vk\" (UID: \"78b77780-8e3d-47c9-97ba-16744e7ad8f1\") " pod="openshift-insights/insights-runtime-extractor-xm6vk"
Sep 15 09:14:50.251899 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.251872    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tccgv\" (UniqueName: \"kubernetes.io/projected/5c97256c-a8d4-44f2-b32d-903189a7cbdf-kube-api-access-tccgv\") pod \"dns-default-w6zwc\" (UID: \"5c97256c-a8d4-44f2-b32d-903189a7cbdf\") " pod="openshift-dns/dns-default-w6zwc"
Sep 15 09:14:50.252041 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.251912    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/78b77780-8e3d-47c9-97ba-16744e7ad8f1-crio-socket\") pod \"insights-runtime-extractor-xm6vk\" (UID: \"78b77780-8e3d-47c9-97ba-16744e7ad8f1\") " pod="openshift-insights/insights-runtime-extractor-xm6vk"
Sep 15 09:14:50.252041 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.251939    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5c97256c-a8d4-44f2-b32d-903189a7cbdf-config-volume\") pod \"dns-default-w6zwc\" (UID: \"5c97256c-a8d4-44f2-b32d-903189a7cbdf\") " pod="openshift-dns/dns-default-w6zwc"
Sep 15 09:14:50.252041 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.251978    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/78b77780-8e3d-47c9-97ba-16744e7ad8f1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xm6vk\" (UID: \"78b77780-8e3d-47c9-97ba-16744e7ad8f1\") " pod="openshift-insights/insights-runtime-extractor-xm6vk"
Sep 15 09:14:50.252041 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.252006    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tndhb\" (UniqueName: \"kubernetes.io/projected/78b77780-8e3d-47c9-97ba-16744e7ad8f1-kube-api-access-tndhb\") pod \"insights-runtime-extractor-xm6vk\" (UID: \"78b77780-8e3d-47c9-97ba-16744e7ad8f1\") " pod="openshift-insights/insights-runtime-extractor-xm6vk"
Sep 15 09:14:50.252246 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.252062    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/78b77780-8e3d-47c9-97ba-16744e7ad8f1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xm6vk\" (UID: \"78b77780-8e3d-47c9-97ba-16744e7ad8f1\") " pod="openshift-insights/insights-runtime-extractor-xm6vk"
Sep 15 09:14:50.252246 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.252085    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/78b77780-8e3d-47c9-97ba-16744e7ad8f1-data-volume\") pod \"insights-runtime-extractor-xm6vk\" (UID: \"78b77780-8e3d-47c9-97ba-16744e7ad8f1\") " pod="openshift-insights/insights-runtime-extractor-xm6vk"
Sep 15 09:14:50.252246 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.252105    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5b07bb7-60da-43c0-97b9-5d7e86227ddd-cert\") pod \"ingress-canary-6qsww\" (UID: \"f5b07bb7-60da-43c0-97b9-5d7e86227ddd\") " pod="openshift-ingress-canary/ingress-canary-6qsww"
Sep 15 09:14:50.252246 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:50.252136    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 09:14:50.252246 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.252143    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/78b77780-8e3d-47c9-97ba-16744e7ad8f1-crio-socket\") pod \"insights-runtime-extractor-xm6vk\" (UID: \"78b77780-8e3d-47c9-97ba-16744e7ad8f1\") " pod="openshift-insights/insights-runtime-extractor-xm6vk"
Sep 15 09:14:50.252246 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:50.252197    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78b77780-8e3d-47c9-97ba-16744e7ad8f1-insights-runtime-extractor-tls podName:78b77780-8e3d-47c9-97ba-16744e7ad8f1 nodeName:}" failed. No retries permitted until 2026-09-15 09:14:50.752177456 +0000 UTC m=+35.090622717 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/78b77780-8e3d-47c9-97ba-16744e7ad8f1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xm6vk" (UID: "78b77780-8e3d-47c9-97ba-16744e7ad8f1") : secret "insights-runtime-extractor-tls" not found
Sep 15 09:14:50.252246 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:50.252211    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 09:14:50.252246 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:50.252250    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c97256c-a8d4-44f2-b32d-903189a7cbdf-metrics-tls podName:5c97256c-a8d4-44f2-b32d-903189a7cbdf nodeName:}" failed. No retries permitted until 2026-09-15 09:14:50.752239681 +0000 UTC m=+35.090684933 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5c97256c-a8d4-44f2-b32d-903189a7cbdf-metrics-tls") pod "dns-default-w6zwc" (UID: "5c97256c-a8d4-44f2-b32d-903189a7cbdf") : secret "dns-default-metrics-tls" not found
Sep 15 09:14:50.252660 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:50.252211    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 09:14:50.252660 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:50.252364    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/78b77780-8e3d-47c9-97ba-16744e7ad8f1-kube-rbac-proxy-cm podName:78b77780-8e3d-47c9-97ba-16744e7ad8f1 nodeName:}" failed. No retries permitted until 2026-09-15 09:14:50.752350409 +0000 UTC m=+35.090795690 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/78b77780-8e3d-47c9-97ba-16744e7ad8f1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xm6vk" (UID: "78b77780-8e3d-47c9-97ba-16744e7ad8f1") : configmap "kube-rbac-proxy" not found
Sep 15 09:14:50.252660 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.252144    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c97256c-a8d4-44f2-b32d-903189a7cbdf-metrics-tls\") pod \"dns-default-w6zwc\" (UID: \"5c97256c-a8d4-44f2-b32d-903189a7cbdf\") " pod="openshift-dns/dns-default-w6zwc"
Sep 15 09:14:50.252660 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.252411    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-897xx\" (UniqueName: \"kubernetes.io/projected/f5b07bb7-60da-43c0-97b9-5d7e86227ddd-kube-api-access-897xx\") pod \"ingress-canary-6qsww\" (UID: \"f5b07bb7-60da-43c0-97b9-5d7e86227ddd\") " pod="openshift-ingress-canary/ingress-canary-6qsww"
Sep 15 09:14:50.252660 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.252443    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c97256c-a8d4-44f2-b32d-903189a7cbdf-tmp-dir\") pod \"dns-default-w6zwc\" (UID: \"5c97256c-a8d4-44f2-b32d-903189a7cbdf\") " pod="openshift-dns/dns-default-w6zwc"
Sep 15 09:14:50.252660 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.252455    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/78b77780-8e3d-47c9-97ba-16744e7ad8f1-data-volume\") pod \"insights-runtime-extractor-xm6vk\" (UID: \"78b77780-8e3d-47c9-97ba-16744e7ad8f1\") " pod="openshift-insights/insights-runtime-extractor-xm6vk"
Sep 15 09:14:50.252660 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.252561    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5c97256c-a8d4-44f2-b32d-903189a7cbdf-config-volume\") pod \"dns-default-w6zwc\" (UID: \"5c97256c-a8d4-44f2-b32d-903189a7cbdf\") " pod="openshift-dns/dns-default-w6zwc"
Sep 15 09:14:50.253018 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.252778    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c97256c-a8d4-44f2-b32d-903189a7cbdf-tmp-dir\") pod \"dns-default-w6zwc\" (UID: \"5c97256c-a8d4-44f2-b32d-903189a7cbdf\") " pod="openshift-dns/dns-default-w6zwc"
Sep 15 09:14:50.256560 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.256541    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5b07bb7-60da-43c0-97b9-5d7e86227ddd-cert\") pod \"ingress-canary-6qsww\" (UID: \"f5b07bb7-60da-43c0-97b9-5d7e86227ddd\") " pod="openshift-ingress-canary/ingress-canary-6qsww"
Sep 15 09:14:50.260809 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.260787    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tndhb\" (UniqueName: \"kubernetes.io/projected/78b77780-8e3d-47c9-97ba-16744e7ad8f1-kube-api-access-tndhb\") pod \"insights-runtime-extractor-xm6vk\" (UID: \"78b77780-8e3d-47c9-97ba-16744e7ad8f1\") " pod="openshift-insights/insights-runtime-extractor-xm6vk"
Sep 15 09:14:50.261200 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.261182    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-897xx\" (UniqueName: \"kubernetes.io/projected/f5b07bb7-60da-43c0-97b9-5d7e86227ddd-kube-api-access-897xx\") pod \"ingress-canary-6qsww\" (UID: \"f5b07bb7-60da-43c0-97b9-5d7e86227ddd\") " pod="openshift-ingress-canary/ingress-canary-6qsww"
Sep 15 09:14:50.261284 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.261199    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tccgv\" (UniqueName: \"kubernetes.io/projected/5c97256c-a8d4-44f2-b32d-903189a7cbdf-kube-api-access-tccgv\") pod \"dns-default-w6zwc\" (UID: \"5c97256c-a8d4-44f2-b32d-903189a7cbdf\") " pod="openshift-dns/dns-default-w6zwc"
Sep 15 09:14:50.327274 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.327250    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6qsww"
Sep 15 09:14:50.640499 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.638732    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6qsww"]
Sep 15 09:14:50.755671 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.755637    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/78b77780-8e3d-47c9-97ba-16744e7ad8f1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xm6vk\" (UID: \"78b77780-8e3d-47c9-97ba-16744e7ad8f1\") " pod="openshift-insights/insights-runtime-extractor-xm6vk"
Sep 15 09:14:50.755852 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.755705    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/78b77780-8e3d-47c9-97ba-16744e7ad8f1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xm6vk\" (UID: \"78b77780-8e3d-47c9-97ba-16744e7ad8f1\") " pod="openshift-insights/insights-runtime-extractor-xm6vk"
Sep 15 09:14:50.755852 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:50.755764    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c97256c-a8d4-44f2-b32d-903189a7cbdf-metrics-tls\") pod \"dns-default-w6zwc\" (UID: \"5c97256c-a8d4-44f2-b32d-903189a7cbdf\") " pod="openshift-dns/dns-default-w6zwc"
Sep 15 09:14:50.755852 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:50.755826    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 09:14:50.756026 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:50.755851    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 09:14:50.756026 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:50.755882    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 09:14:50.756026 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:50.755911    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78b77780-8e3d-47c9-97ba-16744e7ad8f1-insights-runtime-extractor-tls podName:78b77780-8e3d-47c9-97ba-16744e7ad8f1 nodeName:}" failed. No retries permitted until 2026-09-15 09:14:51.755889355 +0000 UTC m=+36.094334609 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/78b77780-8e3d-47c9-97ba-16744e7ad8f1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xm6vk" (UID: "78b77780-8e3d-47c9-97ba-16744e7ad8f1") : secret "insights-runtime-extractor-tls" not found
Sep 15 09:14:50.756026 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:50.755929    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/78b77780-8e3d-47c9-97ba-16744e7ad8f1-kube-rbac-proxy-cm podName:78b77780-8e3d-47c9-97ba-16744e7ad8f1 nodeName:}" failed. No retries permitted until 2026-09-15 09:14:51.755921555 +0000 UTC m=+36.094366808 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/78b77780-8e3d-47c9-97ba-16744e7ad8f1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xm6vk" (UID: "78b77780-8e3d-47c9-97ba-16744e7ad8f1") : configmap "kube-rbac-proxy" not found
Sep 15 09:14:50.756026 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:50.755955    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c97256c-a8d4-44f2-b32d-903189a7cbdf-metrics-tls podName:5c97256c-a8d4-44f2-b32d-903189a7cbdf nodeName:}" failed. No retries permitted until 2026-09-15 09:14:51.75593537 +0000 UTC m=+36.094380623 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5c97256c-a8d4-44f2-b32d-903189a7cbdf-metrics-tls") pod "dns-default-w6zwc" (UID: "5c97256c-a8d4-44f2-b32d-903189a7cbdf") : secret "dns-default-metrics-tls" not found
Sep 15 09:14:51.074281 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:51.074258    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-n5h5g_60e02ffe-03b0-4ac9-b5d0-492856f7d07a/node-ca/0.log"
Sep 15 09:14:51.764504 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:51.764464    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/78b77780-8e3d-47c9-97ba-16744e7ad8f1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xm6vk\" (UID: \"78b77780-8e3d-47c9-97ba-16744e7ad8f1\") " pod="openshift-insights/insights-runtime-extractor-xm6vk"
Sep 15 09:14:51.764695 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:51.764577    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/78b77780-8e3d-47c9-97ba-16744e7ad8f1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xm6vk\" (UID: \"78b77780-8e3d-47c9-97ba-16744e7ad8f1\") " pod="openshift-insights/insights-runtime-extractor-xm6vk"
Sep 15 09:14:51.764695 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:51.764606    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 09:14:51.764695 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:51.764631    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c97256c-a8d4-44f2-b32d-903189a7cbdf-metrics-tls\") pod \"dns-default-w6zwc\" (UID: \"5c97256c-a8d4-44f2-b32d-903189a7cbdf\") " pod="openshift-dns/dns-default-w6zwc"
Sep 15 09:14:51.764695 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:51.764682    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78b77780-8e3d-47c9-97ba-16744e7ad8f1-insights-runtime-extractor-tls podName:78b77780-8e3d-47c9-97ba-16744e7ad8f1 nodeName:}" failed. No retries permitted until 2026-09-15 09:14:53.764660947 +0000 UTC m=+38.103106221 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/78b77780-8e3d-47c9-97ba-16744e7ad8f1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xm6vk" (UID: "78b77780-8e3d-47c9-97ba-16744e7ad8f1") : secret "insights-runtime-extractor-tls" not found
Sep 15 09:14:51.764877 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:51.764713    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 09:14:51.764877 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:51.764745    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 09:14:51.764877 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:51.764758    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/78b77780-8e3d-47c9-97ba-16744e7ad8f1-kube-rbac-proxy-cm podName:78b77780-8e3d-47c9-97ba-16744e7ad8f1 nodeName:}" failed. No retries permitted until 2026-09-15 09:14:53.764746791 +0000 UTC m=+38.103192049 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/78b77780-8e3d-47c9-97ba-16744e7ad8f1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xm6vk" (UID: "78b77780-8e3d-47c9-97ba-16744e7ad8f1") : configmap "kube-rbac-proxy" not found
Sep 15 09:14:51.764877 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:51.764796    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c97256c-a8d4-44f2-b32d-903189a7cbdf-metrics-tls podName:5c97256c-a8d4-44f2-b32d-903189a7cbdf nodeName:}" failed. No retries permitted until 2026-09-15 09:14:53.764781216 +0000 UTC m=+38.103226479 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5c97256c-a8d4-44f2-b32d-903189a7cbdf-metrics-tls") pod "dns-default-w6zwc" (UID: "5c97256c-a8d4-44f2-b32d-903189a7cbdf") : secret "dns-default-metrics-tls" not found
Sep 15 09:14:52.063089 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:52.063018    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5b07bb7_60da_43c0_97b9_5d7e86227ddd.slice/crio-35458f951655c67f306e3afeb7bff6618b39c42b8959d77c139fe6fd0dd7f43e WatchSource:0}: Error finding container 35458f951655c67f306e3afeb7bff6618b39c42b8959d77c139fe6fd0dd7f43e: Status 404 returned error can't find the container with id 35458f951655c67f306e3afeb7bff6618b39c42b8959d77c139fe6fd0dd7f43e
Sep 15 09:14:52.404659 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:52.404624    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6qsww" event={"ID":"f5b07bb7-60da-43c0-97b9-5d7e86227ddd","Type":"ContainerStarted","Data":"35458f951655c67f306e3afeb7bff6618b39c42b8959d77c139fe6fd0dd7f43e"}
Sep 15 09:14:52.407709 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:52.407682    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-826mj" event={"ID":"621cf06d-684f-4bbb-a194-d944fa6d1752","Type":"ContainerStarted","Data":"097110abe986a091422dbfb19517592afce7fe8406e542b104f274423fa5ca4d"}
Sep 15 09:14:53.414170 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:53.414079    2578 generic.go:356] "Generic (PLEG): container finished" podID="621cf06d-684f-4bbb-a194-d944fa6d1752" containerID="097110abe986a091422dbfb19517592afce7fe8406e542b104f274423fa5ca4d" exitCode=0
Sep 15 09:14:53.414170 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:53.414135    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-826mj" event={"ID":"621cf06d-684f-4bbb-a194-d944fa6d1752","Type":"ContainerDied","Data":"097110abe986a091422dbfb19517592afce7fe8406e542b104f274423fa5ca4d"}
Sep 15 09:14:53.431383 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:53.431351    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-426g5"]
Sep 15 09:14:53.447867 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:53.447836    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-426g5"
Sep 15 09:14:53.447867 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:53.447846    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-426g5"]
Sep 15 09:14:53.450319 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:53.450296    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 15 09:14:53.450319 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:53.450314    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 15 09:14:53.450465 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:53.450383    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-rbgqn\""
Sep 15 09:14:53.450509 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:53.450461    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 15 09:14:53.450744 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:53.450587    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 15 09:14:53.578034 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:53.578011    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9e7965a8-ad04-4b30-99ce-3b7598fe18bf-signing-key\") pod \"service-ca-568869fdc5-426g5\" (UID: \"9e7965a8-ad04-4b30-99ce-3b7598fe18bf\") " pod="openshift-service-ca/service-ca-568869fdc5-426g5"
Sep 15 09:14:53.578318 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:53.578298    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9e7965a8-ad04-4b30-99ce-3b7598fe18bf-signing-cabundle\") pod \"service-ca-568869fdc5-426g5\" (UID: \"9e7965a8-ad04-4b30-99ce-3b7598fe18bf\") " pod="openshift-service-ca/service-ca-568869fdc5-426g5"
Sep 15 09:14:53.578398 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:53.578326    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrwb5\" (UniqueName: \"kubernetes.io/projected/9e7965a8-ad04-4b30-99ce-3b7598fe18bf-kube-api-access-hrwb5\") pod \"service-ca-568869fdc5-426g5\" (UID: \"9e7965a8-ad04-4b30-99ce-3b7598fe18bf\") " pod="openshift-service-ca/service-ca-568869fdc5-426g5"
Sep 15 09:14:53.679631 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:53.679555    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9e7965a8-ad04-4b30-99ce-3b7598fe18bf-signing-cabundle\") pod \"service-ca-568869fdc5-426g5\" (UID: \"9e7965a8-ad04-4b30-99ce-3b7598fe18bf\") " pod="openshift-service-ca/service-ca-568869fdc5-426g5"
Sep 15 09:14:53.679631 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:53.679591    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrwb5\" (UniqueName: \"kubernetes.io/projected/9e7965a8-ad04-4b30-99ce-3b7598fe18bf-kube-api-access-hrwb5\") pod \"service-ca-568869fdc5-426g5\" (UID: \"9e7965a8-ad04-4b30-99ce-3b7598fe18bf\") " pod="openshift-service-ca/service-ca-568869fdc5-426g5"
Sep 15 09:14:53.683610 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:53.680106    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9e7965a8-ad04-4b30-99ce-3b7598fe18bf-signing-key\") pod \"service-ca-568869fdc5-426g5\" (UID: \"9e7965a8-ad04-4b30-99ce-3b7598fe18bf\") " pod="openshift-service-ca/service-ca-568869fdc5-426g5"
Sep 15 09:14:53.683610 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:53.680785    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9e7965a8-ad04-4b30-99ce-3b7598fe18bf-signing-cabundle\") pod \"service-ca-568869fdc5-426g5\" (UID: \"9e7965a8-ad04-4b30-99ce-3b7598fe18bf\") " pod="openshift-service-ca/service-ca-568869fdc5-426g5"
Sep 15 09:14:53.684452 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:53.684426    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9e7965a8-ad04-4b30-99ce-3b7598fe18bf-signing-key\") pod \"service-ca-568869fdc5-426g5\" (UID: \"9e7965a8-ad04-4b30-99ce-3b7598fe18bf\") " pod="openshift-service-ca/service-ca-568869fdc5-426g5"
Sep 15 09:14:53.687919 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:53.687900    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrwb5\" (UniqueName: \"kubernetes.io/projected/9e7965a8-ad04-4b30-99ce-3b7598fe18bf-kube-api-access-hrwb5\") pod \"service-ca-568869fdc5-426g5\" (UID: \"9e7965a8-ad04-4b30-99ce-3b7598fe18bf\") " pod="openshift-service-ca/service-ca-568869fdc5-426g5"
Sep 15 09:14:53.763142 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:53.763113    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-426g5"
Sep 15 09:14:53.780488 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:53.780458    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/78b77780-8e3d-47c9-97ba-16744e7ad8f1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xm6vk\" (UID: \"78b77780-8e3d-47c9-97ba-16744e7ad8f1\") " pod="openshift-insights/insights-runtime-extractor-xm6vk"
Sep 15 09:14:53.780612 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:53.780520    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c97256c-a8d4-44f2-b32d-903189a7cbdf-metrics-tls\") pod \"dns-default-w6zwc\" (UID: \"5c97256c-a8d4-44f2-b32d-903189a7cbdf\") " pod="openshift-dns/dns-default-w6zwc"
Sep 15 09:14:53.780612 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:53.780552    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/78b77780-8e3d-47c9-97ba-16744e7ad8f1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xm6vk\" (UID: \"78b77780-8e3d-47c9-97ba-16744e7ad8f1\") " pod="openshift-insights/insights-runtime-extractor-xm6vk"
Sep 15 09:14:53.780718 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:53.780609    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 09:14:53.780718 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:53.780640    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 09:14:53.780718 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:53.780677    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 09:14:53.780718 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:53.780681    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/78b77780-8e3d-47c9-97ba-16744e7ad8f1-kube-rbac-proxy-cm podName:78b77780-8e3d-47c9-97ba-16744e7ad8f1 nodeName:}" failed. No retries permitted until 2026-09-15 09:14:57.780658725 +0000 UTC m=+42.119103982 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/78b77780-8e3d-47c9-97ba-16744e7ad8f1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xm6vk" (UID: "78b77780-8e3d-47c9-97ba-16744e7ad8f1") : configmap "kube-rbac-proxy" not found
Sep 15 09:14:53.780902 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:53.780729    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78b77780-8e3d-47c9-97ba-16744e7ad8f1-insights-runtime-extractor-tls podName:78b77780-8e3d-47c9-97ba-16744e7ad8f1 nodeName:}" failed. No retries permitted until 2026-09-15 09:14:57.78071355 +0000 UTC m=+42.119158803 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/78b77780-8e3d-47c9-97ba-16744e7ad8f1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xm6vk" (UID: "78b77780-8e3d-47c9-97ba-16744e7ad8f1") : secret "insights-runtime-extractor-tls" not found
Sep 15 09:14:53.780902 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:53.780745    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c97256c-a8d4-44f2-b32d-903189a7cbdf-metrics-tls podName:5c97256c-a8d4-44f2-b32d-903189a7cbdf nodeName:}" failed. No retries permitted until 2026-09-15 09:14:57.780736165 +0000 UTC m=+42.119181418 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5c97256c-a8d4-44f2-b32d-903189a7cbdf-metrics-tls") pod "dns-default-w6zwc" (UID: "5c97256c-a8d4-44f2-b32d-903189a7cbdf") : secret "dns-default-metrics-tls" not found
Sep 15 09:14:54.419849 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:54.419823    2578 generic.go:356] "Generic (PLEG): container finished" podID="621cf06d-684f-4bbb-a194-d944fa6d1752" containerID="30fc4c978b202fd084729c969a72361ab31792bdd8e783047912a7172d45fdd3" exitCode=0
Sep 15 09:14:54.420328 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:54.419871    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-826mj" event={"ID":"621cf06d-684f-4bbb-a194-d944fa6d1752","Type":"ContainerDied","Data":"30fc4c978b202fd084729c969a72361ab31792bdd8e783047912a7172d45fdd3"}
Sep 15 09:14:54.671660 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:54.671611    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-426g5"]
Sep 15 09:14:54.758020 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:14:54.757992    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e7965a8_ad04_4b30_99ce_3b7598fe18bf.slice/crio-930ce78ae5bf160dec01288eaeb4cb5da52bf18db337e4b3a1f64ed49006c90b WatchSource:0}: Error finding container 930ce78ae5bf160dec01288eaeb4cb5da52bf18db337e4b3a1f64ed49006c90b: Status 404 returned error can't find the container with id 930ce78ae5bf160dec01288eaeb4cb5da52bf18db337e4b3a1f64ed49006c90b
Sep 15 09:14:55.424429 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:55.424394    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-426g5" event={"ID":"9e7965a8-ad04-4b30-99ce-3b7598fe18bf","Type":"ContainerStarted","Data":"930ce78ae5bf160dec01288eaeb4cb5da52bf18db337e4b3a1f64ed49006c90b"}
Sep 15 09:14:55.428516 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:55.428482    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-826mj" event={"ID":"621cf06d-684f-4bbb-a194-d944fa6d1752","Type":"ContainerStarted","Data":"952c7d8d3b029533835d11cac8522df72cab5582bdbb25d741013a48983db9fc"}
Sep 15 09:14:55.430192 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:55.430170    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6qsww" event={"ID":"f5b07bb7-60da-43c0-97b9-5d7e86227ddd","Type":"ContainerStarted","Data":"f0922fa1680b0196a99343821cc3bf59aa86dc71b33e987c8997a741f8167eb5"}
Sep 15 09:14:55.450257 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:55.450210    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-826mj" podStartSLOduration=8.936651871 podStartE2EDuration="39.450193549s" totalImagesPullingTime="30.513541678s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:14:16 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:14:55.448638328 +0000 UTC m=+39.787083603" watchObservedRunningTime="2026-09-15 09:14:55.450193549 +0000 UTC m=+39.788638829"
Sep 15 09:14:55.463072 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:55.463023    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6qsww" podStartSLOduration=3.74605889 podStartE2EDuration="6.463006857s" totalImagesPullingTime="2.716947967s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:14:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:14:55.462366621 +0000 UTC m=+39.800811900" watchObservedRunningTime="2026-09-15 09:14:55.463006857 +0000 UTC m=+39.801452133"
Sep 15 09:14:57.437315 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:57.437242    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-426g5" event={"ID":"9e7965a8-ad04-4b30-99ce-3b7598fe18bf","Type":"ContainerStarted","Data":"889680923c0bc79368d3bff11966dc6322bc82f09a1bda141b17c3d91743bb93"}
Sep 15 09:14:57.456140 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:57.456092    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-568869fdc5-426g5" podStartSLOduration=2.199397726 podStartE2EDuration="4.456077706s" totalImagesPullingTime="2.25667998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:14:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:14:57.454821491 +0000 UTC m=+41.793266767" watchObservedRunningTime="2026-09-15 09:14:57.456077706 +0000 UTC m=+41.794522981"
Sep 15 09:14:57.814036 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:57.814009    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/78b77780-8e3d-47c9-97ba-16744e7ad8f1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xm6vk\" (UID: \"78b77780-8e3d-47c9-97ba-16744e7ad8f1\") " pod="openshift-insights/insights-runtime-extractor-xm6vk"
Sep 15 09:14:57.814152 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:57.814060    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c97256c-a8d4-44f2-b32d-903189a7cbdf-metrics-tls\") pod \"dns-default-w6zwc\" (UID: \"5c97256c-a8d4-44f2-b32d-903189a7cbdf\") " pod="openshift-dns/dns-default-w6zwc"
Sep 15 09:14:57.814152 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:57.814134    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 09:14:57.814152 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:57.814133    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 09:14:57.814260 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:14:57.814171    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/78b77780-8e3d-47c9-97ba-16744e7ad8f1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xm6vk\" (UID: \"78b77780-8e3d-47c9-97ba-16744e7ad8f1\") " pod="openshift-insights/insights-runtime-extractor-xm6vk"
Sep 15 09:14:57.814260 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:57.814181    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c97256c-a8d4-44f2-b32d-903189a7cbdf-metrics-tls podName:5c97256c-a8d4-44f2-b32d-903189a7cbdf nodeName:}" failed. No retries permitted until 2026-09-15 09:15:05.814166072 +0000 UTC m=+50.152611325 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5c97256c-a8d4-44f2-b32d-903189a7cbdf-metrics-tls") pod "dns-default-w6zwc" (UID: "5c97256c-a8d4-44f2-b32d-903189a7cbdf") : secret "dns-default-metrics-tls" not found
Sep 15 09:14:57.814260 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:57.814241    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 09:14:57.814349 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:57.814257    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/78b77780-8e3d-47c9-97ba-16744e7ad8f1-kube-rbac-proxy-cm podName:78b77780-8e3d-47c9-97ba-16744e7ad8f1 nodeName:}" failed. No retries permitted until 2026-09-15 09:15:05.814235537 +0000 UTC m=+50.152680800 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/78b77780-8e3d-47c9-97ba-16744e7ad8f1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xm6vk" (UID: "78b77780-8e3d-47c9-97ba-16744e7ad8f1") : configmap "kube-rbac-proxy" not found
Sep 15 09:14:57.814349 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:14:57.814286    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78b77780-8e3d-47c9-97ba-16744e7ad8f1-insights-runtime-extractor-tls podName:78b77780-8e3d-47c9-97ba-16744e7ad8f1 nodeName:}" failed. No retries permitted until 2026-09-15 09:15:05.814277014 +0000 UTC m=+50.152722270 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/78b77780-8e3d-47c9-97ba-16744e7ad8f1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xm6vk" (UID: "78b77780-8e3d-47c9-97ba-16744e7ad8f1") : secret "insights-runtime-extractor-tls" not found
Sep 15 09:15:05.870909 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:05.870872    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/78b77780-8e3d-47c9-97ba-16744e7ad8f1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xm6vk\" (UID: \"78b77780-8e3d-47c9-97ba-16744e7ad8f1\") " pod="openshift-insights/insights-runtime-extractor-xm6vk"
Sep 15 09:15:05.871370 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:05.870928    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/78b77780-8e3d-47c9-97ba-16744e7ad8f1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xm6vk\" (UID: \"78b77780-8e3d-47c9-97ba-16744e7ad8f1\") " pod="openshift-insights/insights-runtime-extractor-xm6vk"
Sep 15 09:15:05.871370 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:05.871016    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c97256c-a8d4-44f2-b32d-903189a7cbdf-metrics-tls\") pod \"dns-default-w6zwc\" (UID: \"5c97256c-a8d4-44f2-b32d-903189a7cbdf\") " pod="openshift-dns/dns-default-w6zwc"
Sep 15 09:15:05.871370 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:15:05.871041    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 09:15:05.871370 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:15:05.871127    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78b77780-8e3d-47c9-97ba-16744e7ad8f1-insights-runtime-extractor-tls podName:78b77780-8e3d-47c9-97ba-16744e7ad8f1 nodeName:}" failed. No retries permitted until 2026-09-15 09:15:21.871108253 +0000 UTC m=+66.209553523 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/78b77780-8e3d-47c9-97ba-16744e7ad8f1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xm6vk" (UID: "78b77780-8e3d-47c9-97ba-16744e7ad8f1") : secret "insights-runtime-extractor-tls" not found
Sep 15 09:15:05.871530 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:05.871449    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/78b77780-8e3d-47c9-97ba-16744e7ad8f1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xm6vk\" (UID: \"78b77780-8e3d-47c9-97ba-16744e7ad8f1\") " pod="openshift-insights/insights-runtime-extractor-xm6vk"
Sep 15 09:15:05.873330 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:05.873310    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c97256c-a8d4-44f2-b32d-903189a7cbdf-metrics-tls\") pod \"dns-default-w6zwc\" (UID: \"5c97256c-a8d4-44f2-b32d-903189a7cbdf\") " pod="openshift-dns/dns-default-w6zwc"
Sep 15 09:15:05.912211 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:05.912182    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w6zwc"
Sep 15 09:15:06.181696 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:06.181633    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-w6zwc"]
Sep 15 09:15:06.184969 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:15:06.184931    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c97256c_a8d4_44f2_b32d_903189a7cbdf.slice/crio-ac0e7d8bb708e24515fd94401d5d338e687febc6eb9b9c27a2f8cedcc00a89c6 WatchSource:0}: Error finding container ac0e7d8bb708e24515fd94401d5d338e687febc6eb9b9c27a2f8cedcc00a89c6: Status 404 returned error can't find the container with id ac0e7d8bb708e24515fd94401d5d338e687febc6eb9b9c27a2f8cedcc00a89c6
Sep 15 09:15:06.458819 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:06.458783    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w6zwc" event={"ID":"5c97256c-a8d4-44f2-b32d-903189a7cbdf","Type":"ContainerStarted","Data":"ac0e7d8bb708e24515fd94401d5d338e687febc6eb9b9c27a2f8cedcc00a89c6"}
Sep 15 09:15:08.465862 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:08.465829    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w6zwc" event={"ID":"5c97256c-a8d4-44f2-b32d-903189a7cbdf","Type":"ContainerStarted","Data":"c258770609ff293d7dca1be110c163059d2c16d6407bddf52e12431178349225"}
Sep 15 09:15:08.466219 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:08.465881    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w6zwc" event={"ID":"5c97256c-a8d4-44f2-b32d-903189a7cbdf","Type":"ContainerStarted","Data":"2588aa2b5e73be61626c6e0702b26bbbdfc0fccaa09e01d7888e835f6b2a4cc6"}
Sep 15 09:15:08.466219 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:08.465970    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-w6zwc"
Sep 15 09:15:08.485442 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:08.485392    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-w6zwc" podStartSLOduration=17.794198814 podStartE2EDuration="19.485376761s" totalImagesPullingTime="1.691177947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:14:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:15:08.484720238 +0000 UTC m=+52.823165513" watchObservedRunningTime="2026-09-15 09:15:08.485376761 +0000 UTC m=+52.823822027"
Sep 15 09:15:15.300103 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:15.300061    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-wjsdn"]
Sep 15 09:15:15.332644 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:15.332615    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-wjsdn"]
Sep 15 09:15:15.332771 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:15.332717    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-wjsdn"
Sep 15 09:15:15.335127 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:15.335102    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 15 09:15:15.335443 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:15.335427    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 15 09:15:15.335794 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:15.335776    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-zv6vx\""
Sep 15 09:15:15.405887 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:15.405862    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-756984fb65-j28xh"]
Sep 15 09:15:15.423400 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:15.423378    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-756984fb65-j28xh"]
Sep 15 09:15:15.423538 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:15.423486    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-756984fb65-j28xh"
Sep 15 09:15:15.425845 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:15.425823    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 15 09:15:15.425977 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:15.425902    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 15 09:15:15.425977 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:15.425902    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 15 09:15:15.425977 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:15.425903    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pc6pr\""
Sep 15 09:15:15.430798 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:15.430780    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 15 09:15:15.432909 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:15.432886    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdxk8\" (UniqueName: \"kubernetes.io/projected/5bb7f43b-83cd-4018-9c7b-03b85b554e8a-kube-api-access-cdxk8\") pod \"downloads-76f99584f4-wjsdn\" (UID: \"5bb7f43b-83cd-4018-9c7b-03b85b554e8a\") " pod="openshift-console/downloads-76f99584f4-wjsdn"
Sep 15 09:15:15.433030 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:15.433014    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ad8afefa-a88b-4788-9a11-97bad041e1c0-ca-trust-extracted\") pod \"image-registry-756984fb65-j28xh\" (UID: \"ad8afefa-a88b-4788-9a11-97bad041e1c0\") " pod="openshift-image-registry/image-registry-756984fb65-j28xh"
Sep 15 09:15:15.433075 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:15.433044    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ad8afefa-a88b-4788-9a11-97bad041e1c0-trusted-ca\") pod \"image-registry-756984fb65-j28xh\" (UID: \"ad8afefa-a88b-4788-9a11-97bad041e1c0\") " pod="openshift-image-registry/image-registry-756984fb65-j28xh"
Sep 15 09:15:15.433109 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:15.433074    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ad8afefa-a88b-4788-9a11-97bad041e1c0-installation-pull-secrets\") pod \"image-registry-756984fb65-j28xh\" (UID: \"ad8afefa-a88b-4788-9a11-97bad041e1c0\") " pod="openshift-image-registry/image-registry-756984fb65-j28xh"
Sep 15 09:15:15.433142 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:15.433104    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ad8afefa-a88b-4788-9a11-97bad041e1c0-bound-sa-token\") pod \"image-registry-756984fb65-j28xh\" (UID: \"ad8afefa-a88b-4788-9a11-97bad041e1c0\") " pod="openshift-image-registry/image-registry-756984fb65-j28xh"
Sep 15 09:15:15.433174 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:15.433159    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ad8afefa-a88b-4788-9a11-97bad041e1c0-image-registry-private-configuration\") pod \"image-registry-756984fb65-j28xh\" (UID: \"ad8afefa-a88b-4788-9a11-97bad041e1c0\") " pod="openshift-image-registry/image-registry-756984fb65-j28xh"
Sep 15 09:15:15.433224 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:15.433210    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ad8afefa-a88b-4788-9a11-97bad041e1c0-registry-certificates\") pod \"image-registry-756984fb65-j28xh\" (UID: \"ad8afefa-a88b-4788-9a11-97bad041e1c0\") " pod="openshift-image-registry/image-registry-756984fb65-j28xh"
Sep 15 09:15:15.433259 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:15.433241    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ad8afefa-a88b-4788-9a11-97bad041e1c0-registry-tls\") pod \"image-registry-756984fb65-j28xh\" (UID: \"ad8afefa-a88b-4788-9a11-97bad041e1c0\") " pod="openshift-image-registry/image-registry-756984fb65-j28xh"
Sep 15 09:15:15.433314 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:15.433299    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zh64\" (UniqueName: \"kubernetes.io/projected/ad8afefa-a88b-4788-9a11-97bad041e1c0-kube-api-access-5zh64\") pod \"image-registry-756984fb65-j28xh\" (UID: \"ad8afefa-a88b-4788-9a11-97bad041e1c0\") " pod="openshift-image-registry/image-registry-756984fb65-j28xh"
Sep 15 09:15:15.534228 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:15.534201    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zh64\" (UniqueName: \"kubernetes.io/projected/ad8afefa-a88b-4788-9a11-97bad041e1c0-kube-api-access-5zh64\") pod \"image-registry-756984fb65-j28xh\" (UID: \"ad8afefa-a88b-4788-9a11-97bad041e1c0\") " pod="openshift-image-registry/image-registry-756984fb65-j28xh"
Sep 15 09:15:15.534331 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:15.534234    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdxk8\" (UniqueName: \"kubernetes.io/projected/5bb7f43b-83cd-4018-9c7b-03b85b554e8a-kube-api-access-cdxk8\") pod \"downloads-76f99584f4-wjsdn\" (UID: \"5bb7f43b-83cd-4018-9c7b-03b85b554e8a\") " pod="openshift-console/downloads-76f99584f4-wjsdn"
Sep 15 09:15:15.534331 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:15.534288    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ad8afefa-a88b-4788-9a11-97bad041e1c0-ca-trust-extracted\") pod \"image-registry-756984fb65-j28xh\" (UID: \"ad8afefa-a88b-4788-9a11-97bad041e1c0\") " pod="openshift-image-registry/image-registry-756984fb65-j28xh"
Sep 15 09:15:15.534331 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:15.534303    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ad8afefa-a88b-4788-9a11-97bad041e1c0-trusted-ca\") pod \"image-registry-756984fb65-j28xh\" (UID: \"ad8afefa-a88b-4788-9a11-97bad041e1c0\") " pod="openshift-image-registry/image-registry-756984fb65-j28xh"
Sep 15 09:15:15.534331 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:15.534319    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ad8afefa-a88b-4788-9a11-97bad041e1c0-installation-pull-secrets\") pod \"image-registry-756984fb65-j28xh\" (UID: \"ad8afefa-a88b-4788-9a11-97bad041e1c0\") " pod="openshift-image-registry/image-registry-756984fb65-j28xh"
Sep 15 09:15:15.534508 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:15.534336    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ad8afefa-a88b-4788-9a11-97bad041e1c0-bound-sa-token\") pod \"image-registry-756984fb65-j28xh\" (UID: \"ad8afefa-a88b-4788-9a11-97bad041e1c0\") " pod="openshift-image-registry/image-registry-756984fb65-j28xh"
Sep 15 09:15:15.534557 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:15.534503    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ad8afefa-a88b-4788-9a11-97bad041e1c0-image-registry-private-configuration\") pod \"image-registry-756984fb65-j28xh\" (UID: \"ad8afefa-a88b-4788-9a11-97bad041e1c0\") " pod="openshift-image-registry/image-registry-756984fb65-j28xh"
Sep 15 09:15:15.534619 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:15.534604    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ad8afefa-a88b-4788-9a11-97bad041e1c0-registry-certificates\") pod \"image-registry-756984fb65-j28xh\" (UID: \"ad8afefa-a88b-4788-9a11-97bad041e1c0\") " pod="openshift-image-registry/image-registry-756984fb65-j28xh"
Sep 15 09:15:15.534671 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:15.534638    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ad8afefa-a88b-4788-9a11-97bad041e1c0-registry-tls\") pod \"image-registry-756984fb65-j28xh\" (UID: \"ad8afefa-a88b-4788-9a11-97bad041e1c0\") " pod="openshift-image-registry/image-registry-756984fb65-j28xh"
Sep 15 09:15:15.534786 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:15.534760    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ad8afefa-a88b-4788-9a11-97bad041e1c0-ca-trust-extracted\") pod \"image-registry-756984fb65-j28xh\" (UID: \"ad8afefa-a88b-4788-9a11-97bad041e1c0\") " pod="openshift-image-registry/image-registry-756984fb65-j28xh"
Sep 15 09:15:15.535349 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:15.535322    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ad8afefa-a88b-4788-9a11-97bad041e1c0-trusted-ca\") pod \"image-registry-756984fb65-j28xh\" (UID: \"ad8afefa-a88b-4788-9a11-97bad041e1c0\") " pod="openshift-image-registry/image-registry-756984fb65-j28xh"
Sep 15 09:15:15.535349 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:15.535345    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ad8afefa-a88b-4788-9a11-97bad041e1c0-registry-certificates\") pod \"image-registry-756984fb65-j28xh\" (UID: \"ad8afefa-a88b-4788-9a11-97bad041e1c0\") " pod="openshift-image-registry/image-registry-756984fb65-j28xh"
Sep 15 09:15:15.536808 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:15.536780    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ad8afefa-a88b-4788-9a11-97bad041e1c0-installation-pull-secrets\") pod \"image-registry-756984fb65-j28xh\" (UID: \"ad8afefa-a88b-4788-9a11-97bad041e1c0\") " pod="openshift-image-registry/image-registry-756984fb65-j28xh"
Sep 15 09:15:15.536996 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:15.536976    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ad8afefa-a88b-4788-9a11-97bad041e1c0-registry-tls\") pod \"image-registry-756984fb65-j28xh\" (UID: \"ad8afefa-a88b-4788-9a11-97bad041e1c0\") " pod="openshift-image-registry/image-registry-756984fb65-j28xh"
Sep 15 09:15:15.537063 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:15.537000    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ad8afefa-a88b-4788-9a11-97bad041e1c0-image-registry-private-configuration\") pod \"image-registry-756984fb65-j28xh\" (UID: \"ad8afefa-a88b-4788-9a11-97bad041e1c0\") " pod="openshift-image-registry/image-registry-756984fb65-j28xh"
Sep 15 09:15:15.548145 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:15.548124    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ad8afefa-a88b-4788-9a11-97bad041e1c0-bound-sa-token\") pod \"image-registry-756984fb65-j28xh\" (UID: \"ad8afefa-a88b-4788-9a11-97bad041e1c0\") " pod="openshift-image-registry/image-registry-756984fb65-j28xh"
Sep 15 09:15:15.548342 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:15.548315    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdxk8\" (UniqueName: \"kubernetes.io/projected/5bb7f43b-83cd-4018-9c7b-03b85b554e8a-kube-api-access-cdxk8\") pod \"downloads-76f99584f4-wjsdn\" (UID: \"5bb7f43b-83cd-4018-9c7b-03b85b554e8a\") " pod="openshift-console/downloads-76f99584f4-wjsdn"
Sep 15 09:15:15.550423 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:15.550377    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zh64\" (UniqueName: \"kubernetes.io/projected/ad8afefa-a88b-4788-9a11-97bad041e1c0-kube-api-access-5zh64\") pod \"image-registry-756984fb65-j28xh\" (UID: \"ad8afefa-a88b-4788-9a11-97bad041e1c0\") " pod="openshift-image-registry/image-registry-756984fb65-j28xh"
Sep 15 09:15:15.641255 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:15.641234    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-wjsdn"
Sep 15 09:15:15.733910 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:15.733884    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-756984fb65-j28xh"
Sep 15 09:15:15.906858 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:15.906828    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-wjsdn"]
Sep 15 09:15:15.909218 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:15:15.909190    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bb7f43b_83cd_4018_9c7b_03b85b554e8a.slice/crio-2105841fd159b87a501c436f664f40316382b3f83ab8309d037791673e9623b4 WatchSource:0}: Error finding container 2105841fd159b87a501c436f664f40316382b3f83ab8309d037791673e9623b4: Status 404 returned error can't find the container with id 2105841fd159b87a501c436f664f40316382b3f83ab8309d037791673e9623b4
Sep 15 09:15:15.998359 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:15.998336    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-756984fb65-j28xh"]
Sep 15 09:15:16.000676 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:15:16.000635    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad8afefa_a88b_4788_9a11_97bad041e1c0.slice/crio-8fc1a3ef7f46420039914a9ae37fbab2d10870634ba7f8f5b42c9099cebd57a5 WatchSource:0}: Error finding container 8fc1a3ef7f46420039914a9ae37fbab2d10870634ba7f8f5b42c9099cebd57a5: Status 404 returned error can't find the container with id 8fc1a3ef7f46420039914a9ae37fbab2d10870634ba7f8f5b42c9099cebd57a5
Sep 15 09:15:16.399839 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:16.399181    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gp58d"
Sep 15 09:15:16.487992 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:16.487957    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-756984fb65-j28xh" event={"ID":"ad8afefa-a88b-4788-9a11-97bad041e1c0","Type":"ContainerStarted","Data":"171c5c35052287360851334300d33227d24207c1fb1d5438548f57ec8a19820d"}
Sep 15 09:15:16.488173 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:16.488009    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-756984fb65-j28xh" event={"ID":"ad8afefa-a88b-4788-9a11-97bad041e1c0","Type":"ContainerStarted","Data":"8fc1a3ef7f46420039914a9ae37fbab2d10870634ba7f8f5b42c9099cebd57a5"}
Sep 15 09:15:16.488173 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:16.488043    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-756984fb65-j28xh"
Sep 15 09:15:16.489216 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:16.489187    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-wjsdn" event={"ID":"5bb7f43b-83cd-4018-9c7b-03b85b554e8a","Type":"ContainerStarted","Data":"2105841fd159b87a501c436f664f40316382b3f83ab8309d037791673e9623b4"}
Sep 15 09:15:16.508181 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:16.508124    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-756984fb65-j28xh" podStartSLOduration=1.508104635 podStartE2EDuration="1.508104635s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:15:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:15:16.50786655 +0000 UTC m=+60.846311840" watchObservedRunningTime="2026-09-15 09:15:16.508104635 +0000 UTC m=+60.846549891"
Sep 15 09:15:18.470851 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:18.470819    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-w6zwc"
Sep 15 09:15:20.876768 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:20.876735    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e176b54-2fe2-4b90-ae2b-f66860907acf-metrics-certs\") pod \"network-metrics-daemon-fpphv\" (UID: \"5e176b54-2fe2-4b90-ae2b-f66860907acf\") " pod="openshift-multus/network-metrics-daemon-fpphv"
Sep 15 09:15:20.877250 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:20.876787    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d4126b6-996d-46d2-8abe-9fb14423f0ac-original-pull-secret\") pod \"global-pull-secret-syncer-hqkrc\" (UID: \"4d4126b6-996d-46d2-8abe-9fb14423f0ac\") " pod="kube-system/global-pull-secret-syncer-hqkrc"
Sep 15 09:15:20.879575 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:20.879549    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 15 09:15:20.879714 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:20.879608    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 15 09:15:20.889768 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:20.889743    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e176b54-2fe2-4b90-ae2b-f66860907acf-metrics-certs\") pod \"network-metrics-daemon-fpphv\" (UID: \"5e176b54-2fe2-4b90-ae2b-f66860907acf\") " pod="openshift-multus/network-metrics-daemon-fpphv"
Sep 15 09:15:20.889894 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:20.889801    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d4126b6-996d-46d2-8abe-9fb14423f0ac-original-pull-secret\") pod \"global-pull-secret-syncer-hqkrc\" (UID: \"4d4126b6-996d-46d2-8abe-9fb14423f0ac\") " pod="kube-system/global-pull-secret-syncer-hqkrc"
Sep 15 09:15:20.977738 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:20.977710    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9smf\" (UniqueName: \"kubernetes.io/projected/a457ba28-efbe-4cdf-b186-edbf98e80297-kube-api-access-p9smf\") pod \"network-check-target-pbttq\" (UID: \"a457ba28-efbe-4cdf-b186-edbf98e80297\") " pod="openshift-network-diagnostics/network-check-target-pbttq"
Sep 15 09:15:20.980392 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:20.980368    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 15 09:15:20.990261 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:20.990241    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 15 09:15:21.001785 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:21.001766    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9smf\" (UniqueName: \"kubernetes.io/projected/a457ba28-efbe-4cdf-b186-edbf98e80297-kube-api-access-p9smf\") pod \"network-check-target-pbttq\" (UID: \"a457ba28-efbe-4cdf-b186-edbf98e80297\") " pod="openshift-network-diagnostics/network-check-target-pbttq"
Sep 15 09:15:21.029839 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:21.029819    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6rrz2\""
Sep 15 09:15:21.036704 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:21.036686    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ddxwx\""
Sep 15 09:15:21.037756 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:21.037733    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbttq"
Sep 15 09:15:21.041525 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:21.041504    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hqkrc"
Sep 15 09:15:21.044749 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:21.044731    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fpphv"
Sep 15 09:15:21.318713 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:21.318684    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pbttq"]
Sep 15 09:15:21.321901 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:15:21.321861    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda457ba28_efbe_4cdf_b186_edbf98e80297.slice/crio-f899fe1ec7b1cdb988bcac5e77ca69ea660f5f4bf7001f07121b7a6bc22f9ce3 WatchSource:0}: Error finding container f899fe1ec7b1cdb988bcac5e77ca69ea660f5f4bf7001f07121b7a6bc22f9ce3: Status 404 returned error can't find the container with id f899fe1ec7b1cdb988bcac5e77ca69ea660f5f4bf7001f07121b7a6bc22f9ce3
Sep 15 09:15:21.331436 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:21.331408    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hqkrc"]
Sep 15 09:15:21.333242 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:21.333221    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fpphv"]
Sep 15 09:15:21.336492 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:15:21.336469    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d4126b6_996d_46d2_8abe_9fb14423f0ac.slice/crio-0ae4148e6a9d89f6b2e15513cda2d107166245330a11cf47f2b11dc31fcae8fc WatchSource:0}: Error finding container 0ae4148e6a9d89f6b2e15513cda2d107166245330a11cf47f2b11dc31fcae8fc: Status 404 returned error can't find the container with id 0ae4148e6a9d89f6b2e15513cda2d107166245330a11cf47f2b11dc31fcae8fc
Sep 15 09:15:21.337229 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:15:21.337207    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e176b54_2fe2_4b90_ae2b_f66860907acf.slice/crio-ac403b5c158a439fef8ff908f401658356bfab6dfb8e8b9ac7dc8b0e3f0541e6 WatchSource:0}: Error finding container ac403b5c158a439fef8ff908f401658356bfab6dfb8e8b9ac7dc8b0e3f0541e6: Status 404 returned error can't find the container with id ac403b5c158a439fef8ff908f401658356bfab6dfb8e8b9ac7dc8b0e3f0541e6
Sep 15 09:15:21.505297 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:21.505263    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fpphv" event={"ID":"5e176b54-2fe2-4b90-ae2b-f66860907acf","Type":"ContainerStarted","Data":"ac403b5c158a439fef8ff908f401658356bfab6dfb8e8b9ac7dc8b0e3f0541e6"}
Sep 15 09:15:21.506627 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:21.506592    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pbttq" event={"ID":"a457ba28-efbe-4cdf-b186-edbf98e80297","Type":"ContainerStarted","Data":"f899fe1ec7b1cdb988bcac5e77ca69ea660f5f4bf7001f07121b7a6bc22f9ce3"}
Sep 15 09:15:21.507734 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:21.507710    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hqkrc" event={"ID":"4d4126b6-996d-46d2-8abe-9fb14423f0ac","Type":"ContainerStarted","Data":"0ae4148e6a9d89f6b2e15513cda2d107166245330a11cf47f2b11dc31fcae8fc"}
Sep 15 09:15:21.884761 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:21.884680    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/78b77780-8e3d-47c9-97ba-16744e7ad8f1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xm6vk\" (UID: \"78b77780-8e3d-47c9-97ba-16744e7ad8f1\") " pod="openshift-insights/insights-runtime-extractor-xm6vk"
Sep 15 09:15:21.887485 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:21.887457    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/78b77780-8e3d-47c9-97ba-16744e7ad8f1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xm6vk\" (UID: \"78b77780-8e3d-47c9-97ba-16744e7ad8f1\") " pod="openshift-insights/insights-runtime-extractor-xm6vk"
Sep 15 09:15:22.148781 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:22.148700    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pkv2r\""
Sep 15 09:15:22.156905 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:22.156879    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xm6vk"
Sep 15 09:15:22.463514 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:22.463483    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xm6vk"]
Sep 15 09:15:22.802733 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:15:22.802650    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78b77780_8e3d_47c9_97ba_16744e7ad8f1.slice/crio-bf65683ef04f271ae5e5c75807578cab685227eef9bff104f5c3870aa27a0626 WatchSource:0}: Error finding container bf65683ef04f271ae5e5c75807578cab685227eef9bff104f5c3870aa27a0626: Status 404 returned error can't find the container with id bf65683ef04f271ae5e5c75807578cab685227eef9bff104f5c3870aa27a0626
Sep 15 09:15:23.518748 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:23.518715    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fpphv" event={"ID":"5e176b54-2fe2-4b90-ae2b-f66860907acf","Type":"ContainerStarted","Data":"7403eee85624811a6e5ad491f1a6a15c105eeed66459d45ba93e695de9a4fbdc"}
Sep 15 09:15:23.519243 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:23.518779    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fpphv" event={"ID":"5e176b54-2fe2-4b90-ae2b-f66860907acf","Type":"ContainerStarted","Data":"34d97059d4c00534a61cd0df7b92bdf6ff7588c1d8475b30c4d17c7f763305d8"}
Sep 15 09:15:23.520961 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:23.520918    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xm6vk" event={"ID":"78b77780-8e3d-47c9-97ba-16744e7ad8f1","Type":"ContainerStarted","Data":"00514eeaa504eb8ffbe7a19e2d25e3d397cf99090f03735af51becf7a41558da"}
Sep 15 09:15:23.521094 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:23.520993    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xm6vk" event={"ID":"78b77780-8e3d-47c9-97ba-16744e7ad8f1","Type":"ContainerStarted","Data":"bf65683ef04f271ae5e5c75807578cab685227eef9bff104f5c3870aa27a0626"}
Sep 15 09:15:24.528184 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:24.528061    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xm6vk" event={"ID":"78b77780-8e3d-47c9-97ba-16744e7ad8f1","Type":"ContainerStarted","Data":"6684c0f34049ebf203218fc1887f068c29d9221818e57b8653803a242fe07006"}
Sep 15 09:15:34.570001 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:34.569969    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hqkrc" event={"ID":"4d4126b6-996d-46d2-8abe-9fb14423f0ac","Type":"ContainerStarted","Data":"a50dbf73f10608930caa3d0c567ad2621715c184f42d5a38a26b57d833634def"}
Sep 15 09:15:34.571511 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:34.571480    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-wjsdn" event={"ID":"5bb7f43b-83cd-4018-9c7b-03b85b554e8a","Type":"ContainerStarted","Data":"0026dbbbce6861c9990d0e22bdebffc5f7ae8d83c279b7fddf0754651d23cdf4"}
Sep 15 09:15:34.571621 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:34.571600    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-wjsdn"
Sep 15 09:15:34.573096 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:34.573075    2578 patch_prober.go:28] interesting pod/downloads-76f99584f4-wjsdn container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.134.0.10:8080/\": dial tcp 10.134.0.10:8080: connect: connection refused" start-of-body=
Sep 15 09:15:34.573209 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:34.573120    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-76f99584f4-wjsdn" podUID="5bb7f43b-83cd-4018-9c7b-03b85b554e8a" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.10:8080/\": dial tcp 10.134.0.10:8080: connect: connection refused"
Sep 15 09:15:34.573271 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:34.573207    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pbttq" event={"ID":"a457ba28-efbe-4cdf-b186-edbf98e80297","Type":"ContainerStarted","Data":"905b8624e43b2f092211d47f1735e5508e34f923057badb4b748d6a627047f38"}
Sep 15 09:15:34.573321 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:34.573315    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-pbttq"
Sep 15 09:15:34.587666 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:34.587526    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fpphv" podStartSLOduration=76.94501792 podStartE2EDuration="1m18.587513734s" totalImagesPullingTime="1.642495814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:14:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:15:23.536775993 +0000 UTC m=+67.875221278" watchObservedRunningTime="2026-09-15 09:15:34.587513734 +0000 UTC m=+78.925959009"
Sep 15 09:15:34.587788 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:34.587760    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hqkrc" podStartSLOduration=65.773895687 podStartE2EDuration="1m18.587749006s" totalImagesPullingTime="12.813853319s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:14:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:15:34.586632196 +0000 UTC m=+78.925077471" watchObservedRunningTime="2026-09-15 09:15:34.587749006 +0000 UTC m=+78.926194282"
Sep 15 09:15:34.601960 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:34.601901    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-pbttq" podStartSLOduration=66.211023207 podStartE2EDuration="1m18.601875731s" totalImagesPullingTime="12.390852524s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:14:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:15:34.601476871 +0000 UTC m=+78.939922146" watchObservedRunningTime="2026-09-15 09:15:34.601875731 +0000 UTC m=+78.940321013"
Sep 15 09:15:34.618897 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:34.618852    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-wjsdn" podStartSLOduration=1.377536595 podStartE2EDuration="19.618838029s" totalImagesPullingTime="18.241301434s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:15:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:15:34.617684309 +0000 UTC m=+78.956129585" watchObservedRunningTime="2026-09-15 09:15:34.618838029 +0000 UTC m=+78.957283303"
Sep 15 09:15:35.580312 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:35.580269    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xm6vk" event={"ID":"78b77780-8e3d-47c9-97ba-16744e7ad8f1","Type":"ContainerStarted","Data":"1bf013fcf591e30bd17bb98514995fc99f1c94bbaf6598f0acc82fb59fd9a650"}
Sep 15 09:15:35.598643 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:35.598613    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-wjsdn"
Sep 15 09:15:35.600744 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:35.600699    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xm6vk" podStartSLOduration=35.07743012 podStartE2EDuration="46.600677962s" totalImagesPullingTime="11.523247842s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:14:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:15:35.59925905 +0000 UTC m=+79.937704327" watchObservedRunningTime="2026-09-15 09:15:35.600677962 +0000 UTC m=+79.939123237"
Sep 15 09:15:37.497707 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:37.497680    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-756984fb65-j28xh"
Sep 15 09:15:37.686275 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:37.686237    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-689b7b4d6d-zr5rw"]
Sep 15 09:15:37.705267 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:37.705239    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-689b7b4d6d-zr5rw"]
Sep 15 09:15:37.705424 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:37.705381    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-689b7b4d6d-zr5rw"
Sep 15 09:15:37.707929 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:37.707907    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 15 09:15:37.711980 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:37.709424    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 15 09:15:37.711980 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:37.711281    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 15 09:15:37.711980 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:37.711701    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 15 09:15:37.718021 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:37.717596    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2vbkq\""
Sep 15 09:15:37.718021 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:37.717602    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 15 09:15:37.792848 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:37.792772    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/21fdbbc4-98af-492c-8165-acd08bc6394c-console-oauth-config\") pod \"console-689b7b4d6d-zr5rw\" (UID: \"21fdbbc4-98af-492c-8165-acd08bc6394c\") " pod="openshift-console/console-689b7b4d6d-zr5rw"
Sep 15 09:15:37.792848 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:37.792815    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/21fdbbc4-98af-492c-8165-acd08bc6394c-console-config\") pod \"console-689b7b4d6d-zr5rw\" (UID: \"21fdbbc4-98af-492c-8165-acd08bc6394c\") " pod="openshift-console/console-689b7b4d6d-zr5rw"
Sep 15 09:15:37.793044 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:37.792854    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/21fdbbc4-98af-492c-8165-acd08bc6394c-console-serving-cert\") pod \"console-689b7b4d6d-zr5rw\" (UID: \"21fdbbc4-98af-492c-8165-acd08bc6394c\") " pod="openshift-console/console-689b7b4d6d-zr5rw"
Sep 15 09:15:37.793044 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:37.792911    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/21fdbbc4-98af-492c-8165-acd08bc6394c-service-ca\") pod \"console-689b7b4d6d-zr5rw\" (UID: \"21fdbbc4-98af-492c-8165-acd08bc6394c\") " pod="openshift-console/console-689b7b4d6d-zr5rw"
Sep 15 09:15:37.793044 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:37.792966    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/21fdbbc4-98af-492c-8165-acd08bc6394c-oauth-serving-cert\") pod \"console-689b7b4d6d-zr5rw\" (UID: \"21fdbbc4-98af-492c-8165-acd08bc6394c\") " pod="openshift-console/console-689b7b4d6d-zr5rw"
Sep 15 09:15:37.793044 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:37.792991    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpj6p\" (UniqueName: \"kubernetes.io/projected/21fdbbc4-98af-492c-8165-acd08bc6394c-kube-api-access-qpj6p\") pod \"console-689b7b4d6d-zr5rw\" (UID: \"21fdbbc4-98af-492c-8165-acd08bc6394c\") " pod="openshift-console/console-689b7b4d6d-zr5rw"
Sep 15 09:15:37.894274 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:37.894242    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/21fdbbc4-98af-492c-8165-acd08bc6394c-console-serving-cert\") pod \"console-689b7b4d6d-zr5rw\" (UID: \"21fdbbc4-98af-492c-8165-acd08bc6394c\") " pod="openshift-console/console-689b7b4d6d-zr5rw"
Sep 15 09:15:37.894422 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:37.894282    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/21fdbbc4-98af-492c-8165-acd08bc6394c-service-ca\") pod \"console-689b7b4d6d-zr5rw\" (UID: \"21fdbbc4-98af-492c-8165-acd08bc6394c\") " pod="openshift-console/console-689b7b4d6d-zr5rw"
Sep 15 09:15:37.894422 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:37.894319    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/21fdbbc4-98af-492c-8165-acd08bc6394c-oauth-serving-cert\") pod \"console-689b7b4d6d-zr5rw\" (UID: \"21fdbbc4-98af-492c-8165-acd08bc6394c\") " pod="openshift-console/console-689b7b4d6d-zr5rw"
Sep 15 09:15:37.894422 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:37.894340    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpj6p\" (UniqueName: \"kubernetes.io/projected/21fdbbc4-98af-492c-8165-acd08bc6394c-kube-api-access-qpj6p\") pod \"console-689b7b4d6d-zr5rw\" (UID: \"21fdbbc4-98af-492c-8165-acd08bc6394c\") " pod="openshift-console/console-689b7b4d6d-zr5rw"
Sep 15 09:15:37.894422 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:37.894399    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/21fdbbc4-98af-492c-8165-acd08bc6394c-console-oauth-config\") pod \"console-689b7b4d6d-zr5rw\" (UID: \"21fdbbc4-98af-492c-8165-acd08bc6394c\") " pod="openshift-console/console-689b7b4d6d-zr5rw"
Sep 15 09:15:37.894622 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:37.894426    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/21fdbbc4-98af-492c-8165-acd08bc6394c-console-config\") pod \"console-689b7b4d6d-zr5rw\" (UID: \"21fdbbc4-98af-492c-8165-acd08bc6394c\") " pod="openshift-console/console-689b7b4d6d-zr5rw"
Sep 15 09:15:37.895899 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:37.895873    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/21fdbbc4-98af-492c-8165-acd08bc6394c-console-config\") pod \"console-689b7b4d6d-zr5rw\" (UID: \"21fdbbc4-98af-492c-8165-acd08bc6394c\") " pod="openshift-console/console-689b7b4d6d-zr5rw"
Sep 15 09:15:37.896073 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:37.895927    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/21fdbbc4-98af-492c-8165-acd08bc6394c-oauth-serving-cert\") pod \"console-689b7b4d6d-zr5rw\" (UID: \"21fdbbc4-98af-492c-8165-acd08bc6394c\") " pod="openshift-console/console-689b7b4d6d-zr5rw"
Sep 15 09:15:37.896761 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:37.896725    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/21fdbbc4-98af-492c-8165-acd08bc6394c-service-ca\") pod \"console-689b7b4d6d-zr5rw\" (UID: \"21fdbbc4-98af-492c-8165-acd08bc6394c\") " pod="openshift-console/console-689b7b4d6d-zr5rw"
Sep 15 09:15:37.904913 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:37.904889    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/21fdbbc4-98af-492c-8165-acd08bc6394c-console-oauth-config\") pod \"console-689b7b4d6d-zr5rw\" (UID: \"21fdbbc4-98af-492c-8165-acd08bc6394c\") " pod="openshift-console/console-689b7b4d6d-zr5rw"
Sep 15 09:15:37.922379 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:37.922353    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/21fdbbc4-98af-492c-8165-acd08bc6394c-console-serving-cert\") pod \"console-689b7b4d6d-zr5rw\" (UID: \"21fdbbc4-98af-492c-8165-acd08bc6394c\") " pod="openshift-console/console-689b7b4d6d-zr5rw"
Sep 15 09:15:37.922496 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:37.922479    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpj6p\" (UniqueName: \"kubernetes.io/projected/21fdbbc4-98af-492c-8165-acd08bc6394c-kube-api-access-qpj6p\") pod \"console-689b7b4d6d-zr5rw\" (UID: \"21fdbbc4-98af-492c-8165-acd08bc6394c\") " pod="openshift-console/console-689b7b4d6d-zr5rw"
Sep 15 09:15:38.019063 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:38.019032    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-689b7b4d6d-zr5rw"
Sep 15 09:15:38.344387 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:38.344319    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-689b7b4d6d-zr5rw"]
Sep 15 09:15:38.347616 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:15:38.347589    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21fdbbc4_98af_492c_8165_acd08bc6394c.slice/crio-79ed631745954019fab61dc11c37458f705ef93dacc35b844db39045e95c5d4b WatchSource:0}: Error finding container 79ed631745954019fab61dc11c37458f705ef93dacc35b844db39045e95c5d4b: Status 404 returned error can't find the container with id 79ed631745954019fab61dc11c37458f705ef93dacc35b844db39045e95c5d4b
Sep 15 09:15:38.593809 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:38.593703    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-689b7b4d6d-zr5rw" event={"ID":"21fdbbc4-98af-492c-8165-acd08bc6394c","Type":"ContainerStarted","Data":"79ed631745954019fab61dc11c37458f705ef93dacc35b844db39045e95c5d4b"}
Sep 15 09:15:38.668930 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:38.668864    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57876c4c87-kvqd7"]
Sep 15 09:15:38.692703 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:38.692672    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57876c4c87-kvqd7"]
Sep 15 09:15:38.692858 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:38.692807    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57876c4c87-kvqd7"
Sep 15 09:15:38.700111 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:38.700082    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 15 09:15:38.801358 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:38.801324    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/965c85ad-81e8-488f-8ff3-af41b04b7c6c-console-config\") pod \"console-57876c4c87-kvqd7\" (UID: \"965c85ad-81e8-488f-8ff3-af41b04b7c6c\") " pod="openshift-console/console-57876c4c87-kvqd7"
Sep 15 09:15:38.801517 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:38.801367    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mnt7\" (UniqueName: \"kubernetes.io/projected/965c85ad-81e8-488f-8ff3-af41b04b7c6c-kube-api-access-6mnt7\") pod \"console-57876c4c87-kvqd7\" (UID: \"965c85ad-81e8-488f-8ff3-af41b04b7c6c\") " pod="openshift-console/console-57876c4c87-kvqd7"
Sep 15 09:15:38.801517 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:38.801392    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/965c85ad-81e8-488f-8ff3-af41b04b7c6c-console-serving-cert\") pod \"console-57876c4c87-kvqd7\" (UID: \"965c85ad-81e8-488f-8ff3-af41b04b7c6c\") " pod="openshift-console/console-57876c4c87-kvqd7"
Sep 15 09:15:38.801639 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:38.801510    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/965c85ad-81e8-488f-8ff3-af41b04b7c6c-service-ca\") pod \"console-57876c4c87-kvqd7\" (UID: \"965c85ad-81e8-488f-8ff3-af41b04b7c6c\") " pod="openshift-console/console-57876c4c87-kvqd7"
Sep 15 09:15:38.801639 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:38.801563    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/965c85ad-81e8-488f-8ff3-af41b04b7c6c-console-oauth-config\") pod \"console-57876c4c87-kvqd7\" (UID: \"965c85ad-81e8-488f-8ff3-af41b04b7c6c\") " pod="openshift-console/console-57876c4c87-kvqd7"
Sep 15 09:15:38.801639 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:38.801590    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/965c85ad-81e8-488f-8ff3-af41b04b7c6c-trusted-ca-bundle\") pod \"console-57876c4c87-kvqd7\" (UID: \"965c85ad-81e8-488f-8ff3-af41b04b7c6c\") " pod="openshift-console/console-57876c4c87-kvqd7"
Sep 15 09:15:38.801639 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:38.801614    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/965c85ad-81e8-488f-8ff3-af41b04b7c6c-oauth-serving-cert\") pod \"console-57876c4c87-kvqd7\" (UID: \"965c85ad-81e8-488f-8ff3-af41b04b7c6c\") " pod="openshift-console/console-57876c4c87-kvqd7"
Sep 15 09:15:38.902883 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:38.902851    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/965c85ad-81e8-488f-8ff3-af41b04b7c6c-console-config\") pod \"console-57876c4c87-kvqd7\" (UID: \"965c85ad-81e8-488f-8ff3-af41b04b7c6c\") " pod="openshift-console/console-57876c4c87-kvqd7"
Sep 15 09:15:38.902883 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:38.902885    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mnt7\" (UniqueName: \"kubernetes.io/projected/965c85ad-81e8-488f-8ff3-af41b04b7c6c-kube-api-access-6mnt7\") pod \"console-57876c4c87-kvqd7\" (UID: \"965c85ad-81e8-488f-8ff3-af41b04b7c6c\") " pod="openshift-console/console-57876c4c87-kvqd7"
Sep 15 09:15:38.903107 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:38.902906    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/965c85ad-81e8-488f-8ff3-af41b04b7c6c-console-serving-cert\") pod \"console-57876c4c87-kvqd7\" (UID: \"965c85ad-81e8-488f-8ff3-af41b04b7c6c\") " pod="openshift-console/console-57876c4c87-kvqd7"
Sep 15 09:15:38.903107 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:38.902964    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/965c85ad-81e8-488f-8ff3-af41b04b7c6c-service-ca\") pod \"console-57876c4c87-kvqd7\" (UID: \"965c85ad-81e8-488f-8ff3-af41b04b7c6c\") " pod="openshift-console/console-57876c4c87-kvqd7"
Sep 15 09:15:38.903107 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:38.902998    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/965c85ad-81e8-488f-8ff3-af41b04b7c6c-console-oauth-config\") pod \"console-57876c4c87-kvqd7\" (UID: \"965c85ad-81e8-488f-8ff3-af41b04b7c6c\") " pod="openshift-console/console-57876c4c87-kvqd7"
Sep 15 09:15:38.903107 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:38.903020    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/965c85ad-81e8-488f-8ff3-af41b04b7c6c-trusted-ca-bundle\") pod \"console-57876c4c87-kvqd7\" (UID: \"965c85ad-81e8-488f-8ff3-af41b04b7c6c\") " pod="openshift-console/console-57876c4c87-kvqd7"
Sep 15 09:15:38.903107 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:38.903044    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/965c85ad-81e8-488f-8ff3-af41b04b7c6c-oauth-serving-cert\") pod \"console-57876c4c87-kvqd7\" (UID: \"965c85ad-81e8-488f-8ff3-af41b04b7c6c\") " pod="openshift-console/console-57876c4c87-kvqd7"
Sep 15 09:15:38.903839 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:38.903809    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/965c85ad-81e8-488f-8ff3-af41b04b7c6c-service-ca\") pod \"console-57876c4c87-kvqd7\" (UID: \"965c85ad-81e8-488f-8ff3-af41b04b7c6c\") " pod="openshift-console/console-57876c4c87-kvqd7"
Sep 15 09:15:38.904022 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:38.903968    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/965c85ad-81e8-488f-8ff3-af41b04b7c6c-trusted-ca-bundle\") pod \"console-57876c4c87-kvqd7\" (UID: \"965c85ad-81e8-488f-8ff3-af41b04b7c6c\") " pod="openshift-console/console-57876c4c87-kvqd7"
Sep 15 09:15:38.904022 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:38.903986    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/965c85ad-81e8-488f-8ff3-af41b04b7c6c-console-config\") pod \"console-57876c4c87-kvqd7\" (UID: \"965c85ad-81e8-488f-8ff3-af41b04b7c6c\") " pod="openshift-console/console-57876c4c87-kvqd7"
Sep 15 09:15:38.904022 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:38.903896    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/965c85ad-81e8-488f-8ff3-af41b04b7c6c-oauth-serving-cert\") pod \"console-57876c4c87-kvqd7\" (UID: \"965c85ad-81e8-488f-8ff3-af41b04b7c6c\") " pod="openshift-console/console-57876c4c87-kvqd7"
Sep 15 09:15:38.906022 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:38.905996    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/965c85ad-81e8-488f-8ff3-af41b04b7c6c-console-serving-cert\") pod \"console-57876c4c87-kvqd7\" (UID: \"965c85ad-81e8-488f-8ff3-af41b04b7c6c\") " pod="openshift-console/console-57876c4c87-kvqd7"
Sep 15 09:15:38.906111 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:38.905991    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/965c85ad-81e8-488f-8ff3-af41b04b7c6c-console-oauth-config\") pod \"console-57876c4c87-kvqd7\" (UID: \"965c85ad-81e8-488f-8ff3-af41b04b7c6c\") " pod="openshift-console/console-57876c4c87-kvqd7"
Sep 15 09:15:38.910640 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:38.910617    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mnt7\" (UniqueName: \"kubernetes.io/projected/965c85ad-81e8-488f-8ff3-af41b04b7c6c-kube-api-access-6mnt7\") pod \"console-57876c4c87-kvqd7\" (UID: \"965c85ad-81e8-488f-8ff3-af41b04b7c6c\") " pod="openshift-console/console-57876c4c87-kvqd7"
Sep 15 09:15:39.003867 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:39.003836    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57876c4c87-kvqd7"
Sep 15 09:15:39.299027 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:39.298894    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57876c4c87-kvqd7"]
Sep 15 09:15:39.302902 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:15:39.302859    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod965c85ad_81e8_488f_8ff3_af41b04b7c6c.slice/crio-c117456a1a8e80902042ad1f622c106311fa2c2553afce877b820e31c3c94db2 WatchSource:0}: Error finding container c117456a1a8e80902042ad1f622c106311fa2c2553afce877b820e31c3c94db2: Status 404 returned error can't find the container with id c117456a1a8e80902042ad1f622c106311fa2c2553afce877b820e31c3c94db2
Sep 15 09:15:39.599808 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:39.599728    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57876c4c87-kvqd7" event={"ID":"965c85ad-81e8-488f-8ff3-af41b04b7c6c","Type":"ContainerStarted","Data":"c117456a1a8e80902042ad1f622c106311fa2c2553afce877b820e31c3c94db2"}
Sep 15 09:15:43.618506 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:43.618472    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-689b7b4d6d-zr5rw" event={"ID":"21fdbbc4-98af-492c-8165-acd08bc6394c","Type":"ContainerStarted","Data":"0607f17d799659c4d40bdd46a6eb0f0e91e37deb8e417f7ac1753f1d997c08e4"}
Sep 15 09:15:43.620145 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:43.620121    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57876c4c87-kvqd7" event={"ID":"965c85ad-81e8-488f-8ff3-af41b04b7c6c","Type":"ContainerStarted","Data":"23ffc11823bc579fc413e6eee7dc744488ec6819d80311ea2d30528f30755b69"}
Sep 15 09:15:43.636235 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:43.636189    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-689b7b4d6d-zr5rw" podStartSLOduration=2.179711294 podStartE2EDuration="6.636173322s" totalImagesPullingTime="4.456462028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:15:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:15:43.634980412 +0000 UTC m=+87.973425678" watchObservedRunningTime="2026-09-15 09:15:43.636173322 +0000 UTC m=+87.974618596"
Sep 15 09:15:43.651213 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:43.651176    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57876c4c87-kvqd7" podStartSLOduration=2.142717424 podStartE2EDuration="5.651161781s" totalImagesPullingTime="3.508444357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:15:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:15:43.650514415 +0000 UTC m=+87.988959694" watchObservedRunningTime="2026-09-15 09:15:43.651161781 +0000 UTC m=+87.989607054"
Sep 15 09:15:47.085351 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:47.085309    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-r6hz5"]
Sep 15 09:15:47.112458 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:47.112431    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-r6hz5"
Sep 15 09:15:47.115047 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:47.114963    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 15 09:15:47.115047 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:47.114986    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 15 09:15:47.115200 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:47.115146    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 15 09:15:47.115784 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:47.115766    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 15 09:15:47.115924 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:47.115902    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 15 09:15:47.116092 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:47.115908    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 15 09:15:47.116243 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:47.116023    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dcwhg\""
Sep 15 09:15:47.164533 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:47.164509    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/055c959d-7967-47ee-a400-1ae39bf5d1ae-node-exporter-accelerators-collector-config\") pod \"node-exporter-r6hz5\" (UID: \"055c959d-7967-47ee-a400-1ae39bf5d1ae\") " pod="openshift-monitoring/node-exporter-r6hz5"
Sep 15 09:15:47.164638 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:47.164555    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xbbv\" (UniqueName: \"kubernetes.io/projected/055c959d-7967-47ee-a400-1ae39bf5d1ae-kube-api-access-8xbbv\") pod \"node-exporter-r6hz5\" (UID: \"055c959d-7967-47ee-a400-1ae39bf5d1ae\") " pod="openshift-monitoring/node-exporter-r6hz5"
Sep 15 09:15:47.164638 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:47.164591    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/055c959d-7967-47ee-a400-1ae39bf5d1ae-root\") pod \"node-exporter-r6hz5\" (UID: \"055c959d-7967-47ee-a400-1ae39bf5d1ae\") " pod="openshift-monitoring/node-exporter-r6hz5"
Sep 15 09:15:47.164638 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:47.164617    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/055c959d-7967-47ee-a400-1ae39bf5d1ae-metrics-client-ca\") pod \"node-exporter-r6hz5\" (UID: \"055c959d-7967-47ee-a400-1ae39bf5d1ae\") " pod="openshift-monitoring/node-exporter-r6hz5"
Sep 15 09:15:47.164768 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:47.164645    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/055c959d-7967-47ee-a400-1ae39bf5d1ae-sys\") pod \"node-exporter-r6hz5\" (UID: \"055c959d-7967-47ee-a400-1ae39bf5d1ae\") " pod="openshift-monitoring/node-exporter-r6hz5"
Sep 15 09:15:47.164768 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:47.164668    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/055c959d-7967-47ee-a400-1ae39bf5d1ae-node-exporter-tls\") pod \"node-exporter-r6hz5\" (UID: \"055c959d-7967-47ee-a400-1ae39bf5d1ae\") " pod="openshift-monitoring/node-exporter-r6hz5"
Sep 15 09:15:47.164768 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:47.164691    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/055c959d-7967-47ee-a400-1ae39bf5d1ae-node-exporter-wtmp\") pod \"node-exporter-r6hz5\" (UID: \"055c959d-7967-47ee-a400-1ae39bf5d1ae\") " pod="openshift-monitoring/node-exporter-r6hz5"
Sep 15 09:15:47.164857 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:47.164759    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/055c959d-7967-47ee-a400-1ae39bf5d1ae-node-exporter-textfile\") pod \"node-exporter-r6hz5\" (UID: \"055c959d-7967-47ee-a400-1ae39bf5d1ae\") " pod="openshift-monitoring/node-exporter-r6hz5"
Sep 15 09:15:47.164857 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:47.164795    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/055c959d-7967-47ee-a400-1ae39bf5d1ae-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r6hz5\" (UID: \"055c959d-7967-47ee-a400-1ae39bf5d1ae\") " pod="openshift-monitoring/node-exporter-r6hz5"
Sep 15 09:15:47.266029 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:47.266008    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/055c959d-7967-47ee-a400-1ae39bf5d1ae-node-exporter-accelerators-collector-config\") pod \"node-exporter-r6hz5\" (UID: \"055c959d-7967-47ee-a400-1ae39bf5d1ae\") " pod="openshift-monitoring/node-exporter-r6hz5"
Sep 15 09:15:47.266168 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:47.266042    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xbbv\" (UniqueName: \"kubernetes.io/projected/055c959d-7967-47ee-a400-1ae39bf5d1ae-kube-api-access-8xbbv\") pod \"node-exporter-r6hz5\" (UID: \"055c959d-7967-47ee-a400-1ae39bf5d1ae\") " pod="openshift-monitoring/node-exporter-r6hz5"
Sep 15 09:15:47.266168 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:47.266064    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/055c959d-7967-47ee-a400-1ae39bf5d1ae-root\") pod \"node-exporter-r6hz5\" (UID: \"055c959d-7967-47ee-a400-1ae39bf5d1ae\") " pod="openshift-monitoring/node-exporter-r6hz5"
Sep 15 09:15:47.266168 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:47.266080    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/055c959d-7967-47ee-a400-1ae39bf5d1ae-metrics-client-ca\") pod \"node-exporter-r6hz5\" (UID: \"055c959d-7967-47ee-a400-1ae39bf5d1ae\") " pod="openshift-monitoring/node-exporter-r6hz5"
Sep 15 09:15:47.266168 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:47.266098    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/055c959d-7967-47ee-a400-1ae39bf5d1ae-sys\") pod \"node-exporter-r6hz5\" (UID: \"055c959d-7967-47ee-a400-1ae39bf5d1ae\") " pod="openshift-monitoring/node-exporter-r6hz5"
Sep 15 09:15:47.266168 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:47.266119    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/055c959d-7967-47ee-a400-1ae39bf5d1ae-node-exporter-tls\") pod \"node-exporter-r6hz5\" (UID: \"055c959d-7967-47ee-a400-1ae39bf5d1ae\") " pod="openshift-monitoring/node-exporter-r6hz5"
Sep 15 09:15:47.266168 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:47.266133    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/055c959d-7967-47ee-a400-1ae39bf5d1ae-root\") pod \"node-exporter-r6hz5\" (UID: \"055c959d-7967-47ee-a400-1ae39bf5d1ae\") " pod="openshift-monitoring/node-exporter-r6hz5"
Sep 15 09:15:47.266168 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:47.266165    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/055c959d-7967-47ee-a400-1ae39bf5d1ae-sys\") pod \"node-exporter-r6hz5\" (UID: \"055c959d-7967-47ee-a400-1ae39bf5d1ae\") " pod="openshift-monitoring/node-exporter-r6hz5"
Sep 15 09:15:47.266461 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:47.266142    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/055c959d-7967-47ee-a400-1ae39bf5d1ae-node-exporter-wtmp\") pod \"node-exporter-r6hz5\" (UID: \"055c959d-7967-47ee-a400-1ae39bf5d1ae\") " pod="openshift-monitoring/node-exporter-r6hz5"
Sep 15 09:15:47.266461 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:47.266259    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/055c959d-7967-47ee-a400-1ae39bf5d1ae-node-exporter-textfile\") pod \"node-exporter-r6hz5\" (UID: \"055c959d-7967-47ee-a400-1ae39bf5d1ae\") " pod="openshift-monitoring/node-exporter-r6hz5"
Sep 15 09:15:47.266461 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:47.266289    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/055c959d-7967-47ee-a400-1ae39bf5d1ae-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r6hz5\" (UID: \"055c959d-7967-47ee-a400-1ae39bf5d1ae\") " pod="openshift-monitoring/node-exporter-r6hz5"
Sep 15 09:15:47.266461 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:47.266260    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/055c959d-7967-47ee-a400-1ae39bf5d1ae-node-exporter-wtmp\") pod \"node-exporter-r6hz5\" (UID: \"055c959d-7967-47ee-a400-1ae39bf5d1ae\") " pod="openshift-monitoring/node-exporter-r6hz5"
Sep 15 09:15:47.266587 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:47.266537    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/055c959d-7967-47ee-a400-1ae39bf5d1ae-node-exporter-textfile\") pod \"node-exporter-r6hz5\" (UID: \"055c959d-7967-47ee-a400-1ae39bf5d1ae\") " pod="openshift-monitoring/node-exporter-r6hz5"
Sep 15 09:15:47.266712 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:47.266691    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/055c959d-7967-47ee-a400-1ae39bf5d1ae-metrics-client-ca\") pod \"node-exporter-r6hz5\" (UID: \"055c959d-7967-47ee-a400-1ae39bf5d1ae\") " pod="openshift-monitoring/node-exporter-r6hz5"
Sep 15 09:15:47.266748 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:47.266691    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/055c959d-7967-47ee-a400-1ae39bf5d1ae-node-exporter-accelerators-collector-config\") pod \"node-exporter-r6hz5\" (UID: \"055c959d-7967-47ee-a400-1ae39bf5d1ae\") " pod="openshift-monitoring/node-exporter-r6hz5"
Sep 15 09:15:47.268467 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:47.268441    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/055c959d-7967-47ee-a400-1ae39bf5d1ae-node-exporter-tls\") pod \"node-exporter-r6hz5\" (UID: \"055c959d-7967-47ee-a400-1ae39bf5d1ae\") " pod="openshift-monitoring/node-exporter-r6hz5"
Sep 15 09:15:47.268757 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:47.268742    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/055c959d-7967-47ee-a400-1ae39bf5d1ae-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r6hz5\" (UID: \"055c959d-7967-47ee-a400-1ae39bf5d1ae\") " pod="openshift-monitoring/node-exporter-r6hz5"
Sep 15 09:15:47.273713 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:47.273692    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xbbv\" (UniqueName: \"kubernetes.io/projected/055c959d-7967-47ee-a400-1ae39bf5d1ae-kube-api-access-8xbbv\") pod \"node-exporter-r6hz5\" (UID: \"055c959d-7967-47ee-a400-1ae39bf5d1ae\") " pod="openshift-monitoring/node-exporter-r6hz5"
Sep 15 09:15:47.422573 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:47.422508    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-r6hz5"
Sep 15 09:15:47.467687 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:15:47.467662    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod055c959d_7967_47ee_a400_1ae39bf5d1ae.slice/crio-9f4bd31839cbfa9797dc3e8c7cc7df8a908c114d66e0f9ad9204acdc416cd62f WatchSource:0}: Error finding container 9f4bd31839cbfa9797dc3e8c7cc7df8a908c114d66e0f9ad9204acdc416cd62f: Status 404 returned error can't find the container with id 9f4bd31839cbfa9797dc3e8c7cc7df8a908c114d66e0f9ad9204acdc416cd62f
Sep 15 09:15:47.633350 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:47.633322    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r6hz5" event={"ID":"055c959d-7967-47ee-a400-1ae39bf5d1ae","Type":"ContainerStarted","Data":"9f4bd31839cbfa9797dc3e8c7cc7df8a908c114d66e0f9ad9204acdc416cd62f"}
Sep 15 09:15:48.019511 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.019484    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-689b7b4d6d-zr5rw"
Sep 15 09:15:48.019663 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.019533    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-689b7b4d6d-zr5rw"
Sep 15 09:15:48.025474 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.025450    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-689b7b4d6d-zr5rw"
Sep 15 09:15:48.120838 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.120809    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 09:15:48.137996 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.137938    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 09:15:48.138136 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.138096    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:15:48.140616 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.140593    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 15 09:15:48.140875 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.140841    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 15 09:15:48.140875 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.140862    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 15 09:15:48.141023 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.140898    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 15 09:15:48.141023 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.140844    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 15 09:15:48.141198 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.141177    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 15 09:15:48.141309 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.141282    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-66fn2\""
Sep 15 09:15:48.141374 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.141308    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 15 09:15:48.141374 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.141340    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 15 09:15:48.141471 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.141440    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 15 09:15:48.173700 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.173674    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3887b186-0ad7-4e6c-bbae-6a037340e5ed-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:15:48.173832 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.173711    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3887b186-0ad7-4e6c-bbae-6a037340e5ed-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:15:48.173832 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.173734    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3887b186-0ad7-4e6c-bbae-6a037340e5ed-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:15:48.173832 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.173805    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9dkm\" (UniqueName: \"kubernetes.io/projected/3887b186-0ad7-4e6c-bbae-6a037340e5ed-kube-api-access-g9dkm\") pod \"alertmanager-main-0\" (UID: \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:15:48.174075 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.173830    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3887b186-0ad7-4e6c-bbae-6a037340e5ed-web-config\") pod \"alertmanager-main-0\" (UID: \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:15:48.174075 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.173868    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3887b186-0ad7-4e6c-bbae-6a037340e5ed-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:15:48.174075 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.174018    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3887b186-0ad7-4e6c-bbae-6a037340e5ed-config-volume\") pod \"alertmanager-main-0\" (UID: \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:15:48.174075 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.174047    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3887b186-0ad7-4e6c-bbae-6a037340e5ed-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:15:48.174272 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.174080    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3887b186-0ad7-4e6c-bbae-6a037340e5ed-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:15:48.174272 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.174164    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3887b186-0ad7-4e6c-bbae-6a037340e5ed-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:15:48.174272 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.174189    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3887b186-0ad7-4e6c-bbae-6a037340e5ed-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:15:48.174272 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.174217    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3887b186-0ad7-4e6c-bbae-6a037340e5ed-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:15:48.174272 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.174241    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3887b186-0ad7-4e6c-bbae-6a037340e5ed-config-out\") pod \"alertmanager-main-0\" (UID: \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:15:48.274809 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.274746    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3887b186-0ad7-4e6c-bbae-6a037340e5ed-config-volume\") pod \"alertmanager-main-0\" (UID: \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:15:48.274809 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.274782    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3887b186-0ad7-4e6c-bbae-6a037340e5ed-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:15:48.275019 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.274811    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3887b186-0ad7-4e6c-bbae-6a037340e5ed-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:15:48.275019 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.274848    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3887b186-0ad7-4e6c-bbae-6a037340e5ed-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:15:48.275019 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.274873    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3887b186-0ad7-4e6c-bbae-6a037340e5ed-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:15:48.275019 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.274898    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3887b186-0ad7-4e6c-bbae-6a037340e5ed-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:15:48.275019 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:15:48.275014    2578 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Sep 15 09:15:48.275256 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:15:48.275086    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3887b186-0ad7-4e6c-bbae-6a037340e5ed-secret-alertmanager-main-tls podName:3887b186-0ad7-4e6c-bbae-6a037340e5ed nodeName:}" failed. No retries permitted until 2026-09-15 09:15:48.775065924 +0000 UTC m=+93.113511192 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/3887b186-0ad7-4e6c-bbae-6a037340e5ed-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "3887b186-0ad7-4e6c-bbae-6a037340e5ed") : secret "alertmanager-main-tls" not found
Sep 15 09:15:48.275256 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:15:48.275127    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3887b186-0ad7-4e6c-bbae-6a037340e5ed-alertmanager-trusted-ca-bundle podName:3887b186-0ad7-4e6c-bbae-6a037340e5ed nodeName:}" failed. No retries permitted until 2026-09-15 09:15:48.775108104 +0000 UTC m=+93.113553370 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/3887b186-0ad7-4e6c-bbae-6a037340e5ed-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "3887b186-0ad7-4e6c-bbae-6a037340e5ed") : configmap references non-existent config key: ca-bundle.crt
Sep 15 09:15:48.275256 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.275166    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3887b186-0ad7-4e6c-bbae-6a037340e5ed-config-out\") pod \"alertmanager-main-0\" (UID: \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:15:48.275256 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.275207    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3887b186-0ad7-4e6c-bbae-6a037340e5ed-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:15:48.275256 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.275231    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3887b186-0ad7-4e6c-bbae-6a037340e5ed-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:15:48.275256 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.275255    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3887b186-0ad7-4e6c-bbae-6a037340e5ed-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:15:48.275563 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.275317    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9dkm\" (UniqueName: \"kubernetes.io/projected/3887b186-0ad7-4e6c-bbae-6a037340e5ed-kube-api-access-g9dkm\") pod \"alertmanager-main-0\" (UID: \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:15:48.275563 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.275344    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3887b186-0ad7-4e6c-bbae-6a037340e5ed-web-config\") pod \"alertmanager-main-0\" (UID: \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:15:48.275563 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.275372    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3887b186-0ad7-4e6c-bbae-6a037340e5ed-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:15:48.275894 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.275872    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3887b186-0ad7-4e6c-bbae-6a037340e5ed-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:15:48.276586 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.276528    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3887b186-0ad7-4e6c-bbae-6a037340e5ed-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:15:48.278214 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.278192    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3887b186-0ad7-4e6c-bbae-6a037340e5ed-config-volume\") pod \"alertmanager-main-0\" (UID: \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:15:48.278430 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.278406    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3887b186-0ad7-4e6c-bbae-6a037340e5ed-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:15:48.279386 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.279340    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3887b186-0ad7-4e6c-bbae-6a037340e5ed-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:15:48.279592 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.279570    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3887b186-0ad7-4e6c-bbae-6a037340e5ed-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:15:48.279810 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.279773    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3887b186-0ad7-4e6c-bbae-6a037340e5ed-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:15:48.280093 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.280072    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3887b186-0ad7-4e6c-bbae-6a037340e5ed-web-config\") pod \"alertmanager-main-0\" (UID: \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:15:48.280359 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.280332    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3887b186-0ad7-4e6c-bbae-6a037340e5ed-config-out\") pod \"alertmanager-main-0\" (UID: \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:15:48.280359 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.280350    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3887b186-0ad7-4e6c-bbae-6a037340e5ed-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:15:48.283642 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.283612    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9dkm\" (UniqueName: \"kubernetes.io/projected/3887b186-0ad7-4e6c-bbae-6a037340e5ed-kube-api-access-g9dkm\") pod \"alertmanager-main-0\" (UID: \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:15:48.640935 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.640866    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-689b7b4d6d-zr5rw"
Sep 15 09:15:48.778903 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.778870    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3887b186-0ad7-4e6c-bbae-6a037340e5ed-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:15:48.778903 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.778906    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3887b186-0ad7-4e6c-bbae-6a037340e5ed-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:15:48.779719 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.779698    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3887b186-0ad7-4e6c-bbae-6a037340e5ed-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:15:48.781187 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:48.781169    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3887b186-0ad7-4e6c-bbae-6a037340e5ed-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:15:49.004533 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:49.004509    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57876c4c87-kvqd7"
Sep 15 09:15:49.004667 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:49.004572    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57876c4c87-kvqd7"
Sep 15 09:15:49.009202 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:49.009186    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57876c4c87-kvqd7"
Sep 15 09:15:49.051488 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:49.051470    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:15:49.338273 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:49.338250    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 09:15:49.340207 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:15:49.340176    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3887b186_0ad7_4e6c_bbae_6a037340e5ed.slice/crio-631e6709cf75eb1b1dc3501c5748cd9a9ab59584e9609bcb038ed11c7951b93f WatchSource:0}: Error finding container 631e6709cf75eb1b1dc3501c5748cd9a9ab59584e9609bcb038ed11c7951b93f: Status 404 returned error can't find the container with id 631e6709cf75eb1b1dc3501c5748cd9a9ab59584e9609bcb038ed11c7951b93f
Sep 15 09:15:49.641219 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:49.641152    2578 generic.go:356] "Generic (PLEG): container finished" podID="055c959d-7967-47ee-a400-1ae39bf5d1ae" containerID="646a257f30c584a7722829ac5fce98dfca6b4a63fa6b3d8ffe2a57342c536e6e" exitCode=0
Sep 15 09:15:49.641398 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:49.641246    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r6hz5" event={"ID":"055c959d-7967-47ee-a400-1ae39bf5d1ae","Type":"ContainerDied","Data":"646a257f30c584a7722829ac5fce98dfca6b4a63fa6b3d8ffe2a57342c536e6e"}
Sep 15 09:15:49.642518 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:49.642493    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3887b186-0ad7-4e6c-bbae-6a037340e5ed","Type":"ContainerStarted","Data":"631e6709cf75eb1b1dc3501c5748cd9a9ab59584e9609bcb038ed11c7951b93f"}
Sep 15 09:15:49.646404 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:49.646386    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57876c4c87-kvqd7"
Sep 15 09:15:49.707524 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:49.707502    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-689b7b4d6d-zr5rw"]
Sep 15 09:15:50.648178 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:50.648144    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r6hz5" event={"ID":"055c959d-7967-47ee-a400-1ae39bf5d1ae","Type":"ContainerStarted","Data":"38e5ca301876d25c855b7b33b54c144be02e3e306457b3a0fe318161906fa5ec"}
Sep 15 09:15:50.648758 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:50.648203    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r6hz5" event={"ID":"055c959d-7967-47ee-a400-1ae39bf5d1ae","Type":"ContainerStarted","Data":"1c2d3aaf9e5592d4a7112c78a3bb5623bb34f4c9a53a3915c2edcdef5846d1e2"}
Sep 15 09:15:50.681089 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:50.681043    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-r6hz5" podStartSLOduration=2.09904339 podStartE2EDuration="3.681025944s" totalImagesPullingTime="1.496629756s" totalInitContainerRuntime="85.352798ms" isStatefulPod=true podCreationTimestamp="2026-09-15 09:15:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:15:50.6807668 +0000 UTC m=+95.019212076" watchObservedRunningTime="2026-09-15 09:15:50.681025944 +0000 UTC m=+95.019471223"
Sep 15 09:15:51.653172 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:51.653088    2578 generic.go:356] "Generic (PLEG): container finished" podID="3887b186-0ad7-4e6c-bbae-6a037340e5ed" containerID="2f679a120e68bbcc6b0630a6b72eac1423e3ce1a1834d2b3f1bf0ca88a6c4805" exitCode=0
Sep 15 09:15:51.653606 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:51.653180    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3887b186-0ad7-4e6c-bbae-6a037340e5ed","Type":"ContainerDied","Data":"2f679a120e68bbcc6b0630a6b72eac1423e3ce1a1834d2b3f1bf0ca88a6c4805"}
Sep 15 09:15:51.855876 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:51.855842    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-pjbp5"]
Sep 15 09:15:51.875389 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:51.875368    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-pjbp5"]
Sep 15 09:15:51.875519 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:51.875450    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-pjbp5"
Sep 15 09:15:51.877670 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:51.877649    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-m8l4s\""
Sep 15 09:15:51.877976 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:51.877941    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 15 09:15:52.008395 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:52.008370    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/92994fee-bac9-48c3-8df6-573abbdea0af-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-pjbp5\" (UID: \"92994fee-bac9-48c3-8df6-573abbdea0af\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-pjbp5"
Sep 15 09:15:52.008518 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:52.008401    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfj6r\" (UniqueName: \"kubernetes.io/projected/92994fee-bac9-48c3-8df6-573abbdea0af-kube-api-access-gfj6r\") pod \"monitoring-plugin-5d85778b9d-pjbp5\" (UID: \"92994fee-bac9-48c3-8df6-573abbdea0af\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-pjbp5"
Sep 15 09:15:52.109461 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:52.109440    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/92994fee-bac9-48c3-8df6-573abbdea0af-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-pjbp5\" (UID: \"92994fee-bac9-48c3-8df6-573abbdea0af\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-pjbp5"
Sep 15 09:15:52.109588 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:52.109472    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfj6r\" (UniqueName: \"kubernetes.io/projected/92994fee-bac9-48c3-8df6-573abbdea0af-kube-api-access-gfj6r\") pod \"monitoring-plugin-5d85778b9d-pjbp5\" (UID: \"92994fee-bac9-48c3-8df6-573abbdea0af\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-pjbp5"
Sep 15 09:15:52.111745 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:52.111724    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/92994fee-bac9-48c3-8df6-573abbdea0af-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-pjbp5\" (UID: \"92994fee-bac9-48c3-8df6-573abbdea0af\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-pjbp5"
Sep 15 09:15:52.117304 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:52.117281    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfj6r\" (UniqueName: \"kubernetes.io/projected/92994fee-bac9-48c3-8df6-573abbdea0af-kube-api-access-gfj6r\") pod \"monitoring-plugin-5d85778b9d-pjbp5\" (UID: \"92994fee-bac9-48c3-8df6-573abbdea0af\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-pjbp5"
Sep 15 09:15:52.184014 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:52.183987    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-pjbp5"
Sep 15 09:15:52.466180 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:52.466157    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-pjbp5"]
Sep 15 09:15:52.467994 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:15:52.467967    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92994fee_bac9_48c3_8df6_573abbdea0af.slice/crio-49f9c325fb977a4b4be2766bf95135a4c75935330d0efbf4a8f6897818a6f9d6 WatchSource:0}: Error finding container 49f9c325fb977a4b4be2766bf95135a4c75935330d0efbf4a8f6897818a6f9d6: Status 404 returned error can't find the container with id 49f9c325fb977a4b4be2766bf95135a4c75935330d0efbf4a8f6897818a6f9d6
Sep 15 09:15:52.658421 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:52.658381    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-pjbp5" event={"ID":"92994fee-bac9-48c3-8df6-573abbdea0af","Type":"ContainerStarted","Data":"49f9c325fb977a4b4be2766bf95135a4c75935330d0efbf4a8f6897818a6f9d6"}
Sep 15 09:15:53.055588 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:53.055558    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59656fcc6f-d84xf"]
Sep 15 09:15:53.077315 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:53.077287    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59656fcc6f-d84xf"]
Sep 15 09:15:53.077466 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:53.077384    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59656fcc6f-d84xf"
Sep 15 09:15:53.219755 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:53.219725    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjsfr\" (UniqueName: \"kubernetes.io/projected/1979ab20-eae3-4bdb-8516-71ed4b1f2d80-kube-api-access-hjsfr\") pod \"console-59656fcc6f-d84xf\" (UID: \"1979ab20-eae3-4bdb-8516-71ed4b1f2d80\") " pod="openshift-console/console-59656fcc6f-d84xf"
Sep 15 09:15:53.219918 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:53.219764    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1979ab20-eae3-4bdb-8516-71ed4b1f2d80-console-serving-cert\") pod \"console-59656fcc6f-d84xf\" (UID: \"1979ab20-eae3-4bdb-8516-71ed4b1f2d80\") " pod="openshift-console/console-59656fcc6f-d84xf"
Sep 15 09:15:53.219918 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:53.219891    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1979ab20-eae3-4bdb-8516-71ed4b1f2d80-console-config\") pod \"console-59656fcc6f-d84xf\" (UID: \"1979ab20-eae3-4bdb-8516-71ed4b1f2d80\") " pod="openshift-console/console-59656fcc6f-d84xf"
Sep 15 09:15:53.220034 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:53.219974    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1979ab20-eae3-4bdb-8516-71ed4b1f2d80-console-oauth-config\") pod \"console-59656fcc6f-d84xf\" (UID: \"1979ab20-eae3-4bdb-8516-71ed4b1f2d80\") " pod="openshift-console/console-59656fcc6f-d84xf"
Sep 15 09:15:53.220091 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:53.220044    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1979ab20-eae3-4bdb-8516-71ed4b1f2d80-service-ca\") pod \"console-59656fcc6f-d84xf\" (UID: \"1979ab20-eae3-4bdb-8516-71ed4b1f2d80\") " pod="openshift-console/console-59656fcc6f-d84xf"
Sep 15 09:15:53.220091 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:53.220073    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1979ab20-eae3-4bdb-8516-71ed4b1f2d80-trusted-ca-bundle\") pod \"console-59656fcc6f-d84xf\" (UID: \"1979ab20-eae3-4bdb-8516-71ed4b1f2d80\") " pod="openshift-console/console-59656fcc6f-d84xf"
Sep 15 09:15:53.220200 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:53.220120    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1979ab20-eae3-4bdb-8516-71ed4b1f2d80-oauth-serving-cert\") pod \"console-59656fcc6f-d84xf\" (UID: \"1979ab20-eae3-4bdb-8516-71ed4b1f2d80\") " pod="openshift-console/console-59656fcc6f-d84xf"
Sep 15 09:15:53.321189 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:53.321107    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1979ab20-eae3-4bdb-8516-71ed4b1f2d80-console-oauth-config\") pod \"console-59656fcc6f-d84xf\" (UID: \"1979ab20-eae3-4bdb-8516-71ed4b1f2d80\") " pod="openshift-console/console-59656fcc6f-d84xf"
Sep 15 09:15:53.321189 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:53.321164    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1979ab20-eae3-4bdb-8516-71ed4b1f2d80-service-ca\") pod \"console-59656fcc6f-d84xf\" (UID: \"1979ab20-eae3-4bdb-8516-71ed4b1f2d80\") " pod="openshift-console/console-59656fcc6f-d84xf"
Sep 15 09:15:53.321392 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:53.321194    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1979ab20-eae3-4bdb-8516-71ed4b1f2d80-trusted-ca-bundle\") pod \"console-59656fcc6f-d84xf\" (UID: \"1979ab20-eae3-4bdb-8516-71ed4b1f2d80\") " pod="openshift-console/console-59656fcc6f-d84xf"
Sep 15 09:15:53.321392 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:53.321232    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1979ab20-eae3-4bdb-8516-71ed4b1f2d80-oauth-serving-cert\") pod \"console-59656fcc6f-d84xf\" (UID: \"1979ab20-eae3-4bdb-8516-71ed4b1f2d80\") " pod="openshift-console/console-59656fcc6f-d84xf"
Sep 15 09:15:53.321392 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:53.321277    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjsfr\" (UniqueName: \"kubernetes.io/projected/1979ab20-eae3-4bdb-8516-71ed4b1f2d80-kube-api-access-hjsfr\") pod \"console-59656fcc6f-d84xf\" (UID: \"1979ab20-eae3-4bdb-8516-71ed4b1f2d80\") " pod="openshift-console/console-59656fcc6f-d84xf"
Sep 15 09:15:53.321392 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:53.321316    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1979ab20-eae3-4bdb-8516-71ed4b1f2d80-console-serving-cert\") pod \"console-59656fcc6f-d84xf\" (UID: \"1979ab20-eae3-4bdb-8516-71ed4b1f2d80\") " pod="openshift-console/console-59656fcc6f-d84xf"
Sep 15 09:15:53.321392 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:53.321347    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1979ab20-eae3-4bdb-8516-71ed4b1f2d80-console-config\") pod \"console-59656fcc6f-d84xf\" (UID: \"1979ab20-eae3-4bdb-8516-71ed4b1f2d80\") " pod="openshift-console/console-59656fcc6f-d84xf"
Sep 15 09:15:53.321974 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:53.321921    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1979ab20-eae3-4bdb-8516-71ed4b1f2d80-service-ca\") pod \"console-59656fcc6f-d84xf\" (UID: \"1979ab20-eae3-4bdb-8516-71ed4b1f2d80\") " pod="openshift-console/console-59656fcc6f-d84xf"
Sep 15 09:15:53.322128 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:53.322043    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1979ab20-eae3-4bdb-8516-71ed4b1f2d80-console-config\") pod \"console-59656fcc6f-d84xf\" (UID: \"1979ab20-eae3-4bdb-8516-71ed4b1f2d80\") " pod="openshift-console/console-59656fcc6f-d84xf"
Sep 15 09:15:53.322213 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:53.322189    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1979ab20-eae3-4bdb-8516-71ed4b1f2d80-oauth-serving-cert\") pod \"console-59656fcc6f-d84xf\" (UID: \"1979ab20-eae3-4bdb-8516-71ed4b1f2d80\") " pod="openshift-console/console-59656fcc6f-d84xf"
Sep 15 09:15:53.322476 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:53.322450    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1979ab20-eae3-4bdb-8516-71ed4b1f2d80-trusted-ca-bundle\") pod \"console-59656fcc6f-d84xf\" (UID: \"1979ab20-eae3-4bdb-8516-71ed4b1f2d80\") " pod="openshift-console/console-59656fcc6f-d84xf"
Sep 15 09:15:53.323919 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:53.323899    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1979ab20-eae3-4bdb-8516-71ed4b1f2d80-console-oauth-config\") pod \"console-59656fcc6f-d84xf\" (UID: \"1979ab20-eae3-4bdb-8516-71ed4b1f2d80\") " pod="openshift-console/console-59656fcc6f-d84xf"
Sep 15 09:15:53.324724 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:53.324700    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1979ab20-eae3-4bdb-8516-71ed4b1f2d80-console-serving-cert\") pod \"console-59656fcc6f-d84xf\" (UID: \"1979ab20-eae3-4bdb-8516-71ed4b1f2d80\") " pod="openshift-console/console-59656fcc6f-d84xf"
Sep 15 09:15:53.331455 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:53.331432    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjsfr\" (UniqueName: \"kubernetes.io/projected/1979ab20-eae3-4bdb-8516-71ed4b1f2d80-kube-api-access-hjsfr\") pod \"console-59656fcc6f-d84xf\" (UID: \"1979ab20-eae3-4bdb-8516-71ed4b1f2d80\") " pod="openshift-console/console-59656fcc6f-d84xf"
Sep 15 09:15:53.389317 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:53.389290    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59656fcc6f-d84xf"
Sep 15 09:15:54.667856 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:54.667815    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-pjbp5" event={"ID":"92994fee-bac9-48c3-8df6-573abbdea0af","Type":"ContainerStarted","Data":"489ed4f5454a69ae8a2f9238647b9e0020549bf35929a0a788dc554bc649bf7e"}
Sep 15 09:15:54.668418 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:54.668392    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-pjbp5"
Sep 15 09:15:54.670266 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:54.670231    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3887b186-0ad7-4e6c-bbae-6a037340e5ed","Type":"ContainerStarted","Data":"661ea5be675e67fc95b3661b41ec17da2cad7ead4f5164ecff0b5d8deb7ad22f"}
Sep 15 09:15:54.673523 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:54.673479    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-pjbp5"
Sep 15 09:15:54.683302 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:54.683263    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-pjbp5" podStartSLOduration=1.607148503 podStartE2EDuration="3.683250818s" totalImagesPullingTime="2.076102315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:15:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:15:54.681913702 +0000 UTC m=+99.020358978" watchObservedRunningTime="2026-09-15 09:15:54.683250818 +0000 UTC m=+99.021696093"
Sep 15 09:15:54.803823 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:54.803798    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59656fcc6f-d84xf"]
Sep 15 09:15:54.806202 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:15:54.806180    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1979ab20_eae3_4bdb_8516_71ed4b1f2d80.slice/crio-9913b4b3cd31eeec0cb91f803f8ce258877021d96833c2d8e99d2d6a3576559a WatchSource:0}: Error finding container 9913b4b3cd31eeec0cb91f803f8ce258877021d96833c2d8e99d2d6a3576559a: Status 404 returned error can't find the container with id 9913b4b3cd31eeec0cb91f803f8ce258877021d96833c2d8e99d2d6a3576559a
Sep 15 09:15:55.677908 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:55.677872    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3887b186-0ad7-4e6c-bbae-6a037340e5ed","Type":"ContainerStarted","Data":"4bc67dae8348922cafb82869b0a58a7d10c891566603e06ea043c2837c5b9b22"}
Sep 15 09:15:55.678365 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:55.677964    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3887b186-0ad7-4e6c-bbae-6a037340e5ed","Type":"ContainerStarted","Data":"f38404763f36af7a069c039384cbf597571bdef441afc52e6ffc04a95175e847"}
Sep 15 09:15:55.678365 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:55.678004    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3887b186-0ad7-4e6c-bbae-6a037340e5ed","Type":"ContainerStarted","Data":"86c8e742da3fd1ac5efec523d38389719b69e2463184bfb66c0b2bd627f219ab"}
Sep 15 09:15:55.678365 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:55.678037    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3887b186-0ad7-4e6c-bbae-6a037340e5ed","Type":"ContainerStarted","Data":"5fb30f978d25fd4fc677883f6453a217f458f31995a3c65f070c06484ab49cc9"}
Sep 15 09:15:55.679596 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:55.679567    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59656fcc6f-d84xf" event={"ID":"1979ab20-eae3-4bdb-8516-71ed4b1f2d80","Type":"ContainerStarted","Data":"479e16c26475427ea5f913ca9db1eae852b871666133fa382a1772fba06cf630"}
Sep 15 09:15:55.679712 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:55.679613    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59656fcc6f-d84xf" event={"ID":"1979ab20-eae3-4bdb-8516-71ed4b1f2d80","Type":"ContainerStarted","Data":"9913b4b3cd31eeec0cb91f803f8ce258877021d96833c2d8e99d2d6a3576559a"}
Sep 15 09:15:55.696973 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:55.696918    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59656fcc6f-d84xf" podStartSLOduration=2.69690348 podStartE2EDuration="2.69690348s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:15:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:15:55.695301263 +0000 UTC m=+100.033746538" watchObservedRunningTime="2026-09-15 09:15:55.69690348 +0000 UTC m=+100.035348756"
Sep 15 09:15:56.685970 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:56.685886    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3887b186-0ad7-4e6c-bbae-6a037340e5ed","Type":"ContainerStarted","Data":"c8d50db370baae821562fecb04ac37f85e1effec630accf01f896c71db2f072d"}
Sep 15 09:15:56.712845 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:15:56.712789    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.687595639 podStartE2EDuration="8.712770308s" totalImagesPullingTime="5.997336435s" totalInitContainerRuntime="27.838234ms" isStatefulPod=false podCreationTimestamp="2026-09-15 09:15:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:15:56.711308401 +0000 UTC m=+101.049753711" watchObservedRunningTime="2026-09-15 09:15:56.712770308 +0000 UTC m=+101.051215586"
Sep 15 09:16:03.390232 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:03.390193    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59656fcc6f-d84xf"
Sep 15 09:16:03.390585 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:03.390278    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59656fcc6f-d84xf"
Sep 15 09:16:03.394659 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:03.394636    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59656fcc6f-d84xf"
Sep 15 09:16:03.713524 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:03.713500    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59656fcc6f-d84xf"
Sep 15 09:16:03.761106 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:03.761077    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57876c4c87-kvqd7"]
Sep 15 09:16:05.582508 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:05.582472    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-pbttq"
Sep 15 09:16:15.666841 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:15.666801    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-689b7b4d6d-zr5rw" podUID="21fdbbc4-98af-492c-8165-acd08bc6394c" containerName="console" containerID="cri-o://0607f17d799659c4d40bdd46a6eb0f0e91e37deb8e417f7ac1753f1d997c08e4" gracePeriod=15
Sep 15 09:16:15.932254 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:15.932194    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-689b7b4d6d-zr5rw"
Sep 15 09:16:16.086104 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:16.086077    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/21fdbbc4-98af-492c-8165-acd08bc6394c-console-config\") pod \"21fdbbc4-98af-492c-8165-acd08bc6394c\" (UID: \"21fdbbc4-98af-492c-8165-acd08bc6394c\") "
Sep 15 09:16:16.086276 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:16.086110    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/21fdbbc4-98af-492c-8165-acd08bc6394c-service-ca\") pod \"21fdbbc4-98af-492c-8165-acd08bc6394c\" (UID: \"21fdbbc4-98af-492c-8165-acd08bc6394c\") "
Sep 15 09:16:16.086276 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:16.086135    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/21fdbbc4-98af-492c-8165-acd08bc6394c-console-serving-cert\") pod \"21fdbbc4-98af-492c-8165-acd08bc6394c\" (UID: \"21fdbbc4-98af-492c-8165-acd08bc6394c\") "
Sep 15 09:16:16.086276 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:16.086193    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/21fdbbc4-98af-492c-8165-acd08bc6394c-oauth-serving-cert\") pod \"21fdbbc4-98af-492c-8165-acd08bc6394c\" (UID: \"21fdbbc4-98af-492c-8165-acd08bc6394c\") "
Sep 15 09:16:16.086276 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:16.086209    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/21fdbbc4-98af-492c-8165-acd08bc6394c-console-oauth-config\") pod \"21fdbbc4-98af-492c-8165-acd08bc6394c\" (UID: \"21fdbbc4-98af-492c-8165-acd08bc6394c\") "
Sep 15 09:16:16.086276 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:16.086233    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qpj6p\" (UniqueName: \"kubernetes.io/projected/21fdbbc4-98af-492c-8165-acd08bc6394c-kube-api-access-qpj6p\") pod \"21fdbbc4-98af-492c-8165-acd08bc6394c\" (UID: \"21fdbbc4-98af-492c-8165-acd08bc6394c\") "
Sep 15 09:16:16.086536 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:16.086495    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21fdbbc4-98af-492c-8165-acd08bc6394c-console-config" (OuterVolumeSpecName: "console-config") pod "21fdbbc4-98af-492c-8165-acd08bc6394c" (UID: "21fdbbc4-98af-492c-8165-acd08bc6394c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:16:16.086536 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:16.086506    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21fdbbc4-98af-492c-8165-acd08bc6394c-service-ca" (OuterVolumeSpecName: "service-ca") pod "21fdbbc4-98af-492c-8165-acd08bc6394c" (UID: "21fdbbc4-98af-492c-8165-acd08bc6394c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:16:16.086648 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:16.086554    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21fdbbc4-98af-492c-8165-acd08bc6394c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "21fdbbc4-98af-492c-8165-acd08bc6394c" (UID: "21fdbbc4-98af-492c-8165-acd08bc6394c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:16:16.088364 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:16.088334    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21fdbbc4-98af-492c-8165-acd08bc6394c-kube-api-access-qpj6p" (OuterVolumeSpecName: "kube-api-access-qpj6p") pod "21fdbbc4-98af-492c-8165-acd08bc6394c" (UID: "21fdbbc4-98af-492c-8165-acd08bc6394c"). InnerVolumeSpecName "kube-api-access-qpj6p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:16:16.088364 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:16.088344    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21fdbbc4-98af-492c-8165-acd08bc6394c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "21fdbbc4-98af-492c-8165-acd08bc6394c" (UID: "21fdbbc4-98af-492c-8165-acd08bc6394c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:16:16.088546 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:16.088364    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21fdbbc4-98af-492c-8165-acd08bc6394c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "21fdbbc4-98af-492c-8165-acd08bc6394c" (UID: "21fdbbc4-98af-492c-8165-acd08bc6394c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:16:16.187523 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:16.187463    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qpj6p\" (UniqueName: \"kubernetes.io/projected/21fdbbc4-98af-492c-8165-acd08bc6394c-kube-api-access-qpj6p\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:16:16.187523 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:16.187487    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/21fdbbc4-98af-492c-8165-acd08bc6394c-console-config\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:16:16.187523 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:16.187496    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/21fdbbc4-98af-492c-8165-acd08bc6394c-service-ca\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:16:16.187523 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:16.187504    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/21fdbbc4-98af-492c-8165-acd08bc6394c-console-serving-cert\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:16:16.187523 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:16.187514    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/21fdbbc4-98af-492c-8165-acd08bc6394c-oauth-serving-cert\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:16:16.187523 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:16.187523    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/21fdbbc4-98af-492c-8165-acd08bc6394c-console-oauth-config\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:16:16.756652 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:16.756612    2578 generic.go:356] "Generic (PLEG): container finished" podID="21fdbbc4-98af-492c-8165-acd08bc6394c" containerID="0607f17d799659c4d40bdd46a6eb0f0e91e37deb8e417f7ac1753f1d997c08e4" exitCode=0
Sep 15 09:16:16.757136 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:16.756676    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-689b7b4d6d-zr5rw"
Sep 15 09:16:16.757136 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:16.756695    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-689b7b4d6d-zr5rw" event={"ID":"21fdbbc4-98af-492c-8165-acd08bc6394c","Type":"ContainerDied","Data":"0607f17d799659c4d40bdd46a6eb0f0e91e37deb8e417f7ac1753f1d997c08e4"}
Sep 15 09:16:16.757136 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:16.756771    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-689b7b4d6d-zr5rw" event={"ID":"21fdbbc4-98af-492c-8165-acd08bc6394c","Type":"ContainerDied","Data":"79ed631745954019fab61dc11c37458f705ef93dacc35b844db39045e95c5d4b"}
Sep 15 09:16:16.757136 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:16.756791    2578 scope.go:117] "RemoveContainer" containerID="0607f17d799659c4d40bdd46a6eb0f0e91e37deb8e417f7ac1753f1d997c08e4"
Sep 15 09:16:16.764617 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:16.764602    2578 scope.go:117] "RemoveContainer" containerID="0607f17d799659c4d40bdd46a6eb0f0e91e37deb8e417f7ac1753f1d997c08e4"
Sep 15 09:16:16.764873 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:16:16.764854    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0607f17d799659c4d40bdd46a6eb0f0e91e37deb8e417f7ac1753f1d997c08e4\": container with ID starting with 0607f17d799659c4d40bdd46a6eb0f0e91e37deb8e417f7ac1753f1d997c08e4 not found: ID does not exist" containerID="0607f17d799659c4d40bdd46a6eb0f0e91e37deb8e417f7ac1753f1d997c08e4"
Sep 15 09:16:16.764938 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:16.764885    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0607f17d799659c4d40bdd46a6eb0f0e91e37deb8e417f7ac1753f1d997c08e4"} err="failed to get container status \"0607f17d799659c4d40bdd46a6eb0f0e91e37deb8e417f7ac1753f1d997c08e4\": rpc error: code = NotFound desc = could not find container \"0607f17d799659c4d40bdd46a6eb0f0e91e37deb8e417f7ac1753f1d997c08e4\": container with ID starting with 0607f17d799659c4d40bdd46a6eb0f0e91e37deb8e417f7ac1753f1d997c08e4 not found: ID does not exist"
Sep 15 09:16:16.771714 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:16.771693    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-689b7b4d6d-zr5rw"]
Sep 15 09:16:16.774917 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:16.774895    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-689b7b4d6d-zr5rw"]
Sep 15 09:16:18.120169 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:18.120138    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21fdbbc4-98af-492c-8165-acd08bc6394c" path="/var/lib/kubelet/pods/21fdbbc4-98af-492c-8165-acd08bc6394c/volumes"
Sep 15 09:16:28.779283 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:28.779245    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-57876c4c87-kvqd7" podUID="965c85ad-81e8-488f-8ff3-af41b04b7c6c" containerName="console" containerID="cri-o://23ffc11823bc579fc413e6eee7dc744488ec6819d80311ea2d30528f30755b69" gracePeriod=15
Sep 15 09:16:29.023033 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:29.023009    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57876c4c87-kvqd7"
Sep 15 09:16:29.179956 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:29.179846    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/965c85ad-81e8-488f-8ff3-af41b04b7c6c-trusted-ca-bundle\") pod \"965c85ad-81e8-488f-8ff3-af41b04b7c6c\" (UID: \"965c85ad-81e8-488f-8ff3-af41b04b7c6c\") "
Sep 15 09:16:29.179956 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:29.179891    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6mnt7\" (UniqueName: \"kubernetes.io/projected/965c85ad-81e8-488f-8ff3-af41b04b7c6c-kube-api-access-6mnt7\") pod \"965c85ad-81e8-488f-8ff3-af41b04b7c6c\" (UID: \"965c85ad-81e8-488f-8ff3-af41b04b7c6c\") "
Sep 15 09:16:29.179956 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:29.179922    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/965c85ad-81e8-488f-8ff3-af41b04b7c6c-oauth-serving-cert\") pod \"965c85ad-81e8-488f-8ff3-af41b04b7c6c\" (UID: \"965c85ad-81e8-488f-8ff3-af41b04b7c6c\") "
Sep 15 09:16:29.180225 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:29.179967    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/965c85ad-81e8-488f-8ff3-af41b04b7c6c-console-serving-cert\") pod \"965c85ad-81e8-488f-8ff3-af41b04b7c6c\" (UID: \"965c85ad-81e8-488f-8ff3-af41b04b7c6c\") "
Sep 15 09:16:29.180225 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:29.179992    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/965c85ad-81e8-488f-8ff3-af41b04b7c6c-service-ca\") pod \"965c85ad-81e8-488f-8ff3-af41b04b7c6c\" (UID: \"965c85ad-81e8-488f-8ff3-af41b04b7c6c\") "
Sep 15 09:16:29.180225 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:29.180051    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/965c85ad-81e8-488f-8ff3-af41b04b7c6c-console-config\") pod \"965c85ad-81e8-488f-8ff3-af41b04b7c6c\" (UID: \"965c85ad-81e8-488f-8ff3-af41b04b7c6c\") "
Sep 15 09:16:29.180225 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:29.180093    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/965c85ad-81e8-488f-8ff3-af41b04b7c6c-console-oauth-config\") pod \"965c85ad-81e8-488f-8ff3-af41b04b7c6c\" (UID: \"965c85ad-81e8-488f-8ff3-af41b04b7c6c\") "
Sep 15 09:16:29.180430 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:29.180306    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/965c85ad-81e8-488f-8ff3-af41b04b7c6c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "965c85ad-81e8-488f-8ff3-af41b04b7c6c" (UID: "965c85ad-81e8-488f-8ff3-af41b04b7c6c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:16:29.180430 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:29.180395    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/965c85ad-81e8-488f-8ff3-af41b04b7c6c-service-ca" (OuterVolumeSpecName: "service-ca") pod "965c85ad-81e8-488f-8ff3-af41b04b7c6c" (UID: "965c85ad-81e8-488f-8ff3-af41b04b7c6c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:16:29.180567 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:29.180541    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/965c85ad-81e8-488f-8ff3-af41b04b7c6c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "965c85ad-81e8-488f-8ff3-af41b04b7c6c" (UID: "965c85ad-81e8-488f-8ff3-af41b04b7c6c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:16:29.180639 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:29.180569    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/965c85ad-81e8-488f-8ff3-af41b04b7c6c-console-config" (OuterVolumeSpecName: "console-config") pod "965c85ad-81e8-488f-8ff3-af41b04b7c6c" (UID: "965c85ad-81e8-488f-8ff3-af41b04b7c6c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:16:29.182260 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:29.182231    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/965c85ad-81e8-488f-8ff3-af41b04b7c6c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "965c85ad-81e8-488f-8ff3-af41b04b7c6c" (UID: "965c85ad-81e8-488f-8ff3-af41b04b7c6c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:16:29.182378 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:29.182283    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/965c85ad-81e8-488f-8ff3-af41b04b7c6c-kube-api-access-6mnt7" (OuterVolumeSpecName: "kube-api-access-6mnt7") pod "965c85ad-81e8-488f-8ff3-af41b04b7c6c" (UID: "965c85ad-81e8-488f-8ff3-af41b04b7c6c"). InnerVolumeSpecName "kube-api-access-6mnt7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:16:29.182378 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:29.182311    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/965c85ad-81e8-488f-8ff3-af41b04b7c6c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "965c85ad-81e8-488f-8ff3-af41b04b7c6c" (UID: "965c85ad-81e8-488f-8ff3-af41b04b7c6c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:16:29.281511 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:29.281470    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6mnt7\" (UniqueName: \"kubernetes.io/projected/965c85ad-81e8-488f-8ff3-af41b04b7c6c-kube-api-access-6mnt7\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:16:29.281511 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:29.281514    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/965c85ad-81e8-488f-8ff3-af41b04b7c6c-oauth-serving-cert\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:16:29.281693 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:29.281531    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/965c85ad-81e8-488f-8ff3-af41b04b7c6c-console-serving-cert\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:16:29.281693 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:29.281545    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/965c85ad-81e8-488f-8ff3-af41b04b7c6c-service-ca\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:16:29.281693 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:29.281558    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/965c85ad-81e8-488f-8ff3-af41b04b7c6c-console-config\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:16:29.281693 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:29.281570    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/965c85ad-81e8-488f-8ff3-af41b04b7c6c-console-oauth-config\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:16:29.281693 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:29.281582    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/965c85ad-81e8-488f-8ff3-af41b04b7c6c-trusted-ca-bundle\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:16:29.804449 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:29.804411    2578 generic.go:356] "Generic (PLEG): container finished" podID="965c85ad-81e8-488f-8ff3-af41b04b7c6c" containerID="23ffc11823bc579fc413e6eee7dc744488ec6819d80311ea2d30528f30755b69" exitCode=0
Sep 15 09:16:29.804887 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:29.804446    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57876c4c87-kvqd7" event={"ID":"965c85ad-81e8-488f-8ff3-af41b04b7c6c","Type":"ContainerDied","Data":"23ffc11823bc579fc413e6eee7dc744488ec6819d80311ea2d30528f30755b69"}
Sep 15 09:16:29.804887 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:29.804493    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57876c4c87-kvqd7"
Sep 15 09:16:29.804887 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:29.804543    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57876c4c87-kvqd7" event={"ID":"965c85ad-81e8-488f-8ff3-af41b04b7c6c","Type":"ContainerDied","Data":"c117456a1a8e80902042ad1f622c106311fa2c2553afce877b820e31c3c94db2"}
Sep 15 09:16:29.804887 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:29.804579    2578 scope.go:117] "RemoveContainer" containerID="23ffc11823bc579fc413e6eee7dc744488ec6819d80311ea2d30528f30755b69"
Sep 15 09:16:29.813824 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:29.813806    2578 scope.go:117] "RemoveContainer" containerID="23ffc11823bc579fc413e6eee7dc744488ec6819d80311ea2d30528f30755b69"
Sep 15 09:16:29.814109 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:16:29.814092    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23ffc11823bc579fc413e6eee7dc744488ec6819d80311ea2d30528f30755b69\": container with ID starting with 23ffc11823bc579fc413e6eee7dc744488ec6819d80311ea2d30528f30755b69 not found: ID does not exist" containerID="23ffc11823bc579fc413e6eee7dc744488ec6819d80311ea2d30528f30755b69"
Sep 15 09:16:29.814160 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:29.814117    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23ffc11823bc579fc413e6eee7dc744488ec6819d80311ea2d30528f30755b69"} err="failed to get container status \"23ffc11823bc579fc413e6eee7dc744488ec6819d80311ea2d30528f30755b69\": rpc error: code = NotFound desc = could not find container \"23ffc11823bc579fc413e6eee7dc744488ec6819d80311ea2d30528f30755b69\": container with ID starting with 23ffc11823bc579fc413e6eee7dc744488ec6819d80311ea2d30528f30755b69 not found: ID does not exist"
Sep 15 09:16:29.826041 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:29.826010    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57876c4c87-kvqd7"]
Sep 15 09:16:29.829809 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:29.829780    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-57876c4c87-kvqd7"]
Sep 15 09:16:30.120403 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:16:30.120332    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="965c85ad-81e8-488f-8ff3-af41b04b7c6c" path="/var/lib/kubelet/pods/965c85ad-81e8-488f-8ff3-af41b04b7c6c/volumes"
Sep 15 09:17:07.433238 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:07.433202    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 09:17:07.433818 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:07.433487    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3887b186-0ad7-4e6c-bbae-6a037340e5ed" containerName="alertmanager" containerID="cri-o://661ea5be675e67fc95b3661b41ec17da2cad7ead4f5164ecff0b5d8deb7ad22f" gracePeriod=120
Sep 15 09:17:07.433818 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:07.433550    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3887b186-0ad7-4e6c-bbae-6a037340e5ed" containerName="kube-rbac-proxy-metric" containerID="cri-o://4bc67dae8348922cafb82869b0a58a7d10c891566603e06ea043c2837c5b9b22" gracePeriod=120
Sep 15 09:17:07.433818 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:07.433638    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3887b186-0ad7-4e6c-bbae-6a037340e5ed" containerName="kube-rbac-proxy-web" containerID="cri-o://86c8e742da3fd1ac5efec523d38389719b69e2463184bfb66c0b2bd627f219ab" gracePeriod=120
Sep 15 09:17:07.433818 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:07.433684    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3887b186-0ad7-4e6c-bbae-6a037340e5ed" containerName="config-reloader" containerID="cri-o://5fb30f978d25fd4fc677883f6453a217f458f31995a3c65f070c06484ab49cc9" gracePeriod=120
Sep 15 09:17:07.433818 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:07.433645    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3887b186-0ad7-4e6c-bbae-6a037340e5ed" containerName="kube-rbac-proxy" containerID="cri-o://f38404763f36af7a069c039384cbf597571bdef441afc52e6ffc04a95175e847" gracePeriod=120
Sep 15 09:17:07.433818 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:07.433645    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3887b186-0ad7-4e6c-bbae-6a037340e5ed" containerName="prom-label-proxy" containerID="cri-o://c8d50db370baae821562fecb04ac37f85e1effec630accf01f896c71db2f072d" gracePeriod=120
Sep 15 09:17:07.945728 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:07.945698    2578 generic.go:356] "Generic (PLEG): container finished" podID="3887b186-0ad7-4e6c-bbae-6a037340e5ed" containerID="c8d50db370baae821562fecb04ac37f85e1effec630accf01f896c71db2f072d" exitCode=0
Sep 15 09:17:07.945728 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:07.945720    2578 generic.go:356] "Generic (PLEG): container finished" podID="3887b186-0ad7-4e6c-bbae-6a037340e5ed" containerID="f38404763f36af7a069c039384cbf597571bdef441afc52e6ffc04a95175e847" exitCode=0
Sep 15 09:17:07.945728 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:07.945727    2578 generic.go:356] "Generic (PLEG): container finished" podID="3887b186-0ad7-4e6c-bbae-6a037340e5ed" containerID="5fb30f978d25fd4fc677883f6453a217f458f31995a3c65f070c06484ab49cc9" exitCode=0
Sep 15 09:17:07.945728 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:07.945733    2578 generic.go:356] "Generic (PLEG): container finished" podID="3887b186-0ad7-4e6c-bbae-6a037340e5ed" containerID="661ea5be675e67fc95b3661b41ec17da2cad7ead4f5164ecff0b5d8deb7ad22f" exitCode=0
Sep 15 09:17:07.946050 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:07.945775    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3887b186-0ad7-4e6c-bbae-6a037340e5ed","Type":"ContainerDied","Data":"c8d50db370baae821562fecb04ac37f85e1effec630accf01f896c71db2f072d"}
Sep 15 09:17:07.946050 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:07.945863    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3887b186-0ad7-4e6c-bbae-6a037340e5ed","Type":"ContainerDied","Data":"f38404763f36af7a069c039384cbf597571bdef441afc52e6ffc04a95175e847"}
Sep 15 09:17:07.946050 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:07.945910    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3887b186-0ad7-4e6c-bbae-6a037340e5ed","Type":"ContainerDied","Data":"5fb30f978d25fd4fc677883f6453a217f458f31995a3c65f070c06484ab49cc9"}
Sep 15 09:17:07.946050 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:07.945982    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3887b186-0ad7-4e6c-bbae-6a037340e5ed","Type":"ContainerDied","Data":"661ea5be675e67fc95b3661b41ec17da2cad7ead4f5164ecff0b5d8deb7ad22f"}
Sep 15 09:17:08.670146 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:08.670122    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:17:08.738631 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:08.738564    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3887b186-0ad7-4e6c-bbae-6a037340e5ed-metrics-client-ca\") pod \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\" (UID: \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\") "
Sep 15 09:17:08.738631 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:08.738609    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3887b186-0ad7-4e6c-bbae-6a037340e5ed-tls-assets\") pod \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\" (UID: \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\") "
Sep 15 09:17:08.738631 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:08.738626    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3887b186-0ad7-4e6c-bbae-6a037340e5ed-config-out\") pod \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\" (UID: \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\") "
Sep 15 09:17:08.738864 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:08.738646    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g9dkm\" (UniqueName: \"kubernetes.io/projected/3887b186-0ad7-4e6c-bbae-6a037340e5ed-kube-api-access-g9dkm\") pod \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\" (UID: \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\") "
Sep 15 09:17:08.738864 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:08.738778    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3887b186-0ad7-4e6c-bbae-6a037340e5ed-cluster-tls-config\") pod \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\" (UID: \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\") "
Sep 15 09:17:08.738864 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:08.738820    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3887b186-0ad7-4e6c-bbae-6a037340e5ed-secret-alertmanager-kube-rbac-proxy-metric\") pod \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\" (UID: \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\") "
Sep 15 09:17:08.738864 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:08.738857    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3887b186-0ad7-4e6c-bbae-6a037340e5ed-secret-alertmanager-main-tls\") pod \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\" (UID: \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\") "
Sep 15 09:17:08.739105 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:08.738886    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3887b186-0ad7-4e6c-bbae-6a037340e5ed-alertmanager-trusted-ca-bundle\") pod \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\" (UID: \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\") "
Sep 15 09:17:08.739105 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:08.738933    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3887b186-0ad7-4e6c-bbae-6a037340e5ed-alertmanager-main-db\") pod \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\" (UID: \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\") "
Sep 15 09:17:08.739105 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:08.738940    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3887b186-0ad7-4e6c-bbae-6a037340e5ed-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "3887b186-0ad7-4e6c-bbae-6a037340e5ed" (UID: "3887b186-0ad7-4e6c-bbae-6a037340e5ed"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:17:08.739105 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:08.738977    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3887b186-0ad7-4e6c-bbae-6a037340e5ed-secret-alertmanager-kube-rbac-proxy\") pod \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\" (UID: \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\") "
Sep 15 09:17:08.739105 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:08.739016    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3887b186-0ad7-4e6c-bbae-6a037340e5ed-web-config\") pod \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\" (UID: \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\") "
Sep 15 09:17:08.739105 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:08.739047    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3887b186-0ad7-4e6c-bbae-6a037340e5ed-config-volume\") pod \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\" (UID: \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\") "
Sep 15 09:17:08.739105 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:08.739079    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3887b186-0ad7-4e6c-bbae-6a037340e5ed-secret-alertmanager-kube-rbac-proxy-web\") pod \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\" (UID: \"3887b186-0ad7-4e6c-bbae-6a037340e5ed\") "
Sep 15 09:17:08.739454 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:08.739298    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3887b186-0ad7-4e6c-bbae-6a037340e5ed-metrics-client-ca\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:17:08.739454 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:08.739316    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3887b186-0ad7-4e6c-bbae-6a037340e5ed-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "3887b186-0ad7-4e6c-bbae-6a037340e5ed" (UID: "3887b186-0ad7-4e6c-bbae-6a037340e5ed"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:17:08.740173 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:08.739999    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3887b186-0ad7-4e6c-bbae-6a037340e5ed-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "3887b186-0ad7-4e6c-bbae-6a037340e5ed" (UID: "3887b186-0ad7-4e6c-bbae-6a037340e5ed"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:17:08.741831 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:08.741806    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3887b186-0ad7-4e6c-bbae-6a037340e5ed-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "3887b186-0ad7-4e6c-bbae-6a037340e5ed" (UID: "3887b186-0ad7-4e6c-bbae-6a037340e5ed"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:17:08.741977 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:08.741913    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3887b186-0ad7-4e6c-bbae-6a037340e5ed-config-out" (OuterVolumeSpecName: "config-out") pod "3887b186-0ad7-4e6c-bbae-6a037340e5ed" (UID: "3887b186-0ad7-4e6c-bbae-6a037340e5ed"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:17:08.742748 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:08.742710    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3887b186-0ad7-4e6c-bbae-6a037340e5ed-kube-api-access-g9dkm" (OuterVolumeSpecName: "kube-api-access-g9dkm") pod "3887b186-0ad7-4e6c-bbae-6a037340e5ed" (UID: "3887b186-0ad7-4e6c-bbae-6a037340e5ed"). InnerVolumeSpecName "kube-api-access-g9dkm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:17:08.743507 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:08.743481    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3887b186-0ad7-4e6c-bbae-6a037340e5ed-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "3887b186-0ad7-4e6c-bbae-6a037340e5ed" (UID: "3887b186-0ad7-4e6c-bbae-6a037340e5ed"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:17:08.743855 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:08.743822    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3887b186-0ad7-4e6c-bbae-6a037340e5ed-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "3887b186-0ad7-4e6c-bbae-6a037340e5ed" (UID: "3887b186-0ad7-4e6c-bbae-6a037340e5ed"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:17:08.744640 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:08.744614    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3887b186-0ad7-4e6c-bbae-6a037340e5ed-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "3887b186-0ad7-4e6c-bbae-6a037340e5ed" (UID: "3887b186-0ad7-4e6c-bbae-6a037340e5ed"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:17:08.745180 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:08.745149    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3887b186-0ad7-4e6c-bbae-6a037340e5ed-config-volume" (OuterVolumeSpecName: "config-volume") pod "3887b186-0ad7-4e6c-bbae-6a037340e5ed" (UID: "3887b186-0ad7-4e6c-bbae-6a037340e5ed"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:17:08.745268 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:08.745224    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3887b186-0ad7-4e6c-bbae-6a037340e5ed-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "3887b186-0ad7-4e6c-bbae-6a037340e5ed" (UID: "3887b186-0ad7-4e6c-bbae-6a037340e5ed"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:17:08.748509 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:08.748488    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3887b186-0ad7-4e6c-bbae-6a037340e5ed-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "3887b186-0ad7-4e6c-bbae-6a037340e5ed" (UID: "3887b186-0ad7-4e6c-bbae-6a037340e5ed"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:17:08.755141 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:08.755119    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3887b186-0ad7-4e6c-bbae-6a037340e5ed-web-config" (OuterVolumeSpecName: "web-config") pod "3887b186-0ad7-4e6c-bbae-6a037340e5ed" (UID: "3887b186-0ad7-4e6c-bbae-6a037340e5ed"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:17:08.840272 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:08.840252    2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3887b186-0ad7-4e6c-bbae-6a037340e5ed-tls-assets\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:17:08.840272 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:08.840270    2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3887b186-0ad7-4e6c-bbae-6a037340e5ed-config-out\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:17:08.840390 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:08.840279    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g9dkm\" (UniqueName: \"kubernetes.io/projected/3887b186-0ad7-4e6c-bbae-6a037340e5ed-kube-api-access-g9dkm\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:17:08.840390 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:08.840288    2578 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3887b186-0ad7-4e6c-bbae-6a037340e5ed-cluster-tls-config\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:17:08.840390 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:08.840298    2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3887b186-0ad7-4e6c-bbae-6a037340e5ed-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:17:08.840390 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:08.840306    2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3887b186-0ad7-4e6c-bbae-6a037340e5ed-secret-alertmanager-main-tls\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:17:08.840390 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:08.840314    2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3887b186-0ad7-4e6c-bbae-6a037340e5ed-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:17:08.840390 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:08.840326    2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3887b186-0ad7-4e6c-bbae-6a037340e5ed-alertmanager-main-db\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:17:08.840390 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:08.840335    2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3887b186-0ad7-4e6c-bbae-6a037340e5ed-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:17:08.840390 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:08.840343    2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3887b186-0ad7-4e6c-bbae-6a037340e5ed-web-config\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:17:08.840390 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:08.840350    2578 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3887b186-0ad7-4e6c-bbae-6a037340e5ed-config-volume\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:17:08.840390 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:08.840358    2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3887b186-0ad7-4e6c-bbae-6a037340e5ed-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:17:08.952892 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:08.952865    2578 generic.go:356] "Generic (PLEG): container finished" podID="3887b186-0ad7-4e6c-bbae-6a037340e5ed" containerID="4bc67dae8348922cafb82869b0a58a7d10c891566603e06ea043c2837c5b9b22" exitCode=0
Sep 15 09:17:08.952892 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:08.952888    2578 generic.go:356] "Generic (PLEG): container finished" podID="3887b186-0ad7-4e6c-bbae-6a037340e5ed" containerID="86c8e742da3fd1ac5efec523d38389719b69e2463184bfb66c0b2bd627f219ab" exitCode=0
Sep 15 09:17:08.953071 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:08.952919    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3887b186-0ad7-4e6c-bbae-6a037340e5ed","Type":"ContainerDied","Data":"4bc67dae8348922cafb82869b0a58a7d10c891566603e06ea043c2837c5b9b22"}
Sep 15 09:17:08.953071 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:08.952959    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:17:08.953071 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:08.953017    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3887b186-0ad7-4e6c-bbae-6a037340e5ed","Type":"ContainerDied","Data":"86c8e742da3fd1ac5efec523d38389719b69e2463184bfb66c0b2bd627f219ab"}
Sep 15 09:17:08.953071 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:08.953067    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3887b186-0ad7-4e6c-bbae-6a037340e5ed","Type":"ContainerDied","Data":"631e6709cf75eb1b1dc3501c5748cd9a9ab59584e9609bcb038ed11c7951b93f"}
Sep 15 09:17:08.953229 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:08.953094    2578 scope.go:117] "RemoveContainer" containerID="c8d50db370baae821562fecb04ac37f85e1effec630accf01f896c71db2f072d"
Sep 15 09:17:08.960531 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:08.960510    2578 scope.go:117] "RemoveContainer" containerID="4bc67dae8348922cafb82869b0a58a7d10c891566603e06ea043c2837c5b9b22"
Sep 15 09:17:08.968239 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:08.968218    2578 scope.go:117] "RemoveContainer" containerID="f38404763f36af7a069c039384cbf597571bdef441afc52e6ffc04a95175e847"
Sep 15 09:17:08.974919 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:08.974899    2578 scope.go:117] "RemoveContainer" containerID="86c8e742da3fd1ac5efec523d38389719b69e2463184bfb66c0b2bd627f219ab"
Sep 15 09:17:08.980788 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:08.980766    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 09:17:08.981730 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:08.981712    2578 scope.go:117] "RemoveContainer" containerID="5fb30f978d25fd4fc677883f6453a217f458f31995a3c65f070c06484ab49cc9"
Sep 15 09:17:08.988519 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:08.988501    2578 scope.go:117] "RemoveContainer" containerID="661ea5be675e67fc95b3661b41ec17da2cad7ead4f5164ecff0b5d8deb7ad22f"
Sep 15 09:17:08.988818 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:08.988771    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 09:17:08.994764 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:08.994747    2578 scope.go:117] "RemoveContainer" containerID="2f679a120e68bbcc6b0630a6b72eac1423e3ce1a1834d2b3f1bf0ca88a6c4805"
Sep 15 09:17:09.000909 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.000895    2578 scope.go:117] "RemoveContainer" containerID="c8d50db370baae821562fecb04ac37f85e1effec630accf01f896c71db2f072d"
Sep 15 09:17:09.001200 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:17:09.001182    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8d50db370baae821562fecb04ac37f85e1effec630accf01f896c71db2f072d\": container with ID starting with c8d50db370baae821562fecb04ac37f85e1effec630accf01f896c71db2f072d not found: ID does not exist" containerID="c8d50db370baae821562fecb04ac37f85e1effec630accf01f896c71db2f072d"
Sep 15 09:17:09.001259 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.001206    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8d50db370baae821562fecb04ac37f85e1effec630accf01f896c71db2f072d"} err="failed to get container status \"c8d50db370baae821562fecb04ac37f85e1effec630accf01f896c71db2f072d\": rpc error: code = NotFound desc = could not find container \"c8d50db370baae821562fecb04ac37f85e1effec630accf01f896c71db2f072d\": container with ID starting with c8d50db370baae821562fecb04ac37f85e1effec630accf01f896c71db2f072d not found: ID does not exist"
Sep 15 09:17:09.001259 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.001222    2578 scope.go:117] "RemoveContainer" containerID="4bc67dae8348922cafb82869b0a58a7d10c891566603e06ea043c2837c5b9b22"
Sep 15 09:17:09.001449 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:17:09.001432    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bc67dae8348922cafb82869b0a58a7d10c891566603e06ea043c2837c5b9b22\": container with ID starting with 4bc67dae8348922cafb82869b0a58a7d10c891566603e06ea043c2837c5b9b22 not found: ID does not exist" containerID="4bc67dae8348922cafb82869b0a58a7d10c891566603e06ea043c2837c5b9b22"
Sep 15 09:17:09.001490 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.001455    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bc67dae8348922cafb82869b0a58a7d10c891566603e06ea043c2837c5b9b22"} err="failed to get container status \"4bc67dae8348922cafb82869b0a58a7d10c891566603e06ea043c2837c5b9b22\": rpc error: code = NotFound desc = could not find container \"4bc67dae8348922cafb82869b0a58a7d10c891566603e06ea043c2837c5b9b22\": container with ID starting with 4bc67dae8348922cafb82869b0a58a7d10c891566603e06ea043c2837c5b9b22 not found: ID does not exist"
Sep 15 09:17:09.001490 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.001468    2578 scope.go:117] "RemoveContainer" containerID="f38404763f36af7a069c039384cbf597571bdef441afc52e6ffc04a95175e847"
Sep 15 09:17:09.001714 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:17:09.001697    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f38404763f36af7a069c039384cbf597571bdef441afc52e6ffc04a95175e847\": container with ID starting with f38404763f36af7a069c039384cbf597571bdef441afc52e6ffc04a95175e847 not found: ID does not exist" containerID="f38404763f36af7a069c039384cbf597571bdef441afc52e6ffc04a95175e847"
Sep 15 09:17:09.001755 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.001718    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f38404763f36af7a069c039384cbf597571bdef441afc52e6ffc04a95175e847"} err="failed to get container status \"f38404763f36af7a069c039384cbf597571bdef441afc52e6ffc04a95175e847\": rpc error: code = NotFound desc = could not find container \"f38404763f36af7a069c039384cbf597571bdef441afc52e6ffc04a95175e847\": container with ID starting with f38404763f36af7a069c039384cbf597571bdef441afc52e6ffc04a95175e847 not found: ID does not exist"
Sep 15 09:17:09.001755 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.001731    2578 scope.go:117] "RemoveContainer" containerID="86c8e742da3fd1ac5efec523d38389719b69e2463184bfb66c0b2bd627f219ab"
Sep 15 09:17:09.001989 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:17:09.001973    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86c8e742da3fd1ac5efec523d38389719b69e2463184bfb66c0b2bd627f219ab\": container with ID starting with 86c8e742da3fd1ac5efec523d38389719b69e2463184bfb66c0b2bd627f219ab not found: ID does not exist" containerID="86c8e742da3fd1ac5efec523d38389719b69e2463184bfb66c0b2bd627f219ab"
Sep 15 09:17:09.002032 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.001995    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86c8e742da3fd1ac5efec523d38389719b69e2463184bfb66c0b2bd627f219ab"} err="failed to get container status \"86c8e742da3fd1ac5efec523d38389719b69e2463184bfb66c0b2bd627f219ab\": rpc error: code = NotFound desc = could not find container \"86c8e742da3fd1ac5efec523d38389719b69e2463184bfb66c0b2bd627f219ab\": container with ID starting with 86c8e742da3fd1ac5efec523d38389719b69e2463184bfb66c0b2bd627f219ab not found: ID does not exist"
Sep 15 09:17:09.002032 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.002009    2578 scope.go:117] "RemoveContainer" containerID="5fb30f978d25fd4fc677883f6453a217f458f31995a3c65f070c06484ab49cc9"
Sep 15 09:17:09.002217 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:17:09.002201    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fb30f978d25fd4fc677883f6453a217f458f31995a3c65f070c06484ab49cc9\": container with ID starting with 5fb30f978d25fd4fc677883f6453a217f458f31995a3c65f070c06484ab49cc9 not found: ID does not exist" containerID="5fb30f978d25fd4fc677883f6453a217f458f31995a3c65f070c06484ab49cc9"
Sep 15 09:17:09.002250 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.002220    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fb30f978d25fd4fc677883f6453a217f458f31995a3c65f070c06484ab49cc9"} err="failed to get container status \"5fb30f978d25fd4fc677883f6453a217f458f31995a3c65f070c06484ab49cc9\": rpc error: code = NotFound desc = could not find container \"5fb30f978d25fd4fc677883f6453a217f458f31995a3c65f070c06484ab49cc9\": container with ID starting with 5fb30f978d25fd4fc677883f6453a217f458f31995a3c65f070c06484ab49cc9 not found: ID does not exist"
Sep 15 09:17:09.002250 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.002233    2578 scope.go:117] "RemoveContainer" containerID="661ea5be675e67fc95b3661b41ec17da2cad7ead4f5164ecff0b5d8deb7ad22f"
Sep 15 09:17:09.002442 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:17:09.002428    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"661ea5be675e67fc95b3661b41ec17da2cad7ead4f5164ecff0b5d8deb7ad22f\": container with ID starting with 661ea5be675e67fc95b3661b41ec17da2cad7ead4f5164ecff0b5d8deb7ad22f not found: ID does not exist" containerID="661ea5be675e67fc95b3661b41ec17da2cad7ead4f5164ecff0b5d8deb7ad22f"
Sep 15 09:17:09.002481 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.002445    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"661ea5be675e67fc95b3661b41ec17da2cad7ead4f5164ecff0b5d8deb7ad22f"} err="failed to get container status \"661ea5be675e67fc95b3661b41ec17da2cad7ead4f5164ecff0b5d8deb7ad22f\": rpc error: code = NotFound desc = could not find container \"661ea5be675e67fc95b3661b41ec17da2cad7ead4f5164ecff0b5d8deb7ad22f\": container with ID starting with 661ea5be675e67fc95b3661b41ec17da2cad7ead4f5164ecff0b5d8deb7ad22f not found: ID does not exist"
Sep 15 09:17:09.002481 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.002457    2578 scope.go:117] "RemoveContainer" containerID="2f679a120e68bbcc6b0630a6b72eac1423e3ce1a1834d2b3f1bf0ca88a6c4805"
Sep 15 09:17:09.002675 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:17:09.002657    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f679a120e68bbcc6b0630a6b72eac1423e3ce1a1834d2b3f1bf0ca88a6c4805\": container with ID starting with 2f679a120e68bbcc6b0630a6b72eac1423e3ce1a1834d2b3f1bf0ca88a6c4805 not found: ID does not exist" containerID="2f679a120e68bbcc6b0630a6b72eac1423e3ce1a1834d2b3f1bf0ca88a6c4805"
Sep 15 09:17:09.002711 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.002679    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f679a120e68bbcc6b0630a6b72eac1423e3ce1a1834d2b3f1bf0ca88a6c4805"} err="failed to get container status \"2f679a120e68bbcc6b0630a6b72eac1423e3ce1a1834d2b3f1bf0ca88a6c4805\": rpc error: code = NotFound desc = could not find container \"2f679a120e68bbcc6b0630a6b72eac1423e3ce1a1834d2b3f1bf0ca88a6c4805\": container with ID starting with 2f679a120e68bbcc6b0630a6b72eac1423e3ce1a1834d2b3f1bf0ca88a6c4805 not found: ID does not exist"
Sep 15 09:17:09.002711 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.002691    2578 scope.go:117] "RemoveContainer" containerID="c8d50db370baae821562fecb04ac37f85e1effec630accf01f896c71db2f072d"
Sep 15 09:17:09.002899 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.002878    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8d50db370baae821562fecb04ac37f85e1effec630accf01f896c71db2f072d"} err="failed to get container status \"c8d50db370baae821562fecb04ac37f85e1effec630accf01f896c71db2f072d\": rpc error: code = NotFound desc = could not find container \"c8d50db370baae821562fecb04ac37f85e1effec630accf01f896c71db2f072d\": container with ID starting with c8d50db370baae821562fecb04ac37f85e1effec630accf01f896c71db2f072d not found: ID does not exist"
Sep 15 09:17:09.002940 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.002900    2578 scope.go:117] "RemoveContainer" containerID="4bc67dae8348922cafb82869b0a58a7d10c891566603e06ea043c2837c5b9b22"
Sep 15 09:17:09.003135 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.003119    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bc67dae8348922cafb82869b0a58a7d10c891566603e06ea043c2837c5b9b22"} err="failed to get container status \"4bc67dae8348922cafb82869b0a58a7d10c891566603e06ea043c2837c5b9b22\": rpc error: code = NotFound desc = could not find container \"4bc67dae8348922cafb82869b0a58a7d10c891566603e06ea043c2837c5b9b22\": container with ID starting with 4bc67dae8348922cafb82869b0a58a7d10c891566603e06ea043c2837c5b9b22 not found: ID does not exist"
Sep 15 09:17:09.003176 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.003135    2578 scope.go:117] "RemoveContainer" containerID="f38404763f36af7a069c039384cbf597571bdef441afc52e6ffc04a95175e847"
Sep 15 09:17:09.003372 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.003353    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f38404763f36af7a069c039384cbf597571bdef441afc52e6ffc04a95175e847"} err="failed to get container status \"f38404763f36af7a069c039384cbf597571bdef441afc52e6ffc04a95175e847\": rpc error: code = NotFound desc = could not find container \"f38404763f36af7a069c039384cbf597571bdef441afc52e6ffc04a95175e847\": container with ID starting with f38404763f36af7a069c039384cbf597571bdef441afc52e6ffc04a95175e847 not found: ID does not exist"
Sep 15 09:17:09.003414 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.003373    2578 scope.go:117] "RemoveContainer" containerID="86c8e742da3fd1ac5efec523d38389719b69e2463184bfb66c0b2bd627f219ab"
Sep 15 09:17:09.003591 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.003575    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86c8e742da3fd1ac5efec523d38389719b69e2463184bfb66c0b2bd627f219ab"} err="failed to get container status \"86c8e742da3fd1ac5efec523d38389719b69e2463184bfb66c0b2bd627f219ab\": rpc error: code = NotFound desc = could not find container \"86c8e742da3fd1ac5efec523d38389719b69e2463184bfb66c0b2bd627f219ab\": container with ID starting with 86c8e742da3fd1ac5efec523d38389719b69e2463184bfb66c0b2bd627f219ab not found: ID does not exist"
Sep 15 09:17:09.003634 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.003592    2578 scope.go:117] "RemoveContainer" containerID="5fb30f978d25fd4fc677883f6453a217f458f31995a3c65f070c06484ab49cc9"
Sep 15 09:17:09.003792 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.003777    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fb30f978d25fd4fc677883f6453a217f458f31995a3c65f070c06484ab49cc9"} err="failed to get container status \"5fb30f978d25fd4fc677883f6453a217f458f31995a3c65f070c06484ab49cc9\": rpc error: code = NotFound desc = could not find container \"5fb30f978d25fd4fc677883f6453a217f458f31995a3c65f070c06484ab49cc9\": container with ID starting with 5fb30f978d25fd4fc677883f6453a217f458f31995a3c65f070c06484ab49cc9 not found: ID does not exist"
Sep 15 09:17:09.003830 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.003792    2578 scope.go:117] "RemoveContainer" containerID="661ea5be675e67fc95b3661b41ec17da2cad7ead4f5164ecff0b5d8deb7ad22f"
Sep 15 09:17:09.004013 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.003997    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"661ea5be675e67fc95b3661b41ec17da2cad7ead4f5164ecff0b5d8deb7ad22f"} err="failed to get container status \"661ea5be675e67fc95b3661b41ec17da2cad7ead4f5164ecff0b5d8deb7ad22f\": rpc error: code = NotFound desc = could not find container \"661ea5be675e67fc95b3661b41ec17da2cad7ead4f5164ecff0b5d8deb7ad22f\": container with ID starting with 661ea5be675e67fc95b3661b41ec17da2cad7ead4f5164ecff0b5d8deb7ad22f not found: ID does not exist"
Sep 15 09:17:09.004060 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.004013    2578 scope.go:117] "RemoveContainer" containerID="2f679a120e68bbcc6b0630a6b72eac1423e3ce1a1834d2b3f1bf0ca88a6c4805"
Sep 15 09:17:09.004225 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.004208    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f679a120e68bbcc6b0630a6b72eac1423e3ce1a1834d2b3f1bf0ca88a6c4805"} err="failed to get container status \"2f679a120e68bbcc6b0630a6b72eac1423e3ce1a1834d2b3f1bf0ca88a6c4805\": rpc error: code = NotFound desc = could not find container \"2f679a120e68bbcc6b0630a6b72eac1423e3ce1a1834d2b3f1bf0ca88a6c4805\": container with ID starting with 2f679a120e68bbcc6b0630a6b72eac1423e3ce1a1834d2b3f1bf0ca88a6c4805 not found: ID does not exist"
Sep 15 09:17:09.013483 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.013464    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 09:17:09.013710 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.013698    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3887b186-0ad7-4e6c-bbae-6a037340e5ed" containerName="alertmanager"
Sep 15 09:17:09.013755 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.013712    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3887b186-0ad7-4e6c-bbae-6a037340e5ed" containerName="alertmanager"
Sep 15 09:17:09.013755 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.013720    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3887b186-0ad7-4e6c-bbae-6a037340e5ed" containerName="config-reloader"
Sep 15 09:17:09.013755 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.013725    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3887b186-0ad7-4e6c-bbae-6a037340e5ed" containerName="config-reloader"
Sep 15 09:17:09.013755 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.013737    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21fdbbc4-98af-492c-8165-acd08bc6394c" containerName="console"
Sep 15 09:17:09.013755 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.013744    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="21fdbbc4-98af-492c-8165-acd08bc6394c" containerName="console"
Sep 15 09:17:09.013755 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.013752    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3887b186-0ad7-4e6c-bbae-6a037340e5ed" containerName="init-config-reloader"
Sep 15 09:17:09.013921 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.013757    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3887b186-0ad7-4e6c-bbae-6a037340e5ed" containerName="init-config-reloader"
Sep 15 09:17:09.013921 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.013764    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3887b186-0ad7-4e6c-bbae-6a037340e5ed" containerName="prom-label-proxy"
Sep 15 09:17:09.013921 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.013769    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3887b186-0ad7-4e6c-bbae-6a037340e5ed" containerName="prom-label-proxy"
Sep 15 09:17:09.013921 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.013776    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3887b186-0ad7-4e6c-bbae-6a037340e5ed" containerName="kube-rbac-proxy-web"
Sep 15 09:17:09.013921 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.013780    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3887b186-0ad7-4e6c-bbae-6a037340e5ed" containerName="kube-rbac-proxy-web"
Sep 15 09:17:09.013921 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.013786    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3887b186-0ad7-4e6c-bbae-6a037340e5ed" containerName="kube-rbac-proxy-metric"
Sep 15 09:17:09.013921 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.013791    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3887b186-0ad7-4e6c-bbae-6a037340e5ed" containerName="kube-rbac-proxy-metric"
Sep 15 09:17:09.013921 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.013799    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3887b186-0ad7-4e6c-bbae-6a037340e5ed" containerName="kube-rbac-proxy"
Sep 15 09:17:09.013921 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.013803    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3887b186-0ad7-4e6c-bbae-6a037340e5ed" containerName="kube-rbac-proxy"
Sep 15 09:17:09.013921 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.013817    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="965c85ad-81e8-488f-8ff3-af41b04b7c6c" containerName="console"
Sep 15 09:17:09.013921 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.013824    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="965c85ad-81e8-488f-8ff3-af41b04b7c6c" containerName="console"
Sep 15 09:17:09.013921 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.013858    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3887b186-0ad7-4e6c-bbae-6a037340e5ed" containerName="kube-rbac-proxy"
Sep 15 09:17:09.013921 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.013863    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3887b186-0ad7-4e6c-bbae-6a037340e5ed" containerName="prom-label-proxy"
Sep 15 09:17:09.013921 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.013868    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="965c85ad-81e8-488f-8ff3-af41b04b7c6c" containerName="console"
Sep 15 09:17:09.013921 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.013873    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3887b186-0ad7-4e6c-bbae-6a037340e5ed" containerName="alertmanager"
Sep 15 09:17:09.013921 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.013878    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3887b186-0ad7-4e6c-bbae-6a037340e5ed" containerName="kube-rbac-proxy-web"
Sep 15 09:17:09.013921 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.013884    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="21fdbbc4-98af-492c-8165-acd08bc6394c" containerName="console"
Sep 15 09:17:09.013921 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.013890    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3887b186-0ad7-4e6c-bbae-6a037340e5ed" containerName="kube-rbac-proxy-metric"
Sep 15 09:17:09.013921 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.013899    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3887b186-0ad7-4e6c-bbae-6a037340e5ed" containerName="config-reloader"
Sep 15 09:17:09.017462 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.017447    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:17:09.019697 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.019679    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 15 09:17:09.019908 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.019884    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 15 09:17:09.020015 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.019940    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 15 09:17:09.020015 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.019993    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 15 09:17:09.020015 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.020008    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 15 09:17:09.020171 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.020012    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 15 09:17:09.020277 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.020260    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-66fn2\""
Sep 15 09:17:09.020343 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.020328    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 15 09:17:09.020396 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.020336    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 15 09:17:09.025294 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.025277    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 15 09:17:09.030290 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.030269    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 09:17:09.041375 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.041353    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/878b5bc4-e521-4ed1-a955-ccc71231091c-config-volume\") pod \"alertmanager-main-0\" (UID: \"878b5bc4-e521-4ed1-a955-ccc71231091c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:17:09.041467 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.041385    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/878b5bc4-e521-4ed1-a955-ccc71231091c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"878b5bc4-e521-4ed1-a955-ccc71231091c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:17:09.041467 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.041407    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/878b5bc4-e521-4ed1-a955-ccc71231091c-config-out\") pod \"alertmanager-main-0\" (UID: \"878b5bc4-e521-4ed1-a955-ccc71231091c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:17:09.041467 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.041423    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/878b5bc4-e521-4ed1-a955-ccc71231091c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"878b5bc4-e521-4ed1-a955-ccc71231091c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:17:09.041467 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.041454    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/878b5bc4-e521-4ed1-a955-ccc71231091c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"878b5bc4-e521-4ed1-a955-ccc71231091c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:17:09.041633 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.041518    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzsfr\" (UniqueName: \"kubernetes.io/projected/878b5bc4-e521-4ed1-a955-ccc71231091c-kube-api-access-pzsfr\") pod \"alertmanager-main-0\" (UID: \"878b5bc4-e521-4ed1-a955-ccc71231091c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:17:09.041633 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.041538    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/878b5bc4-e521-4ed1-a955-ccc71231091c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"878b5bc4-e521-4ed1-a955-ccc71231091c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:17:09.041633 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.041553    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/878b5bc4-e521-4ed1-a955-ccc71231091c-web-config\") pod \"alertmanager-main-0\" (UID: \"878b5bc4-e521-4ed1-a955-ccc71231091c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:17:09.041633 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.041567    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/878b5bc4-e521-4ed1-a955-ccc71231091c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"878b5bc4-e521-4ed1-a955-ccc71231091c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:17:09.041633 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.041605    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/878b5bc4-e521-4ed1-a955-ccc71231091c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"878b5bc4-e521-4ed1-a955-ccc71231091c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:17:09.041807 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.041686    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/878b5bc4-e521-4ed1-a955-ccc71231091c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"878b5bc4-e521-4ed1-a955-ccc71231091c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:17:09.041807 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.041715    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/878b5bc4-e521-4ed1-a955-ccc71231091c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"878b5bc4-e521-4ed1-a955-ccc71231091c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:17:09.041807 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.041755    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/878b5bc4-e521-4ed1-a955-ccc71231091c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"878b5bc4-e521-4ed1-a955-ccc71231091c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:17:09.142846 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.142822    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/878b5bc4-e521-4ed1-a955-ccc71231091c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"878b5bc4-e521-4ed1-a955-ccc71231091c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:17:09.142939 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.142852    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/878b5bc4-e521-4ed1-a955-ccc71231091c-config-volume\") pod \"alertmanager-main-0\" (UID: \"878b5bc4-e521-4ed1-a955-ccc71231091c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:17:09.142939 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.142882    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/878b5bc4-e521-4ed1-a955-ccc71231091c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"878b5bc4-e521-4ed1-a955-ccc71231091c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:17:09.142939 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.142903    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/878b5bc4-e521-4ed1-a955-ccc71231091c-config-out\") pod \"alertmanager-main-0\" (UID: \"878b5bc4-e521-4ed1-a955-ccc71231091c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:17:09.143114 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.143018    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/878b5bc4-e521-4ed1-a955-ccc71231091c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"878b5bc4-e521-4ed1-a955-ccc71231091c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:17:09.143114 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.143048    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/878b5bc4-e521-4ed1-a955-ccc71231091c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"878b5bc4-e521-4ed1-a955-ccc71231091c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:17:09.143114 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.143091    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzsfr\" (UniqueName: \"kubernetes.io/projected/878b5bc4-e521-4ed1-a955-ccc71231091c-kube-api-access-pzsfr\") pod \"alertmanager-main-0\" (UID: \"878b5bc4-e521-4ed1-a955-ccc71231091c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:17:09.143266 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.143125    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/878b5bc4-e521-4ed1-a955-ccc71231091c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"878b5bc4-e521-4ed1-a955-ccc71231091c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:17:09.143266 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.143154    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/878b5bc4-e521-4ed1-a955-ccc71231091c-web-config\") pod \"alertmanager-main-0\" (UID: \"878b5bc4-e521-4ed1-a955-ccc71231091c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:17:09.143266 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.143180    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/878b5bc4-e521-4ed1-a955-ccc71231091c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"878b5bc4-e521-4ed1-a955-ccc71231091c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:17:09.143266 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.143219    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/878b5bc4-e521-4ed1-a955-ccc71231091c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"878b5bc4-e521-4ed1-a955-ccc71231091c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:17:09.143266 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.143254    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/878b5bc4-e521-4ed1-a955-ccc71231091c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"878b5bc4-e521-4ed1-a955-ccc71231091c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:17:09.143513 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.143291    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/878b5bc4-e521-4ed1-a955-ccc71231091c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"878b5bc4-e521-4ed1-a955-ccc71231091c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:17:09.143725 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.143622    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/878b5bc4-e521-4ed1-a955-ccc71231091c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"878b5bc4-e521-4ed1-a955-ccc71231091c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:17:09.145286 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.144625    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/878b5bc4-e521-4ed1-a955-ccc71231091c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"878b5bc4-e521-4ed1-a955-ccc71231091c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:17:09.145662 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.145639    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/878b5bc4-e521-4ed1-a955-ccc71231091c-config-out\") pod \"alertmanager-main-0\" (UID: \"878b5bc4-e521-4ed1-a955-ccc71231091c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:17:09.145916 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.145895    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/878b5bc4-e521-4ed1-a955-ccc71231091c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"878b5bc4-e521-4ed1-a955-ccc71231091c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:17:09.146021 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.145927    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/878b5bc4-e521-4ed1-a955-ccc71231091c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"878b5bc4-e521-4ed1-a955-ccc71231091c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:17:09.146097 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.146077    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/878b5bc4-e521-4ed1-a955-ccc71231091c-config-volume\") pod \"alertmanager-main-0\" (UID: \"878b5bc4-e521-4ed1-a955-ccc71231091c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:17:09.146097 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.146088    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/878b5bc4-e521-4ed1-a955-ccc71231091c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"878b5bc4-e521-4ed1-a955-ccc71231091c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:17:09.146250 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.146226    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/878b5bc4-e521-4ed1-a955-ccc71231091c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"878b5bc4-e521-4ed1-a955-ccc71231091c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:17:09.146390 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.146367    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/878b5bc4-e521-4ed1-a955-ccc71231091c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"878b5bc4-e521-4ed1-a955-ccc71231091c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:17:09.146461 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.146391    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/878b5bc4-e521-4ed1-a955-ccc71231091c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"878b5bc4-e521-4ed1-a955-ccc71231091c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:17:09.147467 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.147445    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/878b5bc4-e521-4ed1-a955-ccc71231091c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"878b5bc4-e521-4ed1-a955-ccc71231091c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:17:09.147740 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.147721    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/878b5bc4-e521-4ed1-a955-ccc71231091c-web-config\") pod \"alertmanager-main-0\" (UID: \"878b5bc4-e521-4ed1-a955-ccc71231091c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:17:09.151293 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.151278    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzsfr\" (UniqueName: \"kubernetes.io/projected/878b5bc4-e521-4ed1-a955-ccc71231091c-kube-api-access-pzsfr\") pod \"alertmanager-main-0\" (UID: \"878b5bc4-e521-4ed1-a955-ccc71231091c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:17:09.326512 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.326460    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 15 09:17:09.623179 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.623150    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 09:17:09.623693 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:17:09.623669    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod878b5bc4_e521_4ed1_a955_ccc71231091c.slice/crio-e0e5705d6ec4a34d92c7efcf7f0aefa36f12a5a05123bf0e03c9510ba129c627 WatchSource:0}: Error finding container e0e5705d6ec4a34d92c7efcf7f0aefa36f12a5a05123bf0e03c9510ba129c627: Status 404 returned error can't find the container with id e0e5705d6ec4a34d92c7efcf7f0aefa36f12a5a05123bf0e03c9510ba129c627
Sep 15 09:17:09.959006 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.958972    2578 generic.go:356] "Generic (PLEG): container finished" podID="878b5bc4-e521-4ed1-a955-ccc71231091c" containerID="d877d9890c40a0accbaa2c90e83acc52c49c83e47f6b73129d2cd1d49787e929" exitCode=0
Sep 15 09:17:09.959398 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.959017    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"878b5bc4-e521-4ed1-a955-ccc71231091c","Type":"ContainerDied","Data":"d877d9890c40a0accbaa2c90e83acc52c49c83e47f6b73129d2cd1d49787e929"}
Sep 15 09:17:09.959398 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:09.959073    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"878b5bc4-e521-4ed1-a955-ccc71231091c","Type":"ContainerStarted","Data":"e0e5705d6ec4a34d92c7efcf7f0aefa36f12a5a05123bf0e03c9510ba129c627"}
Sep 15 09:17:10.120386 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:10.120362    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3887b186-0ad7-4e6c-bbae-6a037340e5ed" path="/var/lib/kubelet/pods/3887b186-0ad7-4e6c-bbae-6a037340e5ed/volumes"
Sep 15 09:17:10.966859 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:10.966825    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"878b5bc4-e521-4ed1-a955-ccc71231091c","Type":"ContainerStarted","Data":"1226f307e8db4ccd96db53edd400506994e3857218fe78047d8a86d0f06fdd4c"}
Sep 15 09:17:10.967294 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:10.966914    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"878b5bc4-e521-4ed1-a955-ccc71231091c","Type":"ContainerStarted","Data":"f064191dec2bc0e7b6a78b191bfe4f7b02765e9a6460699358005c2614f9e604"}
Sep 15 09:17:10.967294 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:10.967017    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"878b5bc4-e521-4ed1-a955-ccc71231091c","Type":"ContainerStarted","Data":"562534f10a768d9cf09fec2a10d4a821d5a895492f85555a02aac7cf1945c4d5"}
Sep 15 09:17:10.967294 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:10.967058    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"878b5bc4-e521-4ed1-a955-ccc71231091c","Type":"ContainerStarted","Data":"0393b94c67eeb990ac3cc4541a3c5d8e8f228e9cc28474321827dbe79255cda1"}
Sep 15 09:17:10.967294 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:10.967110    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"878b5bc4-e521-4ed1-a955-ccc71231091c","Type":"ContainerStarted","Data":"73ea7dc43c8adadef6d005d5c0f6031e6efc28388494a2226219cba1a8d4ba0b"}
Sep 15 09:17:10.967294 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:10.967151    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"878b5bc4-e521-4ed1-a955-ccc71231091c","Type":"ContainerStarted","Data":"595e0aa072a9a8e57c27de6389f48804c1176e32ca0f307ebeb901df2df2e65b"}
Sep 15 09:17:10.996430 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:10.996384    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.977803435 podStartE2EDuration="2.996366239s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.562804ms" isStatefulPod=false podCreationTimestamp="2026-09-15 09:17:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:17:10.994475882 +0000 UTC m=+175.332921156" watchObservedRunningTime="2026-09-15 09:17:10.996366239 +0000 UTC m=+175.334811515"
Sep 15 09:17:11.472048 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:11.472012    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-76f96fd4cf-8h5p5"]
Sep 15 09:17:11.474300 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:11.474279    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-76f96fd4cf-8h5p5"
Sep 15 09:17:11.480146 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:11.480114    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 15 09:17:11.480146 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:11.480134    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 15 09:17:11.480342 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:11.480309    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 15 09:17:11.481072 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:11.481045    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 15 09:17:11.481495 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:11.481178    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-2m89d\""
Sep 15 09:17:11.481610 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:11.481589    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 15 09:17:11.485353 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:11.485330    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 15 09:17:11.496823 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:11.496797    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-76f96fd4cf-8h5p5"]
Sep 15 09:17:11.558733 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:11.558705    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkjw6\" (UniqueName: \"kubernetes.io/projected/0904cc42-29a0-415d-a910-dc6de8788b86-kube-api-access-rkjw6\") pod \"telemeter-client-76f96fd4cf-8h5p5\" (UID: \"0904cc42-29a0-415d-a910-dc6de8788b86\") " pod="openshift-monitoring/telemeter-client-76f96fd4cf-8h5p5"
Sep 15 09:17:11.558849 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:11.558745    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0904cc42-29a0-415d-a910-dc6de8788b86-secret-telemeter-client\") pod \"telemeter-client-76f96fd4cf-8h5p5\" (UID: \"0904cc42-29a0-415d-a910-dc6de8788b86\") " pod="openshift-monitoring/telemeter-client-76f96fd4cf-8h5p5"
Sep 15 09:17:11.558849 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:11.558765    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0904cc42-29a0-415d-a910-dc6de8788b86-serving-certs-ca-bundle\") pod \"telemeter-client-76f96fd4cf-8h5p5\" (UID: \"0904cc42-29a0-415d-a910-dc6de8788b86\") " pod="openshift-monitoring/telemeter-client-76f96fd4cf-8h5p5"
Sep 15 09:17:11.558995 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:11.558848    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0904cc42-29a0-415d-a910-dc6de8788b86-metrics-client-ca\") pod \"telemeter-client-76f96fd4cf-8h5p5\" (UID: \"0904cc42-29a0-415d-a910-dc6de8788b86\") " pod="openshift-monitoring/telemeter-client-76f96fd4cf-8h5p5"
Sep 15 09:17:11.558995 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:11.558905    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0904cc42-29a0-415d-a910-dc6de8788b86-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-76f96fd4cf-8h5p5\" (UID: \"0904cc42-29a0-415d-a910-dc6de8788b86\") " pod="openshift-monitoring/telemeter-client-76f96fd4cf-8h5p5"
Sep 15 09:17:11.558995 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:11.558935    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0904cc42-29a0-415d-a910-dc6de8788b86-telemeter-client-tls\") pod \"telemeter-client-76f96fd4cf-8h5p5\" (UID: \"0904cc42-29a0-415d-a910-dc6de8788b86\") " pod="openshift-monitoring/telemeter-client-76f96fd4cf-8h5p5"
Sep 15 09:17:11.559137 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:11.558993    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0904cc42-29a0-415d-a910-dc6de8788b86-federate-client-tls\") pod \"telemeter-client-76f96fd4cf-8h5p5\" (UID: \"0904cc42-29a0-415d-a910-dc6de8788b86\") " pod="openshift-monitoring/telemeter-client-76f96fd4cf-8h5p5"
Sep 15 09:17:11.559137 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:11.559023    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0904cc42-29a0-415d-a910-dc6de8788b86-telemeter-trusted-ca-bundle\") pod \"telemeter-client-76f96fd4cf-8h5p5\" (UID: \"0904cc42-29a0-415d-a910-dc6de8788b86\") " pod="openshift-monitoring/telemeter-client-76f96fd4cf-8h5p5"
Sep 15 09:17:11.660090 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:11.660057    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0904cc42-29a0-415d-a910-dc6de8788b86-federate-client-tls\") pod \"telemeter-client-76f96fd4cf-8h5p5\" (UID: \"0904cc42-29a0-415d-a910-dc6de8788b86\") " pod="openshift-monitoring/telemeter-client-76f96fd4cf-8h5p5"
Sep 15 09:17:11.660090 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:11.660094    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0904cc42-29a0-415d-a910-dc6de8788b86-telemeter-trusted-ca-bundle\") pod \"telemeter-client-76f96fd4cf-8h5p5\" (UID: \"0904cc42-29a0-415d-a910-dc6de8788b86\") " pod="openshift-monitoring/telemeter-client-76f96fd4cf-8h5p5"
Sep 15 09:17:11.660263 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:11.660124    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkjw6\" (UniqueName: \"kubernetes.io/projected/0904cc42-29a0-415d-a910-dc6de8788b86-kube-api-access-rkjw6\") pod \"telemeter-client-76f96fd4cf-8h5p5\" (UID: \"0904cc42-29a0-415d-a910-dc6de8788b86\") " pod="openshift-monitoring/telemeter-client-76f96fd4cf-8h5p5"
Sep 15 09:17:11.660263 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:11.660148    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0904cc42-29a0-415d-a910-dc6de8788b86-secret-telemeter-client\") pod \"telemeter-client-76f96fd4cf-8h5p5\" (UID: \"0904cc42-29a0-415d-a910-dc6de8788b86\") " pod="openshift-monitoring/telemeter-client-76f96fd4cf-8h5p5"
Sep 15 09:17:11.660263 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:11.660170    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0904cc42-29a0-415d-a910-dc6de8788b86-serving-certs-ca-bundle\") pod \"telemeter-client-76f96fd4cf-8h5p5\" (UID: \"0904cc42-29a0-415d-a910-dc6de8788b86\") " pod="openshift-monitoring/telemeter-client-76f96fd4cf-8h5p5"
Sep 15 09:17:11.660263 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:11.660203    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0904cc42-29a0-415d-a910-dc6de8788b86-metrics-client-ca\") pod \"telemeter-client-76f96fd4cf-8h5p5\" (UID: \"0904cc42-29a0-415d-a910-dc6de8788b86\") " pod="openshift-monitoring/telemeter-client-76f96fd4cf-8h5p5"
Sep 15 09:17:11.660263 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:11.660238    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0904cc42-29a0-415d-a910-dc6de8788b86-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-76f96fd4cf-8h5p5\" (UID: \"0904cc42-29a0-415d-a910-dc6de8788b86\") " pod="openshift-monitoring/telemeter-client-76f96fd4cf-8h5p5"
Sep 15 09:17:11.660263 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:11.660263    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0904cc42-29a0-415d-a910-dc6de8788b86-telemeter-client-tls\") pod \"telemeter-client-76f96fd4cf-8h5p5\" (UID: \"0904cc42-29a0-415d-a910-dc6de8788b86\") " pod="openshift-monitoring/telemeter-client-76f96fd4cf-8h5p5"
Sep 15 09:17:11.661054 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:11.661024    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0904cc42-29a0-415d-a910-dc6de8788b86-serving-certs-ca-bundle\") pod \"telemeter-client-76f96fd4cf-8h5p5\" (UID: \"0904cc42-29a0-415d-a910-dc6de8788b86\") " pod="openshift-monitoring/telemeter-client-76f96fd4cf-8h5p5"
Sep 15 09:17:11.661164 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:11.661067    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0904cc42-29a0-415d-a910-dc6de8788b86-metrics-client-ca\") pod \"telemeter-client-76f96fd4cf-8h5p5\" (UID: \"0904cc42-29a0-415d-a910-dc6de8788b86\") " pod="openshift-monitoring/telemeter-client-76f96fd4cf-8h5p5"
Sep 15 09:17:11.661232 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:11.661199    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0904cc42-29a0-415d-a910-dc6de8788b86-telemeter-trusted-ca-bundle\") pod \"telemeter-client-76f96fd4cf-8h5p5\" (UID: \"0904cc42-29a0-415d-a910-dc6de8788b86\") " pod="openshift-monitoring/telemeter-client-76f96fd4cf-8h5p5"
Sep 15 09:17:11.662835 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:11.662805    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0904cc42-29a0-415d-a910-dc6de8788b86-federate-client-tls\") pod \"telemeter-client-76f96fd4cf-8h5p5\" (UID: \"0904cc42-29a0-415d-a910-dc6de8788b86\") " pod="openshift-monitoring/telemeter-client-76f96fd4cf-8h5p5"
Sep 15 09:17:11.663046 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:11.663023    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0904cc42-29a0-415d-a910-dc6de8788b86-secret-telemeter-client\") pod \"telemeter-client-76f96fd4cf-8h5p5\" (UID: \"0904cc42-29a0-415d-a910-dc6de8788b86\") " pod="openshift-monitoring/telemeter-client-76f96fd4cf-8h5p5"
Sep 15 09:17:11.663324 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:11.663298    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0904cc42-29a0-415d-a910-dc6de8788b86-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-76f96fd4cf-8h5p5\" (UID: \"0904cc42-29a0-415d-a910-dc6de8788b86\") " pod="openshift-monitoring/telemeter-client-76f96fd4cf-8h5p5"
Sep 15 09:17:11.663358 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:11.663320    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0904cc42-29a0-415d-a910-dc6de8788b86-telemeter-client-tls\") pod \"telemeter-client-76f96fd4cf-8h5p5\" (UID: \"0904cc42-29a0-415d-a910-dc6de8788b86\") " pod="openshift-monitoring/telemeter-client-76f96fd4cf-8h5p5"
Sep 15 09:17:11.668808 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:11.668781    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkjw6\" (UniqueName: \"kubernetes.io/projected/0904cc42-29a0-415d-a910-dc6de8788b86-kube-api-access-rkjw6\") pod \"telemeter-client-76f96fd4cf-8h5p5\" (UID: \"0904cc42-29a0-415d-a910-dc6de8788b86\") " pod="openshift-monitoring/telemeter-client-76f96fd4cf-8h5p5"
Sep 15 09:17:11.784744 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:11.784688    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-76f96fd4cf-8h5p5"
Sep 15 09:17:12.062194 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:12.062163    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-76f96fd4cf-8h5p5"]
Sep 15 09:17:12.063941 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:17:12.063892    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0904cc42_29a0_415d_a910_dc6de8788b86.slice/crio-e2f9307c730f89278be4d2ad3223a840cef0ae3fb2d78de9c18e2d28fe9c91d6 WatchSource:0}: Error finding container e2f9307c730f89278be4d2ad3223a840cef0ae3fb2d78de9c18e2d28fe9c91d6: Status 404 returned error can't find the container with id e2f9307c730f89278be4d2ad3223a840cef0ae3fb2d78de9c18e2d28fe9c91d6
Sep 15 09:17:12.977377 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:12.977329    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-76f96fd4cf-8h5p5" event={"ID":"0904cc42-29a0-415d-a910-dc6de8788b86","Type":"ContainerStarted","Data":"e2f9307c730f89278be4d2ad3223a840cef0ae3fb2d78de9c18e2d28fe9c91d6"}
Sep 15 09:17:13.983339 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:13.983314    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-76f96fd4cf-8h5p5" event={"ID":"0904cc42-29a0-415d-a910-dc6de8788b86","Type":"ContainerStarted","Data":"d1329900ef70c1c8a8cb9ad5885eedb5a5ef5ec6e2e555f70dbc1c6af6150c8c"}
Sep 15 09:17:13.983604 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:13.983366    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-76f96fd4cf-8h5p5" event={"ID":"0904cc42-29a0-415d-a910-dc6de8788b86","Type":"ContainerStarted","Data":"e548dbce004065f0b9f89f4251cda2959b6e07ab6a87c4e1486fab7fa1baf8f5"}
Sep 15 09:17:14.990282 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:14.990239    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-76f96fd4cf-8h5p5" event={"ID":"0904cc42-29a0-415d-a910-dc6de8788b86","Type":"ContainerStarted","Data":"e62b55d1050859c9481f67c7c6bdda3dbefc82674063a2486eb2ad6ef86c6462"}
Sep 15 09:17:15.015526 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:15.015471    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-76f96fd4cf-8h5p5" podStartSLOduration=2.223849773 podStartE2EDuration="4.015452722s" totalImagesPullingTime="1.791602949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:17:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:17:15.014103467 +0000 UTC m=+179.352548742" watchObservedRunningTime="2026-09-15 09:17:15.015452722 +0000 UTC m=+179.353897997"
Sep 15 09:17:15.115628 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:15.115585    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5dc68bdb4d-4scxk"]
Sep 15 09:17:15.117633 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:15.117612    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dc68bdb4d-4scxk"
Sep 15 09:17:15.135761 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:15.135740    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5dc68bdb4d-4scxk"]
Sep 15 09:17:15.184814 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:15.184792    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fcff3f68-b45c-4c8f-b397-51138c8f693e-console-oauth-config\") pod \"console-5dc68bdb4d-4scxk\" (UID: \"fcff3f68-b45c-4c8f-b397-51138c8f693e\") " pod="openshift-console/console-5dc68bdb4d-4scxk"
Sep 15 09:17:15.184929 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:15.184818    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fcff3f68-b45c-4c8f-b397-51138c8f693e-service-ca\") pod \"console-5dc68bdb4d-4scxk\" (UID: \"fcff3f68-b45c-4c8f-b397-51138c8f693e\") " pod="openshift-console/console-5dc68bdb4d-4scxk"
Sep 15 09:17:15.184929 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:15.184836    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fcff3f68-b45c-4c8f-b397-51138c8f693e-oauth-serving-cert\") pod \"console-5dc68bdb4d-4scxk\" (UID: \"fcff3f68-b45c-4c8f-b397-51138c8f693e\") " pod="openshift-console/console-5dc68bdb4d-4scxk"
Sep 15 09:17:15.184929 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:15.184851    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbgj6\" (UniqueName: \"kubernetes.io/projected/fcff3f68-b45c-4c8f-b397-51138c8f693e-kube-api-access-nbgj6\") pod \"console-5dc68bdb4d-4scxk\" (UID: \"fcff3f68-b45c-4c8f-b397-51138c8f693e\") " pod="openshift-console/console-5dc68bdb4d-4scxk"
Sep 15 09:17:15.185116 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:15.184936    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fcff3f68-b45c-4c8f-b397-51138c8f693e-console-serving-cert\") pod \"console-5dc68bdb4d-4scxk\" (UID: \"fcff3f68-b45c-4c8f-b397-51138c8f693e\") " pod="openshift-console/console-5dc68bdb4d-4scxk"
Sep 15 09:17:15.185116 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:15.185025    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fcff3f68-b45c-4c8f-b397-51138c8f693e-console-config\") pod \"console-5dc68bdb4d-4scxk\" (UID: \"fcff3f68-b45c-4c8f-b397-51138c8f693e\") " pod="openshift-console/console-5dc68bdb4d-4scxk"
Sep 15 09:17:15.185116 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:15.185056    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcff3f68-b45c-4c8f-b397-51138c8f693e-trusted-ca-bundle\") pod \"console-5dc68bdb4d-4scxk\" (UID: \"fcff3f68-b45c-4c8f-b397-51138c8f693e\") " pod="openshift-console/console-5dc68bdb4d-4scxk"
Sep 15 09:17:15.286105 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:15.286040    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fcff3f68-b45c-4c8f-b397-51138c8f693e-console-config\") pod \"console-5dc68bdb4d-4scxk\" (UID: \"fcff3f68-b45c-4c8f-b397-51138c8f693e\") " pod="openshift-console/console-5dc68bdb4d-4scxk"
Sep 15 09:17:15.286105 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:15.286076    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcff3f68-b45c-4c8f-b397-51138c8f693e-trusted-ca-bundle\") pod \"console-5dc68bdb4d-4scxk\" (UID: \"fcff3f68-b45c-4c8f-b397-51138c8f693e\") " pod="openshift-console/console-5dc68bdb4d-4scxk"
Sep 15 09:17:15.286240 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:15.286131    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fcff3f68-b45c-4c8f-b397-51138c8f693e-console-oauth-config\") pod \"console-5dc68bdb4d-4scxk\" (UID: \"fcff3f68-b45c-4c8f-b397-51138c8f693e\") " pod="openshift-console/console-5dc68bdb4d-4scxk"
Sep 15 09:17:15.286240 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:15.286153    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fcff3f68-b45c-4c8f-b397-51138c8f693e-service-ca\") pod \"console-5dc68bdb4d-4scxk\" (UID: \"fcff3f68-b45c-4c8f-b397-51138c8f693e\") " pod="openshift-console/console-5dc68bdb4d-4scxk"
Sep 15 09:17:15.286240 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:15.286176    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fcff3f68-b45c-4c8f-b397-51138c8f693e-oauth-serving-cert\") pod \"console-5dc68bdb4d-4scxk\" (UID: \"fcff3f68-b45c-4c8f-b397-51138c8f693e\") " pod="openshift-console/console-5dc68bdb4d-4scxk"
Sep 15 09:17:15.286410 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:15.286386    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbgj6\" (UniqueName: \"kubernetes.io/projected/fcff3f68-b45c-4c8f-b397-51138c8f693e-kube-api-access-nbgj6\") pod \"console-5dc68bdb4d-4scxk\" (UID: \"fcff3f68-b45c-4c8f-b397-51138c8f693e\") " pod="openshift-console/console-5dc68bdb4d-4scxk"
Sep 15 09:17:15.286464 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:15.286451    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fcff3f68-b45c-4c8f-b397-51138c8f693e-console-serving-cert\") pod \"console-5dc68bdb4d-4scxk\" (UID: \"fcff3f68-b45c-4c8f-b397-51138c8f693e\") " pod="openshift-console/console-5dc68bdb4d-4scxk"
Sep 15 09:17:15.286832 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:15.286796    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fcff3f68-b45c-4c8f-b397-51138c8f693e-service-ca\") pod \"console-5dc68bdb4d-4scxk\" (UID: \"fcff3f68-b45c-4c8f-b397-51138c8f693e\") " pod="openshift-console/console-5dc68bdb4d-4scxk"
Sep 15 09:17:15.286924 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:15.286804    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fcff3f68-b45c-4c8f-b397-51138c8f693e-console-config\") pod \"console-5dc68bdb4d-4scxk\" (UID: \"fcff3f68-b45c-4c8f-b397-51138c8f693e\") " pod="openshift-console/console-5dc68bdb4d-4scxk"
Sep 15 09:17:15.287089 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:15.287067    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcff3f68-b45c-4c8f-b397-51138c8f693e-trusted-ca-bundle\") pod \"console-5dc68bdb4d-4scxk\" (UID: \"fcff3f68-b45c-4c8f-b397-51138c8f693e\") " pod="openshift-console/console-5dc68bdb4d-4scxk"
Sep 15 09:17:15.287134 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:15.287067    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fcff3f68-b45c-4c8f-b397-51138c8f693e-oauth-serving-cert\") pod \"console-5dc68bdb4d-4scxk\" (UID: \"fcff3f68-b45c-4c8f-b397-51138c8f693e\") " pod="openshift-console/console-5dc68bdb4d-4scxk"
Sep 15 09:17:15.288580 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:15.288557    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fcff3f68-b45c-4c8f-b397-51138c8f693e-console-oauth-config\") pod \"console-5dc68bdb4d-4scxk\" (UID: \"fcff3f68-b45c-4c8f-b397-51138c8f693e\") " pod="openshift-console/console-5dc68bdb4d-4scxk"
Sep 15 09:17:15.288860 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:15.288838    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fcff3f68-b45c-4c8f-b397-51138c8f693e-console-serving-cert\") pod \"console-5dc68bdb4d-4scxk\" (UID: \"fcff3f68-b45c-4c8f-b397-51138c8f693e\") " pod="openshift-console/console-5dc68bdb4d-4scxk"
Sep 15 09:17:15.297885 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:15.297863    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbgj6\" (UniqueName: \"kubernetes.io/projected/fcff3f68-b45c-4c8f-b397-51138c8f693e-kube-api-access-nbgj6\") pod \"console-5dc68bdb4d-4scxk\" (UID: \"fcff3f68-b45c-4c8f-b397-51138c8f693e\") " pod="openshift-console/console-5dc68bdb4d-4scxk"
Sep 15 09:17:15.427069 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:15.427045    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dc68bdb4d-4scxk"
Sep 15 09:17:15.695101 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:15.695029    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5dc68bdb4d-4scxk"]
Sep 15 09:17:15.697543 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:17:15.697515    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcff3f68_b45c_4c8f_b397_51138c8f693e.slice/crio-6486e4205ee5c3736b28385b66203b016b2864fd8cd23496c607cec0db6963c0 WatchSource:0}: Error finding container 6486e4205ee5c3736b28385b66203b016b2864fd8cd23496c607cec0db6963c0: Status 404 returned error can't find the container with id 6486e4205ee5c3736b28385b66203b016b2864fd8cd23496c607cec0db6963c0
Sep 15 09:17:15.995868 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:15.995828    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dc68bdb4d-4scxk" event={"ID":"fcff3f68-b45c-4c8f-b397-51138c8f693e","Type":"ContainerStarted","Data":"f4e48a3973ac24bef0fac9969f1344cbd65e33450b6b0b08e1e24645f0c7e543"}
Sep 15 09:17:15.996248 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:15.995888    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dc68bdb4d-4scxk" event={"ID":"fcff3f68-b45c-4c8f-b397-51138c8f693e","Type":"ContainerStarted","Data":"6486e4205ee5c3736b28385b66203b016b2864fd8cd23496c607cec0db6963c0"}
Sep 15 09:17:16.011405 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:16.011367    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5dc68bdb4d-4scxk" podStartSLOduration=1.011352455 podStartE2EDuration="1.011352455s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:17:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:17:16.010662736 +0000 UTC m=+180.349108012" watchObservedRunningTime="2026-09-15 09:17:16.011352455 +0000 UTC m=+180.349797730"
Sep 15 09:17:25.428044 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:25.428002    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5dc68bdb4d-4scxk"
Sep 15 09:17:25.428476 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:25.428074    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5dc68bdb4d-4scxk"
Sep 15 09:17:25.432899 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:25.432870    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5dc68bdb4d-4scxk"
Sep 15 09:17:26.034690 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:26.034664    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5dc68bdb4d-4scxk"
Sep 15 09:17:26.076739 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:26.076711    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59656fcc6f-d84xf"]
Sep 15 09:17:51.101393 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:51.101350    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-59656fcc6f-d84xf" podUID="1979ab20-eae3-4bdb-8516-71ed4b1f2d80" containerName="console" containerID="cri-o://479e16c26475427ea5f913ca9db1eae852b871666133fa382a1772fba06cf630" gracePeriod=15
Sep 15 09:17:51.343763 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:51.343740    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59656fcc6f-d84xf"
Sep 15 09:17:51.427518 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:51.427470    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1979ab20-eae3-4bdb-8516-71ed4b1f2d80-oauth-serving-cert\") pod \"1979ab20-eae3-4bdb-8516-71ed4b1f2d80\" (UID: \"1979ab20-eae3-4bdb-8516-71ed4b1f2d80\") "
Sep 15 09:17:51.427518 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:51.427500    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1979ab20-eae3-4bdb-8516-71ed4b1f2d80-trusted-ca-bundle\") pod \"1979ab20-eae3-4bdb-8516-71ed4b1f2d80\" (UID: \"1979ab20-eae3-4bdb-8516-71ed4b1f2d80\") "
Sep 15 09:17:51.427670 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:51.427523    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1979ab20-eae3-4bdb-8516-71ed4b1f2d80-console-config\") pod \"1979ab20-eae3-4bdb-8516-71ed4b1f2d80\" (UID: \"1979ab20-eae3-4bdb-8516-71ed4b1f2d80\") "
Sep 15 09:17:51.427670 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:51.427553    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hjsfr\" (UniqueName: \"kubernetes.io/projected/1979ab20-eae3-4bdb-8516-71ed4b1f2d80-kube-api-access-hjsfr\") pod \"1979ab20-eae3-4bdb-8516-71ed4b1f2d80\" (UID: \"1979ab20-eae3-4bdb-8516-71ed4b1f2d80\") "
Sep 15 09:17:51.427670 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:51.427577    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1979ab20-eae3-4bdb-8516-71ed4b1f2d80-console-serving-cert\") pod \"1979ab20-eae3-4bdb-8516-71ed4b1f2d80\" (UID: \"1979ab20-eae3-4bdb-8516-71ed4b1f2d80\") "
Sep 15 09:17:51.427670 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:51.427623    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1979ab20-eae3-4bdb-8516-71ed4b1f2d80-service-ca\") pod \"1979ab20-eae3-4bdb-8516-71ed4b1f2d80\" (UID: \"1979ab20-eae3-4bdb-8516-71ed4b1f2d80\") "
Sep 15 09:17:51.427670 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:51.427659    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1979ab20-eae3-4bdb-8516-71ed4b1f2d80-console-oauth-config\") pod \"1979ab20-eae3-4bdb-8516-71ed4b1f2d80\" (UID: \"1979ab20-eae3-4bdb-8516-71ed4b1f2d80\") "
Sep 15 09:17:51.428059 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:51.428031    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1979ab20-eae3-4bdb-8516-71ed4b1f2d80-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1979ab20-eae3-4bdb-8516-71ed4b1f2d80" (UID: "1979ab20-eae3-4bdb-8516-71ed4b1f2d80"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:17:51.428172 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:51.428054    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1979ab20-eae3-4bdb-8516-71ed4b1f2d80-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1979ab20-eae3-4bdb-8516-71ed4b1f2d80" (UID: "1979ab20-eae3-4bdb-8516-71ed4b1f2d80"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:17:51.428172 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:51.428028    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1979ab20-eae3-4bdb-8516-71ed4b1f2d80-console-config" (OuterVolumeSpecName: "console-config") pod "1979ab20-eae3-4bdb-8516-71ed4b1f2d80" (UID: "1979ab20-eae3-4bdb-8516-71ed4b1f2d80"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:17:51.428284 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:51.428162    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1979ab20-eae3-4bdb-8516-71ed4b1f2d80-service-ca" (OuterVolumeSpecName: "service-ca") pod "1979ab20-eae3-4bdb-8516-71ed4b1f2d80" (UID: "1979ab20-eae3-4bdb-8516-71ed4b1f2d80"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:17:51.429807 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:51.429782    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1979ab20-eae3-4bdb-8516-71ed4b1f2d80-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1979ab20-eae3-4bdb-8516-71ed4b1f2d80" (UID: "1979ab20-eae3-4bdb-8516-71ed4b1f2d80"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:17:51.429899 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:51.429823    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1979ab20-eae3-4bdb-8516-71ed4b1f2d80-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1979ab20-eae3-4bdb-8516-71ed4b1f2d80" (UID: "1979ab20-eae3-4bdb-8516-71ed4b1f2d80"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:17:51.429899 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:51.429846    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1979ab20-eae3-4bdb-8516-71ed4b1f2d80-kube-api-access-hjsfr" (OuterVolumeSpecName: "kube-api-access-hjsfr") pod "1979ab20-eae3-4bdb-8516-71ed4b1f2d80" (UID: "1979ab20-eae3-4bdb-8516-71ed4b1f2d80"). InnerVolumeSpecName "kube-api-access-hjsfr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:17:51.528639 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:51.528616    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjsfr\" (UniqueName: \"kubernetes.io/projected/1979ab20-eae3-4bdb-8516-71ed4b1f2d80-kube-api-access-hjsfr\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:17:51.528639 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:51.528638    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1979ab20-eae3-4bdb-8516-71ed4b1f2d80-console-serving-cert\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:17:51.528779 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:51.528652    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1979ab20-eae3-4bdb-8516-71ed4b1f2d80-service-ca\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:17:51.528779 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:51.528664    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1979ab20-eae3-4bdb-8516-71ed4b1f2d80-console-oauth-config\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:17:51.528779 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:51.528675    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1979ab20-eae3-4bdb-8516-71ed4b1f2d80-oauth-serving-cert\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:17:51.528779 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:51.528689    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1979ab20-eae3-4bdb-8516-71ed4b1f2d80-trusted-ca-bundle\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:17:51.528779 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:51.528701    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1979ab20-eae3-4bdb-8516-71ed4b1f2d80-console-config\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:17:52.130053 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:52.130026    2578 generic.go:356] "Generic (PLEG): container finished" podID="1979ab20-eae3-4bdb-8516-71ed4b1f2d80" containerID="479e16c26475427ea5f913ca9db1eae852b871666133fa382a1772fba06cf630" exitCode=0
Sep 15 09:17:52.130349 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:52.130080    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59656fcc6f-d84xf"
Sep 15 09:17:52.130349 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:52.130102    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59656fcc6f-d84xf" event={"ID":"1979ab20-eae3-4bdb-8516-71ed4b1f2d80","Type":"ContainerDied","Data":"479e16c26475427ea5f913ca9db1eae852b871666133fa382a1772fba06cf630"}
Sep 15 09:17:52.130349 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:52.130142    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59656fcc6f-d84xf" event={"ID":"1979ab20-eae3-4bdb-8516-71ed4b1f2d80","Type":"ContainerDied","Data":"9913b4b3cd31eeec0cb91f803f8ce258877021d96833c2d8e99d2d6a3576559a"}
Sep 15 09:17:52.130349 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:52.130166    2578 scope.go:117] "RemoveContainer" containerID="479e16c26475427ea5f913ca9db1eae852b871666133fa382a1772fba06cf630"
Sep 15 09:17:52.138932 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:52.138913    2578 scope.go:117] "RemoveContainer" containerID="479e16c26475427ea5f913ca9db1eae852b871666133fa382a1772fba06cf630"
Sep 15 09:17:52.139288 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:17:52.139268    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"479e16c26475427ea5f913ca9db1eae852b871666133fa382a1772fba06cf630\": container with ID starting with 479e16c26475427ea5f913ca9db1eae852b871666133fa382a1772fba06cf630 not found: ID does not exist" containerID="479e16c26475427ea5f913ca9db1eae852b871666133fa382a1772fba06cf630"
Sep 15 09:17:52.139352 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:52.139295    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"479e16c26475427ea5f913ca9db1eae852b871666133fa382a1772fba06cf630"} err="failed to get container status \"479e16c26475427ea5f913ca9db1eae852b871666133fa382a1772fba06cf630\": rpc error: code = NotFound desc = could not find container \"479e16c26475427ea5f913ca9db1eae852b871666133fa382a1772fba06cf630\": container with ID starting with 479e16c26475427ea5f913ca9db1eae852b871666133fa382a1772fba06cf630 not found: ID does not exist"
Sep 15 09:17:52.145334 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:52.145309    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59656fcc6f-d84xf"]
Sep 15 09:17:52.147492 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:52.147471    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59656fcc6f-d84xf"]
Sep 15 09:17:54.119366 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:17:54.119334    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1979ab20-eae3-4bdb-8516-71ed4b1f2d80" path="/var/lib/kubelet/pods/1979ab20-eae3-4bdb-8516-71ed4b1f2d80/volumes"
Sep 15 09:18:22.479831 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:22.479802    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-75d8658568-mqcfm"]
Sep 15 09:18:22.480298 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:22.480102    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1979ab20-eae3-4bdb-8516-71ed4b1f2d80" containerName="console"
Sep 15 09:18:22.480298 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:22.480115    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1979ab20-eae3-4bdb-8516-71ed4b1f2d80" containerName="console"
Sep 15 09:18:22.480298 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:22.480156    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1979ab20-eae3-4bdb-8516-71ed4b1f2d80" containerName="console"
Sep 15 09:18:22.484169 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:22.484152    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75d8658568-mqcfm"
Sep 15 09:18:22.493143 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:22.493120    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75d8658568-mqcfm"]
Sep 15 09:18:22.639370 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:22.639342    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81e0e3f9-a4ee-4a1b-8876-f46d63013e32-service-ca\") pod \"console-75d8658568-mqcfm\" (UID: \"81e0e3f9-a4ee-4a1b-8876-f46d63013e32\") " pod="openshift-console/console-75d8658568-mqcfm"
Sep 15 09:18:22.639483 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:22.639380    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81e0e3f9-a4ee-4a1b-8876-f46d63013e32-console-config\") pod \"console-75d8658568-mqcfm\" (UID: \"81e0e3f9-a4ee-4a1b-8876-f46d63013e32\") " pod="openshift-console/console-75d8658568-mqcfm"
Sep 15 09:18:22.639483 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:22.639405    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bv5dq\" (UniqueName: \"kubernetes.io/projected/81e0e3f9-a4ee-4a1b-8876-f46d63013e32-kube-api-access-bv5dq\") pod \"console-75d8658568-mqcfm\" (UID: \"81e0e3f9-a4ee-4a1b-8876-f46d63013e32\") " pod="openshift-console/console-75d8658568-mqcfm"
Sep 15 09:18:22.639483 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:22.639463    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81e0e3f9-a4ee-4a1b-8876-f46d63013e32-console-oauth-config\") pod \"console-75d8658568-mqcfm\" (UID: \"81e0e3f9-a4ee-4a1b-8876-f46d63013e32\") " pod="openshift-console/console-75d8658568-mqcfm"
Sep 15 09:18:22.639605 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:22.639489    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81e0e3f9-a4ee-4a1b-8876-f46d63013e32-trusted-ca-bundle\") pod \"console-75d8658568-mqcfm\" (UID: \"81e0e3f9-a4ee-4a1b-8876-f46d63013e32\") " pod="openshift-console/console-75d8658568-mqcfm"
Sep 15 09:18:22.639605 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:22.639534    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81e0e3f9-a4ee-4a1b-8876-f46d63013e32-oauth-serving-cert\") pod \"console-75d8658568-mqcfm\" (UID: \"81e0e3f9-a4ee-4a1b-8876-f46d63013e32\") " pod="openshift-console/console-75d8658568-mqcfm"
Sep 15 09:18:22.639605 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:22.639558    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81e0e3f9-a4ee-4a1b-8876-f46d63013e32-console-serving-cert\") pod \"console-75d8658568-mqcfm\" (UID: \"81e0e3f9-a4ee-4a1b-8876-f46d63013e32\") " pod="openshift-console/console-75d8658568-mqcfm"
Sep 15 09:18:22.740263 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:22.740207    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81e0e3f9-a4ee-4a1b-8876-f46d63013e32-console-oauth-config\") pod \"console-75d8658568-mqcfm\" (UID: \"81e0e3f9-a4ee-4a1b-8876-f46d63013e32\") " pod="openshift-console/console-75d8658568-mqcfm"
Sep 15 09:18:22.740263 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:22.740236    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81e0e3f9-a4ee-4a1b-8876-f46d63013e32-trusted-ca-bundle\") pod \"console-75d8658568-mqcfm\" (UID: \"81e0e3f9-a4ee-4a1b-8876-f46d63013e32\") " pod="openshift-console/console-75d8658568-mqcfm"
Sep 15 09:18:22.740263 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:22.740261    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81e0e3f9-a4ee-4a1b-8876-f46d63013e32-oauth-serving-cert\") pod \"console-75d8658568-mqcfm\" (UID: \"81e0e3f9-a4ee-4a1b-8876-f46d63013e32\") " pod="openshift-console/console-75d8658568-mqcfm"
Sep 15 09:18:22.740421 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:22.740293    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81e0e3f9-a4ee-4a1b-8876-f46d63013e32-console-serving-cert\") pod \"console-75d8658568-mqcfm\" (UID: \"81e0e3f9-a4ee-4a1b-8876-f46d63013e32\") " pod="openshift-console/console-75d8658568-mqcfm"
Sep 15 09:18:22.740421 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:22.740381    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81e0e3f9-a4ee-4a1b-8876-f46d63013e32-service-ca\") pod \"console-75d8658568-mqcfm\" (UID: \"81e0e3f9-a4ee-4a1b-8876-f46d63013e32\") " pod="openshift-console/console-75d8658568-mqcfm"
Sep 15 09:18:22.740487 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:22.740431    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81e0e3f9-a4ee-4a1b-8876-f46d63013e32-console-config\") pod \"console-75d8658568-mqcfm\" (UID: \"81e0e3f9-a4ee-4a1b-8876-f46d63013e32\") " pod="openshift-console/console-75d8658568-mqcfm"
Sep 15 09:18:22.740487 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:22.740459    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bv5dq\" (UniqueName: \"kubernetes.io/projected/81e0e3f9-a4ee-4a1b-8876-f46d63013e32-kube-api-access-bv5dq\") pod \"console-75d8658568-mqcfm\" (UID: \"81e0e3f9-a4ee-4a1b-8876-f46d63013e32\") " pod="openshift-console/console-75d8658568-mqcfm"
Sep 15 09:18:22.741138 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:22.741111    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81e0e3f9-a4ee-4a1b-8876-f46d63013e32-oauth-serving-cert\") pod \"console-75d8658568-mqcfm\" (UID: \"81e0e3f9-a4ee-4a1b-8876-f46d63013e32\") " pod="openshift-console/console-75d8658568-mqcfm"
Sep 15 09:18:22.741229 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:22.741111    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81e0e3f9-a4ee-4a1b-8876-f46d63013e32-service-ca\") pod \"console-75d8658568-mqcfm\" (UID: \"81e0e3f9-a4ee-4a1b-8876-f46d63013e32\") " pod="openshift-console/console-75d8658568-mqcfm"
Sep 15 09:18:22.741229 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:22.741187    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81e0e3f9-a4ee-4a1b-8876-f46d63013e32-trusted-ca-bundle\") pod \"console-75d8658568-mqcfm\" (UID: \"81e0e3f9-a4ee-4a1b-8876-f46d63013e32\") " pod="openshift-console/console-75d8658568-mqcfm"
Sep 15 09:18:22.741343 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:22.741271    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81e0e3f9-a4ee-4a1b-8876-f46d63013e32-console-config\") pod \"console-75d8658568-mqcfm\" (UID: \"81e0e3f9-a4ee-4a1b-8876-f46d63013e32\") " pod="openshift-console/console-75d8658568-mqcfm"
Sep 15 09:18:22.742746 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:22.742724    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81e0e3f9-a4ee-4a1b-8876-f46d63013e32-console-oauth-config\") pod \"console-75d8658568-mqcfm\" (UID: \"81e0e3f9-a4ee-4a1b-8876-f46d63013e32\") " pod="openshift-console/console-75d8658568-mqcfm"
Sep 15 09:18:22.742903 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:22.742883    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81e0e3f9-a4ee-4a1b-8876-f46d63013e32-console-serving-cert\") pod \"console-75d8658568-mqcfm\" (UID: \"81e0e3f9-a4ee-4a1b-8876-f46d63013e32\") " pod="openshift-console/console-75d8658568-mqcfm"
Sep 15 09:18:22.747958 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:22.747927    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bv5dq\" (UniqueName: \"kubernetes.io/projected/81e0e3f9-a4ee-4a1b-8876-f46d63013e32-kube-api-access-bv5dq\") pod \"console-75d8658568-mqcfm\" (UID: \"81e0e3f9-a4ee-4a1b-8876-f46d63013e32\") " pod="openshift-console/console-75d8658568-mqcfm"
Sep 15 09:18:22.793545 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:22.793525    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75d8658568-mqcfm"
Sep 15 09:18:23.059894 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:23.059827    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75d8658568-mqcfm"]
Sep 15 09:18:23.062612 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:18:23.062582    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81e0e3f9_a4ee_4a1b_8876_f46d63013e32.slice/crio-d9d0b2b9f7eaa23c4de8e00ca6babd5bd62e60f5b2e4153a3b6aa8cc459d3faf WatchSource:0}: Error finding container d9d0b2b9f7eaa23c4de8e00ca6babd5bd62e60f5b2e4153a3b6aa8cc459d3faf: Status 404 returned error can't find the container with id d9d0b2b9f7eaa23c4de8e00ca6babd5bd62e60f5b2e4153a3b6aa8cc459d3faf
Sep 15 09:18:23.240101 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:23.240054    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75d8658568-mqcfm" event={"ID":"81e0e3f9-a4ee-4a1b-8876-f46d63013e32","Type":"ContainerStarted","Data":"6c8b99d792b0d76531636dd24df9ca358e4fb951a937926c3aeadb72f1ba8529"}
Sep 15 09:18:23.240234 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:23.240118    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75d8658568-mqcfm" event={"ID":"81e0e3f9-a4ee-4a1b-8876-f46d63013e32","Type":"ContainerStarted","Data":"d9d0b2b9f7eaa23c4de8e00ca6babd5bd62e60f5b2e4153a3b6aa8cc459d3faf"}
Sep 15 09:18:23.261871 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:23.261830    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-75d8658568-mqcfm" podStartSLOduration=1.261815527 podStartE2EDuration="1.261815527s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:18:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:18:23.26139811 +0000 UTC m=+247.599843386" watchObservedRunningTime="2026-09-15 09:18:23.261815527 +0000 UTC m=+247.600260802"
Sep 15 09:18:32.794696 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:32.794657    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75d8658568-mqcfm"
Sep 15 09:18:32.795361 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:32.794729    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75d8658568-mqcfm"
Sep 15 09:18:32.799394 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:32.799368    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-75d8658568-mqcfm"
Sep 15 09:18:33.279220 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:33.279190    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75d8658568-mqcfm"
Sep 15 09:18:33.323133 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:33.323106    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5dc68bdb4d-4scxk"]
Sep 15 09:18:58.346260 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:58.346197    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5dc68bdb4d-4scxk" podUID="fcff3f68-b45c-4c8f-b397-51138c8f693e" containerName="console" containerID="cri-o://f4e48a3973ac24bef0fac9969f1344cbd65e33450b6b0b08e1e24645f0c7e543" gracePeriod=15
Sep 15 09:18:58.582201 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:58.582177    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dc68bdb4d-4scxk"
Sep 15 09:18:58.668145 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:58.668081    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fcff3f68-b45c-4c8f-b397-51138c8f693e-console-serving-cert\") pod \"fcff3f68-b45c-4c8f-b397-51138c8f693e\" (UID: \"fcff3f68-b45c-4c8f-b397-51138c8f693e\") "
Sep 15 09:18:58.668145 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:58.668135    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fcff3f68-b45c-4c8f-b397-51138c8f693e-console-config\") pod \"fcff3f68-b45c-4c8f-b397-51138c8f693e\" (UID: \"fcff3f68-b45c-4c8f-b397-51138c8f693e\") "
Sep 15 09:18:58.668316 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:58.668172    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fcff3f68-b45c-4c8f-b397-51138c8f693e-console-oauth-config\") pod \"fcff3f68-b45c-4c8f-b397-51138c8f693e\" (UID: \"fcff3f68-b45c-4c8f-b397-51138c8f693e\") "
Sep 15 09:18:58.668316 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:58.668217    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fcff3f68-b45c-4c8f-b397-51138c8f693e-service-ca\") pod \"fcff3f68-b45c-4c8f-b397-51138c8f693e\" (UID: \"fcff3f68-b45c-4c8f-b397-51138c8f693e\") "
Sep 15 09:18:58.668415 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:58.668373    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbgj6\" (UniqueName: \"kubernetes.io/projected/fcff3f68-b45c-4c8f-b397-51138c8f693e-kube-api-access-nbgj6\") pod \"fcff3f68-b45c-4c8f-b397-51138c8f693e\" (UID: \"fcff3f68-b45c-4c8f-b397-51138c8f693e\") "
Sep 15 09:18:58.668473 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:58.668412    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcff3f68-b45c-4c8f-b397-51138c8f693e-trusted-ca-bundle\") pod \"fcff3f68-b45c-4c8f-b397-51138c8f693e\" (UID: \"fcff3f68-b45c-4c8f-b397-51138c8f693e\") "
Sep 15 09:18:58.668473 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:58.668454    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fcff3f68-b45c-4c8f-b397-51138c8f693e-oauth-serving-cert\") pod \"fcff3f68-b45c-4c8f-b397-51138c8f693e\" (UID: \"fcff3f68-b45c-4c8f-b397-51138c8f693e\") "
Sep 15 09:18:58.668588 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:58.668561    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fcff3f68-b45c-4c8f-b397-51138c8f693e-console-config" (OuterVolumeSpecName: "console-config") pod "fcff3f68-b45c-4c8f-b397-51138c8f693e" (UID: "fcff3f68-b45c-4c8f-b397-51138c8f693e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:18:58.668588 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:58.668567    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fcff3f68-b45c-4c8f-b397-51138c8f693e-service-ca" (OuterVolumeSpecName: "service-ca") pod "fcff3f68-b45c-4c8f-b397-51138c8f693e" (UID: "fcff3f68-b45c-4c8f-b397-51138c8f693e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:18:58.668836 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:58.668692    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fcff3f68-b45c-4c8f-b397-51138c8f693e-console-config\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:18:58.668836 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:58.668729    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fcff3f68-b45c-4c8f-b397-51138c8f693e-service-ca\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:18:58.669022 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:58.668871    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fcff3f68-b45c-4c8f-b397-51138c8f693e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fcff3f68-b45c-4c8f-b397-51138c8f693e" (UID: "fcff3f68-b45c-4c8f-b397-51138c8f693e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:18:58.669022 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:58.668879    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fcff3f68-b45c-4c8f-b397-51138c8f693e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "fcff3f68-b45c-4c8f-b397-51138c8f693e" (UID: "fcff3f68-b45c-4c8f-b397-51138c8f693e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:18:58.670204 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:58.670181    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fcff3f68-b45c-4c8f-b397-51138c8f693e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fcff3f68-b45c-4c8f-b397-51138c8f693e" (UID: "fcff3f68-b45c-4c8f-b397-51138c8f693e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:18:58.670578 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:58.670558    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fcff3f68-b45c-4c8f-b397-51138c8f693e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fcff3f68-b45c-4c8f-b397-51138c8f693e" (UID: "fcff3f68-b45c-4c8f-b397-51138c8f693e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:18:58.670639 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:58.670579    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcff3f68-b45c-4c8f-b397-51138c8f693e-kube-api-access-nbgj6" (OuterVolumeSpecName: "kube-api-access-nbgj6") pod "fcff3f68-b45c-4c8f-b397-51138c8f693e" (UID: "fcff3f68-b45c-4c8f-b397-51138c8f693e"). InnerVolumeSpecName "kube-api-access-nbgj6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:18:58.769031 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:58.769007    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fcff3f68-b45c-4c8f-b397-51138c8f693e-console-serving-cert\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:18:58.769031 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:58.769026    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fcff3f68-b45c-4c8f-b397-51138c8f693e-console-oauth-config\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:18:58.769145 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:58.769036    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbgj6\" (UniqueName: \"kubernetes.io/projected/fcff3f68-b45c-4c8f-b397-51138c8f693e-kube-api-access-nbgj6\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:18:58.769145 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:58.769046    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcff3f68-b45c-4c8f-b397-51138c8f693e-trusted-ca-bundle\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:18:58.769145 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:58.769054    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fcff3f68-b45c-4c8f-b397-51138c8f693e-oauth-serving-cert\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:18:59.371116 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:59.371084    2578 generic.go:356] "Generic (PLEG): container finished" podID="fcff3f68-b45c-4c8f-b397-51138c8f693e" containerID="f4e48a3973ac24bef0fac9969f1344cbd65e33450b6b0b08e1e24645f0c7e543" exitCode=0
Sep 15 09:18:59.371445 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:59.371138    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dc68bdb4d-4scxk"
Sep 15 09:18:59.371445 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:59.371173    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dc68bdb4d-4scxk" event={"ID":"fcff3f68-b45c-4c8f-b397-51138c8f693e","Type":"ContainerDied","Data":"f4e48a3973ac24bef0fac9969f1344cbd65e33450b6b0b08e1e24645f0c7e543"}
Sep 15 09:18:59.371445 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:59.371235    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dc68bdb4d-4scxk" event={"ID":"fcff3f68-b45c-4c8f-b397-51138c8f693e","Type":"ContainerDied","Data":"6486e4205ee5c3736b28385b66203b016b2864fd8cd23496c607cec0db6963c0"}
Sep 15 09:18:59.371445 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:59.371267    2578 scope.go:117] "RemoveContainer" containerID="f4e48a3973ac24bef0fac9969f1344cbd65e33450b6b0b08e1e24645f0c7e543"
Sep 15 09:18:59.380232 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:59.380215    2578 scope.go:117] "RemoveContainer" containerID="f4e48a3973ac24bef0fac9969f1344cbd65e33450b6b0b08e1e24645f0c7e543"
Sep 15 09:18:59.380544 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:18:59.380525    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4e48a3973ac24bef0fac9969f1344cbd65e33450b6b0b08e1e24645f0c7e543\": container with ID starting with f4e48a3973ac24bef0fac9969f1344cbd65e33450b6b0b08e1e24645f0c7e543 not found: ID does not exist" containerID="f4e48a3973ac24bef0fac9969f1344cbd65e33450b6b0b08e1e24645f0c7e543"
Sep 15 09:18:59.380598 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:59.380553    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4e48a3973ac24bef0fac9969f1344cbd65e33450b6b0b08e1e24645f0c7e543"} err="failed to get container status \"f4e48a3973ac24bef0fac9969f1344cbd65e33450b6b0b08e1e24645f0c7e543\": rpc error: code = NotFound desc = could not find container \"f4e48a3973ac24bef0fac9969f1344cbd65e33450b6b0b08e1e24645f0c7e543\": container with ID starting with f4e48a3973ac24bef0fac9969f1344cbd65e33450b6b0b08e1e24645f0c7e543 not found: ID does not exist"
Sep 15 09:18:59.399772 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:59.399737    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5dc68bdb4d-4scxk"]
Sep 15 09:18:59.403322 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:18:59.403300    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5dc68bdb4d-4scxk"]
Sep 15 09:19:00.119557 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:19:00.119515    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fcff3f68-b45c-4c8f-b397-51138c8f693e" path="/var/lib/kubelet/pods/fcff3f68-b45c-4c8f-b397-51138c8f693e/volumes"
Sep 15 09:19:16.010874 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:19:16.010840    2578 kubelet.go:1648] "Image garbage collection succeeded"
Sep 15 09:19:37.254600 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:19:37.254559    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxqrt"]
Sep 15 09:19:37.256981 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:19:37.254820    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcff3f68-b45c-4c8f-b397-51138c8f693e" containerName="console"
Sep 15 09:19:37.256981 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:19:37.254831    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcff3f68-b45c-4c8f-b397-51138c8f693e" containerName="console"
Sep 15 09:19:37.256981 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:19:37.254881    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcff3f68-b45c-4c8f-b397-51138c8f693e" containerName="console"
Sep 15 09:19:37.257776 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:19:37.257760    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxqrt"
Sep 15 09:19:37.260231 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:19:37.260206    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 15 09:19:37.261131 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:19:37.261116    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 15 09:19:37.261201 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:19:37.261123    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7sfkk\""
Sep 15 09:19:37.266561 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:19:37.266539    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxqrt"]
Sep 15 09:19:37.318811 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:19:37.318787    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhmjv\" (UniqueName: \"kubernetes.io/projected/9ea117b1-2b86-430d-887f-4917ab69b569-kube-api-access-bhmjv\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxqrt\" (UID: \"9ea117b1-2b86-430d-887f-4917ab69b569\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxqrt"
Sep 15 09:19:37.318912 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:19:37.318816    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ea117b1-2b86-430d-887f-4917ab69b569-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxqrt\" (UID: \"9ea117b1-2b86-430d-887f-4917ab69b569\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxqrt"
Sep 15 09:19:37.318912 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:19:37.318839    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ea117b1-2b86-430d-887f-4917ab69b569-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxqrt\" (UID: \"9ea117b1-2b86-430d-887f-4917ab69b569\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxqrt"
Sep 15 09:19:37.419618 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:19:37.419585    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhmjv\" (UniqueName: \"kubernetes.io/projected/9ea117b1-2b86-430d-887f-4917ab69b569-kube-api-access-bhmjv\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxqrt\" (UID: \"9ea117b1-2b86-430d-887f-4917ab69b569\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxqrt"
Sep 15 09:19:37.419734 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:19:37.419668    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ea117b1-2b86-430d-887f-4917ab69b569-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxqrt\" (UID: \"9ea117b1-2b86-430d-887f-4917ab69b569\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxqrt"
Sep 15 09:19:37.419734 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:19:37.419703    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ea117b1-2b86-430d-887f-4917ab69b569-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxqrt\" (UID: \"9ea117b1-2b86-430d-887f-4917ab69b569\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxqrt"
Sep 15 09:19:37.420066 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:19:37.420046    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ea117b1-2b86-430d-887f-4917ab69b569-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxqrt\" (UID: \"9ea117b1-2b86-430d-887f-4917ab69b569\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxqrt"
Sep 15 09:19:37.420144 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:19:37.420076    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ea117b1-2b86-430d-887f-4917ab69b569-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxqrt\" (UID: \"9ea117b1-2b86-430d-887f-4917ab69b569\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxqrt"
Sep 15 09:19:37.427147 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:19:37.427126    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhmjv\" (UniqueName: \"kubernetes.io/projected/9ea117b1-2b86-430d-887f-4917ab69b569-kube-api-access-bhmjv\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxqrt\" (UID: \"9ea117b1-2b86-430d-887f-4917ab69b569\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxqrt"
Sep 15 09:19:37.567436 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:19:37.567379    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxqrt"
Sep 15 09:19:37.834033 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:19:37.834011    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxqrt"]
Sep 15 09:19:37.835852 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:19:37.835825    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ea117b1_2b86_430d_887f_4917ab69b569.slice/crio-ae27b03b86408a1db5e5de28b9b3f8b3111e2b8559ce0740995cb6e0247fb50b WatchSource:0}: Error finding container ae27b03b86408a1db5e5de28b9b3f8b3111e2b8559ce0740995cb6e0247fb50b: Status 404 returned error can't find the container with id ae27b03b86408a1db5e5de28b9b3f8b3111e2b8559ce0740995cb6e0247fb50b
Sep 15 09:19:37.837861 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:19:37.837845    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 09:19:38.500472 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:19:38.500436    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxqrt" event={"ID":"9ea117b1-2b86-430d-887f-4917ab69b569","Type":"ContainerStarted","Data":"ae27b03b86408a1db5e5de28b9b3f8b3111e2b8559ce0740995cb6e0247fb50b"}
Sep 15 09:19:43.521164 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:19:43.521129    2578 generic.go:356] "Generic (PLEG): container finished" podID="9ea117b1-2b86-430d-887f-4917ab69b569" containerID="75cdf5ebe4aca4588d6983d40bafcb1daa6fde8a1db24d01c3f58e1eb04c2ec1" exitCode=0
Sep 15 09:19:43.521669 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:19:43.521216    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxqrt" event={"ID":"9ea117b1-2b86-430d-887f-4917ab69b569","Type":"ContainerDied","Data":"75cdf5ebe4aca4588d6983d40bafcb1daa6fde8a1db24d01c3f58e1eb04c2ec1"}
Sep 15 09:19:45.533063 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:19:45.533024    2578 generic.go:356] "Generic (PLEG): container finished" podID="9ea117b1-2b86-430d-887f-4917ab69b569" containerID="14c05ae5f858534d3aa47e12e626822a2c62073bbfcb635e122ee5f5ff00bafe" exitCode=0
Sep 15 09:19:45.533404 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:19:45.533094    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxqrt" event={"ID":"9ea117b1-2b86-430d-887f-4917ab69b569","Type":"ContainerDied","Data":"14c05ae5f858534d3aa47e12e626822a2c62073bbfcb635e122ee5f5ff00bafe"}
Sep 15 09:19:53.566376 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:19:53.566345    2578 generic.go:356] "Generic (PLEG): container finished" podID="9ea117b1-2b86-430d-887f-4917ab69b569" containerID="2346ee49d1c2b221dfad667bd2e7db33ca206ec70d3d4d59e85dd22bdbea8cb2" exitCode=0
Sep 15 09:19:53.566716 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:19:53.566431    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxqrt" event={"ID":"9ea117b1-2b86-430d-887f-4917ab69b569","Type":"ContainerDied","Data":"2346ee49d1c2b221dfad667bd2e7db33ca206ec70d3d4d59e85dd22bdbea8cb2"}
Sep 15 09:19:54.689812 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:19:54.689790    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxqrt"
Sep 15 09:19:54.759465 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:19:54.759438    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bhmjv\" (UniqueName: \"kubernetes.io/projected/9ea117b1-2b86-430d-887f-4917ab69b569-kube-api-access-bhmjv\") pod \"9ea117b1-2b86-430d-887f-4917ab69b569\" (UID: \"9ea117b1-2b86-430d-887f-4917ab69b569\") "
Sep 15 09:19:54.759601 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:19:54.759528    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ea117b1-2b86-430d-887f-4917ab69b569-util\") pod \"9ea117b1-2b86-430d-887f-4917ab69b569\" (UID: \"9ea117b1-2b86-430d-887f-4917ab69b569\") "
Sep 15 09:19:54.759649 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:19:54.759632    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ea117b1-2b86-430d-887f-4917ab69b569-bundle\") pod \"9ea117b1-2b86-430d-887f-4917ab69b569\" (UID: \"9ea117b1-2b86-430d-887f-4917ab69b569\") "
Sep 15 09:19:54.760232 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:19:54.760206    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ea117b1-2b86-430d-887f-4917ab69b569-bundle" (OuterVolumeSpecName: "bundle") pod "9ea117b1-2b86-430d-887f-4917ab69b569" (UID: "9ea117b1-2b86-430d-887f-4917ab69b569"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:19:54.761643 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:19:54.761616    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ea117b1-2b86-430d-887f-4917ab69b569-kube-api-access-bhmjv" (OuterVolumeSpecName: "kube-api-access-bhmjv") pod "9ea117b1-2b86-430d-887f-4917ab69b569" (UID: "9ea117b1-2b86-430d-887f-4917ab69b569"). InnerVolumeSpecName "kube-api-access-bhmjv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:19:54.764650 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:19:54.764630    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ea117b1-2b86-430d-887f-4917ab69b569-util" (OuterVolumeSpecName: "util") pod "9ea117b1-2b86-430d-887f-4917ab69b569" (UID: "9ea117b1-2b86-430d-887f-4917ab69b569"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:19:54.860759 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:19:54.860708    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ea117b1-2b86-430d-887f-4917ab69b569-util\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:19:54.860759 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:19:54.860727    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ea117b1-2b86-430d-887f-4917ab69b569-bundle\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:19:54.860759 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:19:54.860736    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhmjv\" (UniqueName: \"kubernetes.io/projected/9ea117b1-2b86-430d-887f-4917ab69b569-kube-api-access-bhmjv\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:19:55.575350 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:19:55.575322    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxqrt"
Sep 15 09:19:55.575493 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:19:55.575329    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jxqrt" event={"ID":"9ea117b1-2b86-430d-887f-4917ab69b569","Type":"ContainerDied","Data":"ae27b03b86408a1db5e5de28b9b3f8b3111e2b8559ce0740995cb6e0247fb50b"}
Sep 15 09:19:55.575493 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:19:55.575433    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ae27b03b86408a1db5e5de28b9b3f8b3111e2b8559ce0740995cb6e0247fb50b"
Sep 15 09:20:00.240844 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:00.240809    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2lc56"]
Sep 15 09:20:00.241306 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:00.241089    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ea117b1-2b86-430d-887f-4917ab69b569" containerName="util"
Sep 15 09:20:00.241306 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:00.241100    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ea117b1-2b86-430d-887f-4917ab69b569" containerName="util"
Sep 15 09:20:00.241306 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:00.241109    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ea117b1-2b86-430d-887f-4917ab69b569" containerName="pull"
Sep 15 09:20:00.241306 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:00.241114    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ea117b1-2b86-430d-887f-4917ab69b569" containerName="pull"
Sep 15 09:20:00.241306 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:00.241130    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ea117b1-2b86-430d-887f-4917ab69b569" containerName="extract"
Sep 15 09:20:00.241306 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:00.241136    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ea117b1-2b86-430d-887f-4917ab69b569" containerName="extract"
Sep 15 09:20:00.241306 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:00.241181    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ea117b1-2b86-430d-887f-4917ab69b569" containerName="extract"
Sep 15 09:20:00.244576 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:00.244560    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2lc56"
Sep 15 09:20:00.248192 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:00.248164    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 15 09:20:00.248192 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:00.248183    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 15 09:20:00.248383 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:00.248183    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-lq9kl\""
Sep 15 09:20:00.268172 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:00.268146    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2lc56"]
Sep 15 09:20:00.400375 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:00.400332    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wq6l2\" (UniqueName: \"kubernetes.io/projected/21d3d9c1-0a5b-4253-bf34-840e6bd12469-kube-api-access-wq6l2\") pod \"cert-manager-operator-controller-manager-55c444bf86-2lc56\" (UID: \"21d3d9c1-0a5b-4253-bf34-840e6bd12469\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2lc56"
Sep 15 09:20:00.400548 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:00.400380    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/21d3d9c1-0a5b-4253-bf34-840e6bd12469-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-2lc56\" (UID: \"21d3d9c1-0a5b-4253-bf34-840e6bd12469\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2lc56"
Sep 15 09:20:00.501701 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:00.501622    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wq6l2\" (UniqueName: \"kubernetes.io/projected/21d3d9c1-0a5b-4253-bf34-840e6bd12469-kube-api-access-wq6l2\") pod \"cert-manager-operator-controller-manager-55c444bf86-2lc56\" (UID: \"21d3d9c1-0a5b-4253-bf34-840e6bd12469\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2lc56"
Sep 15 09:20:00.501701 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:00.501659    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/21d3d9c1-0a5b-4253-bf34-840e6bd12469-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-2lc56\" (UID: \"21d3d9c1-0a5b-4253-bf34-840e6bd12469\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2lc56"
Sep 15 09:20:00.502035 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:00.502018    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/21d3d9c1-0a5b-4253-bf34-840e6bd12469-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-2lc56\" (UID: \"21d3d9c1-0a5b-4253-bf34-840e6bd12469\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2lc56"
Sep 15 09:20:00.509183 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:00.509166    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wq6l2\" (UniqueName: \"kubernetes.io/projected/21d3d9c1-0a5b-4253-bf34-840e6bd12469-kube-api-access-wq6l2\") pod \"cert-manager-operator-controller-manager-55c444bf86-2lc56\" (UID: \"21d3d9c1-0a5b-4253-bf34-840e6bd12469\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2lc56"
Sep 15 09:20:00.553692 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:00.553658    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2lc56"
Sep 15 09:20:00.828151 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:00.828127    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2lc56"]
Sep 15 09:20:00.829857 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:20:00.829829    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21d3d9c1_0a5b_4253_bf34_840e6bd12469.slice/crio-2bf598a21f8b632a86c2c3189f172e54ae8c2281a451153197b967ec654dd1aa WatchSource:0}: Error finding container 2bf598a21f8b632a86c2c3189f172e54ae8c2281a451153197b967ec654dd1aa: Status 404 returned error can't find the container with id 2bf598a21f8b632a86c2c3189f172e54ae8c2281a451153197b967ec654dd1aa
Sep 15 09:20:01.601609 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:01.601568    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2lc56" event={"ID":"21d3d9c1-0a5b-4253-bf34-840e6bd12469","Type":"ContainerStarted","Data":"2bf598a21f8b632a86c2c3189f172e54ae8c2281a451153197b967ec654dd1aa"}
Sep 15 09:20:02.610066 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:02.610030    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2lc56" event={"ID":"21d3d9c1-0a5b-4253-bf34-840e6bd12469","Type":"ContainerStarted","Data":"6cd2b2c80243fd6e145767dde220ef26cbcda27e212d898fea7c6c70ab05222e"}
Sep 15 09:20:02.631577 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:02.631532    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2lc56" podStartSLOduration=1.028868403 podStartE2EDuration="2.631514049s" totalImagesPullingTime="1.602645646s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:20:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:20:02.629720335 +0000 UTC m=+346.968165610" watchObservedRunningTime="2026-09-15 09:20:02.631514049 +0000 UTC m=+346.969959324"
Sep 15 09:20:03.864126 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:03.864092    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f944vp"]
Sep 15 09:20:03.870720 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:03.870690    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f944vp"
Sep 15 09:20:03.873238 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:03.873213    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 15 09:20:03.874523 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:03.874504    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7sfkk\""
Sep 15 09:20:03.874634 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:03.874549    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 15 09:20:03.876240 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:03.876219    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f944vp"]
Sep 15 09:20:04.030857 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:04.030819    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a40e305-06ae-486c-af0e-cdc027c782de-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f944vp\" (UID: \"8a40e305-06ae-486c-af0e-cdc027c782de\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f944vp"
Sep 15 09:20:04.031050 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:04.030884    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a40e305-06ae-486c-af0e-cdc027c782de-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f944vp\" (UID: \"8a40e305-06ae-486c-af0e-cdc027c782de\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f944vp"
Sep 15 09:20:04.031050 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:04.030924    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwb8d\" (UniqueName: \"kubernetes.io/projected/8a40e305-06ae-486c-af0e-cdc027c782de-kube-api-access-rwb8d\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f944vp\" (UID: \"8a40e305-06ae-486c-af0e-cdc027c782de\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f944vp"
Sep 15 09:20:04.131630 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:04.131555    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwb8d\" (UniqueName: \"kubernetes.io/projected/8a40e305-06ae-486c-af0e-cdc027c782de-kube-api-access-rwb8d\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f944vp\" (UID: \"8a40e305-06ae-486c-af0e-cdc027c782de\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f944vp"
Sep 15 09:20:04.131630 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:04.131601    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a40e305-06ae-486c-af0e-cdc027c782de-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f944vp\" (UID: \"8a40e305-06ae-486c-af0e-cdc027c782de\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f944vp"
Sep 15 09:20:04.131799 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:04.131643    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a40e305-06ae-486c-af0e-cdc027c782de-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f944vp\" (UID: \"8a40e305-06ae-486c-af0e-cdc027c782de\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f944vp"
Sep 15 09:20:04.131984 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:04.131968    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a40e305-06ae-486c-af0e-cdc027c782de-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f944vp\" (UID: \"8a40e305-06ae-486c-af0e-cdc027c782de\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f944vp"
Sep 15 09:20:04.132025 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:04.131996    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a40e305-06ae-486c-af0e-cdc027c782de-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f944vp\" (UID: \"8a40e305-06ae-486c-af0e-cdc027c782de\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f944vp"
Sep 15 09:20:04.143186 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:04.143158    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwb8d\" (UniqueName: \"kubernetes.io/projected/8a40e305-06ae-486c-af0e-cdc027c782de-kube-api-access-rwb8d\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f944vp\" (UID: \"8a40e305-06ae-486c-af0e-cdc027c782de\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f944vp"
Sep 15 09:20:04.180610 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:04.180584    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f944vp"
Sep 15 09:20:04.454782 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:04.454758    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f944vp"]
Sep 15 09:20:04.457321 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:20:04.457292    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a40e305_06ae_486c_af0e_cdc027c782de.slice/crio-679cbb1e6cc53ad21abc1ee0bd6772c5fb7b353aebc289b2ed7caa83049736d8 WatchSource:0}: Error finding container 679cbb1e6cc53ad21abc1ee0bd6772c5fb7b353aebc289b2ed7caa83049736d8: Status 404 returned error can't find the container with id 679cbb1e6cc53ad21abc1ee0bd6772c5fb7b353aebc289b2ed7caa83049736d8
Sep 15 09:20:04.620330 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:04.620299    2578 generic.go:356] "Generic (PLEG): container finished" podID="8a40e305-06ae-486c-af0e-cdc027c782de" containerID="7e0a13f5c9dfa34e026c03c5a1a886ff6fc50eac7e6748f176c797c08baf708f" exitCode=0
Sep 15 09:20:04.620483 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:04.620341    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f944vp" event={"ID":"8a40e305-06ae-486c-af0e-cdc027c782de","Type":"ContainerDied","Data":"7e0a13f5c9dfa34e026c03c5a1a886ff6fc50eac7e6748f176c797c08baf708f"}
Sep 15 09:20:04.620483 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:04.620375    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f944vp" event={"ID":"8a40e305-06ae-486c-af0e-cdc027c782de","Type":"ContainerStarted","Data":"679cbb1e6cc53ad21abc1ee0bd6772c5fb7b353aebc289b2ed7caa83049736d8"}
Sep 15 09:20:06.630447 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:06.630417    2578 generic.go:356] "Generic (PLEG): container finished" podID="8a40e305-06ae-486c-af0e-cdc027c782de" containerID="141523acfeca419f7ffd7e6c24839d3c5bcb394d62b3ab53852d14a16e6a581b" exitCode=0
Sep 15 09:20:06.630727 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:06.630459    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f944vp" event={"ID":"8a40e305-06ae-486c-af0e-cdc027c782de","Type":"ContainerDied","Data":"141523acfeca419f7ffd7e6c24839d3c5bcb394d62b3ab53852d14a16e6a581b"}
Sep 15 09:20:06.715040 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:06.715008    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-kfbbx"]
Sep 15 09:20:06.716841 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:06.716825    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-kfbbx"
Sep 15 09:20:06.719296 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:06.719278    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 15 09:20:06.719395 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:06.719315    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-d48rb\""
Sep 15 09:20:06.719519 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:06.719492    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 15 09:20:06.725330 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:06.725310    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-kfbbx"]
Sep 15 09:20:06.767427 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:20:06.767403    2578 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a40e305_06ae_486c_af0e_cdc027c782de.slice/crio-1056b0d3a9292f7994f772f8f97728208c9c7c3e07d22fff6ee61ba62bec4d67.scope\": RecentStats: unable to find data in memory cache]"
Sep 15 09:20:06.853737 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:06.853710    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be05aa83-5f75-4835-89c1-f659b5da71a8-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-kfbbx\" (UID: \"be05aa83-5f75-4835-89c1-f659b5da71a8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-kfbbx"
Sep 15 09:20:06.853825 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:06.853768    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmr75\" (UniqueName: \"kubernetes.io/projected/be05aa83-5f75-4835-89c1-f659b5da71a8-kube-api-access-bmr75\") pod \"cert-manager-cainjector-559cdd8c87-kfbbx\" (UID: \"be05aa83-5f75-4835-89c1-f659b5da71a8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-kfbbx"
Sep 15 09:20:06.954191 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:06.954164    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be05aa83-5f75-4835-89c1-f659b5da71a8-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-kfbbx\" (UID: \"be05aa83-5f75-4835-89c1-f659b5da71a8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-kfbbx"
Sep 15 09:20:06.954282 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:06.954243    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmr75\" (UniqueName: \"kubernetes.io/projected/be05aa83-5f75-4835-89c1-f659b5da71a8-kube-api-access-bmr75\") pod \"cert-manager-cainjector-559cdd8c87-kfbbx\" (UID: \"be05aa83-5f75-4835-89c1-f659b5da71a8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-kfbbx"
Sep 15 09:20:06.962006 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:06.961986    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be05aa83-5f75-4835-89c1-f659b5da71a8-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-kfbbx\" (UID: \"be05aa83-5f75-4835-89c1-f659b5da71a8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-kfbbx"
Sep 15 09:20:06.962088 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:06.962072    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmr75\" (UniqueName: \"kubernetes.io/projected/be05aa83-5f75-4835-89c1-f659b5da71a8-kube-api-access-bmr75\") pod \"cert-manager-cainjector-559cdd8c87-kfbbx\" (UID: \"be05aa83-5f75-4835-89c1-f659b5da71a8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-kfbbx"
Sep 15 09:20:07.035762 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:07.035715    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-kfbbx"
Sep 15 09:20:07.298874 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:07.298791    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-kfbbx"]
Sep 15 09:20:07.301408 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:20:07.301386    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe05aa83_5f75_4835_89c1_f659b5da71a8.slice/crio-896a1c32ff911319dd78470b7d35207298bd6c523ba1fcdc7dd5e8e0d0fee9ec WatchSource:0}: Error finding container 896a1c32ff911319dd78470b7d35207298bd6c523ba1fcdc7dd5e8e0d0fee9ec: Status 404 returned error can't find the container with id 896a1c32ff911319dd78470b7d35207298bd6c523ba1fcdc7dd5e8e0d0fee9ec
Sep 15 09:20:07.635521 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:07.635439    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-kfbbx" event={"ID":"be05aa83-5f75-4835-89c1-f659b5da71a8","Type":"ContainerStarted","Data":"896a1c32ff911319dd78470b7d35207298bd6c523ba1fcdc7dd5e8e0d0fee9ec"}
Sep 15 09:20:07.637426 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:07.637396    2578 generic.go:356] "Generic (PLEG): container finished" podID="8a40e305-06ae-486c-af0e-cdc027c782de" containerID="1056b0d3a9292f7994f772f8f97728208c9c7c3e07d22fff6ee61ba62bec4d67" exitCode=0
Sep 15 09:20:07.637520 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:07.637434    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f944vp" event={"ID":"8a40e305-06ae-486c-af0e-cdc027c782de","Type":"ContainerDied","Data":"1056b0d3a9292f7994f772f8f97728208c9c7c3e07d22fff6ee61ba62bec4d67"}
Sep 15 09:20:08.757101 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:08.757077    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f944vp"
Sep 15 09:20:08.870675 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:08.870640    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rwb8d\" (UniqueName: \"kubernetes.io/projected/8a40e305-06ae-486c-af0e-cdc027c782de-kube-api-access-rwb8d\") pod \"8a40e305-06ae-486c-af0e-cdc027c782de\" (UID: \"8a40e305-06ae-486c-af0e-cdc027c782de\") "
Sep 15 09:20:08.870799 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:08.870709    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a40e305-06ae-486c-af0e-cdc027c782de-bundle\") pod \"8a40e305-06ae-486c-af0e-cdc027c782de\" (UID: \"8a40e305-06ae-486c-af0e-cdc027c782de\") "
Sep 15 09:20:08.870799 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:08.870763    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a40e305-06ae-486c-af0e-cdc027c782de-util\") pod \"8a40e305-06ae-486c-af0e-cdc027c782de\" (UID: \"8a40e305-06ae-486c-af0e-cdc027c782de\") "
Sep 15 09:20:08.871135 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:08.871113    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a40e305-06ae-486c-af0e-cdc027c782de-bundle" (OuterVolumeSpecName: "bundle") pod "8a40e305-06ae-486c-af0e-cdc027c782de" (UID: "8a40e305-06ae-486c-af0e-cdc027c782de"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:20:08.872790 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:08.872767    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a40e305-06ae-486c-af0e-cdc027c782de-kube-api-access-rwb8d" (OuterVolumeSpecName: "kube-api-access-rwb8d") pod "8a40e305-06ae-486c-af0e-cdc027c782de" (UID: "8a40e305-06ae-486c-af0e-cdc027c782de"). InnerVolumeSpecName "kube-api-access-rwb8d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:20:08.875893 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:08.875871    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a40e305-06ae-486c-af0e-cdc027c782de-util" (OuterVolumeSpecName: "util") pod "8a40e305-06ae-486c-af0e-cdc027c782de" (UID: "8a40e305-06ae-486c-af0e-cdc027c782de"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:20:08.971813 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:08.971787    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwb8d\" (UniqueName: \"kubernetes.io/projected/8a40e305-06ae-486c-af0e-cdc027c782de-kube-api-access-rwb8d\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:20:08.971813 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:08.971808    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a40e305-06ae-486c-af0e-cdc027c782de-bundle\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:20:08.971813 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:08.971818    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a40e305-06ae-486c-af0e-cdc027c782de-util\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:20:09.646855 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:09.646825    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f944vp" event={"ID":"8a40e305-06ae-486c-af0e-cdc027c782de","Type":"ContainerDied","Data":"679cbb1e6cc53ad21abc1ee0bd6772c5fb7b353aebc289b2ed7caa83049736d8"}
Sep 15 09:20:09.646855 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:09.646858    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f944vp"
Sep 15 09:20:09.647073 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:09.646870    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="679cbb1e6cc53ad21abc1ee0bd6772c5fb7b353aebc289b2ed7caa83049736d8"
Sep 15 09:20:13.665730 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:13.665691    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-kfbbx" event={"ID":"be05aa83-5f75-4835-89c1-f659b5da71a8","Type":"ContainerStarted","Data":"fbdcb7e1f840fa821342eafc463489d8ea8b0549dc5b60d59d4a268c3e1983bf"}
Sep 15 09:20:13.681280 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:13.681240    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-kfbbx" podStartSLOduration=1.918324127 podStartE2EDuration="7.681224878s" totalImagesPullingTime="5.762900751s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:20:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:20:13.679851627 +0000 UTC m=+358.018296901" watchObservedRunningTime="2026-09-15 09:20:13.681224878 +0000 UTC m=+358.019670154"
Sep 15 09:20:14.723556 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:14.723523    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-w47nh"]
Sep 15 09:20:14.723909 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:14.723771    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a40e305-06ae-486c-af0e-cdc027c782de" containerName="extract"
Sep 15 09:20:14.723909 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:14.723782    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a40e305-06ae-486c-af0e-cdc027c782de" containerName="extract"
Sep 15 09:20:14.723909 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:14.723798    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a40e305-06ae-486c-af0e-cdc027c782de" containerName="util"
Sep 15 09:20:14.723909 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:14.723804    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a40e305-06ae-486c-af0e-cdc027c782de" containerName="util"
Sep 15 09:20:14.723909 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:14.723816    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a40e305-06ae-486c-af0e-cdc027c782de" containerName="pull"
Sep 15 09:20:14.723909 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:14.723822    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a40e305-06ae-486c-af0e-cdc027c782de" containerName="pull"
Sep 15 09:20:14.723909 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:14.723866    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a40e305-06ae-486c-af0e-cdc027c782de" containerName="extract"
Sep 15 09:20:14.726721 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:14.726707    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-w47nh"
Sep 15 09:20:14.728931 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:14.728908    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-l5pk6\""
Sep 15 09:20:14.736176 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:14.736157    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-w47nh"]
Sep 15 09:20:14.817026 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:14.817001    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rn8br\" (UniqueName: \"kubernetes.io/projected/b3f8714c-0f36-4422-8d30-babbd8f7db1d-kube-api-access-rn8br\") pod \"cert-manager-55b4d954d5-w47nh\" (UID: \"b3f8714c-0f36-4422-8d30-babbd8f7db1d\") " pod="cert-manager/cert-manager-55b4d954d5-w47nh"
Sep 15 09:20:14.817182 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:14.817161    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b3f8714c-0f36-4422-8d30-babbd8f7db1d-bound-sa-token\") pod \"cert-manager-55b4d954d5-w47nh\" (UID: \"b3f8714c-0f36-4422-8d30-babbd8f7db1d\") " pod="cert-manager/cert-manager-55b4d954d5-w47nh"
Sep 15 09:20:14.918335 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:14.918302    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b3f8714c-0f36-4422-8d30-babbd8f7db1d-bound-sa-token\") pod \"cert-manager-55b4d954d5-w47nh\" (UID: \"b3f8714c-0f36-4422-8d30-babbd8f7db1d\") " pod="cert-manager/cert-manager-55b4d954d5-w47nh"
Sep 15 09:20:14.918422 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:14.918357    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn8br\" (UniqueName: \"kubernetes.io/projected/b3f8714c-0f36-4422-8d30-babbd8f7db1d-kube-api-access-rn8br\") pod \"cert-manager-55b4d954d5-w47nh\" (UID: \"b3f8714c-0f36-4422-8d30-babbd8f7db1d\") " pod="cert-manager/cert-manager-55b4d954d5-w47nh"
Sep 15 09:20:14.926885 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:14.926854    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b3f8714c-0f36-4422-8d30-babbd8f7db1d-bound-sa-token\") pod \"cert-manager-55b4d954d5-w47nh\" (UID: \"b3f8714c-0f36-4422-8d30-babbd8f7db1d\") " pod="cert-manager/cert-manager-55b4d954d5-w47nh"
Sep 15 09:20:14.926994 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:14.926972    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn8br\" (UniqueName: \"kubernetes.io/projected/b3f8714c-0f36-4422-8d30-babbd8f7db1d-kube-api-access-rn8br\") pod \"cert-manager-55b4d954d5-w47nh\" (UID: \"b3f8714c-0f36-4422-8d30-babbd8f7db1d\") " pod="cert-manager/cert-manager-55b4d954d5-w47nh"
Sep 15 09:20:15.035048 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:15.034997    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-w47nh"
Sep 15 09:20:15.305426 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:15.305258    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-w47nh"]
Sep 15 09:20:15.307839 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:20:15.307812    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb3f8714c_0f36_4422_8d30_babbd8f7db1d.slice/crio-0c3d87189bb1fc301c07c3db452279d57cf7c31aa85c250f60acd791ad18dcb4 WatchSource:0}: Error finding container 0c3d87189bb1fc301c07c3db452279d57cf7c31aa85c250f60acd791ad18dcb4: Status 404 returned error can't find the container with id 0c3d87189bb1fc301c07c3db452279d57cf7c31aa85c250f60acd791ad18dcb4
Sep 15 09:20:15.675625 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:15.675536    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-w47nh" event={"ID":"b3f8714c-0f36-4422-8d30-babbd8f7db1d","Type":"ContainerStarted","Data":"8a1a3742c1f107e3db200715127011bdb645381673a4681e5d2615d90ebdb3ac"}
Sep 15 09:20:15.675625 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:15.675580    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-w47nh" event={"ID":"b3f8714c-0f36-4422-8d30-babbd8f7db1d","Type":"ContainerStarted","Data":"0c3d87189bb1fc301c07c3db452279d57cf7c31aa85c250f60acd791ad18dcb4"}
Sep 15 09:20:15.692025 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:15.691978    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-w47nh" podStartSLOduration=1.691962331 podStartE2EDuration="1.691962331s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:20:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:20:15.690037491 +0000 UTC m=+360.028482766" watchObservedRunningTime="2026-09-15 09:20:15.691962331 +0000 UTC m=+360.030407600"
Sep 15 09:20:16.867180 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:16.867146    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rwm4b"]
Sep 15 09:20:16.873663 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:16.870869    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rwm4b"
Sep 15 09:20:16.874324 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:16.874286    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-fqc44\""
Sep 15 09:20:16.875226 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:16.875206    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 15 09:20:16.875334 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:16.875206    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 15 09:20:16.879458 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:16.879435    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rwm4b"]
Sep 15 09:20:17.033720 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:17.033692    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk7zc\" (UniqueName: \"kubernetes.io/projected/84b1c034-6ed8-4af2-bee6-7e328644151b-kube-api-access-wk7zc\") pod \"openshift-lws-operator-fd8ccff4c-rwm4b\" (UID: \"84b1c034-6ed8-4af2-bee6-7e328644151b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rwm4b"
Sep 15 09:20:17.033841 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:17.033763    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/84b1c034-6ed8-4af2-bee6-7e328644151b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-rwm4b\" (UID: \"84b1c034-6ed8-4af2-bee6-7e328644151b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rwm4b"
Sep 15 09:20:17.134805 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:17.134746    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wk7zc\" (UniqueName: \"kubernetes.io/projected/84b1c034-6ed8-4af2-bee6-7e328644151b-kube-api-access-wk7zc\") pod \"openshift-lws-operator-fd8ccff4c-rwm4b\" (UID: \"84b1c034-6ed8-4af2-bee6-7e328644151b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rwm4b"
Sep 15 09:20:17.134805 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:17.134802    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/84b1c034-6ed8-4af2-bee6-7e328644151b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-rwm4b\" (UID: \"84b1c034-6ed8-4af2-bee6-7e328644151b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rwm4b"
Sep 15 09:20:17.135161 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:17.135142    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/84b1c034-6ed8-4af2-bee6-7e328644151b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-rwm4b\" (UID: \"84b1c034-6ed8-4af2-bee6-7e328644151b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rwm4b"
Sep 15 09:20:17.143094 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:17.143069    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk7zc\" (UniqueName: \"kubernetes.io/projected/84b1c034-6ed8-4af2-bee6-7e328644151b-kube-api-access-wk7zc\") pod \"openshift-lws-operator-fd8ccff4c-rwm4b\" (UID: \"84b1c034-6ed8-4af2-bee6-7e328644151b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rwm4b"
Sep 15 09:20:17.184194 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:17.184170    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rwm4b"
Sep 15 09:20:17.454129 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:17.454105    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rwm4b"]
Sep 15 09:20:17.457284 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:20:17.457256    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod84b1c034_6ed8_4af2_bee6_7e328644151b.slice/crio-968b23760e7432f4b15dd4f2bfa6bbd11c6c2fb7217fe036bd1c715406855923 WatchSource:0}: Error finding container 968b23760e7432f4b15dd4f2bfa6bbd11c6c2fb7217fe036bd1c715406855923: Status 404 returned error can't find the container with id 968b23760e7432f4b15dd4f2bfa6bbd11c6c2fb7217fe036bd1c715406855923
Sep 15 09:20:17.686760 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:17.686718    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rwm4b" event={"ID":"84b1c034-6ed8-4af2-bee6-7e328644151b","Type":"ContainerStarted","Data":"968b23760e7432f4b15dd4f2bfa6bbd11c6c2fb7217fe036bd1c715406855923"}
Sep 15 09:20:19.696913 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:19.696871    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rwm4b" event={"ID":"84b1c034-6ed8-4af2-bee6-7e328644151b","Type":"ContainerStarted","Data":"08221f1534ae28afc7e25c8aa8b61b6956ac7d0b1b43c5371e8a3c7bc6e589ac"}
Sep 15 09:20:19.712651 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:19.712599    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rwm4b" podStartSLOduration=2.324080477 podStartE2EDuration="3.712584091s" totalImagesPullingTime="1.388503614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:20:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:20:19.711596502 +0000 UTC m=+364.050041781" watchObservedRunningTime="2026-09-15 09:20:19.712584091 +0000 UTC m=+364.051029366"
Sep 15 09:20:24.454684 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:24.454645    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd6dsg"]
Sep 15 09:20:24.459172 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:24.459153    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd6dsg"
Sep 15 09:20:24.461378 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:24.461349    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 15 09:20:24.462339 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:24.462319    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7sfkk\""
Sep 15 09:20:24.462402 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:24.462348    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 15 09:20:24.465565 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:24.465542    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd6dsg"]
Sep 15 09:20:24.494167 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:24.494140    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ss595\" (UniqueName: \"kubernetes.io/projected/8e150348-d8eb-4fe4-a5f1-8f043220e46d-kube-api-access-ss595\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd6dsg\" (UID: \"8e150348-d8eb-4fe4-a5f1-8f043220e46d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd6dsg"
Sep 15 09:20:24.494247 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:24.494183    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e150348-d8eb-4fe4-a5f1-8f043220e46d-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd6dsg\" (UID: \"8e150348-d8eb-4fe4-a5f1-8f043220e46d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd6dsg"
Sep 15 09:20:24.494332 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:24.494315    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e150348-d8eb-4fe4-a5f1-8f043220e46d-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd6dsg\" (UID: \"8e150348-d8eb-4fe4-a5f1-8f043220e46d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd6dsg"
Sep 15 09:20:24.594607 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:24.594581    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ss595\" (UniqueName: \"kubernetes.io/projected/8e150348-d8eb-4fe4-a5f1-8f043220e46d-kube-api-access-ss595\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd6dsg\" (UID: \"8e150348-d8eb-4fe4-a5f1-8f043220e46d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd6dsg"
Sep 15 09:20:24.594701 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:24.594620    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e150348-d8eb-4fe4-a5f1-8f043220e46d-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd6dsg\" (UID: \"8e150348-d8eb-4fe4-a5f1-8f043220e46d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd6dsg"
Sep 15 09:20:24.594701 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:24.594672    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e150348-d8eb-4fe4-a5f1-8f043220e46d-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd6dsg\" (UID: \"8e150348-d8eb-4fe4-a5f1-8f043220e46d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd6dsg"
Sep 15 09:20:24.595036 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:24.595022    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e150348-d8eb-4fe4-a5f1-8f043220e46d-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd6dsg\" (UID: \"8e150348-d8eb-4fe4-a5f1-8f043220e46d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd6dsg"
Sep 15 09:20:24.595079 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:24.595063    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e150348-d8eb-4fe4-a5f1-8f043220e46d-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd6dsg\" (UID: \"8e150348-d8eb-4fe4-a5f1-8f043220e46d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd6dsg"
Sep 15 09:20:24.604671 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:24.604647    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ss595\" (UniqueName: \"kubernetes.io/projected/8e150348-d8eb-4fe4-a5f1-8f043220e46d-kube-api-access-ss595\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd6dsg\" (UID: \"8e150348-d8eb-4fe4-a5f1-8f043220e46d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd6dsg"
Sep 15 09:20:24.769715 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:24.769646    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd6dsg"
Sep 15 09:20:25.056694 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:25.056668    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd6dsg"]
Sep 15 09:20:25.058929 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:20:25.058905    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e150348_d8eb_4fe4_a5f1_8f043220e46d.slice/crio-a9e60d5db8c3cd2316a6689af617a6a4b080107829f1dd2de421d6c7125a7dcc WatchSource:0}: Error finding container a9e60d5db8c3cd2316a6689af617a6a4b080107829f1dd2de421d6c7125a7dcc: Status 404 returned error can't find the container with id a9e60d5db8c3cd2316a6689af617a6a4b080107829f1dd2de421d6c7125a7dcc
Sep 15 09:20:25.723008 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:25.722974    2578 generic.go:356] "Generic (PLEG): container finished" podID="8e150348-d8eb-4fe4-a5f1-8f043220e46d" containerID="139d8c22fdcfa695c5feb4810002406f7216aacda8191d6c91e70bddbf8e1770" exitCode=0
Sep 15 09:20:25.723340 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:25.723061    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd6dsg" event={"ID":"8e150348-d8eb-4fe4-a5f1-8f043220e46d","Type":"ContainerDied","Data":"139d8c22fdcfa695c5feb4810002406f7216aacda8191d6c91e70bddbf8e1770"}
Sep 15 09:20:25.723340 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:25.723095    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd6dsg" event={"ID":"8e150348-d8eb-4fe4-a5f1-8f043220e46d","Type":"ContainerStarted","Data":"a9e60d5db8c3cd2316a6689af617a6a4b080107829f1dd2de421d6c7125a7dcc"}
Sep 15 09:20:27.733327 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:27.733291    2578 generic.go:356] "Generic (PLEG): container finished" podID="8e150348-d8eb-4fe4-a5f1-8f043220e46d" containerID="0db90fa942dc4f44a18b71aa288f6616e763e1b6506aa389a6ba95e88be53f18" exitCode=0
Sep 15 09:20:27.733768 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:27.733366    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd6dsg" event={"ID":"8e150348-d8eb-4fe4-a5f1-8f043220e46d","Type":"ContainerDied","Data":"0db90fa942dc4f44a18b71aa288f6616e763e1b6506aa389a6ba95e88be53f18"}
Sep 15 09:20:28.740083 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:28.740040    2578 generic.go:356] "Generic (PLEG): container finished" podID="8e150348-d8eb-4fe4-a5f1-8f043220e46d" containerID="bfc87f188c4f01f1f894f819a6bca605e1d6ddf453250972c3a05a440755fe75" exitCode=0
Sep 15 09:20:28.740083 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:28.740086    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd6dsg" event={"ID":"8e150348-d8eb-4fe4-a5f1-8f043220e46d","Type":"ContainerDied","Data":"bfc87f188c4f01f1f894f819a6bca605e1d6ddf453250972c3a05a440755fe75"}
Sep 15 09:20:29.861654 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:29.861626    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd6dsg"
Sep 15 09:20:29.928335 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:29.928296    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e150348-d8eb-4fe4-a5f1-8f043220e46d-util\") pod \"8e150348-d8eb-4fe4-a5f1-8f043220e46d\" (UID: \"8e150348-d8eb-4fe4-a5f1-8f043220e46d\") "
Sep 15 09:20:29.928524 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:29.928356    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ss595\" (UniqueName: \"kubernetes.io/projected/8e150348-d8eb-4fe4-a5f1-8f043220e46d-kube-api-access-ss595\") pod \"8e150348-d8eb-4fe4-a5f1-8f043220e46d\" (UID: \"8e150348-d8eb-4fe4-a5f1-8f043220e46d\") "
Sep 15 09:20:29.928524 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:29.928384    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e150348-d8eb-4fe4-a5f1-8f043220e46d-bundle\") pod \"8e150348-d8eb-4fe4-a5f1-8f043220e46d\" (UID: \"8e150348-d8eb-4fe4-a5f1-8f043220e46d\") "
Sep 15 09:20:29.929076 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:29.929045    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e150348-d8eb-4fe4-a5f1-8f043220e46d-bundle" (OuterVolumeSpecName: "bundle") pod "8e150348-d8eb-4fe4-a5f1-8f043220e46d" (UID: "8e150348-d8eb-4fe4-a5f1-8f043220e46d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:20:29.930465 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:29.930440    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e150348-d8eb-4fe4-a5f1-8f043220e46d-kube-api-access-ss595" (OuterVolumeSpecName: "kube-api-access-ss595") pod "8e150348-d8eb-4fe4-a5f1-8f043220e46d" (UID: "8e150348-d8eb-4fe4-a5f1-8f043220e46d"). InnerVolumeSpecName "kube-api-access-ss595". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:20:29.936125 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:29.936094    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e150348-d8eb-4fe4-a5f1-8f043220e46d-util" (OuterVolumeSpecName: "util") pod "8e150348-d8eb-4fe4-a5f1-8f043220e46d" (UID: "8e150348-d8eb-4fe4-a5f1-8f043220e46d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:20:30.029273 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:30.029186    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e150348-d8eb-4fe4-a5f1-8f043220e46d-util\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:20:30.029273 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:30.029221    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ss595\" (UniqueName: \"kubernetes.io/projected/8e150348-d8eb-4fe4-a5f1-8f043220e46d-kube-api-access-ss595\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:20:30.029273 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:30.029231    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e150348-d8eb-4fe4-a5f1-8f043220e46d-bundle\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:20:30.750569 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:30.750532    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd6dsg" event={"ID":"8e150348-d8eb-4fe4-a5f1-8f043220e46d","Type":"ContainerDied","Data":"a9e60d5db8c3cd2316a6689af617a6a4b080107829f1dd2de421d6c7125a7dcc"}
Sep 15 09:20:30.750732 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:30.750594    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a9e60d5db8c3cd2316a6689af617a6a4b080107829f1dd2de421d6c7125a7dcc"
Sep 15 09:20:30.750732 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:30.750549    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd6dsg"
Sep 15 09:20:38.997814 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:38.997781    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6f69b6c8dc-jbrrx"]
Sep 15 09:20:38.998279 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:38.998059    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e150348-d8eb-4fe4-a5f1-8f043220e46d" containerName="extract"
Sep 15 09:20:38.998279 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:38.998071    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e150348-d8eb-4fe4-a5f1-8f043220e46d" containerName="extract"
Sep 15 09:20:38.998279 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:38.998086    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e150348-d8eb-4fe4-a5f1-8f043220e46d" containerName="pull"
Sep 15 09:20:38.998279 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:38.998092    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e150348-d8eb-4fe4-a5f1-8f043220e46d" containerName="pull"
Sep 15 09:20:38.998279 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:38.998102    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e150348-d8eb-4fe4-a5f1-8f043220e46d" containerName="util"
Sep 15 09:20:38.998279 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:38.998108    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e150348-d8eb-4fe4-a5f1-8f043220e46d" containerName="util"
Sep 15 09:20:38.998279 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:38.998157    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e150348-d8eb-4fe4-a5f1-8f043220e46d" containerName="extract"
Sep 15 09:20:39.000841 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:39.000826    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6f69b6c8dc-jbrrx"
Sep 15 09:20:39.003386 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:39.003362    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-jtvl9\""
Sep 15 09:20:39.004443 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:39.004426    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 15 09:20:39.004593 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:39.004577    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 15 09:20:39.004689 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:39.004675    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 15 09:20:39.011272 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:39.011250    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6f69b6c8dc-jbrrx"]
Sep 15 09:20:39.102561 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:39.102535    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cz8l8\" (UniqueName: \"kubernetes.io/projected/c3409cbc-028e-4c4a-8bb6-4b058b3972af-kube-api-access-cz8l8\") pod \"lws-controller-manager-6f69b6c8dc-jbrrx\" (UID: \"c3409cbc-028e-4c4a-8bb6-4b058b3972af\") " pod="openshift-lws-operator/lws-controller-manager-6f69b6c8dc-jbrrx"
Sep 15 09:20:39.102845 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:39.102596    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c3409cbc-028e-4c4a-8bb6-4b058b3972af-metrics-cert\") pod \"lws-controller-manager-6f69b6c8dc-jbrrx\" (UID: \"c3409cbc-028e-4c4a-8bb6-4b058b3972af\") " pod="openshift-lws-operator/lws-controller-manager-6f69b6c8dc-jbrrx"
Sep 15 09:20:39.102845 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:39.102651    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c3409cbc-028e-4c4a-8bb6-4b058b3972af-manager-config\") pod \"lws-controller-manager-6f69b6c8dc-jbrrx\" (UID: \"c3409cbc-028e-4c4a-8bb6-4b058b3972af\") " pod="openshift-lws-operator/lws-controller-manager-6f69b6c8dc-jbrrx"
Sep 15 09:20:39.102845 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:39.102685    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3409cbc-028e-4c4a-8bb6-4b058b3972af-cert\") pod \"lws-controller-manager-6f69b6c8dc-jbrrx\" (UID: \"c3409cbc-028e-4c4a-8bb6-4b058b3972af\") " pod="openshift-lws-operator/lws-controller-manager-6f69b6c8dc-jbrrx"
Sep 15 09:20:39.203518 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:39.203492    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c3409cbc-028e-4c4a-8bb6-4b058b3972af-metrics-cert\") pod \"lws-controller-manager-6f69b6c8dc-jbrrx\" (UID: \"c3409cbc-028e-4c4a-8bb6-4b058b3972af\") " pod="openshift-lws-operator/lws-controller-manager-6f69b6c8dc-jbrrx"
Sep 15 09:20:39.203637 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:39.203525    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c3409cbc-028e-4c4a-8bb6-4b058b3972af-manager-config\") pod \"lws-controller-manager-6f69b6c8dc-jbrrx\" (UID: \"c3409cbc-028e-4c4a-8bb6-4b058b3972af\") " pod="openshift-lws-operator/lws-controller-manager-6f69b6c8dc-jbrrx"
Sep 15 09:20:39.203637 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:39.203544    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3409cbc-028e-4c4a-8bb6-4b058b3972af-cert\") pod \"lws-controller-manager-6f69b6c8dc-jbrrx\" (UID: \"c3409cbc-028e-4c4a-8bb6-4b058b3972af\") " pod="openshift-lws-operator/lws-controller-manager-6f69b6c8dc-jbrrx"
Sep 15 09:20:39.203637 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:39.203562    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cz8l8\" (UniqueName: \"kubernetes.io/projected/c3409cbc-028e-4c4a-8bb6-4b058b3972af-kube-api-access-cz8l8\") pod \"lws-controller-manager-6f69b6c8dc-jbrrx\" (UID: \"c3409cbc-028e-4c4a-8bb6-4b058b3972af\") " pod="openshift-lws-operator/lws-controller-manager-6f69b6c8dc-jbrrx"
Sep 15 09:20:39.204191 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:39.204170    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c3409cbc-028e-4c4a-8bb6-4b058b3972af-manager-config\") pod \"lws-controller-manager-6f69b6c8dc-jbrrx\" (UID: \"c3409cbc-028e-4c4a-8bb6-4b058b3972af\") " pod="openshift-lws-operator/lws-controller-manager-6f69b6c8dc-jbrrx"
Sep 15 09:20:39.206014 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:39.205986    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3409cbc-028e-4c4a-8bb6-4b058b3972af-cert\") pod \"lws-controller-manager-6f69b6c8dc-jbrrx\" (UID: \"c3409cbc-028e-4c4a-8bb6-4b058b3972af\") " pod="openshift-lws-operator/lws-controller-manager-6f69b6c8dc-jbrrx"
Sep 15 09:20:39.206214 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:39.206193    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c3409cbc-028e-4c4a-8bb6-4b058b3972af-metrics-cert\") pod \"lws-controller-manager-6f69b6c8dc-jbrrx\" (UID: \"c3409cbc-028e-4c4a-8bb6-4b058b3972af\") " pod="openshift-lws-operator/lws-controller-manager-6f69b6c8dc-jbrrx"
Sep 15 09:20:39.211790 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:39.211772    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cz8l8\" (UniqueName: \"kubernetes.io/projected/c3409cbc-028e-4c4a-8bb6-4b058b3972af-kube-api-access-cz8l8\") pod \"lws-controller-manager-6f69b6c8dc-jbrrx\" (UID: \"c3409cbc-028e-4c4a-8bb6-4b058b3972af\") " pod="openshift-lws-operator/lws-controller-manager-6f69b6c8dc-jbrrx"
Sep 15 09:20:39.309926 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:39.309858    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6f69b6c8dc-jbrrx"
Sep 15 09:20:39.592261 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:39.592240    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6f69b6c8dc-jbrrx"]
Sep 15 09:20:39.594363 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:20:39.594336    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3409cbc_028e_4c4a_8bb6_4b058b3972af.slice/crio-65b316947fadff5a1be5a0dfa68fe850911bb7ef53bfb15057b31439fa64fad1 WatchSource:0}: Error finding container 65b316947fadff5a1be5a0dfa68fe850911bb7ef53bfb15057b31439fa64fad1: Status 404 returned error can't find the container with id 65b316947fadff5a1be5a0dfa68fe850911bb7ef53bfb15057b31439fa64fad1
Sep 15 09:20:39.606833 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:39.606807    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06jzmf"]
Sep 15 09:20:39.611145 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:39.611130    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06jzmf"
Sep 15 09:20:39.615549 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:39.615486    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 15 09:20:39.615764 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:39.615731    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7sfkk\""
Sep 15 09:20:39.616422 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:39.616405    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 15 09:20:39.623883 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:39.623862    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06jzmf"]
Sep 15 09:20:39.707017 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:39.706989    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c652699d-a5a8-409b-9c23-d516b9d770c4-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06jzmf\" (UID: \"c652699d-a5a8-409b-9c23-d516b9d770c4\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06jzmf"
Sep 15 09:20:39.707017 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:39.707019    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfmw5\" (UniqueName: \"kubernetes.io/projected/c652699d-a5a8-409b-9c23-d516b9d770c4-kube-api-access-tfmw5\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06jzmf\" (UID: \"c652699d-a5a8-409b-9c23-d516b9d770c4\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06jzmf"
Sep 15 09:20:39.707166 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:39.707049    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c652699d-a5a8-409b-9c23-d516b9d770c4-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06jzmf\" (UID: \"c652699d-a5a8-409b-9c23-d516b9d770c4\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06jzmf"
Sep 15 09:20:39.796430 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:39.796396    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6f69b6c8dc-jbrrx" event={"ID":"c3409cbc-028e-4c4a-8bb6-4b058b3972af","Type":"ContainerStarted","Data":"65b316947fadff5a1be5a0dfa68fe850911bb7ef53bfb15057b31439fa64fad1"}
Sep 15 09:20:39.807831 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:39.807806    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c652699d-a5a8-409b-9c23-d516b9d770c4-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06jzmf\" (UID: \"c652699d-a5a8-409b-9c23-d516b9d770c4\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06jzmf"
Sep 15 09:20:39.807955 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:39.807862    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c652699d-a5a8-409b-9c23-d516b9d770c4-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06jzmf\" (UID: \"c652699d-a5a8-409b-9c23-d516b9d770c4\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06jzmf"
Sep 15 09:20:39.808015 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:39.807960    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfmw5\" (UniqueName: \"kubernetes.io/projected/c652699d-a5a8-409b-9c23-d516b9d770c4-kube-api-access-tfmw5\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06jzmf\" (UID: \"c652699d-a5a8-409b-9c23-d516b9d770c4\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06jzmf"
Sep 15 09:20:39.808212 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:39.808193    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c652699d-a5a8-409b-9c23-d516b9d770c4-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06jzmf\" (UID: \"c652699d-a5a8-409b-9c23-d516b9d770c4\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06jzmf"
Sep 15 09:20:39.808449 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:39.808421    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c652699d-a5a8-409b-9c23-d516b9d770c4-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06jzmf\" (UID: \"c652699d-a5a8-409b-9c23-d516b9d770c4\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06jzmf"
Sep 15 09:20:39.830916 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:39.830895    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfmw5\" (UniqueName: \"kubernetes.io/projected/c652699d-a5a8-409b-9c23-d516b9d770c4-kube-api-access-tfmw5\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06jzmf\" (UID: \"c652699d-a5a8-409b-9c23-d516b9d770c4\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06jzmf"
Sep 15 09:20:39.920632 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:39.920561    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06jzmf"
Sep 15 09:20:40.189285 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:40.189247    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06jzmf"]
Sep 15 09:20:40.191252 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:20:40.191227    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc652699d_a5a8_409b_9c23_d516b9d770c4.slice/crio-6d7cf9dee91232ebc0a406873e788f35de9131f82c88914d8a3330b5610d01c2 WatchSource:0}: Error finding container 6d7cf9dee91232ebc0a406873e788f35de9131f82c88914d8a3330b5610d01c2: Status 404 returned error can't find the container with id 6d7cf9dee91232ebc0a406873e788f35de9131f82c88914d8a3330b5610d01c2
Sep 15 09:20:40.802031 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:40.801998    2578 generic.go:356] "Generic (PLEG): container finished" podID="c652699d-a5a8-409b-9c23-d516b9d770c4" containerID="693c9db6ce8c90fb452001e14f0ace321c5276a980c0a61c299dcd184ef169cf" exitCode=0
Sep 15 09:20:40.802198 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:40.802046    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06jzmf" event={"ID":"c652699d-a5a8-409b-9c23-d516b9d770c4","Type":"ContainerDied","Data":"693c9db6ce8c90fb452001e14f0ace321c5276a980c0a61c299dcd184ef169cf"}
Sep 15 09:20:40.802198 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:40.802081    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06jzmf" event={"ID":"c652699d-a5a8-409b-9c23-d516b9d770c4","Type":"ContainerStarted","Data":"6d7cf9dee91232ebc0a406873e788f35de9131f82c88914d8a3330b5610d01c2"}
Sep 15 09:20:41.372717 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:41.372683    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-767c4c8b76-jmwcb"]
Sep 15 09:20:41.376179 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:41.376162    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-767c4c8b76-jmwcb"
Sep 15 09:20:41.378804 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:41.378777    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 15 09:20:41.378804 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:41.378803    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 15 09:20:41.379016 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:41.378817    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 15 09:20:41.379016 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:41.378911    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-d2wz4\""
Sep 15 09:20:41.379016 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:41.378921    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 15 09:20:41.392030 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:41.392003    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-767c4c8b76-jmwcb"]
Sep 15 09:20:41.420443 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:41.420416    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ced6aa23-9676-4cc4-a15a-1d18d5aeedf1-tmp\") pod \"opendatahub-operator-controller-manager-767c4c8b76-jmwcb\" (UID: \"ced6aa23-9676-4cc4-a15a-1d18d5aeedf1\") " pod="opendatahub/opendatahub-operator-controller-manager-767c4c8b76-jmwcb"
Sep 15 09:20:41.420568 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:41.420449    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ced6aa23-9676-4cc4-a15a-1d18d5aeedf1-manifests\") pod \"opendatahub-operator-controller-manager-767c4c8b76-jmwcb\" (UID: \"ced6aa23-9676-4cc4-a15a-1d18d5aeedf1\") " pod="opendatahub/opendatahub-operator-controller-manager-767c4c8b76-jmwcb"
Sep 15 09:20:41.420568 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:41.420469    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ced6aa23-9676-4cc4-a15a-1d18d5aeedf1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-767c4c8b76-jmwcb\" (UID: \"ced6aa23-9676-4cc4-a15a-1d18d5aeedf1\") " pod="opendatahub/opendatahub-operator-controller-manager-767c4c8b76-jmwcb"
Sep 15 09:20:41.420568 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:41.420485    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ced6aa23-9676-4cc4-a15a-1d18d5aeedf1-webhook-cert\") pod \"opendatahub-operator-controller-manager-767c4c8b76-jmwcb\" (UID: \"ced6aa23-9676-4cc4-a15a-1d18d5aeedf1\") " pod="opendatahub/opendatahub-operator-controller-manager-767c4c8b76-jmwcb"
Sep 15 09:20:41.420568 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:41.420533    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bhgl\" (UniqueName: \"kubernetes.io/projected/ced6aa23-9676-4cc4-a15a-1d18d5aeedf1-kube-api-access-8bhgl\") pod \"opendatahub-operator-controller-manager-767c4c8b76-jmwcb\" (UID: \"ced6aa23-9676-4cc4-a15a-1d18d5aeedf1\") " pod="opendatahub/opendatahub-operator-controller-manager-767c4c8b76-jmwcb"
Sep 15 09:20:41.521062 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:41.521028    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ced6aa23-9676-4cc4-a15a-1d18d5aeedf1-manifests\") pod \"opendatahub-operator-controller-manager-767c4c8b76-jmwcb\" (UID: \"ced6aa23-9676-4cc4-a15a-1d18d5aeedf1\") " pod="opendatahub/opendatahub-operator-controller-manager-767c4c8b76-jmwcb"
Sep 15 09:20:41.521227 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:41.521071    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ced6aa23-9676-4cc4-a15a-1d18d5aeedf1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-767c4c8b76-jmwcb\" (UID: \"ced6aa23-9676-4cc4-a15a-1d18d5aeedf1\") " pod="opendatahub/opendatahub-operator-controller-manager-767c4c8b76-jmwcb"
Sep 15 09:20:41.521227 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:41.521093    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ced6aa23-9676-4cc4-a15a-1d18d5aeedf1-webhook-cert\") pod \"opendatahub-operator-controller-manager-767c4c8b76-jmwcb\" (UID: \"ced6aa23-9676-4cc4-a15a-1d18d5aeedf1\") " pod="opendatahub/opendatahub-operator-controller-manager-767c4c8b76-jmwcb"
Sep 15 09:20:41.521227 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:41.521134    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bhgl\" (UniqueName: \"kubernetes.io/projected/ced6aa23-9676-4cc4-a15a-1d18d5aeedf1-kube-api-access-8bhgl\") pod \"opendatahub-operator-controller-manager-767c4c8b76-jmwcb\" (UID: \"ced6aa23-9676-4cc4-a15a-1d18d5aeedf1\") " pod="opendatahub/opendatahub-operator-controller-manager-767c4c8b76-jmwcb"
Sep 15 09:20:41.521227 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:41.521200    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ced6aa23-9676-4cc4-a15a-1d18d5aeedf1-tmp\") pod \"opendatahub-operator-controller-manager-767c4c8b76-jmwcb\" (UID: \"ced6aa23-9676-4cc4-a15a-1d18d5aeedf1\") " pod="opendatahub/opendatahub-operator-controller-manager-767c4c8b76-jmwcb"
Sep 15 09:20:41.521458 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:41.521399    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ced6aa23-9676-4cc4-a15a-1d18d5aeedf1-manifests\") pod \"opendatahub-operator-controller-manager-767c4c8b76-jmwcb\" (UID: \"ced6aa23-9676-4cc4-a15a-1d18d5aeedf1\") " pod="opendatahub/opendatahub-operator-controller-manager-767c4c8b76-jmwcb"
Sep 15 09:20:41.523329 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:41.523303    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ced6aa23-9676-4cc4-a15a-1d18d5aeedf1-tmp\") pod \"opendatahub-operator-controller-manager-767c4c8b76-jmwcb\" (UID: \"ced6aa23-9676-4cc4-a15a-1d18d5aeedf1\") " pod="opendatahub/opendatahub-operator-controller-manager-767c4c8b76-jmwcb"
Sep 15 09:20:41.523674 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:41.523656    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ced6aa23-9676-4cc4-a15a-1d18d5aeedf1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-767c4c8b76-jmwcb\" (UID: \"ced6aa23-9676-4cc4-a15a-1d18d5aeedf1\") " pod="opendatahub/opendatahub-operator-controller-manager-767c4c8b76-jmwcb"
Sep 15 09:20:41.523767 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:41.523704    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ced6aa23-9676-4cc4-a15a-1d18d5aeedf1-webhook-cert\") pod \"opendatahub-operator-controller-manager-767c4c8b76-jmwcb\" (UID: \"ced6aa23-9676-4cc4-a15a-1d18d5aeedf1\") " pod="opendatahub/opendatahub-operator-controller-manager-767c4c8b76-jmwcb"
Sep 15 09:20:41.534061 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:41.534038    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bhgl\" (UniqueName: \"kubernetes.io/projected/ced6aa23-9676-4cc4-a15a-1d18d5aeedf1-kube-api-access-8bhgl\") pod \"opendatahub-operator-controller-manager-767c4c8b76-jmwcb\" (UID: \"ced6aa23-9676-4cc4-a15a-1d18d5aeedf1\") " pod="opendatahub/opendatahub-operator-controller-manager-767c4c8b76-jmwcb"
Sep 15 09:20:41.686117 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:41.686069    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-767c4c8b76-jmwcb"
Sep 15 09:20:41.808524 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:41.808495    2578 generic.go:356] "Generic (PLEG): container finished" podID="c652699d-a5a8-409b-9c23-d516b9d770c4" containerID="8770abb3b8dd50cb670bbac0e272eff44be399da2554314408c642ea4533fd07" exitCode=0
Sep 15 09:20:41.808633 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:41.808558    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06jzmf" event={"ID":"c652699d-a5a8-409b-9c23-d516b9d770c4","Type":"ContainerDied","Data":"8770abb3b8dd50cb670bbac0e272eff44be399da2554314408c642ea4533fd07"}
Sep 15 09:20:41.966278 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:41.966255    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-767c4c8b76-jmwcb"]
Sep 15 09:20:42.005772 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:20:42.005748    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podced6aa23_9676_4cc4_a15a_1d18d5aeedf1.slice/crio-11036fd3ba108940c0fa8ffa0831b04676fb43b64db3d2cbb48ae130d78982e1 WatchSource:0}: Error finding container 11036fd3ba108940c0fa8ffa0831b04676fb43b64db3d2cbb48ae130d78982e1: Status 404 returned error can't find the container with id 11036fd3ba108940c0fa8ffa0831b04676fb43b64db3d2cbb48ae130d78982e1
Sep 15 09:20:42.818061 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:42.818026    2578 generic.go:356] "Generic (PLEG): container finished" podID="c652699d-a5a8-409b-9c23-d516b9d770c4" containerID="1d0d2294165b9c5cd33f5ec4b232dbe0ab1911f3aaba07329b9b7b2eb80cbc9b" exitCode=0
Sep 15 09:20:42.818547 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:42.818172    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06jzmf" event={"ID":"c652699d-a5a8-409b-9c23-d516b9d770c4","Type":"ContainerDied","Data":"1d0d2294165b9c5cd33f5ec4b232dbe0ab1911f3aaba07329b9b7b2eb80cbc9b"}
Sep 15 09:20:42.820067 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:42.820036    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-767c4c8b76-jmwcb" event={"ID":"ced6aa23-9676-4cc4-a15a-1d18d5aeedf1","Type":"ContainerStarted","Data":"11036fd3ba108940c0fa8ffa0831b04676fb43b64db3d2cbb48ae130d78982e1"}
Sep 15 09:20:44.041292 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:44.041258    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06jzmf"
Sep 15 09:20:44.145713 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:44.145639    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c652699d-a5a8-409b-9c23-d516b9d770c4-util\") pod \"c652699d-a5a8-409b-9c23-d516b9d770c4\" (UID: \"c652699d-a5a8-409b-9c23-d516b9d770c4\") "
Sep 15 09:20:44.145713 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:44.145695    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c652699d-a5a8-409b-9c23-d516b9d770c4-bundle\") pod \"c652699d-a5a8-409b-9c23-d516b9d770c4\" (UID: \"c652699d-a5a8-409b-9c23-d516b9d770c4\") "
Sep 15 09:20:44.145936 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:44.145762    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tfmw5\" (UniqueName: \"kubernetes.io/projected/c652699d-a5a8-409b-9c23-d516b9d770c4-kube-api-access-tfmw5\") pod \"c652699d-a5a8-409b-9c23-d516b9d770c4\" (UID: \"c652699d-a5a8-409b-9c23-d516b9d770c4\") "
Sep 15 09:20:44.146535 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:44.146493    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c652699d-a5a8-409b-9c23-d516b9d770c4-bundle" (OuterVolumeSpecName: "bundle") pod "c652699d-a5a8-409b-9c23-d516b9d770c4" (UID: "c652699d-a5a8-409b-9c23-d516b9d770c4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:20:44.148295 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:44.148268    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c652699d-a5a8-409b-9c23-d516b9d770c4-kube-api-access-tfmw5" (OuterVolumeSpecName: "kube-api-access-tfmw5") pod "c652699d-a5a8-409b-9c23-d516b9d770c4" (UID: "c652699d-a5a8-409b-9c23-d516b9d770c4"). InnerVolumeSpecName "kube-api-access-tfmw5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:20:44.151526 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:44.151502    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c652699d-a5a8-409b-9c23-d516b9d770c4-util" (OuterVolumeSpecName: "util") pod "c652699d-a5a8-409b-9c23-d516b9d770c4" (UID: "c652699d-a5a8-409b-9c23-d516b9d770c4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:20:44.246588 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:44.246553    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c652699d-a5a8-409b-9c23-d516b9d770c4-util\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:20:44.246588 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:44.246577    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c652699d-a5a8-409b-9c23-d516b9d770c4-bundle\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:20:44.246588 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:44.246585    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tfmw5\" (UniqueName: \"kubernetes.io/projected/c652699d-a5a8-409b-9c23-d516b9d770c4-kube-api-access-tfmw5\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:20:44.833913 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:44.833874    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06jzmf" event={"ID":"c652699d-a5a8-409b-9c23-d516b9d770c4","Type":"ContainerDied","Data":"6d7cf9dee91232ebc0a406873e788f35de9131f82c88914d8a3330b5610d01c2"}
Sep 15 09:20:44.834094 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:44.833892    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b06jzmf"
Sep 15 09:20:44.834094 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:44.833971    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6d7cf9dee91232ebc0a406873e788f35de9131f82c88914d8a3330b5610d01c2"
Sep 15 09:20:45.000393 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:45.000366    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7445bbdc5b-mzrk4"]
Sep 15 09:20:45.000807 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:45.000789    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c652699d-a5a8-409b-9c23-d516b9d770c4" containerName="util"
Sep 15 09:20:45.000849 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:45.000813    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c652699d-a5a8-409b-9c23-d516b9d770c4" containerName="util"
Sep 15 09:20:45.000849 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:45.000831    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c652699d-a5a8-409b-9c23-d516b9d770c4" containerName="pull"
Sep 15 09:20:45.000849 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:45.000839    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c652699d-a5a8-409b-9c23-d516b9d770c4" containerName="pull"
Sep 15 09:20:45.000942 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:45.000848    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c652699d-a5a8-409b-9c23-d516b9d770c4" containerName="extract"
Sep 15 09:20:45.000942 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:45.000856    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c652699d-a5a8-409b-9c23-d516b9d770c4" containerName="extract"
Sep 15 09:20:45.000942 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:45.000926    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c652699d-a5a8-409b-9c23-d516b9d770c4" containerName="extract"
Sep 15 09:20:45.005241 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:45.005223    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7445bbdc5b-mzrk4"
Sep 15 09:20:45.014051 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:45.014032    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7445bbdc5b-mzrk4"]
Sep 15 09:20:45.055302 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:45.055278    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/20173696-7b4b-4743-a55f-024bc73a8a30-console-config\") pod \"console-7445bbdc5b-mzrk4\" (UID: \"20173696-7b4b-4743-a55f-024bc73a8a30\") " pod="openshift-console/console-7445bbdc5b-mzrk4"
Sep 15 09:20:45.055653 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:45.055328    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/20173696-7b4b-4743-a55f-024bc73a8a30-console-serving-cert\") pod \"console-7445bbdc5b-mzrk4\" (UID: \"20173696-7b4b-4743-a55f-024bc73a8a30\") " pod="openshift-console/console-7445bbdc5b-mzrk4"
Sep 15 09:20:45.055653 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:45.055357    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20173696-7b4b-4743-a55f-024bc73a8a30-trusted-ca-bundle\") pod \"console-7445bbdc5b-mzrk4\" (UID: \"20173696-7b4b-4743-a55f-024bc73a8a30\") " pod="openshift-console/console-7445bbdc5b-mzrk4"
Sep 15 09:20:45.055653 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:45.055444    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/20173696-7b4b-4743-a55f-024bc73a8a30-oauth-serving-cert\") pod \"console-7445bbdc5b-mzrk4\" (UID: \"20173696-7b4b-4743-a55f-024bc73a8a30\") " pod="openshift-console/console-7445bbdc5b-mzrk4"
Sep 15 09:20:45.055653 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:45.055531    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/20173696-7b4b-4743-a55f-024bc73a8a30-console-oauth-config\") pod \"console-7445bbdc5b-mzrk4\" (UID: \"20173696-7b4b-4743-a55f-024bc73a8a30\") " pod="openshift-console/console-7445bbdc5b-mzrk4"
Sep 15 09:20:45.055653 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:45.055568    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/20173696-7b4b-4743-a55f-024bc73a8a30-service-ca\") pod \"console-7445bbdc5b-mzrk4\" (UID: \"20173696-7b4b-4743-a55f-024bc73a8a30\") " pod="openshift-console/console-7445bbdc5b-mzrk4"
Sep 15 09:20:45.055653 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:45.055594    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c87tk\" (UniqueName: \"kubernetes.io/projected/20173696-7b4b-4743-a55f-024bc73a8a30-kube-api-access-c87tk\") pod \"console-7445bbdc5b-mzrk4\" (UID: \"20173696-7b4b-4743-a55f-024bc73a8a30\") " pod="openshift-console/console-7445bbdc5b-mzrk4"
Sep 15 09:20:45.156073 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:45.156004    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/20173696-7b4b-4743-a55f-024bc73a8a30-console-config\") pod \"console-7445bbdc5b-mzrk4\" (UID: \"20173696-7b4b-4743-a55f-024bc73a8a30\") " pod="openshift-console/console-7445bbdc5b-mzrk4"
Sep 15 09:20:45.156188 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:45.156088    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/20173696-7b4b-4743-a55f-024bc73a8a30-console-serving-cert\") pod \"console-7445bbdc5b-mzrk4\" (UID: \"20173696-7b4b-4743-a55f-024bc73a8a30\") " pod="openshift-console/console-7445bbdc5b-mzrk4"
Sep 15 09:20:45.156188 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:45.156117    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20173696-7b4b-4743-a55f-024bc73a8a30-trusted-ca-bundle\") pod \"console-7445bbdc5b-mzrk4\" (UID: \"20173696-7b4b-4743-a55f-024bc73a8a30\") " pod="openshift-console/console-7445bbdc5b-mzrk4"
Sep 15 09:20:45.156188 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:45.156144    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/20173696-7b4b-4743-a55f-024bc73a8a30-oauth-serving-cert\") pod \"console-7445bbdc5b-mzrk4\" (UID: \"20173696-7b4b-4743-a55f-024bc73a8a30\") " pod="openshift-console/console-7445bbdc5b-mzrk4"
Sep 15 09:20:45.156357 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:45.156187    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/20173696-7b4b-4743-a55f-024bc73a8a30-console-oauth-config\") pod \"console-7445bbdc5b-mzrk4\" (UID: \"20173696-7b4b-4743-a55f-024bc73a8a30\") " pod="openshift-console/console-7445bbdc5b-mzrk4"
Sep 15 09:20:45.156357 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:45.156214    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/20173696-7b4b-4743-a55f-024bc73a8a30-service-ca\") pod \"console-7445bbdc5b-mzrk4\" (UID: \"20173696-7b4b-4743-a55f-024bc73a8a30\") " pod="openshift-console/console-7445bbdc5b-mzrk4"
Sep 15 09:20:45.156357 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:45.156236    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c87tk\" (UniqueName: \"kubernetes.io/projected/20173696-7b4b-4743-a55f-024bc73a8a30-kube-api-access-c87tk\") pod \"console-7445bbdc5b-mzrk4\" (UID: \"20173696-7b4b-4743-a55f-024bc73a8a30\") " pod="openshift-console/console-7445bbdc5b-mzrk4"
Sep 15 09:20:45.156751 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:45.156729    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/20173696-7b4b-4743-a55f-024bc73a8a30-console-config\") pod \"console-7445bbdc5b-mzrk4\" (UID: \"20173696-7b4b-4743-a55f-024bc73a8a30\") " pod="openshift-console/console-7445bbdc5b-mzrk4"
Sep 15 09:20:45.157079 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:45.157056    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/20173696-7b4b-4743-a55f-024bc73a8a30-oauth-serving-cert\") pod \"console-7445bbdc5b-mzrk4\" (UID: \"20173696-7b4b-4743-a55f-024bc73a8a30\") " pod="openshift-console/console-7445bbdc5b-mzrk4"
Sep 15 09:20:45.157279 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:45.157236    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/20173696-7b4b-4743-a55f-024bc73a8a30-service-ca\") pod \"console-7445bbdc5b-mzrk4\" (UID: \"20173696-7b4b-4743-a55f-024bc73a8a30\") " pod="openshift-console/console-7445bbdc5b-mzrk4"
Sep 15 09:20:45.157279 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:45.157247    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20173696-7b4b-4743-a55f-024bc73a8a30-trusted-ca-bundle\") pod \"console-7445bbdc5b-mzrk4\" (UID: \"20173696-7b4b-4743-a55f-024bc73a8a30\") " pod="openshift-console/console-7445bbdc5b-mzrk4"
Sep 15 09:20:45.159149 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:45.159124    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/20173696-7b4b-4743-a55f-024bc73a8a30-console-oauth-config\") pod \"console-7445bbdc5b-mzrk4\" (UID: \"20173696-7b4b-4743-a55f-024bc73a8a30\") " pod="openshift-console/console-7445bbdc5b-mzrk4"
Sep 15 09:20:45.159250 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:45.159185    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/20173696-7b4b-4743-a55f-024bc73a8a30-console-serving-cert\") pod \"console-7445bbdc5b-mzrk4\" (UID: \"20173696-7b4b-4743-a55f-024bc73a8a30\") " pod="openshift-console/console-7445bbdc5b-mzrk4"
Sep 15 09:20:45.166421 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:45.166398    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c87tk\" (UniqueName: \"kubernetes.io/projected/20173696-7b4b-4743-a55f-024bc73a8a30-kube-api-access-c87tk\") pod \"console-7445bbdc5b-mzrk4\" (UID: \"20173696-7b4b-4743-a55f-024bc73a8a30\") " pod="openshift-console/console-7445bbdc5b-mzrk4"
Sep 15 09:20:45.313747 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:45.313720    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7445bbdc5b-mzrk4"
Sep 15 09:20:45.623903 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:45.623877    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7445bbdc5b-mzrk4"]
Sep 15 09:20:45.809813 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:20:45.809780    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20173696_7b4b_4743_a55f_024bc73a8a30.slice/crio-488126d6b5f9eba34f5e7b252c6c6ca116408562b8dc85501b2d676c50865171 WatchSource:0}: Error finding container 488126d6b5f9eba34f5e7b252c6c6ca116408562b8dc85501b2d676c50865171: Status 404 returned error can't find the container with id 488126d6b5f9eba34f5e7b252c6c6ca116408562b8dc85501b2d676c50865171
Sep 15 09:20:45.840379 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:45.840349    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-767c4c8b76-jmwcb" event={"ID":"ced6aa23-9676-4cc4-a15a-1d18d5aeedf1","Type":"ContainerStarted","Data":"eb42fe42bd668fbe4682b282a16752e41e83b2525bfc93132ee622bb6c187560"}
Sep 15 09:20:45.841567 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:45.841546    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7445bbdc5b-mzrk4" event={"ID":"20173696-7b4b-4743-a55f-024bc73a8a30","Type":"ContainerStarted","Data":"488126d6b5f9eba34f5e7b252c6c6ca116408562b8dc85501b2d676c50865171"}
Sep 15 09:20:46.847858 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:46.847822    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6f69b6c8dc-jbrrx" event={"ID":"c3409cbc-028e-4c4a-8bb6-4b058b3972af","Type":"ContainerStarted","Data":"a36116f83552e535f1b9473c029788c2180721c0ae673cb101809256f929b9eb"}
Sep 15 09:20:46.848330 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:46.847940    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6f69b6c8dc-jbrrx"
Sep 15 09:20:46.849773 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:46.849749    2578 generic.go:356] "Generic (PLEG): container finished" podID="ced6aa23-9676-4cc4-a15a-1d18d5aeedf1" containerID="eb42fe42bd668fbe4682b282a16752e41e83b2525bfc93132ee622bb6c187560" exitCode=0
Sep 15 09:20:46.849911 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:46.849829    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-767c4c8b76-jmwcb" event={"ID":"ced6aa23-9676-4cc4-a15a-1d18d5aeedf1","Type":"ContainerDied","Data":"eb42fe42bd668fbe4682b282a16752e41e83b2525bfc93132ee622bb6c187560"}
Sep 15 09:20:46.851881 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:46.851852    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7445bbdc5b-mzrk4" event={"ID":"20173696-7b4b-4743-a55f-024bc73a8a30","Type":"ContainerStarted","Data":"b0e9995b7c2df78159305546282ac49b58fb7173408660c10c57f4a4639b0fe6"}
Sep 15 09:20:46.870971 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:46.868344    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6f69b6c8dc-jbrrx" podStartSLOduration=2.591593805 podStartE2EDuration="8.868316406s" totalImagesPullingTime="6.276722601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:20:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:20:46.865712014 +0000 UTC m=+391.204157289" watchObservedRunningTime="2026-09-15 09:20:46.868316406 +0000 UTC m=+391.206761681"
Sep 15 09:20:46.901657 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:46.901620    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7445bbdc5b-mzrk4" podStartSLOduration=2.901608354 podStartE2EDuration="2.901608354s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:20:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:20:46.901050623 +0000 UTC m=+391.239495890" watchObservedRunningTime="2026-09-15 09:20:46.901608354 +0000 UTC m=+391.240053629"
Sep 15 09:20:47.859251 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:47.859213    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-767c4c8b76-jmwcb" event={"ID":"ced6aa23-9676-4cc4-a15a-1d18d5aeedf1","Type":"ContainerStarted","Data":"998614e647c206d8d46d494fdc0322b4dcfa24c04cc88c15a985d229b037c8de"}
Sep 15 09:20:47.859656 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:47.859396    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-767c4c8b76-jmwcb"
Sep 15 09:20:47.884204 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:47.884157    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-767c4c8b76-jmwcb" podStartSLOduration=2.2192014589999998 podStartE2EDuration="6.884141955s" totalImagesPullingTime="3.466629721s" totalInitContainerRuntime="1.198310775s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:20:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:20:47.882406238 +0000 UTC m=+392.220851513" watchObservedRunningTime="2026-09-15 09:20:47.884141955 +0000 UTC m=+392.222587230"
Sep 15 09:20:55.314221 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:55.314185    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7445bbdc5b-mzrk4"
Sep 15 09:20:55.314666 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:55.314245    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7445bbdc5b-mzrk4"
Sep 15 09:20:55.318838 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:55.318809    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7445bbdc5b-mzrk4"
Sep 15 09:20:55.900101 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:55.900065    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7445bbdc5b-mzrk4"
Sep 15 09:20:55.947638 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:55.947599    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75d8658568-mqcfm"]
Sep 15 09:20:57.861383 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:57.861346    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6f69b6c8dc-jbrrx"
Sep 15 09:20:58.866087 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:20:58.866061    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-767c4c8b76-jmwcb"
Sep 15 09:21:07.852429 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:07.852389    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c795f6"]
Sep 15 09:21:07.861348 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:07.861326    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c795f6"
Sep 15 09:21:07.863895 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:07.863869    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 15 09:21:07.863895 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:07.863889    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 15 09:21:07.864104 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:07.863928    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 15 09:21:07.864664 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:07.864639    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-58fxr\""
Sep 15 09:21:07.865733 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:07.865709    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c795f6"]
Sep 15 09:21:07.930074 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:07.930053    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d1fbe79-bd03-4730-8b84-2b8e7bb949fc-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c795f6\" (UID: \"5d1fbe79-bd03-4730-8b84-2b8e7bb949fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c795f6"
Sep 15 09:21:07.930181 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:07.930088    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d1fbe79-bd03-4730-8b84-2b8e7bb949fc-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c795f6\" (UID: \"5d1fbe79-bd03-4730-8b84-2b8e7bb949fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c795f6"
Sep 15 09:21:07.930181 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:07.930122    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d1fbe79-bd03-4730-8b84-2b8e7bb949fc-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c795f6\" (UID: \"5d1fbe79-bd03-4730-8b84-2b8e7bb949fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c795f6"
Sep 15 09:21:07.930181 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:07.930149    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d1fbe79-bd03-4730-8b84-2b8e7bb949fc-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c795f6\" (UID: \"5d1fbe79-bd03-4730-8b84-2b8e7bb949fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c795f6"
Sep 15 09:21:07.930181 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:07.930175    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wrd4\" (UniqueName: \"kubernetes.io/projected/5d1fbe79-bd03-4730-8b84-2b8e7bb949fc-kube-api-access-2wrd4\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c795f6\" (UID: \"5d1fbe79-bd03-4730-8b84-2b8e7bb949fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c795f6"
Sep 15 09:21:07.930339 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:07.930274    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d1fbe79-bd03-4730-8b84-2b8e7bb949fc-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c795f6\" (UID: \"5d1fbe79-bd03-4730-8b84-2b8e7bb949fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c795f6"
Sep 15 09:21:07.930381 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:07.930335    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d1fbe79-bd03-4730-8b84-2b8e7bb949fc-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c795f6\" (UID: \"5d1fbe79-bd03-4730-8b84-2b8e7bb949fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c795f6"
Sep 15 09:21:07.930381 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:07.930368    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d1fbe79-bd03-4730-8b84-2b8e7bb949fc-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c795f6\" (UID: \"5d1fbe79-bd03-4730-8b84-2b8e7bb949fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c795f6"
Sep 15 09:21:07.930450 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:07.930390    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d1fbe79-bd03-4730-8b84-2b8e7bb949fc-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c795f6\" (UID: \"5d1fbe79-bd03-4730-8b84-2b8e7bb949fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c795f6"
Sep 15 09:21:08.031293 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:08.031271    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d1fbe79-bd03-4730-8b84-2b8e7bb949fc-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c795f6\" (UID: \"5d1fbe79-bd03-4730-8b84-2b8e7bb949fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c795f6"
Sep 15 09:21:08.031387 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:08.031314    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d1fbe79-bd03-4730-8b84-2b8e7bb949fc-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c795f6\" (UID: \"5d1fbe79-bd03-4730-8b84-2b8e7bb949fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c795f6"
Sep 15 09:21:08.031438 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:08.031423    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d1fbe79-bd03-4730-8b84-2b8e7bb949fc-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c795f6\" (UID: \"5d1fbe79-bd03-4730-8b84-2b8e7bb949fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c795f6"
Sep 15 09:21:08.031484 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:08.031452    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d1fbe79-bd03-4730-8b84-2b8e7bb949fc-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c795f6\" (UID: \"5d1fbe79-bd03-4730-8b84-2b8e7bb949fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c795f6"
Sep 15 09:21:08.031484 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:08.031476    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d1fbe79-bd03-4730-8b84-2b8e7bb949fc-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c795f6\" (UID: \"5d1fbe79-bd03-4730-8b84-2b8e7bb949fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c795f6"
Sep 15 09:21:08.031583 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:08.031497    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d1fbe79-bd03-4730-8b84-2b8e7bb949fc-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c795f6\" (UID: \"5d1fbe79-bd03-4730-8b84-2b8e7bb949fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c795f6"
Sep 15 09:21:08.031583 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:08.031520    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d1fbe79-bd03-4730-8b84-2b8e7bb949fc-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c795f6\" (UID: \"5d1fbe79-bd03-4730-8b84-2b8e7bb949fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c795f6"
Sep 15 09:21:08.031583 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:08.031545    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d1fbe79-bd03-4730-8b84-2b8e7bb949fc-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c795f6\" (UID: \"5d1fbe79-bd03-4730-8b84-2b8e7bb949fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c795f6"
Sep 15 09:21:08.031716 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:08.031630    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d1fbe79-bd03-4730-8b84-2b8e7bb949fc-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c795f6\" (UID: \"5d1fbe79-bd03-4730-8b84-2b8e7bb949fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c795f6"
Sep 15 09:21:08.031716 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:08.031695    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wrd4\" (UniqueName: \"kubernetes.io/projected/5d1fbe79-bd03-4730-8b84-2b8e7bb949fc-kube-api-access-2wrd4\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c795f6\" (UID: \"5d1fbe79-bd03-4730-8b84-2b8e7bb949fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c795f6"
Sep 15 09:21:08.031816 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:08.031771    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d1fbe79-bd03-4730-8b84-2b8e7bb949fc-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c795f6\" (UID: \"5d1fbe79-bd03-4730-8b84-2b8e7bb949fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c795f6"
Sep 15 09:21:08.032040 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:08.032016    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d1fbe79-bd03-4730-8b84-2b8e7bb949fc-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c795f6\" (UID: \"5d1fbe79-bd03-4730-8b84-2b8e7bb949fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c795f6"
Sep 15 09:21:08.032131 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:08.032038    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d1fbe79-bd03-4730-8b84-2b8e7bb949fc-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c795f6\" (UID: \"5d1fbe79-bd03-4730-8b84-2b8e7bb949fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c795f6"
Sep 15 09:21:08.032182 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:08.032138    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d1fbe79-bd03-4730-8b84-2b8e7bb949fc-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c795f6\" (UID: \"5d1fbe79-bd03-4730-8b84-2b8e7bb949fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c795f6"
Sep 15 09:21:08.033705 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:08.033685    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d1fbe79-bd03-4730-8b84-2b8e7bb949fc-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c795f6\" (UID: \"5d1fbe79-bd03-4730-8b84-2b8e7bb949fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c795f6"
Sep 15 09:21:08.034010 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:08.033992    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d1fbe79-bd03-4730-8b84-2b8e7bb949fc-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c795f6\" (UID: \"5d1fbe79-bd03-4730-8b84-2b8e7bb949fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c795f6"
Sep 15 09:21:08.039620 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:08.039593    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d1fbe79-bd03-4730-8b84-2b8e7bb949fc-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c795f6\" (UID: \"5d1fbe79-bd03-4730-8b84-2b8e7bb949fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c795f6"
Sep 15 09:21:08.039620 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:08.039600    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wrd4\" (UniqueName: \"kubernetes.io/projected/5d1fbe79-bd03-4730-8b84-2b8e7bb949fc-kube-api-access-2wrd4\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c795f6\" (UID: \"5d1fbe79-bd03-4730-8b84-2b8e7bb949fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c795f6"
Sep 15 09:21:08.174084 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:08.174035    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c795f6"
Sep 15 09:21:08.454327 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:08.454302    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c795f6"]
Sep 15 09:21:08.455705 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:21:08.455676    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d1fbe79_bd03_4730_8b84_2b8e7bb949fc.slice/crio-47914bc1b91f8900dbb6053f22e9fbb901303c302e45c45a012d2ac25577dd4b WatchSource:0}: Error finding container 47914bc1b91f8900dbb6053f22e9fbb901303c302e45c45a012d2ac25577dd4b: Status 404 returned error can't find the container with id 47914bc1b91f8900dbb6053f22e9fbb901303c302e45c45a012d2ac25577dd4b
Sep 15 09:21:08.960166 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:08.960135    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c795f6" event={"ID":"5d1fbe79-bd03-4730-8b84-2b8e7bb949fc","Type":"ContainerStarted","Data":"47914bc1b91f8900dbb6053f22e9fbb901303c302e45c45a012d2ac25577dd4b"}
Sep 15 09:21:11.208233 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:11.208194    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:21:11.208499 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:11.208277    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:21:11.208499 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:11.208311    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:21:11.439770 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:11.439739    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-t4dnj"]
Sep 15 09:21:11.443068 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:11.443046    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-t4dnj"
Sep 15 09:21:11.446094 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:11.446076    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-5psjv\""
Sep 15 09:21:11.446210 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:11.446166    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 15 09:21:11.454278 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:11.454255    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-t4dnj"]
Sep 15 09:21:11.563971 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:11.563881    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d3d9b371-4a0b-4729-8f9e-eddf8e262286-cert\") pod \"odh-model-controller-7998c67dc4-t4dnj\" (UID: \"d3d9b371-4a0b-4729-8f9e-eddf8e262286\") " pod="opendatahub/odh-model-controller-7998c67dc4-t4dnj"
Sep 15 09:21:11.563971 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:11.563920    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khgds\" (UniqueName: \"kubernetes.io/projected/d3d9b371-4a0b-4729-8f9e-eddf8e262286-kube-api-access-khgds\") pod \"odh-model-controller-7998c67dc4-t4dnj\" (UID: \"d3d9b371-4a0b-4729-8f9e-eddf8e262286\") " pod="opendatahub/odh-model-controller-7998c67dc4-t4dnj"
Sep 15 09:21:11.664852 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:11.664824    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d3d9b371-4a0b-4729-8f9e-eddf8e262286-cert\") pod \"odh-model-controller-7998c67dc4-t4dnj\" (UID: \"d3d9b371-4a0b-4729-8f9e-eddf8e262286\") " pod="opendatahub/odh-model-controller-7998c67dc4-t4dnj"
Sep 15 09:21:11.665013 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:11.664858    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khgds\" (UniqueName: \"kubernetes.io/projected/d3d9b371-4a0b-4729-8f9e-eddf8e262286-kube-api-access-khgds\") pod \"odh-model-controller-7998c67dc4-t4dnj\" (UID: \"d3d9b371-4a0b-4729-8f9e-eddf8e262286\") " pod="opendatahub/odh-model-controller-7998c67dc4-t4dnj"
Sep 15 09:21:11.665013 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:21:11.664981    2578 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 15 09:21:11.665123 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:21:11.665050    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3d9b371-4a0b-4729-8f9e-eddf8e262286-cert podName:d3d9b371-4a0b-4729-8f9e-eddf8e262286 nodeName:}" failed. No retries permitted until 2026-09-15 09:21:12.165031155 +0000 UTC m=+416.503476424 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d3d9b371-4a0b-4729-8f9e-eddf8e262286-cert") pod "odh-model-controller-7998c67dc4-t4dnj" (UID: "d3d9b371-4a0b-4729-8f9e-eddf8e262286") : secret "odh-model-controller-webhook-cert" not found
Sep 15 09:21:11.673381 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:11.673356    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khgds\" (UniqueName: \"kubernetes.io/projected/d3d9b371-4a0b-4729-8f9e-eddf8e262286-kube-api-access-khgds\") pod \"odh-model-controller-7998c67dc4-t4dnj\" (UID: \"d3d9b371-4a0b-4729-8f9e-eddf8e262286\") " pod="opendatahub/odh-model-controller-7998c67dc4-t4dnj"
Sep 15 09:21:11.868167 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:11.868099    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-qlv9b"]
Sep 15 09:21:11.871338 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:11.871322    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-qlv9b"
Sep 15 09:21:11.873629 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:11.873600    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 15 09:21:11.873747 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:11.873691    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-hg2mr\""
Sep 15 09:21:11.881939 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:11.881920    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-qlv9b"]
Sep 15 09:21:11.967353 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:11.967328    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pdxf\" (UniqueName: \"kubernetes.io/projected/e0a9edc3-3b09-43d0-a303-b989fa3d4656-kube-api-access-8pdxf\") pod \"model-serving-api-54d89bd5fc-qlv9b\" (UID: \"e0a9edc3-3b09-43d0-a303-b989fa3d4656\") " pod="opendatahub/model-serving-api-54d89bd5fc-qlv9b"
Sep 15 09:21:11.967467 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:11.967412    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e0a9edc3-3b09-43d0-a303-b989fa3d4656-tls-certs\") pod \"model-serving-api-54d89bd5fc-qlv9b\" (UID: \"e0a9edc3-3b09-43d0-a303-b989fa3d4656\") " pod="opendatahub/model-serving-api-54d89bd5fc-qlv9b"
Sep 15 09:21:11.977722 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:11.977698    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c795f6" event={"ID":"5d1fbe79-bd03-4730-8b84-2b8e7bb949fc","Type":"ContainerStarted","Data":"27da84e5b4c72a868901ea54d6fbdf0e66bfb601ef6a80007a09c86e2cef2131"}
Sep 15 09:21:11.995213 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:11.995165    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c795f6" podStartSLOduration=2.245031199 podStartE2EDuration="4.995148701s" totalImagesPullingTime="2.750117502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:21:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:21:11.994582068 +0000 UTC m=+416.333027342" watchObservedRunningTime="2026-09-15 09:21:11.995148701 +0000 UTC m=+416.333593977"
Sep 15 09:21:12.067915 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:12.067894    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e0a9edc3-3b09-43d0-a303-b989fa3d4656-tls-certs\") pod \"model-serving-api-54d89bd5fc-qlv9b\" (UID: \"e0a9edc3-3b09-43d0-a303-b989fa3d4656\") " pod="opendatahub/model-serving-api-54d89bd5fc-qlv9b"
Sep 15 09:21:12.068048 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:21:12.068029    2578 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Sep 15 09:21:12.068115 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:21:12.068096    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0a9edc3-3b09-43d0-a303-b989fa3d4656-tls-certs podName:e0a9edc3-3b09-43d0-a303-b989fa3d4656 nodeName:}" failed. No retries permitted until 2026-09-15 09:21:12.568072886 +0000 UTC m=+416.906518139 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/e0a9edc3-3b09-43d0-a303-b989fa3d4656-tls-certs") pod "model-serving-api-54d89bd5fc-qlv9b" (UID: "e0a9edc3-3b09-43d0-a303-b989fa3d4656") : secret "model-serving-api-tls" not found
Sep 15 09:21:12.068178 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:12.068026    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pdxf\" (UniqueName: \"kubernetes.io/projected/e0a9edc3-3b09-43d0-a303-b989fa3d4656-kube-api-access-8pdxf\") pod \"model-serving-api-54d89bd5fc-qlv9b\" (UID: \"e0a9edc3-3b09-43d0-a303-b989fa3d4656\") " pod="opendatahub/model-serving-api-54d89bd5fc-qlv9b"
Sep 15 09:21:12.078446 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:12.078423    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pdxf\" (UniqueName: \"kubernetes.io/projected/e0a9edc3-3b09-43d0-a303-b989fa3d4656-kube-api-access-8pdxf\") pod \"model-serving-api-54d89bd5fc-qlv9b\" (UID: \"e0a9edc3-3b09-43d0-a303-b989fa3d4656\") " pod="opendatahub/model-serving-api-54d89bd5fc-qlv9b"
Sep 15 09:21:12.168987 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:12.168908    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d3d9b371-4a0b-4729-8f9e-eddf8e262286-cert\") pod \"odh-model-controller-7998c67dc4-t4dnj\" (UID: \"d3d9b371-4a0b-4729-8f9e-eddf8e262286\") " pod="opendatahub/odh-model-controller-7998c67dc4-t4dnj"
Sep 15 09:21:12.171040 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:12.171016    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d3d9b371-4a0b-4729-8f9e-eddf8e262286-cert\") pod \"odh-model-controller-7998c67dc4-t4dnj\" (UID: \"d3d9b371-4a0b-4729-8f9e-eddf8e262286\") " pod="opendatahub/odh-model-controller-7998c67dc4-t4dnj"
Sep 15 09:21:12.174961 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:12.174929    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c795f6"
Sep 15 09:21:12.180039 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:12.180019    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c795f6"
Sep 15 09:21:12.353357 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:12.353334    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-t4dnj"
Sep 15 09:21:12.572318 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:12.572286    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e0a9edc3-3b09-43d0-a303-b989fa3d4656-tls-certs\") pod \"model-serving-api-54d89bd5fc-qlv9b\" (UID: \"e0a9edc3-3b09-43d0-a303-b989fa3d4656\") " pod="opendatahub/model-serving-api-54d89bd5fc-qlv9b"
Sep 15 09:21:12.574519 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:12.574496    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e0a9edc3-3b09-43d0-a303-b989fa3d4656-tls-certs\") pod \"model-serving-api-54d89bd5fc-qlv9b\" (UID: \"e0a9edc3-3b09-43d0-a303-b989fa3d4656\") " pod="opendatahub/model-serving-api-54d89bd5fc-qlv9b"
Sep 15 09:21:12.622905 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:12.622887    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-t4dnj"]
Sep 15 09:21:12.624891 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:21:12.624866    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3d9b371_4a0b_4729_8f9e_eddf8e262286.slice/crio-fba5bd9ecf5263824f22d4168c5cf162d0dfbd10dcf7032b317dddd80364a356 WatchSource:0}: Error finding container fba5bd9ecf5263824f22d4168c5cf162d0dfbd10dcf7032b317dddd80364a356: Status 404 returned error can't find the container with id fba5bd9ecf5263824f22d4168c5cf162d0dfbd10dcf7032b317dddd80364a356
Sep 15 09:21:12.782419 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:12.782395    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-qlv9b"
Sep 15 09:21:12.983577 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:12.983548    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-t4dnj" event={"ID":"d3d9b371-4a0b-4729-8f9e-eddf8e262286","Type":"ContainerStarted","Data":"fba5bd9ecf5263824f22d4168c5cf162d0dfbd10dcf7032b317dddd80364a356"}
Sep 15 09:21:12.983895 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:12.983875    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c795f6"
Sep 15 09:21:12.984710 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:12.984693    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c795f6"
Sep 15 09:21:13.051554 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:13.051535    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-qlv9b"]
Sep 15 09:21:13.053719 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:21:13.053681    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0a9edc3_3b09_43d0_a303_b989fa3d4656.slice/crio-27e5f5ec477d5cacdd91c2ab0ab5180dbde0d717e6f8648668a369dbe9e1662f WatchSource:0}: Error finding container 27e5f5ec477d5cacdd91c2ab0ab5180dbde0d717e6f8648668a369dbe9e1662f: Status 404 returned error can't find the container with id 27e5f5ec477d5cacdd91c2ab0ab5180dbde0d717e6f8648668a369dbe9e1662f
Sep 15 09:21:13.993083 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:13.993045    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-qlv9b" event={"ID":"e0a9edc3-3b09-43d0-a303-b989fa3d4656","Type":"ContainerStarted","Data":"27e5f5ec477d5cacdd91c2ab0ab5180dbde0d717e6f8648668a369dbe9e1662f"}
Sep 15 09:21:17.008997 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:17.008960    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-qlv9b" event={"ID":"e0a9edc3-3b09-43d0-a303-b989fa3d4656","Type":"ContainerStarted","Data":"5ab5aefa24e99d0b85c49f2ca761715d5d7a8708c3a56412094f2911b3ea5025"}
Sep 15 09:21:17.009461 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:17.009030    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-qlv9b"
Sep 15 09:21:17.010481 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:17.010462    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-t4dnj" event={"ID":"d3d9b371-4a0b-4729-8f9e-eddf8e262286","Type":"ContainerStarted","Data":"da9ee419c170ebeff1a5b2b8a2812dcda5ddd7c1c2b45d17aa9317e3e26b998c"}
Sep 15 09:21:17.010614 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:17.010596    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-t4dnj"
Sep 15 09:21:17.029483 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:17.029405    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-qlv9b" podStartSLOduration=2.219306764 podStartE2EDuration="6.029388463s" totalImagesPullingTime="3.810081699s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:21:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:21:17.027362963 +0000 UTC m=+421.365808239" watchObservedRunningTime="2026-09-15 09:21:17.029388463 +0000 UTC m=+421.367833757"
Sep 15 09:21:17.046892 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:17.046846    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-t4dnj" podStartSLOduration=2.12336248 podStartE2EDuration="6.046832527s" totalImagesPullingTime="3.923470047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:21:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:21:17.045568612 +0000 UTC m=+421.384013887" watchObservedRunningTime="2026-09-15 09:21:17.046832527 +0000 UTC m=+421.385277802"
Sep 15 09:21:18.173307 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:18.173270    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfsfx"]
Sep 15 09:21:18.175714 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:18.175697    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfsfx"
Sep 15 09:21:18.178211 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:18.178189    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-qnrdb\""
Sep 15 09:21:18.178334 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:18.178224    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 15 09:21:18.178334 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:18.178247    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 15 09:21:18.178334 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:18.178224    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 15 09:21:18.187780 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:18.187757    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfsfx"]
Sep 15 09:21:18.323232 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:18.323199    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwlmg\" (UniqueName: \"kubernetes.io/projected/7d25c4bb-e3cb-4a38-a42c-242dc96a724e-kube-api-access-pwlmg\") pod \"istiod-openshift-gateway-5677ccb49b-rfsfx\" (UID: \"7d25c4bb-e3cb-4a38-a42c-242dc96a724e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfsfx"
Sep 15 09:21:18.323388 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:18.323241    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7d25c4bb-e3cb-4a38-a42c-242dc96a724e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-rfsfx\" (UID: \"7d25c4bb-e3cb-4a38-a42c-242dc96a724e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfsfx"
Sep 15 09:21:18.323388 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:18.323334    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d25c4bb-e3cb-4a38-a42c-242dc96a724e-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-rfsfx\" (UID: \"7d25c4bb-e3cb-4a38-a42c-242dc96a724e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfsfx"
Sep 15 09:21:18.323388 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:18.323363    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7d25c4bb-e3cb-4a38-a42c-242dc96a724e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-rfsfx\" (UID: \"7d25c4bb-e3cb-4a38-a42c-242dc96a724e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfsfx"
Sep 15 09:21:18.323500 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:18.323405    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7d25c4bb-e3cb-4a38-a42c-242dc96a724e-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-rfsfx\" (UID: \"7d25c4bb-e3cb-4a38-a42c-242dc96a724e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfsfx"
Sep 15 09:21:18.323500 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:18.323440    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d25c4bb-e3cb-4a38-a42c-242dc96a724e-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-rfsfx\" (UID: \"7d25c4bb-e3cb-4a38-a42c-242dc96a724e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfsfx"
Sep 15 09:21:18.323500 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:18.323458    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7d25c4bb-e3cb-4a38-a42c-242dc96a724e-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-rfsfx\" (UID: \"7d25c4bb-e3cb-4a38-a42c-242dc96a724e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfsfx"
Sep 15 09:21:18.423940 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:18.423878    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d25c4bb-e3cb-4a38-a42c-242dc96a724e-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-rfsfx\" (UID: \"7d25c4bb-e3cb-4a38-a42c-242dc96a724e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfsfx"
Sep 15 09:21:18.423940 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:18.423910    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7d25c4bb-e3cb-4a38-a42c-242dc96a724e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-rfsfx\" (UID: \"7d25c4bb-e3cb-4a38-a42c-242dc96a724e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfsfx"
Sep 15 09:21:18.424226 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:18.423971    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7d25c4bb-e3cb-4a38-a42c-242dc96a724e-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-rfsfx\" (UID: \"7d25c4bb-e3cb-4a38-a42c-242dc96a724e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfsfx"
Sep 15 09:21:18.424226 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:18.424012    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d25c4bb-e3cb-4a38-a42c-242dc96a724e-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-rfsfx\" (UID: \"7d25c4bb-e3cb-4a38-a42c-242dc96a724e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfsfx"
Sep 15 09:21:18.424226 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:18.424038    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7d25c4bb-e3cb-4a38-a42c-242dc96a724e-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-rfsfx\" (UID: \"7d25c4bb-e3cb-4a38-a42c-242dc96a724e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfsfx"
Sep 15 09:21:18.424226 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:18.424076    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwlmg\" (UniqueName: \"kubernetes.io/projected/7d25c4bb-e3cb-4a38-a42c-242dc96a724e-kube-api-access-pwlmg\") pod \"istiod-openshift-gateway-5677ccb49b-rfsfx\" (UID: \"7d25c4bb-e3cb-4a38-a42c-242dc96a724e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfsfx"
Sep 15 09:21:18.424226 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:18.424121    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7d25c4bb-e3cb-4a38-a42c-242dc96a724e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-rfsfx\" (UID: \"7d25c4bb-e3cb-4a38-a42c-242dc96a724e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfsfx"
Sep 15 09:21:18.424759 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:18.424735    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7d25c4bb-e3cb-4a38-a42c-242dc96a724e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-rfsfx\" (UID: \"7d25c4bb-e3cb-4a38-a42c-242dc96a724e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfsfx"
Sep 15 09:21:18.426319 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:18.426299    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d25c4bb-e3cb-4a38-a42c-242dc96a724e-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-rfsfx\" (UID: \"7d25c4bb-e3cb-4a38-a42c-242dc96a724e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfsfx"
Sep 15 09:21:18.426532 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:18.426513    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7d25c4bb-e3cb-4a38-a42c-242dc96a724e-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-rfsfx\" (UID: \"7d25c4bb-e3cb-4a38-a42c-242dc96a724e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfsfx"
Sep 15 09:21:18.426606 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:18.426513    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7d25c4bb-e3cb-4a38-a42c-242dc96a724e-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-rfsfx\" (UID: \"7d25c4bb-e3cb-4a38-a42c-242dc96a724e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfsfx"
Sep 15 09:21:18.426606 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:18.426591    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7d25c4bb-e3cb-4a38-a42c-242dc96a724e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-rfsfx\" (UID: \"7d25c4bb-e3cb-4a38-a42c-242dc96a724e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfsfx"
Sep 15 09:21:18.432234 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:18.432211    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwlmg\" (UniqueName: \"kubernetes.io/projected/7d25c4bb-e3cb-4a38-a42c-242dc96a724e-kube-api-access-pwlmg\") pod \"istiod-openshift-gateway-5677ccb49b-rfsfx\" (UID: \"7d25c4bb-e3cb-4a38-a42c-242dc96a724e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfsfx"
Sep 15 09:21:18.432430 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:18.432413    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d25c4bb-e3cb-4a38-a42c-242dc96a724e-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-rfsfx\" (UID: \"7d25c4bb-e3cb-4a38-a42c-242dc96a724e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfsfx"
Sep 15 09:21:18.485311 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:18.485287    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfsfx"
Sep 15 09:21:18.769914 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:18.769883    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfsfx"]
Sep 15 09:21:18.771734 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:21:18.771702    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d25c4bb_e3cb_4a38_a42c_242dc96a724e.slice/crio-e88441f1b96effdfe3b36249ce9f4884b0dadb43d45766181f70eecf546dd7a4 WatchSource:0}: Error finding container e88441f1b96effdfe3b36249ce9f4884b0dadb43d45766181f70eecf546dd7a4: Status 404 returned error can't find the container with id e88441f1b96effdfe3b36249ce9f4884b0dadb43d45766181f70eecf546dd7a4
Sep 15 09:21:19.022366 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:19.022290    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfsfx" event={"ID":"7d25c4bb-e3cb-4a38-a42c-242dc96a724e","Type":"ContainerStarted","Data":"e88441f1b96effdfe3b36249ce9f4884b0dadb43d45766181f70eecf546dd7a4"}
Sep 15 09:21:20.974387 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:20.974291    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-75d8658568-mqcfm" podUID="81e0e3f9-a4ee-4a1b-8876-f46d63013e32" containerName="console" containerID="cri-o://6c8b99d792b0d76531636dd24df9ca358e4fb951a937926c3aeadb72f1ba8529" gracePeriod=15
Sep 15 09:21:21.135497 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:21.135392    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:21:21.135497 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:21.135477    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:21:21.218448 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:21.218425    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75d8658568-mqcfm"
Sep 15 09:21:21.353480 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:21.353400    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81e0e3f9-a4ee-4a1b-8876-f46d63013e32-service-ca\") pod \"81e0e3f9-a4ee-4a1b-8876-f46d63013e32\" (UID: \"81e0e3f9-a4ee-4a1b-8876-f46d63013e32\") "
Sep 15 09:21:21.353480 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:21.353453    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81e0e3f9-a4ee-4a1b-8876-f46d63013e32-console-config\") pod \"81e0e3f9-a4ee-4a1b-8876-f46d63013e32\" (UID: \"81e0e3f9-a4ee-4a1b-8876-f46d63013e32\") "
Sep 15 09:21:21.353759 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:21.353487    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81e0e3f9-a4ee-4a1b-8876-f46d63013e32-console-oauth-config\") pod \"81e0e3f9-a4ee-4a1b-8876-f46d63013e32\" (UID: \"81e0e3f9-a4ee-4a1b-8876-f46d63013e32\") "
Sep 15 09:21:21.353759 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:21.353552    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81e0e3f9-a4ee-4a1b-8876-f46d63013e32-oauth-serving-cert\") pod \"81e0e3f9-a4ee-4a1b-8876-f46d63013e32\" (UID: \"81e0e3f9-a4ee-4a1b-8876-f46d63013e32\") "
Sep 15 09:21:21.353759 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:21.353595    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81e0e3f9-a4ee-4a1b-8876-f46d63013e32-console-serving-cert\") pod \"81e0e3f9-a4ee-4a1b-8876-f46d63013e32\" (UID: \"81e0e3f9-a4ee-4a1b-8876-f46d63013e32\") "
Sep 15 09:21:21.353759 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:21.353633    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bv5dq\" (UniqueName: \"kubernetes.io/projected/81e0e3f9-a4ee-4a1b-8876-f46d63013e32-kube-api-access-bv5dq\") pod \"81e0e3f9-a4ee-4a1b-8876-f46d63013e32\" (UID: \"81e0e3f9-a4ee-4a1b-8876-f46d63013e32\") "
Sep 15 09:21:21.353759 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:21.353690    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81e0e3f9-a4ee-4a1b-8876-f46d63013e32-trusted-ca-bundle\") pod \"81e0e3f9-a4ee-4a1b-8876-f46d63013e32\" (UID: \"81e0e3f9-a4ee-4a1b-8876-f46d63013e32\") "
Sep 15 09:21:21.354041 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:21.353777    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81e0e3f9-a4ee-4a1b-8876-f46d63013e32-service-ca" (OuterVolumeSpecName: "service-ca") pod "81e0e3f9-a4ee-4a1b-8876-f46d63013e32" (UID: "81e0e3f9-a4ee-4a1b-8876-f46d63013e32"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:21:21.354041 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:21.353885    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81e0e3f9-a4ee-4a1b-8876-f46d63013e32-console-config" (OuterVolumeSpecName: "console-config") pod "81e0e3f9-a4ee-4a1b-8876-f46d63013e32" (UID: "81e0e3f9-a4ee-4a1b-8876-f46d63013e32"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:21:21.354041 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:21.354033    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81e0e3f9-a4ee-4a1b-8876-f46d63013e32-service-ca\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:21:21.354162 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:21.354052    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81e0e3f9-a4ee-4a1b-8876-f46d63013e32-console-config\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:21:21.354162 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:21.354059    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81e0e3f9-a4ee-4a1b-8876-f46d63013e32-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "81e0e3f9-a4ee-4a1b-8876-f46d63013e32" (UID: "81e0e3f9-a4ee-4a1b-8876-f46d63013e32"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:21:21.354162 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:21.354139    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81e0e3f9-a4ee-4a1b-8876-f46d63013e32-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "81e0e3f9-a4ee-4a1b-8876-f46d63013e32" (UID: "81e0e3f9-a4ee-4a1b-8876-f46d63013e32"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:21:21.355765 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:21.355734    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81e0e3f9-a4ee-4a1b-8876-f46d63013e32-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "81e0e3f9-a4ee-4a1b-8876-f46d63013e32" (UID: "81e0e3f9-a4ee-4a1b-8876-f46d63013e32"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:21:21.355869 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:21.355772    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81e0e3f9-a4ee-4a1b-8876-f46d63013e32-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "81e0e3f9-a4ee-4a1b-8876-f46d63013e32" (UID: "81e0e3f9-a4ee-4a1b-8876-f46d63013e32"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:21:21.355869 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:21.355824    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81e0e3f9-a4ee-4a1b-8876-f46d63013e32-kube-api-access-bv5dq" (OuterVolumeSpecName: "kube-api-access-bv5dq") pod "81e0e3f9-a4ee-4a1b-8876-f46d63013e32" (UID: "81e0e3f9-a4ee-4a1b-8876-f46d63013e32"). InnerVolumeSpecName "kube-api-access-bv5dq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:21:21.455278 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:21.455242    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81e0e3f9-a4ee-4a1b-8876-f46d63013e32-oauth-serving-cert\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:21:21.455278 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:21.455280    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81e0e3f9-a4ee-4a1b-8876-f46d63013e32-console-serving-cert\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:21:21.455482 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:21.455295    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bv5dq\" (UniqueName: \"kubernetes.io/projected/81e0e3f9-a4ee-4a1b-8876-f46d63013e32-kube-api-access-bv5dq\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:21:21.455482 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:21.455311    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81e0e3f9-a4ee-4a1b-8876-f46d63013e32-trusted-ca-bundle\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:21:21.455482 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:21.455320    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81e0e3f9-a4ee-4a1b-8876-f46d63013e32-console-oauth-config\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:21:22.042424 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:22.042388    2578 generic.go:356] "Generic (PLEG): container finished" podID="81e0e3f9-a4ee-4a1b-8876-f46d63013e32" containerID="6c8b99d792b0d76531636dd24df9ca358e4fb951a937926c3aeadb72f1ba8529" exitCode=0
Sep 15 09:21:22.042870 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:22.042430    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75d8658568-mqcfm"
Sep 15 09:21:22.042870 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:22.042467    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75d8658568-mqcfm" event={"ID":"81e0e3f9-a4ee-4a1b-8876-f46d63013e32","Type":"ContainerDied","Data":"6c8b99d792b0d76531636dd24df9ca358e4fb951a937926c3aeadb72f1ba8529"}
Sep 15 09:21:22.042870 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:22.042516    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75d8658568-mqcfm" event={"ID":"81e0e3f9-a4ee-4a1b-8876-f46d63013e32","Type":"ContainerDied","Data":"d9d0b2b9f7eaa23c4de8e00ca6babd5bd62e60f5b2e4153a3b6aa8cc459d3faf"}
Sep 15 09:21:22.042870 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:22.042540    2578 scope.go:117] "RemoveContainer" containerID="6c8b99d792b0d76531636dd24df9ca358e4fb951a937926c3aeadb72f1ba8529"
Sep 15 09:21:22.044321 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:22.044299    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfsfx" event={"ID":"7d25c4bb-e3cb-4a38-a42c-242dc96a724e","Type":"ContainerStarted","Data":"9f973501bc91fdb45e0ea1048e2ba2452fc10dde6a723959c5704ed4c6d98bd4"}
Sep 15 09:21:22.044438 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:22.044421    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfsfx"
Sep 15 09:21:22.046421 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:22.046399    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfsfx"
Sep 15 09:21:22.051432 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:22.051419    2578 scope.go:117] "RemoveContainer" containerID="6c8b99d792b0d76531636dd24df9ca358e4fb951a937926c3aeadb72f1ba8529"
Sep 15 09:21:22.051722 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:21:22.051704    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c8b99d792b0d76531636dd24df9ca358e4fb951a937926c3aeadb72f1ba8529\": container with ID starting with 6c8b99d792b0d76531636dd24df9ca358e4fb951a937926c3aeadb72f1ba8529 not found: ID does not exist" containerID="6c8b99d792b0d76531636dd24df9ca358e4fb951a937926c3aeadb72f1ba8529"
Sep 15 09:21:22.051788 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:22.051729    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c8b99d792b0d76531636dd24df9ca358e4fb951a937926c3aeadb72f1ba8529"} err="failed to get container status \"6c8b99d792b0d76531636dd24df9ca358e4fb951a937926c3aeadb72f1ba8529\": rpc error: code = NotFound desc = could not find container \"6c8b99d792b0d76531636dd24df9ca358e4fb951a937926c3aeadb72f1ba8529\": container with ID starting with 6c8b99d792b0d76531636dd24df9ca358e4fb951a937926c3aeadb72f1ba8529 not found: ID does not exist"
Sep 15 09:21:22.076123 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:22.076076    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rfsfx" podStartSLOduration=1.714903928 podStartE2EDuration="4.076064654s" totalImagesPullingTime="2.361160726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:21:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:21:22.075858498 +0000 UTC m=+426.414303774" watchObservedRunningTime="2026-09-15 09:21:22.076064654 +0000 UTC m=+426.414509929"
Sep 15 09:21:22.092686 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:22.092666    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75d8658568-mqcfm"]
Sep 15 09:21:22.096835 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:22.096816    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-75d8658568-mqcfm"]
Sep 15 09:21:22.122441 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:22.122418    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81e0e3f9-a4ee-4a1b-8876-f46d63013e32" path="/var/lib/kubelet/pods/81e0e3f9-a4ee-4a1b-8876-f46d63013e32/volumes"
Sep 15 09:21:28.017471 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:28.017444    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-t4dnj"
Sep 15 09:21:28.019730 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:21:28.019713    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-qlv9b"
Sep 15 09:22:28.639897 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:28.639859    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tq2jz"]
Sep 15 09:22:28.640431 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:28.640187    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81e0e3f9-a4ee-4a1b-8876-f46d63013e32" containerName="console"
Sep 15 09:22:28.640431 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:28.640199    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="81e0e3f9-a4ee-4a1b-8876-f46d63013e32" containerName="console"
Sep 15 09:22:28.640431 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:28.640258    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="81e0e3f9-a4ee-4a1b-8876-f46d63013e32" containerName="console"
Sep 15 09:22:28.642906 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:28.642892    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tq2jz"
Sep 15 09:22:28.645385 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:28.645353    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 15 09:22:28.645519 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:28.645383    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 15 09:22:28.646399 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:28.646379    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7sfkk\""
Sep 15 09:22:28.651418 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:28.651398    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tq2jz"]
Sep 15 09:22:28.737466 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:28.737445    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amj9jp"]
Sep 15 09:22:28.739653 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:28.739640    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amj9jp"
Sep 15 09:22:28.747974 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:28.747933    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amj9jp"]
Sep 15 09:22:28.756083 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:28.756064    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2d7b740-94d7-4150-9dcf-e4dd1c79e93f-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tq2jz\" (UID: \"c2d7b740-94d7-4150-9dcf-e4dd1c79e93f\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tq2jz"
Sep 15 09:22:28.756202 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:28.756128    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bxvn\" (UniqueName: \"kubernetes.io/projected/c2d7b740-94d7-4150-9dcf-e4dd1c79e93f-kube-api-access-4bxvn\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tq2jz\" (UID: \"c2d7b740-94d7-4150-9dcf-e4dd1c79e93f\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tq2jz"
Sep 15 09:22:28.756268 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:28.756202    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2d7b740-94d7-4150-9dcf-e4dd1c79e93f-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tq2jz\" (UID: \"c2d7b740-94d7-4150-9dcf-e4dd1c79e93f\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tq2jz"
Sep 15 09:22:28.837819 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:28.837795    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx57wq"]
Sep 15 09:22:28.841525 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:28.841510    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx57wq"
Sep 15 09:22:28.849114 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:28.849094    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx57wq"]
Sep 15 09:22:28.856551 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:28.856527    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bxvn\" (UniqueName: \"kubernetes.io/projected/c2d7b740-94d7-4150-9dcf-e4dd1c79e93f-kube-api-access-4bxvn\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tq2jz\" (UID: \"c2d7b740-94d7-4150-9dcf-e4dd1c79e93f\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tq2jz"
Sep 15 09:22:28.856667 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:28.856580    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2d7b740-94d7-4150-9dcf-e4dd1c79e93f-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tq2jz\" (UID: \"c2d7b740-94d7-4150-9dcf-e4dd1c79e93f\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tq2jz"
Sep 15 09:22:28.856667 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:28.856639    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2d7b740-94d7-4150-9dcf-e4dd1c79e93f-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tq2jz\" (UID: \"c2d7b740-94d7-4150-9dcf-e4dd1c79e93f\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tq2jz"
Sep 15 09:22:28.856799 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:28.856675    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1006cbd6-b9ed-4425-a82c-f67de043fc7a-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amj9jp\" (UID: \"1006cbd6-b9ed-4425-a82c-f67de043fc7a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amj9jp"
Sep 15 09:22:28.856799 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:28.856704    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c7dh\" (UniqueName: \"kubernetes.io/projected/1006cbd6-b9ed-4425-a82c-f67de043fc7a-kube-api-access-9c7dh\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amj9jp\" (UID: \"1006cbd6-b9ed-4425-a82c-f67de043fc7a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amj9jp"
Sep 15 09:22:28.856799 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:28.856740    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1006cbd6-b9ed-4425-a82c-f67de043fc7a-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amj9jp\" (UID: \"1006cbd6-b9ed-4425-a82c-f67de043fc7a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amj9jp"
Sep 15 09:22:28.857152 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:28.857129    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2d7b740-94d7-4150-9dcf-e4dd1c79e93f-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tq2jz\" (UID: \"c2d7b740-94d7-4150-9dcf-e4dd1c79e93f\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tq2jz"
Sep 15 09:22:28.857238 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:28.857193    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2d7b740-94d7-4150-9dcf-e4dd1c79e93f-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tq2jz\" (UID: \"c2d7b740-94d7-4150-9dcf-e4dd1c79e93f\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tq2jz"
Sep 15 09:22:28.864056 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:28.864032    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bxvn\" (UniqueName: \"kubernetes.io/projected/c2d7b740-94d7-4150-9dcf-e4dd1c79e93f-kube-api-access-4bxvn\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tq2jz\" (UID: \"c2d7b740-94d7-4150-9dcf-e4dd1c79e93f\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tq2jz"
Sep 15 09:22:28.936291 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:28.936242    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7thmsf"]
Sep 15 09:22:28.938517 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:28.938502    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7thmsf"
Sep 15 09:22:28.947347 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:28.947327    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7thmsf"]
Sep 15 09:22:28.952275 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:28.952257    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tq2jz"
Sep 15 09:22:28.958056 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:28.958036    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef7ebc40-a2f2-4374-9f09-7fe287d70e11-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx57wq\" (UID: \"ef7ebc40-a2f2-4374-9f09-7fe287d70e11\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx57wq"
Sep 15 09:22:28.958148 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:28.958080    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1006cbd6-b9ed-4425-a82c-f67de043fc7a-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amj9jp\" (UID: \"1006cbd6-b9ed-4425-a82c-f67de043fc7a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amj9jp"
Sep 15 09:22:28.958148 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:28.958108    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9c7dh\" (UniqueName: \"kubernetes.io/projected/1006cbd6-b9ed-4425-a82c-f67de043fc7a-kube-api-access-9c7dh\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amj9jp\" (UID: \"1006cbd6-b9ed-4425-a82c-f67de043fc7a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amj9jp"
Sep 15 09:22:28.958235 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:28.958164    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1006cbd6-b9ed-4425-a82c-f67de043fc7a-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amj9jp\" (UID: \"1006cbd6-b9ed-4425-a82c-f67de043fc7a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amj9jp"
Sep 15 09:22:28.958235 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:28.958213    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2gqd\" (UniqueName: \"kubernetes.io/projected/ef7ebc40-a2f2-4374-9f09-7fe287d70e11-kube-api-access-d2gqd\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx57wq\" (UID: \"ef7ebc40-a2f2-4374-9f09-7fe287d70e11\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx57wq"
Sep 15 09:22:28.958338 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:28.958265    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef7ebc40-a2f2-4374-9f09-7fe287d70e11-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx57wq\" (UID: \"ef7ebc40-a2f2-4374-9f09-7fe287d70e11\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx57wq"
Sep 15 09:22:28.958426 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:28.958407    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1006cbd6-b9ed-4425-a82c-f67de043fc7a-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amj9jp\" (UID: \"1006cbd6-b9ed-4425-a82c-f67de043fc7a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amj9jp"
Sep 15 09:22:28.958520 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:28.958504    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1006cbd6-b9ed-4425-a82c-f67de043fc7a-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amj9jp\" (UID: \"1006cbd6-b9ed-4425-a82c-f67de043fc7a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amj9jp"
Sep 15 09:22:28.966392 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:28.966373    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c7dh\" (UniqueName: \"kubernetes.io/projected/1006cbd6-b9ed-4425-a82c-f67de043fc7a-kube-api-access-9c7dh\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amj9jp\" (UID: \"1006cbd6-b9ed-4425-a82c-f67de043fc7a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amj9jp"
Sep 15 09:22:29.048933 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:29.048908    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amj9jp"
Sep 15 09:22:29.058773 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:29.058747    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef7ebc40-a2f2-4374-9f09-7fe287d70e11-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx57wq\" (UID: \"ef7ebc40-a2f2-4374-9f09-7fe287d70e11\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx57wq"
Sep 15 09:22:29.058890 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:29.058813    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ebd19a24-f9c1-4552-ad2e-5da3e4b42e82-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7thmsf\" (UID: \"ebd19a24-f9c1-4552-ad2e-5da3e4b42e82\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7thmsf"
Sep 15 09:22:29.058890 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:29.058851    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2gqd\" (UniqueName: \"kubernetes.io/projected/ef7ebc40-a2f2-4374-9f09-7fe287d70e11-kube-api-access-d2gqd\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx57wq\" (UID: \"ef7ebc40-a2f2-4374-9f09-7fe287d70e11\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx57wq"
Sep 15 09:22:29.058890 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:29.058885    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqcwt\" (UniqueName: \"kubernetes.io/projected/ebd19a24-f9c1-4552-ad2e-5da3e4b42e82-kube-api-access-gqcwt\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7thmsf\" (UID: \"ebd19a24-f9c1-4552-ad2e-5da3e4b42e82\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7thmsf"
Sep 15 09:22:29.059061 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:29.058928    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef7ebc40-a2f2-4374-9f09-7fe287d70e11-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx57wq\" (UID: \"ef7ebc40-a2f2-4374-9f09-7fe287d70e11\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx57wq"
Sep 15 09:22:29.059061 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:29.058985    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ebd19a24-f9c1-4552-ad2e-5da3e4b42e82-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7thmsf\" (UID: \"ebd19a24-f9c1-4552-ad2e-5da3e4b42e82\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7thmsf"
Sep 15 09:22:29.059173 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:29.059144    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef7ebc40-a2f2-4374-9f09-7fe287d70e11-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx57wq\" (UID: \"ef7ebc40-a2f2-4374-9f09-7fe287d70e11\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx57wq"
Sep 15 09:22:29.059294 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:29.059256    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef7ebc40-a2f2-4374-9f09-7fe287d70e11-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx57wq\" (UID: \"ef7ebc40-a2f2-4374-9f09-7fe287d70e11\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx57wq"
Sep 15 09:22:29.067070 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:29.067052    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2gqd\" (UniqueName: \"kubernetes.io/projected/ef7ebc40-a2f2-4374-9f09-7fe287d70e11-kube-api-access-d2gqd\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx57wq\" (UID: \"ef7ebc40-a2f2-4374-9f09-7fe287d70e11\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx57wq"
Sep 15 09:22:29.150370 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:29.150341    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx57wq"
Sep 15 09:22:29.159771 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:29.159747    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqcwt\" (UniqueName: \"kubernetes.io/projected/ebd19a24-f9c1-4552-ad2e-5da3e4b42e82-kube-api-access-gqcwt\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7thmsf\" (UID: \"ebd19a24-f9c1-4552-ad2e-5da3e4b42e82\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7thmsf"
Sep 15 09:22:29.159881 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:29.159779    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ebd19a24-f9c1-4552-ad2e-5da3e4b42e82-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7thmsf\" (UID: \"ebd19a24-f9c1-4552-ad2e-5da3e4b42e82\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7thmsf"
Sep 15 09:22:29.159881 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:29.159845    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ebd19a24-f9c1-4552-ad2e-5da3e4b42e82-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7thmsf\" (UID: \"ebd19a24-f9c1-4552-ad2e-5da3e4b42e82\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7thmsf"
Sep 15 09:22:29.160261 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:29.160245    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ebd19a24-f9c1-4552-ad2e-5da3e4b42e82-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7thmsf\" (UID: \"ebd19a24-f9c1-4552-ad2e-5da3e4b42e82\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7thmsf"
Sep 15 09:22:29.160333 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:29.160309    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ebd19a24-f9c1-4552-ad2e-5da3e4b42e82-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7thmsf\" (UID: \"ebd19a24-f9c1-4552-ad2e-5da3e4b42e82\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7thmsf"
Sep 15 09:22:29.168332 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:29.168309    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqcwt\" (UniqueName: \"kubernetes.io/projected/ebd19a24-f9c1-4552-ad2e-5da3e4b42e82-kube-api-access-gqcwt\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7thmsf\" (UID: \"ebd19a24-f9c1-4552-ad2e-5da3e4b42e82\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7thmsf"
Sep 15 09:22:29.224801 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:29.224768    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tq2jz"]
Sep 15 09:22:29.227774 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:22:29.227747    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2d7b740_94d7_4150_9dcf_e4dd1c79e93f.slice/crio-0215bd6704d8cbf17971e8a92c0ddee17374deb3310411f0709619291c5be3fa WatchSource:0}: Error finding container 0215bd6704d8cbf17971e8a92c0ddee17374deb3310411f0709619291c5be3fa: Status 404 returned error can't find the container with id 0215bd6704d8cbf17971e8a92c0ddee17374deb3310411f0709619291c5be3fa
Sep 15 09:22:29.247759 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:29.247738    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7thmsf"
Sep 15 09:22:29.322409 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:29.322377    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amj9jp"]
Sep 15 09:22:29.325261 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:22:29.325234    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1006cbd6_b9ed_4425_a82c_f67de043fc7a.slice/crio-ca4e093caade3d0c79e65c9d28e4ef64e7bf5797df1289d6a446c6de7488fc63 WatchSource:0}: Error finding container ca4e093caade3d0c79e65c9d28e4ef64e7bf5797df1289d6a446c6de7488fc63: Status 404 returned error can't find the container with id ca4e093caade3d0c79e65c9d28e4ef64e7bf5797df1289d6a446c6de7488fc63
Sep 15 09:22:29.370651 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:29.370628    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amj9jp" event={"ID":"1006cbd6-b9ed-4425-a82c-f67de043fc7a","Type":"ContainerStarted","Data":"ca4e093caade3d0c79e65c9d28e4ef64e7bf5797df1289d6a446c6de7488fc63"}
Sep 15 09:22:29.372390 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:29.372364    2578 generic.go:356] "Generic (PLEG): container finished" podID="c2d7b740-94d7-4150-9dcf-e4dd1c79e93f" containerID="7b88bcfc351477d177d50b363fbb7e31d93f78cbc0ad22dc6cff88239ac5f662" exitCode=0
Sep 15 09:22:29.372493 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:29.372447    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tq2jz" event={"ID":"c2d7b740-94d7-4150-9dcf-e4dd1c79e93f","Type":"ContainerDied","Data":"7b88bcfc351477d177d50b363fbb7e31d93f78cbc0ad22dc6cff88239ac5f662"}
Sep 15 09:22:29.372560 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:29.372494    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tq2jz" event={"ID":"c2d7b740-94d7-4150-9dcf-e4dd1c79e93f","Type":"ContainerStarted","Data":"0215bd6704d8cbf17971e8a92c0ddee17374deb3310411f0709619291c5be3fa"}
Sep 15 09:22:29.416878 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:29.416850    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx57wq"]
Sep 15 09:22:29.417990 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:22:29.417959    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef7ebc40_a2f2_4374_9f09_7fe287d70e11.slice/crio-445be0ea34eeb13cf0938a677ba44f1e178fe4c654e98dce4c2f040f3e1368c6 WatchSource:0}: Error finding container 445be0ea34eeb13cf0938a677ba44f1e178fe4c654e98dce4c2f040f3e1368c6: Status 404 returned error can't find the container with id 445be0ea34eeb13cf0938a677ba44f1e178fe4c654e98dce4c2f040f3e1368c6
Sep 15 09:22:29.513833 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:29.513809    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7thmsf"]
Sep 15 09:22:29.515384 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:22:29.515359    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebd19a24_f9c1_4552_ad2e_5da3e4b42e82.slice/crio-c22a0a40efa52aa00864344c1e3c755371afb1f3defd2f3161a2fa61385b616f WatchSource:0}: Error finding container c22a0a40efa52aa00864344c1e3c755371afb1f3defd2f3161a2fa61385b616f: Status 404 returned error can't find the container with id c22a0a40efa52aa00864344c1e3c755371afb1f3defd2f3161a2fa61385b616f
Sep 15 09:22:30.379528 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:30.379489    2578 generic.go:356] "Generic (PLEG): container finished" podID="ebd19a24-f9c1-4552-ad2e-5da3e4b42e82" containerID="ff40e3baf83e151292bfadba2755ac74af96fea85e49df1cdcb81c0b8e0be250" exitCode=0
Sep 15 09:22:30.379932 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:30.379581    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7thmsf" event={"ID":"ebd19a24-f9c1-4552-ad2e-5da3e4b42e82","Type":"ContainerDied","Data":"ff40e3baf83e151292bfadba2755ac74af96fea85e49df1cdcb81c0b8e0be250"}
Sep 15 09:22:30.379932 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:30.379642    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7thmsf" event={"ID":"ebd19a24-f9c1-4552-ad2e-5da3e4b42e82","Type":"ContainerStarted","Data":"c22a0a40efa52aa00864344c1e3c755371afb1f3defd2f3161a2fa61385b616f"}
Sep 15 09:22:30.381625 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:30.381600    2578 generic.go:356] "Generic (PLEG): container finished" podID="ef7ebc40-a2f2-4374-9f09-7fe287d70e11" containerID="0fc9e740efdde535dc4d870a08eef7e9345aba5e4af8dc77bb5bfb96916c29af" exitCode=0
Sep 15 09:22:30.381717 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:30.381681    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx57wq" event={"ID":"ef7ebc40-a2f2-4374-9f09-7fe287d70e11","Type":"ContainerDied","Data":"0fc9e740efdde535dc4d870a08eef7e9345aba5e4af8dc77bb5bfb96916c29af"}
Sep 15 09:22:30.381759 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:30.381729    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx57wq" event={"ID":"ef7ebc40-a2f2-4374-9f09-7fe287d70e11","Type":"ContainerStarted","Data":"445be0ea34eeb13cf0938a677ba44f1e178fe4c654e98dce4c2f040f3e1368c6"}
Sep 15 09:22:30.383775 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:30.383750    2578 generic.go:356] "Generic (PLEG): container finished" podID="1006cbd6-b9ed-4425-a82c-f67de043fc7a" containerID="f1d40e622854fd563232c377c892cd82333ec055887d53bac613d27bed10959d" exitCode=0
Sep 15 09:22:30.383919 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:30.383845    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amj9jp" event={"ID":"1006cbd6-b9ed-4425-a82c-f67de043fc7a","Type":"ContainerDied","Data":"f1d40e622854fd563232c377c892cd82333ec055887d53bac613d27bed10959d"}
Sep 15 09:22:31.390425 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:31.390400    2578 generic.go:356] "Generic (PLEG): container finished" podID="1006cbd6-b9ed-4425-a82c-f67de043fc7a" containerID="bc577108025645b62d07435b26d559e5725fb094300595415c66c82c911f5fa9" exitCode=0
Sep 15 09:22:31.390775 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:31.390493    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amj9jp" event={"ID":"1006cbd6-b9ed-4425-a82c-f67de043fc7a","Type":"ContainerDied","Data":"bc577108025645b62d07435b26d559e5725fb094300595415c66c82c911f5fa9"}
Sep 15 09:22:31.392457 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:31.392418    2578 generic.go:356] "Generic (PLEG): container finished" podID="c2d7b740-94d7-4150-9dcf-e4dd1c79e93f" containerID="a0b3322556404a4cfec0ca39272edc4016f6762869950b8f86aeef7d5a22e98d" exitCode=0
Sep 15 09:22:31.392541 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:31.392502    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tq2jz" event={"ID":"c2d7b740-94d7-4150-9dcf-e4dd1c79e93f","Type":"ContainerDied","Data":"a0b3322556404a4cfec0ca39272edc4016f6762869950b8f86aeef7d5a22e98d"}
Sep 15 09:22:31.394566 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:31.394548    2578 generic.go:356] "Generic (PLEG): container finished" podID="ebd19a24-f9c1-4552-ad2e-5da3e4b42e82" containerID="eadf37445646f9dca59527aeed8ec766656d6e0756afd821fd4adf0fb5ba185d" exitCode=0
Sep 15 09:22:31.394647 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:31.394582    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7thmsf" event={"ID":"ebd19a24-f9c1-4552-ad2e-5da3e4b42e82","Type":"ContainerDied","Data":"eadf37445646f9dca59527aeed8ec766656d6e0756afd821fd4adf0fb5ba185d"}
Sep 15 09:22:32.401865 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:32.401791    2578 generic.go:356] "Generic (PLEG): container finished" podID="c2d7b740-94d7-4150-9dcf-e4dd1c79e93f" containerID="a20b16d5eb86d2a1ece0ee8528440ecbffeb4fe39bfaa896221b46fde808514d" exitCode=0
Sep 15 09:22:32.402230 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:32.401856    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tq2jz" event={"ID":"c2d7b740-94d7-4150-9dcf-e4dd1c79e93f","Type":"ContainerDied","Data":"a20b16d5eb86d2a1ece0ee8528440ecbffeb4fe39bfaa896221b46fde808514d"}
Sep 15 09:22:32.404289 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:32.404265    2578 generic.go:356] "Generic (PLEG): container finished" podID="ebd19a24-f9c1-4552-ad2e-5da3e4b42e82" containerID="b70729d0e11407c5b5a05cc1fea254a43426bce8d51a4bac399a82c93227570e" exitCode=0
Sep 15 09:22:32.404408 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:32.404336    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7thmsf" event={"ID":"ebd19a24-f9c1-4552-ad2e-5da3e4b42e82","Type":"ContainerDied","Data":"b70729d0e11407c5b5a05cc1fea254a43426bce8d51a4bac399a82c93227570e"}
Sep 15 09:22:32.406543 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:32.406521    2578 generic.go:356] "Generic (PLEG): container finished" podID="ef7ebc40-a2f2-4374-9f09-7fe287d70e11" containerID="1b84c26ccecc80b1facf7e2fb0e8aee786064abdd4ff0c72e3261613207eb666" exitCode=0
Sep 15 09:22:32.406631 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:32.406588    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx57wq" event={"ID":"ef7ebc40-a2f2-4374-9f09-7fe287d70e11","Type":"ContainerDied","Data":"1b84c26ccecc80b1facf7e2fb0e8aee786064abdd4ff0c72e3261613207eb666"}
Sep 15 09:22:32.409258 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:32.409238    2578 generic.go:356] "Generic (PLEG): container finished" podID="1006cbd6-b9ed-4425-a82c-f67de043fc7a" containerID="1e13c3819940a25d487a77b56553f350b9163613ee85c969962a112615a97089" exitCode=0
Sep 15 09:22:32.409258 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:32.409265    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amj9jp" event={"ID":"1006cbd6-b9ed-4425-a82c-f67de043fc7a","Type":"ContainerDied","Data":"1e13c3819940a25d487a77b56553f350b9163613ee85c969962a112615a97089"}
Sep 15 09:22:33.416486 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:33.416457    2578 generic.go:356] "Generic (PLEG): container finished" podID="ef7ebc40-a2f2-4374-9f09-7fe287d70e11" containerID="6ffaecd248ed146ac582b480d406ee4c1cdb92eec109b7789e5c585ad071368d" exitCode=0
Sep 15 09:22:33.416852 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:33.416534    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx57wq" event={"ID":"ef7ebc40-a2f2-4374-9f09-7fe287d70e11","Type":"ContainerDied","Data":"6ffaecd248ed146ac582b480d406ee4c1cdb92eec109b7789e5c585ad071368d"}
Sep 15 09:22:33.573980 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:33.573836    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amj9jp"
Sep 15 09:22:33.596269 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:33.596249    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7thmsf"
Sep 15 09:22:33.599659 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:33.599641    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tq2jz"
Sep 15 09:22:33.700671 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:33.700610    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gqcwt\" (UniqueName: \"kubernetes.io/projected/ebd19a24-f9c1-4552-ad2e-5da3e4b42e82-kube-api-access-gqcwt\") pod \"ebd19a24-f9c1-4552-ad2e-5da3e4b42e82\" (UID: \"ebd19a24-f9c1-4552-ad2e-5da3e4b42e82\") "
Sep 15 09:22:33.700671 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:33.700641    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ebd19a24-f9c1-4552-ad2e-5da3e4b42e82-bundle\") pod \"ebd19a24-f9c1-4552-ad2e-5da3e4b42e82\" (UID: \"ebd19a24-f9c1-4552-ad2e-5da3e4b42e82\") "
Sep 15 09:22:33.700812 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:33.700689    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2d7b740-94d7-4150-9dcf-e4dd1c79e93f-bundle\") pod \"c2d7b740-94d7-4150-9dcf-e4dd1c79e93f\" (UID: \"c2d7b740-94d7-4150-9dcf-e4dd1c79e93f\") "
Sep 15 09:22:33.700812 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:33.700707    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1006cbd6-b9ed-4425-a82c-f67de043fc7a-util\") pod \"1006cbd6-b9ed-4425-a82c-f67de043fc7a\" (UID: \"1006cbd6-b9ed-4425-a82c-f67de043fc7a\") "
Sep 15 09:22:33.700812 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:33.700726    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2d7b740-94d7-4150-9dcf-e4dd1c79e93f-util\") pod \"c2d7b740-94d7-4150-9dcf-e4dd1c79e93f\" (UID: \"c2d7b740-94d7-4150-9dcf-e4dd1c79e93f\") "
Sep 15 09:22:33.700812 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:33.700744    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ebd19a24-f9c1-4552-ad2e-5da3e4b42e82-util\") pod \"ebd19a24-f9c1-4552-ad2e-5da3e4b42e82\" (UID: \"ebd19a24-f9c1-4552-ad2e-5da3e4b42e82\") "
Sep 15 09:22:33.700812 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:33.700789    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4bxvn\" (UniqueName: \"kubernetes.io/projected/c2d7b740-94d7-4150-9dcf-e4dd1c79e93f-kube-api-access-4bxvn\") pod \"c2d7b740-94d7-4150-9dcf-e4dd1c79e93f\" (UID: \"c2d7b740-94d7-4150-9dcf-e4dd1c79e93f\") "
Sep 15 09:22:33.701069 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:33.700823    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9c7dh\" (UniqueName: \"kubernetes.io/projected/1006cbd6-b9ed-4425-a82c-f67de043fc7a-kube-api-access-9c7dh\") pod \"1006cbd6-b9ed-4425-a82c-f67de043fc7a\" (UID: \"1006cbd6-b9ed-4425-a82c-f67de043fc7a\") "
Sep 15 09:22:33.701069 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:33.700860    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1006cbd6-b9ed-4425-a82c-f67de043fc7a-bundle\") pod \"1006cbd6-b9ed-4425-a82c-f67de043fc7a\" (UID: \"1006cbd6-b9ed-4425-a82c-f67de043fc7a\") "
Sep 15 09:22:33.701447 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:33.701238    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2d7b740-94d7-4150-9dcf-e4dd1c79e93f-bundle" (OuterVolumeSpecName: "bundle") pod "c2d7b740-94d7-4150-9dcf-e4dd1c79e93f" (UID: "c2d7b740-94d7-4150-9dcf-e4dd1c79e93f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:22:33.701447 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:33.701405    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebd19a24-f9c1-4552-ad2e-5da3e4b42e82-bundle" (OuterVolumeSpecName: "bundle") pod "ebd19a24-f9c1-4552-ad2e-5da3e4b42e82" (UID: "ebd19a24-f9c1-4552-ad2e-5da3e4b42e82"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:22:33.701921 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:33.701896    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1006cbd6-b9ed-4425-a82c-f67de043fc7a-bundle" (OuterVolumeSpecName: "bundle") pod "1006cbd6-b9ed-4425-a82c-f67de043fc7a" (UID: "1006cbd6-b9ed-4425-a82c-f67de043fc7a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:22:33.703324 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:33.703286    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebd19a24-f9c1-4552-ad2e-5da3e4b42e82-kube-api-access-gqcwt" (OuterVolumeSpecName: "kube-api-access-gqcwt") pod "ebd19a24-f9c1-4552-ad2e-5da3e4b42e82" (UID: "ebd19a24-f9c1-4552-ad2e-5da3e4b42e82"). InnerVolumeSpecName "kube-api-access-gqcwt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:22:33.703324 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:33.703299    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1006cbd6-b9ed-4425-a82c-f67de043fc7a-kube-api-access-9c7dh" (OuterVolumeSpecName: "kube-api-access-9c7dh") pod "1006cbd6-b9ed-4425-a82c-f67de043fc7a" (UID: "1006cbd6-b9ed-4425-a82c-f67de043fc7a"). InnerVolumeSpecName "kube-api-access-9c7dh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:22:33.703479 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:33.703452    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2d7b740-94d7-4150-9dcf-e4dd1c79e93f-kube-api-access-4bxvn" (OuterVolumeSpecName: "kube-api-access-4bxvn") pod "c2d7b740-94d7-4150-9dcf-e4dd1c79e93f" (UID: "c2d7b740-94d7-4150-9dcf-e4dd1c79e93f"). InnerVolumeSpecName "kube-api-access-4bxvn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:22:33.707469 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:33.707444    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2d7b740-94d7-4150-9dcf-e4dd1c79e93f-util" (OuterVolumeSpecName: "util") pod "c2d7b740-94d7-4150-9dcf-e4dd1c79e93f" (UID: "c2d7b740-94d7-4150-9dcf-e4dd1c79e93f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:22:33.707637 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:33.707615    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebd19a24-f9c1-4552-ad2e-5da3e4b42e82-util" (OuterVolumeSpecName: "util") pod "ebd19a24-f9c1-4552-ad2e-5da3e4b42e82" (UID: "ebd19a24-f9c1-4552-ad2e-5da3e4b42e82"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:22:33.709452 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:33.709429    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1006cbd6-b9ed-4425-a82c-f67de043fc7a-util" (OuterVolumeSpecName: "util") pod "1006cbd6-b9ed-4425-a82c-f67de043fc7a" (UID: "1006cbd6-b9ed-4425-a82c-f67de043fc7a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:22:33.802430 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:33.802406    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4bxvn\" (UniqueName: \"kubernetes.io/projected/c2d7b740-94d7-4150-9dcf-e4dd1c79e93f-kube-api-access-4bxvn\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:22:33.802430 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:33.802428    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9c7dh\" (UniqueName: \"kubernetes.io/projected/1006cbd6-b9ed-4425-a82c-f67de043fc7a-kube-api-access-9c7dh\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:22:33.802545 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:33.802439    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1006cbd6-b9ed-4425-a82c-f67de043fc7a-bundle\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:22:33.802545 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:33.802447    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqcwt\" (UniqueName: \"kubernetes.io/projected/ebd19a24-f9c1-4552-ad2e-5da3e4b42e82-kube-api-access-gqcwt\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:22:33.802545 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:33.802457    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ebd19a24-f9c1-4552-ad2e-5da3e4b42e82-bundle\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:22:33.802545 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:33.802469    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2d7b740-94d7-4150-9dcf-e4dd1c79e93f-bundle\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:22:33.802545 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:33.802478    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1006cbd6-b9ed-4425-a82c-f67de043fc7a-util\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:22:33.802545 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:33.802487    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2d7b740-94d7-4150-9dcf-e4dd1c79e93f-util\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:22:33.802545 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:33.802494    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ebd19a24-f9c1-4552-ad2e-5da3e4b42e82-util\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:22:34.423748 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:34.423695    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amj9jp"
Sep 15 09:22:34.424081 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:34.423697    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847amj9jp" event={"ID":"1006cbd6-b9ed-4425-a82c-f67de043fc7a","Type":"ContainerDied","Data":"ca4e093caade3d0c79e65c9d28e4ef64e7bf5797df1289d6a446c6de7488fc63"}
Sep 15 09:22:34.424081 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:34.423816    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ca4e093caade3d0c79e65c9d28e4ef64e7bf5797df1289d6a446c6de7488fc63"
Sep 15 09:22:34.426136 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:34.426110    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tq2jz" event={"ID":"c2d7b740-94d7-4150-9dcf-e4dd1c79e93f","Type":"ContainerDied","Data":"0215bd6704d8cbf17971e8a92c0ddee17374deb3310411f0709619291c5be3fa"}
Sep 15 09:22:34.426244 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:34.426156    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0215bd6704d8cbf17971e8a92c0ddee17374deb3310411f0709619291c5be3fa"
Sep 15 09:22:34.426294 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:34.426237    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6tq2jz"
Sep 15 09:22:34.428460 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:34.428441    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7thmsf"
Sep 15 09:22:34.428460 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:34.428452    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7thmsf" event={"ID":"ebd19a24-f9c1-4552-ad2e-5da3e4b42e82","Type":"ContainerDied","Data":"c22a0a40efa52aa00864344c1e3c755371afb1f3defd2f3161a2fa61385b616f"}
Sep 15 09:22:34.428586 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:34.428483    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c22a0a40efa52aa00864344c1e3c755371afb1f3defd2f3161a2fa61385b616f"
Sep 15 09:22:34.550283 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:34.550054    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx57wq"
Sep 15 09:22:34.710933 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:34.710910    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef7ebc40-a2f2-4374-9f09-7fe287d70e11-bundle\") pod \"ef7ebc40-a2f2-4374-9f09-7fe287d70e11\" (UID: \"ef7ebc40-a2f2-4374-9f09-7fe287d70e11\") "
Sep 15 09:22:34.711062 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:34.710960    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d2gqd\" (UniqueName: \"kubernetes.io/projected/ef7ebc40-a2f2-4374-9f09-7fe287d70e11-kube-api-access-d2gqd\") pod \"ef7ebc40-a2f2-4374-9f09-7fe287d70e11\" (UID: \"ef7ebc40-a2f2-4374-9f09-7fe287d70e11\") "
Sep 15 09:22:34.711062 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:34.711018    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef7ebc40-a2f2-4374-9f09-7fe287d70e11-util\") pod \"ef7ebc40-a2f2-4374-9f09-7fe287d70e11\" (UID: \"ef7ebc40-a2f2-4374-9f09-7fe287d70e11\") "
Sep 15 09:22:34.711442 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:34.711421    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef7ebc40-a2f2-4374-9f09-7fe287d70e11-bundle" (OuterVolumeSpecName: "bundle") pod "ef7ebc40-a2f2-4374-9f09-7fe287d70e11" (UID: "ef7ebc40-a2f2-4374-9f09-7fe287d70e11"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:22:34.713049 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:34.713025    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef7ebc40-a2f2-4374-9f09-7fe287d70e11-kube-api-access-d2gqd" (OuterVolumeSpecName: "kube-api-access-d2gqd") pod "ef7ebc40-a2f2-4374-9f09-7fe287d70e11" (UID: "ef7ebc40-a2f2-4374-9f09-7fe287d70e11"). InnerVolumeSpecName "kube-api-access-d2gqd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:22:34.767482 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:34.767456    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef7ebc40-a2f2-4374-9f09-7fe287d70e11-util" (OuterVolumeSpecName: "util") pod "ef7ebc40-a2f2-4374-9f09-7fe287d70e11" (UID: "ef7ebc40-a2f2-4374-9f09-7fe287d70e11"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:22:34.812515 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:34.812495    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef7ebc40-a2f2-4374-9f09-7fe287d70e11-bundle\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:22:34.812515 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:34.812514    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d2gqd\" (UniqueName: \"kubernetes.io/projected/ef7ebc40-a2f2-4374-9f09-7fe287d70e11-kube-api-access-d2gqd\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:22:34.812626 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:34.812524    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef7ebc40-a2f2-4374-9f09-7fe287d70e11-util\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:22:35.436391 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:35.436358    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx57wq" event={"ID":"ef7ebc40-a2f2-4374-9f09-7fe287d70e11","Type":"ContainerDied","Data":"445be0ea34eeb13cf0938a677ba44f1e178fe4c654e98dce4c2f040f3e1368c6"}
Sep 15 09:22:35.436718 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:35.436407    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cx57wq"
Sep 15 09:22:35.436718 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:22:35.436411    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="445be0ea34eeb13cf0938a677ba44f1e178fe4c654e98dce4c2f040f3e1368c6"
Sep 15 09:23:32.548605 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.548530    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-648hw"]
Sep 15 09:23:32.549050 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.548891    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2d7b740-94d7-4150-9dcf-e4dd1c79e93f" containerName="extract"
Sep 15 09:23:32.549050 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.548905    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2d7b740-94d7-4150-9dcf-e4dd1c79e93f" containerName="extract"
Sep 15 09:23:32.549050 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.548915    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1006cbd6-b9ed-4425-a82c-f67de043fc7a" containerName="util"
Sep 15 09:23:32.549050 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.548921    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1006cbd6-b9ed-4425-a82c-f67de043fc7a" containerName="util"
Sep 15 09:23:32.549050 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.548928    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef7ebc40-a2f2-4374-9f09-7fe287d70e11" containerName="extract"
Sep 15 09:23:32.549050 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.548933    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef7ebc40-a2f2-4374-9f09-7fe287d70e11" containerName="extract"
Sep 15 09:23:32.549050 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.548941    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1006cbd6-b9ed-4425-a82c-f67de043fc7a" containerName="extract"
Sep 15 09:23:32.549050 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.548968    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1006cbd6-b9ed-4425-a82c-f67de043fc7a" containerName="extract"
Sep 15 09:23:32.549050 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.548983    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebd19a24-f9c1-4552-ad2e-5da3e4b42e82" containerName="util"
Sep 15 09:23:32.549050 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.548989    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebd19a24-f9c1-4552-ad2e-5da3e4b42e82" containerName="util"
Sep 15 09:23:32.549050 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.548995    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebd19a24-f9c1-4552-ad2e-5da3e4b42e82" containerName="extract"
Sep 15 09:23:32.549050 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.549000    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebd19a24-f9c1-4552-ad2e-5da3e4b42e82" containerName="extract"
Sep 15 09:23:32.549050 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.549009    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef7ebc40-a2f2-4374-9f09-7fe287d70e11" containerName="util"
Sep 15 09:23:32.549050 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.549014    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef7ebc40-a2f2-4374-9f09-7fe287d70e11" containerName="util"
Sep 15 09:23:32.549050 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.549019    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2d7b740-94d7-4150-9dcf-e4dd1c79e93f" containerName="pull"
Sep 15 09:23:32.549050 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.549024    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2d7b740-94d7-4150-9dcf-e4dd1c79e93f" containerName="pull"
Sep 15 09:23:32.549050 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.549030    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebd19a24-f9c1-4552-ad2e-5da3e4b42e82" containerName="pull"
Sep 15 09:23:32.549050 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.549034    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebd19a24-f9c1-4552-ad2e-5da3e4b42e82" containerName="pull"
Sep 15 09:23:32.549050 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.549043    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2d7b740-94d7-4150-9dcf-e4dd1c79e93f" containerName="util"
Sep 15 09:23:32.549050 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.549048    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2d7b740-94d7-4150-9dcf-e4dd1c79e93f" containerName="util"
Sep 15 09:23:32.549050 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.549054    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1006cbd6-b9ed-4425-a82c-f67de043fc7a" containerName="pull"
Sep 15 09:23:32.549050 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.549059    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1006cbd6-b9ed-4425-a82c-f67de043fc7a" containerName="pull"
Sep 15 09:23:32.549725 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.549071    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef7ebc40-a2f2-4374-9f09-7fe287d70e11" containerName="pull"
Sep 15 09:23:32.549725 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.549077    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef7ebc40-a2f2-4374-9f09-7fe287d70e11" containerName="pull"
Sep 15 09:23:32.549725 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.549126    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1006cbd6-b9ed-4425-a82c-f67de043fc7a" containerName="extract"
Sep 15 09:23:32.549725 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.549133    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2d7b740-94d7-4150-9dcf-e4dd1c79e93f" containerName="extract"
Sep 15 09:23:32.549725 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.549138    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebd19a24-f9c1-4552-ad2e-5da3e4b42e82" containerName="extract"
Sep 15 09:23:32.549725 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.549145    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef7ebc40-a2f2-4374-9f09-7fe287d70e11" containerName="extract"
Sep 15 09:23:32.551696 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.551682    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-648hw"
Sep 15 09:23:32.554138 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.554117    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-gcghd\""
Sep 15 09:23:32.567724 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.567700    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-648hw"]
Sep 15 09:23:32.646727 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.646694    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32fe6fe4-c078-4a0e-82dc-47182c507813-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-648hw\" (UID: \"32fe6fe4-c078-4a0e-82dc-47182c507813\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-648hw"
Sep 15 09:23:32.646891 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.646734    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32fe6fe4-c078-4a0e-82dc-47182c507813-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-648hw\" (UID: \"32fe6fe4-c078-4a0e-82dc-47182c507813\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-648hw"
Sep 15 09:23:32.646891 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.646839    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32fe6fe4-c078-4a0e-82dc-47182c507813-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-648hw\" (UID: \"32fe6fe4-c078-4a0e-82dc-47182c507813\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-648hw"
Sep 15 09:23:32.646891 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.646881    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32fe6fe4-c078-4a0e-82dc-47182c507813-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-648hw\" (UID: \"32fe6fe4-c078-4a0e-82dc-47182c507813\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-648hw"
Sep 15 09:23:32.647077 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.646910    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32fe6fe4-c078-4a0e-82dc-47182c507813-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-648hw\" (UID: \"32fe6fe4-c078-4a0e-82dc-47182c507813\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-648hw"
Sep 15 09:23:32.647077 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.647026    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmkxr\" (UniqueName: \"kubernetes.io/projected/32fe6fe4-c078-4a0e-82dc-47182c507813-kube-api-access-lmkxr\") pod \"maas-default-gateway-openshift-default-5ccb968c66-648hw\" (UID: \"32fe6fe4-c078-4a0e-82dc-47182c507813\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-648hw"
Sep 15 09:23:32.647077 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.647068    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32fe6fe4-c078-4a0e-82dc-47182c507813-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-648hw\" (UID: \"32fe6fe4-c078-4a0e-82dc-47182c507813\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-648hw"
Sep 15 09:23:32.647227 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.647111    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32fe6fe4-c078-4a0e-82dc-47182c507813-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-648hw\" (UID: \"32fe6fe4-c078-4a0e-82dc-47182c507813\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-648hw"
Sep 15 09:23:32.647227 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.647174    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32fe6fe4-c078-4a0e-82dc-47182c507813-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-648hw\" (UID: \"32fe6fe4-c078-4a0e-82dc-47182c507813\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-648hw"
Sep 15 09:23:32.747968 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.747919    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmkxr\" (UniqueName: \"kubernetes.io/projected/32fe6fe4-c078-4a0e-82dc-47182c507813-kube-api-access-lmkxr\") pod \"maas-default-gateway-openshift-default-5ccb968c66-648hw\" (UID: \"32fe6fe4-c078-4a0e-82dc-47182c507813\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-648hw"
Sep 15 09:23:32.748168 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.747989    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32fe6fe4-c078-4a0e-82dc-47182c507813-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-648hw\" (UID: \"32fe6fe4-c078-4a0e-82dc-47182c507813\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-648hw"
Sep 15 09:23:32.748168 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.748020    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32fe6fe4-c078-4a0e-82dc-47182c507813-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-648hw\" (UID: \"32fe6fe4-c078-4a0e-82dc-47182c507813\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-648hw"
Sep 15 09:23:32.748168 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.748051    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32fe6fe4-c078-4a0e-82dc-47182c507813-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-648hw\" (UID: \"32fe6fe4-c078-4a0e-82dc-47182c507813\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-648hw"
Sep 15 09:23:32.748168 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.748072    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32fe6fe4-c078-4a0e-82dc-47182c507813-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-648hw\" (UID: \"32fe6fe4-c078-4a0e-82dc-47182c507813\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-648hw"
Sep 15 09:23:32.748168 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.748089    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32fe6fe4-c078-4a0e-82dc-47182c507813-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-648hw\" (UID: \"32fe6fe4-c078-4a0e-82dc-47182c507813\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-648hw"
Sep 15 09:23:32.748446 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.748169    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32fe6fe4-c078-4a0e-82dc-47182c507813-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-648hw\" (UID: \"32fe6fe4-c078-4a0e-82dc-47182c507813\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-648hw"
Sep 15 09:23:32.748446 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.748197    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32fe6fe4-c078-4a0e-82dc-47182c507813-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-648hw\" (UID: \"32fe6fe4-c078-4a0e-82dc-47182c507813\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-648hw"
Sep 15 09:23:32.748446 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.748220    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32fe6fe4-c078-4a0e-82dc-47182c507813-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-648hw\" (UID: \"32fe6fe4-c078-4a0e-82dc-47182c507813\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-648hw"
Sep 15 09:23:32.748446 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.748431    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32fe6fe4-c078-4a0e-82dc-47182c507813-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-648hw\" (UID: \"32fe6fe4-c078-4a0e-82dc-47182c507813\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-648hw"
Sep 15 09:23:32.748652 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.748564    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32fe6fe4-c078-4a0e-82dc-47182c507813-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-648hw\" (UID: \"32fe6fe4-c078-4a0e-82dc-47182c507813\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-648hw"
Sep 15 09:23:32.748708 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.748671    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32fe6fe4-c078-4a0e-82dc-47182c507813-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-648hw\" (UID: \"32fe6fe4-c078-4a0e-82dc-47182c507813\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-648hw"
Sep 15 09:23:32.748708 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.748671    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32fe6fe4-c078-4a0e-82dc-47182c507813-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-648hw\" (UID: \"32fe6fe4-c078-4a0e-82dc-47182c507813\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-648hw"
Sep 15 09:23:32.748853 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.748834    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32fe6fe4-c078-4a0e-82dc-47182c507813-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-648hw\" (UID: \"32fe6fe4-c078-4a0e-82dc-47182c507813\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-648hw"
Sep 15 09:23:32.750380 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.750361    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32fe6fe4-c078-4a0e-82dc-47182c507813-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-648hw\" (UID: \"32fe6fe4-c078-4a0e-82dc-47182c507813\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-648hw"
Sep 15 09:23:32.750630 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.750610    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32fe6fe4-c078-4a0e-82dc-47182c507813-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-648hw\" (UID: \"32fe6fe4-c078-4a0e-82dc-47182c507813\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-648hw"
Sep 15 09:23:32.756548 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.756530    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32fe6fe4-c078-4a0e-82dc-47182c507813-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-648hw\" (UID: \"32fe6fe4-c078-4a0e-82dc-47182c507813\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-648hw"
Sep 15 09:23:32.756721 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.756702    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmkxr\" (UniqueName: \"kubernetes.io/projected/32fe6fe4-c078-4a0e-82dc-47182c507813-kube-api-access-lmkxr\") pod \"maas-default-gateway-openshift-default-5ccb968c66-648hw\" (UID: \"32fe6fe4-c078-4a0e-82dc-47182c507813\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-648hw"
Sep 15 09:23:32.864932 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:32.864852    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-648hw"
Sep 15 09:23:33.139817 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:33.139789    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-648hw"]
Sep 15 09:23:33.141136 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:23:33.141103    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32fe6fe4_c078_4a0e_82dc_47182c507813.slice/crio-9e464a76fd5c68161ab2b9d5fdb64602ab8b68d41930875d4c6421349d0f0d57 WatchSource:0}: Error finding container 9e464a76fd5c68161ab2b9d5fdb64602ab8b68d41930875d4c6421349d0f0d57: Status 404 returned error can't find the container with id 9e464a76fd5c68161ab2b9d5fdb64602ab8b68d41930875d4c6421349d0f0d57
Sep 15 09:23:33.143698 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:33.143660    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:23:33.143761 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:33.143723    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:23:33.143761 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:33.143751    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:23:33.720464 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:33.720429    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-648hw" event={"ID":"32fe6fe4-c078-4a0e-82dc-47182c507813","Type":"ContainerStarted","Data":"600aead532afc1d4c18fa68fdce3acddcfab424aada80b02262c6ca9b816daad"}
Sep 15 09:23:33.720830 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:33.720502    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-648hw" event={"ID":"32fe6fe4-c078-4a0e-82dc-47182c507813","Type":"ContainerStarted","Data":"9e464a76fd5c68161ab2b9d5fdb64602ab8b68d41930875d4c6421349d0f0d57"}
Sep 15 09:23:33.740111 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:33.740066    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-648hw" podStartSLOduration=1.740052427 podStartE2EDuration="1.740052427s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:23:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:23:33.73711303 +0000 UTC m=+558.075558310" watchObservedRunningTime="2026-09-15 09:23:33.740052427 +0000 UTC m=+558.078497701"
Sep 15 09:23:33.865961 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:33.865920    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-648hw"
Sep 15 09:23:34.870156 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:34.870130    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-648hw"
Sep 15 09:23:35.731303 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:35.731275    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-648hw"
Sep 15 09:23:35.732062 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:23:35.732045    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-648hw"
Sep 15 09:25:05.732310 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:05.732279    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-648hw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 15 09:25:05.732734 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:05.732353    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-648hw" podUID="32fe6fe4-c078-4a0e-82dc-47182c507813" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 15 09:25:06.181301 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:06.181269    2578 generic.go:356] "Generic (PLEG): container finished" podID="32fe6fe4-c078-4a0e-82dc-47182c507813" containerID="600aead532afc1d4c18fa68fdce3acddcfab424aada80b02262c6ca9b816daad" exitCode=0
Sep 15 09:25:06.181457 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:06.181311    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-648hw" event={"ID":"32fe6fe4-c078-4a0e-82dc-47182c507813","Type":"ContainerDied","Data":"600aead532afc1d4c18fa68fdce3acddcfab424aada80b02262c6ca9b816daad"}
Sep 15 09:25:06.181631 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:06.181616    2578 scope.go:117] "RemoveContainer" containerID="600aead532afc1d4c18fa68fdce3acddcfab424aada80b02262c6ca9b816daad"
Sep 15 09:25:06.182615 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:06.182584    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:25:06.182707 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:06.182652    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:25:06.182707 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:06.182683    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:25:07.188124 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:07.188091    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-648hw" event={"ID":"32fe6fe4-c078-4a0e-82dc-47182c507813","Type":"ContainerStarted","Data":"06359b094fa2ca957194b573cdd59486ae5cacf7843f2c9140fb2cafa6606379"}
Sep 15 09:25:07.865613 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:07.865579    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-648hw"
Sep 15 09:25:07.865823 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:07.865735    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-648hw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 15 09:25:07.865823 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:07.865789    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-648hw" podUID="32fe6fe4-c078-4a0e-82dc-47182c507813" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 15 09:25:08.865274 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:08.865231    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-648hw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 15 09:25:08.865798 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:08.865291    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-648hw" podUID="32fe6fe4-c078-4a0e-82dc-47182c507813" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 15 09:25:09.865363 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:09.865327    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-648hw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 15 09:25:09.865733 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:09.865380    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-648hw" podUID="32fe6fe4-c078-4a0e-82dc-47182c507813" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 15 09:25:10.865447 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:10.865414    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-648hw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 15 09:25:10.865799 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:10.865478    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-648hw" podUID="32fe6fe4-c078-4a0e-82dc-47182c507813" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 15 09:25:11.865345 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:11.865306    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-648hw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 15 09:25:11.865553 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:11.865366    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-648hw" podUID="32fe6fe4-c078-4a0e-82dc-47182c507813" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 15 09:25:12.870154 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:12.870115    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-648hw"
Sep 15 09:25:12.870706 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:12.870418    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-648hw"
Sep 15 09:25:12.871362 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:12.871340    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-648hw"
Sep 15 09:25:30.010577 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:30.010530    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-jc92s"]
Sep 15 09:25:30.013242 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:30.013215    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jc92s"
Sep 15 09:25:30.015759 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:30.015734    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 15 09:25:30.015878 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:30.015737    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-d8dng\""
Sep 15 09:25:30.016487 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:30.016467    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 15 09:25:30.016582 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:30.016488    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 15 09:25:30.021495 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:30.021472    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-jc92s"]
Sep 15 09:25:30.095527 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:30.095507    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa70fdfc-2414-4b44-b057-9bda2c7bb1fa-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jc92s\" (UID: \"aa70fdfc-2414-4b44-b057-9bda2c7bb1fa\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jc92s"
Sep 15 09:25:30.095628 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:30.095540    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa70fdfc-2414-4b44-b057-9bda2c7bb1fa-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jc92s\" (UID: \"aa70fdfc-2414-4b44-b057-9bda2c7bb1fa\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jc92s"
Sep 15 09:25:30.095628 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:30.095560    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa70fdfc-2414-4b44-b057-9bda2c7bb1fa-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jc92s\" (UID: \"aa70fdfc-2414-4b44-b057-9bda2c7bb1fa\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jc92s"
Sep 15 09:25:30.095708 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:30.095640    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa70fdfc-2414-4b44-b057-9bda2c7bb1fa-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jc92s\" (UID: \"aa70fdfc-2414-4b44-b057-9bda2c7bb1fa\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jc92s"
Sep 15 09:25:30.095708 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:30.095684    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa70fdfc-2414-4b44-b057-9bda2c7bb1fa-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jc92s\" (UID: \"aa70fdfc-2414-4b44-b057-9bda2c7bb1fa\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jc92s"
Sep 15 09:25:30.095773 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:30.095717    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxch9\" (UniqueName: \"kubernetes.io/projected/aa70fdfc-2414-4b44-b057-9bda2c7bb1fa-kube-api-access-dxch9\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jc92s\" (UID: \"aa70fdfc-2414-4b44-b057-9bda2c7bb1fa\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jc92s"
Sep 15 09:25:30.197066 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:30.197037    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa70fdfc-2414-4b44-b057-9bda2c7bb1fa-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jc92s\" (UID: \"aa70fdfc-2414-4b44-b057-9bda2c7bb1fa\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jc92s"
Sep 15 09:25:30.197228 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:30.197200    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxch9\" (UniqueName: \"kubernetes.io/projected/aa70fdfc-2414-4b44-b057-9bda2c7bb1fa-kube-api-access-dxch9\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jc92s\" (UID: \"aa70fdfc-2414-4b44-b057-9bda2c7bb1fa\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jc92s"
Sep 15 09:25:30.197303 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:30.197251    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa70fdfc-2414-4b44-b057-9bda2c7bb1fa-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jc92s\" (UID: \"aa70fdfc-2414-4b44-b057-9bda2c7bb1fa\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jc92s"
Sep 15 09:25:30.197303 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:30.197296    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa70fdfc-2414-4b44-b057-9bda2c7bb1fa-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jc92s\" (UID: \"aa70fdfc-2414-4b44-b057-9bda2c7bb1fa\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jc92s"
Sep 15 09:25:30.197430 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:30.197326    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa70fdfc-2414-4b44-b057-9bda2c7bb1fa-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jc92s\" (UID: \"aa70fdfc-2414-4b44-b057-9bda2c7bb1fa\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jc92s"
Sep 15 09:25:30.197430 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:30.197384    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa70fdfc-2414-4b44-b057-9bda2c7bb1fa-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jc92s\" (UID: \"aa70fdfc-2414-4b44-b057-9bda2c7bb1fa\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jc92s"
Sep 15 09:25:30.197618 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:30.197594    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa70fdfc-2414-4b44-b057-9bda2c7bb1fa-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jc92s\" (UID: \"aa70fdfc-2414-4b44-b057-9bda2c7bb1fa\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jc92s"
Sep 15 09:25:30.197674 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:30.197624    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa70fdfc-2414-4b44-b057-9bda2c7bb1fa-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jc92s\" (UID: \"aa70fdfc-2414-4b44-b057-9bda2c7bb1fa\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jc92s"
Sep 15 09:25:30.197674 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:30.197668    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa70fdfc-2414-4b44-b057-9bda2c7bb1fa-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jc92s\" (UID: \"aa70fdfc-2414-4b44-b057-9bda2c7bb1fa\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jc92s"
Sep 15 09:25:30.199487 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:30.199468    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa70fdfc-2414-4b44-b057-9bda2c7bb1fa-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jc92s\" (UID: \"aa70fdfc-2414-4b44-b057-9bda2c7bb1fa\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jc92s"
Sep 15 09:25:30.199749 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:30.199731    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa70fdfc-2414-4b44-b057-9bda2c7bb1fa-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jc92s\" (UID: \"aa70fdfc-2414-4b44-b057-9bda2c7bb1fa\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jc92s"
Sep 15 09:25:30.204515 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:30.204495    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxch9\" (UniqueName: \"kubernetes.io/projected/aa70fdfc-2414-4b44-b057-9bda2c7bb1fa-kube-api-access-dxch9\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jc92s\" (UID: \"aa70fdfc-2414-4b44-b057-9bda2c7bb1fa\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jc92s"
Sep 15 09:25:30.325834 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:30.325779    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jc92s"
Sep 15 09:25:30.594333 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:30.594310    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-jc92s"]
Sep 15 09:25:30.595923 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:25:30.595871    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa70fdfc_2414_4b44_b057_9bda2c7bb1fa.slice/crio-89e04e70e8cd06c21e7acdeec16a842695e0459ee500f267fd23c75c5ed8f89c WatchSource:0}: Error finding container 89e04e70e8cd06c21e7acdeec16a842695e0459ee500f267fd23c75c5ed8f89c: Status 404 returned error can't find the container with id 89e04e70e8cd06c21e7acdeec16a842695e0459ee500f267fd23c75c5ed8f89c
Sep 15 09:25:30.597637 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:30.597621    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 09:25:31.317322 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:31.317283    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jc92s" event={"ID":"aa70fdfc-2414-4b44-b057-9bda2c7bb1fa","Type":"ContainerStarted","Data":"89e04e70e8cd06c21e7acdeec16a842695e0459ee500f267fd23c75c5ed8f89c"}
Sep 15 09:25:32.324676 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:32.324645    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jc92s" event={"ID":"aa70fdfc-2414-4b44-b057-9bda2c7bb1fa","Type":"ContainerStarted","Data":"4e7c4f08895cab40b8adba4065cfe7ec608b4874ff32a70dfa931822977fd348"}
Sep 15 09:25:32.344048 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:32.344002    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jc92s" podStartSLOduration=2.373133802 podStartE2EDuration="3.343987691s" totalImagesPullingTime="970.853889ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:25:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:25:32.342234252 +0000 UTC m=+676.680679521" watchObservedRunningTime="2026-09-15 09:25:32.343987691 +0000 UTC m=+676.682432969"
Sep 15 09:25:40.326443 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:40.326408    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jc92s"
Sep 15 09:25:40.326907 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:40.326473    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jc92s"
Sep 15 09:25:40.338721 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:40.338699    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jc92s"
Sep 15 09:25:40.376718 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:40.376695    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jc92s"
Sep 15 09:25:53.193069 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:53.193040    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff7sdk"]
Sep 15 09:25:53.196616 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:53.196594    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff7sdk"
Sep 15 09:25:53.199242 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:53.199223    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 15 09:25:53.204811 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:53.204791    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff7sdk"]
Sep 15 09:25:53.377015 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:53.376985    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e5f457f-493f-468d-bb2e-fb24ca2c02b4-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff7sdk\" (UID: \"8e5f457f-493f-468d-bb2e-fb24ca2c02b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff7sdk"
Sep 15 09:25:53.377127 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:53.377034    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e5f457f-493f-468d-bb2e-fb24ca2c02b4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff7sdk\" (UID: \"8e5f457f-493f-468d-bb2e-fb24ca2c02b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff7sdk"
Sep 15 09:25:53.377127 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:53.377088    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e5f457f-493f-468d-bb2e-fb24ca2c02b4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff7sdk\" (UID: \"8e5f457f-493f-468d-bb2e-fb24ca2c02b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff7sdk"
Sep 15 09:25:53.377127 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:53.377111    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thgcx\" (UniqueName: \"kubernetes.io/projected/8e5f457f-493f-468d-bb2e-fb24ca2c02b4-kube-api-access-thgcx\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff7sdk\" (UID: \"8e5f457f-493f-468d-bb2e-fb24ca2c02b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff7sdk"
Sep 15 09:25:53.377255 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:53.377132    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e5f457f-493f-468d-bb2e-fb24ca2c02b4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff7sdk\" (UID: \"8e5f457f-493f-468d-bb2e-fb24ca2c02b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff7sdk"
Sep 15 09:25:53.377255 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:53.377187    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e5f457f-493f-468d-bb2e-fb24ca2c02b4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff7sdk\" (UID: \"8e5f457f-493f-468d-bb2e-fb24ca2c02b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff7sdk"
Sep 15 09:25:53.477915 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:53.477886    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e5f457f-493f-468d-bb2e-fb24ca2c02b4-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff7sdk\" (UID: \"8e5f457f-493f-468d-bb2e-fb24ca2c02b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff7sdk"
Sep 15 09:25:53.478080 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:53.477935    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e5f457f-493f-468d-bb2e-fb24ca2c02b4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff7sdk\" (UID: \"8e5f457f-493f-468d-bb2e-fb24ca2c02b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff7sdk"
Sep 15 09:25:53.478080 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:53.477995    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e5f457f-493f-468d-bb2e-fb24ca2c02b4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff7sdk\" (UID: \"8e5f457f-493f-468d-bb2e-fb24ca2c02b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff7sdk"
Sep 15 09:25:53.478080 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:53.478015    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thgcx\" (UniqueName: \"kubernetes.io/projected/8e5f457f-493f-468d-bb2e-fb24ca2c02b4-kube-api-access-thgcx\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff7sdk\" (UID: \"8e5f457f-493f-468d-bb2e-fb24ca2c02b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff7sdk"
Sep 15 09:25:53.478080 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:53.478039    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e5f457f-493f-468d-bb2e-fb24ca2c02b4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff7sdk\" (UID: \"8e5f457f-493f-468d-bb2e-fb24ca2c02b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff7sdk"
Sep 15 09:25:53.478278 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:53.478089    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e5f457f-493f-468d-bb2e-fb24ca2c02b4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff7sdk\" (UID: \"8e5f457f-493f-468d-bb2e-fb24ca2c02b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff7sdk"
Sep 15 09:25:53.478362 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:53.478339    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e5f457f-493f-468d-bb2e-fb24ca2c02b4-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff7sdk\" (UID: \"8e5f457f-493f-468d-bb2e-fb24ca2c02b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff7sdk"
Sep 15 09:25:53.478426 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:53.478357    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e5f457f-493f-468d-bb2e-fb24ca2c02b4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff7sdk\" (UID: \"8e5f457f-493f-468d-bb2e-fb24ca2c02b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff7sdk"
Sep 15 09:25:53.478488 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:53.478430    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e5f457f-493f-468d-bb2e-fb24ca2c02b4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff7sdk\" (UID: \"8e5f457f-493f-468d-bb2e-fb24ca2c02b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff7sdk"
Sep 15 09:25:53.480347 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:53.480322    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e5f457f-493f-468d-bb2e-fb24ca2c02b4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff7sdk\" (UID: \"8e5f457f-493f-468d-bb2e-fb24ca2c02b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff7sdk"
Sep 15 09:25:53.480574 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:53.480560    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e5f457f-493f-468d-bb2e-fb24ca2c02b4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff7sdk\" (UID: \"8e5f457f-493f-468d-bb2e-fb24ca2c02b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff7sdk"
Sep 15 09:25:53.485782 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:53.485761    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thgcx\" (UniqueName: \"kubernetes.io/projected/8e5f457f-493f-468d-bb2e-fb24ca2c02b4-kube-api-access-thgcx\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff7sdk\" (UID: \"8e5f457f-493f-468d-bb2e-fb24ca2c02b4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff7sdk"
Sep 15 09:25:53.507791 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:53.507769    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff7sdk"
Sep 15 09:25:53.776338 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:53.776316    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff7sdk"]
Sep 15 09:25:53.778030 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:25:53.777999    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e5f457f_493f_468d_bb2e_fb24ca2c02b4.slice/crio-fdcae47c480c10f8088e6909192a91f2e5e5b92f437351a5c374e178b70e6d01 WatchSource:0}: Error finding container fdcae47c480c10f8088e6909192a91f2e5e5b92f437351a5c374e178b70e6d01: Status 404 returned error can't find the container with id fdcae47c480c10f8088e6909192a91f2e5e5b92f437351a5c374e178b70e6d01
Sep 15 09:25:54.435184 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:54.435149    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff7sdk" event={"ID":"8e5f457f-493f-468d-bb2e-fb24ca2c02b4","Type":"ContainerStarted","Data":"d93867d9f113e8e98cf2bd04cba45df8552bdabe5121ed92d53130bc43989ccd"}
Sep 15 09:25:54.435528 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:54.435210    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff7sdk" event={"ID":"8e5f457f-493f-468d-bb2e-fb24ca2c02b4","Type":"ContainerStarted","Data":"fdcae47c480c10f8088e6909192a91f2e5e5b92f437351a5c374e178b70e6d01"}
Sep 15 09:25:54.451542 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:25:54.451502    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff7sdk" podStartSLOduration=1.252745992 podStartE2EDuration="1.451488226s" totalImagesPullingTime="198.742234ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:25:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:25:54.450304805 +0000 UTC m=+698.788750079" watchObservedRunningTime="2026-09-15 09:25:54.451488226 +0000 UTC m=+698.789933500"
Sep 15 09:26:03.507889 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:26:03.507855    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff7sdk"
Sep 15 09:26:03.508390 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:26:03.507910    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff7sdk"
Sep 15 09:26:03.521377 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:26:03.521354    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff7sdk"
Sep 15 09:26:04.495601 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:26:04.495577    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff7sdk"
Sep 15 09:27:51.329885 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.329842    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd"]
Sep 15 09:27:51.333640 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.333618    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd"
Sep 15 09:27:51.336037 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.336014    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-c183a5-openshift-default-dockercfg-dtsgc\""
Sep 15 09:27:51.345156 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.345131    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd"]
Sep 15 09:27:51.392894 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.392860    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg"]
Sep 15 09:27:51.396710 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.396688    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg"
Sep 15 09:27:51.398898 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.398879    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-7a31d6-openshift-default-dockercfg-dxswp\""
Sep 15 09:27:51.407457 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.407431    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg"]
Sep 15 09:27:51.440904 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.440871    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4660a7ba-4f49-4385-bb4e-e62f977d5aca-istio-data\") pod \"e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd\" (UID: \"4660a7ba-4f49-4385-bb4e-e62f977d5aca\") " pod="openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd"
Sep 15 09:27:51.441096 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.440939    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4660a7ba-4f49-4385-bb4e-e62f977d5aca-istiod-ca-cert\") pod \"e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd\" (UID: \"4660a7ba-4f49-4385-bb4e-e62f977d5aca\") " pod="openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd"
Sep 15 09:27:51.441096 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.441009    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4660a7ba-4f49-4385-bb4e-e62f977d5aca-credential-socket\") pod \"e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd\" (UID: \"4660a7ba-4f49-4385-bb4e-e62f977d5aca\") " pod="openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd"
Sep 15 09:27:51.441096 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.441056    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4660a7ba-4f49-4385-bb4e-e62f977d5aca-istio-podinfo\") pod \"e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd\" (UID: \"4660a7ba-4f49-4385-bb4e-e62f977d5aca\") " pod="openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd"
Sep 15 09:27:51.441280 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.441134    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4660a7ba-4f49-4385-bb4e-e62f977d5aca-workload-socket\") pod \"e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd\" (UID: \"4660a7ba-4f49-4385-bb4e-e62f977d5aca\") " pod="openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd"
Sep 15 09:27:51.441280 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.441161    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phhls\" (UniqueName: \"kubernetes.io/projected/4660a7ba-4f49-4385-bb4e-e62f977d5aca-kube-api-access-phhls\") pod \"e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd\" (UID: \"4660a7ba-4f49-4385-bb4e-e62f977d5aca\") " pod="openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd"
Sep 15 09:27:51.441280 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.441185    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4660a7ba-4f49-4385-bb4e-e62f977d5aca-istio-token\") pod \"e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd\" (UID: \"4660a7ba-4f49-4385-bb4e-e62f977d5aca\") " pod="openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd"
Sep 15 09:27:51.441280 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.441264    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4660a7ba-4f49-4385-bb4e-e62f977d5aca-workload-certs\") pod \"e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd\" (UID: \"4660a7ba-4f49-4385-bb4e-e62f977d5aca\") " pod="openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd"
Sep 15 09:27:51.441501 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.441303    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4660a7ba-4f49-4385-bb4e-e62f977d5aca-istio-envoy\") pod \"e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd\" (UID: \"4660a7ba-4f49-4385-bb4e-e62f977d5aca\") " pod="openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd"
Sep 15 09:27:51.541880 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.541845    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7fj8\" (UniqueName: \"kubernetes.io/projected/eb558fdf-7208-4fae-bcf2-c92b8874e2c2-kube-api-access-z7fj8\") pod \"e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg\" (UID: \"eb558fdf-7208-4fae-bcf2-c92b8874e2c2\") " pod="openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg"
Sep 15 09:27:51.542085 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.541886    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb558fdf-7208-4fae-bcf2-c92b8874e2c2-istio-envoy\") pod \"e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg\" (UID: \"eb558fdf-7208-4fae-bcf2-c92b8874e2c2\") " pod="openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg"
Sep 15 09:27:51.542085 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.541939    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb558fdf-7208-4fae-bcf2-c92b8874e2c2-istio-podinfo\") pod \"e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg\" (UID: \"eb558fdf-7208-4fae-bcf2-c92b8874e2c2\") " pod="openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg"
Sep 15 09:27:51.542085 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.541981    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb558fdf-7208-4fae-bcf2-c92b8874e2c2-istiod-ca-cert\") pod \"e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg\" (UID: \"eb558fdf-7208-4fae-bcf2-c92b8874e2c2\") " pod="openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg"
Sep 15 09:27:51.542085 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.542058    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phhls\" (UniqueName: \"kubernetes.io/projected/4660a7ba-4f49-4385-bb4e-e62f977d5aca-kube-api-access-phhls\") pod \"e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd\" (UID: \"4660a7ba-4f49-4385-bb4e-e62f977d5aca\") " pod="openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd"
Sep 15 09:27:51.542313 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.542104    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb558fdf-7208-4fae-bcf2-c92b8874e2c2-credential-socket\") pod \"e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg\" (UID: \"eb558fdf-7208-4fae-bcf2-c92b8874e2c2\") " pod="openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg"
Sep 15 09:27:51.542313 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.542142    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4660a7ba-4f49-4385-bb4e-e62f977d5aca-credential-socket\") pod \"e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd\" (UID: \"4660a7ba-4f49-4385-bb4e-e62f977d5aca\") " pod="openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd"
Sep 15 09:27:51.542313 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.542168    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4660a7ba-4f49-4385-bb4e-e62f977d5aca-istio-token\") pod \"e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd\" (UID: \"4660a7ba-4f49-4385-bb4e-e62f977d5aca\") " pod="openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd"
Sep 15 09:27:51.542313 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.542201    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4660a7ba-4f49-4385-bb4e-e62f977d5aca-istio-podinfo\") pod \"e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd\" (UID: \"4660a7ba-4f49-4385-bb4e-e62f977d5aca\") " pod="openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd"
Sep 15 09:27:51.542313 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.542231    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4660a7ba-4f49-4385-bb4e-e62f977d5aca-workload-socket\") pod \"e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd\" (UID: \"4660a7ba-4f49-4385-bb4e-e62f977d5aca\") " pod="openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd"
Sep 15 09:27:51.542313 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.542278    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb558fdf-7208-4fae-bcf2-c92b8874e2c2-istio-data\") pod \"e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg\" (UID: \"eb558fdf-7208-4fae-bcf2-c92b8874e2c2\") " pod="openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg"
Sep 15 09:27:51.542313 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.542310    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4660a7ba-4f49-4385-bb4e-e62f977d5aca-workload-certs\") pod \"e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd\" (UID: \"4660a7ba-4f49-4385-bb4e-e62f977d5aca\") " pod="openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd"
Sep 15 09:27:51.542739 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.542346    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb558fdf-7208-4fae-bcf2-c92b8874e2c2-istio-token\") pod \"e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg\" (UID: \"eb558fdf-7208-4fae-bcf2-c92b8874e2c2\") " pod="openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg"
Sep 15 09:27:51.542739 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.542382    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4660a7ba-4f49-4385-bb4e-e62f977d5aca-istio-envoy\") pod \"e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd\" (UID: \"4660a7ba-4f49-4385-bb4e-e62f977d5aca\") " pod="openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd"
Sep 15 09:27:51.542739 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.542412    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4660a7ba-4f49-4385-bb4e-e62f977d5aca-istio-data\") pod \"e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd\" (UID: \"4660a7ba-4f49-4385-bb4e-e62f977d5aca\") " pod="openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd"
Sep 15 09:27:51.542739 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.542473    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb558fdf-7208-4fae-bcf2-c92b8874e2c2-workload-socket\") pod \"e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg\" (UID: \"eb558fdf-7208-4fae-bcf2-c92b8874e2c2\") " pod="openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg"
Sep 15 09:27:51.542739 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.542508    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4660a7ba-4f49-4385-bb4e-e62f977d5aca-istiod-ca-cert\") pod \"e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd\" (UID: \"4660a7ba-4f49-4385-bb4e-e62f977d5aca\") " pod="openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd"
Sep 15 09:27:51.542739 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.542577    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb558fdf-7208-4fae-bcf2-c92b8874e2c2-workload-certs\") pod \"e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg\" (UID: \"eb558fdf-7208-4fae-bcf2-c92b8874e2c2\") " pod="openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg"
Sep 15 09:27:51.542739 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.542617    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4660a7ba-4f49-4385-bb4e-e62f977d5aca-credential-socket\") pod \"e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd\" (UID: \"4660a7ba-4f49-4385-bb4e-e62f977d5aca\") " pod="openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd"
Sep 15 09:27:51.542739 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.542653    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4660a7ba-4f49-4385-bb4e-e62f977d5aca-workload-socket\") pod \"e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd\" (UID: \"4660a7ba-4f49-4385-bb4e-e62f977d5aca\") " pod="openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd"
Sep 15 09:27:51.542739 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.542717    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4660a7ba-4f49-4385-bb4e-e62f977d5aca-istio-data\") pod \"e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd\" (UID: \"4660a7ba-4f49-4385-bb4e-e62f977d5aca\") " pod="openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd"
Sep 15 09:27:51.543191 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.543038    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4660a7ba-4f49-4385-bb4e-e62f977d5aca-workload-certs\") pod \"e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd\" (UID: \"4660a7ba-4f49-4385-bb4e-e62f977d5aca\") " pod="openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd"
Sep 15 09:27:51.543366 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.543346    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4660a7ba-4f49-4385-bb4e-e62f977d5aca-istiod-ca-cert\") pod \"e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd\" (UID: \"4660a7ba-4f49-4385-bb4e-e62f977d5aca\") " pod="openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd"
Sep 15 09:27:51.544931 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.544907    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4660a7ba-4f49-4385-bb4e-e62f977d5aca-istio-envoy\") pod \"e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd\" (UID: \"4660a7ba-4f49-4385-bb4e-e62f977d5aca\") " pod="openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd"
Sep 15 09:27:51.545274 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.545255    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4660a7ba-4f49-4385-bb4e-e62f977d5aca-istio-podinfo\") pod \"e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd\" (UID: \"4660a7ba-4f49-4385-bb4e-e62f977d5aca\") " pod="openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd"
Sep 15 09:27:51.555152 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.555124    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4660a7ba-4f49-4385-bb4e-e62f977d5aca-istio-token\") pod \"e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd\" (UID: \"4660a7ba-4f49-4385-bb4e-e62f977d5aca\") " pod="openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd"
Sep 15 09:27:51.555623 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.555603    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phhls\" (UniqueName: \"kubernetes.io/projected/4660a7ba-4f49-4385-bb4e-e62f977d5aca-kube-api-access-phhls\") pod \"e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd\" (UID: \"4660a7ba-4f49-4385-bb4e-e62f977d5aca\") " pod="openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd"
Sep 15 09:27:51.643597 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.643498    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb558fdf-7208-4fae-bcf2-c92b8874e2c2-credential-socket\") pod \"e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg\" (UID: \"eb558fdf-7208-4fae-bcf2-c92b8874e2c2\") " pod="openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg"
Sep 15 09:27:51.643597 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.643580    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb558fdf-7208-4fae-bcf2-c92b8874e2c2-istio-data\") pod \"e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg\" (UID: \"eb558fdf-7208-4fae-bcf2-c92b8874e2c2\") " pod="openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg"
Sep 15 09:27:51.643811 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.643615    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb558fdf-7208-4fae-bcf2-c92b8874e2c2-istio-token\") pod \"e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg\" (UID: \"eb558fdf-7208-4fae-bcf2-c92b8874e2c2\") " pod="openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg"
Sep 15 09:27:51.643811 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.643661    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb558fdf-7208-4fae-bcf2-c92b8874e2c2-workload-socket\") pod \"e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg\" (UID: \"eb558fdf-7208-4fae-bcf2-c92b8874e2c2\") " pod="openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg"
Sep 15 09:27:51.643811 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.643717    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb558fdf-7208-4fae-bcf2-c92b8874e2c2-workload-certs\") pod \"e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg\" (UID: \"eb558fdf-7208-4fae-bcf2-c92b8874e2c2\") " pod="openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg"
Sep 15 09:27:51.643811 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.643749    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7fj8\" (UniqueName: \"kubernetes.io/projected/eb558fdf-7208-4fae-bcf2-c92b8874e2c2-kube-api-access-z7fj8\") pod \"e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg\" (UID: \"eb558fdf-7208-4fae-bcf2-c92b8874e2c2\") " pod="openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg"
Sep 15 09:27:51.643811 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.643778    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb558fdf-7208-4fae-bcf2-c92b8874e2c2-istio-envoy\") pod \"e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg\" (UID: \"eb558fdf-7208-4fae-bcf2-c92b8874e2c2\") " pod="openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg"
Sep 15 09:27:51.643811 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.643808    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb558fdf-7208-4fae-bcf2-c92b8874e2c2-istio-podinfo\") pod \"e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg\" (UID: \"eb558fdf-7208-4fae-bcf2-c92b8874e2c2\") " pod="openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg"
Sep 15 09:27:51.644118 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.643841    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb558fdf-7208-4fae-bcf2-c92b8874e2c2-istiod-ca-cert\") pod \"e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg\" (UID: \"eb558fdf-7208-4fae-bcf2-c92b8874e2c2\") " pod="openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg"
Sep 15 09:27:51.644118 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.643992    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb558fdf-7208-4fae-bcf2-c92b8874e2c2-istio-data\") pod \"e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg\" (UID: \"eb558fdf-7208-4fae-bcf2-c92b8874e2c2\") " pod="openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg"
Sep 15 09:27:51.644753 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.644446    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb558fdf-7208-4fae-bcf2-c92b8874e2c2-workload-socket\") pod \"e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg\" (UID: \"eb558fdf-7208-4fae-bcf2-c92b8874e2c2\") " pod="openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg"
Sep 15 09:27:51.644753 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.644594    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb558fdf-7208-4fae-bcf2-c92b8874e2c2-istiod-ca-cert\") pod \"e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg\" (UID: \"eb558fdf-7208-4fae-bcf2-c92b8874e2c2\") " pod="openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg"
Sep 15 09:27:51.645154 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.645129    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb558fdf-7208-4fae-bcf2-c92b8874e2c2-credential-socket\") pod \"e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg\" (UID: \"eb558fdf-7208-4fae-bcf2-c92b8874e2c2\") " pod="openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg"
Sep 15 09:27:51.645307 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.645287    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb558fdf-7208-4fae-bcf2-c92b8874e2c2-workload-certs\") pod \"e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg\" (UID: \"eb558fdf-7208-4fae-bcf2-c92b8874e2c2\") " pod="openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg"
Sep 15 09:27:51.646071 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.645854    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd"
Sep 15 09:27:51.649120 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.649076    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb558fdf-7208-4fae-bcf2-c92b8874e2c2-istio-envoy\") pod \"e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg\" (UID: \"eb558fdf-7208-4fae-bcf2-c92b8874e2c2\") " pod="openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg"
Sep 15 09:27:51.653867 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.653582    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb558fdf-7208-4fae-bcf2-c92b8874e2c2-istio-podinfo\") pod \"e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg\" (UID: \"eb558fdf-7208-4fae-bcf2-c92b8874e2c2\") " pod="openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg"
Sep 15 09:27:51.658382 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.658339    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb558fdf-7208-4fae-bcf2-c92b8874e2c2-istio-token\") pod \"e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg\" (UID: \"eb558fdf-7208-4fae-bcf2-c92b8874e2c2\") " pod="openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg"
Sep 15 09:27:51.661041 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.660725    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7fj8\" (UniqueName: \"kubernetes.io/projected/eb558fdf-7208-4fae-bcf2-c92b8874e2c2-kube-api-access-z7fj8\") pod \"e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg\" (UID: \"eb558fdf-7208-4fae-bcf2-c92b8874e2c2\") " pod="openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg"
Sep 15 09:27:51.710647 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.710597    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg"
Sep 15 09:27:51.937551 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.937522    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd"]
Sep 15 09:27:51.940018 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:27:51.939988    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4660a7ba_4f49_4385_bb4e_e62f977d5aca.slice/crio-91c12b3e0e96e94479c1e2699e1199eb1fae4817674ad35aa810cf1d971ead02 WatchSource:0}: Error finding container 91c12b3e0e96e94479c1e2699e1199eb1fae4817674ad35aa810cf1d971ead02: Status 404 returned error can't find the container with id 91c12b3e0e96e94479c1e2699e1199eb1fae4817674ad35aa810cf1d971ead02
Sep 15 09:27:51.942055 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.942022    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:27:51.942121 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.942086    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:27:51.942160 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.942119    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:27:51.996886 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:51.996864    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg"]
Sep 15 09:27:51.999432 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:27:51.999404    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb558fdf_7208_4fae_bcf2_c92b8874e2c2.slice/crio-a0c9955f42bb9e40a07d11e8e0b8d75b91070d370a9e4f0c049081e2c444f05b WatchSource:0}: Error finding container a0c9955f42bb9e40a07d11e8e0b8d75b91070d370a9e4f0c049081e2c444f05b: Status 404 returned error can't find the container with id a0c9955f42bb9e40a07d11e8e0b8d75b91070d370a9e4f0c049081e2c444f05b
Sep 15 09:27:52.001561 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:52.001529    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:27:52.001648 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:52.001604    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:27:52.001712 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:52.001648    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:27:52.061865 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:52.061830    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd" event={"ID":"4660a7ba-4f49-4385-bb4e-e62f977d5aca","Type":"ContainerStarted","Data":"70fc3a8d8557d7ca827499a4ed63fd31d56928c7608a9386aabaf52e7d4c7941"}
Sep 15 09:27:52.062004 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:52.061890    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd" event={"ID":"4660a7ba-4f49-4385-bb4e-e62f977d5aca","Type":"ContainerStarted","Data":"91c12b3e0e96e94479c1e2699e1199eb1fae4817674ad35aa810cf1d971ead02"}
Sep 15 09:27:52.064208 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:52.063811    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg" event={"ID":"eb558fdf-7208-4fae-bcf2-c92b8874e2c2","Type":"ContainerStarted","Data":"3526c9eb97f161eef442f259ade4fc58bbab37703ec48b5214cddea64bd090fa"}
Sep 15 09:27:52.064208 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:52.063869    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg" event={"ID":"eb558fdf-7208-4fae-bcf2-c92b8874e2c2","Type":"ContainerStarted","Data":"a0c9955f42bb9e40a07d11e8e0b8d75b91070d370a9e4f0c049081e2c444f05b"}
Sep 15 09:27:52.106173 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:52.102013    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg" podStartSLOduration=1.101988959 podStartE2EDuration="1.101988959s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:27:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:27:52.100820353 +0000 UTC m=+816.439265628" watchObservedRunningTime="2026-09-15 09:27:52.101988959 +0000 UTC m=+816.440434291"
Sep 15 09:27:52.106173 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:52.104490    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd" podStartSLOduration=1.104473345 podStartE2EDuration="1.104473345s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:27:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:27:52.082293543 +0000 UTC m=+816.420738813" watchObservedRunningTime="2026-09-15 09:27:52.104473345 +0000 UTC m=+816.442918620"
Sep 15 09:27:52.647035 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:52.646994    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd"
Sep 15 09:27:52.711062 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:52.711012    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg"
Sep 15 09:27:53.651063 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:53.651032    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd"
Sep 15 09:27:53.715934 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:53.715898    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg"
Sep 15 09:27:54.075707 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:54.075679    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg"
Sep 15 09:27:54.075873 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:54.075857    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd"
Sep 15 09:27:54.076391 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:54.076372    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg"
Sep 15 09:27:54.076490 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:54.076423    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd"
Sep 15 09:27:59.872049 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:59.872017    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h"]
Sep 15 09:27:59.876737 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:59.876716    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h"
Sep 15 09:27:59.879498 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:59.879474    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-3b0480-openshift-default-dockercfg-97fjq\""
Sep 15 09:27:59.901899 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:27:59.901877    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h"]
Sep 15 09:28:00.020864 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.020835    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95e679bc-84f2-4d8d-8d0c-20dc54488321-credential-socket\") pod \"e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h\" (UID: \"95e679bc-84f2-4d8d-8d0c-20dc54488321\") " pod="openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h"
Sep 15 09:28:00.021030 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.020879    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95e679bc-84f2-4d8d-8d0c-20dc54488321-istio-data\") pod \"e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h\" (UID: \"95e679bc-84f2-4d8d-8d0c-20dc54488321\") " pod="openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h"
Sep 15 09:28:00.021030 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.020906    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95e679bc-84f2-4d8d-8d0c-20dc54488321-istio-podinfo\") pod \"e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h\" (UID: \"95e679bc-84f2-4d8d-8d0c-20dc54488321\") " pod="openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h"
Sep 15 09:28:00.021030 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.021013    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95e679bc-84f2-4d8d-8d0c-20dc54488321-workload-certs\") pod \"e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h\" (UID: \"95e679bc-84f2-4d8d-8d0c-20dc54488321\") " pod="openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h"
Sep 15 09:28:00.021195 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.021060    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95e679bc-84f2-4d8d-8d0c-20dc54488321-istio-envoy\") pod \"e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h\" (UID: \"95e679bc-84f2-4d8d-8d0c-20dc54488321\") " pod="openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h"
Sep 15 09:28:00.021195 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.021095    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95e679bc-84f2-4d8d-8d0c-20dc54488321-istio-token\") pod \"e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h\" (UID: \"95e679bc-84f2-4d8d-8d0c-20dc54488321\") " pod="openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h"
Sep 15 09:28:00.021195 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.021129    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95e679bc-84f2-4d8d-8d0c-20dc54488321-istiod-ca-cert\") pod \"e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h\" (UID: \"95e679bc-84f2-4d8d-8d0c-20dc54488321\") " pod="openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h"
Sep 15 09:28:00.021297 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.021197    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95e679bc-84f2-4d8d-8d0c-20dc54488321-workload-socket\") pod \"e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h\" (UID: \"95e679bc-84f2-4d8d-8d0c-20dc54488321\") " pod="openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h"
Sep 15 09:28:00.021297 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.021236    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klpcj\" (UniqueName: \"kubernetes.io/projected/95e679bc-84f2-4d8d-8d0c-20dc54488321-kube-api-access-klpcj\") pod \"e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h\" (UID: \"95e679bc-84f2-4d8d-8d0c-20dc54488321\") " pod="openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h"
Sep 15 09:28:00.121716 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.121688    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95e679bc-84f2-4d8d-8d0c-20dc54488321-istiod-ca-cert\") pod \"e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h\" (UID: \"95e679bc-84f2-4d8d-8d0c-20dc54488321\") " pod="openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h"
Sep 15 09:28:00.121881 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.121737    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95e679bc-84f2-4d8d-8d0c-20dc54488321-workload-socket\") pod \"e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h\" (UID: \"95e679bc-84f2-4d8d-8d0c-20dc54488321\") " pod="openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h"
Sep 15 09:28:00.121881 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.121828    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klpcj\" (UniqueName: \"kubernetes.io/projected/95e679bc-84f2-4d8d-8d0c-20dc54488321-kube-api-access-klpcj\") pod \"e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h\" (UID: \"95e679bc-84f2-4d8d-8d0c-20dc54488321\") " pod="openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h"
Sep 15 09:28:00.121881 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.121854    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95e679bc-84f2-4d8d-8d0c-20dc54488321-credential-socket\") pod \"e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h\" (UID: \"95e679bc-84f2-4d8d-8d0c-20dc54488321\") " pod="openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h"
Sep 15 09:28:00.122123 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.121893    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95e679bc-84f2-4d8d-8d0c-20dc54488321-istio-data\") pod \"e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h\" (UID: \"95e679bc-84f2-4d8d-8d0c-20dc54488321\") " pod="openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h"
Sep 15 09:28:00.122123 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.121928    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95e679bc-84f2-4d8d-8d0c-20dc54488321-istio-podinfo\") pod \"e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h\" (UID: \"95e679bc-84f2-4d8d-8d0c-20dc54488321\") " pod="openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h"
Sep 15 09:28:00.122123 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.121999    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95e679bc-84f2-4d8d-8d0c-20dc54488321-workload-certs\") pod \"e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h\" (UID: \"95e679bc-84f2-4d8d-8d0c-20dc54488321\") " pod="openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h"
Sep 15 09:28:00.122123 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.122038    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95e679bc-84f2-4d8d-8d0c-20dc54488321-istio-envoy\") pod \"e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h\" (UID: \"95e679bc-84f2-4d8d-8d0c-20dc54488321\") " pod="openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h"
Sep 15 09:28:00.122123 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.122067    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95e679bc-84f2-4d8d-8d0c-20dc54488321-istio-token\") pod \"e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h\" (UID: \"95e679bc-84f2-4d8d-8d0c-20dc54488321\") " pod="openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h"
Sep 15 09:28:00.122408 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.122203    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95e679bc-84f2-4d8d-8d0c-20dc54488321-workload-socket\") pod \"e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h\" (UID: \"95e679bc-84f2-4d8d-8d0c-20dc54488321\") " pod="openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h"
Sep 15 09:28:00.122408 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.122260    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95e679bc-84f2-4d8d-8d0c-20dc54488321-credential-socket\") pod \"e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h\" (UID: \"95e679bc-84f2-4d8d-8d0c-20dc54488321\") " pod="openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h"
Sep 15 09:28:00.122408 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.122372    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95e679bc-84f2-4d8d-8d0c-20dc54488321-workload-certs\") pod \"e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h\" (UID: \"95e679bc-84f2-4d8d-8d0c-20dc54488321\") " pod="openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h"
Sep 15 09:28:00.122560 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.122439    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95e679bc-84f2-4d8d-8d0c-20dc54488321-istiod-ca-cert\") pod \"e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h\" (UID: \"95e679bc-84f2-4d8d-8d0c-20dc54488321\") " pod="openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h"
Sep 15 09:28:00.122560 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.122458    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95e679bc-84f2-4d8d-8d0c-20dc54488321-istio-data\") pod \"e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h\" (UID: \"95e679bc-84f2-4d8d-8d0c-20dc54488321\") " pod="openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h"
Sep 15 09:28:00.124419 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.124397    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95e679bc-84f2-4d8d-8d0c-20dc54488321-istio-envoy\") pod \"e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h\" (UID: \"95e679bc-84f2-4d8d-8d0c-20dc54488321\") " pod="openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h"
Sep 15 09:28:00.124503 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.124491    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95e679bc-84f2-4d8d-8d0c-20dc54488321-istio-podinfo\") pod \"e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h\" (UID: \"95e679bc-84f2-4d8d-8d0c-20dc54488321\") " pod="openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h"
Sep 15 09:28:00.129567 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.129541    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95e679bc-84f2-4d8d-8d0c-20dc54488321-istio-token\") pod \"e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h\" (UID: \"95e679bc-84f2-4d8d-8d0c-20dc54488321\") " pod="openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h"
Sep 15 09:28:00.129695 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.129679    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klpcj\" (UniqueName: \"kubernetes.io/projected/95e679bc-84f2-4d8d-8d0c-20dc54488321-kube-api-access-klpcj\") pod \"e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h\" (UID: \"95e679bc-84f2-4d8d-8d0c-20dc54488321\") " pod="openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h"
Sep 15 09:28:00.186855 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.186833    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h"
Sep 15 09:28:00.230768 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.230387    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5"]
Sep 15 09:28:00.234228 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.234205    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5"
Sep 15 09:28:00.236655 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.236630    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-c6646b4b-openshift-default-dockercfg-c7xng\""
Sep 15 09:28:00.243750 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.243730    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5"]
Sep 15 09:28:00.324696 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.324657    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cd961d8-10d4-4470-8136-74fbcc253a93-istio-data\") pod \"e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5\" (UID: \"6cd961d8-10d4-4470-8136-74fbcc253a93\") " pod="openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5"
Sep 15 09:28:00.324869 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.324725    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cd961d8-10d4-4470-8136-74fbcc253a93-istio-podinfo\") pod \"e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5\" (UID: \"6cd961d8-10d4-4470-8136-74fbcc253a93\") " pod="openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5"
Sep 15 09:28:00.324869 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.324764    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cd961d8-10d4-4470-8136-74fbcc253a93-istio-token\") pod \"e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5\" (UID: \"6cd961d8-10d4-4470-8136-74fbcc253a93\") " pod="openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5"
Sep 15 09:28:00.324869 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.324833    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cd961d8-10d4-4470-8136-74fbcc253a93-istiod-ca-cert\") pod \"e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5\" (UID: \"6cd961d8-10d4-4470-8136-74fbcc253a93\") " pod="openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5"
Sep 15 09:28:00.325064 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.324970    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cd961d8-10d4-4470-8136-74fbcc253a93-workload-certs\") pod \"e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5\" (UID: \"6cd961d8-10d4-4470-8136-74fbcc253a93\") " pod="openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5"
Sep 15 09:28:00.325064 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.324998    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhxc2\" (UniqueName: \"kubernetes.io/projected/6cd961d8-10d4-4470-8136-74fbcc253a93-kube-api-access-lhxc2\") pod \"e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5\" (UID: \"6cd961d8-10d4-4470-8136-74fbcc253a93\") " pod="openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5"
Sep 15 09:28:00.325064 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.325026    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd961d8-10d4-4470-8136-74fbcc253a93-workload-socket\") pod \"e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5\" (UID: \"6cd961d8-10d4-4470-8136-74fbcc253a93\") " pod="openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5"
Sep 15 09:28:00.325215 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.325049    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd961d8-10d4-4470-8136-74fbcc253a93-credential-socket\") pod \"e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5\" (UID: \"6cd961d8-10d4-4470-8136-74fbcc253a93\") " pod="openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5"
Sep 15 09:28:00.325215 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.325131    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cd961d8-10d4-4470-8136-74fbcc253a93-istio-envoy\") pod \"e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5\" (UID: \"6cd961d8-10d4-4470-8136-74fbcc253a93\") " pod="openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5"
Sep 15 09:28:00.426481 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.426397    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cd961d8-10d4-4470-8136-74fbcc253a93-workload-certs\") pod \"e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5\" (UID: \"6cd961d8-10d4-4470-8136-74fbcc253a93\") " pod="openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5"
Sep 15 09:28:00.426481 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.426430    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhxc2\" (UniqueName: \"kubernetes.io/projected/6cd961d8-10d4-4470-8136-74fbcc253a93-kube-api-access-lhxc2\") pod \"e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5\" (UID: \"6cd961d8-10d4-4470-8136-74fbcc253a93\") " pod="openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5"
Sep 15 09:28:00.426481 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.426457    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd961d8-10d4-4470-8136-74fbcc253a93-workload-socket\") pod \"e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5\" (UID: \"6cd961d8-10d4-4470-8136-74fbcc253a93\") " pod="openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5"
Sep 15 09:28:00.426763 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.426633    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd961d8-10d4-4470-8136-74fbcc253a93-credential-socket\") pod \"e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5\" (UID: \"6cd961d8-10d4-4470-8136-74fbcc253a93\") " pod="openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5"
Sep 15 09:28:00.426763 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.426685    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cd961d8-10d4-4470-8136-74fbcc253a93-istio-envoy\") pod \"e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5\" (UID: \"6cd961d8-10d4-4470-8136-74fbcc253a93\") " pod="openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5"
Sep 15 09:28:00.426763 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.426739    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cd961d8-10d4-4470-8136-74fbcc253a93-istio-data\") pod \"e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5\" (UID: \"6cd961d8-10d4-4470-8136-74fbcc253a93\") " pod="openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5"
Sep 15 09:28:00.426917 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.426780    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cd961d8-10d4-4470-8136-74fbcc253a93-istio-podinfo\") pod \"e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5\" (UID: \"6cd961d8-10d4-4470-8136-74fbcc253a93\") " pod="openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5"
Sep 15 09:28:00.426917 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.426817    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cd961d8-10d4-4470-8136-74fbcc253a93-istio-token\") pod \"e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5\" (UID: \"6cd961d8-10d4-4470-8136-74fbcc253a93\") " pod="openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5"
Sep 15 09:28:00.426917 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.426828    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd961d8-10d4-4470-8136-74fbcc253a93-workload-socket\") pod \"e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5\" (UID: \"6cd961d8-10d4-4470-8136-74fbcc253a93\") " pod="openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5"
Sep 15 09:28:00.426917 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.426847    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cd961d8-10d4-4470-8136-74fbcc253a93-workload-certs\") pod \"e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5\" (UID: \"6cd961d8-10d4-4470-8136-74fbcc253a93\") " pod="openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5"
Sep 15 09:28:00.426917 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.426909    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cd961d8-10d4-4470-8136-74fbcc253a93-istiod-ca-cert\") pod \"e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5\" (UID: \"6cd961d8-10d4-4470-8136-74fbcc253a93\") " pod="openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5"
Sep 15 09:28:00.427198 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.426927    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd961d8-10d4-4470-8136-74fbcc253a93-credential-socket\") pod \"e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5\" (UID: \"6cd961d8-10d4-4470-8136-74fbcc253a93\") " pod="openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5"
Sep 15 09:28:00.427198 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.427134    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cd961d8-10d4-4470-8136-74fbcc253a93-istio-data\") pod \"e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5\" (UID: \"6cd961d8-10d4-4470-8136-74fbcc253a93\") " pod="openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5"
Sep 15 09:28:00.427535 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.427519    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cd961d8-10d4-4470-8136-74fbcc253a93-istiod-ca-cert\") pod \"e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5\" (UID: \"6cd961d8-10d4-4470-8136-74fbcc253a93\") " pod="openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5"
Sep 15 09:28:00.429090 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.429065    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cd961d8-10d4-4470-8136-74fbcc253a93-istio-envoy\") pod \"e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5\" (UID: \"6cd961d8-10d4-4470-8136-74fbcc253a93\") " pod="openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5"
Sep 15 09:28:00.429225 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.429211    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cd961d8-10d4-4470-8136-74fbcc253a93-istio-podinfo\") pod \"e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5\" (UID: \"6cd961d8-10d4-4470-8136-74fbcc253a93\") " pod="openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5"
Sep 15 09:28:00.434904 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.434882    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cd961d8-10d4-4470-8136-74fbcc253a93-istio-token\") pod \"e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5\" (UID: \"6cd961d8-10d4-4470-8136-74fbcc253a93\") " pod="openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5"
Sep 15 09:28:00.435113 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.435096    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhxc2\" (UniqueName: \"kubernetes.io/projected/6cd961d8-10d4-4470-8136-74fbcc253a93-kube-api-access-lhxc2\") pod \"e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5\" (UID: \"6cd961d8-10d4-4470-8136-74fbcc253a93\") " pod="openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5"
Sep 15 09:28:00.473072 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:28:00.473051    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95e679bc_84f2_4d8d_8d0c_20dc54488321.slice/crio-3f8a7446655ee49d4f9f4382b7d0b54d4f14d3ac58594e364aa3bdbf0a0a929f WatchSource:0}: Error finding container 3f8a7446655ee49d4f9f4382b7d0b54d4f14d3ac58594e364aa3bdbf0a0a929f: Status 404 returned error can't find the container with id 3f8a7446655ee49d4f9f4382b7d0b54d4f14d3ac58594e364aa3bdbf0a0a929f
Sep 15 09:28:00.473185 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.473164    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h"]
Sep 15 09:28:00.475320 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.475292    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:28:00.475398 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.475353    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:28:00.475398 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.475380    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:28:00.552608 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.552585    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5"
Sep 15 09:28:00.838306 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.838277    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5"]
Sep 15 09:28:00.839590 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:28:00.839560    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cd961d8_10d4_4470_8136_74fbcc253a93.slice/crio-9227d747bd2c0d5686d4425f0038acae3874358365c44d13ff04e8a784d32ba3 WatchSource:0}: Error finding container 9227d747bd2c0d5686d4425f0038acae3874358365c44d13ff04e8a784d32ba3: Status 404 returned error can't find the container with id 9227d747bd2c0d5686d4425f0038acae3874358365c44d13ff04e8a784d32ba3
Sep 15 09:28:00.841868 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.841836    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:28:00.841968 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.841899    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:28:00.841968 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:00.841930    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:28:01.118192 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:01.118114    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h" event={"ID":"95e679bc-84f2-4d8d-8d0c-20dc54488321","Type":"ContainerStarted","Data":"aa7ed4c861d7d1c02722c68e6d094819b06f1a98c22d7d6c6c0e1f8e29c20bba"}
Sep 15 09:28:01.118192 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:01.118173    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h" event={"ID":"95e679bc-84f2-4d8d-8d0c-20dc54488321","Type":"ContainerStarted","Data":"3f8a7446655ee49d4f9f4382b7d0b54d4f14d3ac58594e364aa3bdbf0a0a929f"}
Sep 15 09:28:01.119847 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:01.119819    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5" event={"ID":"6cd961d8-10d4-4470-8136-74fbcc253a93","Type":"ContainerStarted","Data":"e7d0ecdbde3aaf44f9db5ef51d029ed82a7a590f41e8ee59b1616024705e3432"}
Sep 15 09:28:01.120005 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:01.119859    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5" event={"ID":"6cd961d8-10d4-4470-8136-74fbcc253a93","Type":"ContainerStarted","Data":"9227d747bd2c0d5686d4425f0038acae3874358365c44d13ff04e8a784d32ba3"}
Sep 15 09:28:01.136413 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:01.136365    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h" podStartSLOduration=2.13634601 podStartE2EDuration="2.13634601s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:27:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:28:01.135544171 +0000 UTC m=+825.473989447" watchObservedRunningTime="2026-09-15 09:28:01.13634601 +0000 UTC m=+825.474791288"
Sep 15 09:28:01.155413 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:01.155372    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5" podStartSLOduration=1.155359075 podStartE2EDuration="1.155359075s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:28:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:28:01.152878923 +0000 UTC m=+825.491324199" watchObservedRunningTime="2026-09-15 09:28:01.155359075 +0000 UTC m=+825.493804386"
Sep 15 09:28:01.187883 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:01.187859    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h"
Sep 15 09:28:01.192493 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:01.192473    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h"
Sep 15 09:28:01.553729 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:01.553699    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5"
Sep 15 09:28:01.558763 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:01.558741    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5"
Sep 15 09:28:02.125847 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:02.125814    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h"
Sep 15 09:28:02.126313 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:02.125870    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5"
Sep 15 09:28:02.126635 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:02.126615    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h"
Sep 15 09:28:02.126754 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:02.126739    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5"
Sep 15 09:28:08.328235 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:08.328192    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c6646b4b-77bff5fbb6-5pk66"]
Sep 15 09:28:08.333172 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:08.333142    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-c6646b4b-77bff5fbb6-5pk66"
Sep 15 09:28:08.338970 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:08.336240    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-c6646b4b\""
Sep 15 09:28:08.346836 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:08.346810    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c6646b4b-77bff5fbb6-5pk66"]
Sep 15 09:28:08.374963 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:08.374910    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c6646b4b-ccdd7665c-fxkb4"]
Sep 15 09:28:08.381067 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:08.380158    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c6646b4b-ccdd7665c-fxkb4"
Sep 15 09:28:08.381275 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:08.381222    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c6646b4b-ccdd7665c-fxkb4"]
Sep 15 09:28:08.382620 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:08.382595    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-c6646b4b-dockercfg-89b52\""
Sep 15 09:28:08.412198 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:08.412174    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hp4f\" (UniqueName: \"kubernetes.io/projected/291d8a37-0096-48d4-be44-3dc59e1460c2-kube-api-access-5hp4f\") pod \"payload-pre-processing-e2e-ait-c6646b4b-77bff5fbb6-5pk66\" (UID: \"291d8a37-0096-48d4-be44-3dc59e1460c2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c6646b4b-77bff5fbb6-5pk66"
Sep 15 09:28:08.412306 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:08.412229    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b6f53264-6d63-4e49-bbcc-d4fce6307ebe-plugins-config-volume\") pod \"payload-processing-e2e-ait-c6646b4b-ccdd7665c-fxkb4\" (UID: \"b6f53264-6d63-4e49-bbcc-d4fce6307ebe\") " pod="openshift-ingress/payload-processing-e2e-ait-c6646b4b-ccdd7665c-fxkb4"
Sep 15 09:28:08.412348 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:08.412306    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/291d8a37-0096-48d4-be44-3dc59e1460c2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-c6646b4b-77bff5fbb6-5pk66\" (UID: \"291d8a37-0096-48d4-be44-3dc59e1460c2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c6646b4b-77bff5fbb6-5pk66"
Sep 15 09:28:08.412348 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:08.412332    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cn22x\" (UniqueName: \"kubernetes.io/projected/b6f53264-6d63-4e49-bbcc-d4fce6307ebe-kube-api-access-cn22x\") pod \"payload-processing-e2e-ait-c6646b4b-ccdd7665c-fxkb4\" (UID: \"b6f53264-6d63-4e49-bbcc-d4fce6307ebe\") " pod="openshift-ingress/payload-processing-e2e-ait-c6646b4b-ccdd7665c-fxkb4"
Sep 15 09:28:08.513532 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:08.513499    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/291d8a37-0096-48d4-be44-3dc59e1460c2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-c6646b4b-77bff5fbb6-5pk66\" (UID: \"291d8a37-0096-48d4-be44-3dc59e1460c2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c6646b4b-77bff5fbb6-5pk66"
Sep 15 09:28:08.513729 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:08.513550    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn22x\" (UniqueName: \"kubernetes.io/projected/b6f53264-6d63-4e49-bbcc-d4fce6307ebe-kube-api-access-cn22x\") pod \"payload-processing-e2e-ait-c6646b4b-ccdd7665c-fxkb4\" (UID: \"b6f53264-6d63-4e49-bbcc-d4fce6307ebe\") " pod="openshift-ingress/payload-processing-e2e-ait-c6646b4b-ccdd7665c-fxkb4"
Sep 15 09:28:08.513729 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:08.513616    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hp4f\" (UniqueName: \"kubernetes.io/projected/291d8a37-0096-48d4-be44-3dc59e1460c2-kube-api-access-5hp4f\") pod \"payload-pre-processing-e2e-ait-c6646b4b-77bff5fbb6-5pk66\" (UID: \"291d8a37-0096-48d4-be44-3dc59e1460c2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c6646b4b-77bff5fbb6-5pk66"
Sep 15 09:28:08.513729 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:08.513724    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b6f53264-6d63-4e49-bbcc-d4fce6307ebe-plugins-config-volume\") pod \"payload-processing-e2e-ait-c6646b4b-ccdd7665c-fxkb4\" (UID: \"b6f53264-6d63-4e49-bbcc-d4fce6307ebe\") " pod="openshift-ingress/payload-processing-e2e-ait-c6646b4b-ccdd7665c-fxkb4"
Sep 15 09:28:08.517970 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:08.514419    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/291d8a37-0096-48d4-be44-3dc59e1460c2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-c6646b4b-77bff5fbb6-5pk66\" (UID: \"291d8a37-0096-48d4-be44-3dc59e1460c2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c6646b4b-77bff5fbb6-5pk66"
Sep 15 09:28:08.517970 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:08.514803    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b6f53264-6d63-4e49-bbcc-d4fce6307ebe-plugins-config-volume\") pod \"payload-processing-e2e-ait-c6646b4b-ccdd7665c-fxkb4\" (UID: \"b6f53264-6d63-4e49-bbcc-d4fce6307ebe\") " pod="openshift-ingress/payload-processing-e2e-ait-c6646b4b-ccdd7665c-fxkb4"
Sep 15 09:28:08.537823 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:08.537799    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hp4f\" (UniqueName: \"kubernetes.io/projected/291d8a37-0096-48d4-be44-3dc59e1460c2-kube-api-access-5hp4f\") pod \"payload-pre-processing-e2e-ait-c6646b4b-77bff5fbb6-5pk66\" (UID: \"291d8a37-0096-48d4-be44-3dc59e1460c2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c6646b4b-77bff5fbb6-5pk66"
Sep 15 09:28:08.553714 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:08.553691    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cn22x\" (UniqueName: \"kubernetes.io/projected/b6f53264-6d63-4e49-bbcc-d4fce6307ebe-kube-api-access-cn22x\") pod \"payload-processing-e2e-ait-c6646b4b-ccdd7665c-fxkb4\" (UID: \"b6f53264-6d63-4e49-bbcc-d4fce6307ebe\") " pod="openshift-ingress/payload-processing-e2e-ait-c6646b4b-ccdd7665c-fxkb4"
Sep 15 09:28:08.666617 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:08.666527    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-c6646b4b-77bff5fbb6-5pk66"
Sep 15 09:28:08.691500 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:08.691477    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c6646b4b-ccdd7665c-fxkb4"
Sep 15 09:28:08.972812 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:08.972782    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c6646b4b-77bff5fbb6-5pk66"]
Sep 15 09:28:08.975082 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:28:08.975059    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod291d8a37_0096_48d4_be44_3dc59e1460c2.slice/crio-9ecf45f283a92cec1d4d08f1807d74c9b126493e35eeb101c123ffa254b93026 WatchSource:0}: Error finding container 9ecf45f283a92cec1d4d08f1807d74c9b126493e35eeb101c123ffa254b93026: Status 404 returned error can't find the container with id 9ecf45f283a92cec1d4d08f1807d74c9b126493e35eeb101c123ffa254b93026
Sep 15 09:28:09.086031 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:09.086003    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c6646b4b-ccdd7665c-fxkb4"]
Sep 15 09:28:09.087380 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:28:09.087354    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6f53264_6d63_4e49_bbcc_d4fce6307ebe.slice/crio-270e1f40c436f324f77fa692586123dba27c49f348531f82ccd240475d0ff82b WatchSource:0}: Error finding container 270e1f40c436f324f77fa692586123dba27c49f348531f82ccd240475d0ff82b: Status 404 returned error can't find the container with id 270e1f40c436f324f77fa692586123dba27c49f348531f82ccd240475d0ff82b
Sep 15 09:28:09.189507 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:09.189476    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-c6646b4b-77bff5fbb6-5pk66" event={"ID":"291d8a37-0096-48d4-be44-3dc59e1460c2","Type":"ContainerStarted","Data":"9ecf45f283a92cec1d4d08f1807d74c9b126493e35eeb101c123ffa254b93026"}
Sep 15 09:28:09.190632 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:09.190609    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c6646b4b-ccdd7665c-fxkb4" event={"ID":"b6f53264-6d63-4e49-bbcc-d4fce6307ebe","Type":"ContainerStarted","Data":"270e1f40c436f324f77fa692586123dba27c49f348531f82ccd240475d0ff82b"}
Sep 15 09:28:09.395092 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:09.395006    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b"]
Sep 15 09:28:09.400464 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:09.400441    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b"
Sep 15 09:28:09.403624 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:09.403604    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-0e280a-openshift-default-dockercfg-ltq8r\""
Sep 15 09:28:09.413422 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:09.413399    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b"]
Sep 15 09:28:09.443966 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:09.443448    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10b84bc2-3e88-4e79-bbc7-4213e33de1aa-istio-podinfo\") pod \"e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b\" (UID: \"10b84bc2-3e88-4e79-bbc7-4213e33de1aa\") " pod="openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b"
Sep 15 09:28:09.443966 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:09.443538    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10b84bc2-3e88-4e79-bbc7-4213e33de1aa-credential-socket\") pod \"e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b\" (UID: \"10b84bc2-3e88-4e79-bbc7-4213e33de1aa\") " pod="openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b"
Sep 15 09:28:09.443966 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:09.443573    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10b84bc2-3e88-4e79-bbc7-4213e33de1aa-istio-envoy\") pod \"e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b\" (UID: \"10b84bc2-3e88-4e79-bbc7-4213e33de1aa\") " pod="openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b"
Sep 15 09:28:09.443966 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:09.443606    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10b84bc2-3e88-4e79-bbc7-4213e33de1aa-istio-token\") pod \"e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b\" (UID: \"10b84bc2-3e88-4e79-bbc7-4213e33de1aa\") " pod="openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b"
Sep 15 09:28:09.443966 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:09.443648    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2874\" (UniqueName: \"kubernetes.io/projected/10b84bc2-3e88-4e79-bbc7-4213e33de1aa-kube-api-access-g2874\") pod \"e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b\" (UID: \"10b84bc2-3e88-4e79-bbc7-4213e33de1aa\") " pod="openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b"
Sep 15 09:28:09.443966 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:09.443685    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10b84bc2-3e88-4e79-bbc7-4213e33de1aa-istio-data\") pod \"e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b\" (UID: \"10b84bc2-3e88-4e79-bbc7-4213e33de1aa\") " pod="openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b"
Sep 15 09:28:09.443966 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:09.443739    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10b84bc2-3e88-4e79-bbc7-4213e33de1aa-istiod-ca-cert\") pod \"e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b\" (UID: \"10b84bc2-3e88-4e79-bbc7-4213e33de1aa\") " pod="openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b"
Sep 15 09:28:09.443966 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:09.443777    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10b84bc2-3e88-4e79-bbc7-4213e33de1aa-workload-certs\") pod \"e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b\" (UID: \"10b84bc2-3e88-4e79-bbc7-4213e33de1aa\") " pod="openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b"
Sep 15 09:28:09.443966 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:09.443848    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10b84bc2-3e88-4e79-bbc7-4213e33de1aa-workload-socket\") pod \"e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b\" (UID: \"10b84bc2-3e88-4e79-bbc7-4213e33de1aa\") " pod="openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b"
Sep 15 09:28:09.545975 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:09.544645    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10b84bc2-3e88-4e79-bbc7-4213e33de1aa-workload-socket\") pod \"e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b\" (UID: \"10b84bc2-3e88-4e79-bbc7-4213e33de1aa\") " pod="openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b"
Sep 15 09:28:09.545975 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:09.544711    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10b84bc2-3e88-4e79-bbc7-4213e33de1aa-istio-podinfo\") pod \"e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b\" (UID: \"10b84bc2-3e88-4e79-bbc7-4213e33de1aa\") " pod="openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b"
Sep 15 09:28:09.545975 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:09.544776    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10b84bc2-3e88-4e79-bbc7-4213e33de1aa-credential-socket\") pod \"e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b\" (UID: \"10b84bc2-3e88-4e79-bbc7-4213e33de1aa\") " pod="openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b"
Sep 15 09:28:09.545975 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:09.544807    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10b84bc2-3e88-4e79-bbc7-4213e33de1aa-istio-envoy\") pod \"e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b\" (UID: \"10b84bc2-3e88-4e79-bbc7-4213e33de1aa\") " pod="openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b"
Sep 15 09:28:09.545975 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:09.544839    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10b84bc2-3e88-4e79-bbc7-4213e33de1aa-istio-token\") pod \"e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b\" (UID: \"10b84bc2-3e88-4e79-bbc7-4213e33de1aa\") " pod="openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b"
Sep 15 09:28:09.545975 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:09.544865    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2874\" (UniqueName: \"kubernetes.io/projected/10b84bc2-3e88-4e79-bbc7-4213e33de1aa-kube-api-access-g2874\") pod \"e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b\" (UID: \"10b84bc2-3e88-4e79-bbc7-4213e33de1aa\") " pod="openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b"
Sep 15 09:28:09.545975 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:09.544904    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10b84bc2-3e88-4e79-bbc7-4213e33de1aa-istio-data\") pod \"e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b\" (UID: \"10b84bc2-3e88-4e79-bbc7-4213e33de1aa\") " pod="openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b"
Sep 15 09:28:09.545975 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:09.544978    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10b84bc2-3e88-4e79-bbc7-4213e33de1aa-istiod-ca-cert\") pod \"e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b\" (UID: \"10b84bc2-3e88-4e79-bbc7-4213e33de1aa\") " pod="openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b"
Sep 15 09:28:09.545975 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:09.545016    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10b84bc2-3e88-4e79-bbc7-4213e33de1aa-workload-certs\") pod \"e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b\" (UID: \"10b84bc2-3e88-4e79-bbc7-4213e33de1aa\") " pod="openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b"
Sep 15 09:28:09.545975 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:09.545463    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10b84bc2-3e88-4e79-bbc7-4213e33de1aa-workload-certs\") pod \"e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b\" (UID: \"10b84bc2-3e88-4e79-bbc7-4213e33de1aa\") " pod="openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b"
Sep 15 09:28:09.545975 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:09.545704    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10b84bc2-3e88-4e79-bbc7-4213e33de1aa-workload-socket\") pod \"e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b\" (UID: \"10b84bc2-3e88-4e79-bbc7-4213e33de1aa\") " pod="openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b"
Sep 15 09:28:09.547850 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:09.547583    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10b84bc2-3e88-4e79-bbc7-4213e33de1aa-credential-socket\") pod \"e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b\" (UID: \"10b84bc2-3e88-4e79-bbc7-4213e33de1aa\") " pod="openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b"
Sep 15 09:28:09.551271 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:09.550315    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10b84bc2-3e88-4e79-bbc7-4213e33de1aa-istio-data\") pod \"e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b\" (UID: \"10b84bc2-3e88-4e79-bbc7-4213e33de1aa\") " pod="openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b"
Sep 15 09:28:09.551271 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:09.551226    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10b84bc2-3e88-4e79-bbc7-4213e33de1aa-istiod-ca-cert\") pod \"e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b\" (UID: \"10b84bc2-3e88-4e79-bbc7-4213e33de1aa\") " pod="openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b"
Sep 15 09:28:09.552902 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:09.552873    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10b84bc2-3e88-4e79-bbc7-4213e33de1aa-istio-podinfo\") pod \"e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b\" (UID: \"10b84bc2-3e88-4e79-bbc7-4213e33de1aa\") " pod="openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b"
Sep 15 09:28:09.553132 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:09.553111    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10b84bc2-3e88-4e79-bbc7-4213e33de1aa-istio-envoy\") pod \"e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b\" (UID: \"10b84bc2-3e88-4e79-bbc7-4213e33de1aa\") " pod="openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b"
Sep 15 09:28:09.555870 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:09.555830    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10b84bc2-3e88-4e79-bbc7-4213e33de1aa-istio-token\") pod \"e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b\" (UID: \"10b84bc2-3e88-4e79-bbc7-4213e33de1aa\") " pod="openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b"
Sep 15 09:28:09.564592 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:09.564546    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2874\" (UniqueName: \"kubernetes.io/projected/10b84bc2-3e88-4e79-bbc7-4213e33de1aa-kube-api-access-g2874\") pod \"e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b\" (UID: \"10b84bc2-3e88-4e79-bbc7-4213e33de1aa\") " pod="openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b"
Sep 15 09:28:09.713518 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:09.713486    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b"
Sep 15 09:28:10.050643 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:10.050614    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b"]
Sep 15 09:28:10.052782 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:28:10.052752    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10b84bc2_3e88_4e79_bbc7_4213e33de1aa.slice/crio-86b342323d40f0c41b44a37d8254e5d333841606d14358e28b5ddf0ae801704f WatchSource:0}: Error finding container 86b342323d40f0c41b44a37d8254e5d333841606d14358e28b5ddf0ae801704f: Status 404 returned error can't find the container with id 86b342323d40f0c41b44a37d8254e5d333841606d14358e28b5ddf0ae801704f
Sep 15 09:28:10.055703 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:10.055627    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:28:10.055785 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:10.055745    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:28:10.055826 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:10.055787    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:28:10.200313 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:10.200277    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b" event={"ID":"10b84bc2-3e88-4e79-bbc7-4213e33de1aa","Type":"ContainerStarted","Data":"a73c640b0879857839bfc538c071dada31bd7f221bcf1ca28ad4e4fc6ecd3bbd"}
Sep 15 09:28:10.200503 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:10.200344    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b" event={"ID":"10b84bc2-3e88-4e79-bbc7-4213e33de1aa","Type":"ContainerStarted","Data":"86b342323d40f0c41b44a37d8254e5d333841606d14358e28b5ddf0ae801704f"}
Sep 15 09:28:10.714145 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:10.714110    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b"
Sep 15 09:28:11.209604 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:11.209551    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-c6646b4b-77bff5fbb6-5pk66" event={"ID":"291d8a37-0096-48d4-be44-3dc59e1460c2","Type":"ContainerStarted","Data":"e4927a45db3f3a436a034d11e69c51be40b645f08a43cca119053da448a9ccb8"}
Sep 15 09:28:11.209785 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:11.209664    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-c6646b4b-77bff5fbb6-5pk66"
Sep 15 09:28:11.211529 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:11.211469    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c6646b4b-ccdd7665c-fxkb4" event={"ID":"b6f53264-6d63-4e49-bbcc-d4fce6307ebe","Type":"ContainerStarted","Data":"17f43d9505fb4366a2d12677e7ca04a396f65b90b693327d74c2c6a6dff387aa"}
Sep 15 09:28:11.212255 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:11.211691    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-c6646b4b-ccdd7665c-fxkb4"
Sep 15 09:28:11.225490 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:11.225442    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-c6646b4b-77bff5fbb6-5pk66" podStartSLOduration=1.36497065 podStartE2EDuration="3.225425665s" totalImagesPullingTime="1.860455015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:28:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:28:11.224263804 +0000 UTC m=+835.562709079" watchObservedRunningTime="2026-09-15 09:28:11.225425665 +0000 UTC m=+835.563870966"
Sep 15 09:28:11.227502 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:11.227459    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b" podStartSLOduration=2.227442392 podStartE2EDuration="2.227442392s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:28:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:28:10.228266686 +0000 UTC m=+834.566711971" watchObservedRunningTime="2026-09-15 09:28:11.227442392 +0000 UTC m=+835.565887669"
Sep 15 09:28:11.721392 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:11.721354    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b"
Sep 15 09:28:11.739232 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:11.739182    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-c6646b4b-ccdd7665c-fxkb4" podStartSLOduration=1.993432317 podStartE2EDuration="3.73916259s" totalImagesPullingTime="1.745730273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:28:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:28:11.23928588 +0000 UTC m=+835.577731156" watchObservedRunningTime="2026-09-15 09:28:11.73916259 +0000 UTC m=+836.077607869"
Sep 15 09:28:12.218679 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:12.218637    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b"
Sep 15 09:28:12.219572 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:12.219549    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b"
Sep 15 09:28:14.231759 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:14.231729    2578 generic.go:356] "Generic (PLEG): container finished" podID="eb558fdf-7208-4fae-bcf2-c92b8874e2c2" containerID="3526c9eb97f161eef442f259ade4fc58bbab37703ec48b5214cddea64bd090fa" exitCode=0
Sep 15 09:28:14.232278 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:14.231802    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg" event={"ID":"eb558fdf-7208-4fae-bcf2-c92b8874e2c2","Type":"ContainerDied","Data":"3526c9eb97f161eef442f259ade4fc58bbab37703ec48b5214cddea64bd090fa"}
Sep 15 09:28:14.232278 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:14.232260    2578 scope.go:117] "RemoveContainer" containerID="3526c9eb97f161eef442f259ade4fc58bbab37703ec48b5214cddea64bd090fa"
Sep 15 09:28:14.233530 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:14.233496    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:28:14.233643 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:14.233570    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:28:14.233643 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:14.233628    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:28:14.233758 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:14.233662    2578 generic.go:356] "Generic (PLEG): container finished" podID="4660a7ba-4f49-4385-bb4e-e62f977d5aca" containerID="70fc3a8d8557d7ca827499a4ed63fd31d56928c7608a9386aabaf52e7d4c7941" exitCode=0
Sep 15 09:28:14.233758 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:14.233727    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd" event={"ID":"4660a7ba-4f49-4385-bb4e-e62f977d5aca","Type":"ContainerDied","Data":"70fc3a8d8557d7ca827499a4ed63fd31d56928c7608a9386aabaf52e7d4c7941"}
Sep 15 09:28:14.234220 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:14.234203    2578 scope.go:117] "RemoveContainer" containerID="70fc3a8d8557d7ca827499a4ed63fd31d56928c7608a9386aabaf52e7d4c7941"
Sep 15 09:28:14.235269 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:14.235244    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:28:14.235335 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:14.235300    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:28:14.235373 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:14.235332    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:28:15.274384 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:15.274335    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd" event={"ID":"4660a7ba-4f49-4385-bb4e-e62f977d5aca","Type":"ContainerStarted","Data":"ca8f0765d7496262aa965e1f875c446722af42807ac96afa1455a05714ead1da"}
Sep 15 09:28:15.303987 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:15.298730    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg" event={"ID":"eb558fdf-7208-4fae-bcf2-c92b8874e2c2","Type":"ContainerStarted","Data":"d05e461e9555de6ee0dd6477eb5d54d12466b559af69a0839d0bf3a6b1a21d55"}
Sep 15 09:28:15.647319 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:15.647230    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd"
Sep 15 09:28:15.647621 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:15.647599    2578 patch_prober.go:28] interesting pod/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 15 09:28:15.647775 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:15.647751    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd" podUID="4660a7ba-4f49-4385-bb4e-e62f977d5aca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 15 09:28:15.711730 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:15.711625    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg"
Sep 15 09:28:15.712125 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:15.712088    2578 patch_prober.go:28] interesting pod/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 15 09:28:15.712327 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:15.712302    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg" podUID="eb558fdf-7208-4fae-bcf2-c92b8874e2c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 15 09:28:16.650396 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:16.650357    2578 patch_prober.go:28] interesting pod/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 15 09:28:16.651005 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:16.650972    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd" podUID="4660a7ba-4f49-4385-bb4e-e62f977d5aca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 15 09:28:16.711990 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:16.711109    2578 patch_prober.go:28] interesting pod/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 15 09:28:16.711990 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:16.711175    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg" podUID="eb558fdf-7208-4fae-bcf2-c92b8874e2c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 15 09:28:17.647635 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:17.647588    2578 patch_prober.go:28] interesting pod/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 15 09:28:17.647841 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:17.647657    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd" podUID="4660a7ba-4f49-4385-bb4e-e62f977d5aca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 15 09:28:17.711879 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:17.711834    2578 patch_prober.go:28] interesting pod/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 15 09:28:17.712446 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:17.711904    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg" podUID="eb558fdf-7208-4fae-bcf2-c92b8874e2c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 15 09:28:18.647826 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:18.647544    2578 patch_prober.go:28] interesting pod/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 15 09:28:18.647826 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:18.647608    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd" podUID="4660a7ba-4f49-4385-bb4e-e62f977d5aca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 15 09:28:18.711939 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:18.711901    2578 patch_prober.go:28] interesting pod/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 15 09:28:18.712569 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:18.712522    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg" podUID="eb558fdf-7208-4fae-bcf2-c92b8874e2c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 15 09:28:19.647356 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:19.647315    2578 patch_prober.go:28] interesting pod/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 15 09:28:19.647654 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:19.647616    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd" podUID="4660a7ba-4f49-4385-bb4e-e62f977d5aca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 15 09:28:19.711965 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:19.711911    2578 patch_prober.go:28] interesting pod/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 15 09:28:19.712483 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:19.711995    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg" podUID="eb558fdf-7208-4fae-bcf2-c92b8874e2c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 15 09:28:20.647478 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:20.647436    2578 patch_prober.go:28] interesting pod/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 15 09:28:20.648241 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:20.647764    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd" podUID="4660a7ba-4f49-4385-bb4e-e62f977d5aca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 15 09:28:20.711918 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:20.711881    2578 patch_prober.go:28] interesting pod/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 15 09:28:20.712234 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:20.712205    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg" podUID="eb558fdf-7208-4fae-bcf2-c92b8874e2c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 15 09:28:21.695477 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:21.695428    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd"
Sep 15 09:28:21.695859 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:21.695831    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd"
Sep 15 09:28:21.696911 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:21.696887    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd"
Sep 15 09:28:21.724519 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:21.724471    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg"
Sep 15 09:28:21.725175 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:21.725154    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg"
Sep 15 09:28:21.726278 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:21.726252    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg"
Sep 15 09:28:22.220336 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:22.220310    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-c6646b4b-77bff5fbb6-5pk66"
Sep 15 09:28:22.220527 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:22.220388    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-c6646b4b-ccdd7665c-fxkb4"
Sep 15 09:28:25.372545 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:25.372510    2578 generic.go:356] "Generic (PLEG): container finished" podID="95e679bc-84f2-4d8d-8d0c-20dc54488321" containerID="aa7ed4c861d7d1c02722c68e6d094819b06f1a98c22d7d6c6c0e1f8e29c20bba" exitCode=0
Sep 15 09:28:25.373077 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:25.372583    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h" event={"ID":"95e679bc-84f2-4d8d-8d0c-20dc54488321","Type":"ContainerDied","Data":"aa7ed4c861d7d1c02722c68e6d094819b06f1a98c22d7d6c6c0e1f8e29c20bba"}
Sep 15 09:28:25.373077 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:25.373041    2578 scope.go:117] "RemoveContainer" containerID="aa7ed4c861d7d1c02722c68e6d094819b06f1a98c22d7d6c6c0e1f8e29c20bba"
Sep 15 09:28:25.374330 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:25.374290    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:28:25.374419 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:25.374382    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:28:25.374466 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:25.374418    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:28:25.374466 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:25.374425    2578 generic.go:356] "Generic (PLEG): container finished" podID="6cd961d8-10d4-4470-8136-74fbcc253a93" containerID="e7d0ecdbde3aaf44f9db5ef51d029ed82a7a590f41e8ee59b1616024705e3432" exitCode=0
Sep 15 09:28:25.374466 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:25.374455    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5" event={"ID":"6cd961d8-10d4-4470-8136-74fbcc253a93","Type":"ContainerDied","Data":"e7d0ecdbde3aaf44f9db5ef51d029ed82a7a590f41e8ee59b1616024705e3432"}
Sep 15 09:28:25.374772 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:25.374759    2578 scope.go:117] "RemoveContainer" containerID="e7d0ecdbde3aaf44f9db5ef51d029ed82a7a590f41e8ee59b1616024705e3432"
Sep 15 09:28:25.375819 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:25.375790    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:28:25.375910 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:25.375849    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:28:25.375910 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:25.375878    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:28:26.385405 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:26.385370    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h" event={"ID":"95e679bc-84f2-4d8d-8d0c-20dc54488321","Type":"ContainerStarted","Data":"e1882393f47c605ff8cb70d912f9292f0371e7ef29b1e3947731803b14b3c93e"}
Sep 15 09:28:26.389070 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:26.389044    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5" event={"ID":"6cd961d8-10d4-4470-8136-74fbcc253a93","Type":"ContainerStarted","Data":"55eabbb047cd38433af10e70d2e7ca70a3812fdb493c5cd0cf6ae2a8b3c52ec3"}
Sep 15 09:28:26.553289 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:26.553240    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5"
Sep 15 09:28:26.553602 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:26.553284    2578 patch_prober.go:28] interesting pod/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 15 09:28:26.553780 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:26.553758    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5" podUID="6cd961d8-10d4-4470-8136-74fbcc253a93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 15 09:28:27.187828 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:27.187794    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h"
Sep 15 09:28:27.188544 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:27.188523    2578 patch_prober.go:28] interesting pod/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 15 09:28:27.188694 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:27.188677    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h" podUID="95e679bc-84f2-4d8d-8d0c-20dc54488321" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 15 09:28:27.553675 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:27.553638    2578 patch_prober.go:28] interesting pod/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 15 09:28:27.554271 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:27.554240    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5" podUID="6cd961d8-10d4-4470-8136-74fbcc253a93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 15 09:28:28.013196 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:28.013167    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c6646b4b-pkmrq"]
Sep 15 09:28:28.016628 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:28.016606    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c6646b4b-pkmrq"
Sep 15 09:28:28.022201 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:28.022182    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 09:28:28.022488 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:28.022209    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cbqnn\""
Sep 15 09:28:28.024501 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:28.024475    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c6646b4b-pkmrq"]
Sep 15 09:28:28.085851 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:28.085790    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d14e09f8-fe88-422b-82ce-19d0b1f092ec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c6646b4b-pkmrq\" (UID: \"d14e09f8-fe88-422b-82ce-19d0b1f092ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c6646b4b-pkmrq"
Sep 15 09:28:28.188975 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:28.187985    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d14e09f8-fe88-422b-82ce-19d0b1f092ec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c6646b4b-pkmrq\" (UID: \"d14e09f8-fe88-422b-82ce-19d0b1f092ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c6646b4b-pkmrq"
Sep 15 09:28:28.192968 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:28.189333    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d14e09f8-fe88-422b-82ce-19d0b1f092ec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c6646b4b-pkmrq\" (UID: \"d14e09f8-fe88-422b-82ce-19d0b1f092ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c6646b4b-pkmrq"
Sep 15 09:28:28.193610 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:28.193582    2578 patch_prober.go:28] interesting pod/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 15 09:28:28.193700 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:28.193648    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h" podUID="95e679bc-84f2-4d8d-8d0c-20dc54488321" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 15 09:28:28.338774 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:28.338668    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c6646b4b-pkmrq"
Sep 15 09:28:28.557873 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:28.557412    2578 patch_prober.go:28] interesting pod/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 15 09:28:28.557873 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:28.557487    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5" podUID="6cd961d8-10d4-4470-8136-74fbcc253a93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 15 09:28:28.733972 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:28.729976    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c6646b4b-pkmrq"]
Sep 15 09:28:29.187600 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:29.187500    2578 patch_prober.go:28] interesting pod/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 15 09:28:29.187858 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:29.187828    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h" podUID="95e679bc-84f2-4d8d-8d0c-20dc54488321" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 15 09:28:29.414297 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:29.414250    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c6646b4b-pkmrq" event={"ID":"d14e09f8-fe88-422b-82ce-19d0b1f092ec","Type":"ContainerStarted","Data":"5211b768a500512f4f732ba5fa8e9b694a84ee0d42c17e7460a27e295fdd4134"}
Sep 15 09:28:29.553039 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:29.553000    2578 patch_prober.go:28] interesting pod/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 15 09:28:29.553289 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:29.553261    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5" podUID="6cd961d8-10d4-4470-8136-74fbcc253a93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 15 09:28:30.189337 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:30.189295    2578 patch_prober.go:28] interesting pod/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 15 09:28:30.189847 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:30.189364    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h" podUID="95e679bc-84f2-4d8d-8d0c-20dc54488321" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 15 09:28:30.555564 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:30.555136    2578 patch_prober.go:28] interesting pod/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 15 09:28:30.555564 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:30.555198    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5" podUID="6cd961d8-10d4-4470-8136-74fbcc253a93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 15 09:28:31.188970 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:31.188563    2578 patch_prober.go:28] interesting pod/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 15 09:28:31.188970 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:31.188627    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h" podUID="95e679bc-84f2-4d8d-8d0c-20dc54488321" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 15 09:28:31.553971 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:31.553122    2578 patch_prober.go:28] interesting pod/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 15 09:28:31.553971 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:31.553190    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5" podUID="6cd961d8-10d4-4470-8136-74fbcc253a93" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 15 09:28:32.135972 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:32.133046    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5"
Sep 15 09:28:32.143538 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:32.143513    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h"
Sep 15 09:28:32.192633 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:32.192608    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h"
Sep 15 09:28:32.455597 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:32.455571    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h"
Sep 15 09:28:32.558864 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:32.558831    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5"
Sep 15 09:28:32.560327 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:32.560302    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5"
Sep 15 09:28:33.461273 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:33.461223    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c6646b4b-pkmrq" event={"ID":"d14e09f8-fe88-422b-82ce-19d0b1f092ec","Type":"ContainerStarted","Data":"e01102f708f9293b58ec0b65aecc1bffde8e1217f153003885d5313dae48d3c0"}
Sep 15 09:28:33.475925 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:33.475884    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c6646b4b-pkmrq" podStartSLOduration=2.298504836 podStartE2EDuration="6.475871896s" totalImagesPullingTime="4.17736706s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:28:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:28:33.47454482 +0000 UTC m=+857.812990094" watchObservedRunningTime="2026-09-15 09:28:33.475871896 +0000 UTC m=+857.814317220"
Sep 15 09:28:34.468994 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:34.468935    2578 generic.go:356] "Generic (PLEG): container finished" podID="d14e09f8-fe88-422b-82ce-19d0b1f092ec" containerID="e01102f708f9293b58ec0b65aecc1bffde8e1217f153003885d5313dae48d3c0" exitCode=0
Sep 15 09:28:34.468994 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:34.468979    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c6646b4b-pkmrq" event={"ID":"d14e09f8-fe88-422b-82ce-19d0b1f092ec","Type":"ContainerDied","Data":"e01102f708f9293b58ec0b65aecc1bffde8e1217f153003885d5313dae48d3c0"}
Sep 15 09:28:35.612135 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:35.612110    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c6646b4b-pkmrq"
Sep 15 09:28:35.690854 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:35.690826    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d14e09f8-fe88-422b-82ce-19d0b1f092ec-maas-api-service-ca\") pod \"d14e09f8-fe88-422b-82ce-19d0b1f092ec\" (UID: \"d14e09f8-fe88-422b-82ce-19d0b1f092ec\") "
Sep 15 09:28:35.691298 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:35.691269    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d14e09f8-fe88-422b-82ce-19d0b1f092ec-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d14e09f8-fe88-422b-82ce-19d0b1f092ec" (UID: "d14e09f8-fe88-422b-82ce-19d0b1f092ec"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:28:35.791984 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:35.791903    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d14e09f8-fe88-422b-82ce-19d0b1f092ec-maas-api-service-ca\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:28:36.481052 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:36.481022    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c6646b4b-pkmrq"
Sep 15 09:28:36.481219 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:36.481024    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c6646b4b-pkmrq" event={"ID":"d14e09f8-fe88-422b-82ce-19d0b1f092ec","Type":"ContainerDied","Data":"5211b768a500512f4f732ba5fa8e9b694a84ee0d42c17e7460a27e295fdd4134"}
Sep 15 09:28:36.481219 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:36.481158    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5211b768a500512f4f732ba5fa8e9b694a84ee0d42c17e7460a27e295fdd4134"
Sep 15 09:28:37.489918 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:37.489885    2578 generic.go:356] "Generic (PLEG): container finished" podID="10b84bc2-3e88-4e79-bbc7-4213e33de1aa" containerID="a73c640b0879857839bfc538c071dada31bd7f221bcf1ca28ad4e4fc6ecd3bbd" exitCode=0
Sep 15 09:28:37.490347 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:37.489977    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b" event={"ID":"10b84bc2-3e88-4e79-bbc7-4213e33de1aa","Type":"ContainerDied","Data":"a73c640b0879857839bfc538c071dada31bd7f221bcf1ca28ad4e4fc6ecd3bbd"}
Sep 15 09:28:37.490393 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:37.490360    2578 scope.go:117] "RemoveContainer" containerID="a73c640b0879857839bfc538c071dada31bd7f221bcf1ca28ad4e4fc6ecd3bbd"
Sep 15 09:28:37.491540 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:37.491507    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:28:37.491645 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:37.491596    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:28:37.491713 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:37.491647    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:28:38.497317 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:38.497279    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b" event={"ID":"10b84bc2-3e88-4e79-bbc7-4213e33de1aa","Type":"ContainerStarted","Data":"992659facf053d05e4694a6eab30b42f7b361e0ae1f93ea6c415e72cee6b7902"}
Sep 15 09:28:38.715560 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:38.715520    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b"
Sep 15 09:28:38.715901 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:38.715878    2578 patch_prober.go:28] interesting pod/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 15 09:28:38.716104 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:38.716078    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b" podUID="10b84bc2-3e88-4e79-bbc7-4213e33de1aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 15 09:28:39.714638 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:39.714027    2578 patch_prober.go:28] interesting pod/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 15 09:28:39.714638 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:39.714095    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b" podUID="10b84bc2-3e88-4e79-bbc7-4213e33de1aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 15 09:28:40.714462 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:40.714427    2578 patch_prober.go:28] interesting pod/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 15 09:28:40.714751 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:40.714722    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b" podUID="10b84bc2-3e88-4e79-bbc7-4213e33de1aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 15 09:28:41.714625 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:41.714582    2578 patch_prober.go:28] interesting pod/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 15 09:28:41.714830 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:41.714648    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b" podUID="10b84bc2-3e88-4e79-bbc7-4213e33de1aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 15 09:28:42.219737 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:42.219701    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b"
Sep 15 09:28:42.714042 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:42.713997    2578 patch_prober.go:28] interesting pod/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 15 09:28:42.714351 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:42.714321    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b" podUID="10b84bc2-3e88-4e79-bbc7-4213e33de1aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 15 09:28:43.713819 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:43.713789    2578 patch_prober.go:28] interesting pod/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 15 09:28:43.714230 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:43.713840    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b" podUID="10b84bc2-3e88-4e79-bbc7-4213e33de1aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 15 09:28:44.717964 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:44.717925    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b"
Sep 15 09:28:44.719158 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:44.719138    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b"
Sep 15 09:28:44.737816 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:44.737792    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c6646b4b-ccdd7665c-fxkb4"]
Sep 15 09:28:44.738013 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:44.737991    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-c6646b4b-ccdd7665c-fxkb4" podUID="b6f53264-6d63-4e49-bbcc-d4fce6307ebe" containerName="payload-processing" containerID="cri-o://17f43d9505fb4366a2d12677e7ca04a396f65b90b693327d74c2c6a6dff387aa" gracePeriod=30
Sep 15 09:28:44.748429 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:44.748406    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c6646b4b-77bff5fbb6-5pk66"]
Sep 15 09:28:44.748673 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:44.748642    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-c6646b4b-77bff5fbb6-5pk66" podUID="291d8a37-0096-48d4-be44-3dc59e1460c2" containerName="payload-pre-processing" containerID="cri-o://e4927a45db3f3a436a034d11e69c51be40b645f08a43cca119053da448a9ccb8" gracePeriod=30
Sep 15 09:28:44.973302 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:44.973237    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c6646b4b-pkmrq"]
Sep 15 09:28:44.981405 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:44.981374    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c6646b4b-pkmrq"]
Sep 15 09:28:45.021890 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:45.021870    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c6646b4b-ccdd7665c-fxkb4"
Sep 15 09:28:45.024593 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:45.024573    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-c6646b4b-77bff5fbb6-5pk66"
Sep 15 09:28:45.083859 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:45.083833    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5"]
Sep 15 09:28:45.084071 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:45.084046    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5" podUID="6cd961d8-10d4-4470-8136-74fbcc253a93" containerName="istio-proxy" containerID="cri-o://55eabbb047cd38433af10e70d2e7ca70a3812fdb493c5cd0cf6ae2a8b3c52ec3" gracePeriod=30
Sep 15 09:28:45.185264 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:45.184441    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/291d8a37-0096-48d4-be44-3dc59e1460c2-plugins-config-volume\") pod \"291d8a37-0096-48d4-be44-3dc59e1460c2\" (UID: \"291d8a37-0096-48d4-be44-3dc59e1460c2\") "
Sep 15 09:28:45.185691 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:45.185573    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/291d8a37-0096-48d4-be44-3dc59e1460c2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "291d8a37-0096-48d4-be44-3dc59e1460c2" (UID: "291d8a37-0096-48d4-be44-3dc59e1460c2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:28:45.185830 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:45.185771    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5hp4f\" (UniqueName: \"kubernetes.io/projected/291d8a37-0096-48d4-be44-3dc59e1460c2-kube-api-access-5hp4f\") pod \"291d8a37-0096-48d4-be44-3dc59e1460c2\" (UID: \"291d8a37-0096-48d4-be44-3dc59e1460c2\") "
Sep 15 09:28:45.187852 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:45.187779    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6f53264-6d63-4e49-bbcc-d4fce6307ebe-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b6f53264-6d63-4e49-bbcc-d4fce6307ebe" (UID: "b6f53264-6d63-4e49-bbcc-d4fce6307ebe"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:28:45.188124 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:45.187324    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b6f53264-6d63-4e49-bbcc-d4fce6307ebe-plugins-config-volume\") pod \"b6f53264-6d63-4e49-bbcc-d4fce6307ebe\" (UID: \"b6f53264-6d63-4e49-bbcc-d4fce6307ebe\") "
Sep 15 09:28:45.188376 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:45.188360    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cn22x\" (UniqueName: \"kubernetes.io/projected/b6f53264-6d63-4e49-bbcc-d4fce6307ebe-kube-api-access-cn22x\") pod \"b6f53264-6d63-4e49-bbcc-d4fce6307ebe\" (UID: \"b6f53264-6d63-4e49-bbcc-d4fce6307ebe\") "
Sep 15 09:28:45.189008 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:45.188973    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/291d8a37-0096-48d4-be44-3dc59e1460c2-plugins-config-volume\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:28:45.189143 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:45.189129    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b6f53264-6d63-4e49-bbcc-d4fce6307ebe-plugins-config-volume\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:28:45.194682 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:45.194646    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6f53264-6d63-4e49-bbcc-d4fce6307ebe-kube-api-access-cn22x" (OuterVolumeSpecName: "kube-api-access-cn22x") pod "b6f53264-6d63-4e49-bbcc-d4fce6307ebe" (UID: "b6f53264-6d63-4e49-bbcc-d4fce6307ebe"). InnerVolumeSpecName "kube-api-access-cn22x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:28:45.194917 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:45.194899    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/291d8a37-0096-48d4-be44-3dc59e1460c2-kube-api-access-5hp4f" (OuterVolumeSpecName: "kube-api-access-5hp4f") pod "291d8a37-0096-48d4-be44-3dc59e1460c2" (UID: "291d8a37-0096-48d4-be44-3dc59e1460c2"). InnerVolumeSpecName "kube-api-access-5hp4f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:28:45.290209 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:45.290131    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cn22x\" (UniqueName: \"kubernetes.io/projected/b6f53264-6d63-4e49-bbcc-d4fce6307ebe-kube-api-access-cn22x\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:28:45.290209 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:45.290157    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5hp4f\" (UniqueName: \"kubernetes.io/projected/291d8a37-0096-48d4-be44-3dc59e1460c2-kube-api-access-5hp4f\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:28:45.547937 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:45.547859    2578 generic.go:356] "Generic (PLEG): container finished" podID="b6f53264-6d63-4e49-bbcc-d4fce6307ebe" containerID="17f43d9505fb4366a2d12677e7ca04a396f65b90b693327d74c2c6a6dff387aa" exitCode=0
Sep 15 09:28:45.547937 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:45.547905    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c6646b4b-ccdd7665c-fxkb4"
Sep 15 09:28:45.548164 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:45.547973    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c6646b4b-ccdd7665c-fxkb4" event={"ID":"b6f53264-6d63-4e49-bbcc-d4fce6307ebe","Type":"ContainerDied","Data":"17f43d9505fb4366a2d12677e7ca04a396f65b90b693327d74c2c6a6dff387aa"}
Sep 15 09:28:45.548164 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:45.548025    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c6646b4b-ccdd7665c-fxkb4" event={"ID":"b6f53264-6d63-4e49-bbcc-d4fce6307ebe","Type":"ContainerDied","Data":"270e1f40c436f324f77fa692586123dba27c49f348531f82ccd240475d0ff82b"}
Sep 15 09:28:45.548164 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:45.548053    2578 scope.go:117] "RemoveContainer" containerID="17f43d9505fb4366a2d12677e7ca04a396f65b90b693327d74c2c6a6dff387aa"
Sep 15 09:28:45.549346 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:45.549318    2578 generic.go:356] "Generic (PLEG): container finished" podID="291d8a37-0096-48d4-be44-3dc59e1460c2" containerID="e4927a45db3f3a436a034d11e69c51be40b645f08a43cca119053da448a9ccb8" exitCode=0
Sep 15 09:28:45.549467 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:45.549357    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-c6646b4b-77bff5fbb6-5pk66"
Sep 15 09:28:45.549467 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:45.549399    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-c6646b4b-77bff5fbb6-5pk66" event={"ID":"291d8a37-0096-48d4-be44-3dc59e1460c2","Type":"ContainerDied","Data":"e4927a45db3f3a436a034d11e69c51be40b645f08a43cca119053da448a9ccb8"}
Sep 15 09:28:45.549467 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:45.549449    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-c6646b4b-77bff5fbb6-5pk66" event={"ID":"291d8a37-0096-48d4-be44-3dc59e1460c2","Type":"ContainerDied","Data":"9ecf45f283a92cec1d4d08f1807d74c9b126493e35eeb101c123ffa254b93026"}
Sep 15 09:28:45.557140 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:45.557123    2578 scope.go:117] "RemoveContainer" containerID="17f43d9505fb4366a2d12677e7ca04a396f65b90b693327d74c2c6a6dff387aa"
Sep 15 09:28:45.557431 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:28:45.557412    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17f43d9505fb4366a2d12677e7ca04a396f65b90b693327d74c2c6a6dff387aa\": container with ID starting with 17f43d9505fb4366a2d12677e7ca04a396f65b90b693327d74c2c6a6dff387aa not found: ID does not exist" containerID="17f43d9505fb4366a2d12677e7ca04a396f65b90b693327d74c2c6a6dff387aa"
Sep 15 09:28:45.557507 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:45.557442    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17f43d9505fb4366a2d12677e7ca04a396f65b90b693327d74c2c6a6dff387aa"} err="failed to get container status \"17f43d9505fb4366a2d12677e7ca04a396f65b90b693327d74c2c6a6dff387aa\": rpc error: code = NotFound desc = could not find container \"17f43d9505fb4366a2d12677e7ca04a396f65b90b693327d74c2c6a6dff387aa\": container with ID starting with 17f43d9505fb4366a2d12677e7ca04a396f65b90b693327d74c2c6a6dff387aa not found: ID does not exist"
Sep 15 09:28:45.557507 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:45.557465    2578 scope.go:117] "RemoveContainer" containerID="e4927a45db3f3a436a034d11e69c51be40b645f08a43cca119053da448a9ccb8"
Sep 15 09:28:45.565916 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:45.565901    2578 scope.go:117] "RemoveContainer" containerID="e4927a45db3f3a436a034d11e69c51be40b645f08a43cca119053da448a9ccb8"
Sep 15 09:28:45.566189 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:28:45.566172    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4927a45db3f3a436a034d11e69c51be40b645f08a43cca119053da448a9ccb8\": container with ID starting with e4927a45db3f3a436a034d11e69c51be40b645f08a43cca119053da448a9ccb8 not found: ID does not exist" containerID="e4927a45db3f3a436a034d11e69c51be40b645f08a43cca119053da448a9ccb8"
Sep 15 09:28:45.566241 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:45.566195    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4927a45db3f3a436a034d11e69c51be40b645f08a43cca119053da448a9ccb8"} err="failed to get container status \"e4927a45db3f3a436a034d11e69c51be40b645f08a43cca119053da448a9ccb8\": rpc error: code = NotFound desc = could not find container \"e4927a45db3f3a436a034d11e69c51be40b645f08a43cca119053da448a9ccb8\": container with ID starting with e4927a45db3f3a436a034d11e69c51be40b645f08a43cca119053da448a9ccb8 not found: ID does not exist"
Sep 15 09:28:45.573496 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:45.573472    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c6646b4b-ccdd7665c-fxkb4"]
Sep 15 09:28:45.579757 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:45.579737    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c6646b4b-ccdd7665c-fxkb4"]
Sep 15 09:28:45.592468 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:45.592449    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c6646b4b-77bff5fbb6-5pk66"]
Sep 15 09:28:45.596218 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:45.596198    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c6646b4b-77bff5fbb6-5pk66"]
Sep 15 09:28:45.992289 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:45.992262    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv"]
Sep 15 09:28:45.992647 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:45.992620    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6f53264-6d63-4e49-bbcc-d4fce6307ebe" containerName="payload-processing"
Sep 15 09:28:45.992647 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:45.992631    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6f53264-6d63-4e49-bbcc-d4fce6307ebe" containerName="payload-processing"
Sep 15 09:28:45.992647 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:45.992644    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d14e09f8-fe88-422b-82ce-19d0b1f092ec" containerName="revoke-keys"
Sep 15 09:28:45.992768 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:45.992651    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d14e09f8-fe88-422b-82ce-19d0b1f092ec" containerName="revoke-keys"
Sep 15 09:28:45.992768 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:45.992672    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="291d8a37-0096-48d4-be44-3dc59e1460c2" containerName="payload-pre-processing"
Sep 15 09:28:45.992768 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:45.992678    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="291d8a37-0096-48d4-be44-3dc59e1460c2" containerName="payload-pre-processing"
Sep 15 09:28:45.992768 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:45.992733    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="291d8a37-0096-48d4-be44-3dc59e1460c2" containerName="payload-pre-processing"
Sep 15 09:28:45.992768 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:45.992740    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6f53264-6d63-4e49-bbcc-d4fce6307ebe" containerName="payload-processing"
Sep 15 09:28:45.992768 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:45.992745    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d14e09f8-fe88-422b-82ce-19d0b1f092ec" containerName="revoke-keys"
Sep 15 09:28:45.998090 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:45.998073    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv"
Sep 15 09:28:46.000504 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:46.000486    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-357b9aa6-gw-openshift-default-dockercfg-srgwn\""
Sep 15 09:28:46.006369 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:46.006145    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv"]
Sep 15 09:28:46.098547 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:46.098505    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vzkw\" (UniqueName: \"kubernetes.io/projected/2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7-kube-api-access-8vzkw\") pod \"e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv\" (UID: \"2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7\") " pod="openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv"
Sep 15 09:28:46.098877 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:46.098858    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7-istiod-ca-cert\") pod \"e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv\" (UID: \"2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7\") " pod="openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv"
Sep 15 09:28:46.099091 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:46.099074    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7-istio-data\") pod \"e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv\" (UID: \"2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7\") " pod="openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv"
Sep 15 09:28:46.099257 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:46.099242    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7-istio-envoy\") pod \"e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv\" (UID: \"2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7\") " pod="openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv"
Sep 15 09:28:46.099441 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:46.099424    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7-istio-token\") pod \"e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv\" (UID: \"2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7\") " pod="openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv"
Sep 15 09:28:46.099601 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:46.099586    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7-credential-socket\") pod \"e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv\" (UID: \"2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7\") " pod="openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv"
Sep 15 09:28:46.099770 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:46.099755    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7-workload-socket\") pod \"e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv\" (UID: \"2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7\") " pod="openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv"
Sep 15 09:28:46.099915 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:46.099898    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7-istio-podinfo\") pod \"e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv\" (UID: \"2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7\") " pod="openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv"
Sep 15 09:28:46.100207 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:46.100188    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7-workload-certs\") pod \"e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv\" (UID: \"2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7\") " pod="openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv"
Sep 15 09:28:46.129967 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:46.129570    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="291d8a37-0096-48d4-be44-3dc59e1460c2" path="/var/lib/kubelet/pods/291d8a37-0096-48d4-be44-3dc59e1460c2/volumes"
Sep 15 09:28:46.131728 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:46.131693    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6f53264-6d63-4e49-bbcc-d4fce6307ebe" path="/var/lib/kubelet/pods/b6f53264-6d63-4e49-bbcc-d4fce6307ebe/volumes"
Sep 15 09:28:46.132321 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:46.132298    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d14e09f8-fe88-422b-82ce-19d0b1f092ec" path="/var/lib/kubelet/pods/d14e09f8-fe88-422b-82ce-19d0b1f092ec/volumes"
Sep 15 09:28:46.201513 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:46.201486    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7-credential-socket\") pod \"e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv\" (UID: \"2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7\") " pod="openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv"
Sep 15 09:28:46.201628 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:46.201526    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7-workload-socket\") pod \"e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv\" (UID: \"2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7\") " pod="openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv"
Sep 15 09:28:46.201628 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:46.201543    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7-istio-podinfo\") pod \"e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv\" (UID: \"2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7\") " pod="openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv"
Sep 15 09:28:46.201628 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:46.201593    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7-workload-certs\") pod \"e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv\" (UID: \"2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7\") " pod="openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv"
Sep 15 09:28:46.201760 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:46.201671    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vzkw\" (UniqueName: \"kubernetes.io/projected/2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7-kube-api-access-8vzkw\") pod \"e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv\" (UID: \"2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7\") " pod="openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv"
Sep 15 09:28:46.201760 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:46.201702    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7-istiod-ca-cert\") pod \"e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv\" (UID: \"2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7\") " pod="openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv"
Sep 15 09:28:46.201760 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:46.201731    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7-istio-data\") pod \"e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv\" (UID: \"2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7\") " pod="openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv"
Sep 15 09:28:46.201918 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:46.201761    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7-istio-envoy\") pod \"e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv\" (UID: \"2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7\") " pod="openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv"
Sep 15 09:28:46.201918 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:46.201804    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7-istio-token\") pod \"e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv\" (UID: \"2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7\") " pod="openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv"
Sep 15 09:28:46.202033 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:46.201928    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7-credential-socket\") pod \"e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv\" (UID: \"2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7\") " pod="openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv"
Sep 15 09:28:46.202331 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:46.202176    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7-workload-certs\") pod \"e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv\" (UID: \"2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7\") " pod="openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv"
Sep 15 09:28:46.202331 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:46.202211    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7-workload-socket\") pod \"e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv\" (UID: \"2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7\") " pod="openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv"
Sep 15 09:28:46.202331 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:46.202289    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7-istio-data\") pod \"e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv\" (UID: \"2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7\") " pod="openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv"
Sep 15 09:28:46.202596 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:46.202577    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7-istiod-ca-cert\") pod \"e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv\" (UID: \"2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7\") " pod="openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv"
Sep 15 09:28:46.204079 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:46.204048    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7-istio-envoy\") pod \"e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv\" (UID: \"2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7\") " pod="openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv"
Sep 15 09:28:46.204247 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:46.204227    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7-istio-podinfo\") pod \"e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv\" (UID: \"2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7\") " pod="openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv"
Sep 15 09:28:46.209064 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:46.209045    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7-istio-token\") pod \"e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv\" (UID: \"2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7\") " pod="openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv"
Sep 15 09:28:46.209178 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:46.209163    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vzkw\" (UniqueName: \"kubernetes.io/projected/2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7-kube-api-access-8vzkw\") pod \"e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv\" (UID: \"2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7\") " pod="openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv"
Sep 15 09:28:46.311413 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:46.311360    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv"
Sep 15 09:28:46.599357 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:46.599327    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv"]
Sep 15 09:28:46.600387 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:28:46.600365    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2da63a6b_128d_4cb2_bed9_1f0ee8d0cff7.slice/crio-5c33cc7dfb21501e657df00f138b7c847f519d18e52cfec83c348874baa778e8 WatchSource:0}: Error finding container 5c33cc7dfb21501e657df00f138b7c847f519d18e52cfec83c348874baa778e8: Status 404 returned error can't find the container with id 5c33cc7dfb21501e657df00f138b7c847f519d18e52cfec83c348874baa778e8
Sep 15 09:28:46.602567 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:46.602533    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:28:46.602640 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:46.602599    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:28:46.602640 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:46.602629    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:28:47.561563 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:47.561519    2578 patch_prober.go:28] interesting pod/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Sep 15 09:28:47.561914 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:47.561592    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5" podUID="6cd961d8-10d4-4470-8136-74fbcc253a93" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 09:28:47.566208 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:47.566180    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv" event={"ID":"2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7","Type":"ContainerStarted","Data":"4687f5345bd41a46719ecd6b335a2aa6ccd2ec148576a7b378629ab47eb0b521"}
Sep 15 09:28:47.566359 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:47.566235    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv" event={"ID":"2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7","Type":"ContainerStarted","Data":"5c33cc7dfb21501e657df00f138b7c847f519d18e52cfec83c348874baa778e8"}
Sep 15 09:28:47.586535 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:47.586493    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv" podStartSLOduration=2.586477981 podStartE2EDuration="2.586477981s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:28:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:28:47.58376281 +0000 UTC m=+871.922208085" watchObservedRunningTime="2026-09-15 09:28:47.586477981 +0000 UTC m=+871.924923255"
Sep 15 09:28:48.311525 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:48.311497    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv"
Sep 15 09:28:48.316499 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:48.316475    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv"
Sep 15 09:28:48.572124 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:48.572053    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv"
Sep 15 09:28:48.572800 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:48.572783    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv"
Sep 15 09:28:50.362807 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.362784    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5"
Sep 15 09:28:50.444249 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.444214    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cd961d8-10d4-4470-8136-74fbcc253a93-istio-podinfo\") pod \"6cd961d8-10d4-4470-8136-74fbcc253a93\" (UID: \"6cd961d8-10d4-4470-8136-74fbcc253a93\") "
Sep 15 09:28:50.444249 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.444253    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cd961d8-10d4-4470-8136-74fbcc253a93-istio-token\") pod \"6cd961d8-10d4-4470-8136-74fbcc253a93\" (UID: \"6cd961d8-10d4-4470-8136-74fbcc253a93\") "
Sep 15 09:28:50.444466 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.444282    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cd961d8-10d4-4470-8136-74fbcc253a93-workload-certs\") pod \"6cd961d8-10d4-4470-8136-74fbcc253a93\" (UID: \"6cd961d8-10d4-4470-8136-74fbcc253a93\") "
Sep 15 09:28:50.444466 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.444327    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd961d8-10d4-4470-8136-74fbcc253a93-workload-socket\") pod \"6cd961d8-10d4-4470-8136-74fbcc253a93\" (UID: \"6cd961d8-10d4-4470-8136-74fbcc253a93\") "
Sep 15 09:28:50.444466 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.444356    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cd961d8-10d4-4470-8136-74fbcc253a93-istiod-ca-cert\") pod \"6cd961d8-10d4-4470-8136-74fbcc253a93\" (UID: \"6cd961d8-10d4-4470-8136-74fbcc253a93\") "
Sep 15 09:28:50.444466 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.444384    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cd961d8-10d4-4470-8136-74fbcc253a93-istio-data\") pod \"6cd961d8-10d4-4470-8136-74fbcc253a93\" (UID: \"6cd961d8-10d4-4470-8136-74fbcc253a93\") "
Sep 15 09:28:50.444466 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.444407    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cd961d8-10d4-4470-8136-74fbcc253a93-istio-envoy\") pod \"6cd961d8-10d4-4470-8136-74fbcc253a93\" (UID: \"6cd961d8-10d4-4470-8136-74fbcc253a93\") "
Sep 15 09:28:50.444466 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.444458    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd961d8-10d4-4470-8136-74fbcc253a93-credential-socket\") pod \"6cd961d8-10d4-4470-8136-74fbcc253a93\" (UID: \"6cd961d8-10d4-4470-8136-74fbcc253a93\") "
Sep 15 09:28:50.444818 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.444521    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhxc2\" (UniqueName: \"kubernetes.io/projected/6cd961d8-10d4-4470-8136-74fbcc253a93-kube-api-access-lhxc2\") pod \"6cd961d8-10d4-4470-8136-74fbcc253a93\" (UID: \"6cd961d8-10d4-4470-8136-74fbcc253a93\") "
Sep 15 09:28:50.444818 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.444627    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cd961d8-10d4-4470-8136-74fbcc253a93-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6cd961d8-10d4-4470-8136-74fbcc253a93" (UID: "6cd961d8-10d4-4470-8136-74fbcc253a93"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:28:50.444818 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.444640    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cd961d8-10d4-4470-8136-74fbcc253a93-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6cd961d8-10d4-4470-8136-74fbcc253a93" (UID: "6cd961d8-10d4-4470-8136-74fbcc253a93"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:28:50.444818 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.444680    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cd961d8-10d4-4470-8136-74fbcc253a93-istio-data" (OuterVolumeSpecName: "istio-data") pod "6cd961d8-10d4-4470-8136-74fbcc253a93" (UID: "6cd961d8-10d4-4470-8136-74fbcc253a93"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:28:50.445068 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.444837    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cd961d8-10d4-4470-8136-74fbcc253a93-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6cd961d8-10d4-4470-8136-74fbcc253a93" (UID: "6cd961d8-10d4-4470-8136-74fbcc253a93"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:28:50.445128 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.445072    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cd961d8-10d4-4470-8136-74fbcc253a93-workload-certs\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:28:50.445128 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.445094    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd961d8-10d4-4470-8136-74fbcc253a93-workload-socket\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:28:50.445128 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.445110    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cd961d8-10d4-4470-8136-74fbcc253a93-istio-data\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:28:50.445128 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.445124    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd961d8-10d4-4470-8136-74fbcc253a93-credential-socket\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:28:50.445284 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.445137    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6cd961d8-10d4-4470-8136-74fbcc253a93-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6cd961d8-10d4-4470-8136-74fbcc253a93" (UID: "6cd961d8-10d4-4470-8136-74fbcc253a93"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:28:50.446463 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.446441    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6cd961d8-10d4-4470-8136-74fbcc253a93-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6cd961d8-10d4-4470-8136-74fbcc253a93" (UID: "6cd961d8-10d4-4470-8136-74fbcc253a93"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 09:28:50.446670 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.446637    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cd961d8-10d4-4470-8136-74fbcc253a93-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6cd961d8-10d4-4470-8136-74fbcc253a93" (UID: "6cd961d8-10d4-4470-8136-74fbcc253a93"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:28:50.446810 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.446791    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cd961d8-10d4-4470-8136-74fbcc253a93-istio-token" (OuterVolumeSpecName: "istio-token") pod "6cd961d8-10d4-4470-8136-74fbcc253a93" (UID: "6cd961d8-10d4-4470-8136-74fbcc253a93"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:28:50.446898 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.446881    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cd961d8-10d4-4470-8136-74fbcc253a93-kube-api-access-lhxc2" (OuterVolumeSpecName: "kube-api-access-lhxc2") pod "6cd961d8-10d4-4470-8136-74fbcc253a93" (UID: "6cd961d8-10d4-4470-8136-74fbcc253a93"). InnerVolumeSpecName "kube-api-access-lhxc2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:28:50.545790 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.545763    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhxc2\" (UniqueName: \"kubernetes.io/projected/6cd961d8-10d4-4470-8136-74fbcc253a93-kube-api-access-lhxc2\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:28:50.545790 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.545788    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cd961d8-10d4-4470-8136-74fbcc253a93-istio-podinfo\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:28:50.545967 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.545797    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cd961d8-10d4-4470-8136-74fbcc253a93-istio-token\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:28:50.545967 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.545806    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cd961d8-10d4-4470-8136-74fbcc253a93-istiod-ca-cert\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:28:50.545967 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.545815    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cd961d8-10d4-4470-8136-74fbcc253a93-istio-envoy\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:28:50.586613 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.586587    2578 generic.go:356] "Generic (PLEG): container finished" podID="6cd961d8-10d4-4470-8136-74fbcc253a93" containerID="55eabbb047cd38433af10e70d2e7ca70a3812fdb493c5cd0cf6ae2a8b3c52ec3" exitCode=0
Sep 15 09:28:50.586760 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.586637    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5"
Sep 15 09:28:50.586760 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.586666    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5" event={"ID":"6cd961d8-10d4-4470-8136-74fbcc253a93","Type":"ContainerDied","Data":"55eabbb047cd38433af10e70d2e7ca70a3812fdb493c5cd0cf6ae2a8b3c52ec3"}
Sep 15 09:28:50.586760 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.586708    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5" event={"ID":"6cd961d8-10d4-4470-8136-74fbcc253a93","Type":"ContainerDied","Data":"9227d747bd2c0d5686d4425f0038acae3874358365c44d13ff04e8a784d32ba3"}
Sep 15 09:28:50.586760 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.586732    2578 scope.go:117] "RemoveContainer" containerID="55eabbb047cd38433af10e70d2e7ca70a3812fdb493c5cd0cf6ae2a8b3c52ec3"
Sep 15 09:28:50.596375 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.596361    2578 scope.go:117] "RemoveContainer" containerID="e7d0ecdbde3aaf44f9db5ef51d029ed82a7a590f41e8ee59b1616024705e3432"
Sep 15 09:28:50.604558 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.604542    2578 scope.go:117] "RemoveContainer" containerID="55eabbb047cd38433af10e70d2e7ca70a3812fdb493c5cd0cf6ae2a8b3c52ec3"
Sep 15 09:28:50.604822 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:28:50.604804    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55eabbb047cd38433af10e70d2e7ca70a3812fdb493c5cd0cf6ae2a8b3c52ec3\": container with ID starting with 55eabbb047cd38433af10e70d2e7ca70a3812fdb493c5cd0cf6ae2a8b3c52ec3 not found: ID does not exist" containerID="55eabbb047cd38433af10e70d2e7ca70a3812fdb493c5cd0cf6ae2a8b3c52ec3"
Sep 15 09:28:50.604868 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.604831    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55eabbb047cd38433af10e70d2e7ca70a3812fdb493c5cd0cf6ae2a8b3c52ec3"} err="failed to get container status \"55eabbb047cd38433af10e70d2e7ca70a3812fdb493c5cd0cf6ae2a8b3c52ec3\": rpc error: code = NotFound desc = could not find container \"55eabbb047cd38433af10e70d2e7ca70a3812fdb493c5cd0cf6ae2a8b3c52ec3\": container with ID starting with 55eabbb047cd38433af10e70d2e7ca70a3812fdb493c5cd0cf6ae2a8b3c52ec3 not found: ID does not exist"
Sep 15 09:28:50.604868 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.604847    2578 scope.go:117] "RemoveContainer" containerID="e7d0ecdbde3aaf44f9db5ef51d029ed82a7a590f41e8ee59b1616024705e3432"
Sep 15 09:28:50.605110 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:28:50.605094    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7d0ecdbde3aaf44f9db5ef51d029ed82a7a590f41e8ee59b1616024705e3432\": container with ID starting with e7d0ecdbde3aaf44f9db5ef51d029ed82a7a590f41e8ee59b1616024705e3432 not found: ID does not exist" containerID="e7d0ecdbde3aaf44f9db5ef51d029ed82a7a590f41e8ee59b1616024705e3432"
Sep 15 09:28:50.605158 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.605113    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7d0ecdbde3aaf44f9db5ef51d029ed82a7a590f41e8ee59b1616024705e3432"} err="failed to get container status \"e7d0ecdbde3aaf44f9db5ef51d029ed82a7a590f41e8ee59b1616024705e3432\": rpc error: code = NotFound desc = could not find container \"e7d0ecdbde3aaf44f9db5ef51d029ed82a7a590f41e8ee59b1616024705e3432\": container with ID starting with e7d0ecdbde3aaf44f9db5ef51d029ed82a7a590f41e8ee59b1616024705e3432 not found: ID does not exist"
Sep 15 09:28:50.618327 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.618303    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5"]
Sep 15 09:28:50.623539 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.623517    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-c6646b4b-openshift-default-84b975bfd6-mksv5"]
Sep 15 09:28:50.689503 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.689478    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-357b9aa6-dd964dcc8-k5d68"]
Sep 15 09:28:50.689874 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.689861    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cd961d8-10d4-4470-8136-74fbcc253a93" containerName="istio-proxy"
Sep 15 09:28:50.689921 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.689876    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cd961d8-10d4-4470-8136-74fbcc253a93" containerName="istio-proxy"
Sep 15 09:28:50.689921 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.689888    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cd961d8-10d4-4470-8136-74fbcc253a93" containerName="istio-proxy"
Sep 15 09:28:50.689921 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.689893    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cd961d8-10d4-4470-8136-74fbcc253a93" containerName="istio-proxy"
Sep 15 09:28:50.690038 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.689976    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cd961d8-10d4-4470-8136-74fbcc253a93" containerName="istio-proxy"
Sep 15 09:28:50.694526 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.694510    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-357b9aa6-dd964dcc8-k5d68"
Sep 15 09:28:50.696903 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.696885    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-357b9aa6-dockercfg-bnxvx\""
Sep 15 09:28:50.697001 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.696907    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-357b9aa6\""
Sep 15 09:28:50.703569 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.703549    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-357b9aa6-dd964dcc8-k5d68"]
Sep 15 09:28:50.737446 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.737424    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-357b9aa6-8f8c4d474-49tcp"]
Sep 15 09:28:50.737866 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.737849    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cd961d8-10d4-4470-8136-74fbcc253a93" containerName="istio-proxy"
Sep 15 09:28:50.740805 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.740788    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-357b9aa6-8f8c4d474-49tcp"
Sep 15 09:28:50.748250 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.748220    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8fd6029c-c626-4786-93dd-c635f0106313-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-357b9aa6-dd964dcc8-k5d68\" (UID: \"8fd6029c-c626-4786-93dd-c635f0106313\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-357b9aa6-dd964dcc8-k5d68"
Sep 15 09:28:50.748350 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.748318    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ck72\" (UniqueName: \"kubernetes.io/projected/8fd6029c-c626-4786-93dd-c635f0106313-kube-api-access-8ck72\") pod \"payload-pre-processing-e2e-migrate-357b9aa6-dd964dcc8-k5d68\" (UID: \"8fd6029c-c626-4786-93dd-c635f0106313\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-357b9aa6-dd964dcc8-k5d68"
Sep 15 09:28:50.750767 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.750746    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-357b9aa6-8f8c4d474-49tcp"]
Sep 15 09:28:50.849743 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.849644    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ck72\" (UniqueName: \"kubernetes.io/projected/8fd6029c-c626-4786-93dd-c635f0106313-kube-api-access-8ck72\") pod \"payload-pre-processing-e2e-migrate-357b9aa6-dd964dcc8-k5d68\" (UID: \"8fd6029c-c626-4786-93dd-c635f0106313\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-357b9aa6-dd964dcc8-k5d68"
Sep 15 09:28:50.849743 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.849725    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f24a6f68-2d63-4f17-aa78-daa86f780954-plugins-config-volume\") pod \"payload-processing-e2e-migrate-357b9aa6-8f8c4d474-49tcp\" (UID: \"f24a6f68-2d63-4f17-aa78-daa86f780954\") " pod="openshift-ingress/payload-processing-e2e-migrate-357b9aa6-8f8c4d474-49tcp"
Sep 15 09:28:50.850019 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.849754    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbdgg\" (UniqueName: \"kubernetes.io/projected/f24a6f68-2d63-4f17-aa78-daa86f780954-kube-api-access-jbdgg\") pod \"payload-processing-e2e-migrate-357b9aa6-8f8c4d474-49tcp\" (UID: \"f24a6f68-2d63-4f17-aa78-daa86f780954\") " pod="openshift-ingress/payload-processing-e2e-migrate-357b9aa6-8f8c4d474-49tcp"
Sep 15 09:28:50.850019 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.849876    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8fd6029c-c626-4786-93dd-c635f0106313-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-357b9aa6-dd964dcc8-k5d68\" (UID: \"8fd6029c-c626-4786-93dd-c635f0106313\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-357b9aa6-dd964dcc8-k5d68"
Sep 15 09:28:50.850582 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.850559    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8fd6029c-c626-4786-93dd-c635f0106313-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-357b9aa6-dd964dcc8-k5d68\" (UID: \"8fd6029c-c626-4786-93dd-c635f0106313\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-357b9aa6-dd964dcc8-k5d68"
Sep 15 09:28:50.858353 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.858329    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ck72\" (UniqueName: \"kubernetes.io/projected/8fd6029c-c626-4786-93dd-c635f0106313-kube-api-access-8ck72\") pod \"payload-pre-processing-e2e-migrate-357b9aa6-dd964dcc8-k5d68\" (UID: \"8fd6029c-c626-4786-93dd-c635f0106313\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-357b9aa6-dd964dcc8-k5d68"
Sep 15 09:28:50.951227 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.951201    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f24a6f68-2d63-4f17-aa78-daa86f780954-plugins-config-volume\") pod \"payload-processing-e2e-migrate-357b9aa6-8f8c4d474-49tcp\" (UID: \"f24a6f68-2d63-4f17-aa78-daa86f780954\") " pod="openshift-ingress/payload-processing-e2e-migrate-357b9aa6-8f8c4d474-49tcp"
Sep 15 09:28:50.951227 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.951237    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbdgg\" (UniqueName: \"kubernetes.io/projected/f24a6f68-2d63-4f17-aa78-daa86f780954-kube-api-access-jbdgg\") pod \"payload-processing-e2e-migrate-357b9aa6-8f8c4d474-49tcp\" (UID: \"f24a6f68-2d63-4f17-aa78-daa86f780954\") " pod="openshift-ingress/payload-processing-e2e-migrate-357b9aa6-8f8c4d474-49tcp"
Sep 15 09:28:50.952325 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.952306    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f24a6f68-2d63-4f17-aa78-daa86f780954-plugins-config-volume\") pod \"payload-processing-e2e-migrate-357b9aa6-8f8c4d474-49tcp\" (UID: \"f24a6f68-2d63-4f17-aa78-daa86f780954\") " pod="openshift-ingress/payload-processing-e2e-migrate-357b9aa6-8f8c4d474-49tcp"
Sep 15 09:28:50.958865 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:50.958843    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbdgg\" (UniqueName: \"kubernetes.io/projected/f24a6f68-2d63-4f17-aa78-daa86f780954-kube-api-access-jbdgg\") pod \"payload-processing-e2e-migrate-357b9aa6-8f8c4d474-49tcp\" (UID: \"f24a6f68-2d63-4f17-aa78-daa86f780954\") " pod="openshift-ingress/payload-processing-e2e-migrate-357b9aa6-8f8c4d474-49tcp"
Sep 15 09:28:51.004848 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:51.004825    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-357b9aa6-dd964dcc8-k5d68"
Sep 15 09:28:51.050618 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:51.050595    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-357b9aa6-8f8c4d474-49tcp"
Sep 15 09:28:51.289483 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:51.289443    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-357b9aa6-dd964dcc8-k5d68"]
Sep 15 09:28:51.290543 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:28:51.290518    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fd6029c_c626_4786_93dd_c635f0106313.slice/crio-ccd9c40648785970c418af4d4453e6d4c4849875672a56dc2882b8c6304d2c67 WatchSource:0}: Error finding container ccd9c40648785970c418af4d4453e6d4c4849875672a56dc2882b8c6304d2c67: Status 404 returned error can't find the container with id ccd9c40648785970c418af4d4453e6d4c4849875672a56dc2882b8c6304d2c67
Sep 15 09:28:51.348459 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:51.348437    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-357b9aa6-8f8c4d474-49tcp"]
Sep 15 09:28:51.349461 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:28:51.349441    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf24a6f68_2d63_4f17_aa78_daa86f780954.slice/crio-2437a43ff8695a741d74e9e2855053c1611c3619fbfa1b64928584f7849331d4 WatchSource:0}: Error finding container 2437a43ff8695a741d74e9e2855053c1611c3619fbfa1b64928584f7849331d4: Status 404 returned error can't find the container with id 2437a43ff8695a741d74e9e2855053c1611c3619fbfa1b64928584f7849331d4
Sep 15 09:28:51.594379 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:51.594348    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-357b9aa6-8f8c4d474-49tcp" event={"ID":"f24a6f68-2d63-4f17-aa78-daa86f780954","Type":"ContainerStarted","Data":"31cb2772294a53c11846d76470472fdaa677ecbe2b52df8ce5b39a1f65eeec86"}
Sep 15 09:28:51.594810 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:51.594404    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-357b9aa6-8f8c4d474-49tcp" event={"ID":"f24a6f68-2d63-4f17-aa78-daa86f780954","Type":"ContainerStarted","Data":"2437a43ff8695a741d74e9e2855053c1611c3619fbfa1b64928584f7849331d4"}
Sep 15 09:28:51.594810 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:51.594471    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-357b9aa6-8f8c4d474-49tcp"
Sep 15 09:28:51.596235 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:51.596120    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-357b9aa6-dd964dcc8-k5d68" event={"ID":"8fd6029c-c626-4786-93dd-c635f0106313","Type":"ContainerStarted","Data":"bdc2ddcad4992f29bb7a411f48873cd692e023f6eb0a5ca92e1c66e2ad127c54"}
Sep 15 09:28:51.596235 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:51.596184    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-357b9aa6-dd964dcc8-k5d68"
Sep 15 09:28:51.596235 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:51.596211    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-357b9aa6-dd964dcc8-k5d68" event={"ID":"8fd6029c-c626-4786-93dd-c635f0106313","Type":"ContainerStarted","Data":"ccd9c40648785970c418af4d4453e6d4c4849875672a56dc2882b8c6304d2c67"}
Sep 15 09:28:51.609070 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:51.609026    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-357b9aa6-8f8c4d474-49tcp" podStartSLOduration=1.609010278 podStartE2EDuration="1.609010278s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:28:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:28:51.608485478 +0000 UTC m=+875.946930755" watchObservedRunningTime="2026-09-15 09:28:51.609010278 +0000 UTC m=+875.947455553"
Sep 15 09:28:51.622639 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:51.622598    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-357b9aa6-dd964dcc8-k5d68" podStartSLOduration=1.622582282 podStartE2EDuration="1.622582282s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:28:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:28:51.62206743 +0000 UTC m=+875.960512704" watchObservedRunningTime="2026-09-15 09:28:51.622582282 +0000 UTC m=+875.961027560"
Sep 15 09:28:52.123007 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:28:52.122974    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cd961d8-10d4-4470-8136-74fbcc253a93" path="/var/lib/kubelet/pods/6cd961d8-10d4-4470-8136-74fbcc253a93/volumes"
Sep 15 09:29:02.605627 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:02.605596    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-357b9aa6-8f8c4d474-49tcp"
Sep 15 09:29:02.606121 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:02.605724    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-357b9aa6-dd964dcc8-k5d68"
Sep 15 09:29:08.702445 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:08.702342    2578 generic.go:356] "Generic (PLEG): container finished" podID="2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7" containerID="4687f5345bd41a46719ecd6b335a2aa6ccd2ec148576a7b378629ab47eb0b521" exitCode=0
Sep 15 09:29:08.702445 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:08.702389    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv" event={"ID":"2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7","Type":"ContainerDied","Data":"4687f5345bd41a46719ecd6b335a2aa6ccd2ec148576a7b378629ab47eb0b521"}
Sep 15 09:29:08.702859 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:08.702760    2578 scope.go:117] "RemoveContainer" containerID="4687f5345bd41a46719ecd6b335a2aa6ccd2ec148576a7b378629ab47eb0b521"
Sep 15 09:29:08.703859 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:08.703828    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:29:08.703916 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:08.703896    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:29:08.703972 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:08.703925    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:29:09.709920 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:09.709883    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv" event={"ID":"2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7","Type":"ContainerStarted","Data":"6e95ec4be7cf82c571e46fd82e7e75142ca5fd1478edd782ab0ebd61166348b4"}
Sep 15 09:29:10.312051 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:10.312008    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv"
Sep 15 09:29:10.312309 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:10.312282    2578 patch_prober.go:28] interesting pod/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 15 09:29:10.312400 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:10.312353    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv" podUID="2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 15 09:29:11.311961 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:11.311924    2578 patch_prober.go:28] interesting pod/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 15 09:29:11.312346 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:11.312004    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv" podUID="2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 15 09:29:12.312128 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:12.312093    2578 patch_prober.go:28] interesting pod/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 15 09:29:12.312506 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:12.312158    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv" podUID="2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 15 09:29:13.312701 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:13.312668    2578 patch_prober.go:28] interesting pod/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 15 09:29:13.313101 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:13.312721    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv" podUID="2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 15 09:29:13.970556 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:13.970525    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-357b9aa6-6cfg6"]
Sep 15 09:29:13.973348 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:13.973332    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-357b9aa6-6cfg6"
Sep 15 09:29:13.975667 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:13.975640    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 09:29:13.975667 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:13.975656    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cbqnn\""
Sep 15 09:29:13.980555 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:13.980532    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-357b9aa6-6cfg6"]
Sep 15 09:29:14.077188 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:14.077157    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b31f91b7-ebef-48f3-b661-42cf84560b88-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-357b9aa6-6cfg6\" (UID: \"b31f91b7-ebef-48f3-b661-42cf84560b88\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-357b9aa6-6cfg6"
Sep 15 09:29:14.177959 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:14.177928    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b31f91b7-ebef-48f3-b661-42cf84560b88-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-357b9aa6-6cfg6\" (UID: \"b31f91b7-ebef-48f3-b661-42cf84560b88\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-357b9aa6-6cfg6"
Sep 15 09:29:14.178554 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:14.178528    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b31f91b7-ebef-48f3-b661-42cf84560b88-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-357b9aa6-6cfg6\" (UID: \"b31f91b7-ebef-48f3-b661-42cf84560b88\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-357b9aa6-6cfg6"
Sep 15 09:29:14.285217 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:14.285140    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-357b9aa6-6cfg6"
Sep 15 09:29:14.312768 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:14.312729    2578 patch_prober.go:28] interesting pod/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 15 09:29:14.313090 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:14.312809    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv" podUID="2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 15 09:29:14.575869 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:14.575838    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-357b9aa6-6cfg6"]
Sep 15 09:29:14.576985 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:29:14.576958    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb31f91b7_ebef_48f3_b661_42cf84560b88.slice/crio-e29183eae617b16a1a5bf6fa5890ce47e9904ffd94d19e82ddcc88caace67541 WatchSource:0}: Error finding container e29183eae617b16a1a5bf6fa5890ce47e9904ffd94d19e82ddcc88caace67541: Status 404 returned error can't find the container with id e29183eae617b16a1a5bf6fa5890ce47e9904ffd94d19e82ddcc88caace67541
Sep 15 09:29:14.749101 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:14.749072    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-357b9aa6-6cfg6" event={"ID":"b31f91b7-ebef-48f3-b661-42cf84560b88","Type":"ContainerStarted","Data":"e29183eae617b16a1a5bf6fa5890ce47e9904ffd94d19e82ddcc88caace67541"}
Sep 15 09:29:15.316376 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:15.316347    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv"
Sep 15 09:29:15.316822 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:15.316771    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv"
Sep 15 09:29:15.317579 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:15.317560    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv"
Sep 15 09:29:15.757458 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:15.757426    2578 generic.go:356] "Generic (PLEG): container finished" podID="b31f91b7-ebef-48f3-b661-42cf84560b88" containerID="885686c22a35d39c4ca498bc0fc20232b02ac7aa75d866ac3f1851ab11505457" exitCode=0
Sep 15 09:29:15.757641 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:15.757530    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-357b9aa6-6cfg6" event={"ID":"b31f91b7-ebef-48f3-b661-42cf84560b88","Type":"ContainerDied","Data":"885686c22a35d39c4ca498bc0fc20232b02ac7aa75d866ac3f1851ab11505457"}
Sep 15 09:29:16.894208 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:16.894187    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-357b9aa6-6cfg6"
Sep 15 09:29:17.005250 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:17.005224    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b31f91b7-ebef-48f3-b661-42cf84560b88-maas-api-service-ca\") pod \"b31f91b7-ebef-48f3-b661-42cf84560b88\" (UID: \"b31f91b7-ebef-48f3-b661-42cf84560b88\") "
Sep 15 09:29:17.005532 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:17.005512    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b31f91b7-ebef-48f3-b661-42cf84560b88-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b31f91b7-ebef-48f3-b661-42cf84560b88" (UID: "b31f91b7-ebef-48f3-b661-42cf84560b88"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:29:17.106522 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:17.106469    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b31f91b7-ebef-48f3-b661-42cf84560b88-maas-api-service-ca\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:29:17.771098 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:17.771068    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-357b9aa6-6cfg6"
Sep 15 09:29:17.771273 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:17.771114    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-357b9aa6-6cfg6" event={"ID":"b31f91b7-ebef-48f3-b661-42cf84560b88","Type":"ContainerDied","Data":"e29183eae617b16a1a5bf6fa5890ce47e9904ffd94d19e82ddcc88caace67541"}
Sep 15 09:29:17.771273 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:17.771164    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e29183eae617b16a1a5bf6fa5890ce47e9904ffd94d19e82ddcc88caace67541"
Sep 15 09:29:20.738966 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:20.738916    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-357b9aa6-8f8c4d474-49tcp"]
Sep 15 09:29:20.739386 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:20.739150    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-357b9aa6-8f8c4d474-49tcp" podUID="f24a6f68-2d63-4f17-aa78-daa86f780954" containerName="payload-processing" containerID="cri-o://31cb2772294a53c11846d76470472fdaa677ecbe2b52df8ce5b39a1f65eeec86" gracePeriod=30
Sep 15 09:29:20.746155 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:20.746127    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-357b9aa6-dd964dcc8-k5d68"]
Sep 15 09:29:20.746380 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:20.746345    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-357b9aa6-dd964dcc8-k5d68" podUID="8fd6029c-c626-4786-93dd-c635f0106313" containerName="payload-pre-processing" containerID="cri-o://bdc2ddcad4992f29bb7a411f48873cd692e023f6eb0a5ca92e1c66e2ad127c54" gracePeriod=30
Sep 15 09:29:20.905804 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:20.905758    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-357b9aa6-6cfg6"]
Sep 15 09:29:20.908480 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:20.908455    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-357b9aa6-6cfg6"]
Sep 15 09:29:21.017077 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.016725    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-357b9aa6-8f8c4d474-49tcp"
Sep 15 09:29:21.020649 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.020628    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-357b9aa6-dd964dcc8-k5d68"
Sep 15 09:29:21.033968 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.033935    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv"]
Sep 15 09:29:21.034773 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.034204    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv" podUID="2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7" containerName="istio-proxy" containerID="cri-o://6e95ec4be7cf82c571e46fd82e7e75142ca5fd1478edd782ab0ebd61166348b4" gracePeriod=30
Sep 15 09:29:21.146328 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.146295    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbdgg\" (UniqueName: \"kubernetes.io/projected/f24a6f68-2d63-4f17-aa78-daa86f780954-kube-api-access-jbdgg\") pod \"f24a6f68-2d63-4f17-aa78-daa86f780954\" (UID: \"f24a6f68-2d63-4f17-aa78-daa86f780954\") "
Sep 15 09:29:21.147002 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.146977    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ck72\" (UniqueName: \"kubernetes.io/projected/8fd6029c-c626-4786-93dd-c635f0106313-kube-api-access-8ck72\") pod \"8fd6029c-c626-4786-93dd-c635f0106313\" (UID: \"8fd6029c-c626-4786-93dd-c635f0106313\") "
Sep 15 09:29:21.147271 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.147254    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f24a6f68-2d63-4f17-aa78-daa86f780954-plugins-config-volume\") pod \"f24a6f68-2d63-4f17-aa78-daa86f780954\" (UID: \"f24a6f68-2d63-4f17-aa78-daa86f780954\") "
Sep 15 09:29:21.147434 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.147417    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8fd6029c-c626-4786-93dd-c635f0106313-plugins-config-volume\") pod \"8fd6029c-c626-4786-93dd-c635f0106313\" (UID: \"8fd6029c-c626-4786-93dd-c635f0106313\") "
Sep 15 09:29:21.148228 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.148205    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fd6029c-c626-4786-93dd-c635f0106313-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8fd6029c-c626-4786-93dd-c635f0106313" (UID: "8fd6029c-c626-4786-93dd-c635f0106313"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:29:21.148708 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.148688    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f24a6f68-2d63-4f17-aa78-daa86f780954-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f24a6f68-2d63-4f17-aa78-daa86f780954" (UID: "f24a6f68-2d63-4f17-aa78-daa86f780954"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:29:21.153354 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.153331    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f24a6f68-2d63-4f17-aa78-daa86f780954-kube-api-access-jbdgg" (OuterVolumeSpecName: "kube-api-access-jbdgg") pod "f24a6f68-2d63-4f17-aa78-daa86f780954" (UID: "f24a6f68-2d63-4f17-aa78-daa86f780954"). InnerVolumeSpecName "kube-api-access-jbdgg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:29:21.153593 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.153564    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fd6029c-c626-4786-93dd-c635f0106313-kube-api-access-8ck72" (OuterVolumeSpecName: "kube-api-access-8ck72") pod "8fd6029c-c626-4786-93dd-c635f0106313" (UID: "8fd6029c-c626-4786-93dd-c635f0106313"). InnerVolumeSpecName "kube-api-access-8ck72". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:29:21.249372 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.249300    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ck72\" (UniqueName: \"kubernetes.io/projected/8fd6029c-c626-4786-93dd-c635f0106313-kube-api-access-8ck72\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:29:21.249372 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.249328    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f24a6f68-2d63-4f17-aa78-daa86f780954-plugins-config-volume\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:29:21.249372 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.249338    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8fd6029c-c626-4786-93dd-c635f0106313-plugins-config-volume\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:29:21.249372 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.249348    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbdgg\" (UniqueName: \"kubernetes.io/projected/f24a6f68-2d63-4f17-aa78-daa86f780954-kube-api-access-jbdgg\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:29:21.753329 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.753299    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r"]
Sep 15 09:29:21.753691 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.753677    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b31f91b7-ebef-48f3-b661-42cf84560b88" containerName="revoke-keys"
Sep 15 09:29:21.753691 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.753692    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b31f91b7-ebef-48f3-b661-42cf84560b88" containerName="revoke-keys"
Sep 15 09:29:21.753770 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.753710    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f24a6f68-2d63-4f17-aa78-daa86f780954" containerName="payload-processing"
Sep 15 09:29:21.753770 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.753716    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f24a6f68-2d63-4f17-aa78-daa86f780954" containerName="payload-processing"
Sep 15 09:29:21.753770 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.753727    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fd6029c-c626-4786-93dd-c635f0106313" containerName="payload-pre-processing"
Sep 15 09:29:21.753770 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.753732    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fd6029c-c626-4786-93dd-c635f0106313" containerName="payload-pre-processing"
Sep 15 09:29:21.753890 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.753788    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fd6029c-c626-4786-93dd-c635f0106313" containerName="payload-pre-processing"
Sep 15 09:29:21.753890 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.753795    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f24a6f68-2d63-4f17-aa78-daa86f780954" containerName="payload-processing"
Sep 15 09:29:21.753890 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.753802    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b31f91b7-ebef-48f3-b661-42cf84560b88" containerName="revoke-keys"
Sep 15 09:29:21.755815 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.755800    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r"
Sep 15 09:29:21.758160 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.758142    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-3494740c-openshift-default-dockercfg-26p6q\""
Sep 15 09:29:21.768340 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.768317    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r"]
Sep 15 09:29:21.804408 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.804382    2578 generic.go:356] "Generic (PLEG): container finished" podID="f24a6f68-2d63-4f17-aa78-daa86f780954" containerID="31cb2772294a53c11846d76470472fdaa677ecbe2b52df8ce5b39a1f65eeec86" exitCode=0
Sep 15 09:29:21.804537 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.804432    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-357b9aa6-8f8c4d474-49tcp"
Sep 15 09:29:21.804537 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.804454    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-357b9aa6-8f8c4d474-49tcp" event={"ID":"f24a6f68-2d63-4f17-aa78-daa86f780954","Type":"ContainerDied","Data":"31cb2772294a53c11846d76470472fdaa677ecbe2b52df8ce5b39a1f65eeec86"}
Sep 15 09:29:21.804537 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.804528    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-357b9aa6-8f8c4d474-49tcp" event={"ID":"f24a6f68-2d63-4f17-aa78-daa86f780954","Type":"ContainerDied","Data":"2437a43ff8695a741d74e9e2855053c1611c3619fbfa1b64928584f7849331d4"}
Sep 15 09:29:21.804710 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.804562    2578 scope.go:117] "RemoveContainer" containerID="31cb2772294a53c11846d76470472fdaa677ecbe2b52df8ce5b39a1f65eeec86"
Sep 15 09:29:21.805941 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.805921    2578 generic.go:356] "Generic (PLEG): container finished" podID="8fd6029c-c626-4786-93dd-c635f0106313" containerID="bdc2ddcad4992f29bb7a411f48873cd692e023f6eb0a5ca92e1c66e2ad127c54" exitCode=0
Sep 15 09:29:21.805941 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.805982    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-357b9aa6-dd964dcc8-k5d68" event={"ID":"8fd6029c-c626-4786-93dd-c635f0106313","Type":"ContainerDied","Data":"bdc2ddcad4992f29bb7a411f48873cd692e023f6eb0a5ca92e1c66e2ad127c54"}
Sep 15 09:29:21.806131 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.806041    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-357b9aa6-dd964dcc8-k5d68" event={"ID":"8fd6029c-c626-4786-93dd-c635f0106313","Type":"ContainerDied","Data":"ccd9c40648785970c418af4d4453e6d4c4849875672a56dc2882b8c6304d2c67"}
Sep 15 09:29:21.806131 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.806006    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-357b9aa6-dd964dcc8-k5d68"
Sep 15 09:29:21.815742 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.815725    2578 scope.go:117] "RemoveContainer" containerID="31cb2772294a53c11846d76470472fdaa677ecbe2b52df8ce5b39a1f65eeec86"
Sep 15 09:29:21.816240 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:29:21.816090    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31cb2772294a53c11846d76470472fdaa677ecbe2b52df8ce5b39a1f65eeec86\": container with ID starting with 31cb2772294a53c11846d76470472fdaa677ecbe2b52df8ce5b39a1f65eeec86 not found: ID does not exist" containerID="31cb2772294a53c11846d76470472fdaa677ecbe2b52df8ce5b39a1f65eeec86"
Sep 15 09:29:21.816240 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.816120    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31cb2772294a53c11846d76470472fdaa677ecbe2b52df8ce5b39a1f65eeec86"} err="failed to get container status \"31cb2772294a53c11846d76470472fdaa677ecbe2b52df8ce5b39a1f65eeec86\": rpc error: code = NotFound desc = could not find container \"31cb2772294a53c11846d76470472fdaa677ecbe2b52df8ce5b39a1f65eeec86\": container with ID starting with 31cb2772294a53c11846d76470472fdaa677ecbe2b52df8ce5b39a1f65eeec86 not found: ID does not exist"
Sep 15 09:29:21.816240 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.816143    2578 scope.go:117] "RemoveContainer" containerID="bdc2ddcad4992f29bb7a411f48873cd692e023f6eb0a5ca92e1c66e2ad127c54"
Sep 15 09:29:21.824113 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.824093    2578 scope.go:117] "RemoveContainer" containerID="bdc2ddcad4992f29bb7a411f48873cd692e023f6eb0a5ca92e1c66e2ad127c54"
Sep 15 09:29:21.824386 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:29:21.824367    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdc2ddcad4992f29bb7a411f48873cd692e023f6eb0a5ca92e1c66e2ad127c54\": container with ID starting with bdc2ddcad4992f29bb7a411f48873cd692e023f6eb0a5ca92e1c66e2ad127c54 not found: ID does not exist" containerID="bdc2ddcad4992f29bb7a411f48873cd692e023f6eb0a5ca92e1c66e2ad127c54"
Sep 15 09:29:21.824444 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.824392    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdc2ddcad4992f29bb7a411f48873cd692e023f6eb0a5ca92e1c66e2ad127c54"} err="failed to get container status \"bdc2ddcad4992f29bb7a411f48873cd692e023f6eb0a5ca92e1c66e2ad127c54\": rpc error: code = NotFound desc = could not find container \"bdc2ddcad4992f29bb7a411f48873cd692e023f6eb0a5ca92e1c66e2ad127c54\": container with ID starting with bdc2ddcad4992f29bb7a411f48873cd692e023f6eb0a5ca92e1c66e2ad127c54 not found: ID does not exist"
Sep 15 09:29:21.828176 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.828157    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-357b9aa6-8f8c4d474-49tcp"]
Sep 15 09:29:21.833303 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.833284    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-357b9aa6-8f8c4d474-49tcp"]
Sep 15 09:29:21.851912 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.851877    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-357b9aa6-dd964dcc8-k5d68"]
Sep 15 09:29:21.852214 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.852165    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-357b9aa6-dd964dcc8-k5d68"]
Sep 15 09:29:21.863029 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.862480    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19164e2f-f7a2-4f0b-aa25-74da38b3a19f-istio-podinfo\") pod \"e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r\" (UID: \"19164e2f-f7a2-4f0b-aa25-74da38b3a19f\") " pod="openshift-ingress/e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r"
Sep 15 09:29:21.863029 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.862537    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19164e2f-f7a2-4f0b-aa25-74da38b3a19f-istiod-ca-cert\") pod \"e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r\" (UID: \"19164e2f-f7a2-4f0b-aa25-74da38b3a19f\") " pod="openshift-ingress/e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r"
Sep 15 09:29:21.863029 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.862634    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19164e2f-f7a2-4f0b-aa25-74da38b3a19f-istio-data\") pod \"e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r\" (UID: \"19164e2f-f7a2-4f0b-aa25-74da38b3a19f\") " pod="openshift-ingress/e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r"
Sep 15 09:29:21.863029 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.862672    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19164e2f-f7a2-4f0b-aa25-74da38b3a19f-istio-envoy\") pod \"e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r\" (UID: \"19164e2f-f7a2-4f0b-aa25-74da38b3a19f\") " pod="openshift-ingress/e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r"
Sep 15 09:29:21.863029 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.862716    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19164e2f-f7a2-4f0b-aa25-74da38b3a19f-workload-socket\") pod \"e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r\" (UID: \"19164e2f-f7a2-4f0b-aa25-74da38b3a19f\") " pod="openshift-ingress/e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r"
Sep 15 09:29:21.863029 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.862748    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19164e2f-f7a2-4f0b-aa25-74da38b3a19f-workload-certs\") pod \"e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r\" (UID: \"19164e2f-f7a2-4f0b-aa25-74da38b3a19f\") " pod="openshift-ingress/e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r"
Sep 15 09:29:21.863029 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.862780    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19164e2f-f7a2-4f0b-aa25-74da38b3a19f-istio-token\") pod \"e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r\" (UID: \"19164e2f-f7a2-4f0b-aa25-74da38b3a19f\") " pod="openshift-ingress/e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r"
Sep 15 09:29:21.863029 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.862863    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19164e2f-f7a2-4f0b-aa25-74da38b3a19f-credential-socket\") pod \"e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r\" (UID: \"19164e2f-f7a2-4f0b-aa25-74da38b3a19f\") " pod="openshift-ingress/e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r"
Sep 15 09:29:21.863029 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.862912    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw7g2\" (UniqueName: \"kubernetes.io/projected/19164e2f-f7a2-4f0b-aa25-74da38b3a19f-kube-api-access-zw7g2\") pod \"e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r\" (UID: \"19164e2f-f7a2-4f0b-aa25-74da38b3a19f\") " pod="openshift-ingress/e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r"
Sep 15 09:29:21.963816 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.963788    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19164e2f-f7a2-4f0b-aa25-74da38b3a19f-workload-socket\") pod \"e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r\" (UID: \"19164e2f-f7a2-4f0b-aa25-74da38b3a19f\") " pod="openshift-ingress/e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r"
Sep 15 09:29:21.964015 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.963823    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19164e2f-f7a2-4f0b-aa25-74da38b3a19f-workload-certs\") pod \"e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r\" (UID: \"19164e2f-f7a2-4f0b-aa25-74da38b3a19f\") " pod="openshift-ingress/e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r"
Sep 15 09:29:21.964015 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.963845    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19164e2f-f7a2-4f0b-aa25-74da38b3a19f-istio-token\") pod \"e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r\" (UID: \"19164e2f-f7a2-4f0b-aa25-74da38b3a19f\") " pod="openshift-ingress/e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r"
Sep 15 09:29:21.964015 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.963911    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19164e2f-f7a2-4f0b-aa25-74da38b3a19f-credential-socket\") pod \"e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r\" (UID: \"19164e2f-f7a2-4f0b-aa25-74da38b3a19f\") " pod="openshift-ingress/e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r"
Sep 15 09:29:21.964015 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.963968    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw7g2\" (UniqueName: \"kubernetes.io/projected/19164e2f-f7a2-4f0b-aa25-74da38b3a19f-kube-api-access-zw7g2\") pod \"e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r\" (UID: \"19164e2f-f7a2-4f0b-aa25-74da38b3a19f\") " pod="openshift-ingress/e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r"
Sep 15 09:29:21.964015 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.963995    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19164e2f-f7a2-4f0b-aa25-74da38b3a19f-istio-podinfo\") pod \"e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r\" (UID: \"19164e2f-f7a2-4f0b-aa25-74da38b3a19f\") " pod="openshift-ingress/e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r"
Sep 15 09:29:21.964302 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.964018    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19164e2f-f7a2-4f0b-aa25-74da38b3a19f-istiod-ca-cert\") pod \"e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r\" (UID: \"19164e2f-f7a2-4f0b-aa25-74da38b3a19f\") " pod="openshift-ingress/e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r"
Sep 15 09:29:21.964302 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.964107    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19164e2f-f7a2-4f0b-aa25-74da38b3a19f-istio-data\") pod \"e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r\" (UID: \"19164e2f-f7a2-4f0b-aa25-74da38b3a19f\") " pod="openshift-ingress/e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r"
Sep 15 09:29:21.964302 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.964155    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19164e2f-f7a2-4f0b-aa25-74da38b3a19f-istio-envoy\") pod \"e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r\" (UID: \"19164e2f-f7a2-4f0b-aa25-74da38b3a19f\") " pod="openshift-ingress/e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r"
Sep 15 09:29:21.964446 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.964318    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19164e2f-f7a2-4f0b-aa25-74da38b3a19f-workload-certs\") pod \"e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r\" (UID: \"19164e2f-f7a2-4f0b-aa25-74da38b3a19f\") " pod="openshift-ingress/e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r"
Sep 15 09:29:21.964446 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.964341    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19164e2f-f7a2-4f0b-aa25-74da38b3a19f-credential-socket\") pod \"e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r\" (UID: \"19164e2f-f7a2-4f0b-aa25-74da38b3a19f\") " pod="openshift-ingress/e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r"
Sep 15 09:29:21.964584 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.964562    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19164e2f-f7a2-4f0b-aa25-74da38b3a19f-istio-data\") pod \"e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r\" (UID: \"19164e2f-f7a2-4f0b-aa25-74da38b3a19f\") " pod="openshift-ingress/e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r"
Sep 15 09:29:21.964642 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.964603    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19164e2f-f7a2-4f0b-aa25-74da38b3a19f-workload-socket\") pod \"e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r\" (UID: \"19164e2f-f7a2-4f0b-aa25-74da38b3a19f\") " pod="openshift-ingress/e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r"
Sep 15 09:29:21.964802 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.964781    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19164e2f-f7a2-4f0b-aa25-74da38b3a19f-istiod-ca-cert\") pod \"e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r\" (UID: \"19164e2f-f7a2-4f0b-aa25-74da38b3a19f\") " pod="openshift-ingress/e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r"
Sep 15 09:29:21.966525 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.966494    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19164e2f-f7a2-4f0b-aa25-74da38b3a19f-istio-podinfo\") pod \"e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r\" (UID: \"19164e2f-f7a2-4f0b-aa25-74da38b3a19f\") " pod="openshift-ingress/e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r"
Sep 15 09:29:21.966646 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.966623    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19164e2f-f7a2-4f0b-aa25-74da38b3a19f-istio-envoy\") pod \"e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r\" (UID: \"19164e2f-f7a2-4f0b-aa25-74da38b3a19f\") " pod="openshift-ingress/e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r"
Sep 15 09:29:21.972069 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.972047    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw7g2\" (UniqueName: \"kubernetes.io/projected/19164e2f-f7a2-4f0b-aa25-74da38b3a19f-kube-api-access-zw7g2\") pod \"e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r\" (UID: \"19164e2f-f7a2-4f0b-aa25-74da38b3a19f\") " pod="openshift-ingress/e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r"
Sep 15 09:29:21.972192 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:21.972175    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19164e2f-f7a2-4f0b-aa25-74da38b3a19f-istio-token\") pod \"e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r\" (UID: \"19164e2f-f7a2-4f0b-aa25-74da38b3a19f\") " pod="openshift-ingress/e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r"
Sep 15 09:29:22.070106 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:22.070055    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r"
Sep 15 09:29:22.135183 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:22.134441    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fd6029c-c626-4786-93dd-c635f0106313" path="/var/lib/kubelet/pods/8fd6029c-c626-4786-93dd-c635f0106313/volumes"
Sep 15 09:29:22.136370 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:22.135424    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b31f91b7-ebef-48f3-b661-42cf84560b88" path="/var/lib/kubelet/pods/b31f91b7-ebef-48f3-b661-42cf84560b88/volumes"
Sep 15 09:29:22.136370 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:22.135974    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f24a6f68-2d63-4f17-aa78-daa86f780954" path="/var/lib/kubelet/pods/f24a6f68-2d63-4f17-aa78-daa86f780954/volumes"
Sep 15 09:29:22.370668 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:22.370638    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r"]
Sep 15 09:29:22.371866 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:29:22.371837    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19164e2f_f7a2_4f0b_aa25_74da38b3a19f.slice/crio-8913598ef5a2fef0333525ecfc4bf228f75d300891e1fa4e429cca3a6657c269 WatchSource:0}: Error finding container 8913598ef5a2fef0333525ecfc4bf228f75d300891e1fa4e429cca3a6657c269: Status 404 returned error can't find the container with id 8913598ef5a2fef0333525ecfc4bf228f75d300891e1fa4e429cca3a6657c269
Sep 15 09:29:22.374140 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:22.374103    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:29:22.374243 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:22.374170    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:29:22.374243 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:22.374205    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:29:22.815536 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:22.815498    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r" event={"ID":"19164e2f-f7a2-4f0b-aa25-74da38b3a19f","Type":"ContainerStarted","Data":"639dc4684890f2cf90e822ced8e2c4206d65f5aa071b4f2e48b766237a150a6d"}
Sep 15 09:29:22.816039 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:22.815552    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r" event={"ID":"19164e2f-f7a2-4f0b-aa25-74da38b3a19f","Type":"ContainerStarted","Data":"8913598ef5a2fef0333525ecfc4bf228f75d300891e1fa4e429cca3a6657c269"}
Sep 15 09:29:22.836960 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:22.836894    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r" podStartSLOduration=1.836880241 podStartE2EDuration="1.836880241s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:29:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:29:22.83305443 +0000 UTC m=+907.171499740" watchObservedRunningTime="2026-09-15 09:29:22.836880241 +0000 UTC m=+907.175325535"
Sep 15 09:29:23.071074 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:23.070997    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r"
Sep 15 09:29:23.076063 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:23.076036    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r"
Sep 15 09:29:23.823224 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:23.823195    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r"
Sep 15 09:29:23.823982 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:23.823964    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r"
Sep 15 09:29:26.293709 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.293685    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv"
Sep 15 09:29:26.298215 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.298148    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7-istiod-ca-cert\") pod \"2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7\" (UID: \"2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7\") "
Sep 15 09:29:26.298215 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.298185    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8vzkw\" (UniqueName: \"kubernetes.io/projected/2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7-kube-api-access-8vzkw\") pod \"2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7\" (UID: \"2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7\") "
Sep 15 09:29:26.298384 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.298347    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7-workload-certs\") pod \"2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7\" (UID: \"2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7\") "
Sep 15 09:29:26.298450 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.298390    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7-istio-envoy\") pod \"2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7\" (UID: \"2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7\") "
Sep 15 09:29:26.298450 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.298438    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7-workload-socket\") pod \"2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7\" (UID: \"2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7\") "
Sep 15 09:29:26.298557 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.298465    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7-istio-token\") pod \"2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7\" (UID: \"2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7\") "
Sep 15 09:29:26.298557 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.298524    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7-istio-podinfo\") pod \"2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7\" (UID: \"2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7\") "
Sep 15 09:29:26.298557 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.298522    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7" (UID: "2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:29:26.298717 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.298556    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7-credential-socket\") pod \"2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7\" (UID: \"2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7\") "
Sep 15 09:29:26.298717 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.298623    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7-istio-data\") pod \"2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7\" (UID: \"2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7\") "
Sep 15 09:29:26.298717 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.298627    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7" (UID: "2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:29:26.298884 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.298820    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7" (UID: "2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:29:26.298967 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.298888    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7" (UID: "2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:29:26.299033 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.298980    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7-istio-data" (OuterVolumeSpecName: "istio-data") pod "2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7" (UID: "2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:29:26.299075 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.299063    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7-credential-socket\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:29:26.299131 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.299082    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7-istiod-ca-cert\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:29:26.299131 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.299097    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7-workload-certs\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:29:26.299131 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.299110    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7-workload-socket\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:29:26.300874 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.300848    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7" (UID: "2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:29:26.301021 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.300883    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7" (UID: "2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 09:29:26.301021 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.300967    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7-kube-api-access-8vzkw" (OuterVolumeSpecName: "kube-api-access-8vzkw") pod "2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7" (UID: "2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7"). InnerVolumeSpecName "kube-api-access-8vzkw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:29:26.301159 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.301129    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7-istio-token" (OuterVolumeSpecName: "istio-token") pod "2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7" (UID: "2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:29:26.399906 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.399877    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7-istio-token\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:29:26.399906 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.399908    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7-istio-podinfo\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:29:26.400169 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.399917    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7-istio-data\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:29:26.400169 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.399926    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8vzkw\" (UniqueName: \"kubernetes.io/projected/2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7-kube-api-access-8vzkw\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:29:26.400169 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.399934    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7-istio-envoy\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:29:26.402273 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.402248    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-3494740c-79789c69b6-kf66w"]
Sep 15 09:29:26.402646 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.402631    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7" containerName="istio-proxy"
Sep 15 09:29:26.402712 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.402650    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7" containerName="istio-proxy"
Sep 15 09:29:26.402712 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.402664    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7" containerName="istio-proxy"
Sep 15 09:29:26.402712 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.402674    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7" containerName="istio-proxy"
Sep 15 09:29:26.402861 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.402798    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7" containerName="istio-proxy"
Sep 15 09:29:26.402861 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.402811    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7" containerName="istio-proxy"
Sep 15 09:29:26.405059 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.405041    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-3494740c-79789c69b6-kf66w"
Sep 15 09:29:26.407896 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.407874    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-3494740c\""
Sep 15 09:29:26.407896 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.407874    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-3494740c-dockercfg-qrx2k\""
Sep 15 09:29:26.413552 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.413530    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-3494740c-79789c69b6-kf66w"]
Sep 15 09:29:26.427070 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.427047    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-3494740c-66fd6b7767-bktkf"]
Sep 15 09:29:26.429242 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.429223    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-3494740c-66fd6b7767-bktkf"
Sep 15 09:29:26.441041 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.441011    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-3494740c-66fd6b7767-bktkf"]
Sep 15 09:29:26.504970 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.503237    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mp26\" (UniqueName: \"kubernetes.io/projected/2c9e3667-7fb8-47d4-8eaa-db68aedeec48-kube-api-access-6mp26\") pod \"payload-processing-e2e-ait-3494740c-66fd6b7767-bktkf\" (UID: \"2c9e3667-7fb8-47d4-8eaa-db68aedeec48\") " pod="openshift-ingress/payload-processing-e2e-ait-3494740c-66fd6b7767-bktkf"
Sep 15 09:29:26.504970 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.503282    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fp5zc\" (UniqueName: \"kubernetes.io/projected/4bc6c0dc-ced8-4bb8-8086-f23e13599d28-kube-api-access-fp5zc\") pod \"payload-pre-processing-e2e-ait-3494740c-79789c69b6-kf66w\" (UID: \"4bc6c0dc-ced8-4bb8-8086-f23e13599d28\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-3494740c-79789c69b6-kf66w"
Sep 15 09:29:26.504970 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.503368    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4bc6c0dc-ced8-4bb8-8086-f23e13599d28-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-3494740c-79789c69b6-kf66w\" (UID: \"4bc6c0dc-ced8-4bb8-8086-f23e13599d28\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-3494740c-79789c69b6-kf66w"
Sep 15 09:29:26.504970 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.503400    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2c9e3667-7fb8-47d4-8eaa-db68aedeec48-plugins-config-volume\") pod \"payload-processing-e2e-ait-3494740c-66fd6b7767-bktkf\" (UID: \"2c9e3667-7fb8-47d4-8eaa-db68aedeec48\") " pod="openshift-ingress/payload-processing-e2e-ait-3494740c-66fd6b7767-bktkf"
Sep 15 09:29:26.604755 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.604669    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4bc6c0dc-ced8-4bb8-8086-f23e13599d28-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-3494740c-79789c69b6-kf66w\" (UID: \"4bc6c0dc-ced8-4bb8-8086-f23e13599d28\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-3494740c-79789c69b6-kf66w"
Sep 15 09:29:26.604755 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.604709    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2c9e3667-7fb8-47d4-8eaa-db68aedeec48-plugins-config-volume\") pod \"payload-processing-e2e-ait-3494740c-66fd6b7767-bktkf\" (UID: \"2c9e3667-7fb8-47d4-8eaa-db68aedeec48\") " pod="openshift-ingress/payload-processing-e2e-ait-3494740c-66fd6b7767-bktkf"
Sep 15 09:29:26.605020 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.604781    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mp26\" (UniqueName: \"kubernetes.io/projected/2c9e3667-7fb8-47d4-8eaa-db68aedeec48-kube-api-access-6mp26\") pod \"payload-processing-e2e-ait-3494740c-66fd6b7767-bktkf\" (UID: \"2c9e3667-7fb8-47d4-8eaa-db68aedeec48\") " pod="openshift-ingress/payload-processing-e2e-ait-3494740c-66fd6b7767-bktkf"
Sep 15 09:29:26.605020 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.604798    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fp5zc\" (UniqueName: \"kubernetes.io/projected/4bc6c0dc-ced8-4bb8-8086-f23e13599d28-kube-api-access-fp5zc\") pod \"payload-pre-processing-e2e-ait-3494740c-79789c69b6-kf66w\" (UID: \"4bc6c0dc-ced8-4bb8-8086-f23e13599d28\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-3494740c-79789c69b6-kf66w"
Sep 15 09:29:26.605469 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.605446    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2c9e3667-7fb8-47d4-8eaa-db68aedeec48-plugins-config-volume\") pod \"payload-processing-e2e-ait-3494740c-66fd6b7767-bktkf\" (UID: \"2c9e3667-7fb8-47d4-8eaa-db68aedeec48\") " pod="openshift-ingress/payload-processing-e2e-ait-3494740c-66fd6b7767-bktkf"
Sep 15 09:29:26.605469 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.605457    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4bc6c0dc-ced8-4bb8-8086-f23e13599d28-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-3494740c-79789c69b6-kf66w\" (UID: \"4bc6c0dc-ced8-4bb8-8086-f23e13599d28\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-3494740c-79789c69b6-kf66w"
Sep 15 09:29:26.612587 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.612565    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mp26\" (UniqueName: \"kubernetes.io/projected/2c9e3667-7fb8-47d4-8eaa-db68aedeec48-kube-api-access-6mp26\") pod \"payload-processing-e2e-ait-3494740c-66fd6b7767-bktkf\" (UID: \"2c9e3667-7fb8-47d4-8eaa-db68aedeec48\") " pod="openshift-ingress/payload-processing-e2e-ait-3494740c-66fd6b7767-bktkf"
Sep 15 09:29:26.612866 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.612847    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fp5zc\" (UniqueName: \"kubernetes.io/projected/4bc6c0dc-ced8-4bb8-8086-f23e13599d28-kube-api-access-fp5zc\") pod \"payload-pre-processing-e2e-ait-3494740c-79789c69b6-kf66w\" (UID: \"4bc6c0dc-ced8-4bb8-8086-f23e13599d28\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-3494740c-79789c69b6-kf66w"
Sep 15 09:29:26.715699 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.715680    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-3494740c-79789c69b6-kf66w"
Sep 15 09:29:26.738489 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.738470    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-3494740c-66fd6b7767-bktkf"
Sep 15 09:29:26.851658 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.851618    2578 generic.go:356] "Generic (PLEG): container finished" podID="2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7" containerID="6e95ec4be7cf82c571e46fd82e7e75142ca5fd1478edd782ab0ebd61166348b4" exitCode=0
Sep 15 09:29:26.851770 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.851671    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv"
Sep 15 09:29:26.851770 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.851702    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv" event={"ID":"2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7","Type":"ContainerDied","Data":"6e95ec4be7cf82c571e46fd82e7e75142ca5fd1478edd782ab0ebd61166348b4"}
Sep 15 09:29:26.851859 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.851772    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv" event={"ID":"2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7","Type":"ContainerDied","Data":"5c33cc7dfb21501e657df00f138b7c847f519d18e52cfec83c348874baa778e8"}
Sep 15 09:29:26.851859 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.851803    2578 scope.go:117] "RemoveContainer" containerID="6e95ec4be7cf82c571e46fd82e7e75142ca5fd1478edd782ab0ebd61166348b4"
Sep 15 09:29:26.861789 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.861772    2578 scope.go:117] "RemoveContainer" containerID="4687f5345bd41a46719ecd6b335a2aa6ccd2ec148576a7b378629ab47eb0b521"
Sep 15 09:29:26.872267 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.872250    2578 scope.go:117] "RemoveContainer" containerID="6e95ec4be7cf82c571e46fd82e7e75142ca5fd1478edd782ab0ebd61166348b4"
Sep 15 09:29:26.872524 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:29:26.872509    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e95ec4be7cf82c571e46fd82e7e75142ca5fd1478edd782ab0ebd61166348b4\": container with ID starting with 6e95ec4be7cf82c571e46fd82e7e75142ca5fd1478edd782ab0ebd61166348b4 not found: ID does not exist" containerID="6e95ec4be7cf82c571e46fd82e7e75142ca5fd1478edd782ab0ebd61166348b4"
Sep 15 09:29:26.872585 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.872532    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e95ec4be7cf82c571e46fd82e7e75142ca5fd1478edd782ab0ebd61166348b4"} err="failed to get container status \"6e95ec4be7cf82c571e46fd82e7e75142ca5fd1478edd782ab0ebd61166348b4\": rpc error: code = NotFound desc = could not find container \"6e95ec4be7cf82c571e46fd82e7e75142ca5fd1478edd782ab0ebd61166348b4\": container with ID starting with 6e95ec4be7cf82c571e46fd82e7e75142ca5fd1478edd782ab0ebd61166348b4 not found: ID does not exist"
Sep 15 09:29:26.872585 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.872549    2578 scope.go:117] "RemoveContainer" containerID="4687f5345bd41a46719ecd6b335a2aa6ccd2ec148576a7b378629ab47eb0b521"
Sep 15 09:29:26.872814 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:29:26.872796    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4687f5345bd41a46719ecd6b335a2aa6ccd2ec148576a7b378629ab47eb0b521\": container with ID starting with 4687f5345bd41a46719ecd6b335a2aa6ccd2ec148576a7b378629ab47eb0b521 not found: ID does not exist" containerID="4687f5345bd41a46719ecd6b335a2aa6ccd2ec148576a7b378629ab47eb0b521"
Sep 15 09:29:26.872864 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.872821    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4687f5345bd41a46719ecd6b335a2aa6ccd2ec148576a7b378629ab47eb0b521"} err="failed to get container status \"4687f5345bd41a46719ecd6b335a2aa6ccd2ec148576a7b378629ab47eb0b521\": rpc error: code = NotFound desc = could not find container \"4687f5345bd41a46719ecd6b335a2aa6ccd2ec148576a7b378629ab47eb0b521\": container with ID starting with 4687f5345bd41a46719ecd6b335a2aa6ccd2ec148576a7b378629ab47eb0b521 not found: ID does not exist"
Sep 15 09:29:26.873887 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.873867    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv"]
Sep 15 09:29:26.877057 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.877038    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-357b9aa6-gw-openshift-default-85fb56bf48-z6fkv"]
Sep 15 09:29:26.986452 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:26.986434    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-3494740c-79789c69b6-kf66w"]
Sep 15 09:29:26.987554 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:29:26.987529    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bc6c0dc_ced8_4bb8_8086_f23e13599d28.slice/crio-3868af2fea9264fde10c7221cbd4d4a132f2085cee6051874fefa59e40ca8b8f WatchSource:0}: Error finding container 3868af2fea9264fde10c7221cbd4d4a132f2085cee6051874fefa59e40ca8b8f: Status 404 returned error can't find the container with id 3868af2fea9264fde10c7221cbd4d4a132f2085cee6051874fefa59e40ca8b8f
Sep 15 09:29:27.030835 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:27.030815    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-3494740c-66fd6b7767-bktkf"]
Sep 15 09:29:27.044053 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:29:27.044027    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c9e3667_7fb8_47d4_8eaa_db68aedeec48.slice/crio-134bafeb63143fbca9d0045de96ba5c2c25aca239a046ae47c2ff867a41262d2 WatchSource:0}: Error finding container 134bafeb63143fbca9d0045de96ba5c2c25aca239a046ae47c2ff867a41262d2: Status 404 returned error can't find the container with id 134bafeb63143fbca9d0045de96ba5c2c25aca239a046ae47c2ff867a41262d2
Sep 15 09:29:27.861090 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:27.861055    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-3494740c-66fd6b7767-bktkf" event={"ID":"2c9e3667-7fb8-47d4-8eaa-db68aedeec48","Type":"ContainerStarted","Data":"9d5504bfedc6ff36502c795ba8508bedbd9a9031aa3d5cc7c5020e3369bffcb2"}
Sep 15 09:29:27.861467 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:27.861109    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-3494740c-66fd6b7767-bktkf" event={"ID":"2c9e3667-7fb8-47d4-8eaa-db68aedeec48","Type":"ContainerStarted","Data":"134bafeb63143fbca9d0045de96ba5c2c25aca239a046ae47c2ff867a41262d2"}
Sep 15 09:29:27.861467 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:27.861242    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-3494740c-66fd6b7767-bktkf"
Sep 15 09:29:27.863542 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:27.863517    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-3494740c-79789c69b6-kf66w" event={"ID":"4bc6c0dc-ced8-4bb8-8086-f23e13599d28","Type":"ContainerStarted","Data":"9f6966b32fa700148fa40ced8e1046a69cf1b686525a0c5452a82d744e0b1ea3"}
Sep 15 09:29:27.863663 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:27.863552    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-3494740c-79789c69b6-kf66w" event={"ID":"4bc6c0dc-ced8-4bb8-8086-f23e13599d28","Type":"ContainerStarted","Data":"3868af2fea9264fde10c7221cbd4d4a132f2085cee6051874fefa59e40ca8b8f"}
Sep 15 09:29:27.863663 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:27.863571    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-3494740c-79789c69b6-kf66w"
Sep 15 09:29:27.879731 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:27.879674    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-3494740c-66fd6b7767-bktkf" podStartSLOduration=1.87966194 podStartE2EDuration="1.87966194s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:29:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:29:27.878232996 +0000 UTC m=+912.216678271" watchObservedRunningTime="2026-09-15 09:29:27.87966194 +0000 UTC m=+912.218107209"
Sep 15 09:29:27.893637 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:27.893598    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-3494740c-79789c69b6-kf66w" podStartSLOduration=1.893586751 podStartE2EDuration="1.893586751s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:29:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:29:27.892528201 +0000 UTC m=+912.230973492" watchObservedRunningTime="2026-09-15 09:29:27.893586751 +0000 UTC m=+912.232032025"
Sep 15 09:29:28.125481 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:28.125390    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7" path="/var/lib/kubelet/pods/2da63a6b-128d-4cb2-bed9-1f0ee8d0cff7/volumes"
Sep 15 09:29:38.872579 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:38.872546    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-3494740c-66fd6b7767-bktkf"
Sep 15 09:29:38.873080 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:38.872626    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-3494740c-79789c69b6-kf66w"
Sep 15 09:29:49.905658 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:49.905623    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3494740c-j8l2b"]
Sep 15 09:29:49.909218 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:49.909202    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3494740c-j8l2b"
Sep 15 09:29:49.911567 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:49.911542    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 09:29:49.911767 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:49.911601    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cbqnn\""
Sep 15 09:29:49.916464 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:49.916435    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3494740c-j8l2b"]
Sep 15 09:29:50.032543 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:50.032507    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/89352b07-d513-4ad7-8eea-a1223fb1f058-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3494740c-j8l2b\" (UID: \"89352b07-d513-4ad7-8eea-a1223fb1f058\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3494740c-j8l2b"
Sep 15 09:29:50.134251 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:50.134218    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/89352b07-d513-4ad7-8eea-a1223fb1f058-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3494740c-j8l2b\" (UID: \"89352b07-d513-4ad7-8eea-a1223fb1f058\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3494740c-j8l2b"
Sep 15 09:29:50.135066 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:50.135034    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/89352b07-d513-4ad7-8eea-a1223fb1f058-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3494740c-j8l2b\" (UID: \"89352b07-d513-4ad7-8eea-a1223fb1f058\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3494740c-j8l2b"
Sep 15 09:29:50.223371 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:50.223343    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3494740c-j8l2b"
Sep 15 09:29:50.502495 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:50.502467    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3494740c-j8l2b"]
Sep 15 09:29:50.504201 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:29:50.504172    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89352b07_d513_4ad7_8eea_a1223fb1f058.slice/crio-b495f14c3070d7b00b133a064de1ff7083645371ab05188fcbfe958c94ba2d15 WatchSource:0}: Error finding container b495f14c3070d7b00b133a064de1ff7083645371ab05188fcbfe958c94ba2d15: Status 404 returned error can't find the container with id b495f14c3070d7b00b133a064de1ff7083645371ab05188fcbfe958c94ba2d15
Sep 15 09:29:51.005459 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:51.005424    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3494740c-j8l2b" event={"ID":"89352b07-d513-4ad7-8eea-a1223fb1f058","Type":"ContainerStarted","Data":"b694213451666e8a907618f3063ace8d54150d788c3e6416937a658170264d82"}
Sep 15 09:29:51.005755 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:51.005524    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3494740c-j8l2b" event={"ID":"89352b07-d513-4ad7-8eea-a1223fb1f058","Type":"ContainerStarted","Data":"b495f14c3070d7b00b133a064de1ff7083645371ab05188fcbfe958c94ba2d15"}
Sep 15 09:29:51.026168 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:51.026113    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3494740c-j8l2b" podStartSLOduration=2.026094562 podStartE2EDuration="2.026094562s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:29:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:29:51.021453804 +0000 UTC m=+935.359899077" watchObservedRunningTime="2026-09-15 09:29:51.026094562 +0000 UTC m=+935.364539837"
Sep 15 09:29:52.012577 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:52.012544    2578 generic.go:356] "Generic (PLEG): container finished" podID="89352b07-d513-4ad7-8eea-a1223fb1f058" containerID="b694213451666e8a907618f3063ace8d54150d788c3e6416937a658170264d82" exitCode=0
Sep 15 09:29:52.012941 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:52.012631    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3494740c-j8l2b" event={"ID":"89352b07-d513-4ad7-8eea-a1223fb1f058","Type":"ContainerDied","Data":"b694213451666e8a907618f3063ace8d54150d788c3e6416937a658170264d82"}
Sep 15 09:29:53.156230 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:53.156207    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3494740c-j8l2b"
Sep 15 09:29:53.267264 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:53.267234    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/89352b07-d513-4ad7-8eea-a1223fb1f058-maas-api-service-ca\") pod \"89352b07-d513-4ad7-8eea-a1223fb1f058\" (UID: \"89352b07-d513-4ad7-8eea-a1223fb1f058\") "
Sep 15 09:29:53.267548 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:53.267523    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89352b07-d513-4ad7-8eea-a1223fb1f058-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "89352b07-d513-4ad7-8eea-a1223fb1f058" (UID: "89352b07-d513-4ad7-8eea-a1223fb1f058"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:29:53.267667 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:53.267648    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/89352b07-d513-4ad7-8eea-a1223fb1f058-maas-api-service-ca\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:29:54.027017 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:54.026984    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3494740c-j8l2b"
Sep 15 09:29:54.027182 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:54.026982    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3494740c-j8l2b" event={"ID":"89352b07-d513-4ad7-8eea-a1223fb1f058","Type":"ContainerDied","Data":"b495f14c3070d7b00b133a064de1ff7083645371ab05188fcbfe958c94ba2d15"}
Sep 15 09:29:54.027182 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:54.027108    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b495f14c3070d7b00b133a064de1ff7083645371ab05188fcbfe958c94ba2d15"
Sep 15 09:29:54.864072 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:54.864039    2578 patch_prober.go:28] interesting pod/e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 15 09:29:54.864437 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:54.864093    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r" podUID="19164e2f-f7a2-4f0b-aa25-74da38b3a19f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 15 09:29:55.601401 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:55.601356    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-3494740c-66fd6b7767-bktkf"]
Sep 15 09:29:55.601663 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:55.601637    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-3494740c-66fd6b7767-bktkf" podUID="2c9e3667-7fb8-47d4-8eaa-db68aedeec48" containerName="payload-processing" containerID="cri-o://9d5504bfedc6ff36502c795ba8508bedbd9a9031aa3d5cc7c5020e3369bffcb2" gracePeriod=30
Sep 15 09:29:55.611461 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:55.611434    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-3494740c-79789c69b6-kf66w"]
Sep 15 09:29:55.611823 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:55.611800    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-3494740c-79789c69b6-kf66w" podUID="4bc6c0dc-ced8-4bb8-8086-f23e13599d28" containerName="payload-pre-processing" containerID="cri-o://9f6966b32fa700148fa40ced8e1046a69cf1b686525a0c5452a82d744e0b1ea3" gracePeriod=30
Sep 15 09:29:55.761395 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:55.761335    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3494740c-j8l2b"]
Sep 15 09:29:55.765005 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:55.764980    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3494740c-j8l2b"]
Sep 15 09:29:55.887672 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:55.887650    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-3494740c-66fd6b7767-bktkf"
Sep 15 09:29:55.891052 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:55.891033    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-3494740c-79789c69b6-kf66w"
Sep 15 09:29:55.993679 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:55.993653    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2c9e3667-7fb8-47d4-8eaa-db68aedeec48-plugins-config-volume\") pod \"2c9e3667-7fb8-47d4-8eaa-db68aedeec48\" (UID: \"2c9e3667-7fb8-47d4-8eaa-db68aedeec48\") "
Sep 15 09:29:55.993815 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:55.993769    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4bc6c0dc-ced8-4bb8-8086-f23e13599d28-plugins-config-volume\") pod \"4bc6c0dc-ced8-4bb8-8086-f23e13599d28\" (UID: \"4bc6c0dc-ced8-4bb8-8086-f23e13599d28\") "
Sep 15 09:29:55.993815 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:55.993800    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fp5zc\" (UniqueName: \"kubernetes.io/projected/4bc6c0dc-ced8-4bb8-8086-f23e13599d28-kube-api-access-fp5zc\") pod \"4bc6c0dc-ced8-4bb8-8086-f23e13599d28\" (UID: \"4bc6c0dc-ced8-4bb8-8086-f23e13599d28\") "
Sep 15 09:29:55.993961 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:55.993829    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6mp26\" (UniqueName: \"kubernetes.io/projected/2c9e3667-7fb8-47d4-8eaa-db68aedeec48-kube-api-access-6mp26\") pod \"2c9e3667-7fb8-47d4-8eaa-db68aedeec48\" (UID: \"2c9e3667-7fb8-47d4-8eaa-db68aedeec48\") "
Sep 15 09:29:55.994100 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:55.994077    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c9e3667-7fb8-47d4-8eaa-db68aedeec48-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2c9e3667-7fb8-47d4-8eaa-db68aedeec48" (UID: "2c9e3667-7fb8-47d4-8eaa-db68aedeec48"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:29:55.994173 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:55.994129    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bc6c0dc-ced8-4bb8-8086-f23e13599d28-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4bc6c0dc-ced8-4bb8-8086-f23e13599d28" (UID: "4bc6c0dc-ced8-4bb8-8086-f23e13599d28"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:29:55.994228 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:55.994197    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2c9e3667-7fb8-47d4-8eaa-db68aedeec48-plugins-config-volume\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:29:55.995744 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:55.995725    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bc6c0dc-ced8-4bb8-8086-f23e13599d28-kube-api-access-fp5zc" (OuterVolumeSpecName: "kube-api-access-fp5zc") pod "4bc6c0dc-ced8-4bb8-8086-f23e13599d28" (UID: "4bc6c0dc-ced8-4bb8-8086-f23e13599d28"). InnerVolumeSpecName "kube-api-access-fp5zc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:29:55.995849 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:55.995828    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c9e3667-7fb8-47d4-8eaa-db68aedeec48-kube-api-access-6mp26" (OuterVolumeSpecName: "kube-api-access-6mp26") pod "2c9e3667-7fb8-47d4-8eaa-db68aedeec48" (UID: "2c9e3667-7fb8-47d4-8eaa-db68aedeec48"). InnerVolumeSpecName "kube-api-access-6mp26". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:29:56.039584 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:56.039561    2578 generic.go:356] "Generic (PLEG): container finished" podID="4bc6c0dc-ced8-4bb8-8086-f23e13599d28" containerID="9f6966b32fa700148fa40ced8e1046a69cf1b686525a0c5452a82d744e0b1ea3" exitCode=0
Sep 15 09:29:56.039685 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:56.039610    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-3494740c-79789c69b6-kf66w"
Sep 15 09:29:56.039685 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:56.039637    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-3494740c-79789c69b6-kf66w" event={"ID":"4bc6c0dc-ced8-4bb8-8086-f23e13599d28","Type":"ContainerDied","Data":"9f6966b32fa700148fa40ced8e1046a69cf1b686525a0c5452a82d744e0b1ea3"}
Sep 15 09:29:56.039798 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:56.039687    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-3494740c-79789c69b6-kf66w" event={"ID":"4bc6c0dc-ced8-4bb8-8086-f23e13599d28","Type":"ContainerDied","Data":"3868af2fea9264fde10c7221cbd4d4a132f2085cee6051874fefa59e40ca8b8f"}
Sep 15 09:29:56.039798 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:56.039711    2578 scope.go:117] "RemoveContainer" containerID="9f6966b32fa700148fa40ced8e1046a69cf1b686525a0c5452a82d744e0b1ea3"
Sep 15 09:29:56.041522 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:56.041499    2578 generic.go:356] "Generic (PLEG): container finished" podID="19164e2f-f7a2-4f0b-aa25-74da38b3a19f" containerID="639dc4684890f2cf90e822ced8e2c4206d65f5aa071b4f2e48b766237a150a6d" exitCode=0
Sep 15 09:29:56.041610 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:56.041575    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r" event={"ID":"19164e2f-f7a2-4f0b-aa25-74da38b3a19f","Type":"ContainerDied","Data":"639dc4684890f2cf90e822ced8e2c4206d65f5aa071b4f2e48b766237a150a6d"}
Sep 15 09:29:56.042050 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:56.042027    2578 scope.go:117] "RemoveContainer" containerID="639dc4684890f2cf90e822ced8e2c4206d65f5aa071b4f2e48b766237a150a6d"
Sep 15 09:29:56.043203 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:56.043175    2578 generic.go:356] "Generic (PLEG): container finished" podID="2c9e3667-7fb8-47d4-8eaa-db68aedeec48" containerID="9d5504bfedc6ff36502c795ba8508bedbd9a9031aa3d5cc7c5020e3369bffcb2" exitCode=0
Sep 15 09:29:56.043300 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:56.043206    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-3494740c-66fd6b7767-bktkf" event={"ID":"2c9e3667-7fb8-47d4-8eaa-db68aedeec48","Type":"ContainerDied","Data":"9d5504bfedc6ff36502c795ba8508bedbd9a9031aa3d5cc7c5020e3369bffcb2"}
Sep 15 09:29:56.043300 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:56.043212    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:29:56.043300 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:56.043245    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-3494740c-66fd6b7767-bktkf" event={"ID":"2c9e3667-7fb8-47d4-8eaa-db68aedeec48","Type":"ContainerDied","Data":"134bafeb63143fbca9d0045de96ba5c2c25aca239a046ae47c2ff867a41262d2"}
Sep 15 09:29:56.043300 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:56.043275    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:29:56.043522 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:56.043307    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-3494740c-66fd6b7767-bktkf"
Sep 15 09:29:56.043522 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:56.043347    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:29:56.056750 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:56.056730    2578 scope.go:117] "RemoveContainer" containerID="9f6966b32fa700148fa40ced8e1046a69cf1b686525a0c5452a82d744e0b1ea3"
Sep 15 09:29:56.057014 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:29:56.056994    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f6966b32fa700148fa40ced8e1046a69cf1b686525a0c5452a82d744e0b1ea3\": container with ID starting with 9f6966b32fa700148fa40ced8e1046a69cf1b686525a0c5452a82d744e0b1ea3 not found: ID does not exist" containerID="9f6966b32fa700148fa40ced8e1046a69cf1b686525a0c5452a82d744e0b1ea3"
Sep 15 09:29:56.057088 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:56.057022    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f6966b32fa700148fa40ced8e1046a69cf1b686525a0c5452a82d744e0b1ea3"} err="failed to get container status \"9f6966b32fa700148fa40ced8e1046a69cf1b686525a0c5452a82d744e0b1ea3\": rpc error: code = NotFound desc = could not find container \"9f6966b32fa700148fa40ced8e1046a69cf1b686525a0c5452a82d744e0b1ea3\": container with ID starting with 9f6966b32fa700148fa40ced8e1046a69cf1b686525a0c5452a82d744e0b1ea3 not found: ID does not exist"
Sep 15 09:29:56.057088 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:56.057037    2578 scope.go:117] "RemoveContainer" containerID="9d5504bfedc6ff36502c795ba8508bedbd9a9031aa3d5cc7c5020e3369bffcb2"
Sep 15 09:29:56.066663 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:56.066641    2578 scope.go:117] "RemoveContainer" containerID="9d5504bfedc6ff36502c795ba8508bedbd9a9031aa3d5cc7c5020e3369bffcb2"
Sep 15 09:29:56.066958 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:29:56.066926    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d5504bfedc6ff36502c795ba8508bedbd9a9031aa3d5cc7c5020e3369bffcb2\": container with ID starting with 9d5504bfedc6ff36502c795ba8508bedbd9a9031aa3d5cc7c5020e3369bffcb2 not found: ID does not exist" containerID="9d5504bfedc6ff36502c795ba8508bedbd9a9031aa3d5cc7c5020e3369bffcb2"
Sep 15 09:29:56.067043 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:56.066999    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d5504bfedc6ff36502c795ba8508bedbd9a9031aa3d5cc7c5020e3369bffcb2"} err="failed to get container status \"9d5504bfedc6ff36502c795ba8508bedbd9a9031aa3d5cc7c5020e3369bffcb2\": rpc error: code = NotFound desc = could not find container \"9d5504bfedc6ff36502c795ba8508bedbd9a9031aa3d5cc7c5020e3369bffcb2\": container with ID starting with 9d5504bfedc6ff36502c795ba8508bedbd9a9031aa3d5cc7c5020e3369bffcb2 not found: ID does not exist"
Sep 15 09:29:56.079613 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:56.079591    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-3494740c-66fd6b7767-bktkf"]
Sep 15 09:29:56.083625 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:56.083602    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-3494740c-66fd6b7767-bktkf"]
Sep 15 09:29:56.093164 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:56.093145    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-3494740c-79789c69b6-kf66w"]
Sep 15 09:29:56.095538 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:56.095517    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4bc6c0dc-ced8-4bb8-8086-f23e13599d28-plugins-config-volume\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:29:56.095538 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:56.095541    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fp5zc\" (UniqueName: \"kubernetes.io/projected/4bc6c0dc-ced8-4bb8-8086-f23e13599d28-kube-api-access-fp5zc\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:29:56.095751 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:56.095559    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6mp26\" (UniqueName: \"kubernetes.io/projected/2c9e3667-7fb8-47d4-8eaa-db68aedeec48-kube-api-access-6mp26\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:29:56.097448 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:56.097419    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-3494740c-79789c69b6-kf66w"]
Sep 15 09:29:56.122131 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:56.122103    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c9e3667-7fb8-47d4-8eaa-db68aedeec48" path="/var/lib/kubelet/pods/2c9e3667-7fb8-47d4-8eaa-db68aedeec48/volumes"
Sep 15 09:29:56.122521 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:56.122503    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bc6c0dc-ced8-4bb8-8086-f23e13599d28" path="/var/lib/kubelet/pods/4bc6c0dc-ced8-4bb8-8086-f23e13599d28/volumes"
Sep 15 09:29:56.122852 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:56.122834    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89352b07-d513-4ad7-8eea-a1223fb1f058" path="/var/lib/kubelet/pods/89352b07-d513-4ad7-8eea-a1223fb1f058/volumes"
Sep 15 09:29:56.954987 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:56.954940    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r"]
Sep 15 09:29:57.058665 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:57.058632    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r" event={"ID":"19164e2f-f7a2-4f0b-aa25-74da38b3a19f","Type":"ContainerStarted","Data":"a453b18583233ec334f42a088296b912555e16c6c45ee9be7a6518dd007d6e7a"}
Sep 15 09:29:57.059744 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:57.058782    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r" podUID="19164e2f-f7a2-4f0b-aa25-74da38b3a19f" containerName="istio-proxy" containerID="cri-o://a453b18583233ec334f42a088296b912555e16c6c45ee9be7a6518dd007d6e7a" gracePeriod=30
Sep 15 09:29:57.652549 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:57.652511    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d"]
Sep 15 09:29:57.653121 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:57.653106    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bc6c0dc-ced8-4bb8-8086-f23e13599d28" containerName="payload-pre-processing"
Sep 15 09:29:57.653174 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:57.653125    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bc6c0dc-ced8-4bb8-8086-f23e13599d28" containerName="payload-pre-processing"
Sep 15 09:29:57.653174 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:57.653139    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c9e3667-7fb8-47d4-8eaa-db68aedeec48" containerName="payload-processing"
Sep 15 09:29:57.653174 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:57.653148    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c9e3667-7fb8-47d4-8eaa-db68aedeec48" containerName="payload-processing"
Sep 15 09:29:57.653174 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:57.653162    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89352b07-d513-4ad7-8eea-a1223fb1f058" containerName="revoke-keys"
Sep 15 09:29:57.653174 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:57.653171    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="89352b07-d513-4ad7-8eea-a1223fb1f058" containerName="revoke-keys"
Sep 15 09:29:57.653363 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:57.653253    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bc6c0dc-ced8-4bb8-8086-f23e13599d28" containerName="payload-pre-processing"
Sep 15 09:29:57.653363 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:57.653263    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="89352b07-d513-4ad7-8eea-a1223fb1f058" containerName="revoke-keys"
Sep 15 09:29:57.653363 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:57.653274    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c9e3667-7fb8-47d4-8eaa-db68aedeec48" containerName="payload-processing"
Sep 15 09:29:57.656164 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:57.656140    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d"
Sep 15 09:29:57.658712 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:57.658690    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-b75aaea1-openshift-default-dockercfg-vg4qc\""
Sep 15 09:29:57.667254 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:57.667075    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d"]
Sep 15 09:29:57.811732 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:57.811693    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ac8967c-a498-4ed9-8d37-f9e035336964-istiod-ca-cert\") pod \"e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d\" (UID: \"5ac8967c-a498-4ed9-8d37-f9e035336964\") " pod="openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d"
Sep 15 09:29:57.812047 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:57.812023    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ac8967c-a498-4ed9-8d37-f9e035336964-workload-socket\") pod \"e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d\" (UID: \"5ac8967c-a498-4ed9-8d37-f9e035336964\") " pod="openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d"
Sep 15 09:29:57.812188 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:57.812172    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ac8967c-a498-4ed9-8d37-f9e035336964-workload-certs\") pod \"e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d\" (UID: \"5ac8967c-a498-4ed9-8d37-f9e035336964\") " pod="openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d"
Sep 15 09:29:57.812343 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:57.812325    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ac8967c-a498-4ed9-8d37-f9e035336964-istio-data\") pod \"e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d\" (UID: \"5ac8967c-a498-4ed9-8d37-f9e035336964\") " pod="openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d"
Sep 15 09:29:57.812502 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:57.812485    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkbs2\" (UniqueName: \"kubernetes.io/projected/5ac8967c-a498-4ed9-8d37-f9e035336964-kube-api-access-tkbs2\") pod \"e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d\" (UID: \"5ac8967c-a498-4ed9-8d37-f9e035336964\") " pod="openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d"
Sep 15 09:29:57.812611 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:57.812598    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ac8967c-a498-4ed9-8d37-f9e035336964-credential-socket\") pod \"e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d\" (UID: \"5ac8967c-a498-4ed9-8d37-f9e035336964\") " pod="openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d"
Sep 15 09:29:57.812717 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:57.812704    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ac8967c-a498-4ed9-8d37-f9e035336964-istio-podinfo\") pod \"e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d\" (UID: \"5ac8967c-a498-4ed9-8d37-f9e035336964\") " pod="openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d"
Sep 15 09:29:57.812825 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:57.812811    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ac8967c-a498-4ed9-8d37-f9e035336964-istio-token\") pod \"e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d\" (UID: \"5ac8967c-a498-4ed9-8d37-f9e035336964\") " pod="openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d"
Sep 15 09:29:57.812961 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:57.812930    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ac8967c-a498-4ed9-8d37-f9e035336964-istio-envoy\") pod \"e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d\" (UID: \"5ac8967c-a498-4ed9-8d37-f9e035336964\") " pod="openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d"
Sep 15 09:29:57.914568 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:57.914481    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkbs2\" (UniqueName: \"kubernetes.io/projected/5ac8967c-a498-4ed9-8d37-f9e035336964-kube-api-access-tkbs2\") pod \"e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d\" (UID: \"5ac8967c-a498-4ed9-8d37-f9e035336964\") " pod="openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d"
Sep 15 09:29:57.915170 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:57.915146    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ac8967c-a498-4ed9-8d37-f9e035336964-credential-socket\") pod \"e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d\" (UID: \"5ac8967c-a498-4ed9-8d37-f9e035336964\") " pod="openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d"
Sep 15 09:29:57.915733 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:57.915713    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ac8967c-a498-4ed9-8d37-f9e035336964-istio-podinfo\") pod \"e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d\" (UID: \"5ac8967c-a498-4ed9-8d37-f9e035336964\") " pod="openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d"
Sep 15 09:29:57.916333 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:57.916315    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ac8967c-a498-4ed9-8d37-f9e035336964-istio-token\") pod \"e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d\" (UID: \"5ac8967c-a498-4ed9-8d37-f9e035336964\") " pod="openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d"
Sep 15 09:29:57.916561 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:57.916547    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ac8967c-a498-4ed9-8d37-f9e035336964-istio-envoy\") pod \"e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d\" (UID: \"5ac8967c-a498-4ed9-8d37-f9e035336964\") " pod="openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d"
Sep 15 09:29:57.917018 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:57.916999    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ac8967c-a498-4ed9-8d37-f9e035336964-istiod-ca-cert\") pod \"e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d\" (UID: \"5ac8967c-a498-4ed9-8d37-f9e035336964\") " pod="openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d"
Sep 15 09:29:57.917939 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:57.917918    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ac8967c-a498-4ed9-8d37-f9e035336964-workload-socket\") pod \"e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d\" (UID: \"5ac8967c-a498-4ed9-8d37-f9e035336964\") " pod="openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d"
Sep 15 09:29:57.918425 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:57.918407    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ac8967c-a498-4ed9-8d37-f9e035336964-workload-certs\") pod \"e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d\" (UID: \"5ac8967c-a498-4ed9-8d37-f9e035336964\") " pod="openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d"
Sep 15 09:29:57.919466 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:57.919449    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ac8967c-a498-4ed9-8d37-f9e035336964-istio-data\") pod \"e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d\" (UID: \"5ac8967c-a498-4ed9-8d37-f9e035336964\") " pod="openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d"
Sep 15 09:29:57.919939 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:57.917772    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ac8967c-a498-4ed9-8d37-f9e035336964-istiod-ca-cert\") pod \"e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d\" (UID: \"5ac8967c-a498-4ed9-8d37-f9e035336964\") " pod="openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d"
Sep 15 09:29:57.920102 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:57.915653    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ac8967c-a498-4ed9-8d37-f9e035336964-credential-socket\") pod \"e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d\" (UID: \"5ac8967c-a498-4ed9-8d37-f9e035336964\") " pod="openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d"
Sep 15 09:29:57.920315 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:57.918769    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ac8967c-a498-4ed9-8d37-f9e035336964-workload-certs\") pod \"e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d\" (UID: \"5ac8967c-a498-4ed9-8d37-f9e035336964\") " pod="openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d"
Sep 15 09:29:57.920435 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:57.919188    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ac8967c-a498-4ed9-8d37-f9e035336964-istio-envoy\") pod \"e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d\" (UID: \"5ac8967c-a498-4ed9-8d37-f9e035336964\") " pod="openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d"
Sep 15 09:29:57.920885 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:57.919364    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ac8967c-a498-4ed9-8d37-f9e035336964-istio-podinfo\") pod \"e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d\" (UID: \"5ac8967c-a498-4ed9-8d37-f9e035336964\") " pod="openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d"
Sep 15 09:29:57.921088 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:57.918346    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ac8967c-a498-4ed9-8d37-f9e035336964-workload-socket\") pod \"e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d\" (UID: \"5ac8967c-a498-4ed9-8d37-f9e035336964\") " pod="openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d"
Sep 15 09:29:57.921203 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:57.919812    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ac8967c-a498-4ed9-8d37-f9e035336964-istio-data\") pod \"e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d\" (UID: \"5ac8967c-a498-4ed9-8d37-f9e035336964\") " pod="openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d"
Sep 15 09:29:57.925610 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:57.925570    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkbs2\" (UniqueName: \"kubernetes.io/projected/5ac8967c-a498-4ed9-8d37-f9e035336964-kube-api-access-tkbs2\") pod \"e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d\" (UID: \"5ac8967c-a498-4ed9-8d37-f9e035336964\") " pod="openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d"
Sep 15 09:29:57.931414 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:57.931394    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ac8967c-a498-4ed9-8d37-f9e035336964-istio-token\") pod \"e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d\" (UID: \"5ac8967c-a498-4ed9-8d37-f9e035336964\") " pod="openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d"
Sep 15 09:29:57.970903 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:57.970882    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d"
Sep 15 09:29:58.273043 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:58.273011    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d"]
Sep 15 09:29:58.273570 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:29:58.273546    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ac8967c_a498_4ed9_8d37_f9e035336964.slice/crio-4f1fe1eb051c1751617cbfd946bf184904f3c26d56d5eaa5f1bbda3b25ae83b5 WatchSource:0}: Error finding container 4f1fe1eb051c1751617cbfd946bf184904f3c26d56d5eaa5f1bbda3b25ae83b5: Status 404 returned error can't find the container with id 4f1fe1eb051c1751617cbfd946bf184904f3c26d56d5eaa5f1bbda3b25ae83b5
Sep 15 09:29:58.276225 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:58.276190    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:29:58.276315 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:58.276251    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:29:58.276315 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:58.276278    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:29:59.074810 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:59.074778    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d" event={"ID":"5ac8967c-a498-4ed9-8d37-f9e035336964","Type":"ContainerStarted","Data":"6084c5370a4f5a58abb5aa78ad3c684d27cef561927198cf43a53cadb6c38137"}
Sep 15 09:29:59.075178 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:59.074831    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d" event={"ID":"5ac8967c-a498-4ed9-8d37-f9e035336964","Type":"ContainerStarted","Data":"4f1fe1eb051c1751617cbfd946bf184904f3c26d56d5eaa5f1bbda3b25ae83b5"}
Sep 15 09:29:59.097531 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:59.097488    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d" podStartSLOduration=2.097473484 podStartE2EDuration="2.097473484s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:29:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:29:59.094161 +0000 UTC m=+943.432606275" watchObservedRunningTime="2026-09-15 09:29:59.097473484 +0000 UTC m=+943.435918760"
Sep 15 09:29:59.971756 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:59.971724    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d"
Sep 15 09:29:59.977193 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:29:59.977166    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d"
Sep 15 09:30:00.081024 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:00.080997    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d"
Sep 15 09:30:00.081824 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:00.081808    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d"
Sep 15 09:30:00.153511 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:00.153478    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29824410-n6qss"]
Sep 15 09:30:00.156506 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:00.156484    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824410-n6qss"
Sep 15 09:30:00.157102 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:00.157072    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-7a31d6-29824410-rkvbh"]
Sep 15 09:30:00.159093 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:00.159071    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cbqnn\""
Sep 15 09:30:00.159778 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:00.159758    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-7a31d6-29824410-rkvbh"
Sep 15 09:30:00.160465 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:00.160446    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-3b0480-29824410-sjmkj"]
Sep 15 09:30:00.163636 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:00.163617    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-3b0480-29824410-sjmkj"
Sep 15 09:30:00.165491 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:00.165472    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29824410-n6qss"]
Sep 15 09:30:00.171283 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:00.171262    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-7a31d6-29824410-rkvbh"]
Sep 15 09:30:00.174710 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:00.174691    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-3b0480-29824410-sjmkj"]
Sep 15 09:30:00.174848 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:00.174786    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824410-n6qss"
Sep 15 09:30:00.186612 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:00.186591    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-7a31d6-29824410-rkvbh"
Sep 15 09:30:00.195434 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:00.195412    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-3b0480-29824410-sjmkj"
Sep 15 09:30:00.502980 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:00.502930    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29824410-n6qss"]
Sep 15 09:30:00.504062 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:30:00.504036    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46d8501f_6414_451e_9abe_a2f0d62e3a09.slice/crio-9063f76c8c77fd89262da5f49071cd72f030c3f91ec49fc886e5e30409b2c930 WatchSource:0}: Error finding container 9063f76c8c77fd89262da5f49071cd72f030c3f91ec49fc886e5e30409b2c930: Status 404 returned error can't find the container with id 9063f76c8c77fd89262da5f49071cd72f030c3f91ec49fc886e5e30409b2c930
Sep 15 09:30:00.506422 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:00.506396    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-7a31d6-29824410-rkvbh"]
Sep 15 09:30:00.507006 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:30:00.506981    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ec4d6c3_a305_4c8e_afa6_cae200389e8c.slice/crio-6062671d7ebd6ebdeaa3e2a097350e5464544babbf1b6dad26c88c61f7ab1059 WatchSource:0}: Error finding container 6062671d7ebd6ebdeaa3e2a097350e5464544babbf1b6dad26c88c61f7ab1059: Status 404 returned error can't find the container with id 6062671d7ebd6ebdeaa3e2a097350e5464544babbf1b6dad26c88c61f7ab1059
Sep 15 09:30:00.534968 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:00.527094    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-3b0480-29824410-sjmkj"]
Sep 15 09:30:00.546480 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:30:00.546450    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1d01d1c_7316_451f_9a0b_c689d45bd056.slice/crio-96ee6028c35491b179a5f476f08aad006dffb7ad25c15ae8872566d0caed024d WatchSource:0}: Error finding container 96ee6028c35491b179a5f476f08aad006dffb7ad25c15ae8872566d0caed024d: Status 404 returned error can't find the container with id 96ee6028c35491b179a5f476f08aad006dffb7ad25c15ae8872566d0caed024d
Sep 15 09:30:01.088437 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:01.088327    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-7a31d6-29824410-rkvbh" event={"ID":"6ec4d6c3-a305-4c8e-afa6-cae200389e8c","Type":"ContainerStarted","Data":"730e6170c0427a3481b46702df33af39dc3e5323613e131c3ffc7dd264251876"}
Sep 15 09:30:01.088437 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:01.088423    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-7a31d6-29824410-rkvbh" event={"ID":"6ec4d6c3-a305-4c8e-afa6-cae200389e8c","Type":"ContainerStarted","Data":"6062671d7ebd6ebdeaa3e2a097350e5464544babbf1b6dad26c88c61f7ab1059"}
Sep 15 09:30:01.089811 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:01.089770    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-3b0480-29824410-sjmkj" event={"ID":"a1d01d1c-7316-451f-9a0b-c689d45bd056","Type":"ContainerStarted","Data":"29ca6e0786f743ea87dc7284bc9a152678526972f2011a8187774788b6df1c68"}
Sep 15 09:30:01.089980 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:01.089821    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-3b0480-29824410-sjmkj" event={"ID":"a1d01d1c-7316-451f-9a0b-c689d45bd056","Type":"ContainerStarted","Data":"96ee6028c35491b179a5f476f08aad006dffb7ad25c15ae8872566d0caed024d"}
Sep 15 09:30:01.091344 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:01.091320    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824410-n6qss" event={"ID":"46d8501f-6414-451e-9abe-a2f0d62e3a09","Type":"ContainerStarted","Data":"f7ace6d76044665e42135266d36fe20a909279a3d8b75ab8e5d5281f0afd9ff0"}
Sep 15 09:30:01.091459 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:01.091367    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824410-n6qss" event={"ID":"46d8501f-6414-451e-9abe-a2f0d62e3a09","Type":"ContainerStarted","Data":"9063f76c8c77fd89262da5f49071cd72f030c3f91ec49fc886e5e30409b2c930"}
Sep 15 09:30:01.102520 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:01.102471    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-7a31d6-29824410-rkvbh" podStartSLOduration=1.102456045 podStartE2EDuration="1.102456045s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:30:01.102330684 +0000 UTC m=+945.440775961" watchObservedRunningTime="2026-09-15 09:30:01.102456045 +0000 UTC m=+945.440901321"
Sep 15 09:30:01.118245 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:01.118195    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824410-n6qss" podStartSLOduration=1.118179275 podStartE2EDuration="1.118179275s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:30:01.116771329 +0000 UTC m=+945.455216605" watchObservedRunningTime="2026-09-15 09:30:01.118179275 +0000 UTC m=+945.456624551"
Sep 15 09:30:01.132234 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:01.132191    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-3b0480-29824410-sjmkj" podStartSLOduration=1.132173845 podStartE2EDuration="1.132173845s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:30:01.130900277 +0000 UTC m=+945.469345553" watchObservedRunningTime="2026-09-15 09:30:01.132173845 +0000 UTC m=+945.470619122"
Sep 15 09:30:02.102411 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:02.102328    2578 generic.go:356] "Generic (PLEG): container finished" podID="46d8501f-6414-451e-9abe-a2f0d62e3a09" containerID="f7ace6d76044665e42135266d36fe20a909279a3d8b75ab8e5d5281f0afd9ff0" exitCode=0
Sep 15 09:30:02.102755 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:02.102412    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824410-n6qss" event={"ID":"46d8501f-6414-451e-9abe-a2f0d62e3a09","Type":"ContainerDied","Data":"f7ace6d76044665e42135266d36fe20a909279a3d8b75ab8e5d5281f0afd9ff0"}
Sep 15 09:30:02.103924 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:02.103902    2578 generic.go:356] "Generic (PLEG): container finished" podID="6ec4d6c3-a305-4c8e-afa6-cae200389e8c" containerID="730e6170c0427a3481b46702df33af39dc3e5323613e131c3ffc7dd264251876" exitCode=0
Sep 15 09:30:02.104050 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:02.103933    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-7a31d6-29824410-rkvbh" event={"ID":"6ec4d6c3-a305-4c8e-afa6-cae200389e8c","Type":"ContainerDied","Data":"730e6170c0427a3481b46702df33af39dc3e5323613e131c3ffc7dd264251876"}
Sep 15 09:30:02.105482 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:02.105464    2578 generic.go:356] "Generic (PLEG): container finished" podID="a1d01d1c-7316-451f-9a0b-c689d45bd056" containerID="29ca6e0786f743ea87dc7284bc9a152678526972f2011a8187774788b6df1c68" exitCode=0
Sep 15 09:30:02.105570 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:02.105488    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-3b0480-29824410-sjmkj" event={"ID":"a1d01d1c-7316-451f-9a0b-c689d45bd056","Type":"ContainerDied","Data":"29ca6e0786f743ea87dc7284bc9a152678526972f2011a8187774788b6df1c68"}
Sep 15 09:30:03.259850 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:03.259830    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824410-n6qss"
Sep 15 09:30:03.304470 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:03.304448    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-7a31d6-29824410-rkvbh"
Sep 15 09:30:03.307592 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:03.307574    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-3b0480-29824410-sjmkj"
Sep 15 09:30:04.119767 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:04.119736    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-3b0480-29824410-sjmkj"
Sep 15 09:30:04.121160 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:04.121130    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824410-n6qss"
Sep 15 09:30:04.122647 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:04.122624    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-7a31d6-29824410-rkvbh"
Sep 15 09:30:04.123055 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:04.122886    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-3b0480-29824410-sjmkj" event={"ID":"a1d01d1c-7316-451f-9a0b-c689d45bd056","Type":"ContainerDied","Data":"96ee6028c35491b179a5f476f08aad006dffb7ad25c15ae8872566d0caed024d"}
Sep 15 09:30:04.123055 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:04.122929    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="96ee6028c35491b179a5f476f08aad006dffb7ad25c15ae8872566d0caed024d"
Sep 15 09:30:04.123055 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:04.122959    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824410-n6qss" event={"ID":"46d8501f-6414-451e-9abe-a2f0d62e3a09","Type":"ContainerDied","Data":"9063f76c8c77fd89262da5f49071cd72f030c3f91ec49fc886e5e30409b2c930"}
Sep 15 09:30:04.123055 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:04.122981    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9063f76c8c77fd89262da5f49071cd72f030c3f91ec49fc886e5e30409b2c930"
Sep 15 09:30:04.123055 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:04.122993    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-7a31d6-29824410-rkvbh" event={"ID":"6ec4d6c3-a305-4c8e-afa6-cae200389e8c","Type":"ContainerDied","Data":"6062671d7ebd6ebdeaa3e2a097350e5464544babbf1b6dad26c88c61f7ab1059"}
Sep 15 09:30:04.123055 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:04.123011    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6062671d7ebd6ebdeaa3e2a097350e5464544babbf1b6dad26c88c61f7ab1059"
Sep 15 09:30:05.767793 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:05.767760    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-b75aaea1-85bc79bd6b-gqz2h"]
Sep 15 09:30:05.768185 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:05.768135    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46d8501f-6414-451e-9abe-a2f0d62e3a09" containerName="cleanup"
Sep 15 09:30:05.768185 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:05.768146    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="46d8501f-6414-451e-9abe-a2f0d62e3a09" containerName="cleanup"
Sep 15 09:30:05.768185 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:05.768180    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1d01d1c-7316-451f-9a0b-c689d45bd056" containerName="cleanup"
Sep 15 09:30:05.768185 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:05.768186    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1d01d1c-7316-451f-9a0b-c689d45bd056" containerName="cleanup"
Sep 15 09:30:05.768319 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:05.768194    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ec4d6c3-a305-4c8e-afa6-cae200389e8c" containerName="cleanup"
Sep 15 09:30:05.768319 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:05.768199    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ec4d6c3-a305-4c8e-afa6-cae200389e8c" containerName="cleanup"
Sep 15 09:30:05.768319 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:05.768264    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="46d8501f-6414-451e-9abe-a2f0d62e3a09" containerName="cleanup"
Sep 15 09:30:05.768319 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:05.768271    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1d01d1c-7316-451f-9a0b-c689d45bd056" containerName="cleanup"
Sep 15 09:30:05.768319 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:05.768281    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ec4d6c3-a305-4c8e-afa6-cae200389e8c" containerName="cleanup"
Sep 15 09:30:05.770188 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:05.770167    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-b75aaea1-85bc79bd6b-gqz2h"
Sep 15 09:30:05.772395 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:05.772377    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-b75aaea1\""
Sep 15 09:30:05.772509 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:05.772416    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-b75aaea1-dockercfg-p6dpz\""
Sep 15 09:30:05.781529 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:05.781505    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-b75aaea1-85bc79bd6b-gqz2h"]
Sep 15 09:30:05.794283 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:05.794261    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-b75aaea1-75f67bf8df-txghc"]
Sep 15 09:30:05.796848 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:05.796834    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-b75aaea1-75f67bf8df-txghc"
Sep 15 09:30:05.806390 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:05.806368    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-b75aaea1-75f67bf8df-txghc"]
Sep 15 09:30:05.812714 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:05.812694    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hgw8\" (UniqueName: \"kubernetes.io/projected/fd98a4ec-4880-457b-98ed-d64d47bfa038-kube-api-access-6hgw8\") pod \"payload-processing-e2e-derive-b75aaea1-75f67bf8df-txghc\" (UID: \"fd98a4ec-4880-457b-98ed-d64d47bfa038\") " pod="openshift-ingress/payload-processing-e2e-derive-b75aaea1-75f67bf8df-txghc"
Sep 15 09:30:05.812797 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:05.812749    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqx5b\" (UniqueName: \"kubernetes.io/projected/38ad6447-a244-441b-bbd0-6bee38778b98-kube-api-access-vqx5b\") pod \"payload-pre-processing-e2e-derive-b75aaea1-85bc79bd6b-gqz2h\" (UID: \"38ad6447-a244-441b-bbd0-6bee38778b98\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-b75aaea1-85bc79bd6b-gqz2h"
Sep 15 09:30:05.812843 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:05.812799    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd98a4ec-4880-457b-98ed-d64d47bfa038-plugins-config-volume\") pod \"payload-processing-e2e-derive-b75aaea1-75f67bf8df-txghc\" (UID: \"fd98a4ec-4880-457b-98ed-d64d47bfa038\") " pod="openshift-ingress/payload-processing-e2e-derive-b75aaea1-75f67bf8df-txghc"
Sep 15 09:30:05.812843 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:05.812835    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/38ad6447-a244-441b-bbd0-6bee38778b98-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-b75aaea1-85bc79bd6b-gqz2h\" (UID: \"38ad6447-a244-441b-bbd0-6bee38778b98\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-b75aaea1-85bc79bd6b-gqz2h"
Sep 15 09:30:05.913524 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:05.913487    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/38ad6447-a244-441b-bbd0-6bee38778b98-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-b75aaea1-85bc79bd6b-gqz2h\" (UID: \"38ad6447-a244-441b-bbd0-6bee38778b98\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-b75aaea1-85bc79bd6b-gqz2h"
Sep 15 09:30:05.913861 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:05.913837    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hgw8\" (UniqueName: \"kubernetes.io/projected/fd98a4ec-4880-457b-98ed-d64d47bfa038-kube-api-access-6hgw8\") pod \"payload-processing-e2e-derive-b75aaea1-75f67bf8df-txghc\" (UID: \"fd98a4ec-4880-457b-98ed-d64d47bfa038\") " pod="openshift-ingress/payload-processing-e2e-derive-b75aaea1-75f67bf8df-txghc"
Sep 15 09:30:05.914074 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:05.914056    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqx5b\" (UniqueName: \"kubernetes.io/projected/38ad6447-a244-441b-bbd0-6bee38778b98-kube-api-access-vqx5b\") pod \"payload-pre-processing-e2e-derive-b75aaea1-85bc79bd6b-gqz2h\" (UID: \"38ad6447-a244-441b-bbd0-6bee38778b98\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-b75aaea1-85bc79bd6b-gqz2h"
Sep 15 09:30:05.914234 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:05.914216    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd98a4ec-4880-457b-98ed-d64d47bfa038-plugins-config-volume\") pod \"payload-processing-e2e-derive-b75aaea1-75f67bf8df-txghc\" (UID: \"fd98a4ec-4880-457b-98ed-d64d47bfa038\") " pod="openshift-ingress/payload-processing-e2e-derive-b75aaea1-75f67bf8df-txghc"
Sep 15 09:30:05.915280 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:05.915258    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd98a4ec-4880-457b-98ed-d64d47bfa038-plugins-config-volume\") pod \"payload-processing-e2e-derive-b75aaea1-75f67bf8df-txghc\" (UID: \"fd98a4ec-4880-457b-98ed-d64d47bfa038\") " pod="openshift-ingress/payload-processing-e2e-derive-b75aaea1-75f67bf8df-txghc"
Sep 15 09:30:05.915404 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:05.915310    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/38ad6447-a244-441b-bbd0-6bee38778b98-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-b75aaea1-85bc79bd6b-gqz2h\" (UID: \"38ad6447-a244-441b-bbd0-6bee38778b98\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-b75aaea1-85bc79bd6b-gqz2h"
Sep 15 09:30:05.924174 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:05.924141    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqx5b\" (UniqueName: \"kubernetes.io/projected/38ad6447-a244-441b-bbd0-6bee38778b98-kube-api-access-vqx5b\") pod \"payload-pre-processing-e2e-derive-b75aaea1-85bc79bd6b-gqz2h\" (UID: \"38ad6447-a244-441b-bbd0-6bee38778b98\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-b75aaea1-85bc79bd6b-gqz2h"
Sep 15 09:30:05.924564 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:05.924540    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hgw8\" (UniqueName: \"kubernetes.io/projected/fd98a4ec-4880-457b-98ed-d64d47bfa038-kube-api-access-6hgw8\") pod \"payload-processing-e2e-derive-b75aaea1-75f67bf8df-txghc\" (UID: \"fd98a4ec-4880-457b-98ed-d64d47bfa038\") " pod="openshift-ingress/payload-processing-e2e-derive-b75aaea1-75f67bf8df-txghc"
Sep 15 09:30:06.081396 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:06.081320    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-b75aaea1-85bc79bd6b-gqz2h"
Sep 15 09:30:06.106806 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:06.106780    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-b75aaea1-75f67bf8df-txghc"
Sep 15 09:30:06.355399 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:06.355378    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-b75aaea1-85bc79bd6b-gqz2h"]
Sep 15 09:30:06.356302 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:30:06.356274    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38ad6447_a244_441b_bbd0_6bee38778b98.slice/crio-ea681fb34a6f18294c45d34618bf34bded0fa10a4d967c5e2b6b53854de0345a WatchSource:0}: Error finding container ea681fb34a6f18294c45d34618bf34bded0fa10a4d967c5e2b6b53854de0345a: Status 404 returned error can't find the container with id ea681fb34a6f18294c45d34618bf34bded0fa10a4d967c5e2b6b53854de0345a
Sep 15 09:30:06.382748 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:06.382727    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-b75aaea1-75f67bf8df-txghc"]
Sep 15 09:30:06.390903 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:30:06.390871    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd98a4ec_4880_457b_98ed_d64d47bfa038.slice/crio-52267ad66be457198db844130906b7f5a479d74b4a2323915d3eef8f7c089aa4 WatchSource:0}: Error finding container 52267ad66be457198db844130906b7f5a479d74b4a2323915d3eef8f7c089aa4: Status 404 returned error can't find the container with id 52267ad66be457198db844130906b7f5a479d74b4a2323915d3eef8f7c089aa4
Sep 15 09:30:07.149064 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:07.149032    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-b75aaea1-75f67bf8df-txghc" event={"ID":"fd98a4ec-4880-457b-98ed-d64d47bfa038","Type":"ContainerStarted","Data":"c3bac197d3793baed94d7a9977bca860064a44c84b19d162ce3db7fe7ce96b1f"}
Sep 15 09:30:07.149476 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:07.149079    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-b75aaea1-75f67bf8df-txghc" event={"ID":"fd98a4ec-4880-457b-98ed-d64d47bfa038","Type":"ContainerStarted","Data":"52267ad66be457198db844130906b7f5a479d74b4a2323915d3eef8f7c089aa4"}
Sep 15 09:30:07.149476 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:07.149147    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-b75aaea1-75f67bf8df-txghc"
Sep 15 09:30:07.150881 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:07.150856    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-b75aaea1-85bc79bd6b-gqz2h" event={"ID":"38ad6447-a244-441b-bbd0-6bee38778b98","Type":"ContainerStarted","Data":"ff749b859c94f0d01e0a8f5160184b8f8f44464626478c1b9b7f7332a3350347"}
Sep 15 09:30:07.151003 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:07.150898    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-b75aaea1-85bc79bd6b-gqz2h" event={"ID":"38ad6447-a244-441b-bbd0-6bee38778b98","Type":"ContainerStarted","Data":"ea681fb34a6f18294c45d34618bf34bded0fa10a4d967c5e2b6b53854de0345a"}
Sep 15 09:30:07.151003 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:07.150982    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-b75aaea1-85bc79bd6b-gqz2h"
Sep 15 09:30:07.167336 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:07.167291    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-b75aaea1-75f67bf8df-txghc" podStartSLOduration=2.167274662 podStartE2EDuration="2.167274662s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:30:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:30:07.164588602 +0000 UTC m=+951.503033877" watchObservedRunningTime="2026-09-15 09:30:07.167274662 +0000 UTC m=+951.505719941"
Sep 15 09:30:07.181038 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:07.180997    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-b75aaea1-85bc79bd6b-gqz2h" podStartSLOduration=2.180984793 podStartE2EDuration="2.180984793s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:30:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:30:07.178092518 +0000 UTC m=+951.516537794" watchObservedRunningTime="2026-09-15 09:30:07.180984793 +0000 UTC m=+951.519430068"
Sep 15 09:30:07.611467 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:07.611444    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r"
Sep 15 09:30:07.632564 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:07.631696    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19164e2f-f7a2-4f0b-aa25-74da38b3a19f-istio-podinfo\") pod \"19164e2f-f7a2-4f0b-aa25-74da38b3a19f\" (UID: \"19164e2f-f7a2-4f0b-aa25-74da38b3a19f\") "
Sep 15 09:30:07.632564 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:07.631782    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zw7g2\" (UniqueName: \"kubernetes.io/projected/19164e2f-f7a2-4f0b-aa25-74da38b3a19f-kube-api-access-zw7g2\") pod \"19164e2f-f7a2-4f0b-aa25-74da38b3a19f\" (UID: \"19164e2f-f7a2-4f0b-aa25-74da38b3a19f\") "
Sep 15 09:30:07.632564 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:07.631830    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19164e2f-f7a2-4f0b-aa25-74da38b3a19f-istiod-ca-cert\") pod \"19164e2f-f7a2-4f0b-aa25-74da38b3a19f\" (UID: \"19164e2f-f7a2-4f0b-aa25-74da38b3a19f\") "
Sep 15 09:30:07.632564 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:07.631860    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19164e2f-f7a2-4f0b-aa25-74da38b3a19f-istio-envoy\") pod \"19164e2f-f7a2-4f0b-aa25-74da38b3a19f\" (UID: \"19164e2f-f7a2-4f0b-aa25-74da38b3a19f\") "
Sep 15 09:30:07.632564 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:07.631887    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19164e2f-f7a2-4f0b-aa25-74da38b3a19f-workload-certs\") pod \"19164e2f-f7a2-4f0b-aa25-74da38b3a19f\" (UID: \"19164e2f-f7a2-4f0b-aa25-74da38b3a19f\") "
Sep 15 09:30:07.632564 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:07.631911    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19164e2f-f7a2-4f0b-aa25-74da38b3a19f-istio-token\") pod \"19164e2f-f7a2-4f0b-aa25-74da38b3a19f\" (UID: \"19164e2f-f7a2-4f0b-aa25-74da38b3a19f\") "
Sep 15 09:30:07.632564 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:07.632009    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19164e2f-f7a2-4f0b-aa25-74da38b3a19f-credential-socket\") pod \"19164e2f-f7a2-4f0b-aa25-74da38b3a19f\" (UID: \"19164e2f-f7a2-4f0b-aa25-74da38b3a19f\") "
Sep 15 09:30:07.632564 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:07.632057    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19164e2f-f7a2-4f0b-aa25-74da38b3a19f-istio-data\") pod \"19164e2f-f7a2-4f0b-aa25-74da38b3a19f\" (UID: \"19164e2f-f7a2-4f0b-aa25-74da38b3a19f\") "
Sep 15 09:30:07.632564 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:07.632093    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19164e2f-f7a2-4f0b-aa25-74da38b3a19f-workload-socket\") pod \"19164e2f-f7a2-4f0b-aa25-74da38b3a19f\" (UID: \"19164e2f-f7a2-4f0b-aa25-74da38b3a19f\") "
Sep 15 09:30:07.632564 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:07.632216    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19164e2f-f7a2-4f0b-aa25-74da38b3a19f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "19164e2f-f7a2-4f0b-aa25-74da38b3a19f" (UID: "19164e2f-f7a2-4f0b-aa25-74da38b3a19f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:30:07.632564 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:07.632369    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19164e2f-f7a2-4f0b-aa25-74da38b3a19f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "19164e2f-f7a2-4f0b-aa25-74da38b3a19f" (UID: "19164e2f-f7a2-4f0b-aa25-74da38b3a19f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:30:07.632564 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:07.632409    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19164e2f-f7a2-4f0b-aa25-74da38b3a19f-istio-data" (OuterVolumeSpecName: "istio-data") pod "19164e2f-f7a2-4f0b-aa25-74da38b3a19f" (UID: "19164e2f-f7a2-4f0b-aa25-74da38b3a19f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:30:07.632564 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:07.632510    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19164e2f-f7a2-4f0b-aa25-74da38b3a19f-credential-socket\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:30:07.632564 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:07.632529    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19164e2f-f7a2-4f0b-aa25-74da38b3a19f-istio-data\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:30:07.632564 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:07.632542    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19164e2f-f7a2-4f0b-aa25-74da38b3a19f-istiod-ca-cert\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:30:07.633374 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:07.632549    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19164e2f-f7a2-4f0b-aa25-74da38b3a19f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "19164e2f-f7a2-4f0b-aa25-74da38b3a19f" (UID: "19164e2f-f7a2-4f0b-aa25-74da38b3a19f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:30:07.633374 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:07.632608    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19164e2f-f7a2-4f0b-aa25-74da38b3a19f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "19164e2f-f7a2-4f0b-aa25-74da38b3a19f" (UID: "19164e2f-f7a2-4f0b-aa25-74da38b3a19f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:30:07.635017 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:07.634990    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19164e2f-f7a2-4f0b-aa25-74da38b3a19f-kube-api-access-zw7g2" (OuterVolumeSpecName: "kube-api-access-zw7g2") pod "19164e2f-f7a2-4f0b-aa25-74da38b3a19f" (UID: "19164e2f-f7a2-4f0b-aa25-74da38b3a19f"). InnerVolumeSpecName "kube-api-access-zw7g2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:30:07.635134 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:07.635098    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19164e2f-f7a2-4f0b-aa25-74da38b3a19f-istio-token" (OuterVolumeSpecName: "istio-token") pod "19164e2f-f7a2-4f0b-aa25-74da38b3a19f" (UID: "19164e2f-f7a2-4f0b-aa25-74da38b3a19f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:30:07.635222 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:07.635194    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19164e2f-f7a2-4f0b-aa25-74da38b3a19f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "19164e2f-f7a2-4f0b-aa25-74da38b3a19f" (UID: "19164e2f-f7a2-4f0b-aa25-74da38b3a19f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:30:07.636508 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:07.636484    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/19164e2f-f7a2-4f0b-aa25-74da38b3a19f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "19164e2f-f7a2-4f0b-aa25-74da38b3a19f" (UID: "19164e2f-f7a2-4f0b-aa25-74da38b3a19f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 09:30:07.733682 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:07.733622    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zw7g2\" (UniqueName: \"kubernetes.io/projected/19164e2f-f7a2-4f0b-aa25-74da38b3a19f-kube-api-access-zw7g2\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:30:07.733682 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:07.733651    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19164e2f-f7a2-4f0b-aa25-74da38b3a19f-istio-envoy\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:30:07.733682 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:07.733665    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19164e2f-f7a2-4f0b-aa25-74da38b3a19f-workload-certs\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:30:07.733682 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:07.733677    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19164e2f-f7a2-4f0b-aa25-74da38b3a19f-istio-token\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:30:07.733922 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:07.733690    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19164e2f-f7a2-4f0b-aa25-74da38b3a19f-workload-socket\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:30:07.733922 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:07.733705    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19164e2f-f7a2-4f0b-aa25-74da38b3a19f-istio-podinfo\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:30:08.167402 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:08.167370    2578 generic.go:356] "Generic (PLEG): container finished" podID="19164e2f-f7a2-4f0b-aa25-74da38b3a19f" containerID="a453b18583233ec334f42a088296b912555e16c6c45ee9be7a6518dd007d6e7a" exitCode=0
Sep 15 09:30:08.167703 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:08.167422    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r"
Sep 15 09:30:08.167703 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:08.167449    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r" event={"ID":"19164e2f-f7a2-4f0b-aa25-74da38b3a19f","Type":"ContainerDied","Data":"a453b18583233ec334f42a088296b912555e16c6c45ee9be7a6518dd007d6e7a"}
Sep 15 09:30:08.167703 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:08.167524    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r" event={"ID":"19164e2f-f7a2-4f0b-aa25-74da38b3a19f","Type":"ContainerDied","Data":"8913598ef5a2fef0333525ecfc4bf228f75d300891e1fa4e429cca3a6657c269"}
Sep 15 09:30:08.167703 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:08.167549    2578 scope.go:117] "RemoveContainer" containerID="a453b18583233ec334f42a088296b912555e16c6c45ee9be7a6518dd007d6e7a"
Sep 15 09:30:08.176798 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:08.176776    2578 scope.go:117] "RemoveContainer" containerID="639dc4684890f2cf90e822ced8e2c4206d65f5aa071b4f2e48b766237a150a6d"
Sep 15 09:30:08.185439 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:08.185403    2578 scope.go:117] "RemoveContainer" containerID="a453b18583233ec334f42a088296b912555e16c6c45ee9be7a6518dd007d6e7a"
Sep 15 09:30:08.185824 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:30:08.185798    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a453b18583233ec334f42a088296b912555e16c6c45ee9be7a6518dd007d6e7a\": container with ID starting with a453b18583233ec334f42a088296b912555e16c6c45ee9be7a6518dd007d6e7a not found: ID does not exist" containerID="a453b18583233ec334f42a088296b912555e16c6c45ee9be7a6518dd007d6e7a"
Sep 15 09:30:08.185901 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:08.185823    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a453b18583233ec334f42a088296b912555e16c6c45ee9be7a6518dd007d6e7a"} err="failed to get container status \"a453b18583233ec334f42a088296b912555e16c6c45ee9be7a6518dd007d6e7a\": rpc error: code = NotFound desc = could not find container \"a453b18583233ec334f42a088296b912555e16c6c45ee9be7a6518dd007d6e7a\": container with ID starting with a453b18583233ec334f42a088296b912555e16c6c45ee9be7a6518dd007d6e7a not found: ID does not exist"
Sep 15 09:30:08.185901 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:08.185838    2578 scope.go:117] "RemoveContainer" containerID="639dc4684890f2cf90e822ced8e2c4206d65f5aa071b4f2e48b766237a150a6d"
Sep 15 09:30:08.186099 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:30:08.186082    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"639dc4684890f2cf90e822ced8e2c4206d65f5aa071b4f2e48b766237a150a6d\": container with ID starting with 639dc4684890f2cf90e822ced8e2c4206d65f5aa071b4f2e48b766237a150a6d not found: ID does not exist" containerID="639dc4684890f2cf90e822ced8e2c4206d65f5aa071b4f2e48b766237a150a6d"
Sep 15 09:30:08.186149 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:08.186101    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"639dc4684890f2cf90e822ced8e2c4206d65f5aa071b4f2e48b766237a150a6d"} err="failed to get container status \"639dc4684890f2cf90e822ced8e2c4206d65f5aa071b4f2e48b766237a150a6d\": rpc error: code = NotFound desc = could not find container \"639dc4684890f2cf90e822ced8e2c4206d65f5aa071b4f2e48b766237a150a6d\": container with ID starting with 639dc4684890f2cf90e822ced8e2c4206d65f5aa071b4f2e48b766237a150a6d not found: ID does not exist"
Sep 15 09:30:08.189864 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:08.189845    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r"]
Sep 15 09:30:08.193652 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:08.193630    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-3494740c-openshift-default-6fb4f79d44-j648r"]
Sep 15 09:30:10.122295 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:10.122255    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19164e2f-f7a2-4f0b-aa25-74da38b3a19f" path="/var/lib/kubelet/pods/19164e2f-f7a2-4f0b-aa25-74da38b3a19f/volumes"
Sep 15 09:30:18.169740 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:18.169709    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-b75aaea1-75f67bf8df-txghc"
Sep 15 09:30:18.170159 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:18.169860    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-b75aaea1-85bc79bd6b-gqz2h"
Sep 15 09:30:24.285182 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:24.285148    2578 generic.go:356] "Generic (PLEG): container finished" podID="5ac8967c-a498-4ed9-8d37-f9e035336964" containerID="6084c5370a4f5a58abb5aa78ad3c684d27cef561927198cf43a53cadb6c38137" exitCode=0
Sep 15 09:30:24.285608 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:24.285221    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d" event={"ID":"5ac8967c-a498-4ed9-8d37-f9e035336964","Type":"ContainerDied","Data":"6084c5370a4f5a58abb5aa78ad3c684d27cef561927198cf43a53cadb6c38137"}
Sep 15 09:30:24.285651 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:24.285609    2578 scope.go:117] "RemoveContainer" containerID="6084c5370a4f5a58abb5aa78ad3c684d27cef561927198cf43a53cadb6c38137"
Sep 15 09:30:24.286883 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:24.286850    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:30:24.286983 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:24.286940    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:30:24.287030 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:24.286998    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:30:25.293670 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:25.293633    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d" event={"ID":"5ac8967c-a498-4ed9-8d37-f9e035336964","Type":"ContainerStarted","Data":"4f363650dd49ed1adc0ae720c8df4f0a4f8ff1f85389663e7e2cf9d3df350047"}
Sep 15 09:30:25.971310 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:25.971279    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d"
Sep 15 09:30:25.972171 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:25.972142    2578 patch_prober.go:28] interesting pod/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 15 09:30:25.972235 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:25.972209    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d" podUID="5ac8967c-a498-4ed9-8d37-f9e035336964" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 15 09:30:26.971788 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:26.971751    2578 patch_prober.go:28] interesting pod/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 15 09:30:26.972228 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:26.971806    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d" podUID="5ac8967c-a498-4ed9-8d37-f9e035336964" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 15 09:30:27.971848 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:27.971815    2578 patch_prober.go:28] interesting pod/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 15 09:30:27.972251 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:27.971869    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d" podUID="5ac8967c-a498-4ed9-8d37-f9e035336964" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 15 09:30:28.971909 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:28.971875    2578 patch_prober.go:28] interesting pod/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 15 09:30:28.972320 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:28.971942    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d" podUID="5ac8967c-a498-4ed9-8d37-f9e035336964" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 15 09:30:29.971237 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:29.971202    2578 patch_prober.go:28] interesting pod/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 15 09:30:29.971389 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:29.971258    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d" podUID="5ac8967c-a498-4ed9-8d37-f9e035336964" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 15 09:30:30.081303 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:30.081274    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d"
Sep 15 09:30:30.392442 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:30.392367    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b75aaea1-kvm64"]
Sep 15 09:30:30.392765 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:30.392753    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19164e2f-f7a2-4f0b-aa25-74da38b3a19f" containerName="istio-proxy"
Sep 15 09:30:30.392816 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:30.392766    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="19164e2f-f7a2-4f0b-aa25-74da38b3a19f" containerName="istio-proxy"
Sep 15 09:30:30.392816 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:30.392781    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19164e2f-f7a2-4f0b-aa25-74da38b3a19f" containerName="istio-proxy"
Sep 15 09:30:30.392816 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:30.392787    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="19164e2f-f7a2-4f0b-aa25-74da38b3a19f" containerName="istio-proxy"
Sep 15 09:30:30.392927 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:30.392850    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="19164e2f-f7a2-4f0b-aa25-74da38b3a19f" containerName="istio-proxy"
Sep 15 09:30:30.394984 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:30.394968    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b75aaea1-kvm64"
Sep 15 09:30:30.397157 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:30.397134    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cbqnn\""
Sep 15 09:30:30.397278 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:30.397263    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 09:30:30.402090 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:30.402066    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b75aaea1-kvm64"]
Sep 15 09:30:30.561466 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:30.561436    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b645678b-a384-4eb0-932a-870ed172ff76-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-b75aaea1-kvm64\" (UID: \"b645678b-a384-4eb0-932a-870ed172ff76\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b75aaea1-kvm64"
Sep 15 09:30:30.662651 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:30.662578    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b645678b-a384-4eb0-932a-870ed172ff76-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-b75aaea1-kvm64\" (UID: \"b645678b-a384-4eb0-932a-870ed172ff76\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b75aaea1-kvm64"
Sep 15 09:30:30.663202 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:30.663182    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b645678b-a384-4eb0-932a-870ed172ff76-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-b75aaea1-kvm64\" (UID: \"b645678b-a384-4eb0-932a-870ed172ff76\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b75aaea1-kvm64"
Sep 15 09:30:30.707508 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:30.707475    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b75aaea1-kvm64"
Sep 15 09:30:30.971485 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:30.971448    2578 patch_prober.go:28] interesting pod/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 15 09:30:30.971668 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:30.971507    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d" podUID="5ac8967c-a498-4ed9-8d37-f9e035336964" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 15 09:30:30.997303 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:30.997272    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b75aaea1-kvm64"]
Sep 15 09:30:30.998831 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:30:30.998807    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb645678b_a384_4eb0_932a_870ed172ff76.slice/crio-c4471eca0b4b6a099330572a0970ec6f5ce701f2f78311cdf2606bdd9174bc47 WatchSource:0}: Error finding container c4471eca0b4b6a099330572a0970ec6f5ce701f2f78311cdf2606bdd9174bc47: Status 404 returned error can't find the container with id c4471eca0b4b6a099330572a0970ec6f5ce701f2f78311cdf2606bdd9174bc47
Sep 15 09:30:31.341936 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:31.341860    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b75aaea1-kvm64" event={"ID":"b645678b-a384-4eb0-932a-870ed172ff76","Type":"ContainerStarted","Data":"c4471eca0b4b6a099330572a0970ec6f5ce701f2f78311cdf2606bdd9174bc47"}
Sep 15 09:30:31.975690 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:31.975669    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d"
Sep 15 09:30:31.976767 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:31.976746    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d"
Sep 15 09:30:32.349195 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:32.349162    2578 generic.go:356] "Generic (PLEG): container finished" podID="b645678b-a384-4eb0-932a-870ed172ff76" containerID="9fbe6223338c631cd5a7218833aca13dae36bdfc3a6ab4b366af5540434ab141" exitCode=0
Sep 15 09:30:32.349615 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:32.349241    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b75aaea1-kvm64" event={"ID":"b645678b-a384-4eb0-932a-870ed172ff76","Type":"ContainerDied","Data":"9fbe6223338c631cd5a7218833aca13dae36bdfc3a6ab4b366af5540434ab141"}
Sep 15 09:30:33.484688 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:33.484661    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b75aaea1-kvm64"
Sep 15 09:30:33.591062 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:33.591038    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b645678b-a384-4eb0-932a-870ed172ff76-maas-api-service-ca\") pod \"b645678b-a384-4eb0-932a-870ed172ff76\" (UID: \"b645678b-a384-4eb0-932a-870ed172ff76\") "
Sep 15 09:30:33.591341 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:33.591321    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b645678b-a384-4eb0-932a-870ed172ff76-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b645678b-a384-4eb0-932a-870ed172ff76" (UID: "b645678b-a384-4eb0-932a-870ed172ff76"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:30:33.698018 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:33.693014    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b645678b-a384-4eb0-932a-870ed172ff76-maas-api-service-ca\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:30:34.363648 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:34.363619    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b75aaea1-kvm64"
Sep 15 09:30:34.363648 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:34.363628    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b75aaea1-kvm64" event={"ID":"b645678b-a384-4eb0-932a-870ed172ff76","Type":"ContainerDied","Data":"c4471eca0b4b6a099330572a0970ec6f5ce701f2f78311cdf2606bdd9174bc47"}
Sep 15 09:30:34.363888 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:34.363669    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c4471eca0b4b6a099330572a0970ec6f5ce701f2f78311cdf2606bdd9174bc47"
Sep 15 09:30:35.405469 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:35.405438    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-7a31d6/test-model-7a31d6-kserve-786dfdddf-wwshg"]
Sep 15 09:30:35.405822 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:35.405805    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b645678b-a384-4eb0-932a-870ed172ff76" containerName="revoke-keys"
Sep 15 09:30:35.405822 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:35.405816    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b645678b-a384-4eb0-932a-870ed172ff76" containerName="revoke-keys"
Sep 15 09:30:35.405902 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:35.405884    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="19164e2f-f7a2-4f0b-aa25-74da38b3a19f" containerName="istio-proxy"
Sep 15 09:30:35.405902 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:35.405892    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b645678b-a384-4eb0-932a-870ed172ff76" containerName="revoke-keys"
Sep 15 09:30:35.407823 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:35.407808    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-7a31d6/test-model-7a31d6-kserve-786dfdddf-wwshg"
Sep 15 09:30:35.410017 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:35.409996    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-7a31d6\"/\"test-model-7a31d6-kserve-self-signed-certs\""
Sep 15 09:30:35.410994 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:35.410976    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-7a31d6\"/\"default-dockercfg-s9fp9\""
Sep 15 09:30:35.411053 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:35.411011    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-7a31d6\"/\"kube-root-ca.crt\""
Sep 15 09:30:35.411093 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:35.411011    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-7a31d6\"/\"openshift-service-ca.crt\""
Sep 15 09:30:35.418593 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:35.418569    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-7a31d6/test-model-7a31d6-kserve-786dfdddf-wwshg"]
Sep 15 09:30:35.510423 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:35.510393    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1c4b5f9-65b4-4994-b518-b0741439d9fc-tls-certs\") pod \"test-model-7a31d6-kserve-786dfdddf-wwshg\" (UID: \"b1c4b5f9-65b4-4994-b518-b0741439d9fc\") " pod="ai-tenant-e2e-inf-a-7a31d6/test-model-7a31d6-kserve-786dfdddf-wwshg"
Sep 15 09:30:35.510545 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:35.510428    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1c4b5f9-65b4-4994-b518-b0741439d9fc-home\") pod \"test-model-7a31d6-kserve-786dfdddf-wwshg\" (UID: \"b1c4b5f9-65b4-4994-b518-b0741439d9fc\") " pod="ai-tenant-e2e-inf-a-7a31d6/test-model-7a31d6-kserve-786dfdddf-wwshg"
Sep 15 09:30:35.510545 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:35.510461    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1c4b5f9-65b4-4994-b518-b0741439d9fc-dshm\") pod \"test-model-7a31d6-kserve-786dfdddf-wwshg\" (UID: \"b1c4b5f9-65b4-4994-b518-b0741439d9fc\") " pod="ai-tenant-e2e-inf-a-7a31d6/test-model-7a31d6-kserve-786dfdddf-wwshg"
Sep 15 09:30:35.510545 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:35.510526    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1c4b5f9-65b4-4994-b518-b0741439d9fc-tmp-dir\") pod \"test-model-7a31d6-kserve-786dfdddf-wwshg\" (UID: \"b1c4b5f9-65b4-4994-b518-b0741439d9fc\") " pod="ai-tenant-e2e-inf-a-7a31d6/test-model-7a31d6-kserve-786dfdddf-wwshg"
Sep 15 09:30:35.510662 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:35.510560    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1c4b5f9-65b4-4994-b518-b0741439d9fc-model-cache\") pod \"test-model-7a31d6-kserve-786dfdddf-wwshg\" (UID: \"b1c4b5f9-65b4-4994-b518-b0741439d9fc\") " pod="ai-tenant-e2e-inf-a-7a31d6/test-model-7a31d6-kserve-786dfdddf-wwshg"
Sep 15 09:30:35.510662 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:35.510578    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8rrz\" (UniqueName: \"kubernetes.io/projected/b1c4b5f9-65b4-4994-b518-b0741439d9fc-kube-api-access-w8rrz\") pod \"test-model-7a31d6-kserve-786dfdddf-wwshg\" (UID: \"b1c4b5f9-65b4-4994-b518-b0741439d9fc\") " pod="ai-tenant-e2e-inf-a-7a31d6/test-model-7a31d6-kserve-786dfdddf-wwshg"
Sep 15 09:30:35.611499 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:35.611461    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1c4b5f9-65b4-4994-b518-b0741439d9fc-dshm\") pod \"test-model-7a31d6-kserve-786dfdddf-wwshg\" (UID: \"b1c4b5f9-65b4-4994-b518-b0741439d9fc\") " pod="ai-tenant-e2e-inf-a-7a31d6/test-model-7a31d6-kserve-786dfdddf-wwshg"
Sep 15 09:30:35.611782 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:35.611759    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1c4b5f9-65b4-4994-b518-b0741439d9fc-tmp-dir\") pod \"test-model-7a31d6-kserve-786dfdddf-wwshg\" (UID: \"b1c4b5f9-65b4-4994-b518-b0741439d9fc\") " pod="ai-tenant-e2e-inf-a-7a31d6/test-model-7a31d6-kserve-786dfdddf-wwshg"
Sep 15 09:30:35.612307 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:35.612288    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1c4b5f9-65b4-4994-b518-b0741439d9fc-model-cache\") pod \"test-model-7a31d6-kserve-786dfdddf-wwshg\" (UID: \"b1c4b5f9-65b4-4994-b518-b0741439d9fc\") " pod="ai-tenant-e2e-inf-a-7a31d6/test-model-7a31d6-kserve-786dfdddf-wwshg"
Sep 15 09:30:35.612471 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:35.612456    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8rrz\" (UniqueName: \"kubernetes.io/projected/b1c4b5f9-65b4-4994-b518-b0741439d9fc-kube-api-access-w8rrz\") pod \"test-model-7a31d6-kserve-786dfdddf-wwshg\" (UID: \"b1c4b5f9-65b4-4994-b518-b0741439d9fc\") " pod="ai-tenant-e2e-inf-a-7a31d6/test-model-7a31d6-kserve-786dfdddf-wwshg"
Sep 15 09:30:35.612717 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:35.612702    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1c4b5f9-65b4-4994-b518-b0741439d9fc-tls-certs\") pod \"test-model-7a31d6-kserve-786dfdddf-wwshg\" (UID: \"b1c4b5f9-65b4-4994-b518-b0741439d9fc\") " pod="ai-tenant-e2e-inf-a-7a31d6/test-model-7a31d6-kserve-786dfdddf-wwshg"
Sep 15 09:30:35.612809 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:35.612782    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1c4b5f9-65b4-4994-b518-b0741439d9fc-model-cache\") pod \"test-model-7a31d6-kserve-786dfdddf-wwshg\" (UID: \"b1c4b5f9-65b4-4994-b518-b0741439d9fc\") " pod="ai-tenant-e2e-inf-a-7a31d6/test-model-7a31d6-kserve-786dfdddf-wwshg"
Sep 15 09:30:35.612893 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:35.612879    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1c4b5f9-65b4-4994-b518-b0741439d9fc-home\") pod \"test-model-7a31d6-kserve-786dfdddf-wwshg\" (UID: \"b1c4b5f9-65b4-4994-b518-b0741439d9fc\") " pod="ai-tenant-e2e-inf-a-7a31d6/test-model-7a31d6-kserve-786dfdddf-wwshg"
Sep 15 09:30:35.613042 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:35.612214    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1c4b5f9-65b4-4994-b518-b0741439d9fc-tmp-dir\") pod \"test-model-7a31d6-kserve-786dfdddf-wwshg\" (UID: \"b1c4b5f9-65b4-4994-b518-b0741439d9fc\") " pod="ai-tenant-e2e-inf-a-7a31d6/test-model-7a31d6-kserve-786dfdddf-wwshg"
Sep 15 09:30:35.613446 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:35.613386    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1c4b5f9-65b4-4994-b518-b0741439d9fc-home\") pod \"test-model-7a31d6-kserve-786dfdddf-wwshg\" (UID: \"b1c4b5f9-65b4-4994-b518-b0741439d9fc\") " pod="ai-tenant-e2e-inf-a-7a31d6/test-model-7a31d6-kserve-786dfdddf-wwshg"
Sep 15 09:30:35.615601 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:35.615581    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1c4b5f9-65b4-4994-b518-b0741439d9fc-dshm\") pod \"test-model-7a31d6-kserve-786dfdddf-wwshg\" (UID: \"b1c4b5f9-65b4-4994-b518-b0741439d9fc\") " pod="ai-tenant-e2e-inf-a-7a31d6/test-model-7a31d6-kserve-786dfdddf-wwshg"
Sep 15 09:30:35.618918 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:35.618263    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1c4b5f9-65b4-4994-b518-b0741439d9fc-tls-certs\") pod \"test-model-7a31d6-kserve-786dfdddf-wwshg\" (UID: \"b1c4b5f9-65b4-4994-b518-b0741439d9fc\") " pod="ai-tenant-e2e-inf-a-7a31d6/test-model-7a31d6-kserve-786dfdddf-wwshg"
Sep 15 09:30:35.621535 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:35.621494    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8rrz\" (UniqueName: \"kubernetes.io/projected/b1c4b5f9-65b4-4994-b518-b0741439d9fc-kube-api-access-w8rrz\") pod \"test-model-7a31d6-kserve-786dfdddf-wwshg\" (UID: \"b1c4b5f9-65b4-4994-b518-b0741439d9fc\") " pod="ai-tenant-e2e-inf-a-7a31d6/test-model-7a31d6-kserve-786dfdddf-wwshg"
Sep 15 09:30:35.717670 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:35.717627    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-7a31d6/test-model-7a31d6-kserve-786dfdddf-wwshg"
Sep 15 09:30:35.996081 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:35.995989    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-7a31d6/test-model-7a31d6-kserve-786dfdddf-wwshg"]
Sep 15 09:30:35.998720 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:30:35.998694    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb1c4b5f9_65b4_4994_b518_b0741439d9fc.slice/crio-e3e54f383551d46c5eb844f83330bafd50fac8d1151a10a149d18701576f8b6b WatchSource:0}: Error finding container e3e54f383551d46c5eb844f83330bafd50fac8d1151a10a149d18701576f8b6b: Status 404 returned error can't find the container with id e3e54f383551d46c5eb844f83330bafd50fac8d1151a10a149d18701576f8b6b
Sep 15 09:30:36.376912 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:36.376835    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-7a31d6/test-model-7a31d6-kserve-786dfdddf-wwshg" event={"ID":"b1c4b5f9-65b4-4994-b518-b0741439d9fc","Type":"ContainerStarted","Data":"e0dada56ea1647e258a52b8f0dff6ef914fad59c4df0ea2236e48178f608d0fa"}
Sep 15 09:30:36.376912 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:36.376871    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-7a31d6/test-model-7a31d6-kserve-786dfdddf-wwshg" event={"ID":"b1c4b5f9-65b4-4994-b518-b0741439d9fc","Type":"ContainerStarted","Data":"e3e54f383551d46c5eb844f83330bafd50fac8d1151a10a149d18701576f8b6b"}
Sep 15 09:30:36.404369 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:36.404319    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-7a31d6/test-model-7a31d6-kserve-786dfdddf-wwshg" podStartSLOduration=1.40430204 podStartE2EDuration="1.40430204s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:30:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:30:36.391761703 +0000 UTC m=+980.730206991" watchObservedRunningTime="2026-09-15 09:30:36.40430204 +0000 UTC m=+980.742747316"
Sep 15 09:30:42.521555 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:42.521368    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-b75aaea1-75f67bf8df-txghc"]
Sep 15 09:30:42.522260 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:42.522201    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-b75aaea1-75f67bf8df-txghc" podUID="fd98a4ec-4880-457b-98ed-d64d47bfa038" containerName="payload-processing" containerID="cri-o://c3bac197d3793baed94d7a9977bca860064a44c84b19d162ce3db7fe7ce96b1f" gracePeriod=30
Sep 15 09:30:42.525653 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:42.525626    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-b75aaea1-85bc79bd6b-gqz2h"]
Sep 15 09:30:42.526002 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:42.525968    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-b75aaea1-85bc79bd6b-gqz2h" podUID="38ad6447-a244-441b-bbd0-6bee38778b98" containerName="payload-pre-processing" containerID="cri-o://ff749b859c94f0d01e0a8f5160184b8f8f44464626478c1b9b7f7332a3350347" gracePeriod=30
Sep 15 09:30:42.685095 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:42.685044    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b75aaea1-kvm64"]
Sep 15 09:30:42.688086 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:42.688031    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b75aaea1-kvm64"]
Sep 15 09:30:42.788585 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:42.788555    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-b75aaea1-85bc79bd6b-gqz2h"
Sep 15 09:30:42.805258 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:42.805183    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-b75aaea1-75f67bf8df-txghc"
Sep 15 09:30:42.805534 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:42.805510    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d"]
Sep 15 09:30:42.805735 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:42.805708    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d" podUID="5ac8967c-a498-4ed9-8d37-f9e035336964" containerName="istio-proxy" containerID="cri-o://4f363650dd49ed1adc0ae720c8df4f0a4f8ff1f85389663e7e2cf9d3df350047" gracePeriod=30
Sep 15 09:30:42.868694 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:42.868666    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6hgw8\" (UniqueName: \"kubernetes.io/projected/fd98a4ec-4880-457b-98ed-d64d47bfa038-kube-api-access-6hgw8\") pod \"fd98a4ec-4880-457b-98ed-d64d47bfa038\" (UID: \"fd98a4ec-4880-457b-98ed-d64d47bfa038\") "
Sep 15 09:30:42.868694 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:42.868696    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd98a4ec-4880-457b-98ed-d64d47bfa038-plugins-config-volume\") pod \"fd98a4ec-4880-457b-98ed-d64d47bfa038\" (UID: \"fd98a4ec-4880-457b-98ed-d64d47bfa038\") "
Sep 15 09:30:42.868858 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:42.868737    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/38ad6447-a244-441b-bbd0-6bee38778b98-plugins-config-volume\") pod \"38ad6447-a244-441b-bbd0-6bee38778b98\" (UID: \"38ad6447-a244-441b-bbd0-6bee38778b98\") "
Sep 15 09:30:42.868858 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:42.868771    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vqx5b\" (UniqueName: \"kubernetes.io/projected/38ad6447-a244-441b-bbd0-6bee38778b98-kube-api-access-vqx5b\") pod \"38ad6447-a244-441b-bbd0-6bee38778b98\" (UID: \"38ad6447-a244-441b-bbd0-6bee38778b98\") "
Sep 15 09:30:42.869134 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:42.869099    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd98a4ec-4880-457b-98ed-d64d47bfa038-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fd98a4ec-4880-457b-98ed-d64d47bfa038" (UID: "fd98a4ec-4880-457b-98ed-d64d47bfa038"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:30:42.869134 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:42.869122    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38ad6447-a244-441b-bbd0-6bee38778b98-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "38ad6447-a244-441b-bbd0-6bee38778b98" (UID: "38ad6447-a244-441b-bbd0-6bee38778b98"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:30:42.870621 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:42.870596    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd98a4ec-4880-457b-98ed-d64d47bfa038-kube-api-access-6hgw8" (OuterVolumeSpecName: "kube-api-access-6hgw8") pod "fd98a4ec-4880-457b-98ed-d64d47bfa038" (UID: "fd98a4ec-4880-457b-98ed-d64d47bfa038"). InnerVolumeSpecName "kube-api-access-6hgw8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:30:42.870732 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:42.870713    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38ad6447-a244-441b-bbd0-6bee38778b98-kube-api-access-vqx5b" (OuterVolumeSpecName: "kube-api-access-vqx5b") pod "38ad6447-a244-441b-bbd0-6bee38778b98" (UID: "38ad6447-a244-441b-bbd0-6bee38778b98"). InnerVolumeSpecName "kube-api-access-vqx5b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:30:42.969595 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:42.969560    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6hgw8\" (UniqueName: \"kubernetes.io/projected/fd98a4ec-4880-457b-98ed-d64d47bfa038-kube-api-access-6hgw8\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:30:42.969595 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:42.969590    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd98a4ec-4880-457b-98ed-d64d47bfa038-plugins-config-volume\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:30:42.969595 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:42.969600    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/38ad6447-a244-441b-bbd0-6bee38778b98-plugins-config-volume\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:30:42.969829 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:42.969608    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vqx5b\" (UniqueName: \"kubernetes.io/projected/38ad6447-a244-441b-bbd0-6bee38778b98-kube-api-access-vqx5b\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:30:43.421339 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:43.421305    2578 generic.go:356] "Generic (PLEG): container finished" podID="38ad6447-a244-441b-bbd0-6bee38778b98" containerID="ff749b859c94f0d01e0a8f5160184b8f8f44464626478c1b9b7f7332a3350347" exitCode=0
Sep 15 09:30:43.421534 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:43.421360    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-b75aaea1-85bc79bd6b-gqz2h"
Sep 15 09:30:43.421534 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:43.421391    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-b75aaea1-85bc79bd6b-gqz2h" event={"ID":"38ad6447-a244-441b-bbd0-6bee38778b98","Type":"ContainerDied","Data":"ff749b859c94f0d01e0a8f5160184b8f8f44464626478c1b9b7f7332a3350347"}
Sep 15 09:30:43.421534 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:43.421449    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-b75aaea1-85bc79bd6b-gqz2h" event={"ID":"38ad6447-a244-441b-bbd0-6bee38778b98","Type":"ContainerDied","Data":"ea681fb34a6f18294c45d34618bf34bded0fa10a4d967c5e2b6b53854de0345a"}
Sep 15 09:30:43.421534 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:43.421475    2578 scope.go:117] "RemoveContainer" containerID="ff749b859c94f0d01e0a8f5160184b8f8f44464626478c1b9b7f7332a3350347"
Sep 15 09:30:43.423014 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:43.422991    2578 generic.go:356] "Generic (PLEG): container finished" podID="fd98a4ec-4880-457b-98ed-d64d47bfa038" containerID="c3bac197d3793baed94d7a9977bca860064a44c84b19d162ce3db7fe7ce96b1f" exitCode=0
Sep 15 09:30:43.423122 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:43.423025    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-b75aaea1-75f67bf8df-txghc" event={"ID":"fd98a4ec-4880-457b-98ed-d64d47bfa038","Type":"ContainerDied","Data":"c3bac197d3793baed94d7a9977bca860064a44c84b19d162ce3db7fe7ce96b1f"}
Sep 15 09:30:43.423122 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:43.423053    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-b75aaea1-75f67bf8df-txghc"
Sep 15 09:30:43.423199 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:43.423058    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-b75aaea1-75f67bf8df-txghc" event={"ID":"fd98a4ec-4880-457b-98ed-d64d47bfa038","Type":"ContainerDied","Data":"52267ad66be457198db844130906b7f5a479d74b4a2323915d3eef8f7c089aa4"}
Sep 15 09:30:43.431122 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:43.431105    2578 scope.go:117] "RemoveContainer" containerID="ff749b859c94f0d01e0a8f5160184b8f8f44464626478c1b9b7f7332a3350347"
Sep 15 09:30:43.431423 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:30:43.431403    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff749b859c94f0d01e0a8f5160184b8f8f44464626478c1b9b7f7332a3350347\": container with ID starting with ff749b859c94f0d01e0a8f5160184b8f8f44464626478c1b9b7f7332a3350347 not found: ID does not exist" containerID="ff749b859c94f0d01e0a8f5160184b8f8f44464626478c1b9b7f7332a3350347"
Sep 15 09:30:43.431491 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:43.431432    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff749b859c94f0d01e0a8f5160184b8f8f44464626478c1b9b7f7332a3350347"} err="failed to get container status \"ff749b859c94f0d01e0a8f5160184b8f8f44464626478c1b9b7f7332a3350347\": rpc error: code = NotFound desc = could not find container \"ff749b859c94f0d01e0a8f5160184b8f8f44464626478c1b9b7f7332a3350347\": container with ID starting with ff749b859c94f0d01e0a8f5160184b8f8f44464626478c1b9b7f7332a3350347 not found: ID does not exist"
Sep 15 09:30:43.431491 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:43.431447    2578 scope.go:117] "RemoveContainer" containerID="c3bac197d3793baed94d7a9977bca860064a44c84b19d162ce3db7fe7ce96b1f"
Sep 15 09:30:43.440551 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:43.440528    2578 scope.go:117] "RemoveContainer" containerID="c3bac197d3793baed94d7a9977bca860064a44c84b19d162ce3db7fe7ce96b1f"
Sep 15 09:30:43.440850 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:30:43.440828    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3bac197d3793baed94d7a9977bca860064a44c84b19d162ce3db7fe7ce96b1f\": container with ID starting with c3bac197d3793baed94d7a9977bca860064a44c84b19d162ce3db7fe7ce96b1f not found: ID does not exist" containerID="c3bac197d3793baed94d7a9977bca860064a44c84b19d162ce3db7fe7ce96b1f"
Sep 15 09:30:43.440927 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:43.440856    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3bac197d3793baed94d7a9977bca860064a44c84b19d162ce3db7fe7ce96b1f"} err="failed to get container status \"c3bac197d3793baed94d7a9977bca860064a44c84b19d162ce3db7fe7ce96b1f\": rpc error: code = NotFound desc = could not find container \"c3bac197d3793baed94d7a9977bca860064a44c84b19d162ce3db7fe7ce96b1f\": container with ID starting with c3bac197d3793baed94d7a9977bca860064a44c84b19d162ce3db7fe7ce96b1f not found: ID does not exist"
Sep 15 09:30:43.447818 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:43.447796    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-b75aaea1-85bc79bd6b-gqz2h"]
Sep 15 09:30:43.452175 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:43.452154    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-b75aaea1-85bc79bd6b-gqz2h"]
Sep 15 09:30:43.476698 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:43.476668    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-b75aaea1-75f67bf8df-txghc"]
Sep 15 09:30:43.492209 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:43.492185    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-b75aaea1-75f67bf8df-txghc"]
Sep 15 09:30:44.123285 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:44.123252    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38ad6447-a244-441b-bbd0-6bee38778b98" path="/var/lib/kubelet/pods/38ad6447-a244-441b-bbd0-6bee38778b98/volumes"
Sep 15 09:30:44.123632 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:44.123608    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b645678b-a384-4eb0-932a-870ed172ff76" path="/var/lib/kubelet/pods/b645678b-a384-4eb0-932a-870ed172ff76/volumes"
Sep 15 09:30:44.123919 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:44.123906    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd98a4ec-4880-457b-98ed-d64d47bfa038" path="/var/lib/kubelet/pods/fd98a4ec-4880-457b-98ed-d64d47bfa038/volumes"
Sep 15 09:30:45.718734 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:45.718702    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-7a31d6/test-model-7a31d6-kserve-786dfdddf-wwshg"
Sep 15 09:30:45.719128 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:45.718750    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-7a31d6/test-model-7a31d6-kserve-786dfdddf-wwshg"
Sep 15 09:30:45.731287 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:45.731257    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-7a31d6/test-model-7a31d6-kserve-786dfdddf-wwshg"
Sep 15 09:30:46.453892 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:46.453859    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-7a31d6/test-model-7a31d6-kserve-786dfdddf-wwshg"
Sep 15 09:30:46.978260 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:46.978223    2578 patch_prober.go:28] interesting pod/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 15 09:30:46.978616 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:46.978284    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d" podUID="5ac8967c-a498-4ed9-8d37-f9e035336964" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 09:30:48.058653 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:48.058629    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d"
Sep 15 09:30:48.117132 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:48.117075    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ac8967c-a498-4ed9-8d37-f9e035336964-istio-token\") pod \"5ac8967c-a498-4ed9-8d37-f9e035336964\" (UID: \"5ac8967c-a498-4ed9-8d37-f9e035336964\") "
Sep 15 09:30:48.117132 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:48.117125    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ac8967c-a498-4ed9-8d37-f9e035336964-istio-envoy\") pod \"5ac8967c-a498-4ed9-8d37-f9e035336964\" (UID: \"5ac8967c-a498-4ed9-8d37-f9e035336964\") "
Sep 15 09:30:48.117285 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:48.117151    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tkbs2\" (UniqueName: \"kubernetes.io/projected/5ac8967c-a498-4ed9-8d37-f9e035336964-kube-api-access-tkbs2\") pod \"5ac8967c-a498-4ed9-8d37-f9e035336964\" (UID: \"5ac8967c-a498-4ed9-8d37-f9e035336964\") "
Sep 15 09:30:48.117285 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:48.117214    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ac8967c-a498-4ed9-8d37-f9e035336964-credential-socket\") pod \"5ac8967c-a498-4ed9-8d37-f9e035336964\" (UID: \"5ac8967c-a498-4ed9-8d37-f9e035336964\") "
Sep 15 09:30:48.117285 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:48.117246    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ac8967c-a498-4ed9-8d37-f9e035336964-istio-podinfo\") pod \"5ac8967c-a498-4ed9-8d37-f9e035336964\" (UID: \"5ac8967c-a498-4ed9-8d37-f9e035336964\") "
Sep 15 09:30:48.117285 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:48.117274    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ac8967c-a498-4ed9-8d37-f9e035336964-workload-certs\") pod \"5ac8967c-a498-4ed9-8d37-f9e035336964\" (UID: \"5ac8967c-a498-4ed9-8d37-f9e035336964\") "
Sep 15 09:30:48.117500 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:48.117330    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ac8967c-a498-4ed9-8d37-f9e035336964-istio-data\") pod \"5ac8967c-a498-4ed9-8d37-f9e035336964\" (UID: \"5ac8967c-a498-4ed9-8d37-f9e035336964\") "
Sep 15 09:30:48.117589 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:48.117550    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ac8967c-a498-4ed9-8d37-f9e035336964-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5ac8967c-a498-4ed9-8d37-f9e035336964" (UID: "5ac8967c-a498-4ed9-8d37-f9e035336964"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:30:48.117589 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:48.117575    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ac8967c-a498-4ed9-8d37-f9e035336964-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5ac8967c-a498-4ed9-8d37-f9e035336964" (UID: "5ac8967c-a498-4ed9-8d37-f9e035336964"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:30:48.117727 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:48.117708    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ac8967c-a498-4ed9-8d37-f9e035336964-workload-socket\") pod \"5ac8967c-a498-4ed9-8d37-f9e035336964\" (UID: \"5ac8967c-a498-4ed9-8d37-f9e035336964\") "
Sep 15 09:30:48.117786 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:48.117743    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ac8967c-a498-4ed9-8d37-f9e035336964-istiod-ca-cert\") pod \"5ac8967c-a498-4ed9-8d37-f9e035336964\" (UID: \"5ac8967c-a498-4ed9-8d37-f9e035336964\") "
Sep 15 09:30:48.117842 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:48.117816    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ac8967c-a498-4ed9-8d37-f9e035336964-istio-data" (OuterVolumeSpecName: "istio-data") pod "5ac8967c-a498-4ed9-8d37-f9e035336964" (UID: "5ac8967c-a498-4ed9-8d37-f9e035336964"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:30:48.117917 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:48.117893    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ac8967c-a498-4ed9-8d37-f9e035336964-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5ac8967c-a498-4ed9-8d37-f9e035336964" (UID: "5ac8967c-a498-4ed9-8d37-f9e035336964"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:30:48.118161 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:48.118138    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ac8967c-a498-4ed9-8d37-f9e035336964-credential-socket\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:30:48.118277 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:48.118164    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ac8967c-a498-4ed9-8d37-f9e035336964-workload-certs\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:30:48.118277 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:48.118179    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ac8967c-a498-4ed9-8d37-f9e035336964-istio-data\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:30:48.118277 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:48.118193    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ac8967c-a498-4ed9-8d37-f9e035336964-workload-socket\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:30:48.118277 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:48.118217    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ac8967c-a498-4ed9-8d37-f9e035336964-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5ac8967c-a498-4ed9-8d37-f9e035336964" (UID: "5ac8967c-a498-4ed9-8d37-f9e035336964"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:30:48.119421 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:48.119383    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ac8967c-a498-4ed9-8d37-f9e035336964-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5ac8967c-a498-4ed9-8d37-f9e035336964" (UID: "5ac8967c-a498-4ed9-8d37-f9e035336964"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:30:48.119520 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:48.119459    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ac8967c-a498-4ed9-8d37-f9e035336964-kube-api-access-tkbs2" (OuterVolumeSpecName: "kube-api-access-tkbs2") pod "5ac8967c-a498-4ed9-8d37-f9e035336964" (UID: "5ac8967c-a498-4ed9-8d37-f9e035336964"). InnerVolumeSpecName "kube-api-access-tkbs2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:30:48.119622 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:48.119598    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ac8967c-a498-4ed9-8d37-f9e035336964-istio-token" (OuterVolumeSpecName: "istio-token") pod "5ac8967c-a498-4ed9-8d37-f9e035336964" (UID: "5ac8967c-a498-4ed9-8d37-f9e035336964"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:30:48.120004 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:48.119984    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5ac8967c-a498-4ed9-8d37-f9e035336964-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5ac8967c-a498-4ed9-8d37-f9e035336964" (UID: "5ac8967c-a498-4ed9-8d37-f9e035336964"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 09:30:48.218916 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:48.218890    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ac8967c-a498-4ed9-8d37-f9e035336964-istio-token\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:30:48.218916 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:48.218917    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ac8967c-a498-4ed9-8d37-f9e035336964-istio-envoy\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:30:48.219116 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:48.218931    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tkbs2\" (UniqueName: \"kubernetes.io/projected/5ac8967c-a498-4ed9-8d37-f9e035336964-kube-api-access-tkbs2\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:30:48.219116 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:48.218966    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ac8967c-a498-4ed9-8d37-f9e035336964-istio-podinfo\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:30:48.219116 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:48.218980    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ac8967c-a498-4ed9-8d37-f9e035336964-istiod-ca-cert\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:30:48.456873 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:48.456850    2578 generic.go:356] "Generic (PLEG): container finished" podID="5ac8967c-a498-4ed9-8d37-f9e035336964" containerID="4f363650dd49ed1adc0ae720c8df4f0a4f8ff1f85389663e7e2cf9d3df350047" exitCode=0
Sep 15 09:30:48.457018 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:48.456907    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d"
Sep 15 09:30:48.457018 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:48.456940    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d" event={"ID":"5ac8967c-a498-4ed9-8d37-f9e035336964","Type":"ContainerDied","Data":"4f363650dd49ed1adc0ae720c8df4f0a4f8ff1f85389663e7e2cf9d3df350047"}
Sep 15 09:30:48.457135 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:48.457026    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d" event={"ID":"5ac8967c-a498-4ed9-8d37-f9e035336964","Type":"ContainerDied","Data":"4f1fe1eb051c1751617cbfd946bf184904f3c26d56d5eaa5f1bbda3b25ae83b5"}
Sep 15 09:30:48.457135 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:48.457051    2578 scope.go:117] "RemoveContainer" containerID="4f363650dd49ed1adc0ae720c8df4f0a4f8ff1f85389663e7e2cf9d3df350047"
Sep 15 09:30:48.474198 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:48.474172    2578 scope.go:117] "RemoveContainer" containerID="6084c5370a4f5a58abb5aa78ad3c684d27cef561927198cf43a53cadb6c38137"
Sep 15 09:30:48.481413 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:48.481387    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d"]
Sep 15 09:30:48.483680 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:48.483664    2578 scope.go:117] "RemoveContainer" containerID="4f363650dd49ed1adc0ae720c8df4f0a4f8ff1f85389663e7e2cf9d3df350047"
Sep 15 09:30:48.483942 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:30:48.483923    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f363650dd49ed1adc0ae720c8df4f0a4f8ff1f85389663e7e2cf9d3df350047\": container with ID starting with 4f363650dd49ed1adc0ae720c8df4f0a4f8ff1f85389663e7e2cf9d3df350047 not found: ID does not exist" containerID="4f363650dd49ed1adc0ae720c8df4f0a4f8ff1f85389663e7e2cf9d3df350047"
Sep 15 09:30:48.484022 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:48.483968    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f363650dd49ed1adc0ae720c8df4f0a4f8ff1f85389663e7e2cf9d3df350047"} err="failed to get container status \"4f363650dd49ed1adc0ae720c8df4f0a4f8ff1f85389663e7e2cf9d3df350047\": rpc error: code = NotFound desc = could not find container \"4f363650dd49ed1adc0ae720c8df4f0a4f8ff1f85389663e7e2cf9d3df350047\": container with ID starting with 4f363650dd49ed1adc0ae720c8df4f0a4f8ff1f85389663e7e2cf9d3df350047 not found: ID does not exist"
Sep 15 09:30:48.484022 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:48.483992    2578 scope.go:117] "RemoveContainer" containerID="6084c5370a4f5a58abb5aa78ad3c684d27cef561927198cf43a53cadb6c38137"
Sep 15 09:30:48.484135 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:48.483978    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-b75aaea1-openshift-default-86844974fb-jx52d"]
Sep 15 09:30:48.484270 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:30:48.484255    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6084c5370a4f5a58abb5aa78ad3c684d27cef561927198cf43a53cadb6c38137\": container with ID starting with 6084c5370a4f5a58abb5aa78ad3c684d27cef561927198cf43a53cadb6c38137 not found: ID does not exist" containerID="6084c5370a4f5a58abb5aa78ad3c684d27cef561927198cf43a53cadb6c38137"
Sep 15 09:30:48.484322 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:48.484278    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6084c5370a4f5a58abb5aa78ad3c684d27cef561927198cf43a53cadb6c38137"} err="failed to get container status \"6084c5370a4f5a58abb5aa78ad3c684d27cef561927198cf43a53cadb6c38137\": rpc error: code = NotFound desc = could not find container \"6084c5370a4f5a58abb5aa78ad3c684d27cef561927198cf43a53cadb6c38137\": container with ID starting with 6084c5370a4f5a58abb5aa78ad3c684d27cef561927198cf43a53cadb6c38137 not found: ID does not exist"
Sep 15 09:30:50.121494 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:50.121457    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ac8967c-a498-4ed9-8d37-f9e035336964" path="/var/lib/kubelet/pods/5ac8967c-a498-4ed9-8d37-f9e035336964/volumes"
Sep 15 09:30:57.246522 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:57.246489    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-3b0480-xhm88"]
Sep 15 09:30:57.246886 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:57.246856    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd98a4ec-4880-457b-98ed-d64d47bfa038" containerName="payload-processing"
Sep 15 09:30:57.246886 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:57.246867    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd98a4ec-4880-457b-98ed-d64d47bfa038" containerName="payload-processing"
Sep 15 09:30:57.246886 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:57.246877    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ac8967c-a498-4ed9-8d37-f9e035336964" containerName="istio-proxy"
Sep 15 09:30:57.246886 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:57.246883    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ac8967c-a498-4ed9-8d37-f9e035336964" containerName="istio-proxy"
Sep 15 09:30:57.247037 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:57.246893    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38ad6447-a244-441b-bbd0-6bee38778b98" containerName="payload-pre-processing"
Sep 15 09:30:57.247037 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:57.246898    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="38ad6447-a244-441b-bbd0-6bee38778b98" containerName="payload-pre-processing"
Sep 15 09:30:57.247037 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:57.246912    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ac8967c-a498-4ed9-8d37-f9e035336964" containerName="istio-proxy"
Sep 15 09:30:57.247037 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:57.246917    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ac8967c-a498-4ed9-8d37-f9e035336964" containerName="istio-proxy"
Sep 15 09:30:57.247037 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:57.246984    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd98a4ec-4880-457b-98ed-d64d47bfa038" containerName="payload-processing"
Sep 15 09:30:57.247037 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:57.246992    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="38ad6447-a244-441b-bbd0-6bee38778b98" containerName="payload-pre-processing"
Sep 15 09:30:57.247037 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:57.246998    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ac8967c-a498-4ed9-8d37-f9e035336964" containerName="istio-proxy"
Sep 15 09:30:57.251401 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:57.251383    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-3b0480-xhm88"
Sep 15 09:30:57.253651 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:57.253632    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 09:30:57.253761 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:57.253684    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cbqnn\""
Sep 15 09:30:57.255998 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:57.255973    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-3b0480-xhm88"]
Sep 15 09:30:57.295920 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:57.295896    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5922d7e9-d275-4209-b0b3-5aabae10cc5e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-3b0480-xhm88\" (UID: \"5922d7e9-d275-4209-b0b3-5aabae10cc5e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-3b0480-xhm88"
Sep 15 09:30:57.396732 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:57.396709    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5922d7e9-d275-4209-b0b3-5aabae10cc5e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-3b0480-xhm88\" (UID: \"5922d7e9-d275-4209-b0b3-5aabae10cc5e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-3b0480-xhm88"
Sep 15 09:30:57.397309 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:57.397292    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5922d7e9-d275-4209-b0b3-5aabae10cc5e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-3b0480-xhm88\" (UID: \"5922d7e9-d275-4209-b0b3-5aabae10cc5e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-3b0480-xhm88"
Sep 15 09:30:57.565161 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:57.565109    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-3b0480-xhm88"
Sep 15 09:30:57.843165 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:57.843143    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-3b0480-xhm88"]
Sep 15 09:30:57.845659 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:30:57.845631    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5922d7e9_d275_4209_b0b3_5aabae10cc5e.slice/crio-fe9231e77da1c80ee9614201ed4c62c021664116c21aaa392ece8e4009974b31 WatchSource:0}: Error finding container fe9231e77da1c80ee9614201ed4c62c021664116c21aaa392ece8e4009974b31: Status 404 returned error can't find the container with id fe9231e77da1c80ee9614201ed4c62c021664116c21aaa392ece8e4009974b31
Sep 15 09:30:58.518017 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:58.517936    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-3b0480-xhm88" event={"ID":"5922d7e9-d275-4209-b0b3-5aabae10cc5e","Type":"ContainerStarted","Data":"d71e1a17574d98d2f5b87bbe7fb8ade62055e2f51aa963646a6062aa9ab69dee"}
Sep 15 09:30:58.518371 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:58.518040    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-3b0480-xhm88" event={"ID":"5922d7e9-d275-4209-b0b3-5aabae10cc5e","Type":"ContainerStarted","Data":"fe9231e77da1c80ee9614201ed4c62c021664116c21aaa392ece8e4009974b31"}
Sep 15 09:30:58.533507 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:58.533468    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-3b0480-xhm88" podStartSLOduration=1.5334557640000002 podStartE2EDuration="1.533455764s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:30:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:30:58.532486213 +0000 UTC m=+1002.870931487" watchObservedRunningTime="2026-09-15 09:30:58.533455764 +0000 UTC m=+1002.871901039"
Sep 15 09:30:59.525243 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:59.525204    2578 generic.go:356] "Generic (PLEG): container finished" podID="5922d7e9-d275-4209-b0b3-5aabae10cc5e" containerID="d71e1a17574d98d2f5b87bbe7fb8ade62055e2f51aa963646a6062aa9ab69dee" exitCode=0
Sep 15 09:30:59.525615 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:30:59.525263    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-3b0480-xhm88" event={"ID":"5922d7e9-d275-4209-b0b3-5aabae10cc5e","Type":"ContainerDied","Data":"d71e1a17574d98d2f5b87bbe7fb8ade62055e2f51aa963646a6062aa9ab69dee"}
Sep 15 09:31:00.662120 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:00.662094    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-3b0480-xhm88"
Sep 15 09:31:00.731326 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:00.731289    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5922d7e9-d275-4209-b0b3-5aabae10cc5e-maas-api-service-ca\") pod \"5922d7e9-d275-4209-b0b3-5aabae10cc5e\" (UID: \"5922d7e9-d275-4209-b0b3-5aabae10cc5e\") "
Sep 15 09:31:00.731614 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:00.731592    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5922d7e9-d275-4209-b0b3-5aabae10cc5e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5922d7e9-d275-4209-b0b3-5aabae10cc5e" (UID: "5922d7e9-d275-4209-b0b3-5aabae10cc5e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:31:00.832364 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:00.832305    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5922d7e9-d275-4209-b0b3-5aabae10cc5e-maas-api-service-ca\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:31:01.537920 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:01.537893    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-3b0480-xhm88"
Sep 15 09:31:01.538083 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:01.537937    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-3b0480-xhm88" event={"ID":"5922d7e9-d275-4209-b0b3-5aabae10cc5e","Type":"ContainerDied","Data":"fe9231e77da1c80ee9614201ed4c62c021664116c21aaa392ece8e4009974b31"}
Sep 15 09:31:01.538083 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:01.538039    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fe9231e77da1c80ee9614201ed4c62c021664116c21aaa392ece8e4009974b31"
Sep 15 09:31:07.747684 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:07.747652    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-3b0480-29824410-sjmkj"]
Sep 15 09:31:07.750078 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:07.750052    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-autores-3b0480-29824410-sjmkj"]
Sep 15 09:31:07.935268 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:07.935240    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-3b0480-xhm88"]
Sep 15 09:31:07.937590 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:07.937568    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-3b0480-xhm88"]
Sep 15 09:31:08.127021 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:08.126784    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5922d7e9-d275-4209-b0b3-5aabae10cc5e" path="/var/lib/kubelet/pods/5922d7e9-d275-4209-b0b3-5aabae10cc5e/volumes"
Sep 15 09:31:08.128093 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:08.128070    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1d01d1c-7316-451f-9a0b-c689d45bd056" path="/var/lib/kubelet/pods/a1d01d1c-7316-451f-9a0b-c689d45bd056/volumes"
Sep 15 09:31:14.325319 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:14.325285    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h"]
Sep 15 09:31:14.325917 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:14.325489    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h" podUID="95e679bc-84f2-4d8d-8d0c-20dc54488321" containerName="istio-proxy" containerID="cri-o://e1882393f47c605ff8cb70d912f9292f0371e7ef29b1e3947731803b14b3c93e" gracePeriod=30
Sep 15 09:31:15.066744 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:15.066705    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7"]
Sep 15 09:31:15.067278 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:15.067246    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5922d7e9-d275-4209-b0b3-5aabae10cc5e" containerName="revoke-keys"
Sep 15 09:31:15.067278 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:15.067268    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5922d7e9-d275-4209-b0b3-5aabae10cc5e" containerName="revoke-keys"
Sep 15 09:31:15.067482 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:15.067369    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ac8967c-a498-4ed9-8d37-f9e035336964" containerName="istio-proxy"
Sep 15 09:31:15.067482 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:15.067382    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5922d7e9-d275-4209-b0b3-5aabae10cc5e" containerName="revoke-keys"
Sep 15 09:31:15.070749 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:15.070724    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7"
Sep 15 09:31:15.073178 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:15.073159    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-5b654a-openshift-default-dockercfg-22sdb\""
Sep 15 09:31:15.083154 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:15.083130    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7"]
Sep 15 09:31:15.164549 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:15.164514    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d803ad94-c74b-41e1-95b8-a7db21eed4d5-credential-socket\") pod \"e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7\" (UID: \"d803ad94-c74b-41e1-95b8-a7db21eed4d5\") " pod="openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7"
Sep 15 09:31:15.164813 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:15.164791    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d803ad94-c74b-41e1-95b8-a7db21eed4d5-istio-token\") pod \"e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7\" (UID: \"d803ad94-c74b-41e1-95b8-a7db21eed4d5\") " pod="openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7"
Sep 15 09:31:15.164976 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:15.164936    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d803ad94-c74b-41e1-95b8-a7db21eed4d5-workload-socket\") pod \"e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7\" (UID: \"d803ad94-c74b-41e1-95b8-a7db21eed4d5\") " pod="openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7"
Sep 15 09:31:15.165115 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:15.165100    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d803ad94-c74b-41e1-95b8-a7db21eed4d5-istio-envoy\") pod \"e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7\" (UID: \"d803ad94-c74b-41e1-95b8-a7db21eed4d5\") " pod="openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7"
Sep 15 09:31:15.165227 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:15.165213    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d803ad94-c74b-41e1-95b8-a7db21eed4d5-istiod-ca-cert\") pod \"e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7\" (UID: \"d803ad94-c74b-41e1-95b8-a7db21eed4d5\") " pod="openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7"
Sep 15 09:31:15.165329 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:15.165316    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d803ad94-c74b-41e1-95b8-a7db21eed4d5-istio-podinfo\") pod \"e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7\" (UID: \"d803ad94-c74b-41e1-95b8-a7db21eed4d5\") " pod="openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7"
Sep 15 09:31:15.165507 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:15.165489    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwstc\" (UniqueName: \"kubernetes.io/projected/d803ad94-c74b-41e1-95b8-a7db21eed4d5-kube-api-access-qwstc\") pod \"e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7\" (UID: \"d803ad94-c74b-41e1-95b8-a7db21eed4d5\") " pod="openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7"
Sep 15 09:31:15.165673 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:15.165658    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d803ad94-c74b-41e1-95b8-a7db21eed4d5-istio-data\") pod \"e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7\" (UID: \"d803ad94-c74b-41e1-95b8-a7db21eed4d5\") " pod="openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7"
Sep 15 09:31:15.165809 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:15.165794    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d803ad94-c74b-41e1-95b8-a7db21eed4d5-workload-certs\") pod \"e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7\" (UID: \"d803ad94-c74b-41e1-95b8-a7db21eed4d5\") " pod="openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7"
Sep 15 09:31:15.266969 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:15.266917    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d803ad94-c74b-41e1-95b8-a7db21eed4d5-workload-socket\") pod \"e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7\" (UID: \"d803ad94-c74b-41e1-95b8-a7db21eed4d5\") " pod="openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7"
Sep 15 09:31:15.267149 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:15.266989    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d803ad94-c74b-41e1-95b8-a7db21eed4d5-istio-envoy\") pod \"e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7\" (UID: \"d803ad94-c74b-41e1-95b8-a7db21eed4d5\") " pod="openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7"
Sep 15 09:31:15.267149 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:15.267019    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d803ad94-c74b-41e1-95b8-a7db21eed4d5-istiod-ca-cert\") pod \"e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7\" (UID: \"d803ad94-c74b-41e1-95b8-a7db21eed4d5\") " pod="openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7"
Sep 15 09:31:15.267149 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:15.267039    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d803ad94-c74b-41e1-95b8-a7db21eed4d5-istio-podinfo\") pod \"e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7\" (UID: \"d803ad94-c74b-41e1-95b8-a7db21eed4d5\") " pod="openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7"
Sep 15 09:31:15.267149 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:15.267071    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwstc\" (UniqueName: \"kubernetes.io/projected/d803ad94-c74b-41e1-95b8-a7db21eed4d5-kube-api-access-qwstc\") pod \"e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7\" (UID: \"d803ad94-c74b-41e1-95b8-a7db21eed4d5\") " pod="openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7"
Sep 15 09:31:15.267149 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:15.267141    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d803ad94-c74b-41e1-95b8-a7db21eed4d5-istio-data\") pod \"e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7\" (UID: \"d803ad94-c74b-41e1-95b8-a7db21eed4d5\") " pod="openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7"
Sep 15 09:31:15.267435 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:15.267164    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d803ad94-c74b-41e1-95b8-a7db21eed4d5-workload-certs\") pod \"e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7\" (UID: \"d803ad94-c74b-41e1-95b8-a7db21eed4d5\") " pod="openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7"
Sep 15 09:31:15.267508 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:15.267483    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d803ad94-c74b-41e1-95b8-a7db21eed4d5-istio-data\") pod \"e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7\" (UID: \"d803ad94-c74b-41e1-95b8-a7db21eed4d5\") " pod="openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7"
Sep 15 09:31:15.267583 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:15.267536    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d803ad94-c74b-41e1-95b8-a7db21eed4d5-workload-certs\") pod \"e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7\" (UID: \"d803ad94-c74b-41e1-95b8-a7db21eed4d5\") " pod="openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7"
Sep 15 09:31:15.267640 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:15.267614    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d803ad94-c74b-41e1-95b8-a7db21eed4d5-credential-socket\") pod \"e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7\" (UID: \"d803ad94-c74b-41e1-95b8-a7db21eed4d5\") " pod="openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7"
Sep 15 09:31:15.267691 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:15.267676    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d803ad94-c74b-41e1-95b8-a7db21eed4d5-istio-token\") pod \"e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7\" (UID: \"d803ad94-c74b-41e1-95b8-a7db21eed4d5\") " pod="openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7"
Sep 15 09:31:15.267783 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:15.267761    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d803ad94-c74b-41e1-95b8-a7db21eed4d5-istiod-ca-cert\") pod \"e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7\" (UID: \"d803ad94-c74b-41e1-95b8-a7db21eed4d5\") " pod="openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7"
Sep 15 09:31:15.267937 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:15.267909    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d803ad94-c74b-41e1-95b8-a7db21eed4d5-credential-socket\") pod \"e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7\" (UID: \"d803ad94-c74b-41e1-95b8-a7db21eed4d5\") " pod="openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7"
Sep 15 09:31:15.268092 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:15.268073    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d803ad94-c74b-41e1-95b8-a7db21eed4d5-workload-socket\") pod \"e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7\" (UID: \"d803ad94-c74b-41e1-95b8-a7db21eed4d5\") " pod="openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7"
Sep 15 09:31:15.269405 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:15.269382    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d803ad94-c74b-41e1-95b8-a7db21eed4d5-istio-envoy\") pod \"e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7\" (UID: \"d803ad94-c74b-41e1-95b8-a7db21eed4d5\") " pod="openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7"
Sep 15 09:31:15.269722 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:15.269700    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d803ad94-c74b-41e1-95b8-a7db21eed4d5-istio-podinfo\") pod \"e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7\" (UID: \"d803ad94-c74b-41e1-95b8-a7db21eed4d5\") " pod="openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7"
Sep 15 09:31:15.274493 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:15.274474    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d803ad94-c74b-41e1-95b8-a7db21eed4d5-istio-token\") pod \"e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7\" (UID: \"d803ad94-c74b-41e1-95b8-a7db21eed4d5\") " pod="openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7"
Sep 15 09:31:15.274916 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:15.274895    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwstc\" (UniqueName: \"kubernetes.io/projected/d803ad94-c74b-41e1-95b8-a7db21eed4d5-kube-api-access-qwstc\") pod \"e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7\" (UID: \"d803ad94-c74b-41e1-95b8-a7db21eed4d5\") " pod="openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7"
Sep 15 09:31:15.382826 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:15.382773    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7"
Sep 15 09:31:15.655997 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:15.655970    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7"]
Sep 15 09:31:15.657269 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:31:15.657232    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd803ad94_c74b_41e1_95b8_a7db21eed4d5.slice/crio-aac8c8c148dd464be307b72f512818feb0530d9c2d479d9a12d8bd69614f9ed6 WatchSource:0}: Error finding container aac8c8c148dd464be307b72f512818feb0530d9c2d479d9a12d8bd69614f9ed6: Status 404 returned error can't find the container with id aac8c8c148dd464be307b72f512818feb0530d9c2d479d9a12d8bd69614f9ed6
Sep 15 09:31:15.659742 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:15.659705    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:31:15.659853 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:15.659783    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:31:15.659853 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:15.659831    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:31:16.623692 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:16.623656    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7" event={"ID":"d803ad94-c74b-41e1-95b8-a7db21eed4d5","Type":"ContainerStarted","Data":"317227ac113dd19c680d90f413da70f4b5ac0f8298ae4cb405112c1bccde4cfc"}
Sep 15 09:31:16.624173 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:16.623755    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7" event={"ID":"d803ad94-c74b-41e1-95b8-a7db21eed4d5","Type":"ContainerStarted","Data":"aac8c8c148dd464be307b72f512818feb0530d9c2d479d9a12d8bd69614f9ed6"}
Sep 15 09:31:16.646646 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:16.646595    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7" podStartSLOduration=1.646576829 podStartE2EDuration="1.646576829s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:31:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:31:16.6451839 +0000 UTC m=+1020.983629175" watchObservedRunningTime="2026-09-15 09:31:16.646576829 +0000 UTC m=+1020.985022122"
Sep 15 09:31:17.383789 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:17.383754    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7"
Sep 15 09:31:17.389154 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:17.389128    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7"
Sep 15 09:31:17.456317 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:17.456284    2578 patch_prober.go:28] interesting pod/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 15 09:31:17.456447 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:17.456341    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h" podUID="95e679bc-84f2-4d8d-8d0c-20dc54488321" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 09:31:17.629721 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:17.629693    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7"
Sep 15 09:31:17.630614 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:17.630595    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7"
Sep 15 09:31:19.568598 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:19.568575    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h"
Sep 15 09:31:19.645901 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:19.645819    2578 generic.go:356] "Generic (PLEG): container finished" podID="95e679bc-84f2-4d8d-8d0c-20dc54488321" containerID="e1882393f47c605ff8cb70d912f9292f0371e7ef29b1e3947731803b14b3c93e" exitCode=0
Sep 15 09:31:19.645901 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:19.645873    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h"
Sep 15 09:31:19.646104 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:19.645910    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h" event={"ID":"95e679bc-84f2-4d8d-8d0c-20dc54488321","Type":"ContainerDied","Data":"e1882393f47c605ff8cb70d912f9292f0371e7ef29b1e3947731803b14b3c93e"}
Sep 15 09:31:19.646104 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:19.645998    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h" event={"ID":"95e679bc-84f2-4d8d-8d0c-20dc54488321","Type":"ContainerDied","Data":"3f8a7446655ee49d4f9f4382b7d0b54d4f14d3ac58594e364aa3bdbf0a0a929f"}
Sep 15 09:31:19.646104 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:19.646028    2578 scope.go:117] "RemoveContainer" containerID="e1882393f47c605ff8cb70d912f9292f0371e7ef29b1e3947731803b14b3c93e"
Sep 15 09:31:19.655355 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:19.655341    2578 scope.go:117] "RemoveContainer" containerID="aa7ed4c861d7d1c02722c68e6d094819b06f1a98c22d7d6c6c0e1f8e29c20bba"
Sep 15 09:31:19.663472 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:19.663455    2578 scope.go:117] "RemoveContainer" containerID="e1882393f47c605ff8cb70d912f9292f0371e7ef29b1e3947731803b14b3c93e"
Sep 15 09:31:19.663724 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:31:19.663705    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1882393f47c605ff8cb70d912f9292f0371e7ef29b1e3947731803b14b3c93e\": container with ID starting with e1882393f47c605ff8cb70d912f9292f0371e7ef29b1e3947731803b14b3c93e not found: ID does not exist" containerID="e1882393f47c605ff8cb70d912f9292f0371e7ef29b1e3947731803b14b3c93e"
Sep 15 09:31:19.663808 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:19.663737    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1882393f47c605ff8cb70d912f9292f0371e7ef29b1e3947731803b14b3c93e"} err="failed to get container status \"e1882393f47c605ff8cb70d912f9292f0371e7ef29b1e3947731803b14b3c93e\": rpc error: code = NotFound desc = could not find container \"e1882393f47c605ff8cb70d912f9292f0371e7ef29b1e3947731803b14b3c93e\": container with ID starting with e1882393f47c605ff8cb70d912f9292f0371e7ef29b1e3947731803b14b3c93e not found: ID does not exist"
Sep 15 09:31:19.663808 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:19.663761    2578 scope.go:117] "RemoveContainer" containerID="aa7ed4c861d7d1c02722c68e6d094819b06f1a98c22d7d6c6c0e1f8e29c20bba"
Sep 15 09:31:19.664113 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:31:19.664096    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa7ed4c861d7d1c02722c68e6d094819b06f1a98c22d7d6c6c0e1f8e29c20bba\": container with ID starting with aa7ed4c861d7d1c02722c68e6d094819b06f1a98c22d7d6c6c0e1f8e29c20bba not found: ID does not exist" containerID="aa7ed4c861d7d1c02722c68e6d094819b06f1a98c22d7d6c6c0e1f8e29c20bba"
Sep 15 09:31:19.664167 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:19.664121    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa7ed4c861d7d1c02722c68e6d094819b06f1a98c22d7d6c6c0e1f8e29c20bba"} err="failed to get container status \"aa7ed4c861d7d1c02722c68e6d094819b06f1a98c22d7d6c6c0e1f8e29c20bba\": rpc error: code = NotFound desc = could not find container \"aa7ed4c861d7d1c02722c68e6d094819b06f1a98c22d7d6c6c0e1f8e29c20bba\": container with ID starting with aa7ed4c861d7d1c02722c68e6d094819b06f1a98c22d7d6c6c0e1f8e29c20bba not found: ID does not exist"
Sep 15 09:31:19.712076 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:19.712057    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95e679bc-84f2-4d8d-8d0c-20dc54488321-workload-socket\") pod \"95e679bc-84f2-4d8d-8d0c-20dc54488321\" (UID: \"95e679bc-84f2-4d8d-8d0c-20dc54488321\") "
Sep 15 09:31:19.712165 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:19.712089    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95e679bc-84f2-4d8d-8d0c-20dc54488321-credential-socket\") pod \"95e679bc-84f2-4d8d-8d0c-20dc54488321\" (UID: \"95e679bc-84f2-4d8d-8d0c-20dc54488321\") "
Sep 15 09:31:19.712165 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:19.712132    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95e679bc-84f2-4d8d-8d0c-20dc54488321-istio-envoy\") pod \"95e679bc-84f2-4d8d-8d0c-20dc54488321\" (UID: \"95e679bc-84f2-4d8d-8d0c-20dc54488321\") "
Sep 15 09:31:19.712252 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:19.712166    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95e679bc-84f2-4d8d-8d0c-20dc54488321-istio-podinfo\") pod \"95e679bc-84f2-4d8d-8d0c-20dc54488321\" (UID: \"95e679bc-84f2-4d8d-8d0c-20dc54488321\") "
Sep 15 09:31:19.712252 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:19.712216    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95e679bc-84f2-4d8d-8d0c-20dc54488321-workload-certs\") pod \"95e679bc-84f2-4d8d-8d0c-20dc54488321\" (UID: \"95e679bc-84f2-4d8d-8d0c-20dc54488321\") "
Sep 15 09:31:19.712252 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:19.712243    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-klpcj\" (UniqueName: \"kubernetes.io/projected/95e679bc-84f2-4d8d-8d0c-20dc54488321-kube-api-access-klpcj\") pod \"95e679bc-84f2-4d8d-8d0c-20dc54488321\" (UID: \"95e679bc-84f2-4d8d-8d0c-20dc54488321\") "
Sep 15 09:31:19.712375 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:19.712308    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95e679bc-84f2-4d8d-8d0c-20dc54488321-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "95e679bc-84f2-4d8d-8d0c-20dc54488321" (UID: "95e679bc-84f2-4d8d-8d0c-20dc54488321"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:31:19.712375 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:19.712350    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95e679bc-84f2-4d8d-8d0c-20dc54488321-istio-data\") pod \"95e679bc-84f2-4d8d-8d0c-20dc54488321\" (UID: \"95e679bc-84f2-4d8d-8d0c-20dc54488321\") "
Sep 15 09:31:19.712482 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:19.712381    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95e679bc-84f2-4d8d-8d0c-20dc54488321-istiod-ca-cert\") pod \"95e679bc-84f2-4d8d-8d0c-20dc54488321\" (UID: \"95e679bc-84f2-4d8d-8d0c-20dc54488321\") "
Sep 15 09:31:19.712482 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:19.712417    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95e679bc-84f2-4d8d-8d0c-20dc54488321-istio-token\") pod \"95e679bc-84f2-4d8d-8d0c-20dc54488321\" (UID: \"95e679bc-84f2-4d8d-8d0c-20dc54488321\") "
Sep 15 09:31:19.712482 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:19.712416    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95e679bc-84f2-4d8d-8d0c-20dc54488321-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "95e679bc-84f2-4d8d-8d0c-20dc54488321" (UID: "95e679bc-84f2-4d8d-8d0c-20dc54488321"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:31:19.712650 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:19.712492    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95e679bc-84f2-4d8d-8d0c-20dc54488321-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "95e679bc-84f2-4d8d-8d0c-20dc54488321" (UID: "95e679bc-84f2-4d8d-8d0c-20dc54488321"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:31:19.712650 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:19.712621    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95e679bc-84f2-4d8d-8d0c-20dc54488321-istio-data" (OuterVolumeSpecName: "istio-data") pod "95e679bc-84f2-4d8d-8d0c-20dc54488321" (UID: "95e679bc-84f2-4d8d-8d0c-20dc54488321"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:31:19.712792 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:19.712774    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95e679bc-84f2-4d8d-8d0c-20dc54488321-istio-data\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:31:19.712852 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:19.712795    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95e679bc-84f2-4d8d-8d0c-20dc54488321-workload-socket\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:31:19.712852 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:19.712801    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95e679bc-84f2-4d8d-8d0c-20dc54488321-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "95e679bc-84f2-4d8d-8d0c-20dc54488321" (UID: "95e679bc-84f2-4d8d-8d0c-20dc54488321"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:31:19.712852 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:19.712810    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95e679bc-84f2-4d8d-8d0c-20dc54488321-credential-socket\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:31:19.712852 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:19.712845    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95e679bc-84f2-4d8d-8d0c-20dc54488321-workload-certs\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:31:19.714312 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:19.714286    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95e679bc-84f2-4d8d-8d0c-20dc54488321-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "95e679bc-84f2-4d8d-8d0c-20dc54488321" (UID: "95e679bc-84f2-4d8d-8d0c-20dc54488321"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:31:19.714396 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:19.714360    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/95e679bc-84f2-4d8d-8d0c-20dc54488321-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "95e679bc-84f2-4d8d-8d0c-20dc54488321" (UID: "95e679bc-84f2-4d8d-8d0c-20dc54488321"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 09:31:19.714396 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:19.714387    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95e679bc-84f2-4d8d-8d0c-20dc54488321-kube-api-access-klpcj" (OuterVolumeSpecName: "kube-api-access-klpcj") pod "95e679bc-84f2-4d8d-8d0c-20dc54488321" (UID: "95e679bc-84f2-4d8d-8d0c-20dc54488321"). InnerVolumeSpecName "kube-api-access-klpcj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:31:19.714574 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:19.714562    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95e679bc-84f2-4d8d-8d0c-20dc54488321-istio-token" (OuterVolumeSpecName: "istio-token") pod "95e679bc-84f2-4d8d-8d0c-20dc54488321" (UID: "95e679bc-84f2-4d8d-8d0c-20dc54488321"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:31:19.814341 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:19.814315    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95e679bc-84f2-4d8d-8d0c-20dc54488321-istio-envoy\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:31:19.814341 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:19.814342    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95e679bc-84f2-4d8d-8d0c-20dc54488321-istio-podinfo\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:31:19.814560 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:19.814357    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-klpcj\" (UniqueName: \"kubernetes.io/projected/95e679bc-84f2-4d8d-8d0c-20dc54488321-kube-api-access-klpcj\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:31:19.814560 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:19.814372    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95e679bc-84f2-4d8d-8d0c-20dc54488321-istiod-ca-cert\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:31:19.814560 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:19.814384    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95e679bc-84f2-4d8d-8d0c-20dc54488321-istio-token\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:31:19.968087 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:19.968060    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h"]
Sep 15 09:31:19.971851 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:19.971829    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-3b0480-openshift-default-69f6756b68-dpw8h"]
Sep 15 09:31:20.121266 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:20.121236    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95e679bc-84f2-4d8d-8d0c-20dc54488321" path="/var/lib/kubelet/pods/95e679bc-84f2-4d8d-8d0c-20dc54488321/volumes"
Sep 15 09:31:22.413313 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:22.413279    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-5b654a-689bb5579d-jzxzs"]
Sep 15 09:31:22.413709 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:22.413643    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95e679bc-84f2-4d8d-8d0c-20dc54488321" containerName="istio-proxy"
Sep 15 09:31:22.413709 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:22.413654    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="95e679bc-84f2-4d8d-8d0c-20dc54488321" containerName="istio-proxy"
Sep 15 09:31:22.413795 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:22.413730    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="95e679bc-84f2-4d8d-8d0c-20dc54488321" containerName="istio-proxy"
Sep 15 09:31:22.413795 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:22.413738    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="95e679bc-84f2-4d8d-8d0c-20dc54488321" containerName="istio-proxy"
Sep 15 09:31:22.418265 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:22.418244    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-5b654a-689bb5579d-jzxzs"
Sep 15 09:31:22.420458 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:22.420440    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-5b654a-dockercfg-bdh2j\""
Sep 15 09:31:22.420566 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:22.420442    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-5b654a\""
Sep 15 09:31:22.425499 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:22.425477    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-5b654a-689bb5579d-jzxzs"]
Sep 15 09:31:22.440955 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:22.440926    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6fb895d1-b4a2-49da-83eb-cb5293b39a23-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-5b654a-689bb5579d-jzxzs\" (UID: \"6fb895d1-b4a2-49da-83eb-cb5293b39a23\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-5b654a-689bb5579d-jzxzs"
Sep 15 09:31:22.441096 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:22.441045    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-576dq\" (UniqueName: \"kubernetes.io/projected/6fb895d1-b4a2-49da-83eb-cb5293b39a23-kube-api-access-576dq\") pod \"payload-pre-processing-e2e-explicit-5b654a-689bb5579d-jzxzs\" (UID: \"6fb895d1-b4a2-49da-83eb-cb5293b39a23\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-5b654a-689bb5579d-jzxzs"
Sep 15 09:31:22.453273 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:22.453242    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-5b654a-7bd5d9f7c7-5srhn"]
Sep 15 09:31:22.453665 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:22.453649    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95e679bc-84f2-4d8d-8d0c-20dc54488321" containerName="istio-proxy"
Sep 15 09:31:22.453747 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:22.453668    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="95e679bc-84f2-4d8d-8d0c-20dc54488321" containerName="istio-proxy"
Sep 15 09:31:22.456827 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:22.456808    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-5b654a-7bd5d9f7c7-5srhn"
Sep 15 09:31:22.467830 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:22.467809    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-5b654a-7bd5d9f7c7-5srhn"]
Sep 15 09:31:22.542745 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:22.542698    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6fb895d1-b4a2-49da-83eb-cb5293b39a23-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-5b654a-689bb5579d-jzxzs\" (UID: \"6fb895d1-b4a2-49da-83eb-cb5293b39a23\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-5b654a-689bb5579d-jzxzs"
Sep 15 09:31:22.543155 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:22.543120    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-576dq\" (UniqueName: \"kubernetes.io/projected/6fb895d1-b4a2-49da-83eb-cb5293b39a23-kube-api-access-576dq\") pod \"payload-pre-processing-e2e-explicit-5b654a-689bb5579d-jzxzs\" (UID: \"6fb895d1-b4a2-49da-83eb-cb5293b39a23\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-5b654a-689bb5579d-jzxzs"
Sep 15 09:31:22.543378 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:22.543362    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzm8c\" (UniqueName: \"kubernetes.io/projected/748feef6-a8c0-4acd-a6c2-f9cf77f3ee9a-kube-api-access-jzm8c\") pod \"payload-processing-e2e-explicit-5b654a-7bd5d9f7c7-5srhn\" (UID: \"748feef6-a8c0-4acd-a6c2-f9cf77f3ee9a\") " pod="openshift-ingress/payload-processing-e2e-explicit-5b654a-7bd5d9f7c7-5srhn"
Sep 15 09:31:22.543543 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:22.543527    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/748feef6-a8c0-4acd-a6c2-f9cf77f3ee9a-plugins-config-volume\") pod \"payload-processing-e2e-explicit-5b654a-7bd5d9f7c7-5srhn\" (UID: \"748feef6-a8c0-4acd-a6c2-f9cf77f3ee9a\") " pod="openshift-ingress/payload-processing-e2e-explicit-5b654a-7bd5d9f7c7-5srhn"
Sep 15 09:31:22.543837 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:22.543818    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6fb895d1-b4a2-49da-83eb-cb5293b39a23-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-5b654a-689bb5579d-jzxzs\" (UID: \"6fb895d1-b4a2-49da-83eb-cb5293b39a23\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-5b654a-689bb5579d-jzxzs"
Sep 15 09:31:22.560535 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:22.560503    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-576dq\" (UniqueName: \"kubernetes.io/projected/6fb895d1-b4a2-49da-83eb-cb5293b39a23-kube-api-access-576dq\") pod \"payload-pre-processing-e2e-explicit-5b654a-689bb5579d-jzxzs\" (UID: \"6fb895d1-b4a2-49da-83eb-cb5293b39a23\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-5b654a-689bb5579d-jzxzs"
Sep 15 09:31:22.644321 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:22.644284    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzm8c\" (UniqueName: \"kubernetes.io/projected/748feef6-a8c0-4acd-a6c2-f9cf77f3ee9a-kube-api-access-jzm8c\") pod \"payload-processing-e2e-explicit-5b654a-7bd5d9f7c7-5srhn\" (UID: \"748feef6-a8c0-4acd-a6c2-f9cf77f3ee9a\") " pod="openshift-ingress/payload-processing-e2e-explicit-5b654a-7bd5d9f7c7-5srhn"
Sep 15 09:31:22.644486 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:22.644329    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/748feef6-a8c0-4acd-a6c2-f9cf77f3ee9a-plugins-config-volume\") pod \"payload-processing-e2e-explicit-5b654a-7bd5d9f7c7-5srhn\" (UID: \"748feef6-a8c0-4acd-a6c2-f9cf77f3ee9a\") " pod="openshift-ingress/payload-processing-e2e-explicit-5b654a-7bd5d9f7c7-5srhn"
Sep 15 09:31:22.645069 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:22.645050    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/748feef6-a8c0-4acd-a6c2-f9cf77f3ee9a-plugins-config-volume\") pod \"payload-processing-e2e-explicit-5b654a-7bd5d9f7c7-5srhn\" (UID: \"748feef6-a8c0-4acd-a6c2-f9cf77f3ee9a\") " pod="openshift-ingress/payload-processing-e2e-explicit-5b654a-7bd5d9f7c7-5srhn"
Sep 15 09:31:22.652145 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:22.652115    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzm8c\" (UniqueName: \"kubernetes.io/projected/748feef6-a8c0-4acd-a6c2-f9cf77f3ee9a-kube-api-access-jzm8c\") pod \"payload-processing-e2e-explicit-5b654a-7bd5d9f7c7-5srhn\" (UID: \"748feef6-a8c0-4acd-a6c2-f9cf77f3ee9a\") " pod="openshift-ingress/payload-processing-e2e-explicit-5b654a-7bd5d9f7c7-5srhn"
Sep 15 09:31:22.730634 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:22.730607    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-5b654a-689bb5579d-jzxzs"
Sep 15 09:31:22.768326 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:22.768292    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-5b654a-7bd5d9f7c7-5srhn"
Sep 15 09:31:23.004939 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:23.004908    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-5b654a-689bb5579d-jzxzs"]
Sep 15 09:31:23.006513 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:31:23.006487    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fb895d1_b4a2_49da_83eb_cb5293b39a23.slice/crio-8273ff15cced3aea3924f8180552ad52ddd26484ee78fc318318f6cfc9f97830 WatchSource:0}: Error finding container 8273ff15cced3aea3924f8180552ad52ddd26484ee78fc318318f6cfc9f97830: Status 404 returned error can't find the container with id 8273ff15cced3aea3924f8180552ad52ddd26484ee78fc318318f6cfc9f97830
Sep 15 09:31:23.052662 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:23.052638    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-5b654a-7bd5d9f7c7-5srhn"]
Sep 15 09:31:23.053883 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:31:23.053863    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod748feef6_a8c0_4acd_a6c2_f9cf77f3ee9a.slice/crio-eba39e0077dc593fd27605536c7f2c25d7f383e210dd9d6b1970de111a86704a WatchSource:0}: Error finding container eba39e0077dc593fd27605536c7f2c25d7f383e210dd9d6b1970de111a86704a: Status 404 returned error can't find the container with id eba39e0077dc593fd27605536c7f2c25d7f383e210dd9d6b1970de111a86704a
Sep 15 09:31:23.671842 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:23.671808    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-5b654a-7bd5d9f7c7-5srhn" event={"ID":"748feef6-a8c0-4acd-a6c2-f9cf77f3ee9a","Type":"ContainerStarted","Data":"9ea82239994c8fc78cee44c1a6d5f83cbd9be1a8720a99a9252e5f8349a22bc4"}
Sep 15 09:31:23.672323 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:23.671857    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-5b654a-7bd5d9f7c7-5srhn" event={"ID":"748feef6-a8c0-4acd-a6c2-f9cf77f3ee9a","Type":"ContainerStarted","Data":"eba39e0077dc593fd27605536c7f2c25d7f383e210dd9d6b1970de111a86704a"}
Sep 15 09:31:23.672323 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:23.671897    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-5b654a-7bd5d9f7c7-5srhn"
Sep 15 09:31:23.673542 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:23.673518    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-5b654a-689bb5579d-jzxzs" event={"ID":"6fb895d1-b4a2-49da-83eb-cb5293b39a23","Type":"ContainerStarted","Data":"1d246f55e2f358c49d1f190203eb96ec8e161c4f7f81900e663cc6a695d465fa"}
Sep 15 09:31:23.673612 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:23.673563    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-5b654a-689bb5579d-jzxzs" event={"ID":"6fb895d1-b4a2-49da-83eb-cb5293b39a23","Type":"ContainerStarted","Data":"8273ff15cced3aea3924f8180552ad52ddd26484ee78fc318318f6cfc9f97830"}
Sep 15 09:31:23.673612 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:23.673594    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-5b654a-689bb5579d-jzxzs"
Sep 15 09:31:23.704217 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:23.704171    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-5b654a-7bd5d9f7c7-5srhn" podStartSLOduration=1.704156757 podStartE2EDuration="1.704156757s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:31:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:31:23.703276208 +0000 UTC m=+1028.041721496" watchObservedRunningTime="2026-09-15 09:31:23.704156757 +0000 UTC m=+1028.042602028"
Sep 15 09:31:23.749599 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:23.749556    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-5b654a-689bb5579d-jzxzs" podStartSLOduration=1.749540458 podStartE2EDuration="1.749540458s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:31:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:31:23.748922452 +0000 UTC m=+1028.087367727" watchObservedRunningTime="2026-09-15 09:31:23.749540458 +0000 UTC m=+1028.087985732"
Sep 15 09:31:34.681845 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:34.681810    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-5b654a-689bb5579d-jzxzs"
Sep 15 09:31:34.682250 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:34.681877    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-5b654a-7bd5d9f7c7-5srhn"
Sep 15 09:31:39.782780 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:39.782707    2578 generic.go:356] "Generic (PLEG): container finished" podID="d803ad94-c74b-41e1-95b8-a7db21eed4d5" containerID="317227ac113dd19c680d90f413da70f4b5ac0f8298ae4cb405112c1bccde4cfc" exitCode=0
Sep 15 09:31:39.783181 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:39.782781    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7" event={"ID":"d803ad94-c74b-41e1-95b8-a7db21eed4d5","Type":"ContainerDied","Data":"317227ac113dd19c680d90f413da70f4b5ac0f8298ae4cb405112c1bccde4cfc"}
Sep 15 09:31:39.783246 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:39.783231    2578 scope.go:117] "RemoveContainer" containerID="317227ac113dd19c680d90f413da70f4b5ac0f8298ae4cb405112c1bccde4cfc"
Sep 15 09:31:39.784958 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:39.784889    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:31:39.785101 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:39.785078    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:31:39.785200 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:39.785179    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:31:40.792225 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:40.792193    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7" event={"ID":"d803ad94-c74b-41e1-95b8-a7db21eed4d5","Type":"ContainerStarted","Data":"227e782cd85b5a803c1cbfb1e0abea8a5399843d0b8fb342d29c522318cbe991"}
Sep 15 09:31:41.383581 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:41.383545    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7"
Sep 15 09:31:41.383790 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:41.383768    2578 patch_prober.go:28] interesting pod/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 15 09:31:41.383843 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:41.383816    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7" podUID="d803ad94-c74b-41e1-95b8-a7db21eed4d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 15 09:31:42.383775 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:42.383741    2578 patch_prober.go:28] interesting pod/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 15 09:31:42.384205 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:42.383798    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7" podUID="d803ad94-c74b-41e1-95b8-a7db21eed4d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 15 09:31:43.383921 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:43.383885    2578 patch_prober.go:28] interesting pod/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 15 09:31:43.384295 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:43.383956    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7" podUID="d803ad94-c74b-41e1-95b8-a7db21eed4d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 15 09:31:44.383312 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:44.383277    2578 patch_prober.go:28] interesting pod/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 15 09:31:44.383477 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:44.383323    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7" podUID="d803ad94-c74b-41e1-95b8-a7db21eed4d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 15 09:31:45.383872 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:45.383840    2578 patch_prober.go:28] interesting pod/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 15 09:31:45.384342 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:45.383895    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7" podUID="d803ad94-c74b-41e1-95b8-a7db21eed4d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 15 09:31:46.384080 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:46.384044    2578 patch_prober.go:28] interesting pod/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 15 09:31:46.384469 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:46.384103    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7" podUID="d803ad94-c74b-41e1-95b8-a7db21eed4d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 15 09:31:47.388225 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:47.388195    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7"
Sep 15 09:31:47.388725 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:47.388610    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7"
Sep 15 09:31:47.389363 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:31:47.389343    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7"
Sep 15 09:32:16.607489 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:16.607454    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-e76bac/premium-w0-e76bac-kserve-d76cf5596-9x78l"]
Sep 15 09:32:16.612108 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:16.612082    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e76bac/premium-w0-e76bac-kserve-d76cf5596-9x78l"
Sep 15 09:32:16.614742 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:16.614721    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-e76bac\"/\"openshift-service-ca.crt\""
Sep 15 09:32:16.615893 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:16.615863    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-e76bac\"/\"default-dockercfg-sjjrz\""
Sep 15 09:32:16.615893 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:16.615891    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-e76bac\"/\"kube-root-ca.crt\""
Sep 15 09:32:16.616072 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:16.615919    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-e76bac\"/\"premium-w0-e76bac-kserve-self-signed-certs\""
Sep 15 09:32:16.620709 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:16.620688    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-e76bac/premium-w0-e76bac-kserve-d76cf5596-9x78l"]
Sep 15 09:32:16.670822 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:16.670797    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a747a805-27dc-455a-94bd-bd53ff1700e1-dshm\") pod \"premium-w0-e76bac-kserve-d76cf5596-9x78l\" (UID: \"a747a805-27dc-455a-94bd-bd53ff1700e1\") " pod="e2e-models-e2e-worker-w0-e76bac/premium-w0-e76bac-kserve-d76cf5596-9x78l"
Sep 15 09:32:16.670981 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:16.670844    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drw4k\" (UniqueName: \"kubernetes.io/projected/a747a805-27dc-455a-94bd-bd53ff1700e1-kube-api-access-drw4k\") pod \"premium-w0-e76bac-kserve-d76cf5596-9x78l\" (UID: \"a747a805-27dc-455a-94bd-bd53ff1700e1\") " pod="e2e-models-e2e-worker-w0-e76bac/premium-w0-e76bac-kserve-d76cf5596-9x78l"
Sep 15 09:32:16.671053 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:16.670997    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a747a805-27dc-455a-94bd-bd53ff1700e1-tmp-dir\") pod \"premium-w0-e76bac-kserve-d76cf5596-9x78l\" (UID: \"a747a805-27dc-455a-94bd-bd53ff1700e1\") " pod="e2e-models-e2e-worker-w0-e76bac/premium-w0-e76bac-kserve-d76cf5596-9x78l"
Sep 15 09:32:16.671119 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:16.671064    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a747a805-27dc-455a-94bd-bd53ff1700e1-tls-certs\") pod \"premium-w0-e76bac-kserve-d76cf5596-9x78l\" (UID: \"a747a805-27dc-455a-94bd-bd53ff1700e1\") " pod="e2e-models-e2e-worker-w0-e76bac/premium-w0-e76bac-kserve-d76cf5596-9x78l"
Sep 15 09:32:16.671119 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:16.671096    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a747a805-27dc-455a-94bd-bd53ff1700e1-home\") pod \"premium-w0-e76bac-kserve-d76cf5596-9x78l\" (UID: \"a747a805-27dc-455a-94bd-bd53ff1700e1\") " pod="e2e-models-e2e-worker-w0-e76bac/premium-w0-e76bac-kserve-d76cf5596-9x78l"
Sep 15 09:32:16.671227 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:16.671145    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a747a805-27dc-455a-94bd-bd53ff1700e1-model-cache\") pod \"premium-w0-e76bac-kserve-d76cf5596-9x78l\" (UID: \"a747a805-27dc-455a-94bd-bd53ff1700e1\") " pod="e2e-models-e2e-worker-w0-e76bac/premium-w0-e76bac-kserve-d76cf5596-9x78l"
Sep 15 09:32:16.771649 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:16.771620    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a747a805-27dc-455a-94bd-bd53ff1700e1-tls-certs\") pod \"premium-w0-e76bac-kserve-d76cf5596-9x78l\" (UID: \"a747a805-27dc-455a-94bd-bd53ff1700e1\") " pod="e2e-models-e2e-worker-w0-e76bac/premium-w0-e76bac-kserve-d76cf5596-9x78l"
Sep 15 09:32:16.771767 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:16.771664    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a747a805-27dc-455a-94bd-bd53ff1700e1-home\") pod \"premium-w0-e76bac-kserve-d76cf5596-9x78l\" (UID: \"a747a805-27dc-455a-94bd-bd53ff1700e1\") " pod="e2e-models-e2e-worker-w0-e76bac/premium-w0-e76bac-kserve-d76cf5596-9x78l"
Sep 15 09:32:16.771767 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:16.771709    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a747a805-27dc-455a-94bd-bd53ff1700e1-model-cache\") pod \"premium-w0-e76bac-kserve-d76cf5596-9x78l\" (UID: \"a747a805-27dc-455a-94bd-bd53ff1700e1\") " pod="e2e-models-e2e-worker-w0-e76bac/premium-w0-e76bac-kserve-d76cf5596-9x78l"
Sep 15 09:32:16.771767 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:16.771747    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a747a805-27dc-455a-94bd-bd53ff1700e1-dshm\") pod \"premium-w0-e76bac-kserve-d76cf5596-9x78l\" (UID: \"a747a805-27dc-455a-94bd-bd53ff1700e1\") " pod="e2e-models-e2e-worker-w0-e76bac/premium-w0-e76bac-kserve-d76cf5596-9x78l"
Sep 15 09:32:16.771921 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:16.771805    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drw4k\" (UniqueName: \"kubernetes.io/projected/a747a805-27dc-455a-94bd-bd53ff1700e1-kube-api-access-drw4k\") pod \"premium-w0-e76bac-kserve-d76cf5596-9x78l\" (UID: \"a747a805-27dc-455a-94bd-bd53ff1700e1\") " pod="e2e-models-e2e-worker-w0-e76bac/premium-w0-e76bac-kserve-d76cf5596-9x78l"
Sep 15 09:32:16.771921 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:16.771878    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a747a805-27dc-455a-94bd-bd53ff1700e1-tmp-dir\") pod \"premium-w0-e76bac-kserve-d76cf5596-9x78l\" (UID: \"a747a805-27dc-455a-94bd-bd53ff1700e1\") " pod="e2e-models-e2e-worker-w0-e76bac/premium-w0-e76bac-kserve-d76cf5596-9x78l"
Sep 15 09:32:16.772223 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:16.772200    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a747a805-27dc-455a-94bd-bd53ff1700e1-model-cache\") pod \"premium-w0-e76bac-kserve-d76cf5596-9x78l\" (UID: \"a747a805-27dc-455a-94bd-bd53ff1700e1\") " pod="e2e-models-e2e-worker-w0-e76bac/premium-w0-e76bac-kserve-d76cf5596-9x78l"
Sep 15 09:32:16.772336 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:16.772216    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a747a805-27dc-455a-94bd-bd53ff1700e1-home\") pod \"premium-w0-e76bac-kserve-d76cf5596-9x78l\" (UID: \"a747a805-27dc-455a-94bd-bd53ff1700e1\") " pod="e2e-models-e2e-worker-w0-e76bac/premium-w0-e76bac-kserve-d76cf5596-9x78l"
Sep 15 09:32:16.772336 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:16.772303    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a747a805-27dc-455a-94bd-bd53ff1700e1-tmp-dir\") pod \"premium-w0-e76bac-kserve-d76cf5596-9x78l\" (UID: \"a747a805-27dc-455a-94bd-bd53ff1700e1\") " pod="e2e-models-e2e-worker-w0-e76bac/premium-w0-e76bac-kserve-d76cf5596-9x78l"
Sep 15 09:32:16.773934 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:16.773916    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a747a805-27dc-455a-94bd-bd53ff1700e1-dshm\") pod \"premium-w0-e76bac-kserve-d76cf5596-9x78l\" (UID: \"a747a805-27dc-455a-94bd-bd53ff1700e1\") " pod="e2e-models-e2e-worker-w0-e76bac/premium-w0-e76bac-kserve-d76cf5596-9x78l"
Sep 15 09:32:16.774122 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:16.774105    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a747a805-27dc-455a-94bd-bd53ff1700e1-tls-certs\") pod \"premium-w0-e76bac-kserve-d76cf5596-9x78l\" (UID: \"a747a805-27dc-455a-94bd-bd53ff1700e1\") " pod="e2e-models-e2e-worker-w0-e76bac/premium-w0-e76bac-kserve-d76cf5596-9x78l"
Sep 15 09:32:16.782024 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:16.782005    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drw4k\" (UniqueName: \"kubernetes.io/projected/a747a805-27dc-455a-94bd-bd53ff1700e1-kube-api-access-drw4k\") pod \"premium-w0-e76bac-kserve-d76cf5596-9x78l\" (UID: \"a747a805-27dc-455a-94bd-bd53ff1700e1\") " pod="e2e-models-e2e-worker-w0-e76bac/premium-w0-e76bac-kserve-d76cf5596-9x78l"
Sep 15 09:32:16.922774 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:16.922718    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e76bac/premium-w0-e76bac-kserve-d76cf5596-9x78l"
Sep 15 09:32:17.216994 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:17.216969    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-e76bac/premium-w0-e76bac-kserve-d76cf5596-9x78l"]
Sep 15 09:32:17.217676 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:32:17.217656    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda747a805_27dc_455a_94bd_bd53ff1700e1.slice/crio-b71a9cf28e813eab409c07159e966ae7e3f7f70286579946689fe5b5082ac780 WatchSource:0}: Error finding container b71a9cf28e813eab409c07159e966ae7e3f7f70286579946689fe5b5082ac780: Status 404 returned error can't find the container with id b71a9cf28e813eab409c07159e966ae7e3f7f70286579946689fe5b5082ac780
Sep 15 09:32:17.887657 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:17.887626    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v"]
Sep 15 09:32:17.892082 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:17.892063    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v"
Sep 15 09:32:17.895047 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:17.895025    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-8df9f24a-openshift-default-dockercfg-rp5rf\""
Sep 15 09:32:17.911462 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:17.911436    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v"]
Sep 15 09:32:17.985645 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:17.985612    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13ff4ca5-3214-4ad9-a3eb-13575552d314-istio-data\") pod \"e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v\" (UID: \"13ff4ca5-3214-4ad9-a3eb-13575552d314\") " pod="openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v"
Sep 15 09:32:17.985926 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:17.985908    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13ff4ca5-3214-4ad9-a3eb-13575552d314-credential-socket\") pod \"e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v\" (UID: \"13ff4ca5-3214-4ad9-a3eb-13575552d314\") " pod="openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v"
Sep 15 09:32:17.986119 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:17.986101    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13ff4ca5-3214-4ad9-a3eb-13575552d314-workload-certs\") pod \"e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v\" (UID: \"13ff4ca5-3214-4ad9-a3eb-13575552d314\") " pod="openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v"
Sep 15 09:32:17.986242 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:17.986229    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjlqq\" (UniqueName: \"kubernetes.io/projected/13ff4ca5-3214-4ad9-a3eb-13575552d314-kube-api-access-pjlqq\") pod \"e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v\" (UID: \"13ff4ca5-3214-4ad9-a3eb-13575552d314\") " pod="openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v"
Sep 15 09:32:17.986360 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:17.986348    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13ff4ca5-3214-4ad9-a3eb-13575552d314-istio-token\") pod \"e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v\" (UID: \"13ff4ca5-3214-4ad9-a3eb-13575552d314\") " pod="openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v"
Sep 15 09:32:17.986567 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:17.986553    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13ff4ca5-3214-4ad9-a3eb-13575552d314-istio-envoy\") pod \"e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v\" (UID: \"13ff4ca5-3214-4ad9-a3eb-13575552d314\") " pod="openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v"
Sep 15 09:32:17.986758 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:17.986744    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13ff4ca5-3214-4ad9-a3eb-13575552d314-workload-socket\") pod \"e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v\" (UID: \"13ff4ca5-3214-4ad9-a3eb-13575552d314\") " pod="openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v"
Sep 15 09:32:17.986905 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:17.986892    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13ff4ca5-3214-4ad9-a3eb-13575552d314-istiod-ca-cert\") pod \"e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v\" (UID: \"13ff4ca5-3214-4ad9-a3eb-13575552d314\") " pod="openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v"
Sep 15 09:32:17.987096 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:17.987061    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13ff4ca5-3214-4ad9-a3eb-13575552d314-istio-podinfo\") pod \"e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v\" (UID: \"13ff4ca5-3214-4ad9-a3eb-13575552d314\") " pod="openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v"
Sep 15 09:32:18.047122 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:18.047083    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e76bac/premium-w0-e76bac-kserve-d76cf5596-9x78l" event={"ID":"a747a805-27dc-455a-94bd-bd53ff1700e1","Type":"ContainerStarted","Data":"08c26661eaeb350447aa792cf29b196ba06485e19920259bb205afca8677a617"}
Sep 15 09:32:18.047122 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:18.047128    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e76bac/premium-w0-e76bac-kserve-d76cf5596-9x78l" event={"ID":"a747a805-27dc-455a-94bd-bd53ff1700e1","Type":"ContainerStarted","Data":"b71a9cf28e813eab409c07159e966ae7e3f7f70286579946689fe5b5082ac780"}
Sep 15 09:32:18.066296 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:18.066252    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-e76bac/premium-w0-e76bac-kserve-d76cf5596-9x78l" podStartSLOduration=2.066237866 podStartE2EDuration="2.066237866s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:32:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:32:18.063542138 +0000 UTC m=+1082.401987412" watchObservedRunningTime="2026-09-15 09:32:18.066237866 +0000 UTC m=+1082.404683141"
Sep 15 09:32:18.088561 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:18.088527    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13ff4ca5-3214-4ad9-a3eb-13575552d314-istio-data\") pod \"e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v\" (UID: \"13ff4ca5-3214-4ad9-a3eb-13575552d314\") " pod="openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v"
Sep 15 09:32:18.088698 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:18.088606    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13ff4ca5-3214-4ad9-a3eb-13575552d314-credential-socket\") pod \"e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v\" (UID: \"13ff4ca5-3214-4ad9-a3eb-13575552d314\") " pod="openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v"
Sep 15 09:32:18.088698 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:18.088634    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13ff4ca5-3214-4ad9-a3eb-13575552d314-workload-certs\") pod \"e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v\" (UID: \"13ff4ca5-3214-4ad9-a3eb-13575552d314\") " pod="openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v"
Sep 15 09:32:18.088698 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:18.088657    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjlqq\" (UniqueName: \"kubernetes.io/projected/13ff4ca5-3214-4ad9-a3eb-13575552d314-kube-api-access-pjlqq\") pod \"e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v\" (UID: \"13ff4ca5-3214-4ad9-a3eb-13575552d314\") " pod="openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v"
Sep 15 09:32:18.088698 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:18.088690    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13ff4ca5-3214-4ad9-a3eb-13575552d314-istio-token\") pod \"e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v\" (UID: \"13ff4ca5-3214-4ad9-a3eb-13575552d314\") " pod="openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v"
Sep 15 09:32:18.088928 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:18.088714    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13ff4ca5-3214-4ad9-a3eb-13575552d314-istio-envoy\") pod \"e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v\" (UID: \"13ff4ca5-3214-4ad9-a3eb-13575552d314\") " pod="openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v"
Sep 15 09:32:18.088928 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:18.088764    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13ff4ca5-3214-4ad9-a3eb-13575552d314-workload-socket\") pod \"e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v\" (UID: \"13ff4ca5-3214-4ad9-a3eb-13575552d314\") " pod="openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v"
Sep 15 09:32:18.088928 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:18.088787    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13ff4ca5-3214-4ad9-a3eb-13575552d314-istiod-ca-cert\") pod \"e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v\" (UID: \"13ff4ca5-3214-4ad9-a3eb-13575552d314\") " pod="openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v"
Sep 15 09:32:18.088928 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:18.088818    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13ff4ca5-3214-4ad9-a3eb-13575552d314-istio-podinfo\") pod \"e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v\" (UID: \"13ff4ca5-3214-4ad9-a3eb-13575552d314\") " pod="openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v"
Sep 15 09:32:18.089162 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:18.089038    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13ff4ca5-3214-4ad9-a3eb-13575552d314-istio-data\") pod \"e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v\" (UID: \"13ff4ca5-3214-4ad9-a3eb-13575552d314\") " pod="openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v"
Sep 15 09:32:18.089162 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:18.089064    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13ff4ca5-3214-4ad9-a3eb-13575552d314-credential-socket\") pod \"e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v\" (UID: \"13ff4ca5-3214-4ad9-a3eb-13575552d314\") " pod="openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v"
Sep 15 09:32:18.089162 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:18.089144    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13ff4ca5-3214-4ad9-a3eb-13575552d314-workload-certs\") pod \"e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v\" (UID: \"13ff4ca5-3214-4ad9-a3eb-13575552d314\") " pod="openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v"
Sep 15 09:32:18.089329 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:18.089235    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13ff4ca5-3214-4ad9-a3eb-13575552d314-workload-socket\") pod \"e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v\" (UID: \"13ff4ca5-3214-4ad9-a3eb-13575552d314\") " pod="openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v"
Sep 15 09:32:18.089626 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:18.089607    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13ff4ca5-3214-4ad9-a3eb-13575552d314-istiod-ca-cert\") pod \"e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v\" (UID: \"13ff4ca5-3214-4ad9-a3eb-13575552d314\") " pod="openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v"
Sep 15 09:32:18.091356 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:18.091329    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13ff4ca5-3214-4ad9-a3eb-13575552d314-istio-envoy\") pod \"e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v\" (UID: \"13ff4ca5-3214-4ad9-a3eb-13575552d314\") " pod="openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v"
Sep 15 09:32:18.091578 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:18.091559    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13ff4ca5-3214-4ad9-a3eb-13575552d314-istio-podinfo\") pod \"e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v\" (UID: \"13ff4ca5-3214-4ad9-a3eb-13575552d314\") " pod="openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v"
Sep 15 09:32:18.096514 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:18.096486    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjlqq\" (UniqueName: \"kubernetes.io/projected/13ff4ca5-3214-4ad9-a3eb-13575552d314-kube-api-access-pjlqq\") pod \"e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v\" (UID: \"13ff4ca5-3214-4ad9-a3eb-13575552d314\") " pod="openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v"
Sep 15 09:32:18.097124 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:18.097105    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13ff4ca5-3214-4ad9-a3eb-13575552d314-istio-token\") pod \"e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v\" (UID: \"13ff4ca5-3214-4ad9-a3eb-13575552d314\") " pod="openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v"
Sep 15 09:32:18.203526 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:18.203467    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v"
Sep 15 09:32:18.485364 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:18.485339    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v"]
Sep 15 09:32:18.486083 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:32:18.486061    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13ff4ca5_3214_4ad9_a3eb_13575552d314.slice/crio-271eb10a33478babede0d6c32242a292a2ce8517ee653598fa1f20132c781367 WatchSource:0}: Error finding container 271eb10a33478babede0d6c32242a292a2ce8517ee653598fa1f20132c781367: Status 404 returned error can't find the container with id 271eb10a33478babede0d6c32242a292a2ce8517ee653598fa1f20132c781367
Sep 15 09:32:18.488365 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:18.488331    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:32:18.488422 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:18.488397    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:32:18.488463 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:18.488431    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:32:19.055015 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:19.054981    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v" event={"ID":"13ff4ca5-3214-4ad9-a3eb-13575552d314","Type":"ContainerStarted","Data":"d3617ee13618965972a3f24faf9a36092667f52d462a207c1ede9f9511d653b8"}
Sep 15 09:32:19.055403 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:19.055036    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v" event={"ID":"13ff4ca5-3214-4ad9-a3eb-13575552d314","Type":"ContainerStarted","Data":"271eb10a33478babede0d6c32242a292a2ce8517ee653598fa1f20132c781367"}
Sep 15 09:32:19.076880 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:19.076835    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v" podStartSLOduration=2.076821409 podStartE2EDuration="2.076821409s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:32:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:32:19.074904438 +0000 UTC m=+1083.413349723" watchObservedRunningTime="2026-09-15 09:32:19.076821409 +0000 UTC m=+1083.415266685"
Sep 15 09:32:19.204496 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:19.204457    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v"
Sep 15 09:32:19.210307 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:19.210280    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v"
Sep 15 09:32:20.061717 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:20.061686    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v"
Sep 15 09:32:20.062864 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:20.062836    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v"
Sep 15 09:32:26.923038 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:26.923008    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-e76bac/premium-w0-e76bac-kserve-d76cf5596-9x78l"
Sep 15 09:32:26.923412 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:26.923144    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-e76bac/premium-w0-e76bac-kserve-d76cf5596-9x78l"
Sep 15 09:32:26.936014 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:26.935989    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-e76bac/premium-w0-e76bac-kserve-d76cf5596-9x78l"
Sep 15 09:32:27.114420 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:27.114393    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-e76bac/premium-w0-e76bac-kserve-d76cf5596-9x78l"
Sep 15 09:32:28.063242 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:28.063210    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-8df9f24a-6c6d59d75d-5h8lt"]
Sep 15 09:32:28.066825 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:28.066809    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-8df9f24a-6c6d59d75d-5h8lt"
Sep 15 09:32:28.069144 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:28.069119    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-8df9f24a\""
Sep 15 09:32:28.069282 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:28.069163    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-8df9f24a-dockercfg-cbgm4\""
Sep 15 09:32:28.075786 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:28.075767    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-8df9f24a-6c6d59d75d-5h8lt"]
Sep 15 09:32:28.185637 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:28.185599    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/990ef25c-3251-4dea-9132-93c81617f095-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-8df9f24a-6c6d59d75d-5h8lt\" (UID: \"990ef25c-3251-4dea-9132-93c81617f095\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-8df9f24a-6c6d59d75d-5h8lt"
Sep 15 09:32:28.185832 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:28.185650    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xk97k\" (UniqueName: \"kubernetes.io/projected/990ef25c-3251-4dea-9132-93c81617f095-kube-api-access-xk97k\") pod \"payload-pre-processing-e2e-mt-8df9f24a-6c6d59d75d-5h8lt\" (UID: \"990ef25c-3251-4dea-9132-93c81617f095\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-8df9f24a-6c6d59d75d-5h8lt"
Sep 15 09:32:28.286142 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:28.286112    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/990ef25c-3251-4dea-9132-93c81617f095-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-8df9f24a-6c6d59d75d-5h8lt\" (UID: \"990ef25c-3251-4dea-9132-93c81617f095\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-8df9f24a-6c6d59d75d-5h8lt"
Sep 15 09:32:28.286284 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:28.286149    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xk97k\" (UniqueName: \"kubernetes.io/projected/990ef25c-3251-4dea-9132-93c81617f095-kube-api-access-xk97k\") pod \"payload-pre-processing-e2e-mt-8df9f24a-6c6d59d75d-5h8lt\" (UID: \"990ef25c-3251-4dea-9132-93c81617f095\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-8df9f24a-6c6d59d75d-5h8lt"
Sep 15 09:32:28.286927 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:28.286904    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/990ef25c-3251-4dea-9132-93c81617f095-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-8df9f24a-6c6d59d75d-5h8lt\" (UID: \"990ef25c-3251-4dea-9132-93c81617f095\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-8df9f24a-6c6d59d75d-5h8lt"
Sep 15 09:32:28.293253 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:28.293233    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xk97k\" (UniqueName: \"kubernetes.io/projected/990ef25c-3251-4dea-9132-93c81617f095-kube-api-access-xk97k\") pod \"payload-pre-processing-e2e-mt-8df9f24a-6c6d59d75d-5h8lt\" (UID: \"990ef25c-3251-4dea-9132-93c81617f095\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-8df9f24a-6c6d59d75d-5h8lt"
Sep 15 09:32:28.379023 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:28.378966    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-8df9f24a-6c6d59d75d-5h8lt"
Sep 15 09:32:28.647838 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:28.647805    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-8df9f24a-6c6d59d75d-5h8lt"]
Sep 15 09:32:28.648651 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:32:28.648625    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod990ef25c_3251_4dea_9132_93c81617f095.slice/crio-667bbff7bc75a95aeeac771cda612842df9119d6f7282c8f65eb2c723a7146ee WatchSource:0}: Error finding container 667bbff7bc75a95aeeac771cda612842df9119d6f7282c8f65eb2c723a7146ee: Status 404 returned error can't find the container with id 667bbff7bc75a95aeeac771cda612842df9119d6f7282c8f65eb2c723a7146ee
Sep 15 09:32:29.143451 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:29.143420    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-8df9f24a-6c6d59d75d-5h8lt" event={"ID":"990ef25c-3251-4dea-9132-93c81617f095","Type":"ContainerStarted","Data":"bdaad320b9fe35b1bb95968004d66a0cc2b43528e5f1c6a722f8252ba4ba8131"}
Sep 15 09:32:29.143980 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:29.143592    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-8df9f24a-6c6d59d75d-5h8lt"
Sep 15 09:32:29.143980 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:29.143624    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-8df9f24a-6c6d59d75d-5h8lt" event={"ID":"990ef25c-3251-4dea-9132-93c81617f095","Type":"ContainerStarted","Data":"667bbff7bc75a95aeeac771cda612842df9119d6f7282c8f65eb2c723a7146ee"}
Sep 15 09:32:29.160962 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:29.160903    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-8df9f24a-6c6d59d75d-5h8lt" podStartSLOduration=1.160889058 podStartE2EDuration="1.160889058s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:32:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:32:29.158061819 +0000 UTC m=+1093.496507097" watchObservedRunningTime="2026-09-15 09:32:29.160889058 +0000 UTC m=+1093.499334345"
Sep 15 09:32:40.152123 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:40.152094    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-8df9f24a-6c6d59d75d-5h8lt"
Sep 15 09:32:48.281247 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:48.281215    2578 generic.go:356] "Generic (PLEG): container finished" podID="13ff4ca5-3214-4ad9-a3eb-13575552d314" containerID="d3617ee13618965972a3f24faf9a36092667f52d462a207c1ede9f9511d653b8" exitCode=0
Sep 15 09:32:48.281594 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:48.281282    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v" event={"ID":"13ff4ca5-3214-4ad9-a3eb-13575552d314","Type":"ContainerDied","Data":"d3617ee13618965972a3f24faf9a36092667f52d462a207c1ede9f9511d653b8"}
Sep 15 09:32:48.281659 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:48.281629    2578 scope.go:117] "RemoveContainer" containerID="d3617ee13618965972a3f24faf9a36092667f52d462a207c1ede9f9511d653b8"
Sep 15 09:32:48.282697 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:48.282666    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:32:48.282776 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:48.282735    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:32:48.282776 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:48.282763    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:32:49.288911 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:49.288877    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v" event={"ID":"13ff4ca5-3214-4ad9-a3eb-13575552d314","Type":"ContainerStarted","Data":"ea83fa9d50805499a35fc99ebf65c17bf58fabb42b89439567d93aa7958b783a"}
Sep 15 09:32:50.061730 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:50.061690    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v"
Sep 15 09:32:50.204008 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:50.203976    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v"
Sep 15 09:32:50.205228 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:50.205202    2578 patch_prober.go:28] interesting pod/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Sep 15 09:32:50.205351 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:50.205247    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v" podUID="13ff4ca5-3214-4ad9-a3eb-13575552d314" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Sep 15 09:32:51.204689 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:51.204655    2578 patch_prober.go:28] interesting pod/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Sep 15 09:32:51.205164 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:51.204716    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v" podUID="13ff4ca5-3214-4ad9-a3eb-13575552d314" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Sep 15 09:32:52.204407 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:52.204374    2578 patch_prober.go:28] interesting pod/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Sep 15 09:32:52.204571 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:52.204429    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v" podUID="13ff4ca5-3214-4ad9-a3eb-13575552d314" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Sep 15 09:32:53.204751 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:53.204716    2578 patch_prober.go:28] interesting pod/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Sep 15 09:32:53.205166 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:53.204776    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v" podUID="13ff4ca5-3214-4ad9-a3eb-13575552d314" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Sep 15 09:32:54.203897 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:54.203867    2578 patch_prober.go:28] interesting pod/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Sep 15 09:32:54.204060 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:54.203927    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v" podUID="13ff4ca5-3214-4ad9-a3eb-13575552d314" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Sep 15 09:32:55.208118 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:55.208076    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v"
Sep 15 09:32:55.209059 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:32:55.209039    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v"
Sep 15 09:33:00.524887 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:00.524853    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8df9f24a-pggh6"]
Sep 15 09:33:00.528839 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:00.528822    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8df9f24a-pggh6"
Sep 15 09:33:00.531425 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:00.531396    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cbqnn\""
Sep 15 09:33:00.531571 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:00.531479    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 09:33:00.534524 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:00.534502    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8df9f24a-pggh6"]
Sep 15 09:33:00.607554 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:00.607525    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc5652c2-6eb6-4e84-9bcf-ed9e749d5e01-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-8df9f24a-pggh6\" (UID: \"cc5652c2-6eb6-4e84-9bcf-ed9e749d5e01\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8df9f24a-pggh6"
Sep 15 09:33:00.708841 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:00.708809    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc5652c2-6eb6-4e84-9bcf-ed9e749d5e01-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-8df9f24a-pggh6\" (UID: \"cc5652c2-6eb6-4e84-9bcf-ed9e749d5e01\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8df9f24a-pggh6"
Sep 15 09:33:00.709417 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:00.709397    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc5652c2-6eb6-4e84-9bcf-ed9e749d5e01-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-8df9f24a-pggh6\" (UID: \"cc5652c2-6eb6-4e84-9bcf-ed9e749d5e01\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8df9f24a-pggh6"
Sep 15 09:33:00.841983 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:00.841915    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8df9f24a-pggh6"
Sep 15 09:33:01.117080 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:01.117050    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8df9f24a-pggh6"]
Sep 15 09:33:01.117793 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:33:01.117768    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc5652c2_6eb6_4e84_9bcf_ed9e749d5e01.slice/crio-cba82b950f213fbf868bf759a8f8232805cc25188743fa4698bfede885b0c2d9 WatchSource:0}: Error finding container cba82b950f213fbf868bf759a8f8232805cc25188743fa4698bfede885b0c2d9: Status 404 returned error can't find the container with id cba82b950f213fbf868bf759a8f8232805cc25188743fa4698bfede885b0c2d9
Sep 15 09:33:01.365442 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:01.365377    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8df9f24a-pggh6" event={"ID":"cc5652c2-6eb6-4e84-9bcf-ed9e749d5e01","Type":"ContainerStarted","Data":"18eb072872fd852157f01b46f83099d8c54ae506a9ff171aa063d65f82ce2958"}
Sep 15 09:33:01.365442 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:01.365434    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8df9f24a-pggh6" event={"ID":"cc5652c2-6eb6-4e84-9bcf-ed9e749d5e01","Type":"ContainerStarted","Data":"cba82b950f213fbf868bf759a8f8232805cc25188743fa4698bfede885b0c2d9"}
Sep 15 09:33:01.379856 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:01.379815    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8df9f24a-pggh6" podStartSLOduration=1.379800773 podStartE2EDuration="1.379800773s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:33:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:33:01.377888927 +0000 UTC m=+1125.716334203" watchObservedRunningTime="2026-09-15 09:33:01.379800773 +0000 UTC m=+1125.718246047"
Sep 15 09:33:02.372580 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:02.372549    2578 generic.go:356] "Generic (PLEG): container finished" podID="cc5652c2-6eb6-4e84-9bcf-ed9e749d5e01" containerID="18eb072872fd852157f01b46f83099d8c54ae506a9ff171aa063d65f82ce2958" exitCode=0
Sep 15 09:33:02.372926 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:02.372637    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8df9f24a-pggh6" event={"ID":"cc5652c2-6eb6-4e84-9bcf-ed9e749d5e01","Type":"ContainerDied","Data":"18eb072872fd852157f01b46f83099d8c54ae506a9ff171aa063d65f82ce2958"}
Sep 15 09:33:03.509849 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:03.509824    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8df9f24a-pggh6"
Sep 15 09:33:03.638631 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:03.638562    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc5652c2-6eb6-4e84-9bcf-ed9e749d5e01-maas-api-service-ca\") pod \"cc5652c2-6eb6-4e84-9bcf-ed9e749d5e01\" (UID: \"cc5652c2-6eb6-4e84-9bcf-ed9e749d5e01\") "
Sep 15 09:33:03.638940 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:03.638914    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc5652c2-6eb6-4e84-9bcf-ed9e749d5e01-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "cc5652c2-6eb6-4e84-9bcf-ed9e749d5e01" (UID: "cc5652c2-6eb6-4e84-9bcf-ed9e749d5e01"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:33:03.739593 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:03.739564    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc5652c2-6eb6-4e84-9bcf-ed9e749d5e01-maas-api-service-ca\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:33:04.386780 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:04.386698    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8df9f24a-pggh6" event={"ID":"cc5652c2-6eb6-4e84-9bcf-ed9e749d5e01","Type":"ContainerDied","Data":"cba82b950f213fbf868bf759a8f8232805cc25188743fa4698bfede885b0c2d9"}
Sep 15 09:33:04.386780 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:04.386735    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8df9f24a-pggh6"
Sep 15 09:33:04.386780 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:04.386749    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cba82b950f213fbf868bf759a8f8232805cc25188743fa4698bfede885b0c2d9"
Sep 15 09:33:11.042580 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:11.042548    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-8df9f24a-6c6d59d75d-5h8lt"]
Sep 15 09:33:11.043054 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:11.042758    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-8df9f24a-6c6d59d75d-5h8lt" podUID="990ef25c-3251-4dea-9132-93c81617f095" containerName="payload-pre-processing" containerID="cri-o://bdaad320b9fe35b1bb95968004d66a0cc2b43528e5f1c6a722f8252ba4ba8131" gracePeriod=30
Sep 15 09:33:11.195460 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:11.195430    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8df9f24a-pggh6"]
Sep 15 09:33:11.208377 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:11.208350    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8df9f24a-pggh6"]
Sep 15 09:33:11.332616 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:11.332595    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-8df9f24a-6c6d59d75d-5h8lt"
Sep 15 09:33:11.433578 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:11.433535    2578 generic.go:356] "Generic (PLEG): container finished" podID="990ef25c-3251-4dea-9132-93c81617f095" containerID="bdaad320b9fe35b1bb95968004d66a0cc2b43528e5f1c6a722f8252ba4ba8131" exitCode=0
Sep 15 09:33:11.433578 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:11.433584    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-8df9f24a-6c6d59d75d-5h8lt"
Sep 15 09:33:11.433867 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:11.433632    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-8df9f24a-6c6d59d75d-5h8lt" event={"ID":"990ef25c-3251-4dea-9132-93c81617f095","Type":"ContainerDied","Data":"bdaad320b9fe35b1bb95968004d66a0cc2b43528e5f1c6a722f8252ba4ba8131"}
Sep 15 09:33:11.433867 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:11.433703    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-8df9f24a-6c6d59d75d-5h8lt" event={"ID":"990ef25c-3251-4dea-9132-93c81617f095","Type":"ContainerDied","Data":"667bbff7bc75a95aeeac771cda612842df9119d6f7282c8f65eb2c723a7146ee"}
Sep 15 09:33:11.433867 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:11.433737    2578 scope.go:117] "RemoveContainer" containerID="bdaad320b9fe35b1bb95968004d66a0cc2b43528e5f1c6a722f8252ba4ba8131"
Sep 15 09:33:11.444572 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:11.444546    2578 scope.go:117] "RemoveContainer" containerID="bdaad320b9fe35b1bb95968004d66a0cc2b43528e5f1c6a722f8252ba4ba8131"
Sep 15 09:33:11.444912 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:33:11.444882    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdaad320b9fe35b1bb95968004d66a0cc2b43528e5f1c6a722f8252ba4ba8131\": container with ID starting with bdaad320b9fe35b1bb95968004d66a0cc2b43528e5f1c6a722f8252ba4ba8131 not found: ID does not exist" containerID="bdaad320b9fe35b1bb95968004d66a0cc2b43528e5f1c6a722f8252ba4ba8131"
Sep 15 09:33:11.445051 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:11.444924    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdaad320b9fe35b1bb95968004d66a0cc2b43528e5f1c6a722f8252ba4ba8131"} err="failed to get container status \"bdaad320b9fe35b1bb95968004d66a0cc2b43528e5f1c6a722f8252ba4ba8131\": rpc error: code = NotFound desc = could not find container \"bdaad320b9fe35b1bb95968004d66a0cc2b43528e5f1c6a722f8252ba4ba8131\": container with ID starting with bdaad320b9fe35b1bb95968004d66a0cc2b43528e5f1c6a722f8252ba4ba8131 not found: ID does not exist"
Sep 15 09:33:11.511489 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:11.511454    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xk97k\" (UniqueName: \"kubernetes.io/projected/990ef25c-3251-4dea-9132-93c81617f095-kube-api-access-xk97k\") pod \"990ef25c-3251-4dea-9132-93c81617f095\" (UID: \"990ef25c-3251-4dea-9132-93c81617f095\") "
Sep 15 09:33:11.511671 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:11.511610    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/990ef25c-3251-4dea-9132-93c81617f095-plugins-config-volume\") pod \"990ef25c-3251-4dea-9132-93c81617f095\" (UID: \"990ef25c-3251-4dea-9132-93c81617f095\") "
Sep 15 09:33:11.512070 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:11.512039    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/990ef25c-3251-4dea-9132-93c81617f095-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "990ef25c-3251-4dea-9132-93c81617f095" (UID: "990ef25c-3251-4dea-9132-93c81617f095"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:33:11.513697 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:11.513674    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/990ef25c-3251-4dea-9132-93c81617f095-kube-api-access-xk97k" (OuterVolumeSpecName: "kube-api-access-xk97k") pod "990ef25c-3251-4dea-9132-93c81617f095" (UID: "990ef25c-3251-4dea-9132-93c81617f095"). InnerVolumeSpecName "kube-api-access-xk97k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:33:11.612696 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:11.612622    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/990ef25c-3251-4dea-9132-93c81617f095-plugins-config-volume\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:33:11.612696 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:11.612645    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xk97k\" (UniqueName: \"kubernetes.io/projected/990ef25c-3251-4dea-9132-93c81617f095-kube-api-access-xk97k\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:33:11.755757 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:11.755725    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-8df9f24a-6c6d59d75d-5h8lt"]
Sep 15 09:33:11.758405 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:11.758380    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-8df9f24a-6c6d59d75d-5h8lt"]
Sep 15 09:33:12.122911 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:12.122881    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="990ef25c-3251-4dea-9132-93c81617f095" path="/var/lib/kubelet/pods/990ef25c-3251-4dea-9132-93c81617f095/volumes"
Sep 15 09:33:12.123292 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:12.123253    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc5652c2-6eb6-4e84-9bcf-ed9e749d5e01" path="/var/lib/kubelet/pods/cc5652c2-6eb6-4e84-9bcf-ed9e749d5e01/volumes"
Sep 15 09:33:17.356735 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:17.356693    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v"]
Sep 15 09:33:17.357234 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:17.356924    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v" podUID="13ff4ca5-3214-4ad9-a3eb-13575552d314" containerName="istio-proxy" containerID="cri-o://ea83fa9d50805499a35fc99ebf65c17bf58fabb42b89439567d93aa7958b783a" gracePeriod=30
Sep 15 09:33:22.513581 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:22.513549    2578 generic.go:356] "Generic (PLEG): container finished" podID="13ff4ca5-3214-4ad9-a3eb-13575552d314" containerID="ea83fa9d50805499a35fc99ebf65c17bf58fabb42b89439567d93aa7958b783a" exitCode=0
Sep 15 09:33:22.514117 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:22.513595    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v" event={"ID":"13ff4ca5-3214-4ad9-a3eb-13575552d314","Type":"ContainerDied","Data":"ea83fa9d50805499a35fc99ebf65c17bf58fabb42b89439567d93aa7958b783a"}
Sep 15 09:33:22.514117 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:22.513645    2578 scope.go:117] "RemoveContainer" containerID="d3617ee13618965972a3f24faf9a36092667f52d462a207c1ede9f9511d653b8"
Sep 15 09:33:22.609581 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:22.609561    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v"
Sep 15 09:33:22.719158 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:22.719126    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13ff4ca5-3214-4ad9-a3eb-13575552d314-istio-podinfo\") pod \"13ff4ca5-3214-4ad9-a3eb-13575552d314\" (UID: \"13ff4ca5-3214-4ad9-a3eb-13575552d314\") "
Sep 15 09:33:22.719300 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:22.719170    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13ff4ca5-3214-4ad9-a3eb-13575552d314-workload-socket\") pod \"13ff4ca5-3214-4ad9-a3eb-13575552d314\" (UID: \"13ff4ca5-3214-4ad9-a3eb-13575552d314\") "
Sep 15 09:33:22.719300 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:22.719213    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13ff4ca5-3214-4ad9-a3eb-13575552d314-istiod-ca-cert\") pod \"13ff4ca5-3214-4ad9-a3eb-13575552d314\" (UID: \"13ff4ca5-3214-4ad9-a3eb-13575552d314\") "
Sep 15 09:33:22.719392 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:22.719315    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13ff4ca5-3214-4ad9-a3eb-13575552d314-istio-envoy\") pod \"13ff4ca5-3214-4ad9-a3eb-13575552d314\" (UID: \"13ff4ca5-3214-4ad9-a3eb-13575552d314\") "
Sep 15 09:33:22.719392 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:22.719370    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13ff4ca5-3214-4ad9-a3eb-13575552d314-workload-certs\") pod \"13ff4ca5-3214-4ad9-a3eb-13575552d314\" (UID: \"13ff4ca5-3214-4ad9-a3eb-13575552d314\") "
Sep 15 09:33:22.719501 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:22.719425    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pjlqq\" (UniqueName: \"kubernetes.io/projected/13ff4ca5-3214-4ad9-a3eb-13575552d314-kube-api-access-pjlqq\") pod \"13ff4ca5-3214-4ad9-a3eb-13575552d314\" (UID: \"13ff4ca5-3214-4ad9-a3eb-13575552d314\") "
Sep 15 09:33:22.719501 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:22.719470    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13ff4ca5-3214-4ad9-a3eb-13575552d314-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "13ff4ca5-3214-4ad9-a3eb-13575552d314" (UID: "13ff4ca5-3214-4ad9-a3eb-13575552d314"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:33:22.719501 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:22.719486    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13ff4ca5-3214-4ad9-a3eb-13575552d314-credential-socket\") pod \"13ff4ca5-3214-4ad9-a3eb-13575552d314\" (UID: \"13ff4ca5-3214-4ad9-a3eb-13575552d314\") "
Sep 15 09:33:22.719671 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:22.719500    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13ff4ca5-3214-4ad9-a3eb-13575552d314-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "13ff4ca5-3214-4ad9-a3eb-13575552d314" (UID: "13ff4ca5-3214-4ad9-a3eb-13575552d314"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:33:22.719671 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:22.719538    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13ff4ca5-3214-4ad9-a3eb-13575552d314-istio-token\") pod \"13ff4ca5-3214-4ad9-a3eb-13575552d314\" (UID: \"13ff4ca5-3214-4ad9-a3eb-13575552d314\") "
Sep 15 09:33:22.719671 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:22.719590    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13ff4ca5-3214-4ad9-a3eb-13575552d314-istio-data\") pod \"13ff4ca5-3214-4ad9-a3eb-13575552d314\" (UID: \"13ff4ca5-3214-4ad9-a3eb-13575552d314\") "
Sep 15 09:33:22.719671 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:22.719647    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13ff4ca5-3214-4ad9-a3eb-13575552d314-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "13ff4ca5-3214-4ad9-a3eb-13575552d314" (UID: "13ff4ca5-3214-4ad9-a3eb-13575552d314"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:33:22.719885 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:22.719749    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13ff4ca5-3214-4ad9-a3eb-13575552d314-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "13ff4ca5-3214-4ad9-a3eb-13575552d314" (UID: "13ff4ca5-3214-4ad9-a3eb-13575552d314"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:33:22.719969 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:22.719924    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13ff4ca5-3214-4ad9-a3eb-13575552d314-istio-data" (OuterVolumeSpecName: "istio-data") pod "13ff4ca5-3214-4ad9-a3eb-13575552d314" (UID: "13ff4ca5-3214-4ad9-a3eb-13575552d314"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:33:22.720083 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:22.720055    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/13ff4ca5-3214-4ad9-a3eb-13575552d314-workload-certs\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:33:22.720083 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:22.720078    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/13ff4ca5-3214-4ad9-a3eb-13575552d314-credential-socket\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:33:22.720260 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:22.720092    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/13ff4ca5-3214-4ad9-a3eb-13575552d314-istio-data\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:33:22.720260 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:22.720112    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/13ff4ca5-3214-4ad9-a3eb-13575552d314-workload-socket\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:33:22.720260 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:22.720125    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/13ff4ca5-3214-4ad9-a3eb-13575552d314-istiod-ca-cert\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:33:22.721495 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:22.721465    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/13ff4ca5-3214-4ad9-a3eb-13575552d314-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "13ff4ca5-3214-4ad9-a3eb-13575552d314" (UID: "13ff4ca5-3214-4ad9-a3eb-13575552d314"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 09:33:22.721495 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:22.721475    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13ff4ca5-3214-4ad9-a3eb-13575552d314-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "13ff4ca5-3214-4ad9-a3eb-13575552d314" (UID: "13ff4ca5-3214-4ad9-a3eb-13575552d314"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:33:22.721651 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:22.721580    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13ff4ca5-3214-4ad9-a3eb-13575552d314-istio-token" (OuterVolumeSpecName: "istio-token") pod "13ff4ca5-3214-4ad9-a3eb-13575552d314" (UID: "13ff4ca5-3214-4ad9-a3eb-13575552d314"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:33:22.721651 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:22.721612    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13ff4ca5-3214-4ad9-a3eb-13575552d314-kube-api-access-pjlqq" (OuterVolumeSpecName: "kube-api-access-pjlqq") pod "13ff4ca5-3214-4ad9-a3eb-13575552d314" (UID: "13ff4ca5-3214-4ad9-a3eb-13575552d314"). InnerVolumeSpecName "kube-api-access-pjlqq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:33:22.820941 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:22.820903    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/13ff4ca5-3214-4ad9-a3eb-13575552d314-istio-token\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:33:22.820941 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:22.820938    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/13ff4ca5-3214-4ad9-a3eb-13575552d314-istio-podinfo\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:33:22.821097 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:22.820972    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/13ff4ca5-3214-4ad9-a3eb-13575552d314-istio-envoy\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:33:22.821097 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:22.820985    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pjlqq\" (UniqueName: \"kubernetes.io/projected/13ff4ca5-3214-4ad9-a3eb-13575552d314-kube-api-access-pjlqq\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:33:23.522097 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:23.522069    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v"
Sep 15 09:33:23.522568 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:23.522109    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v" event={"ID":"13ff4ca5-3214-4ad9-a3eb-13575552d314","Type":"ContainerDied","Data":"271eb10a33478babede0d6c32242a292a2ce8517ee653598fa1f20132c781367"}
Sep 15 09:33:23.522568 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:23.522182    2578 scope.go:117] "RemoveContainer" containerID="ea83fa9d50805499a35fc99ebf65c17bf58fabb42b89439567d93aa7958b783a"
Sep 15 09:33:23.544077 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:23.544041    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v"]
Sep 15 09:33:23.548896 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:23.548871    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-8df9f24a-openshift-default-c777796f6-hkr6v"]
Sep 15 09:33:24.123138 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:24.123101    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13ff4ca5-3214-4ad9-a3eb-13575552d314" path="/var/lib/kubelet/pods/13ff4ca5-3214-4ad9-a3eb-13575552d314/volumes"
Sep 15 09:33:36.434499 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:36.434470    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-5b654a-mzh49"]
Sep 15 09:33:36.434856 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:36.434843    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="990ef25c-3251-4dea-9132-93c81617f095" containerName="payload-pre-processing"
Sep 15 09:33:36.434856 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:36.434853    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="990ef25c-3251-4dea-9132-93c81617f095" containerName="payload-pre-processing"
Sep 15 09:33:36.434930 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:36.434880    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc5652c2-6eb6-4e84-9bcf-ed9e749d5e01" containerName="revoke-keys"
Sep 15 09:33:36.434930 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:36.434886    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc5652c2-6eb6-4e84-9bcf-ed9e749d5e01" containerName="revoke-keys"
Sep 15 09:33:36.434930 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:36.434896    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13ff4ca5-3214-4ad9-a3eb-13575552d314" containerName="istio-proxy"
Sep 15 09:33:36.434930 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:36.434901    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="13ff4ca5-3214-4ad9-a3eb-13575552d314" containerName="istio-proxy"
Sep 15 09:33:36.434930 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:36.434907    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13ff4ca5-3214-4ad9-a3eb-13575552d314" containerName="istio-proxy"
Sep 15 09:33:36.434930 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:36.434912    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="13ff4ca5-3214-4ad9-a3eb-13575552d314" containerName="istio-proxy"
Sep 15 09:33:36.435191 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:36.434981    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="990ef25c-3251-4dea-9132-93c81617f095" containerName="payload-pre-processing"
Sep 15 09:33:36.435191 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:36.434990    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="13ff4ca5-3214-4ad9-a3eb-13575552d314" containerName="istio-proxy"
Sep 15 09:33:36.435191 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:36.434997    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc5652c2-6eb6-4e84-9bcf-ed9e749d5e01" containerName="revoke-keys"
Sep 15 09:33:36.439474 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:36.439456    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-5b654a-mzh49"
Sep 15 09:33:36.442537 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:36.442510    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cbqnn\""
Sep 15 09:33:36.442978 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:36.442933    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 09:33:36.450120 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:36.450093    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-5b654a-mzh49"]
Sep 15 09:33:36.556092 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:36.556071    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ce507b8-ea5b-429b-a0bf-beed0e4ad74f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-5b654a-mzh49\" (UID: \"6ce507b8-ea5b-429b-a0bf-beed0e4ad74f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-5b654a-mzh49"
Sep 15 09:33:36.657237 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:36.657213    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ce507b8-ea5b-429b-a0bf-beed0e4ad74f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-5b654a-mzh49\" (UID: \"6ce507b8-ea5b-429b-a0bf-beed0e4ad74f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-5b654a-mzh49"
Sep 15 09:33:36.657775 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:36.657756    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ce507b8-ea5b-429b-a0bf-beed0e4ad74f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-5b654a-mzh49\" (UID: \"6ce507b8-ea5b-429b-a0bf-beed0e4ad74f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-5b654a-mzh49"
Sep 15 09:33:36.756430 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:36.756409    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-5b654a-mzh49"
Sep 15 09:33:37.026993 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:37.026960    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-5b654a-mzh49"]
Sep 15 09:33:37.028165 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:33:37.028138    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ce507b8_ea5b_429b_a0bf_beed0e4ad74f.slice/crio-c89e010f00ee01c7a085d9982b5cc76c8d077080db2e7f071ef44644ff73aa5a WatchSource:0}: Error finding container c89e010f00ee01c7a085d9982b5cc76c8d077080db2e7f071ef44644ff73aa5a: Status 404 returned error can't find the container with id c89e010f00ee01c7a085d9982b5cc76c8d077080db2e7f071ef44644ff73aa5a
Sep 15 09:33:37.610630 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:37.610596    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-5b654a-mzh49" event={"ID":"6ce507b8-ea5b-429b-a0bf-beed0e4ad74f","Type":"ContainerStarted","Data":"9353724eb563c5bbb0be1965d324138b011f9af7508c42c71fe23beca3362806"}
Sep 15 09:33:37.610995 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:37.610648    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-5b654a-mzh49" event={"ID":"6ce507b8-ea5b-429b-a0bf-beed0e4ad74f","Type":"ContainerStarted","Data":"c89e010f00ee01c7a085d9982b5cc76c8d077080db2e7f071ef44644ff73aa5a"}
Sep 15 09:33:37.628466 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:37.628425    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-5b654a-mzh49" podStartSLOduration=1.62840999 podStartE2EDuration="1.62840999s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:33:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:33:37.625670408 +0000 UTC m=+1161.964115683" watchObservedRunningTime="2026-09-15 09:33:37.62840999 +0000 UTC m=+1161.966855264"
Sep 15 09:33:38.465341 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:38.465310    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f514a4-6c487f8bcd-z8xt7"]
Sep 15 09:33:38.465840 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:38.465823    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="13ff4ca5-3214-4ad9-a3eb-13575552d314" containerName="istio-proxy"
Sep 15 09:33:38.468988 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:38.468972    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f514a4-6c487f8bcd-z8xt7"
Sep 15 09:33:38.471268 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:38.471248    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-f514a4-dockercfg-hhdgs\""
Sep 15 09:33:38.472059 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:38.472044    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-f514a4\""
Sep 15 09:33:38.482252 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:38.482227    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f514a4-6c487f8bcd-z8xt7"]
Sep 15 09:33:38.574601 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:38.574519    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k26gv\" (UniqueName: \"kubernetes.io/projected/36e2331e-b1da-4571-86c9-f09f18a44844-kube-api-access-k26gv\") pod \"payload-pre-processing-e2e-shared-a-w2-f514a4-6c487f8bcd-z8xt7\" (UID: \"36e2331e-b1da-4571-86c9-f09f18a44844\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f514a4-6c487f8bcd-z8xt7"
Sep 15 09:33:38.574884 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:38.574864    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36e2331e-b1da-4571-86c9-f09f18a44844-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-f514a4-6c487f8bcd-z8xt7\" (UID: \"36e2331e-b1da-4571-86c9-f09f18a44844\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f514a4-6c487f8bcd-z8xt7"
Sep 15 09:33:38.618339 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:38.618300    2578 generic.go:356] "Generic (PLEG): container finished" podID="6ce507b8-ea5b-429b-a0bf-beed0e4ad74f" containerID="9353724eb563c5bbb0be1965d324138b011f9af7508c42c71fe23beca3362806" exitCode=0
Sep 15 09:33:38.618339 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:38.618340    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-5b654a-mzh49" event={"ID":"6ce507b8-ea5b-429b-a0bf-beed0e4ad74f","Type":"ContainerDied","Data":"9353724eb563c5bbb0be1965d324138b011f9af7508c42c71fe23beca3362806"}
Sep 15 09:33:38.675788 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:38.675757    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k26gv\" (UniqueName: \"kubernetes.io/projected/36e2331e-b1da-4571-86c9-f09f18a44844-kube-api-access-k26gv\") pod \"payload-pre-processing-e2e-shared-a-w2-f514a4-6c487f8bcd-z8xt7\" (UID: \"36e2331e-b1da-4571-86c9-f09f18a44844\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f514a4-6c487f8bcd-z8xt7"
Sep 15 09:33:38.675933 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:38.675810    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36e2331e-b1da-4571-86c9-f09f18a44844-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-f514a4-6c487f8bcd-z8xt7\" (UID: \"36e2331e-b1da-4571-86c9-f09f18a44844\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f514a4-6c487f8bcd-z8xt7"
Sep 15 09:33:38.676519 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:38.676501    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36e2331e-b1da-4571-86c9-f09f18a44844-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-f514a4-6c487f8bcd-z8xt7\" (UID: \"36e2331e-b1da-4571-86c9-f09f18a44844\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f514a4-6c487f8bcd-z8xt7"
Sep 15 09:33:38.683531 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:38.683507    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k26gv\" (UniqueName: \"kubernetes.io/projected/36e2331e-b1da-4571-86c9-f09f18a44844-kube-api-access-k26gv\") pod \"payload-pre-processing-e2e-shared-a-w2-f514a4-6c487f8bcd-z8xt7\" (UID: \"36e2331e-b1da-4571-86c9-f09f18a44844\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f514a4-6c487f8bcd-z8xt7"
Sep 15 09:33:38.778910 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:38.778857    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f514a4-6c487f8bcd-z8xt7"
Sep 15 09:33:39.053511 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:39.053484    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f514a4-6c487f8bcd-z8xt7"]
Sep 15 09:33:39.054034 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:33:39.054011    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36e2331e_b1da_4571_86c9_f09f18a44844.slice/crio-7684c29a4685611b2390c6ca25cd0175849a73d62eb86894b8c6e9f706efdc7a WatchSource:0}: Error finding container 7684c29a4685611b2390c6ca25cd0175849a73d62eb86894b8c6e9f706efdc7a: Status 404 returned error can't find the container with id 7684c29a4685611b2390c6ca25cd0175849a73d62eb86894b8c6e9f706efdc7a
Sep 15 09:33:39.626267 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:39.626234    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f514a4-6c487f8bcd-z8xt7" event={"ID":"36e2331e-b1da-4571-86c9-f09f18a44844","Type":"ContainerStarted","Data":"f0374d57e978aa20c470a2c184417e979c1ccf77291565cc1b243005f52ca6d3"}
Sep 15 09:33:39.626682 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:39.626289    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f514a4-6c487f8bcd-z8xt7" event={"ID":"36e2331e-b1da-4571-86c9-f09f18a44844","Type":"ContainerStarted","Data":"7684c29a4685611b2390c6ca25cd0175849a73d62eb86894b8c6e9f706efdc7a"}
Sep 15 09:33:39.626682 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:39.626382    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f514a4-6c487f8bcd-z8xt7"
Sep 15 09:33:39.642472 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:39.642428    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f514a4-6c487f8bcd-z8xt7" podStartSLOduration=1.6424097 podStartE2EDuration="1.6424097s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:33:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:33:39.640530894 +0000 UTC m=+1163.978976170" watchObservedRunningTime="2026-09-15 09:33:39.6424097 +0000 UTC m=+1163.980854975"
Sep 15 09:33:39.763075 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:39.762724    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-5b654a-mzh49"
Sep 15 09:33:39.887939 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:39.887868    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ce507b8-ea5b-429b-a0bf-beed0e4ad74f-maas-api-service-ca\") pod \"6ce507b8-ea5b-429b-a0bf-beed0e4ad74f\" (UID: \"6ce507b8-ea5b-429b-a0bf-beed0e4ad74f\") "
Sep 15 09:33:39.888646 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:39.888601    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ce507b8-ea5b-429b-a0bf-beed0e4ad74f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6ce507b8-ea5b-429b-a0bf-beed0e4ad74f" (UID: "6ce507b8-ea5b-429b-a0bf-beed0e4ad74f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:33:39.890023 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:39.888987    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ce507b8-ea5b-429b-a0bf-beed0e4ad74f-maas-api-service-ca\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:33:40.634080 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:40.634049    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-5b654a-mzh49"
Sep 15 09:33:40.634555 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:40.634088    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-5b654a-mzh49" event={"ID":"6ce507b8-ea5b-429b-a0bf-beed0e4ad74f","Type":"ContainerDied","Data":"c89e010f00ee01c7a085d9982b5cc76c8d077080db2e7f071ef44644ff73aa5a"}
Sep 15 09:33:40.634555 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:40.634149    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c89e010f00ee01c7a085d9982b5cc76c8d077080db2e7f071ef44644ff73aa5a"
Sep 15 09:33:47.358923 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:47.358881    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-5b654a-7bd5d9f7c7-5srhn"]
Sep 15 09:33:47.359387 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:47.359148    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-5b654a-7bd5d9f7c7-5srhn" podUID="748feef6-a8c0-4acd-a6c2-f9cf77f3ee9a" containerName="payload-processing" containerID="cri-o://9ea82239994c8fc78cee44c1a6d5f83cbd9be1a8720a99a9252e5f8349a22bc4" gracePeriod=30
Sep 15 09:33:47.367738 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:47.367711    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-5b654a-689bb5579d-jzxzs"]
Sep 15 09:33:47.368143 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:47.368089    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-5b654a-689bb5579d-jzxzs" podUID="6fb895d1-b4a2-49da-83eb-cb5293b39a23" containerName="payload-pre-processing" containerID="cri-o://1d246f55e2f358c49d1f190203eb96ec8e161c4f7f81900e663cc6a695d465fa" gracePeriod=30
Sep 15 09:33:47.526517 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:47.526459    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-5b654a-mzh49"]
Sep 15 09:33:47.529230 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:47.529204    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-5b654a-mzh49"]
Sep 15 09:33:47.677100 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:47.677038    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-5b654a-689bb5579d-jzxzs"
Sep 15 09:33:47.679693 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:47.679671    2578 generic.go:356] "Generic (PLEG): container finished" podID="6fb895d1-b4a2-49da-83eb-cb5293b39a23" containerID="1d246f55e2f358c49d1f190203eb96ec8e161c4f7f81900e663cc6a695d465fa" exitCode=0
Sep 15 09:33:47.680039 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:47.679704    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-5b654a-689bb5579d-jzxzs"
Sep 15 09:33:47.680039 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:47.679745    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-5b654a-689bb5579d-jzxzs" event={"ID":"6fb895d1-b4a2-49da-83eb-cb5293b39a23","Type":"ContainerDied","Data":"1d246f55e2f358c49d1f190203eb96ec8e161c4f7f81900e663cc6a695d465fa"}
Sep 15 09:33:47.680039 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:47.679796    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-5b654a-689bb5579d-jzxzs" event={"ID":"6fb895d1-b4a2-49da-83eb-cb5293b39a23","Type":"ContainerDied","Data":"8273ff15cced3aea3924f8180552ad52ddd26484ee78fc318318f6cfc9f97830"}
Sep 15 09:33:47.680039 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:47.679818    2578 scope.go:117] "RemoveContainer" containerID="1d246f55e2f358c49d1f190203eb96ec8e161c4f7f81900e663cc6a695d465fa"
Sep 15 09:33:47.681103 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:47.681088    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-5b654a-7bd5d9f7c7-5srhn"
Sep 15 09:33:47.681224 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:47.681116    2578 generic.go:356] "Generic (PLEG): container finished" podID="748feef6-a8c0-4acd-a6c2-f9cf77f3ee9a" containerID="9ea82239994c8fc78cee44c1a6d5f83cbd9be1a8720a99a9252e5f8349a22bc4" exitCode=0
Sep 15 09:33:47.681224 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:47.681157    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-5b654a-7bd5d9f7c7-5srhn" event={"ID":"748feef6-a8c0-4acd-a6c2-f9cf77f3ee9a","Type":"ContainerDied","Data":"9ea82239994c8fc78cee44c1a6d5f83cbd9be1a8720a99a9252e5f8349a22bc4"}
Sep 15 09:33:47.681224 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:47.681186    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-5b654a-7bd5d9f7c7-5srhn" event={"ID":"748feef6-a8c0-4acd-a6c2-f9cf77f3ee9a","Type":"ContainerDied","Data":"eba39e0077dc593fd27605536c7f2c25d7f383e210dd9d6b1970de111a86704a"}
Sep 15 09:33:47.689747 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:47.689731    2578 scope.go:117] "RemoveContainer" containerID="1d246f55e2f358c49d1f190203eb96ec8e161c4f7f81900e663cc6a695d465fa"
Sep 15 09:33:47.690083 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:33:47.690065    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d246f55e2f358c49d1f190203eb96ec8e161c4f7f81900e663cc6a695d465fa\": container with ID starting with 1d246f55e2f358c49d1f190203eb96ec8e161c4f7f81900e663cc6a695d465fa not found: ID does not exist" containerID="1d246f55e2f358c49d1f190203eb96ec8e161c4f7f81900e663cc6a695d465fa"
Sep 15 09:33:47.690162 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:47.690091    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d246f55e2f358c49d1f190203eb96ec8e161c4f7f81900e663cc6a695d465fa"} err="failed to get container status \"1d246f55e2f358c49d1f190203eb96ec8e161c4f7f81900e663cc6a695d465fa\": rpc error: code = NotFound desc = could not find container \"1d246f55e2f358c49d1f190203eb96ec8e161c4f7f81900e663cc6a695d465fa\": container with ID starting with 1d246f55e2f358c49d1f190203eb96ec8e161c4f7f81900e663cc6a695d465fa not found: ID does not exist"
Sep 15 09:33:47.690162 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:47.690106    2578 scope.go:117] "RemoveContainer" containerID="9ea82239994c8fc78cee44c1a6d5f83cbd9be1a8720a99a9252e5f8349a22bc4"
Sep 15 09:33:47.698578 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:47.698553    2578 scope.go:117] "RemoveContainer" containerID="9ea82239994c8fc78cee44c1a6d5f83cbd9be1a8720a99a9252e5f8349a22bc4"
Sep 15 09:33:47.698860 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:33:47.698838    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ea82239994c8fc78cee44c1a6d5f83cbd9be1a8720a99a9252e5f8349a22bc4\": container with ID starting with 9ea82239994c8fc78cee44c1a6d5f83cbd9be1a8720a99a9252e5f8349a22bc4 not found: ID does not exist" containerID="9ea82239994c8fc78cee44c1a6d5f83cbd9be1a8720a99a9252e5f8349a22bc4"
Sep 15 09:33:47.698906 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:47.698869    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ea82239994c8fc78cee44c1a6d5f83cbd9be1a8720a99a9252e5f8349a22bc4"} err="failed to get container status \"9ea82239994c8fc78cee44c1a6d5f83cbd9be1a8720a99a9252e5f8349a22bc4\": rpc error: code = NotFound desc = could not find container \"9ea82239994c8fc78cee44c1a6d5f83cbd9be1a8720a99a9252e5f8349a22bc4\": container with ID starting with 9ea82239994c8fc78cee44c1a6d5f83cbd9be1a8720a99a9252e5f8349a22bc4 not found: ID does not exist"
Sep 15 09:33:47.762841 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:47.762819    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6fb895d1-b4a2-49da-83eb-cb5293b39a23-plugins-config-volume\") pod \"6fb895d1-b4a2-49da-83eb-cb5293b39a23\" (UID: \"6fb895d1-b4a2-49da-83eb-cb5293b39a23\") "
Sep 15 09:33:47.763015 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:47.762883    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-576dq\" (UniqueName: \"kubernetes.io/projected/6fb895d1-b4a2-49da-83eb-cb5293b39a23-kube-api-access-576dq\") pod \"6fb895d1-b4a2-49da-83eb-cb5293b39a23\" (UID: \"6fb895d1-b4a2-49da-83eb-cb5293b39a23\") "
Sep 15 09:33:47.763288 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:47.763260    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fb895d1-b4a2-49da-83eb-cb5293b39a23-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6fb895d1-b4a2-49da-83eb-cb5293b39a23" (UID: "6fb895d1-b4a2-49da-83eb-cb5293b39a23"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:33:47.764961 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:47.764925    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fb895d1-b4a2-49da-83eb-cb5293b39a23-kube-api-access-576dq" (OuterVolumeSpecName: "kube-api-access-576dq") pod "6fb895d1-b4a2-49da-83eb-cb5293b39a23" (UID: "6fb895d1-b4a2-49da-83eb-cb5293b39a23"). InnerVolumeSpecName "kube-api-access-576dq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:33:47.863779 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:47.863754    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzm8c\" (UniqueName: \"kubernetes.io/projected/748feef6-a8c0-4acd-a6c2-f9cf77f3ee9a-kube-api-access-jzm8c\") pod \"748feef6-a8c0-4acd-a6c2-f9cf77f3ee9a\" (UID: \"748feef6-a8c0-4acd-a6c2-f9cf77f3ee9a\") "
Sep 15 09:33:47.863862 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:47.863855    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/748feef6-a8c0-4acd-a6c2-f9cf77f3ee9a-plugins-config-volume\") pod \"748feef6-a8c0-4acd-a6c2-f9cf77f3ee9a\" (UID: \"748feef6-a8c0-4acd-a6c2-f9cf77f3ee9a\") "
Sep 15 09:33:47.864068 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:47.864054    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6fb895d1-b4a2-49da-83eb-cb5293b39a23-plugins-config-volume\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:33:47.864068 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:47.864068    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-576dq\" (UniqueName: \"kubernetes.io/projected/6fb895d1-b4a2-49da-83eb-cb5293b39a23-kube-api-access-576dq\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:33:47.864195 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:47.864176    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/748feef6-a8c0-4acd-a6c2-f9cf77f3ee9a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "748feef6-a8c0-4acd-a6c2-f9cf77f3ee9a" (UID: "748feef6-a8c0-4acd-a6c2-f9cf77f3ee9a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:33:47.865521 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:47.865502    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/748feef6-a8c0-4acd-a6c2-f9cf77f3ee9a-kube-api-access-jzm8c" (OuterVolumeSpecName: "kube-api-access-jzm8c") pod "748feef6-a8c0-4acd-a6c2-f9cf77f3ee9a" (UID: "748feef6-a8c0-4acd-a6c2-f9cf77f3ee9a"). InnerVolumeSpecName "kube-api-access-jzm8c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:33:47.964905 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:47.964881    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzm8c\" (UniqueName: \"kubernetes.io/projected/748feef6-a8c0-4acd-a6c2-f9cf77f3ee9a-kube-api-access-jzm8c\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:33:47.964905 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:47.964905    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/748feef6-a8c0-4acd-a6c2-f9cf77f3ee9a-plugins-config-volume\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:33:48.000940 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:48.000915    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-5b654a-689bb5579d-jzxzs"]
Sep 15 09:33:48.006814 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:48.006794    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-5b654a-689bb5579d-jzxzs"]
Sep 15 09:33:48.130020 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:48.129987    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ce507b8-ea5b-429b-a0bf-beed0e4ad74f" path="/var/lib/kubelet/pods/6ce507b8-ea5b-429b-a0bf-beed0e4ad74f/volumes"
Sep 15 09:33:48.130344 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:48.130331    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fb895d1-b4a2-49da-83eb-cb5293b39a23" path="/var/lib/kubelet/pods/6fb895d1-b4a2-49da-83eb-cb5293b39a23/volumes"
Sep 15 09:33:48.688538 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:48.688469    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-5b654a-7bd5d9f7c7-5srhn"
Sep 15 09:33:48.714502 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:48.714472    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-5b654a-7bd5d9f7c7-5srhn"]
Sep 15 09:33:48.716935 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:48.716913    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-5b654a-7bd5d9f7c7-5srhn"]
Sep 15 09:33:50.121732 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:50.121695    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="748feef6-a8c0-4acd-a6c2-f9cf77f3ee9a" path="/var/lib/kubelet/pods/748feef6-a8c0-4acd-a6c2-f9cf77f3ee9a/volumes"
Sep 15 09:33:50.637018 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:50.636990    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f514a4-6c487f8bcd-z8xt7"
Sep 15 09:33:54.226915 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:54.226884    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd"]
Sep 15 09:33:54.227459 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:54.227442    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fb895d1-b4a2-49da-83eb-cb5293b39a23" containerName="payload-pre-processing"
Sep 15 09:33:54.227505 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:54.227461    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fb895d1-b4a2-49da-83eb-cb5293b39a23" containerName="payload-pre-processing"
Sep 15 09:33:54.227505 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:54.227485    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="748feef6-a8c0-4acd-a6c2-f9cf77f3ee9a" containerName="payload-processing"
Sep 15 09:33:54.227505 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:54.227495    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="748feef6-a8c0-4acd-a6c2-f9cf77f3ee9a" containerName="payload-processing"
Sep 15 09:33:54.227604 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:54.227515    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ce507b8-ea5b-429b-a0bf-beed0e4ad74f" containerName="revoke-keys"
Sep 15 09:33:54.227604 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:54.227524    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ce507b8-ea5b-429b-a0bf-beed0e4ad74f" containerName="revoke-keys"
Sep 15 09:33:54.227668 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:54.227634    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="748feef6-a8c0-4acd-a6c2-f9cf77f3ee9a" containerName="payload-processing"
Sep 15 09:33:54.227668 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:54.227649    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ce507b8-ea5b-429b-a0bf-beed0e4ad74f" containerName="revoke-keys"
Sep 15 09:33:54.227668 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:54.227661    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fb895d1-b4a2-49da-83eb-cb5293b39a23" containerName="payload-pre-processing"
Sep 15 09:33:54.232700 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:54.232680    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd"
Sep 15 09:33:54.235223 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:54.235205    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-161187-openshift-default-dockercfg-bntnw\""
Sep 15 09:33:54.243016 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:54.242243    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd"]
Sep 15 09:33:54.426490 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:54.426458    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b9aa140-0520-470a-98d1-3c711a74a0b9-istiod-ca-cert\") pod \"e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd\" (UID: \"4b9aa140-0520-470a-98d1-3c711a74a0b9\") " pod="openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd"
Sep 15 09:33:54.426655 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:54.426517    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b9aa140-0520-470a-98d1-3c711a74a0b9-workload-socket\") pod \"e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd\" (UID: \"4b9aa140-0520-470a-98d1-3c711a74a0b9\") " pod="openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd"
Sep 15 09:33:54.426655 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:54.426587    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b9aa140-0520-470a-98d1-3c711a74a0b9-istio-envoy\") pod \"e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd\" (UID: \"4b9aa140-0520-470a-98d1-3c711a74a0b9\") " pod="openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd"
Sep 15 09:33:54.426655 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:54.426643    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b9aa140-0520-470a-98d1-3c711a74a0b9-workload-certs\") pod \"e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd\" (UID: \"4b9aa140-0520-470a-98d1-3c711a74a0b9\") " pod="openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd"
Sep 15 09:33:54.426764 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:54.426688    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b9aa140-0520-470a-98d1-3c711a74a0b9-istio-podinfo\") pod \"e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd\" (UID: \"4b9aa140-0520-470a-98d1-3c711a74a0b9\") " pod="openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd"
Sep 15 09:33:54.426764 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:54.426705    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6kqw\" (UniqueName: \"kubernetes.io/projected/4b9aa140-0520-470a-98d1-3c711a74a0b9-kube-api-access-b6kqw\") pod \"e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd\" (UID: \"4b9aa140-0520-470a-98d1-3c711a74a0b9\") " pod="openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd"
Sep 15 09:33:54.426764 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:54.426746    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b9aa140-0520-470a-98d1-3c711a74a0b9-istio-data\") pod \"e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd\" (UID: \"4b9aa140-0520-470a-98d1-3c711a74a0b9\") " pod="openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd"
Sep 15 09:33:54.426863 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:54.426767    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b9aa140-0520-470a-98d1-3c711a74a0b9-istio-token\") pod \"e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd\" (UID: \"4b9aa140-0520-470a-98d1-3c711a74a0b9\") " pod="openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd"
Sep 15 09:33:54.426863 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:54.426816    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b9aa140-0520-470a-98d1-3c711a74a0b9-credential-socket\") pod \"e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd\" (UID: \"4b9aa140-0520-470a-98d1-3c711a74a0b9\") " pod="openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd"
Sep 15 09:33:54.527828 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:54.527767    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b9aa140-0520-470a-98d1-3c711a74a0b9-credential-socket\") pod \"e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd\" (UID: \"4b9aa140-0520-470a-98d1-3c711a74a0b9\") " pod="openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd"
Sep 15 09:33:54.527828 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:54.527821    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b9aa140-0520-470a-98d1-3c711a74a0b9-istiod-ca-cert\") pod \"e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd\" (UID: \"4b9aa140-0520-470a-98d1-3c711a74a0b9\") " pod="openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd"
Sep 15 09:33:54.528051 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:54.527856    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b9aa140-0520-470a-98d1-3c711a74a0b9-workload-socket\") pod \"e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd\" (UID: \"4b9aa140-0520-470a-98d1-3c711a74a0b9\") " pod="openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd"
Sep 15 09:33:54.528051 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:54.527872    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b9aa140-0520-470a-98d1-3c711a74a0b9-istio-envoy\") pod \"e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd\" (UID: \"4b9aa140-0520-470a-98d1-3c711a74a0b9\") " pod="openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd"
Sep 15 09:33:54.528051 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:54.527903    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b9aa140-0520-470a-98d1-3c711a74a0b9-workload-certs\") pod \"e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd\" (UID: \"4b9aa140-0520-470a-98d1-3c711a74a0b9\") " pod="openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd"
Sep 15 09:33:54.528051 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:54.527975    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b9aa140-0520-470a-98d1-3c711a74a0b9-istio-podinfo\") pod \"e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd\" (UID: \"4b9aa140-0520-470a-98d1-3c711a74a0b9\") " pod="openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd"
Sep 15 09:33:54.528051 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:54.528001    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6kqw\" (UniqueName: \"kubernetes.io/projected/4b9aa140-0520-470a-98d1-3c711a74a0b9-kube-api-access-b6kqw\") pod \"e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd\" (UID: \"4b9aa140-0520-470a-98d1-3c711a74a0b9\") " pod="openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd"
Sep 15 09:33:54.528051 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:54.528029    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b9aa140-0520-470a-98d1-3c711a74a0b9-istio-data\") pod \"e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd\" (UID: \"4b9aa140-0520-470a-98d1-3c711a74a0b9\") " pod="openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd"
Sep 15 09:33:54.528384 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:54.528053    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b9aa140-0520-470a-98d1-3c711a74a0b9-istio-token\") pod \"e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd\" (UID: \"4b9aa140-0520-470a-98d1-3c711a74a0b9\") " pod="openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd"
Sep 15 09:33:54.528384 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:54.528235    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b9aa140-0520-470a-98d1-3c711a74a0b9-credential-socket\") pod \"e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd\" (UID: \"4b9aa140-0520-470a-98d1-3c711a74a0b9\") " pod="openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd"
Sep 15 09:33:54.528384 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:54.528249    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b9aa140-0520-470a-98d1-3c711a74a0b9-workload-socket\") pod \"e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd\" (UID: \"4b9aa140-0520-470a-98d1-3c711a74a0b9\") " pod="openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd"
Sep 15 09:33:54.528554 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:54.528483    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b9aa140-0520-470a-98d1-3c711a74a0b9-istio-data\") pod \"e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd\" (UID: \"4b9aa140-0520-470a-98d1-3c711a74a0b9\") " pod="openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd"
Sep 15 09:33:54.528684 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:54.528660    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b9aa140-0520-470a-98d1-3c711a74a0b9-istiod-ca-cert\") pod \"e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd\" (UID: \"4b9aa140-0520-470a-98d1-3c711a74a0b9\") " pod="openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd"
Sep 15 09:33:54.528768 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:54.528748    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b9aa140-0520-470a-98d1-3c711a74a0b9-workload-certs\") pod \"e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd\" (UID: \"4b9aa140-0520-470a-98d1-3c711a74a0b9\") " pod="openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd"
Sep 15 09:33:54.530602 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:54.530577    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b9aa140-0520-470a-98d1-3c711a74a0b9-istio-podinfo\") pod \"e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd\" (UID: \"4b9aa140-0520-470a-98d1-3c711a74a0b9\") " pod="openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd"
Sep 15 09:33:54.530705 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:54.530649    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b9aa140-0520-470a-98d1-3c711a74a0b9-istio-envoy\") pod \"e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd\" (UID: \"4b9aa140-0520-470a-98d1-3c711a74a0b9\") " pod="openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd"
Sep 15 09:33:54.536317 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:54.536296    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b9aa140-0520-470a-98d1-3c711a74a0b9-istio-token\") pod \"e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd\" (UID: \"4b9aa140-0520-470a-98d1-3c711a74a0b9\") " pod="openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd"
Sep 15 09:33:54.536317 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:54.536308    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6kqw\" (UniqueName: \"kubernetes.io/projected/4b9aa140-0520-470a-98d1-3c711a74a0b9-kube-api-access-b6kqw\") pod \"e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd\" (UID: \"4b9aa140-0520-470a-98d1-3c711a74a0b9\") " pod="openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd"
Sep 15 09:33:54.545223 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:54.545204    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd"
Sep 15 09:33:54.827425 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:54.827401    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd"]
Sep 15 09:33:54.828046 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:33:54.828013    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b9aa140_0520_470a_98d1_3c711a74a0b9.slice/crio-c4dee6a642961c57010bdccc2f373d87791651be1744354b3231fd38a65d6876 WatchSource:0}: Error finding container c4dee6a642961c57010bdccc2f373d87791651be1744354b3231fd38a65d6876: Status 404 returned error can't find the container with id c4dee6a642961c57010bdccc2f373d87791651be1744354b3231fd38a65d6876
Sep 15 09:33:54.830305 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:54.830270    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:33:54.830391 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:54.830334    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:33:54.830391 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:54.830362    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:33:55.734363 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:55.734318    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd" event={"ID":"4b9aa140-0520-470a-98d1-3c711a74a0b9","Type":"ContainerStarted","Data":"06bdc72f51e16701d3c55cc30747085a82f4951d88fc853170819f37416d91ab"}
Sep 15 09:33:55.734742 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:55.734383    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd" event={"ID":"4b9aa140-0520-470a-98d1-3c711a74a0b9","Type":"ContainerStarted","Data":"c4dee6a642961c57010bdccc2f373d87791651be1744354b3231fd38a65d6876"}
Sep 15 09:33:55.754852 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:55.754800    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd" podStartSLOduration=1.754786317 podStartE2EDuration="1.754786317s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:33:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:33:55.75282223 +0000 UTC m=+1180.091267506" watchObservedRunningTime="2026-09-15 09:33:55.754786317 +0000 UTC m=+1180.093231591"
Sep 15 09:33:56.545928 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:56.545896    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd"
Sep 15 09:33:56.550883 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:56.550862    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd"
Sep 15 09:33:56.741148 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:56.741121    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd"
Sep 15 09:33:56.742003 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:33:56.741982    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd"
Sep 15 09:34:03.314813 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:03.314780    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-161187-864c7c86b6-7qn5b"]
Sep 15 09:34:03.318516 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:03.318495    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-161187-864c7c86b6-7qn5b"
Sep 15 09:34:03.320727 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:03.320702    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-161187\""
Sep 15 09:34:03.321983 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:03.321962    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-161187-5bc98c8587-4zgsr"]
Sep 15 09:34:03.325629 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:03.325607    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-161187-5bc98c8587-4zgsr"
Sep 15 09:34:03.329422 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:03.329401    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-161187-864c7c86b6-7qn5b"]
Sep 15 09:34:03.335261 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:03.335234    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-161187-5bc98c8587-4zgsr"]
Sep 15 09:34:03.410660 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:03.410634    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jv9g7\" (UniqueName: \"kubernetes.io/projected/7a49e99f-a9f6-4323-a753-e44f5e4b2064-kube-api-access-jv9g7\") pod \"payload-processing-e2e-shared-b-w2-161187-5bc98c8587-4zgsr\" (UID: \"7a49e99f-a9f6-4323-a753-e44f5e4b2064\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-161187-5bc98c8587-4zgsr"
Sep 15 09:34:03.410773 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:03.410678    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqp9b\" (UniqueName: \"kubernetes.io/projected/e14f7d4a-07d1-469b-833d-08659608ff1e-kube-api-access-sqp9b\") pod \"payload-pre-processing-e2e-shared-b-w2-161187-864c7c86b6-7qn5b\" (UID: \"e14f7d4a-07d1-469b-833d-08659608ff1e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-161187-864c7c86b6-7qn5b"
Sep 15 09:34:03.410773 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:03.410701    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e14f7d4a-07d1-469b-833d-08659608ff1e-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-161187-864c7c86b6-7qn5b\" (UID: \"e14f7d4a-07d1-469b-833d-08659608ff1e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-161187-864c7c86b6-7qn5b"
Sep 15 09:34:03.410870 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:03.410788    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a49e99f-a9f6-4323-a753-e44f5e4b2064-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-161187-5bc98c8587-4zgsr\" (UID: \"7a49e99f-a9f6-4323-a753-e44f5e4b2064\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-161187-5bc98c8587-4zgsr"
Sep 15 09:34:03.512292 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:03.512256    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jv9g7\" (UniqueName: \"kubernetes.io/projected/7a49e99f-a9f6-4323-a753-e44f5e4b2064-kube-api-access-jv9g7\") pod \"payload-processing-e2e-shared-b-w2-161187-5bc98c8587-4zgsr\" (UID: \"7a49e99f-a9f6-4323-a753-e44f5e4b2064\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-161187-5bc98c8587-4zgsr"
Sep 15 09:34:03.512491 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:03.512324    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqp9b\" (UniqueName: \"kubernetes.io/projected/e14f7d4a-07d1-469b-833d-08659608ff1e-kube-api-access-sqp9b\") pod \"payload-pre-processing-e2e-shared-b-w2-161187-864c7c86b6-7qn5b\" (UID: \"e14f7d4a-07d1-469b-833d-08659608ff1e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-161187-864c7c86b6-7qn5b"
Sep 15 09:34:03.512491 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:03.512360    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e14f7d4a-07d1-469b-833d-08659608ff1e-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-161187-864c7c86b6-7qn5b\" (UID: \"e14f7d4a-07d1-469b-833d-08659608ff1e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-161187-864c7c86b6-7qn5b"
Sep 15 09:34:03.512491 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:03.512423    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a49e99f-a9f6-4323-a753-e44f5e4b2064-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-161187-5bc98c8587-4zgsr\" (UID: \"7a49e99f-a9f6-4323-a753-e44f5e4b2064\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-161187-5bc98c8587-4zgsr"
Sep 15 09:34:03.513279 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:03.513242    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a49e99f-a9f6-4323-a753-e44f5e4b2064-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-161187-5bc98c8587-4zgsr\" (UID: \"7a49e99f-a9f6-4323-a753-e44f5e4b2064\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-161187-5bc98c8587-4zgsr"
Sep 15 09:34:03.513428 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:03.513335    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e14f7d4a-07d1-469b-833d-08659608ff1e-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-161187-864c7c86b6-7qn5b\" (UID: \"e14f7d4a-07d1-469b-833d-08659608ff1e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-161187-864c7c86b6-7qn5b"
Sep 15 09:34:03.522182 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:03.522156    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jv9g7\" (UniqueName: \"kubernetes.io/projected/7a49e99f-a9f6-4323-a753-e44f5e4b2064-kube-api-access-jv9g7\") pod \"payload-processing-e2e-shared-b-w2-161187-5bc98c8587-4zgsr\" (UID: \"7a49e99f-a9f6-4323-a753-e44f5e4b2064\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-161187-5bc98c8587-4zgsr"
Sep 15 09:34:03.522293 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:03.522159    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqp9b\" (UniqueName: \"kubernetes.io/projected/e14f7d4a-07d1-469b-833d-08659608ff1e-kube-api-access-sqp9b\") pod \"payload-pre-processing-e2e-shared-b-w2-161187-864c7c86b6-7qn5b\" (UID: \"e14f7d4a-07d1-469b-833d-08659608ff1e\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-161187-864c7c86b6-7qn5b"
Sep 15 09:34:03.632512 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:03.632457    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-161187-864c7c86b6-7qn5b"
Sep 15 09:34:03.641386 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:03.641370    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-161187-5bc98c8587-4zgsr"
Sep 15 09:34:03.914477 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:03.914451    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-161187-864c7c86b6-7qn5b"]
Sep 15 09:34:03.915621 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:34:03.915587    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode14f7d4a_07d1_469b_833d_08659608ff1e.slice/crio-c8bd9911f93f77e033d863cdfd533bfd4a61ea142cded7045d82ace40e6495ab WatchSource:0}: Error finding container c8bd9911f93f77e033d863cdfd533bfd4a61ea142cded7045d82ace40e6495ab: Status 404 returned error can't find the container with id c8bd9911f93f77e033d863cdfd533bfd4a61ea142cded7045d82ace40e6495ab
Sep 15 09:34:03.919494 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:03.919466    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-161187-5bc98c8587-4zgsr"]
Sep 15 09:34:03.920581 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:34:03.920559    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a49e99f_a9f6_4323_a753_e44f5e4b2064.slice/crio-6bd77ff0978e2281b368c14206c9d4d8e698137ff01256ef0c16804ff996cac8 WatchSource:0}: Error finding container 6bd77ff0978e2281b368c14206c9d4d8e698137ff01256ef0c16804ff996cac8: Status 404 returned error can't find the container with id 6bd77ff0978e2281b368c14206c9d4d8e698137ff01256ef0c16804ff996cac8
Sep 15 09:34:04.799003 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:04.798975    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-161187-5bc98c8587-4zgsr" event={"ID":"7a49e99f-a9f6-4323-a753-e44f5e4b2064","Type":"ContainerStarted","Data":"689841f3f60cf7b8f87fd17b0443c87174c5fb79754380a906f1e4206aa4ad14"}
Sep 15 09:34:04.799403 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:04.799022    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-161187-5bc98c8587-4zgsr" event={"ID":"7a49e99f-a9f6-4323-a753-e44f5e4b2064","Type":"ContainerStarted","Data":"6bd77ff0978e2281b368c14206c9d4d8e698137ff01256ef0c16804ff996cac8"}
Sep 15 09:34:04.799403 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:04.799153    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-161187-5bc98c8587-4zgsr"
Sep 15 09:34:04.800673 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:04.800645    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-161187-864c7c86b6-7qn5b" event={"ID":"e14f7d4a-07d1-469b-833d-08659608ff1e","Type":"ContainerStarted","Data":"ea7041bcf12262307283c7a80b19fbf9d6754c88e5f6c3b1af1e25a78d50d2f1"}
Sep 15 09:34:04.800815 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:04.800689    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-161187-864c7c86b6-7qn5b" event={"ID":"e14f7d4a-07d1-469b-833d-08659608ff1e","Type":"ContainerStarted","Data":"c8bd9911f93f77e033d863cdfd533bfd4a61ea142cded7045d82ace40e6495ab"}
Sep 15 09:34:04.800815 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:04.800720    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-161187-864c7c86b6-7qn5b"
Sep 15 09:34:04.814752 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:04.814697    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-161187-5bc98c8587-4zgsr" podStartSLOduration=1.814682034 podStartE2EDuration="1.814682034s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:34:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:34:04.814090316 +0000 UTC m=+1189.152535592" watchObservedRunningTime="2026-09-15 09:34:04.814682034 +0000 UTC m=+1189.153127315"
Sep 15 09:34:04.829294 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:04.829261    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-161187-864c7c86b6-7qn5b" podStartSLOduration=1.829252273 podStartE2EDuration="1.829252273s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:34:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:34:04.827891019 +0000 UTC m=+1189.166336299" watchObservedRunningTime="2026-09-15 09:34:04.829252273 +0000 UTC m=+1189.167697547"
Sep 15 09:34:15.809775 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:15.809746    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-161187-864c7c86b6-7qn5b"
Sep 15 09:34:15.810207 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:15.809921    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-161187-5bc98c8587-4zgsr"
Sep 15 09:34:27.782085 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:27.782045    2578 patch_prober.go:28] interesting pod/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 15 09:34:27.782524 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:27.782124    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd" podUID="4b9aa140-0520-470a-98d1-3c711a74a0b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 15 09:34:29.973232 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:29.973198    2578 generic.go:356] "Generic (PLEG): container finished" podID="4b9aa140-0520-470a-98d1-3c711a74a0b9" containerID="06bdc72f51e16701d3c55cc30747085a82f4951d88fc853170819f37416d91ab" exitCode=0
Sep 15 09:34:29.973639 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:29.973274    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd" event={"ID":"4b9aa140-0520-470a-98d1-3c711a74a0b9","Type":"ContainerDied","Data":"06bdc72f51e16701d3c55cc30747085a82f4951d88fc853170819f37416d91ab"}
Sep 15 09:34:29.973693 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:29.973675    2578 scope.go:117] "RemoveContainer" containerID="06bdc72f51e16701d3c55cc30747085a82f4951d88fc853170819f37416d91ab"
Sep 15 09:34:29.974926 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:29.974898    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:34:29.975008 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:29.974981    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:34:29.975046 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:29.975013    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:34:30.078311 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:30.078280    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7"]
Sep 15 09:34:30.078551 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:30.078525    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7" podUID="d803ad94-c74b-41e1-95b8-a7db21eed4d5" containerName="istio-proxy" containerID="cri-o://227e782cd85b5a803c1cbfb1e0abea8a5399843d0b8fb342d29c522318cbe991" gracePeriod=30
Sep 15 09:34:30.809603 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:30.809566    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p"]
Sep 15 09:34:30.817970 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:30.814062    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p"
Sep 15 09:34:30.828968 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:30.826188    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-d3f5a1-openshift-default-dockercfg-rdbcn\""
Sep 15 09:34:30.844969 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:30.842254    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p"]
Sep 15 09:34:30.959620 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:30.959575    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6182ece-2cc8-42d4-a087-778103d3c1b2-credential-socket\") pod \"e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p\" (UID: \"e6182ece-2cc8-42d4-a087-778103d3c1b2\") " pod="openshift-ingress/e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p"
Sep 15 09:34:30.959989 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:30.959966    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6182ece-2cc8-42d4-a087-778103d3c1b2-workload-socket\") pod \"e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p\" (UID: \"e6182ece-2cc8-42d4-a087-778103d3c1b2\") " pod="openshift-ingress/e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p"
Sep 15 09:34:30.960222 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:30.960205    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6182ece-2cc8-42d4-a087-778103d3c1b2-istio-data\") pod \"e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p\" (UID: \"e6182ece-2cc8-42d4-a087-778103d3c1b2\") " pod="openshift-ingress/e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p"
Sep 15 09:34:30.960382 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:30.960365    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6182ece-2cc8-42d4-a087-778103d3c1b2-istio-podinfo\") pod \"e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p\" (UID: \"e6182ece-2cc8-42d4-a087-778103d3c1b2\") " pod="openshift-ingress/e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p"
Sep 15 09:34:30.960613 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:30.960596    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6182ece-2cc8-42d4-a087-778103d3c1b2-istiod-ca-cert\") pod \"e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p\" (UID: \"e6182ece-2cc8-42d4-a087-778103d3c1b2\") " pod="openshift-ingress/e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p"
Sep 15 09:34:30.960751 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:30.960737    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6182ece-2cc8-42d4-a087-778103d3c1b2-istio-envoy\") pod \"e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p\" (UID: \"e6182ece-2cc8-42d4-a087-778103d3c1b2\") " pod="openshift-ingress/e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p"
Sep 15 09:34:30.961029 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:30.961011    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fprw2\" (UniqueName: \"kubernetes.io/projected/e6182ece-2cc8-42d4-a087-778103d3c1b2-kube-api-access-fprw2\") pod \"e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p\" (UID: \"e6182ece-2cc8-42d4-a087-778103d3c1b2\") " pod="openshift-ingress/e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p"
Sep 15 09:34:30.961184 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:30.961169    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6182ece-2cc8-42d4-a087-778103d3c1b2-istio-token\") pod \"e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p\" (UID: \"e6182ece-2cc8-42d4-a087-778103d3c1b2\") " pod="openshift-ingress/e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p"
Sep 15 09:34:30.961339 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:30.961325    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6182ece-2cc8-42d4-a087-778103d3c1b2-workload-certs\") pod \"e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p\" (UID: \"e6182ece-2cc8-42d4-a087-778103d3c1b2\") " pod="openshift-ingress/e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p"
Sep 15 09:34:30.982173 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:30.982148    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd" event={"ID":"4b9aa140-0520-470a-98d1-3c711a74a0b9","Type":"ContainerStarted","Data":"2e77971a720ed3495f0d6ee76b9bee3d91ad8503b0f2314d55d022af27da9e8e"}
Sep 15 09:34:31.062833 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:31.062737    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6182ece-2cc8-42d4-a087-778103d3c1b2-istio-podinfo\") pod \"e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p\" (UID: \"e6182ece-2cc8-42d4-a087-778103d3c1b2\") " pod="openshift-ingress/e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p"
Sep 15 09:34:31.062833 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:31.062773    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6182ece-2cc8-42d4-a087-778103d3c1b2-istiod-ca-cert\") pod \"e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p\" (UID: \"e6182ece-2cc8-42d4-a087-778103d3c1b2\") " pod="openshift-ingress/e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p"
Sep 15 09:34:31.062833 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:31.062799    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6182ece-2cc8-42d4-a087-778103d3c1b2-istio-envoy\") pod \"e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p\" (UID: \"e6182ece-2cc8-42d4-a087-778103d3c1b2\") " pod="openshift-ingress/e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p"
Sep 15 09:34:31.063151 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:31.062870    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fprw2\" (UniqueName: \"kubernetes.io/projected/e6182ece-2cc8-42d4-a087-778103d3c1b2-kube-api-access-fprw2\") pod \"e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p\" (UID: \"e6182ece-2cc8-42d4-a087-778103d3c1b2\") " pod="openshift-ingress/e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p"
Sep 15 09:34:31.063151 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:31.062901    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6182ece-2cc8-42d4-a087-778103d3c1b2-istio-token\") pod \"e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p\" (UID: \"e6182ece-2cc8-42d4-a087-778103d3c1b2\") " pod="openshift-ingress/e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p"
Sep 15 09:34:31.063151 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:31.062972    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6182ece-2cc8-42d4-a087-778103d3c1b2-workload-certs\") pod \"e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p\" (UID: \"e6182ece-2cc8-42d4-a087-778103d3c1b2\") " pod="openshift-ingress/e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p"
Sep 15 09:34:31.063151 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:31.063024    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6182ece-2cc8-42d4-a087-778103d3c1b2-credential-socket\") pod \"e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p\" (UID: \"e6182ece-2cc8-42d4-a087-778103d3c1b2\") " pod="openshift-ingress/e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p"
Sep 15 09:34:31.063151 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:31.063084    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6182ece-2cc8-42d4-a087-778103d3c1b2-workload-socket\") pod \"e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p\" (UID: \"e6182ece-2cc8-42d4-a087-778103d3c1b2\") " pod="openshift-ingress/e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p"
Sep 15 09:34:31.063151 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:31.063143    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6182ece-2cc8-42d4-a087-778103d3c1b2-istio-data\") pod \"e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p\" (UID: \"e6182ece-2cc8-42d4-a087-778103d3c1b2\") " pod="openshift-ingress/e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p"
Sep 15 09:34:31.063734 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:31.063687    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6182ece-2cc8-42d4-a087-778103d3c1b2-credential-socket\") pod \"e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p\" (UID: \"e6182ece-2cc8-42d4-a087-778103d3c1b2\") " pod="openshift-ingress/e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p"
Sep 15 09:34:31.063876 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:31.063743    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6182ece-2cc8-42d4-a087-778103d3c1b2-workload-socket\") pod \"e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p\" (UID: \"e6182ece-2cc8-42d4-a087-778103d3c1b2\") " pod="openshift-ingress/e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p"
Sep 15 09:34:31.063876 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:31.063810    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6182ece-2cc8-42d4-a087-778103d3c1b2-istiod-ca-cert\") pod \"e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p\" (UID: \"e6182ece-2cc8-42d4-a087-778103d3c1b2\") " pod="openshift-ingress/e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p"
Sep 15 09:34:31.063876 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:31.063816    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6182ece-2cc8-42d4-a087-778103d3c1b2-workload-certs\") pod \"e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p\" (UID: \"e6182ece-2cc8-42d4-a087-778103d3c1b2\") " pod="openshift-ingress/e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p"
Sep 15 09:34:31.064089 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:31.064001    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6182ece-2cc8-42d4-a087-778103d3c1b2-istio-data\") pod \"e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p\" (UID: \"e6182ece-2cc8-42d4-a087-778103d3c1b2\") " pod="openshift-ingress/e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p"
Sep 15 09:34:31.065473 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:31.065455    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6182ece-2cc8-42d4-a087-778103d3c1b2-istio-envoy\") pod \"e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p\" (UID: \"e6182ece-2cc8-42d4-a087-778103d3c1b2\") " pod="openshift-ingress/e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p"
Sep 15 09:34:31.065676 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:31.065656    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6182ece-2cc8-42d4-a087-778103d3c1b2-istio-podinfo\") pod \"e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p\" (UID: \"e6182ece-2cc8-42d4-a087-778103d3c1b2\") " pod="openshift-ingress/e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p"
Sep 15 09:34:31.070316 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:31.070296    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6182ece-2cc8-42d4-a087-778103d3c1b2-istio-token\") pod \"e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p\" (UID: \"e6182ece-2cc8-42d4-a087-778103d3c1b2\") " pod="openshift-ingress/e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p"
Sep 15 09:34:31.070668 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:31.070648    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fprw2\" (UniqueName: \"kubernetes.io/projected/e6182ece-2cc8-42d4-a087-778103d3c1b2-kube-api-access-fprw2\") pod \"e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p\" (UID: \"e6182ece-2cc8-42d4-a087-778103d3c1b2\") " pod="openshift-ingress/e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p"
Sep 15 09:34:31.145203 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:31.145167    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p"
Sep 15 09:34:31.425855 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:31.425018    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p"]
Sep 15 09:34:31.431374 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:31.430785    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:34:31.431374 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:31.430870    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:34:31.431374 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:31.430916    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:34:31.545550 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:31.545520    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd"
Sep 15 09:34:31.545759 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:31.545741    2578 patch_prober.go:28] interesting pod/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Sep 15 09:34:31.545821 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:31.545782    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd" podUID="4b9aa140-0520-470a-98d1-3c711a74a0b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Sep 15 09:34:31.990699 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:31.990652    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p" event={"ID":"e6182ece-2cc8-42d4-a087-778103d3c1b2","Type":"ContainerStarted","Data":"6360c2dbf7ab66f4ba5e914182827aa9234ca1ab5a827dc9d9c17aaa18ace342"}
Sep 15 09:34:31.991079 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:31.990720    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p" event={"ID":"e6182ece-2cc8-42d4-a087-778103d3c1b2","Type":"ContainerStarted","Data":"0fbaf8a40b82075b4cd388b8af1cf23e9d042d2348d3be0f6657eb764976966f"}
Sep 15 09:34:32.012799 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:32.012749    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p" podStartSLOduration=2.012733681 podStartE2EDuration="2.012733681s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:34:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:34:32.010022954 +0000 UTC m=+1216.348468229" watchObservedRunningTime="2026-09-15 09:34:32.012733681 +0000 UTC m=+1216.351178956"
Sep 15 09:34:32.148328 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:32.148293    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p"
Sep 15 09:34:32.149002 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:32.148622    2578 patch_prober.go:28] interesting pod/e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Sep 15 09:34:32.149002 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:32.148721    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p" podUID="e6182ece-2cc8-42d4-a087-778103d3c1b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Sep 15 09:34:32.391046 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:32.390941    2578 patch_prober.go:28] interesting pod/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 15 09:34:32.391046 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:32.391014    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7" podUID="d803ad94-c74b-41e1-95b8-a7db21eed4d5" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 09:34:32.545535 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:32.545500    2578 patch_prober.go:28] interesting pod/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Sep 15 09:34:32.545714 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:32.545571    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd" podUID="4b9aa140-0520-470a-98d1-3c711a74a0b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Sep 15 09:34:33.149920 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:33.149889    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p"
Sep 15 09:34:33.546183 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:33.546146    2578 patch_prober.go:28] interesting pod/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Sep 15 09:34:33.546339 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:33.546210    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd" podUID="4b9aa140-0520-470a-98d1-3c711a74a0b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Sep 15 09:34:34.003263 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:34.003236    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p"
Sep 15 09:34:34.004050 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:34.004030    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p"
Sep 15 09:34:34.546170 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:34.546139    2578 patch_prober.go:28] interesting pod/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Sep 15 09:34:34.546533 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:34.546191    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd" podUID="4b9aa140-0520-470a-98d1-3c711a74a0b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Sep 15 09:34:35.370041 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:35.370015    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7"
Sep 15 09:34:35.511703 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:35.511674    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qwstc\" (UniqueName: \"kubernetes.io/projected/d803ad94-c74b-41e1-95b8-a7db21eed4d5-kube-api-access-qwstc\") pod \"d803ad94-c74b-41e1-95b8-a7db21eed4d5\" (UID: \"d803ad94-c74b-41e1-95b8-a7db21eed4d5\") "
Sep 15 09:34:35.511854 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:35.511733    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d803ad94-c74b-41e1-95b8-a7db21eed4d5-istio-token\") pod \"d803ad94-c74b-41e1-95b8-a7db21eed4d5\" (UID: \"d803ad94-c74b-41e1-95b8-a7db21eed4d5\") "
Sep 15 09:34:35.511854 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:35.511759    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d803ad94-c74b-41e1-95b8-a7db21eed4d5-istio-envoy\") pod \"d803ad94-c74b-41e1-95b8-a7db21eed4d5\" (UID: \"d803ad94-c74b-41e1-95b8-a7db21eed4d5\") "
Sep 15 09:34:35.511854 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:35.511783    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d803ad94-c74b-41e1-95b8-a7db21eed4d5-credential-socket\") pod \"d803ad94-c74b-41e1-95b8-a7db21eed4d5\" (UID: \"d803ad94-c74b-41e1-95b8-a7db21eed4d5\") "
Sep 15 09:34:35.511854 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:35.511803    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d803ad94-c74b-41e1-95b8-a7db21eed4d5-workload-socket\") pod \"d803ad94-c74b-41e1-95b8-a7db21eed4d5\" (UID: \"d803ad94-c74b-41e1-95b8-a7db21eed4d5\") "
Sep 15 09:34:35.511854 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:35.511827    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d803ad94-c74b-41e1-95b8-a7db21eed4d5-istio-data\") pod \"d803ad94-c74b-41e1-95b8-a7db21eed4d5\" (UID: \"d803ad94-c74b-41e1-95b8-a7db21eed4d5\") "
Sep 15 09:34:35.512166 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:35.511890    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d803ad94-c74b-41e1-95b8-a7db21eed4d5-istio-podinfo\") pod \"d803ad94-c74b-41e1-95b8-a7db21eed4d5\" (UID: \"d803ad94-c74b-41e1-95b8-a7db21eed4d5\") "
Sep 15 09:34:35.512166 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:35.511916    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d803ad94-c74b-41e1-95b8-a7db21eed4d5-workload-certs\") pod \"d803ad94-c74b-41e1-95b8-a7db21eed4d5\" (UID: \"d803ad94-c74b-41e1-95b8-a7db21eed4d5\") "
Sep 15 09:34:35.512166 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:35.512027    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d803ad94-c74b-41e1-95b8-a7db21eed4d5-istiod-ca-cert\") pod \"d803ad94-c74b-41e1-95b8-a7db21eed4d5\" (UID: \"d803ad94-c74b-41e1-95b8-a7db21eed4d5\") "
Sep 15 09:34:35.512166 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:35.512141    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d803ad94-c74b-41e1-95b8-a7db21eed4d5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d803ad94-c74b-41e1-95b8-a7db21eed4d5" (UID: "d803ad94-c74b-41e1-95b8-a7db21eed4d5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:34:35.512389 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:35.512165    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d803ad94-c74b-41e1-95b8-a7db21eed4d5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d803ad94-c74b-41e1-95b8-a7db21eed4d5" (UID: "d803ad94-c74b-41e1-95b8-a7db21eed4d5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:34:35.512389 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:35.512211    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d803ad94-c74b-41e1-95b8-a7db21eed4d5-istio-data" (OuterVolumeSpecName: "istio-data") pod "d803ad94-c74b-41e1-95b8-a7db21eed4d5" (UID: "d803ad94-c74b-41e1-95b8-a7db21eed4d5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:34:35.512495 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:35.512405    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d803ad94-c74b-41e1-95b8-a7db21eed4d5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d803ad94-c74b-41e1-95b8-a7db21eed4d5" (UID: "d803ad94-c74b-41e1-95b8-a7db21eed4d5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:34:35.512495 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:35.512464    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d803ad94-c74b-41e1-95b8-a7db21eed4d5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d803ad94-c74b-41e1-95b8-a7db21eed4d5" (UID: "d803ad94-c74b-41e1-95b8-a7db21eed4d5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:34:35.512593 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:35.512495    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d803ad94-c74b-41e1-95b8-a7db21eed4d5-credential-socket\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:34:35.512593 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:35.512514    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d803ad94-c74b-41e1-95b8-a7db21eed4d5-workload-socket\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:34:35.512593 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:35.512530    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d803ad94-c74b-41e1-95b8-a7db21eed4d5-istio-data\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:34:35.512593 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:35.512544    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d803ad94-c74b-41e1-95b8-a7db21eed4d5-workload-certs\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:34:35.523161 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:35.523131    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d803ad94-c74b-41e1-95b8-a7db21eed4d5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d803ad94-c74b-41e1-95b8-a7db21eed4d5" (UID: "d803ad94-c74b-41e1-95b8-a7db21eed4d5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 09:34:35.523303 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:35.523224    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d803ad94-c74b-41e1-95b8-a7db21eed4d5-istio-token" (OuterVolumeSpecName: "istio-token") pod "d803ad94-c74b-41e1-95b8-a7db21eed4d5" (UID: "d803ad94-c74b-41e1-95b8-a7db21eed4d5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:34:35.527127 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:35.523940    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d803ad94-c74b-41e1-95b8-a7db21eed4d5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d803ad94-c74b-41e1-95b8-a7db21eed4d5" (UID: "d803ad94-c74b-41e1-95b8-a7db21eed4d5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:34:35.527127 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:35.524105    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d803ad94-c74b-41e1-95b8-a7db21eed4d5-kube-api-access-qwstc" (OuterVolumeSpecName: "kube-api-access-qwstc") pod "d803ad94-c74b-41e1-95b8-a7db21eed4d5" (UID: "d803ad94-c74b-41e1-95b8-a7db21eed4d5"). InnerVolumeSpecName "kube-api-access-qwstc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:34:35.545627 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:35.545601    2578 patch_prober.go:28] interesting pod/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Sep 15 09:34:35.545730 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:35.545651    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd" podUID="4b9aa140-0520-470a-98d1-3c711a74a0b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Sep 15 09:34:35.613709 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:35.613653    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d803ad94-c74b-41e1-95b8-a7db21eed4d5-istio-podinfo\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:34:35.613709 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:35.613676    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d803ad94-c74b-41e1-95b8-a7db21eed4d5-istiod-ca-cert\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:34:35.613709 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:35.613685    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qwstc\" (UniqueName: \"kubernetes.io/projected/d803ad94-c74b-41e1-95b8-a7db21eed4d5-kube-api-access-qwstc\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:34:35.613709 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:35.613694    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d803ad94-c74b-41e1-95b8-a7db21eed4d5-istio-token\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:34:35.613709 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:35.613702    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d803ad94-c74b-41e1-95b8-a7db21eed4d5-istio-envoy\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:34:36.017273 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:36.017243    2578 generic.go:356] "Generic (PLEG): container finished" podID="d803ad94-c74b-41e1-95b8-a7db21eed4d5" containerID="227e782cd85b5a803c1cbfb1e0abea8a5399843d0b8fb342d29c522318cbe991" exitCode=0
Sep 15 09:34:36.017451 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:36.017299    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7"
Sep 15 09:34:36.017451 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:36.017331    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7" event={"ID":"d803ad94-c74b-41e1-95b8-a7db21eed4d5","Type":"ContainerDied","Data":"227e782cd85b5a803c1cbfb1e0abea8a5399843d0b8fb342d29c522318cbe991"}
Sep 15 09:34:36.017451 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:36.017427    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7" event={"ID":"d803ad94-c74b-41e1-95b8-a7db21eed4d5","Type":"ContainerDied","Data":"aac8c8c148dd464be307b72f512818feb0530d9c2d479d9a12d8bd69614f9ed6"}
Sep 15 09:34:36.017617 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:36.017458    2578 scope.go:117] "RemoveContainer" containerID="227e782cd85b5a803c1cbfb1e0abea8a5399843d0b8fb342d29c522318cbe991"
Sep 15 09:34:36.028096 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:36.028071    2578 scope.go:117] "RemoveContainer" containerID="317227ac113dd19c680d90f413da70f4b5ac0f8298ae4cb405112c1bccde4cfc"
Sep 15 09:34:36.038119 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:36.038095    2578 scope.go:117] "RemoveContainer" containerID="227e782cd85b5a803c1cbfb1e0abea8a5399843d0b8fb342d29c522318cbe991"
Sep 15 09:34:36.038414 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:34:36.038389    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"227e782cd85b5a803c1cbfb1e0abea8a5399843d0b8fb342d29c522318cbe991\": container with ID starting with 227e782cd85b5a803c1cbfb1e0abea8a5399843d0b8fb342d29c522318cbe991 not found: ID does not exist" containerID="227e782cd85b5a803c1cbfb1e0abea8a5399843d0b8fb342d29c522318cbe991"
Sep 15 09:34:36.038490 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:36.038426    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"227e782cd85b5a803c1cbfb1e0abea8a5399843d0b8fb342d29c522318cbe991"} err="failed to get container status \"227e782cd85b5a803c1cbfb1e0abea8a5399843d0b8fb342d29c522318cbe991\": rpc error: code = NotFound desc = could not find container \"227e782cd85b5a803c1cbfb1e0abea8a5399843d0b8fb342d29c522318cbe991\": container with ID starting with 227e782cd85b5a803c1cbfb1e0abea8a5399843d0b8fb342d29c522318cbe991 not found: ID does not exist"
Sep 15 09:34:36.038490 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:36.038448    2578 scope.go:117] "RemoveContainer" containerID="317227ac113dd19c680d90f413da70f4b5ac0f8298ae4cb405112c1bccde4cfc"
Sep 15 09:34:36.038757 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:34:36.038736    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"317227ac113dd19c680d90f413da70f4b5ac0f8298ae4cb405112c1bccde4cfc\": container with ID starting with 317227ac113dd19c680d90f413da70f4b5ac0f8298ae4cb405112c1bccde4cfc not found: ID does not exist" containerID="317227ac113dd19c680d90f413da70f4b5ac0f8298ae4cb405112c1bccde4cfc"
Sep 15 09:34:36.038862 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:36.038760    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"317227ac113dd19c680d90f413da70f4b5ac0f8298ae4cb405112c1bccde4cfc"} err="failed to get container status \"317227ac113dd19c680d90f413da70f4b5ac0f8298ae4cb405112c1bccde4cfc\": rpc error: code = NotFound desc = could not find container \"317227ac113dd19c680d90f413da70f4b5ac0f8298ae4cb405112c1bccde4cfc\": container with ID starting with 317227ac113dd19c680d90f413da70f4b5ac0f8298ae4cb405112c1bccde4cfc not found: ID does not exist"
Sep 15 09:34:36.040813 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:36.040795    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7"]
Sep 15 09:34:36.045452 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:36.045433    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-5b654a-openshift-default-7d9bf59bbd-p6rv7"]
Sep 15 09:34:36.123056 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:36.123034    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d803ad94-c74b-41e1-95b8-a7db21eed4d5" path="/var/lib/kubelet/pods/d803ad94-c74b-41e1-95b8-a7db21eed4d5/volumes"
Sep 15 09:34:36.549538 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:36.549510    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd"
Sep 15 09:34:36.549810 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:36.549792    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd"
Sep 15 09:34:36.550432 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:36.550416    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd"
Sep 15 09:34:39.772827 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:39.772795    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx"]
Sep 15 09:34:39.773409 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:39.773393    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d803ad94-c74b-41e1-95b8-a7db21eed4d5" containerName="istio-proxy"
Sep 15 09:34:39.773463 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:39.773412    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d803ad94-c74b-41e1-95b8-a7db21eed4d5" containerName="istio-proxy"
Sep 15 09:34:39.773544 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:39.773532    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d803ad94-c74b-41e1-95b8-a7db21eed4d5" containerName="istio-proxy"
Sep 15 09:34:39.778600 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:39.778576    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx"
Sep 15 09:34:39.782232 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:39.782213    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-312334ca-openshift-default-dockercfg-tldnr\""
Sep 15 09:34:39.788220 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:39.788166    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx"]
Sep 15 09:34:39.957364 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:39.957326    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/701f4de4-2cc6-42f4-bc3d-12f8e355b3dd-workload-socket\") pod \"e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx\" (UID: \"701f4de4-2cc6-42f4-bc3d-12f8e355b3dd\") " pod="openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx"
Sep 15 09:34:39.957578 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:39.957376    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/701f4de4-2cc6-42f4-bc3d-12f8e355b3dd-istio-data\") pod \"e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx\" (UID: \"701f4de4-2cc6-42f4-bc3d-12f8e355b3dd\") " pod="openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx"
Sep 15 09:34:39.957578 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:39.957507    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/701f4de4-2cc6-42f4-bc3d-12f8e355b3dd-istio-token\") pod \"e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx\" (UID: \"701f4de4-2cc6-42f4-bc3d-12f8e355b3dd\") " pod="openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx"
Sep 15 09:34:39.957578 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:39.957558    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/701f4de4-2cc6-42f4-bc3d-12f8e355b3dd-workload-certs\") pod \"e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx\" (UID: \"701f4de4-2cc6-42f4-bc3d-12f8e355b3dd\") " pod="openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx"
Sep 15 09:34:39.957717 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:39.957644    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/701f4de4-2cc6-42f4-bc3d-12f8e355b3dd-istiod-ca-cert\") pod \"e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx\" (UID: \"701f4de4-2cc6-42f4-bc3d-12f8e355b3dd\") " pod="openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx"
Sep 15 09:34:39.957717 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:39.957700    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/701f4de4-2cc6-42f4-bc3d-12f8e355b3dd-istio-podinfo\") pod \"e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx\" (UID: \"701f4de4-2cc6-42f4-bc3d-12f8e355b3dd\") " pod="openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx"
Sep 15 09:34:39.957807 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:39.957740    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/701f4de4-2cc6-42f4-bc3d-12f8e355b3dd-credential-socket\") pod \"e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx\" (UID: \"701f4de4-2cc6-42f4-bc3d-12f8e355b3dd\") " pod="openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx"
Sep 15 09:34:39.957807 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:39.957762    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/701f4de4-2cc6-42f4-bc3d-12f8e355b3dd-istio-envoy\") pod \"e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx\" (UID: \"701f4de4-2cc6-42f4-bc3d-12f8e355b3dd\") " pod="openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx"
Sep 15 09:34:39.957807 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:39.957777    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6s7n\" (UniqueName: \"kubernetes.io/projected/701f4de4-2cc6-42f4-bc3d-12f8e355b3dd-kube-api-access-p6s7n\") pod \"e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx\" (UID: \"701f4de4-2cc6-42f4-bc3d-12f8e355b3dd\") " pod="openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx"
Sep 15 09:34:40.058455 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:40.058379    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/701f4de4-2cc6-42f4-bc3d-12f8e355b3dd-credential-socket\") pod \"e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx\" (UID: \"701f4de4-2cc6-42f4-bc3d-12f8e355b3dd\") " pod="openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx"
Sep 15 09:34:40.058455 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:40.058412    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/701f4de4-2cc6-42f4-bc3d-12f8e355b3dd-istio-envoy\") pod \"e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx\" (UID: \"701f4de4-2cc6-42f4-bc3d-12f8e355b3dd\") " pod="openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx"
Sep 15 09:34:40.058455 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:40.058428    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6s7n\" (UniqueName: \"kubernetes.io/projected/701f4de4-2cc6-42f4-bc3d-12f8e355b3dd-kube-api-access-p6s7n\") pod \"e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx\" (UID: \"701f4de4-2cc6-42f4-bc3d-12f8e355b3dd\") " pod="openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx"
Sep 15 09:34:40.058455 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:40.058454    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/701f4de4-2cc6-42f4-bc3d-12f8e355b3dd-workload-socket\") pod \"e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx\" (UID: \"701f4de4-2cc6-42f4-bc3d-12f8e355b3dd\") " pod="openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx"
Sep 15 09:34:40.058753 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:40.058482    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/701f4de4-2cc6-42f4-bc3d-12f8e355b3dd-istio-data\") pod \"e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx\" (UID: \"701f4de4-2cc6-42f4-bc3d-12f8e355b3dd\") " pod="openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx"
Sep 15 09:34:40.058753 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:40.058524    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/701f4de4-2cc6-42f4-bc3d-12f8e355b3dd-istio-token\") pod \"e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx\" (UID: \"701f4de4-2cc6-42f4-bc3d-12f8e355b3dd\") " pod="openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx"
Sep 15 09:34:40.058753 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:40.058560    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/701f4de4-2cc6-42f4-bc3d-12f8e355b3dd-workload-certs\") pod \"e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx\" (UID: \"701f4de4-2cc6-42f4-bc3d-12f8e355b3dd\") " pod="openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx"
Sep 15 09:34:40.058753 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:40.058612    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/701f4de4-2cc6-42f4-bc3d-12f8e355b3dd-istiod-ca-cert\") pod \"e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx\" (UID: \"701f4de4-2cc6-42f4-bc3d-12f8e355b3dd\") " pod="openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx"
Sep 15 09:34:40.058753 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:40.058662    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/701f4de4-2cc6-42f4-bc3d-12f8e355b3dd-istio-podinfo\") pod \"e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx\" (UID: \"701f4de4-2cc6-42f4-bc3d-12f8e355b3dd\") " pod="openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx"
Sep 15 09:34:40.059010 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:40.058869    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/701f4de4-2cc6-42f4-bc3d-12f8e355b3dd-credential-socket\") pod \"e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx\" (UID: \"701f4de4-2cc6-42f4-bc3d-12f8e355b3dd\") " pod="openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx"
Sep 15 09:34:40.059010 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:40.058935    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/701f4de4-2cc6-42f4-bc3d-12f8e355b3dd-istio-data\") pod \"e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx\" (UID: \"701f4de4-2cc6-42f4-bc3d-12f8e355b3dd\") " pod="openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx"
Sep 15 09:34:40.059094 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:40.059076    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/701f4de4-2cc6-42f4-bc3d-12f8e355b3dd-workload-socket\") pod \"e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx\" (UID: \"701f4de4-2cc6-42f4-bc3d-12f8e355b3dd\") " pod="openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx"
Sep 15 09:34:40.059289 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:40.059270    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/701f4de4-2cc6-42f4-bc3d-12f8e355b3dd-workload-certs\") pod \"e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx\" (UID: \"701f4de4-2cc6-42f4-bc3d-12f8e355b3dd\") " pod="openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx"
Sep 15 09:34:40.059464 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:40.059447    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/701f4de4-2cc6-42f4-bc3d-12f8e355b3dd-istiod-ca-cert\") pod \"e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx\" (UID: \"701f4de4-2cc6-42f4-bc3d-12f8e355b3dd\") " pod="openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx"
Sep 15 09:34:40.060716 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:40.060692    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/701f4de4-2cc6-42f4-bc3d-12f8e355b3dd-istio-envoy\") pod \"e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx\" (UID: \"701f4de4-2cc6-42f4-bc3d-12f8e355b3dd\") " pod="openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx"
Sep 15 09:34:40.061318 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:40.061298    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/701f4de4-2cc6-42f4-bc3d-12f8e355b3dd-istio-podinfo\") pod \"e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx\" (UID: \"701f4de4-2cc6-42f4-bc3d-12f8e355b3dd\") " pod="openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx"
Sep 15 09:34:40.066599 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:40.066578    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/701f4de4-2cc6-42f4-bc3d-12f8e355b3dd-istio-token\") pod \"e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx\" (UID: \"701f4de4-2cc6-42f4-bc3d-12f8e355b3dd\") " pod="openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx"
Sep 15 09:34:40.066705 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:40.066684    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6s7n\" (UniqueName: \"kubernetes.io/projected/701f4de4-2cc6-42f4-bc3d-12f8e355b3dd-kube-api-access-p6s7n\") pod \"e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx\" (UID: \"701f4de4-2cc6-42f4-bc3d-12f8e355b3dd\") " pod="openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx"
Sep 15 09:34:40.090272 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:40.090241    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx"
Sep 15 09:34:40.373578 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:40.373556    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx"]
Sep 15 09:34:40.374548 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:34:40.374521    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod701f4de4_2cc6_42f4_bc3d_12f8e355b3dd.slice/crio-89299285c28b1d891c23cfa388c0c44afea3fed0ced08c0378743c2101938c52 WatchSource:0}: Error finding container 89299285c28b1d891c23cfa388c0c44afea3fed0ced08c0378743c2101938c52: Status 404 returned error can't find the container with id 89299285c28b1d891c23cfa388c0c44afea3fed0ced08c0378743c2101938c52
Sep 15 09:34:40.377552 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:40.377514    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:34:40.377628 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:40.377594    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:34:40.377669 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:40.377632    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:34:41.058545 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:41.058508    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx" event={"ID":"701f4de4-2cc6-42f4-bc3d-12f8e355b3dd","Type":"ContainerStarted","Data":"07f2c0e5adf627723636ea9234625f1dd350a9143d93320f13da11d769055536"}
Sep 15 09:34:41.059043 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:41.058570    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx" event={"ID":"701f4de4-2cc6-42f4-bc3d-12f8e355b3dd","Type":"ContainerStarted","Data":"89299285c28b1d891c23cfa388c0c44afea3fed0ced08c0378743c2101938c52"}
Sep 15 09:34:41.078157 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:41.078114    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx" podStartSLOduration=2.07809916 podStartE2EDuration="2.07809916s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:34:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:34:41.075706297 +0000 UTC m=+1225.414151572" watchObservedRunningTime="2026-09-15 09:34:41.07809916 +0000 UTC m=+1225.416544434"
Sep 15 09:34:41.090571 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:41.090544    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx"
Sep 15 09:34:41.095917 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:41.095898    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx"
Sep 15 09:34:42.065409 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:42.065382    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx"
Sep 15 09:34:42.066343 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:42.066324    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx"
Sep 15 09:34:48.057296 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:48.057266    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-312334ca-8488695b5-mgctt"]
Sep 15 09:34:48.057698 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:48.057684    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d803ad94-c74b-41e1-95b8-a7db21eed4d5" containerName="istio-proxy"
Sep 15 09:34:48.057753 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:48.057699    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d803ad94-c74b-41e1-95b8-a7db21eed4d5" containerName="istio-proxy"
Sep 15 09:34:48.057790 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:48.057781    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d803ad94-c74b-41e1-95b8-a7db21eed4d5" containerName="istio-proxy"
Sep 15 09:34:48.060864 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:48.060849    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-312334ca-8488695b5-mgctt"
Sep 15 09:34:48.063229 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:48.063208    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-312334ca-dockercfg-p6pl5\""
Sep 15 09:34:48.063338 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:48.063284    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-312334ca\""
Sep 15 09:34:48.070325 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:48.070301    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-312334ca-8488695b5-mgctt"]
Sep 15 09:34:48.244367 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:48.244331    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2b2kg\" (UniqueName: \"kubernetes.io/projected/14ee8f8e-a828-4be9-8267-80cd83f1a74b-kube-api-access-2b2kg\") pod \"payload-processing-e2e-mt-312334ca-8488695b5-mgctt\" (UID: \"14ee8f8e-a828-4be9-8267-80cd83f1a74b\") " pod="openshift-ingress/payload-processing-e2e-mt-312334ca-8488695b5-mgctt"
Sep 15 09:34:48.244567 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:48.244488    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14ee8f8e-a828-4be9-8267-80cd83f1a74b-plugins-config-volume\") pod \"payload-processing-e2e-mt-312334ca-8488695b5-mgctt\" (UID: \"14ee8f8e-a828-4be9-8267-80cd83f1a74b\") " pod="openshift-ingress/payload-processing-e2e-mt-312334ca-8488695b5-mgctt"
Sep 15 09:34:48.345805 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:48.345733    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2b2kg\" (UniqueName: \"kubernetes.io/projected/14ee8f8e-a828-4be9-8267-80cd83f1a74b-kube-api-access-2b2kg\") pod \"payload-processing-e2e-mt-312334ca-8488695b5-mgctt\" (UID: \"14ee8f8e-a828-4be9-8267-80cd83f1a74b\") " pod="openshift-ingress/payload-processing-e2e-mt-312334ca-8488695b5-mgctt"
Sep 15 09:34:48.345935 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:48.345820    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14ee8f8e-a828-4be9-8267-80cd83f1a74b-plugins-config-volume\") pod \"payload-processing-e2e-mt-312334ca-8488695b5-mgctt\" (UID: \"14ee8f8e-a828-4be9-8267-80cd83f1a74b\") " pod="openshift-ingress/payload-processing-e2e-mt-312334ca-8488695b5-mgctt"
Sep 15 09:34:48.346512 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:48.346494    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14ee8f8e-a828-4be9-8267-80cd83f1a74b-plugins-config-volume\") pod \"payload-processing-e2e-mt-312334ca-8488695b5-mgctt\" (UID: \"14ee8f8e-a828-4be9-8267-80cd83f1a74b\") " pod="openshift-ingress/payload-processing-e2e-mt-312334ca-8488695b5-mgctt"
Sep 15 09:34:48.353687 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:48.353664    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2b2kg\" (UniqueName: \"kubernetes.io/projected/14ee8f8e-a828-4be9-8267-80cd83f1a74b-kube-api-access-2b2kg\") pod \"payload-processing-e2e-mt-312334ca-8488695b5-mgctt\" (UID: \"14ee8f8e-a828-4be9-8267-80cd83f1a74b\") " pod="openshift-ingress/payload-processing-e2e-mt-312334ca-8488695b5-mgctt"
Sep 15 09:34:48.373353 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:48.373333    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-312334ca-8488695b5-mgctt"
Sep 15 09:34:48.643353 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:48.643329    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-312334ca-8488695b5-mgctt"]
Sep 15 09:34:48.644356 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:34:48.644327    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14ee8f8e_a828_4be9_8267_80cd83f1a74b.slice/crio-3744b96b5a743b7f0c22018704bbea83531949192ff35e900fc952baece07538 WatchSource:0}: Error finding container 3744b96b5a743b7f0c22018704bbea83531949192ff35e900fc952baece07538: Status 404 returned error can't find the container with id 3744b96b5a743b7f0c22018704bbea83531949192ff35e900fc952baece07538
Sep 15 09:34:49.115169 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:49.115137    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-312334ca-8488695b5-mgctt" event={"ID":"14ee8f8e-a828-4be9-8267-80cd83f1a74b","Type":"ContainerStarted","Data":"291d8ddffdfe804f0facfc011681e4ce3b866178e0bfd56c7634f0571acaff42"}
Sep 15 09:34:49.115579 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:49.115183    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-312334ca-8488695b5-mgctt" event={"ID":"14ee8f8e-a828-4be9-8267-80cd83f1a74b","Type":"ContainerStarted","Data":"3744b96b5a743b7f0c22018704bbea83531949192ff35e900fc952baece07538"}
Sep 15 09:34:49.115579 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:49.115323    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-312334ca-8488695b5-mgctt"
Sep 15 09:34:49.132724 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:34:49.132682    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-312334ca-8488695b5-mgctt" podStartSLOduration=1.132669095 podStartE2EDuration="1.132669095s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:34:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:34:49.13041499 +0000 UTC m=+1233.468860265" watchObservedRunningTime="2026-09-15 09:34:49.132669095 +0000 UTC m=+1233.471114369"
Sep 15 09:35:00.148812 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:00.148780    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-312334ca-8488695b5-mgctt"
Sep 15 09:35:07.233589 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:07.233558    2578 generic.go:356] "Generic (PLEG): container finished" podID="701f4de4-2cc6-42f4-bc3d-12f8e355b3dd" containerID="07f2c0e5adf627723636ea9234625f1dd350a9143d93320f13da11d769055536" exitCode=0
Sep 15 09:35:07.234077 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:07.233632    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx" event={"ID":"701f4de4-2cc6-42f4-bc3d-12f8e355b3dd","Type":"ContainerDied","Data":"07f2c0e5adf627723636ea9234625f1dd350a9143d93320f13da11d769055536"}
Sep 15 09:35:07.234077 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:07.234042    2578 scope.go:117] "RemoveContainer" containerID="07f2c0e5adf627723636ea9234625f1dd350a9143d93320f13da11d769055536"
Sep 15 09:35:07.235201 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:07.235167    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:35:07.235281 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:07.235253    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:35:07.235320 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:07.235292    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:35:08.244225 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:08.244192    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx" event={"ID":"701f4de4-2cc6-42f4-bc3d-12f8e355b3dd","Type":"ContainerStarted","Data":"c19b8bb1645485a2a3ee6f6e940ac8472afb70f8c43e55759c9bd03a532cc2c1"}
Sep 15 09:35:09.090603 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:09.090563    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx"
Sep 15 09:35:09.091810 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:09.091785    2578 patch_prober.go:28] interesting pod/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Sep 15 09:35:09.091917 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:09.091843    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx" podUID="701f4de4-2cc6-42f4-bc3d-12f8e355b3dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Sep 15 09:35:10.090646 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:10.090611    2578 patch_prober.go:28] interesting pod/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Sep 15 09:35:10.091053 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:10.090662    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx" podUID="701f4de4-2cc6-42f4-bc3d-12f8e355b3dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Sep 15 09:35:11.090728 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:11.090688    2578 patch_prober.go:28] interesting pod/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Sep 15 09:35:11.091154 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:11.090756    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx" podUID="701f4de4-2cc6-42f4-bc3d-12f8e355b3dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Sep 15 09:35:12.065437 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:12.065406    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx"
Sep 15 09:35:12.090851 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:12.090824    2578 patch_prober.go:28] interesting pod/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Sep 15 09:35:12.091208 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:12.090874    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx" podUID="701f4de4-2cc6-42f4-bc3d-12f8e355b3dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Sep 15 09:35:13.091026 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:13.090992    2578 patch_prober.go:28] interesting pod/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Sep 15 09:35:13.091404 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:13.091052    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx" podUID="701f4de4-2cc6-42f4-bc3d-12f8e355b3dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Sep 15 09:35:14.094797 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:14.094769    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx"
Sep 15 09:35:14.095680 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:14.095662    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx"
Sep 15 09:35:16.245118 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:16.245090    2578 scope.go:117] "RemoveContainer" containerID="e01102f708f9293b58ec0b65aecc1bffde8e1217f153003885d5313dae48d3c0"
Sep 15 09:35:16.253477 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:16.253458    2578 scope.go:117] "RemoveContainer" containerID="885686c22a35d39c4ca498bc0fc20232b02ac7aa75d866ac3f1851ab11505457"
Sep 15 09:35:27.480117 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:27.480064    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-noten-d3f5a1/noten-model-d3f5a1-kserve-54d746846c-jsbvf"]
Sep 15 09:35:27.484200 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:27.484176    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-d3f5a1/noten-model-d3f5a1-kserve-54d746846c-jsbvf"
Sep 15 09:35:27.487617 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:27.487568    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-d3f5a1\"/\"kube-root-ca.crt\""
Sep 15 09:35:27.487617 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:27.487593    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-d3f5a1\"/\"noten-model-d3f5a1-kserve-self-signed-certs\""
Sep 15 09:35:27.487859 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:27.487635    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-d3f5a1\"/\"default-dockercfg-n89mn\""
Sep 15 09:35:27.487859 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:27.487674    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-d3f5a1\"/\"openshift-service-ca.crt\""
Sep 15 09:35:27.493586 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:27.493563    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-d3f5a1/noten-model-d3f5a1-kserve-54d746846c-jsbvf"]
Sep 15 09:35:27.541215 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:27.541176    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2cef53c8-5c3d-4c0a-846c-f71f133f2c33-model-cache\") pod \"noten-model-d3f5a1-kserve-54d746846c-jsbvf\" (UID: \"2cef53c8-5c3d-4c0a-846c-f71f133f2c33\") " pod="ai-tenant-e2e-noten-d3f5a1/noten-model-d3f5a1-kserve-54d746846c-jsbvf"
Sep 15 09:35:27.541215 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:27.541215    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2cef53c8-5c3d-4c0a-846c-f71f133f2c33-tls-certs\") pod \"noten-model-d3f5a1-kserve-54d746846c-jsbvf\" (UID: \"2cef53c8-5c3d-4c0a-846c-f71f133f2c33\") " pod="ai-tenant-e2e-noten-d3f5a1/noten-model-d3f5a1-kserve-54d746846c-jsbvf"
Sep 15 09:35:27.541440 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:27.541236    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9nnr\" (UniqueName: \"kubernetes.io/projected/2cef53c8-5c3d-4c0a-846c-f71f133f2c33-kube-api-access-t9nnr\") pod \"noten-model-d3f5a1-kserve-54d746846c-jsbvf\" (UID: \"2cef53c8-5c3d-4c0a-846c-f71f133f2c33\") " pod="ai-tenant-e2e-noten-d3f5a1/noten-model-d3f5a1-kserve-54d746846c-jsbvf"
Sep 15 09:35:27.541440 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:27.541287    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2cef53c8-5c3d-4c0a-846c-f71f133f2c33-dshm\") pod \"noten-model-d3f5a1-kserve-54d746846c-jsbvf\" (UID: \"2cef53c8-5c3d-4c0a-846c-f71f133f2c33\") " pod="ai-tenant-e2e-noten-d3f5a1/noten-model-d3f5a1-kserve-54d746846c-jsbvf"
Sep 15 09:35:27.541440 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:27.541409    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2cef53c8-5c3d-4c0a-846c-f71f133f2c33-tmp-dir\") pod \"noten-model-d3f5a1-kserve-54d746846c-jsbvf\" (UID: \"2cef53c8-5c3d-4c0a-846c-f71f133f2c33\") " pod="ai-tenant-e2e-noten-d3f5a1/noten-model-d3f5a1-kserve-54d746846c-jsbvf"
Sep 15 09:35:27.541440 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:27.541428    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2cef53c8-5c3d-4c0a-846c-f71f133f2c33-home\") pod \"noten-model-d3f5a1-kserve-54d746846c-jsbvf\" (UID: \"2cef53c8-5c3d-4c0a-846c-f71f133f2c33\") " pod="ai-tenant-e2e-noten-d3f5a1/noten-model-d3f5a1-kserve-54d746846c-jsbvf"
Sep 15 09:35:27.642293 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:27.642255    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2cef53c8-5c3d-4c0a-846c-f71f133f2c33-tmp-dir\") pod \"noten-model-d3f5a1-kserve-54d746846c-jsbvf\" (UID: \"2cef53c8-5c3d-4c0a-846c-f71f133f2c33\") " pod="ai-tenant-e2e-noten-d3f5a1/noten-model-d3f5a1-kserve-54d746846c-jsbvf"
Sep 15 09:35:27.642293 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:27.642289    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2cef53c8-5c3d-4c0a-846c-f71f133f2c33-home\") pod \"noten-model-d3f5a1-kserve-54d746846c-jsbvf\" (UID: \"2cef53c8-5c3d-4c0a-846c-f71f133f2c33\") " pod="ai-tenant-e2e-noten-d3f5a1/noten-model-d3f5a1-kserve-54d746846c-jsbvf"
Sep 15 09:35:27.642551 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:27.642311    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2cef53c8-5c3d-4c0a-846c-f71f133f2c33-model-cache\") pod \"noten-model-d3f5a1-kserve-54d746846c-jsbvf\" (UID: \"2cef53c8-5c3d-4c0a-846c-f71f133f2c33\") " pod="ai-tenant-e2e-noten-d3f5a1/noten-model-d3f5a1-kserve-54d746846c-jsbvf"
Sep 15 09:35:27.642551 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:27.642326    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2cef53c8-5c3d-4c0a-846c-f71f133f2c33-tls-certs\") pod \"noten-model-d3f5a1-kserve-54d746846c-jsbvf\" (UID: \"2cef53c8-5c3d-4c0a-846c-f71f133f2c33\") " pod="ai-tenant-e2e-noten-d3f5a1/noten-model-d3f5a1-kserve-54d746846c-jsbvf"
Sep 15 09:35:27.642551 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:27.642516    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9nnr\" (UniqueName: \"kubernetes.io/projected/2cef53c8-5c3d-4c0a-846c-f71f133f2c33-kube-api-access-t9nnr\") pod \"noten-model-d3f5a1-kserve-54d746846c-jsbvf\" (UID: \"2cef53c8-5c3d-4c0a-846c-f71f133f2c33\") " pod="ai-tenant-e2e-noten-d3f5a1/noten-model-d3f5a1-kserve-54d746846c-jsbvf"
Sep 15 09:35:27.642706 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:27.642567    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2cef53c8-5c3d-4c0a-846c-f71f133f2c33-dshm\") pod \"noten-model-d3f5a1-kserve-54d746846c-jsbvf\" (UID: \"2cef53c8-5c3d-4c0a-846c-f71f133f2c33\") " pod="ai-tenant-e2e-noten-d3f5a1/noten-model-d3f5a1-kserve-54d746846c-jsbvf"
Sep 15 09:35:27.642768 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:27.642713    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2cef53c8-5c3d-4c0a-846c-f71f133f2c33-model-cache\") pod \"noten-model-d3f5a1-kserve-54d746846c-jsbvf\" (UID: \"2cef53c8-5c3d-4c0a-846c-f71f133f2c33\") " pod="ai-tenant-e2e-noten-d3f5a1/noten-model-d3f5a1-kserve-54d746846c-jsbvf"
Sep 15 09:35:27.642768 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:27.642734    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2cef53c8-5c3d-4c0a-846c-f71f133f2c33-home\") pod \"noten-model-d3f5a1-kserve-54d746846c-jsbvf\" (UID: \"2cef53c8-5c3d-4c0a-846c-f71f133f2c33\") " pod="ai-tenant-e2e-noten-d3f5a1/noten-model-d3f5a1-kserve-54d746846c-jsbvf"
Sep 15 09:35:27.642856 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:27.642775    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2cef53c8-5c3d-4c0a-846c-f71f133f2c33-tmp-dir\") pod \"noten-model-d3f5a1-kserve-54d746846c-jsbvf\" (UID: \"2cef53c8-5c3d-4c0a-846c-f71f133f2c33\") " pod="ai-tenant-e2e-noten-d3f5a1/noten-model-d3f5a1-kserve-54d746846c-jsbvf"
Sep 15 09:35:27.644721 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:27.644690    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2cef53c8-5c3d-4c0a-846c-f71f133f2c33-dshm\") pod \"noten-model-d3f5a1-kserve-54d746846c-jsbvf\" (UID: \"2cef53c8-5c3d-4c0a-846c-f71f133f2c33\") " pod="ai-tenant-e2e-noten-d3f5a1/noten-model-d3f5a1-kserve-54d746846c-jsbvf"
Sep 15 09:35:27.644941 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:27.644925    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2cef53c8-5c3d-4c0a-846c-f71f133f2c33-tls-certs\") pod \"noten-model-d3f5a1-kserve-54d746846c-jsbvf\" (UID: \"2cef53c8-5c3d-4c0a-846c-f71f133f2c33\") " pod="ai-tenant-e2e-noten-d3f5a1/noten-model-d3f5a1-kserve-54d746846c-jsbvf"
Sep 15 09:35:27.650239 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:27.650215    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9nnr\" (UniqueName: \"kubernetes.io/projected/2cef53c8-5c3d-4c0a-846c-f71f133f2c33-kube-api-access-t9nnr\") pod \"noten-model-d3f5a1-kserve-54d746846c-jsbvf\" (UID: \"2cef53c8-5c3d-4c0a-846c-f71f133f2c33\") " pod="ai-tenant-e2e-noten-d3f5a1/noten-model-d3f5a1-kserve-54d746846c-jsbvf"
Sep 15 09:35:27.795293 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:27.795196    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-d3f5a1/noten-model-d3f5a1-kserve-54d746846c-jsbvf"
Sep 15 09:35:28.069931 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:28.069907    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-d3f5a1/noten-model-d3f5a1-kserve-54d746846c-jsbvf"]
Sep 15 09:35:28.071451 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:35:28.071424    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2cef53c8_5c3d_4c0a_846c_f71f133f2c33.slice/crio-37078c35c0730564429af325d82284bbd08c2fada5afb7eb03c7110988fbb0c5 WatchSource:0}: Error finding container 37078c35c0730564429af325d82284bbd08c2fada5afb7eb03c7110988fbb0c5: Status 404 returned error can't find the container with id 37078c35c0730564429af325d82284bbd08c2fada5afb7eb03c7110988fbb0c5
Sep 15 09:35:28.372995 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:28.372889    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-d3f5a1/noten-model-d3f5a1-kserve-54d746846c-jsbvf" event={"ID":"2cef53c8-5c3d-4c0a-846c-f71f133f2c33","Type":"ContainerStarted","Data":"1781036d4edad55f45ba66e8635c2a2eed27799a14083fc674b478741ebf5995"}
Sep 15 09:35:28.372995 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:28.372932    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-d3f5a1/noten-model-d3f5a1-kserve-54d746846c-jsbvf" event={"ID":"2cef53c8-5c3d-4c0a-846c-f71f133f2c33","Type":"ContainerStarted","Data":"37078c35c0730564429af325d82284bbd08c2fada5afb7eb03c7110988fbb0c5"}
Sep 15 09:35:28.388067 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:28.388021    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-noten-d3f5a1/noten-model-d3f5a1-kserve-54d746846c-jsbvf" podStartSLOduration=1.388005779 podStartE2EDuration="1.388005779s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:35:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:35:28.387940532 +0000 UTC m=+1272.726385809" watchObservedRunningTime="2026-09-15 09:35:28.388005779 +0000 UTC m=+1272.726451055"
Sep 15 09:35:37.795753 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:37.795711    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-noten-d3f5a1/noten-model-d3f5a1-kserve-54d746846c-jsbvf"
Sep 15 09:35:37.796297 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:37.795776    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-noten-d3f5a1/noten-model-d3f5a1-kserve-54d746846c-jsbvf"
Sep 15 09:35:37.808496 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:37.808471    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-noten-d3f5a1/noten-model-d3f5a1-kserve-54d746846c-jsbvf"
Sep 15 09:35:38.447564 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:38.447537    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-noten-d3f5a1/noten-model-d3f5a1-kserve-54d746846c-jsbvf"
Sep 15 09:35:42.320263 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:42.320230    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-7a31d6/test-model-7a31d6-kserve-786dfdddf-wwshg"]
Sep 15 09:35:57.341860 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:57.341803    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-7a31d6/test-model-7a31d6-kserve-786dfdddf-wwshg" podUID="b1c4b5f9-65b4-4994-b518-b0741439d9fc" containerName="main" containerID="cri-o://e0dada56ea1647e258a52b8f0dff6ef914fad59c4df0ea2236e48178f608d0fa" gracePeriod=45
Sep 15 09:35:57.560919 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:57.560888    2578 generic.go:356] "Generic (PLEG): container finished" podID="b1c4b5f9-65b4-4994-b518-b0741439d9fc" containerID="e0dada56ea1647e258a52b8f0dff6ef914fad59c4df0ea2236e48178f608d0fa" exitCode=0
Sep 15 09:35:57.561064 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:57.560964    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-7a31d6/test-model-7a31d6-kserve-786dfdddf-wwshg" event={"ID":"b1c4b5f9-65b4-4994-b518-b0741439d9fc","Type":"ContainerDied","Data":"e0dada56ea1647e258a52b8f0dff6ef914fad59c4df0ea2236e48178f608d0fa"}
Sep 15 09:35:57.588116 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:57.588096    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-7a31d6/test-model-7a31d6-kserve-786dfdddf-wwshg"
Sep 15 09:35:57.731779 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:57.731756    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w8rrz\" (UniqueName: \"kubernetes.io/projected/b1c4b5f9-65b4-4994-b518-b0741439d9fc-kube-api-access-w8rrz\") pod \"b1c4b5f9-65b4-4994-b518-b0741439d9fc\" (UID: \"b1c4b5f9-65b4-4994-b518-b0741439d9fc\") "
Sep 15 09:35:57.731906 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:57.731831    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1c4b5f9-65b4-4994-b518-b0741439d9fc-model-cache\") pod \"b1c4b5f9-65b4-4994-b518-b0741439d9fc\" (UID: \"b1c4b5f9-65b4-4994-b518-b0741439d9fc\") "
Sep 15 09:35:57.732004 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:57.731984    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1c4b5f9-65b4-4994-b518-b0741439d9fc-home\") pod \"b1c4b5f9-65b4-4994-b518-b0741439d9fc\" (UID: \"b1c4b5f9-65b4-4994-b518-b0741439d9fc\") "
Sep 15 09:35:57.732057 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:57.732042    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1c4b5f9-65b4-4994-b518-b0741439d9fc-model-cache" (OuterVolumeSpecName: "model-cache") pod "b1c4b5f9-65b4-4994-b518-b0741439d9fc" (UID: "b1c4b5f9-65b4-4994-b518-b0741439d9fc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:35:57.732110 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:57.732046    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1c4b5f9-65b4-4994-b518-b0741439d9fc-tls-certs\") pod \"b1c4b5f9-65b4-4994-b518-b0741439d9fc\" (UID: \"b1c4b5f9-65b4-4994-b518-b0741439d9fc\") "
Sep 15 09:35:57.732110 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:57.732096    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1c4b5f9-65b4-4994-b518-b0741439d9fc-tmp-dir\") pod \"b1c4b5f9-65b4-4994-b518-b0741439d9fc\" (UID: \"b1c4b5f9-65b4-4994-b518-b0741439d9fc\") "
Sep 15 09:35:57.732194 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:57.732164    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1c4b5f9-65b4-4994-b518-b0741439d9fc-dshm\") pod \"b1c4b5f9-65b4-4994-b518-b0741439d9fc\" (UID: \"b1c4b5f9-65b4-4994-b518-b0741439d9fc\") "
Sep 15 09:35:57.732247 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:57.732227    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1c4b5f9-65b4-4994-b518-b0741439d9fc-home" (OuterVolumeSpecName: "home") pod "b1c4b5f9-65b4-4994-b518-b0741439d9fc" (UID: "b1c4b5f9-65b4-4994-b518-b0741439d9fc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:35:57.732380 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:57.732360    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1c4b5f9-65b4-4994-b518-b0741439d9fc-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b1c4b5f9-65b4-4994-b518-b0741439d9fc" (UID: "b1c4b5f9-65b4-4994-b518-b0741439d9fc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:35:57.732522 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:57.732503    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1c4b5f9-65b4-4994-b518-b0741439d9fc-model-cache\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:35:57.732522 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:57.732519    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1c4b5f9-65b4-4994-b518-b0741439d9fc-home\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:35:57.732639 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:57.732531    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1c4b5f9-65b4-4994-b518-b0741439d9fc-tmp-dir\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:35:57.734145 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:57.734124    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1c4b5f9-65b4-4994-b518-b0741439d9fc-kube-api-access-w8rrz" (OuterVolumeSpecName: "kube-api-access-w8rrz") pod "b1c4b5f9-65b4-4994-b518-b0741439d9fc" (UID: "b1c4b5f9-65b4-4994-b518-b0741439d9fc"). InnerVolumeSpecName "kube-api-access-w8rrz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:35:57.734216 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:57.734145    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1c4b5f9-65b4-4994-b518-b0741439d9fc-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b1c4b5f9-65b4-4994-b518-b0741439d9fc" (UID: "b1c4b5f9-65b4-4994-b518-b0741439d9fc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:35:57.734253 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:57.734213    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1c4b5f9-65b4-4994-b518-b0741439d9fc-dshm" (OuterVolumeSpecName: "dshm") pod "b1c4b5f9-65b4-4994-b518-b0741439d9fc" (UID: "b1c4b5f9-65b4-4994-b518-b0741439d9fc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:35:57.833756 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:57.833733    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1c4b5f9-65b4-4994-b518-b0741439d9fc-tls-certs\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:35:57.833756 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:57.833754    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1c4b5f9-65b4-4994-b518-b0741439d9fc-dshm\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:35:57.833881 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:57.833762    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w8rrz\" (UniqueName: \"kubernetes.io/projected/b1c4b5f9-65b4-4994-b518-b0741439d9fc-kube-api-access-w8rrz\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:35:58.568341 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:58.568310    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-7a31d6/test-model-7a31d6-kserve-786dfdddf-wwshg" event={"ID":"b1c4b5f9-65b4-4994-b518-b0741439d9fc","Type":"ContainerDied","Data":"e3e54f383551d46c5eb844f83330bafd50fac8d1151a10a149d18701576f8b6b"}
Sep 15 09:35:58.568728 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:58.568356    2578 scope.go:117] "RemoveContainer" containerID="e0dada56ea1647e258a52b8f0dff6ef914fad59c4df0ea2236e48178f608d0fa"
Sep 15 09:35:58.568728 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:58.568323    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-7a31d6/test-model-7a31d6-kserve-786dfdddf-wwshg"
Sep 15 09:35:58.585142 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:58.585120    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-7a31d6/test-model-7a31d6-kserve-786dfdddf-wwshg"]
Sep 15 09:35:58.588929 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:35:58.588905    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-7a31d6/test-model-7a31d6-kserve-786dfdddf-wwshg"]
Sep 15 09:36:00.122806 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:00.122768    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1c4b5f9-65b4-4994-b518-b0741439d9fc" path="/var/lib/kubelet/pods/b1c4b5f9-65b4-4994-b518-b0741439d9fc/volumes"
Sep 15 09:36:00.619696 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:00.619666    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p"]
Sep 15 09:36:00.619899 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:00.619874    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p" podUID="e6182ece-2cc8-42d4-a087-778103d3c1b2" containerName="istio-proxy" containerID="cri-o://6360c2dbf7ab66f4ba5e914182827aa9234ca1ab5a827dc9d9c17aaa18ace342" gracePeriod=30
Sep 15 09:36:04.005495 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:04.005450    2578 patch_prober.go:28] interesting pod/e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 15 09:36:04.005905 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:04.005529    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p" podUID="e6182ece-2cc8-42d4-a087-778103d3c1b2" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 09:36:05.872403 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:05.872381    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p"
Sep 15 09:36:05.913424 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:05.913347    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6182ece-2cc8-42d4-a087-778103d3c1b2-istiod-ca-cert\") pod \"e6182ece-2cc8-42d4-a087-778103d3c1b2\" (UID: \"e6182ece-2cc8-42d4-a087-778103d3c1b2\") "
Sep 15 09:36:05.913424 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:05.913396    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6182ece-2cc8-42d4-a087-778103d3c1b2-istio-data\") pod \"e6182ece-2cc8-42d4-a087-778103d3c1b2\" (UID: \"e6182ece-2cc8-42d4-a087-778103d3c1b2\") "
Sep 15 09:36:05.913624 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:05.913451    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6182ece-2cc8-42d4-a087-778103d3c1b2-workload-socket\") pod \"e6182ece-2cc8-42d4-a087-778103d3c1b2\" (UID: \"e6182ece-2cc8-42d4-a087-778103d3c1b2\") "
Sep 15 09:36:05.913624 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:05.913528    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6182ece-2cc8-42d4-a087-778103d3c1b2-credential-socket\") pod \"e6182ece-2cc8-42d4-a087-778103d3c1b2\" (UID: \"e6182ece-2cc8-42d4-a087-778103d3c1b2\") "
Sep 15 09:36:05.913624 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:05.913583    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6182ece-2cc8-42d4-a087-778103d3c1b2-workload-certs\") pod \"e6182ece-2cc8-42d4-a087-778103d3c1b2\" (UID: \"e6182ece-2cc8-42d4-a087-778103d3c1b2\") "
Sep 15 09:36:05.913624 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:05.913613    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fprw2\" (UniqueName: \"kubernetes.io/projected/e6182ece-2cc8-42d4-a087-778103d3c1b2-kube-api-access-fprw2\") pod \"e6182ece-2cc8-42d4-a087-778103d3c1b2\" (UID: \"e6182ece-2cc8-42d4-a087-778103d3c1b2\") "
Sep 15 09:36:05.913831 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:05.913643    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6182ece-2cc8-42d4-a087-778103d3c1b2-istio-podinfo\") pod \"e6182ece-2cc8-42d4-a087-778103d3c1b2\" (UID: \"e6182ece-2cc8-42d4-a087-778103d3c1b2\") "
Sep 15 09:36:05.913831 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:05.913667    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6182ece-2cc8-42d4-a087-778103d3c1b2-istio-token\") pod \"e6182ece-2cc8-42d4-a087-778103d3c1b2\" (UID: \"e6182ece-2cc8-42d4-a087-778103d3c1b2\") "
Sep 15 09:36:05.913831 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:05.913724    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6182ece-2cc8-42d4-a087-778103d3c1b2-istio-envoy\") pod \"e6182ece-2cc8-42d4-a087-778103d3c1b2\" (UID: \"e6182ece-2cc8-42d4-a087-778103d3c1b2\") "
Sep 15 09:36:05.914029 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:05.913849    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6182ece-2cc8-42d4-a087-778103d3c1b2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e6182ece-2cc8-42d4-a087-778103d3c1b2" (UID: "e6182ece-2cc8-42d4-a087-778103d3c1b2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:36:05.914029 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:05.913935    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6182ece-2cc8-42d4-a087-778103d3c1b2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e6182ece-2cc8-42d4-a087-778103d3c1b2" (UID: "e6182ece-2cc8-42d4-a087-778103d3c1b2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:36:05.914029 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:05.913980    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6182ece-2cc8-42d4-a087-778103d3c1b2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e6182ece-2cc8-42d4-a087-778103d3c1b2" (UID: "e6182ece-2cc8-42d4-a087-778103d3c1b2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:36:05.914238 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:05.914168    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6182ece-2cc8-42d4-a087-778103d3c1b2-istio-data" (OuterVolumeSpecName: "istio-data") pod "e6182ece-2cc8-42d4-a087-778103d3c1b2" (UID: "e6182ece-2cc8-42d4-a087-778103d3c1b2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:36:05.914238 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:05.914183    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6182ece-2cc8-42d4-a087-778103d3c1b2-workload-certs\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:36:05.914238 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:05.914200    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6182ece-2cc8-42d4-a087-778103d3c1b2-workload-socket\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:36:05.914238 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:05.914213    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6182ece-2cc8-42d4-a087-778103d3c1b2-credential-socket\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:36:05.914599 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:05.914569    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6182ece-2cc8-42d4-a087-778103d3c1b2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e6182ece-2cc8-42d4-a087-778103d3c1b2" (UID: "e6182ece-2cc8-42d4-a087-778103d3c1b2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:36:05.916407 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:05.916384    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6182ece-2cc8-42d4-a087-778103d3c1b2-istio-token" (OuterVolumeSpecName: "istio-token") pod "e6182ece-2cc8-42d4-a087-778103d3c1b2" (UID: "e6182ece-2cc8-42d4-a087-778103d3c1b2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:36:05.916806 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:05.916784    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6182ece-2cc8-42d4-a087-778103d3c1b2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e6182ece-2cc8-42d4-a087-778103d3c1b2" (UID: "e6182ece-2cc8-42d4-a087-778103d3c1b2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:36:05.916895 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:05.916861    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6182ece-2cc8-42d4-a087-778103d3c1b2-kube-api-access-fprw2" (OuterVolumeSpecName: "kube-api-access-fprw2") pod "e6182ece-2cc8-42d4-a087-778103d3c1b2" (UID: "e6182ece-2cc8-42d4-a087-778103d3c1b2"). InnerVolumeSpecName "kube-api-access-fprw2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:36:05.917062 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:05.917044    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e6182ece-2cc8-42d4-a087-778103d3c1b2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e6182ece-2cc8-42d4-a087-778103d3c1b2" (UID: "e6182ece-2cc8-42d4-a087-778103d3c1b2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 09:36:05.969475 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:05.969452    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-d3f5a1/noten-model-d3f5a1-kserve-54d746846c-jsbvf"]
Sep 15 09:36:06.015150 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:06.015123    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fprw2\" (UniqueName: \"kubernetes.io/projected/e6182ece-2cc8-42d4-a087-778103d3c1b2-kube-api-access-fprw2\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:36:06.015150 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:06.015148    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6182ece-2cc8-42d4-a087-778103d3c1b2-istio-podinfo\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:36:06.015289 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:06.015158    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6182ece-2cc8-42d4-a087-778103d3c1b2-istio-token\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:36:06.015289 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:06.015166    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6182ece-2cc8-42d4-a087-778103d3c1b2-istio-envoy\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:36:06.015289 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:06.015173    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6182ece-2cc8-42d4-a087-778103d3c1b2-istiod-ca-cert\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:36:06.015289 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:06.015180    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6182ece-2cc8-42d4-a087-778103d3c1b2-istio-data\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:36:06.621439 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:06.621408    2578 generic.go:356] "Generic (PLEG): container finished" podID="e6182ece-2cc8-42d4-a087-778103d3c1b2" containerID="6360c2dbf7ab66f4ba5e914182827aa9234ca1ab5a827dc9d9c17aaa18ace342" exitCode=0
Sep 15 09:36:06.621605 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:06.621451    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p"
Sep 15 09:36:06.621605 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:06.621493    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p" event={"ID":"e6182ece-2cc8-42d4-a087-778103d3c1b2","Type":"ContainerDied","Data":"6360c2dbf7ab66f4ba5e914182827aa9234ca1ab5a827dc9d9c17aaa18ace342"}
Sep 15 09:36:06.621605 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:06.621548    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p" event={"ID":"e6182ece-2cc8-42d4-a087-778103d3c1b2","Type":"ContainerDied","Data":"0fbaf8a40b82075b4cd388b8af1cf23e9d042d2348d3be0f6657eb764976966f"}
Sep 15 09:36:06.621605 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:06.621574    2578 scope.go:117] "RemoveContainer" containerID="6360c2dbf7ab66f4ba5e914182827aa9234ca1ab5a827dc9d9c17aaa18ace342"
Sep 15 09:36:06.631730 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:06.631707    2578 scope.go:117] "RemoveContainer" containerID="6360c2dbf7ab66f4ba5e914182827aa9234ca1ab5a827dc9d9c17aaa18ace342"
Sep 15 09:36:06.631984 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:36:06.631961    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6360c2dbf7ab66f4ba5e914182827aa9234ca1ab5a827dc9d9c17aaa18ace342\": container with ID starting with 6360c2dbf7ab66f4ba5e914182827aa9234ca1ab5a827dc9d9c17aaa18ace342 not found: ID does not exist" containerID="6360c2dbf7ab66f4ba5e914182827aa9234ca1ab5a827dc9d9c17aaa18ace342"
Sep 15 09:36:06.632064 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:06.631997    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6360c2dbf7ab66f4ba5e914182827aa9234ca1ab5a827dc9d9c17aaa18ace342"} err="failed to get container status \"6360c2dbf7ab66f4ba5e914182827aa9234ca1ab5a827dc9d9c17aaa18ace342\": rpc error: code = NotFound desc = could not find container \"6360c2dbf7ab66f4ba5e914182827aa9234ca1ab5a827dc9d9c17aaa18ace342\": container with ID starting with 6360c2dbf7ab66f4ba5e914182827aa9234ca1ab5a827dc9d9c17aaa18ace342 not found: ID does not exist"
Sep 15 09:36:06.640794 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:06.640768    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p"]
Sep 15 09:36:06.644778 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:06.644755    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-d3f5a1-openshift-default-75858b9b84-pkk8p"]
Sep 15 09:36:08.122111 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:08.122059    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6182ece-2cc8-42d4-a087-778103d3c1b2" path="/var/lib/kubelet/pods/e6182ece-2cc8-42d4-a087-778103d3c1b2/volumes"
Sep 15 09:36:09.044046 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:09.044015    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7a31d6-bfl8g"]
Sep 15 09:36:09.044477 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:09.044463    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6182ece-2cc8-42d4-a087-778103d3c1b2" containerName="istio-proxy"
Sep 15 09:36:09.044524 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:09.044479    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6182ece-2cc8-42d4-a087-778103d3c1b2" containerName="istio-proxy"
Sep 15 09:36:09.044524 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:09.044492    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1c4b5f9-65b4-4994-b518-b0741439d9fc" containerName="main"
Sep 15 09:36:09.044524 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:09.044497    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1c4b5f9-65b4-4994-b518-b0741439d9fc" containerName="main"
Sep 15 09:36:09.044619 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:09.044578    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6182ece-2cc8-42d4-a087-778103d3c1b2" containerName="istio-proxy"
Sep 15 09:36:09.044619 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:09.044588    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1c4b5f9-65b4-4994-b518-b0741439d9fc" containerName="main"
Sep 15 09:36:09.049000 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:09.048976    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7a31d6-bfl8g"
Sep 15 09:36:09.051747 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:09.051349    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 09:36:09.051747 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:09.051390    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cbqnn\""
Sep 15 09:36:09.054198 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:09.054177    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7a31d6-bfl8g"]
Sep 15 09:36:09.143924 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:09.143903    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f6c77d6-6fd8-4fbb-998c-9251751f3bb1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-7a31d6-bfl8g\" (UID: \"0f6c77d6-6fd8-4fbb-998c-9251751f3bb1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7a31d6-bfl8g"
Sep 15 09:36:09.245232 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:09.245193    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f6c77d6-6fd8-4fbb-998c-9251751f3bb1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-7a31d6-bfl8g\" (UID: \"0f6c77d6-6fd8-4fbb-998c-9251751f3bb1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7a31d6-bfl8g"
Sep 15 09:36:09.245798 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:09.245778    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f6c77d6-6fd8-4fbb-998c-9251751f3bb1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-7a31d6-bfl8g\" (UID: \"0f6c77d6-6fd8-4fbb-998c-9251751f3bb1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7a31d6-bfl8g"
Sep 15 09:36:09.362516 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:09.362454    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7a31d6-bfl8g"
Sep 15 09:36:09.636989 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:09.636965    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7a31d6-bfl8g"]
Sep 15 09:36:09.638790 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:36:09.638764    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f6c77d6_6fd8_4fbb_998c_9251751f3bb1.slice/crio-f85b58a6914f0e907e02c744dc0b2379b4e9e3555137608f1a61bec850b4215d WatchSource:0}: Error finding container f85b58a6914f0e907e02c744dc0b2379b4e9e3555137608f1a61bec850b4215d: Status 404 returned error can't find the container with id f85b58a6914f0e907e02c744dc0b2379b4e9e3555137608f1a61bec850b4215d
Sep 15 09:36:10.650844 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:10.650760    2578 generic.go:356] "Generic (PLEG): container finished" podID="0f6c77d6-6fd8-4fbb-998c-9251751f3bb1" containerID="83c76ccdd4a7614e2c9e3b3ee1702bdd5732bc4c9e08b823c812ecc104ebb254" exitCode=0
Sep 15 09:36:10.651208 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:10.650851    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7a31d6-bfl8g" event={"ID":"0f6c77d6-6fd8-4fbb-998c-9251751f3bb1","Type":"ContainerDied","Data":"83c76ccdd4a7614e2c9e3b3ee1702bdd5732bc4c9e08b823c812ecc104ebb254"}
Sep 15 09:36:10.651208 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:10.650900    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7a31d6-bfl8g" event={"ID":"0f6c77d6-6fd8-4fbb-998c-9251751f3bb1","Type":"ContainerStarted","Data":"f85b58a6914f0e907e02c744dc0b2379b4e9e3555137608f1a61bec850b4215d"}
Sep 15 09:36:11.797125 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:11.797102    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7a31d6-bfl8g"
Sep 15 09:36:11.871259 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:11.871233    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f6c77d6-6fd8-4fbb-998c-9251751f3bb1-maas-api-service-ca\") pod \"0f6c77d6-6fd8-4fbb-998c-9251751f3bb1\" (UID: \"0f6c77d6-6fd8-4fbb-998c-9251751f3bb1\") "
Sep 15 09:36:11.871542 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:11.871522    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f6c77d6-6fd8-4fbb-998c-9251751f3bb1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0f6c77d6-6fd8-4fbb-998c-9251751f3bb1" (UID: "0f6c77d6-6fd8-4fbb-998c-9251751f3bb1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:36:11.972496 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:11.972476    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f6c77d6-6fd8-4fbb-998c-9251751f3bb1-maas-api-service-ca\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:36:12.666100 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:12.666073    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7a31d6-bfl8g"
Sep 15 09:36:12.666100 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:12.666093    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7a31d6-bfl8g" event={"ID":"0f6c77d6-6fd8-4fbb-998c-9251751f3bb1","Type":"ContainerDied","Data":"f85b58a6914f0e907e02c744dc0b2379b4e9e3555137608f1a61bec850b4215d"}
Sep 15 09:36:12.666304 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:12.666139    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f85b58a6914f0e907e02c744dc0b2379b4e9e3555137608f1a61bec850b4215d"
Sep 15 09:36:16.282894 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:16.282864    2578 scope.go:117] "RemoveContainer" containerID="b694213451666e8a907618f3063ace8d54150d788c3e6416937a658170264d82"
Sep 15 09:36:16.292087 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:16.292061    2578 scope.go:117] "RemoveContainer" containerID="29ca6e0786f743ea87dc7284bc9a152678526972f2011a8187774788b6df1c68"
Sep 15 09:36:19.655110 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:19.655068    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-7a31d6-29824410-rkvbh"]
Sep 15 09:36:19.657990 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:19.657930    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-7a31d6-29824410-rkvbh"]
Sep 15 09:36:19.853124 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:19.853091    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7a31d6-bfl8g"]
Sep 15 09:36:19.855932 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:19.855910    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-7a31d6-bfl8g"]
Sep 15 09:36:20.121901 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:20.121866    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f6c77d6-6fd8-4fbb-998c-9251751f3bb1" path="/var/lib/kubelet/pods/0f6c77d6-6fd8-4fbb-998c-9251751f3bb1/volumes"
Sep 15 09:36:20.122219 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:20.122205    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ec4d6c3-a305-4c8e-afa6-cae200389e8c" path="/var/lib/kubelet/pods/6ec4d6c3-a305-4c8e-afa6-cae200389e8c/volumes"
Sep 15 09:36:20.990222 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:20.990190    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-noten-d3f5a1/noten-model-d3f5a1-kserve-54d746846c-jsbvf" podUID="2cef53c8-5c3d-4c0a-846c-f71f133f2c33" containerName="main" containerID="cri-o://1781036d4edad55f45ba66e8635c2a2eed27799a14083fc674b478741ebf5995" gracePeriod=45
Sep 15 09:36:21.249473 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:21.249421    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-d3f5a1/noten-model-d3f5a1-kserve-54d746846c-jsbvf"
Sep 15 09:36:21.357601 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:21.357576    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2cef53c8-5c3d-4c0a-846c-f71f133f2c33-home\") pod \"2cef53c8-5c3d-4c0a-846c-f71f133f2c33\" (UID: \"2cef53c8-5c3d-4c0a-846c-f71f133f2c33\") "
Sep 15 09:36:21.357726 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:21.357629    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2cef53c8-5c3d-4c0a-846c-f71f133f2c33-model-cache\") pod \"2cef53c8-5c3d-4c0a-846c-f71f133f2c33\" (UID: \"2cef53c8-5c3d-4c0a-846c-f71f133f2c33\") "
Sep 15 09:36:21.357726 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:21.357666    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9nnr\" (UniqueName: \"kubernetes.io/projected/2cef53c8-5c3d-4c0a-846c-f71f133f2c33-kube-api-access-t9nnr\") pod \"2cef53c8-5c3d-4c0a-846c-f71f133f2c33\" (UID: \"2cef53c8-5c3d-4c0a-846c-f71f133f2c33\") "
Sep 15 09:36:21.357726 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:21.357683    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2cef53c8-5c3d-4c0a-846c-f71f133f2c33-tmp-dir\") pod \"2cef53c8-5c3d-4c0a-846c-f71f133f2c33\" (UID: \"2cef53c8-5c3d-4c0a-846c-f71f133f2c33\") "
Sep 15 09:36:21.357726 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:21.357715    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2cef53c8-5c3d-4c0a-846c-f71f133f2c33-dshm\") pod \"2cef53c8-5c3d-4c0a-846c-f71f133f2c33\" (UID: \"2cef53c8-5c3d-4c0a-846c-f71f133f2c33\") "
Sep 15 09:36:21.357977 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:21.357774    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2cef53c8-5c3d-4c0a-846c-f71f133f2c33-tls-certs\") pod \"2cef53c8-5c3d-4c0a-846c-f71f133f2c33\" (UID: \"2cef53c8-5c3d-4c0a-846c-f71f133f2c33\") "
Sep 15 09:36:21.357977 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:21.357823    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2cef53c8-5c3d-4c0a-846c-f71f133f2c33-home" (OuterVolumeSpecName: "home") pod "2cef53c8-5c3d-4c0a-846c-f71f133f2c33" (UID: "2cef53c8-5c3d-4c0a-846c-f71f133f2c33"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:36:21.357977 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:21.357888    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2cef53c8-5c3d-4c0a-846c-f71f133f2c33-model-cache" (OuterVolumeSpecName: "model-cache") pod "2cef53c8-5c3d-4c0a-846c-f71f133f2c33" (UID: "2cef53c8-5c3d-4c0a-846c-f71f133f2c33"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:36:21.358145 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:21.357981    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2cef53c8-5c3d-4c0a-846c-f71f133f2c33-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2cef53c8-5c3d-4c0a-846c-f71f133f2c33" (UID: "2cef53c8-5c3d-4c0a-846c-f71f133f2c33"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:36:21.358202 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:21.358153    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2cef53c8-5c3d-4c0a-846c-f71f133f2c33-home\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:36:21.358202 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:21.358172    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2cef53c8-5c3d-4c0a-846c-f71f133f2c33-model-cache\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:36:21.358202 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:21.358187    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2cef53c8-5c3d-4c0a-846c-f71f133f2c33-tmp-dir\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:36:21.359874 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:21.359845    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2cef53c8-5c3d-4c0a-846c-f71f133f2c33-dshm" (OuterVolumeSpecName: "dshm") pod "2cef53c8-5c3d-4c0a-846c-f71f133f2c33" (UID: "2cef53c8-5c3d-4c0a-846c-f71f133f2c33"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:36:21.360044 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:21.359898    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cef53c8-5c3d-4c0a-846c-f71f133f2c33-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2cef53c8-5c3d-4c0a-846c-f71f133f2c33" (UID: "2cef53c8-5c3d-4c0a-846c-f71f133f2c33"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:36:21.360044 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:21.359967    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cef53c8-5c3d-4c0a-846c-f71f133f2c33-kube-api-access-t9nnr" (OuterVolumeSpecName: "kube-api-access-t9nnr") pod "2cef53c8-5c3d-4c0a-846c-f71f133f2c33" (UID: "2cef53c8-5c3d-4c0a-846c-f71f133f2c33"). InnerVolumeSpecName "kube-api-access-t9nnr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:36:21.459517 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:21.459498    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9nnr\" (UniqueName: \"kubernetes.io/projected/2cef53c8-5c3d-4c0a-846c-f71f133f2c33-kube-api-access-t9nnr\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:36:21.459517 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:21.459518    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2cef53c8-5c3d-4c0a-846c-f71f133f2c33-dshm\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:36:21.459655 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:21.459527    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2cef53c8-5c3d-4c0a-846c-f71f133f2c33-tls-certs\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:36:21.727676 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:21.727649    2578 generic.go:356] "Generic (PLEG): container finished" podID="2cef53c8-5c3d-4c0a-846c-f71f133f2c33" containerID="1781036d4edad55f45ba66e8635c2a2eed27799a14083fc674b478741ebf5995" exitCode=0
Sep 15 09:36:21.727805 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:21.727690    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-d3f5a1/noten-model-d3f5a1-kserve-54d746846c-jsbvf"
Sep 15 09:36:21.727805 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:21.727708    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-d3f5a1/noten-model-d3f5a1-kserve-54d746846c-jsbvf" event={"ID":"2cef53c8-5c3d-4c0a-846c-f71f133f2c33","Type":"ContainerDied","Data":"1781036d4edad55f45ba66e8635c2a2eed27799a14083fc674b478741ebf5995"}
Sep 15 09:36:21.727805 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:21.727748    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-d3f5a1/noten-model-d3f5a1-kserve-54d746846c-jsbvf" event={"ID":"2cef53c8-5c3d-4c0a-846c-f71f133f2c33","Type":"ContainerDied","Data":"37078c35c0730564429af325d82284bbd08c2fada5afb7eb03c7110988fbb0c5"}
Sep 15 09:36:21.727805 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:21.727771    2578 scope.go:117] "RemoveContainer" containerID="1781036d4edad55f45ba66e8635c2a2eed27799a14083fc674b478741ebf5995"
Sep 15 09:36:21.737919 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:21.737904    2578 scope.go:117] "RemoveContainer" containerID="1781036d4edad55f45ba66e8635c2a2eed27799a14083fc674b478741ebf5995"
Sep 15 09:36:21.738218 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:36:21.738198    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1781036d4edad55f45ba66e8635c2a2eed27799a14083fc674b478741ebf5995\": container with ID starting with 1781036d4edad55f45ba66e8635c2a2eed27799a14083fc674b478741ebf5995 not found: ID does not exist" containerID="1781036d4edad55f45ba66e8635c2a2eed27799a14083fc674b478741ebf5995"
Sep 15 09:36:21.738274 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:21.738226    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1781036d4edad55f45ba66e8635c2a2eed27799a14083fc674b478741ebf5995"} err="failed to get container status \"1781036d4edad55f45ba66e8635c2a2eed27799a14083fc674b478741ebf5995\": rpc error: code = NotFound desc = could not find container \"1781036d4edad55f45ba66e8635c2a2eed27799a14083fc674b478741ebf5995\": container with ID starting with 1781036d4edad55f45ba66e8635c2a2eed27799a14083fc674b478741ebf5995 not found: ID does not exist"
Sep 15 09:36:21.751499 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:21.751473    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-d3f5a1/noten-model-d3f5a1-kserve-54d746846c-jsbvf"]
Sep 15 09:36:21.757660 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:21.757640    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-noten-d3f5a1/noten-model-d3f5a1-kserve-54d746846c-jsbvf"]
Sep 15 09:36:22.122235 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:22.122163    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2cef53c8-5c3d-4c0a-846c-f71f133f2c33" path="/var/lib/kubelet/pods/2cef53c8-5c3d-4c0a-846c-f71f133f2c33/volumes"
Sep 15 09:36:26.034247 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:26.034210    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg"]
Sep 15 09:36:26.034654 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:26.034460    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg" podUID="eb558fdf-7208-4fae-bcf2-c92b8874e2c2" containerName="istio-proxy" containerID="cri-o://d05e461e9555de6ee0dd6477eb5d54d12466b559af69a0839d0bf3a6b1a21d55" gracePeriod=30
Sep 15 09:36:26.398060 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:26.397987    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0e280a-5dfqg"]
Sep 15 09:36:26.398389 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:26.398377    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cef53c8-5c3d-4c0a-846c-f71f133f2c33" containerName="main"
Sep 15 09:36:26.398441 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:26.398390    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cef53c8-5c3d-4c0a-846c-f71f133f2c33" containerName="main"
Sep 15 09:36:26.398441 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:26.398405    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f6c77d6-6fd8-4fbb-998c-9251751f3bb1" containerName="revoke-keys"
Sep 15 09:36:26.398441 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:26.398410    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f6c77d6-6fd8-4fbb-998c-9251751f3bb1" containerName="revoke-keys"
Sep 15 09:36:26.398535 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:26.398480    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f6c77d6-6fd8-4fbb-998c-9251751f3bb1" containerName="revoke-keys"
Sep 15 09:36:26.398535 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:26.398489    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2cef53c8-5c3d-4c0a-846c-f71f133f2c33" containerName="main"
Sep 15 09:36:26.402987 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:26.402972    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0e280a-5dfqg"
Sep 15 09:36:26.405470 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:26.405284    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 09:36:26.405470 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:26.405318    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cbqnn\""
Sep 15 09:36:26.407981 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:26.407931    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0e280a-5dfqg"]
Sep 15 09:36:26.504379 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:26.504353    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be2cea8a-9e74-452d-873c-a4cdabfcc3bf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-0e280a-5dfqg\" (UID: \"be2cea8a-9e74-452d-873c-a4cdabfcc3bf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0e280a-5dfqg"
Sep 15 09:36:26.605627 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:26.605606    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be2cea8a-9e74-452d-873c-a4cdabfcc3bf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-0e280a-5dfqg\" (UID: \"be2cea8a-9e74-452d-873c-a4cdabfcc3bf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0e280a-5dfqg"
Sep 15 09:36:26.606270 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:26.606248    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be2cea8a-9e74-452d-873c-a4cdabfcc3bf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-0e280a-5dfqg\" (UID: \"be2cea8a-9e74-452d-873c-a4cdabfcc3bf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0e280a-5dfqg"
Sep 15 09:36:26.715307 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:26.715281    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0e280a-5dfqg"
Sep 15 09:36:26.987265 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:26.986941    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0e280a-5dfqg"]
Sep 15 09:36:26.987661 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:36:26.987629    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe2cea8a_9e74_452d_873c_a4cdabfcc3bf.slice/crio-4ca78fb9a3d7001fc6eb4aba0d09dd41950bb1157bd4ef70d51ae15e5dac403d WatchSource:0}: Error finding container 4ca78fb9a3d7001fc6eb4aba0d09dd41950bb1157bd4ef70d51ae15e5dac403d: Status 404 returned error can't find the container with id 4ca78fb9a3d7001fc6eb4aba0d09dd41950bb1157bd4ef70d51ae15e5dac403d
Sep 15 09:36:27.502788 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:27.502712    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-c183a5/e2e-conflict-b-0b195997-kserve-858787f76f-r7h47"]
Sep 15 09:36:27.506248 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:27.506233    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-c183a5/e2e-conflict-b-0b195997-kserve-858787f76f-r7h47"
Sep 15 09:36:27.508426 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:27.508402    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-c183a5\"/\"kube-root-ca.crt\""
Sep 15 09:36:27.509315 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:27.509293    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-c183a5\"/\"e2e-conflict-b-0b195997-kserve-self-signed-certs\""
Sep 15 09:36:27.509315 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:27.509302    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-c183a5\"/\"openshift-service-ca.crt\""
Sep 15 09:36:27.509479 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:27.509309    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-c183a5\"/\"default-dockercfg-k7hvd\""
Sep 15 09:36:27.516488 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:27.516466    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-c183a5/e2e-conflict-b-0b195997-kserve-858787f76f-r7h47"]
Sep 15 09:36:27.621185 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:27.621140    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6696565-7769-4c30-90e3-826ebc19fe68-tls-certs\") pod \"e2e-conflict-b-0b195997-kserve-858787f76f-r7h47\" (UID: \"d6696565-7769-4c30-90e3-826ebc19fe68\") " pod="e2e-models-e2e-worker-w4-c183a5/e2e-conflict-b-0b195997-kserve-858787f76f-r7h47"
Sep 15 09:36:27.621378 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:27.621288    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6696565-7769-4c30-90e3-826ebc19fe68-model-cache\") pod \"e2e-conflict-b-0b195997-kserve-858787f76f-r7h47\" (UID: \"d6696565-7769-4c30-90e3-826ebc19fe68\") " pod="e2e-models-e2e-worker-w4-c183a5/e2e-conflict-b-0b195997-kserve-858787f76f-r7h47"
Sep 15 09:36:27.621518 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:27.621438    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flmlj\" (UniqueName: \"kubernetes.io/projected/d6696565-7769-4c30-90e3-826ebc19fe68-kube-api-access-flmlj\") pod \"e2e-conflict-b-0b195997-kserve-858787f76f-r7h47\" (UID: \"d6696565-7769-4c30-90e3-826ebc19fe68\") " pod="e2e-models-e2e-worker-w4-c183a5/e2e-conflict-b-0b195997-kserve-858787f76f-r7h47"
Sep 15 09:36:27.621597 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:27.621543    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6696565-7769-4c30-90e3-826ebc19fe68-dshm\") pod \"e2e-conflict-b-0b195997-kserve-858787f76f-r7h47\" (UID: \"d6696565-7769-4c30-90e3-826ebc19fe68\") " pod="e2e-models-e2e-worker-w4-c183a5/e2e-conflict-b-0b195997-kserve-858787f76f-r7h47"
Sep 15 09:36:27.621834 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:27.621755    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6696565-7769-4c30-90e3-826ebc19fe68-home\") pod \"e2e-conflict-b-0b195997-kserve-858787f76f-r7h47\" (UID: \"d6696565-7769-4c30-90e3-826ebc19fe68\") " pod="e2e-models-e2e-worker-w4-c183a5/e2e-conflict-b-0b195997-kserve-858787f76f-r7h47"
Sep 15 09:36:27.621834 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:27.621826    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6696565-7769-4c30-90e3-826ebc19fe68-tmp-dir\") pod \"e2e-conflict-b-0b195997-kserve-858787f76f-r7h47\" (UID: \"d6696565-7769-4c30-90e3-826ebc19fe68\") " pod="e2e-models-e2e-worker-w4-c183a5/e2e-conflict-b-0b195997-kserve-858787f76f-r7h47"
Sep 15 09:36:27.722358 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:27.722334    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flmlj\" (UniqueName: \"kubernetes.io/projected/d6696565-7769-4c30-90e3-826ebc19fe68-kube-api-access-flmlj\") pod \"e2e-conflict-b-0b195997-kserve-858787f76f-r7h47\" (UID: \"d6696565-7769-4c30-90e3-826ebc19fe68\") " pod="e2e-models-e2e-worker-w4-c183a5/e2e-conflict-b-0b195997-kserve-858787f76f-r7h47"
Sep 15 09:36:27.722478 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:27.722366    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6696565-7769-4c30-90e3-826ebc19fe68-dshm\") pod \"e2e-conflict-b-0b195997-kserve-858787f76f-r7h47\" (UID: \"d6696565-7769-4c30-90e3-826ebc19fe68\") " pod="e2e-models-e2e-worker-w4-c183a5/e2e-conflict-b-0b195997-kserve-858787f76f-r7h47"
Sep 15 09:36:27.722478 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:27.722467    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6696565-7769-4c30-90e3-826ebc19fe68-home\") pod \"e2e-conflict-b-0b195997-kserve-858787f76f-r7h47\" (UID: \"d6696565-7769-4c30-90e3-826ebc19fe68\") " pod="e2e-models-e2e-worker-w4-c183a5/e2e-conflict-b-0b195997-kserve-858787f76f-r7h47"
Sep 15 09:36:27.722558 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:27.722507    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6696565-7769-4c30-90e3-826ebc19fe68-tmp-dir\") pod \"e2e-conflict-b-0b195997-kserve-858787f76f-r7h47\" (UID: \"d6696565-7769-4c30-90e3-826ebc19fe68\") " pod="e2e-models-e2e-worker-w4-c183a5/e2e-conflict-b-0b195997-kserve-858787f76f-r7h47"
Sep 15 09:36:27.722558 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:27.722543    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6696565-7769-4c30-90e3-826ebc19fe68-tls-certs\") pod \"e2e-conflict-b-0b195997-kserve-858787f76f-r7h47\" (UID: \"d6696565-7769-4c30-90e3-826ebc19fe68\") " pod="e2e-models-e2e-worker-w4-c183a5/e2e-conflict-b-0b195997-kserve-858787f76f-r7h47"
Sep 15 09:36:27.722638 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:27.722587    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6696565-7769-4c30-90e3-826ebc19fe68-model-cache\") pod \"e2e-conflict-b-0b195997-kserve-858787f76f-r7h47\" (UID: \"d6696565-7769-4c30-90e3-826ebc19fe68\") " pod="e2e-models-e2e-worker-w4-c183a5/e2e-conflict-b-0b195997-kserve-858787f76f-r7h47"
Sep 15 09:36:27.722932 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:27.722909    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6696565-7769-4c30-90e3-826ebc19fe68-home\") pod \"e2e-conflict-b-0b195997-kserve-858787f76f-r7h47\" (UID: \"d6696565-7769-4c30-90e3-826ebc19fe68\") " pod="e2e-models-e2e-worker-w4-c183a5/e2e-conflict-b-0b195997-kserve-858787f76f-r7h47"
Sep 15 09:36:27.723068 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:27.723019    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6696565-7769-4c30-90e3-826ebc19fe68-tmp-dir\") pod \"e2e-conflict-b-0b195997-kserve-858787f76f-r7h47\" (UID: \"d6696565-7769-4c30-90e3-826ebc19fe68\") " pod="e2e-models-e2e-worker-w4-c183a5/e2e-conflict-b-0b195997-kserve-858787f76f-r7h47"
Sep 15 09:36:27.723068 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:27.723036    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6696565-7769-4c30-90e3-826ebc19fe68-model-cache\") pod \"e2e-conflict-b-0b195997-kserve-858787f76f-r7h47\" (UID: \"d6696565-7769-4c30-90e3-826ebc19fe68\") " pod="e2e-models-e2e-worker-w4-c183a5/e2e-conflict-b-0b195997-kserve-858787f76f-r7h47"
Sep 15 09:36:27.724973 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:27.724937    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6696565-7769-4c30-90e3-826ebc19fe68-dshm\") pod \"e2e-conflict-b-0b195997-kserve-858787f76f-r7h47\" (UID: \"d6696565-7769-4c30-90e3-826ebc19fe68\") " pod="e2e-models-e2e-worker-w4-c183a5/e2e-conflict-b-0b195997-kserve-858787f76f-r7h47"
Sep 15 09:36:27.725622 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:27.725591    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6696565-7769-4c30-90e3-826ebc19fe68-tls-certs\") pod \"e2e-conflict-b-0b195997-kserve-858787f76f-r7h47\" (UID: \"d6696565-7769-4c30-90e3-826ebc19fe68\") " pod="e2e-models-e2e-worker-w4-c183a5/e2e-conflict-b-0b195997-kserve-858787f76f-r7h47"
Sep 15 09:36:27.729652 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:27.729626    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flmlj\" (UniqueName: \"kubernetes.io/projected/d6696565-7769-4c30-90e3-826ebc19fe68-kube-api-access-flmlj\") pod \"e2e-conflict-b-0b195997-kserve-858787f76f-r7h47\" (UID: \"d6696565-7769-4c30-90e3-826ebc19fe68\") " pod="e2e-models-e2e-worker-w4-c183a5/e2e-conflict-b-0b195997-kserve-858787f76f-r7h47"
Sep 15 09:36:27.780673 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:27.780587    2578 generic.go:356] "Generic (PLEG): container finished" podID="be2cea8a-9e74-452d-873c-a4cdabfcc3bf" containerID="8ca2087a4b0ef67e0e59a550a8b83b7a5ee30fbc1140a5308c2d24f3fea5eb2c" exitCode=0
Sep 15 09:36:27.780673 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:27.780658    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0e280a-5dfqg" event={"ID":"be2cea8a-9e74-452d-873c-a4cdabfcc3bf","Type":"ContainerDied","Data":"8ca2087a4b0ef67e0e59a550a8b83b7a5ee30fbc1140a5308c2d24f3fea5eb2c"}
Sep 15 09:36:27.780857 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:27.780695    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0e280a-5dfqg" event={"ID":"be2cea8a-9e74-452d-873c-a4cdabfcc3bf","Type":"ContainerStarted","Data":"4ca78fb9a3d7001fc6eb4aba0d09dd41950bb1157bd4ef70d51ae15e5dac403d"}
Sep 15 09:36:27.817547 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:27.817517    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-c183a5/e2e-conflict-b-0b195997-kserve-858787f76f-r7h47"
Sep 15 09:36:28.088998 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:28.087178    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-c183a5/e2e-conflict-b-0b195997-kserve-858787f76f-r7h47"]
Sep 15 09:36:28.089707 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:36:28.089681    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd6696565_7769_4c30_90e3_826ebc19fe68.slice/crio-c2646b095545d897141d62a7fb4af51485d4543cab9cf5e2d8ac3e2e9555ff02 WatchSource:0}: Error finding container c2646b095545d897141d62a7fb4af51485d4543cab9cf5e2d8ac3e2e9555ff02: Status 404 returned error can't find the container with id c2646b095545d897141d62a7fb4af51485d4543cab9cf5e2d8ac3e2e9555ff02
Sep 15 09:36:28.788996 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:28.788934    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-c183a5/e2e-conflict-b-0b195997-kserve-858787f76f-r7h47" event={"ID":"d6696565-7769-4c30-90e3-826ebc19fe68","Type":"ContainerStarted","Data":"f33238df5470590f56bc5108af1e05ec7a4ff05f8b78a36e3a9701995982b811"}
Sep 15 09:36:28.789442 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:28.789009    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-c183a5/e2e-conflict-b-0b195997-kserve-858787f76f-r7h47" event={"ID":"d6696565-7769-4c30-90e3-826ebc19fe68","Type":"ContainerStarted","Data":"c2646b095545d897141d62a7fb4af51485d4543cab9cf5e2d8ac3e2e9555ff02"}
Sep 15 09:36:28.806329 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:28.806283    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-c183a5/e2e-conflict-b-0b195997-kserve-858787f76f-r7h47" podStartSLOduration=1.8062666 podStartE2EDuration="1.8062666s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:36:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:36:28.804195885 +0000 UTC m=+1333.142641163" watchObservedRunningTime="2026-09-15 09:36:28.8062666 +0000 UTC m=+1333.144711874"
Sep 15 09:36:28.943114 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:28.943085    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0e280a-5dfqg"
Sep 15 09:36:29.036393 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:29.036366    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be2cea8a-9e74-452d-873c-a4cdabfcc3bf-maas-api-service-ca\") pod \"be2cea8a-9e74-452d-873c-a4cdabfcc3bf\" (UID: \"be2cea8a-9e74-452d-873c-a4cdabfcc3bf\") "
Sep 15 09:36:29.036748 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:29.036727    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be2cea8a-9e74-452d-873c-a4cdabfcc3bf-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "be2cea8a-9e74-452d-873c-a4cdabfcc3bf" (UID: "be2cea8a-9e74-452d-873c-a4cdabfcc3bf"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:36:29.137801 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:29.137727    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be2cea8a-9e74-452d-873c-a4cdabfcc3bf-maas-api-service-ca\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:36:29.796580 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:29.796546    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0e280a-5dfqg"
Sep 15 09:36:29.796994 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:29.796583    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0e280a-5dfqg" event={"ID":"be2cea8a-9e74-452d-873c-a4cdabfcc3bf","Type":"ContainerDied","Data":"4ca78fb9a3d7001fc6eb4aba0d09dd41950bb1157bd4ef70d51ae15e5dac403d"}
Sep 15 09:36:29.796994 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:29.796624    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4ca78fb9a3d7001fc6eb4aba0d09dd41950bb1157bd4ef70d51ae15e5dac403d"
Sep 15 09:36:31.300447 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:31.300396    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg"
Sep 15 09:36:31.459796 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:31.459768    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb558fdf-7208-4fae-bcf2-c92b8874e2c2-workload-certs\") pod \"eb558fdf-7208-4fae-bcf2-c92b8874e2c2\" (UID: \"eb558fdf-7208-4fae-bcf2-c92b8874e2c2\") "
Sep 15 09:36:31.459976 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:31.459819    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb558fdf-7208-4fae-bcf2-c92b8874e2c2-istio-podinfo\") pod \"eb558fdf-7208-4fae-bcf2-c92b8874e2c2\" (UID: \"eb558fdf-7208-4fae-bcf2-c92b8874e2c2\") "
Sep 15 09:36:31.459976 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:31.459876    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb558fdf-7208-4fae-bcf2-c92b8874e2c2-istio-data\") pod \"eb558fdf-7208-4fae-bcf2-c92b8874e2c2\" (UID: \"eb558fdf-7208-4fae-bcf2-c92b8874e2c2\") "
Sep 15 09:36:31.459976 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:31.459905    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb558fdf-7208-4fae-bcf2-c92b8874e2c2-istio-token\") pod \"eb558fdf-7208-4fae-bcf2-c92b8874e2c2\" (UID: \"eb558fdf-7208-4fae-bcf2-c92b8874e2c2\") "
Sep 15 09:36:31.459976 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:31.459937    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb558fdf-7208-4fae-bcf2-c92b8874e2c2-istiod-ca-cert\") pod \"eb558fdf-7208-4fae-bcf2-c92b8874e2c2\" (UID: \"eb558fdf-7208-4fae-bcf2-c92b8874e2c2\") "
Sep 15 09:36:31.460213 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:31.460023    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb558fdf-7208-4fae-bcf2-c92b8874e2c2-credential-socket\") pod \"eb558fdf-7208-4fae-bcf2-c92b8874e2c2\" (UID: \"eb558fdf-7208-4fae-bcf2-c92b8874e2c2\") "
Sep 15 09:36:31.460213 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:31.460065    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb558fdf-7208-4fae-bcf2-c92b8874e2c2-istio-envoy\") pod \"eb558fdf-7208-4fae-bcf2-c92b8874e2c2\" (UID: \"eb558fdf-7208-4fae-bcf2-c92b8874e2c2\") "
Sep 15 09:36:31.460213 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:31.460124    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7fj8\" (UniqueName: \"kubernetes.io/projected/eb558fdf-7208-4fae-bcf2-c92b8874e2c2-kube-api-access-z7fj8\") pod \"eb558fdf-7208-4fae-bcf2-c92b8874e2c2\" (UID: \"eb558fdf-7208-4fae-bcf2-c92b8874e2c2\") "
Sep 15 09:36:31.460213 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:31.460148    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb558fdf-7208-4fae-bcf2-c92b8874e2c2-workload-socket\") pod \"eb558fdf-7208-4fae-bcf2-c92b8874e2c2\" (UID: \"eb558fdf-7208-4fae-bcf2-c92b8874e2c2\") "
Sep 15 09:36:31.460404 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:31.460239    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb558fdf-7208-4fae-bcf2-c92b8874e2c2-istio-data" (OuterVolumeSpecName: "istio-data") pod "eb558fdf-7208-4fae-bcf2-c92b8874e2c2" (UID: "eb558fdf-7208-4fae-bcf2-c92b8874e2c2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:36:31.460404 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:31.460280    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb558fdf-7208-4fae-bcf2-c92b8874e2c2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "eb558fdf-7208-4fae-bcf2-c92b8874e2c2" (UID: "eb558fdf-7208-4fae-bcf2-c92b8874e2c2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:36:31.460546 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:31.460517    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb558fdf-7208-4fae-bcf2-c92b8874e2c2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "eb558fdf-7208-4fae-bcf2-c92b8874e2c2" (UID: "eb558fdf-7208-4fae-bcf2-c92b8874e2c2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:36:31.460601 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:31.460582    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb558fdf-7208-4fae-bcf2-c92b8874e2c2-istio-data\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:36:31.460601 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:31.460586    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb558fdf-7208-4fae-bcf2-c92b8874e2c2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "eb558fdf-7208-4fae-bcf2-c92b8874e2c2" (UID: "eb558fdf-7208-4fae-bcf2-c92b8874e2c2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:36:31.460705 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:31.460601    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb558fdf-7208-4fae-bcf2-c92b8874e2c2-credential-socket\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:36:31.460705 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:31.460606    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb558fdf-7208-4fae-bcf2-c92b8874e2c2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "eb558fdf-7208-4fae-bcf2-c92b8874e2c2" (UID: "eb558fdf-7208-4fae-bcf2-c92b8874e2c2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:36:31.462191 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:31.462168    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/eb558fdf-7208-4fae-bcf2-c92b8874e2c2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "eb558fdf-7208-4fae-bcf2-c92b8874e2c2" (UID: "eb558fdf-7208-4fae-bcf2-c92b8874e2c2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 09:36:31.462328 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:31.462312    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb558fdf-7208-4fae-bcf2-c92b8874e2c2-istio-token" (OuterVolumeSpecName: "istio-token") pod "eb558fdf-7208-4fae-bcf2-c92b8874e2c2" (UID: "eb558fdf-7208-4fae-bcf2-c92b8874e2c2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:36:31.462686 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:31.462661    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb558fdf-7208-4fae-bcf2-c92b8874e2c2-kube-api-access-z7fj8" (OuterVolumeSpecName: "kube-api-access-z7fj8") pod "eb558fdf-7208-4fae-bcf2-c92b8874e2c2" (UID: "eb558fdf-7208-4fae-bcf2-c92b8874e2c2"). InnerVolumeSpecName "kube-api-access-z7fj8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:36:31.462774 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:31.462678    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb558fdf-7208-4fae-bcf2-c92b8874e2c2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "eb558fdf-7208-4fae-bcf2-c92b8874e2c2" (UID: "eb558fdf-7208-4fae-bcf2-c92b8874e2c2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:36:31.561649 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:31.561600    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb558fdf-7208-4fae-bcf2-c92b8874e2c2-istio-podinfo\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:36:31.561649 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:31.561620    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb558fdf-7208-4fae-bcf2-c92b8874e2c2-istio-token\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:36:31.561649 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:31.561630    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb558fdf-7208-4fae-bcf2-c92b8874e2c2-istiod-ca-cert\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:36:31.561649 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:31.561638    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb558fdf-7208-4fae-bcf2-c92b8874e2c2-istio-envoy\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:36:31.561649 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:31.561646    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7fj8\" (UniqueName: \"kubernetes.io/projected/eb558fdf-7208-4fae-bcf2-c92b8874e2c2-kube-api-access-z7fj8\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:36:31.561857 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:31.561654    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb558fdf-7208-4fae-bcf2-c92b8874e2c2-workload-socket\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:36:31.561857 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:31.561663    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb558fdf-7208-4fae-bcf2-c92b8874e2c2-workload-certs\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:36:31.810497 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:31.810467    2578 generic.go:356] "Generic (PLEG): container finished" podID="eb558fdf-7208-4fae-bcf2-c92b8874e2c2" containerID="d05e461e9555de6ee0dd6477eb5d54d12466b559af69a0839d0bf3a6b1a21d55" exitCode=0
Sep 15 09:36:31.810604 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:31.810519    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg"
Sep 15 09:36:31.810604 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:31.810553    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg" event={"ID":"eb558fdf-7208-4fae-bcf2-c92b8874e2c2","Type":"ContainerDied","Data":"d05e461e9555de6ee0dd6477eb5d54d12466b559af69a0839d0bf3a6b1a21d55"}
Sep 15 09:36:31.810690 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:31.810640    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg" event={"ID":"eb558fdf-7208-4fae-bcf2-c92b8874e2c2","Type":"ContainerDied","Data":"a0c9955f42bb9e40a07d11e8e0b8d75b91070d370a9e4f0c049081e2c444f05b"}
Sep 15 09:36:31.810690 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:31.810669    2578 scope.go:117] "RemoveContainer" containerID="d05e461e9555de6ee0dd6477eb5d54d12466b559af69a0839d0bf3a6b1a21d55"
Sep 15 09:36:31.821191 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:31.821169    2578 scope.go:117] "RemoveContainer" containerID="3526c9eb97f161eef442f259ade4fc58bbab37703ec48b5214cddea64bd090fa"
Sep 15 09:36:31.829410 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:31.829366    2578 scope.go:117] "RemoveContainer" containerID="d05e461e9555de6ee0dd6477eb5d54d12466b559af69a0839d0bf3a6b1a21d55"
Sep 15 09:36:31.829903 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:36:31.829708    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d05e461e9555de6ee0dd6477eb5d54d12466b559af69a0839d0bf3a6b1a21d55\": container with ID starting with d05e461e9555de6ee0dd6477eb5d54d12466b559af69a0839d0bf3a6b1a21d55 not found: ID does not exist" containerID="d05e461e9555de6ee0dd6477eb5d54d12466b559af69a0839d0bf3a6b1a21d55"
Sep 15 09:36:31.829903 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:31.829749    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d05e461e9555de6ee0dd6477eb5d54d12466b559af69a0839d0bf3a6b1a21d55"} err="failed to get container status \"d05e461e9555de6ee0dd6477eb5d54d12466b559af69a0839d0bf3a6b1a21d55\": rpc error: code = NotFound desc = could not find container \"d05e461e9555de6ee0dd6477eb5d54d12466b559af69a0839d0bf3a6b1a21d55\": container with ID starting with d05e461e9555de6ee0dd6477eb5d54d12466b559af69a0839d0bf3a6b1a21d55 not found: ID does not exist"
Sep 15 09:36:31.829903 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:31.829769    2578 scope.go:117] "RemoveContainer" containerID="3526c9eb97f161eef442f259ade4fc58bbab37703ec48b5214cddea64bd090fa"
Sep 15 09:36:31.830656 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:36:31.830631    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3526c9eb97f161eef442f259ade4fc58bbab37703ec48b5214cddea64bd090fa\": container with ID starting with 3526c9eb97f161eef442f259ade4fc58bbab37703ec48b5214cddea64bd090fa not found: ID does not exist" containerID="3526c9eb97f161eef442f259ade4fc58bbab37703ec48b5214cddea64bd090fa"
Sep 15 09:36:31.830731 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:31.830665    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3526c9eb97f161eef442f259ade4fc58bbab37703ec48b5214cddea64bd090fa"} err="failed to get container status \"3526c9eb97f161eef442f259ade4fc58bbab37703ec48b5214cddea64bd090fa\": rpc error: code = NotFound desc = could not find container \"3526c9eb97f161eef442f259ade4fc58bbab37703ec48b5214cddea64bd090fa\": container with ID starting with 3526c9eb97f161eef442f259ade4fc58bbab37703ec48b5214cddea64bd090fa not found: ID does not exist"
Sep 15 09:36:31.833171 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:31.833153    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg"]
Sep 15 09:36:31.838502 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:31.838482    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-7a31d6-openshift-default-77d5447cb6-7gbtg"]
Sep 15 09:36:32.122050 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:32.121935    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb558fdf-7208-4fae-bcf2-c92b8874e2c2" path="/var/lib/kubelet/pods/eb558fdf-7208-4fae-bcf2-c92b8874e2c2/volumes"
Sep 15 09:36:37.073776 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:37.073742    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0e280a-5dfqg"]
Sep 15 09:36:37.076281 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:37.076260    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-0e280a-5dfqg"]
Sep 15 09:36:37.818344 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:37.818308    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-c183a5/e2e-conflict-b-0b195997-kserve-858787f76f-r7h47"
Sep 15 09:36:37.818524 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:37.818354    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-c183a5/e2e-conflict-b-0b195997-kserve-858787f76f-r7h47"
Sep 15 09:36:37.830927 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:37.830904    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-c183a5/e2e-conflict-b-0b195997-kserve-858787f76f-r7h47"
Sep 15 09:36:37.865349 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:37.865325    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-c183a5/e2e-conflict-b-0b195997-kserve-858787f76f-r7h47"
Sep 15 09:36:38.122884 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:38.122807    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be2cea8a-9e74-452d-873c-a4cdabfcc3bf" path="/var/lib/kubelet/pods/be2cea8a-9e74-452d-873c-a4cdabfcc3bf/volumes"
Sep 15 09:36:43.875532 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:43.875442    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b"]
Sep 15 09:36:43.876065 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:43.875711    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b" podUID="10b84bc2-3e88-4e79-bbc7-4213e33de1aa" containerName="istio-proxy" containerID="cri-o://992659facf053d05e4694a6eab30b42f7b361e0ae1f93ea6c415e72cee6b7902" gracePeriod=30
Sep 15 09:36:44.720732 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:44.720693    2578 patch_prober.go:28] interesting pod/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 15 09:36:44.720902 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:44.720749    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b" podUID="10b84bc2-3e88-4e79-bbc7-4213e33de1aa" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 09:36:49.132720 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.132697    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b"
Sep 15 09:36:49.224257 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.224234    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g2874\" (UniqueName: \"kubernetes.io/projected/10b84bc2-3e88-4e79-bbc7-4213e33de1aa-kube-api-access-g2874\") pod \"10b84bc2-3e88-4e79-bbc7-4213e33de1aa\" (UID: \"10b84bc2-3e88-4e79-bbc7-4213e33de1aa\") "
Sep 15 09:36:49.224378 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.224277    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10b84bc2-3e88-4e79-bbc7-4213e33de1aa-istiod-ca-cert\") pod \"10b84bc2-3e88-4e79-bbc7-4213e33de1aa\" (UID: \"10b84bc2-3e88-4e79-bbc7-4213e33de1aa\") "
Sep 15 09:36:49.224378 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.224304    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10b84bc2-3e88-4e79-bbc7-4213e33de1aa-istio-envoy\") pod \"10b84bc2-3e88-4e79-bbc7-4213e33de1aa\" (UID: \"10b84bc2-3e88-4e79-bbc7-4213e33de1aa\") "
Sep 15 09:36:49.224378 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.224358    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10b84bc2-3e88-4e79-bbc7-4213e33de1aa-credential-socket\") pod \"10b84bc2-3e88-4e79-bbc7-4213e33de1aa\" (UID: \"10b84bc2-3e88-4e79-bbc7-4213e33de1aa\") "
Sep 15 09:36:49.224526 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.224385    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10b84bc2-3e88-4e79-bbc7-4213e33de1aa-workload-certs\") pod \"10b84bc2-3e88-4e79-bbc7-4213e33de1aa\" (UID: \"10b84bc2-3e88-4e79-bbc7-4213e33de1aa\") "
Sep 15 09:36:49.224526 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.224432    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10b84bc2-3e88-4e79-bbc7-4213e33de1aa-istio-token\") pod \"10b84bc2-3e88-4e79-bbc7-4213e33de1aa\" (UID: \"10b84bc2-3e88-4e79-bbc7-4213e33de1aa\") "
Sep 15 09:36:49.224526 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.224480    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10b84bc2-3e88-4e79-bbc7-4213e33de1aa-istio-data\") pod \"10b84bc2-3e88-4e79-bbc7-4213e33de1aa\" (UID: \"10b84bc2-3e88-4e79-bbc7-4213e33de1aa\") "
Sep 15 09:36:49.224526 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.224523    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10b84bc2-3e88-4e79-bbc7-4213e33de1aa-workload-socket\") pod \"10b84bc2-3e88-4e79-bbc7-4213e33de1aa\" (UID: \"10b84bc2-3e88-4e79-bbc7-4213e33de1aa\") "
Sep 15 09:36:49.224739 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.224617    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10b84bc2-3e88-4e79-bbc7-4213e33de1aa-istio-podinfo\") pod \"10b84bc2-3e88-4e79-bbc7-4213e33de1aa\" (UID: \"10b84bc2-3e88-4e79-bbc7-4213e33de1aa\") "
Sep 15 09:36:49.224739 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.224701    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10b84bc2-3e88-4e79-bbc7-4213e33de1aa-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "10b84bc2-3e88-4e79-bbc7-4213e33de1aa" (UID: "10b84bc2-3e88-4e79-bbc7-4213e33de1aa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:36:49.224739 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.224626    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10b84bc2-3e88-4e79-bbc7-4213e33de1aa-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "10b84bc2-3e88-4e79-bbc7-4213e33de1aa" (UID: "10b84bc2-3e88-4e79-bbc7-4213e33de1aa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:36:49.224902 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.224850    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10b84bc2-3e88-4e79-bbc7-4213e33de1aa-istio-data" (OuterVolumeSpecName: "istio-data") pod "10b84bc2-3e88-4e79-bbc7-4213e33de1aa" (UID: "10b84bc2-3e88-4e79-bbc7-4213e33de1aa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:36:49.225238 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.224992    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10b84bc2-3e88-4e79-bbc7-4213e33de1aa-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "10b84bc2-3e88-4e79-bbc7-4213e33de1aa" (UID: "10b84bc2-3e88-4e79-bbc7-4213e33de1aa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:36:49.225238 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.225005    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10b84bc2-3e88-4e79-bbc7-4213e33de1aa-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "10b84bc2-3e88-4e79-bbc7-4213e33de1aa" (UID: "10b84bc2-3e88-4e79-bbc7-4213e33de1aa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:36:49.225238 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.225149    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10b84bc2-3e88-4e79-bbc7-4213e33de1aa-istiod-ca-cert\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:36:49.225238 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.225172    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10b84bc2-3e88-4e79-bbc7-4213e33de1aa-credential-socket\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:36:49.225238 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.225188    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10b84bc2-3e88-4e79-bbc7-4213e33de1aa-workload-certs\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:36:49.225238 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.225202    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10b84bc2-3e88-4e79-bbc7-4213e33de1aa-istio-data\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:36:49.225238 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.225214    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10b84bc2-3e88-4e79-bbc7-4213e33de1aa-workload-socket\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:36:49.226540 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.226519    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10b84bc2-3e88-4e79-bbc7-4213e33de1aa-kube-api-access-g2874" (OuterVolumeSpecName: "kube-api-access-g2874") pod "10b84bc2-3e88-4e79-bbc7-4213e33de1aa" (UID: "10b84bc2-3e88-4e79-bbc7-4213e33de1aa"). InnerVolumeSpecName "kube-api-access-g2874". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:36:49.226708 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.226686    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/10b84bc2-3e88-4e79-bbc7-4213e33de1aa-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "10b84bc2-3e88-4e79-bbc7-4213e33de1aa" (UID: "10b84bc2-3e88-4e79-bbc7-4213e33de1aa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 09:36:49.226863 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.226846    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10b84bc2-3e88-4e79-bbc7-4213e33de1aa-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "10b84bc2-3e88-4e79-bbc7-4213e33de1aa" (UID: "10b84bc2-3e88-4e79-bbc7-4213e33de1aa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:36:49.226998 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.226976    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10b84bc2-3e88-4e79-bbc7-4213e33de1aa-istio-token" (OuterVolumeSpecName: "istio-token") pod "10b84bc2-3e88-4e79-bbc7-4213e33de1aa" (UID: "10b84bc2-3e88-4e79-bbc7-4213e33de1aa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:36:49.326076 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.326054    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10b84bc2-3e88-4e79-bbc7-4213e33de1aa-istio-podinfo\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:36:49.326076 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.326075    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2874\" (UniqueName: \"kubernetes.io/projected/10b84bc2-3e88-4e79-bbc7-4213e33de1aa-kube-api-access-g2874\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:36:49.326211 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.326085    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10b84bc2-3e88-4e79-bbc7-4213e33de1aa-istio-envoy\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:36:49.326211 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.326093    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10b84bc2-3e88-4e79-bbc7-4213e33de1aa-istio-token\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:36:49.617498 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.617415    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-312334ca-rqzdc"]
Sep 15 09:36:49.617836 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.617822    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be2cea8a-9e74-452d-873c-a4cdabfcc3bf" containerName="revoke-keys"
Sep 15 09:36:49.617886 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.617838    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="be2cea8a-9e74-452d-873c-a4cdabfcc3bf" containerName="revoke-keys"
Sep 15 09:36:49.617886 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.617854    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10b84bc2-3e88-4e79-bbc7-4213e33de1aa" containerName="istio-proxy"
Sep 15 09:36:49.617886 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.617860    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="10b84bc2-3e88-4e79-bbc7-4213e33de1aa" containerName="istio-proxy"
Sep 15 09:36:49.617886 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.617871    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb558fdf-7208-4fae-bcf2-c92b8874e2c2" containerName="istio-proxy"
Sep 15 09:36:49.617886 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.617877    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb558fdf-7208-4fae-bcf2-c92b8874e2c2" containerName="istio-proxy"
Sep 15 09:36:49.617886 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.617888    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10b84bc2-3e88-4e79-bbc7-4213e33de1aa" containerName="istio-proxy"
Sep 15 09:36:49.618091 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.617893    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="10b84bc2-3e88-4e79-bbc7-4213e33de1aa" containerName="istio-proxy"
Sep 15 09:36:49.618091 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.617899    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb558fdf-7208-4fae-bcf2-c92b8874e2c2" containerName="istio-proxy"
Sep 15 09:36:49.618091 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.617904    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb558fdf-7208-4fae-bcf2-c92b8874e2c2" containerName="istio-proxy"
Sep 15 09:36:49.618091 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.617977    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="10b84bc2-3e88-4e79-bbc7-4213e33de1aa" containerName="istio-proxy"
Sep 15 09:36:49.618091 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.617985    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb558fdf-7208-4fae-bcf2-c92b8874e2c2" containerName="istio-proxy"
Sep 15 09:36:49.618091 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.617990    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="10b84bc2-3e88-4e79-bbc7-4213e33de1aa" containerName="istio-proxy"
Sep 15 09:36:49.618091 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.617996    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="be2cea8a-9e74-452d-873c-a4cdabfcc3bf" containerName="revoke-keys"
Sep 15 09:36:49.621237 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.621221    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-312334ca-rqzdc"
Sep 15 09:36:49.624111 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.624087    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 09:36:49.624642 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.624614    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cbqnn\""
Sep 15 09:36:49.627998 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.627977    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-312334ca-rqzdc"]
Sep 15 09:36:49.728873 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.728839    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5a7f0f3-d166-4ad9-a974-43c2926f2437-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-312334ca-rqzdc\" (UID: \"a5a7f0f3-d166-4ad9-a974-43c2926f2437\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-312334ca-rqzdc"
Sep 15 09:36:49.830127 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.830098    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5a7f0f3-d166-4ad9-a974-43c2926f2437-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-312334ca-rqzdc\" (UID: \"a5a7f0f3-d166-4ad9-a974-43c2926f2437\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-312334ca-rqzdc"
Sep 15 09:36:49.830688 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.830668    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5a7f0f3-d166-4ad9-a974-43c2926f2437-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-312334ca-rqzdc\" (UID: \"a5a7f0f3-d166-4ad9-a974-43c2926f2437\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-312334ca-rqzdc"
Sep 15 09:36:49.933459 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.933384    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-312334ca-rqzdc"
Sep 15 09:36:49.941578 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.941556    2578 generic.go:356] "Generic (PLEG): container finished" podID="10b84bc2-3e88-4e79-bbc7-4213e33de1aa" containerID="992659facf053d05e4694a6eab30b42f7b361e0ae1f93ea6c415e72cee6b7902" exitCode=0
Sep 15 09:36:49.941696 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.941610    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b"
Sep 15 09:36:49.941696 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.941640    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b" event={"ID":"10b84bc2-3e88-4e79-bbc7-4213e33de1aa","Type":"ContainerDied","Data":"992659facf053d05e4694a6eab30b42f7b361e0ae1f93ea6c415e72cee6b7902"}
Sep 15 09:36:49.941779 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.941698    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b" event={"ID":"10b84bc2-3e88-4e79-bbc7-4213e33de1aa","Type":"ContainerDied","Data":"86b342323d40f0c41b44a37d8254e5d333841606d14358e28b5ddf0ae801704f"}
Sep 15 09:36:49.941779 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.941713    2578 scope.go:117] "RemoveContainer" containerID="992659facf053d05e4694a6eab30b42f7b361e0ae1f93ea6c415e72cee6b7902"
Sep 15 09:36:49.965488 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.965462    2578 scope.go:117] "RemoveContainer" containerID="a73c640b0879857839bfc538c071dada31bd7f221bcf1ca28ad4e4fc6ecd3bbd"
Sep 15 09:36:49.974834 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.974292    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b"]
Sep 15 09:36:49.975103 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.975083    2578 scope.go:117] "RemoveContainer" containerID="992659facf053d05e4694a6eab30b42f7b361e0ae1f93ea6c415e72cee6b7902"
Sep 15 09:36:49.975617 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:36:49.975594    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"992659facf053d05e4694a6eab30b42f7b361e0ae1f93ea6c415e72cee6b7902\": container with ID starting with 992659facf053d05e4694a6eab30b42f7b361e0ae1f93ea6c415e72cee6b7902 not found: ID does not exist" containerID="992659facf053d05e4694a6eab30b42f7b361e0ae1f93ea6c415e72cee6b7902"
Sep 15 09:36:49.975782 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.975749    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"992659facf053d05e4694a6eab30b42f7b361e0ae1f93ea6c415e72cee6b7902"} err="failed to get container status \"992659facf053d05e4694a6eab30b42f7b361e0ae1f93ea6c415e72cee6b7902\": rpc error: code = NotFound desc = could not find container \"992659facf053d05e4694a6eab30b42f7b361e0ae1f93ea6c415e72cee6b7902\": container with ID starting with 992659facf053d05e4694a6eab30b42f7b361e0ae1f93ea6c415e72cee6b7902 not found: ID does not exist"
Sep 15 09:36:49.975782 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.975781    2578 scope.go:117] "RemoveContainer" containerID="a73c640b0879857839bfc538c071dada31bd7f221bcf1ca28ad4e4fc6ecd3bbd"
Sep 15 09:36:49.976314 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:36:49.976282    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a73c640b0879857839bfc538c071dada31bd7f221bcf1ca28ad4e4fc6ecd3bbd\": container with ID starting with a73c640b0879857839bfc538c071dada31bd7f221bcf1ca28ad4e4fc6ecd3bbd not found: ID does not exist" containerID="a73c640b0879857839bfc538c071dada31bd7f221bcf1ca28ad4e4fc6ecd3bbd"
Sep 15 09:36:49.976414 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.976327    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a73c640b0879857839bfc538c071dada31bd7f221bcf1ca28ad4e4fc6ecd3bbd"} err="failed to get container status \"a73c640b0879857839bfc538c071dada31bd7f221bcf1ca28ad4e4fc6ecd3bbd\": rpc error: code = NotFound desc = could not find container \"a73c640b0879857839bfc538c071dada31bd7f221bcf1ca28ad4e4fc6ecd3bbd\": container with ID starting with a73c640b0879857839bfc538c071dada31bd7f221bcf1ca28ad4e4fc6ecd3bbd not found: ID does not exist"
Sep 15 09:36:49.978581 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:49.978563    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-0e280a-openshift-default-566d79b496-ttz4b"]
Sep 15 09:36:50.122279 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:50.122245    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10b84bc2-3e88-4e79-bbc7-4213e33de1aa" path="/var/lib/kubelet/pods/10b84bc2-3e88-4e79-bbc7-4213e33de1aa/volumes"
Sep 15 09:36:50.208114 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:50.208088    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-312334ca-rqzdc"]
Sep 15 09:36:50.209184 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:36:50.209160    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5a7f0f3_d166_4ad9_a974_43c2926f2437.slice/crio-20ee368efca7d93a566fa94df510f79bfc5c05a232063d66a4c57b572f554695 WatchSource:0}: Error finding container 20ee368efca7d93a566fa94df510f79bfc5c05a232063d66a4c57b572f554695: Status 404 returned error can't find the container with id 20ee368efca7d93a566fa94df510f79bfc5c05a232063d66a4c57b572f554695
Sep 15 09:36:50.949062 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:50.949037    2578 generic.go:356] "Generic (PLEG): container finished" podID="a5a7f0f3-d166-4ad9-a974-43c2926f2437" containerID="c070d2758a48ae26be3ff18649732cba4ee3b2c70366a72929df22f96f0fa9b9" exitCode=0
Sep 15 09:36:50.949199 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:50.949134    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-312334ca-rqzdc" event={"ID":"a5a7f0f3-d166-4ad9-a974-43c2926f2437","Type":"ContainerDied","Data":"c070d2758a48ae26be3ff18649732cba4ee3b2c70366a72929df22f96f0fa9b9"}
Sep 15 09:36:50.949258 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:50.949197    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-312334ca-rqzdc" event={"ID":"a5a7f0f3-d166-4ad9-a974-43c2926f2437","Type":"ContainerStarted","Data":"20ee368efca7d93a566fa94df510f79bfc5c05a232063d66a4c57b572f554695"}
Sep 15 09:36:52.091090 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:52.091067    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-312334ca-rqzdc"
Sep 15 09:36:52.154049 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:52.154023    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5a7f0f3-d166-4ad9-a974-43c2926f2437-maas-api-service-ca\") pod \"a5a7f0f3-d166-4ad9-a974-43c2926f2437\" (UID: \"a5a7f0f3-d166-4ad9-a974-43c2926f2437\") "
Sep 15 09:36:52.154324 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:52.154304    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5a7f0f3-d166-4ad9-a974-43c2926f2437-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a5a7f0f3-d166-4ad9-a974-43c2926f2437" (UID: "a5a7f0f3-d166-4ad9-a974-43c2926f2437"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:36:52.213867 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:52.213792    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-864b9a-65c8744b9d-btmfr"]
Sep 15 09:36:52.214388 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:52.214362    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5a7f0f3-d166-4ad9-a974-43c2926f2437" containerName="revoke-keys"
Sep 15 09:36:52.214388 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:52.214383    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5a7f0f3-d166-4ad9-a974-43c2926f2437" containerName="revoke-keys"
Sep 15 09:36:52.214576 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:52.214452    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5a7f0f3-d166-4ad9-a974-43c2926f2437" containerName="revoke-keys"
Sep 15 09:36:52.214576 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:52.214460    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb558fdf-7208-4fae-bcf2-c92b8874e2c2" containerName="istio-proxy"
Sep 15 09:36:52.217405 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:52.217390    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-864b9a-65c8744b9d-btmfr"
Sep 15 09:36:52.219922 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:52.219900    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-hb4ml\""
Sep 15 09:36:52.220059 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:52.219920    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 15 09:36:52.220059 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:52.219905    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-864b9a-serving-cert\""
Sep 15 09:36:52.220183 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:52.220171    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 15 09:36:52.227836 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:52.227816    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-864b9a-65c8744b9d-btmfr"]
Sep 15 09:36:52.254898 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:52.254874    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5202e88-6619-4158-b332-04e8ed44c4ca-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-864b9a-65c8744b9d-btmfr\" (UID: \"f5202e88-6619-4158-b332-04e8ed44c4ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-864b9a-65c8744b9d-btmfr"
Sep 15 09:36:52.255051 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:52.254905    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5202e88-6619-4158-b332-04e8ed44c4ca-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-864b9a-65c8744b9d-btmfr\" (UID: \"f5202e88-6619-4158-b332-04e8ed44c4ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-864b9a-65c8744b9d-btmfr"
Sep 15 09:36:52.255051 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:52.254923    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5202e88-6619-4158-b332-04e8ed44c4ca-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-864b9a-65c8744b9d-btmfr\" (UID: \"f5202e88-6619-4158-b332-04e8ed44c4ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-864b9a-65c8744b9d-btmfr"
Sep 15 09:36:52.255051 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:52.255019    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n27kx\" (UniqueName: \"kubernetes.io/projected/f5202e88-6619-4158-b332-04e8ed44c4ca-kube-api-access-n27kx\") pod \"maas-api-e2e-shared-a-w3-864b9a-65c8744b9d-btmfr\" (UID: \"f5202e88-6619-4158-b332-04e8ed44c4ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-864b9a-65c8744b9d-btmfr"
Sep 15 09:36:52.255219 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:52.255090    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5a7f0f3-d166-4ad9-a974-43c2926f2437-maas-api-service-ca\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:36:52.355524 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:52.355497    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5202e88-6619-4158-b332-04e8ed44c4ca-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-864b9a-65c8744b9d-btmfr\" (UID: \"f5202e88-6619-4158-b332-04e8ed44c4ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-864b9a-65c8744b9d-btmfr"
Sep 15 09:36:52.355671 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:52.355528    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5202e88-6619-4158-b332-04e8ed44c4ca-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-864b9a-65c8744b9d-btmfr\" (UID: \"f5202e88-6619-4158-b332-04e8ed44c4ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-864b9a-65c8744b9d-btmfr"
Sep 15 09:36:52.355671 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:52.355545    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5202e88-6619-4158-b332-04e8ed44c4ca-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-864b9a-65c8744b9d-btmfr\" (UID: \"f5202e88-6619-4158-b332-04e8ed44c4ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-864b9a-65c8744b9d-btmfr"
Sep 15 09:36:52.355671 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:52.355586    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n27kx\" (UniqueName: \"kubernetes.io/projected/f5202e88-6619-4158-b332-04e8ed44c4ca-kube-api-access-n27kx\") pod \"maas-api-e2e-shared-a-w3-864b9a-65c8744b9d-btmfr\" (UID: \"f5202e88-6619-4158-b332-04e8ed44c4ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-864b9a-65c8744b9d-btmfr"
Sep 15 09:36:52.356126 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:52.356108    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5202e88-6619-4158-b332-04e8ed44c4ca-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-864b9a-65c8744b9d-btmfr\" (UID: \"f5202e88-6619-4158-b332-04e8ed44c4ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-864b9a-65c8744b9d-btmfr"
Sep 15 09:36:52.357913 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:52.357893    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5202e88-6619-4158-b332-04e8ed44c4ca-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-864b9a-65c8744b9d-btmfr\" (UID: \"f5202e88-6619-4158-b332-04e8ed44c4ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-864b9a-65c8744b9d-btmfr"
Sep 15 09:36:52.358037 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:52.357971    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5202e88-6619-4158-b332-04e8ed44c4ca-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-864b9a-65c8744b9d-btmfr\" (UID: \"f5202e88-6619-4158-b332-04e8ed44c4ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-864b9a-65c8744b9d-btmfr"
Sep 15 09:36:52.364164 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:52.364142    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n27kx\" (UniqueName: \"kubernetes.io/projected/f5202e88-6619-4158-b332-04e8ed44c4ca-kube-api-access-n27kx\") pod \"maas-api-e2e-shared-a-w3-864b9a-65c8744b9d-btmfr\" (UID: \"f5202e88-6619-4158-b332-04e8ed44c4ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-864b9a-65c8744b9d-btmfr"
Sep 15 09:36:52.531898 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:52.531819    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-864b9a-65c8744b9d-btmfr"
Sep 15 09:36:52.807849 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:52.807826    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-864b9a-65c8744b9d-btmfr"]
Sep 15 09:36:52.809449 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:36:52.809424    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5202e88_6619_4158_b332_04e8ed44c4ca.slice/crio-04e2356c311fa2e1ae6de5edeb62e71e8cb03ca2008feae3cf2bdb187fb7b8ba WatchSource:0}: Error finding container 04e2356c311fa2e1ae6de5edeb62e71e8cb03ca2008feae3cf2bdb187fb7b8ba: Status 404 returned error can't find the container with id 04e2356c311fa2e1ae6de5edeb62e71e8cb03ca2008feae3cf2bdb187fb7b8ba
Sep 15 09:36:52.811380 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:52.811364    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 09:36:52.963075 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:52.963044    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-864b9a-567c79f95-lrm59"]
Sep 15 09:36:52.965204 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:52.965183    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-312334ca-rqzdc"
Sep 15 09:36:52.967970 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:52.967930    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-864b9a-65c8744b9d-btmfr" event={"ID":"f5202e88-6619-4158-b332-04e8ed44c4ca","Type":"ContainerStarted","Data":"04e2356c311fa2e1ae6de5edeb62e71e8cb03ca2008feae3cf2bdb187fb7b8ba"}
Sep 15 09:36:52.968069 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:52.967977    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-312334ca-rqzdc" event={"ID":"a5a7f0f3-d166-4ad9-a974-43c2926f2437","Type":"ContainerDied","Data":"20ee368efca7d93a566fa94df510f79bfc5c05a232063d66a4c57b572f554695"}
Sep 15 09:36:52.968069 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:52.967998    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="20ee368efca7d93a566fa94df510f79bfc5c05a232063d66a4c57b572f554695"
Sep 15 09:36:52.968069 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:52.968010    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-864b9a-567c79f95-lrm59"
Sep 15 09:36:52.970346 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:52.970330    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-864b9a-dockercfg-5bhbl\""
Sep 15 09:36:52.970480 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:52.970364    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-864b9a\""
Sep 15 09:36:52.974514 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:52.974496    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-864b9a-567c79f95-lrm59"]
Sep 15 09:36:53.062712 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:53.062605    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/92c84132-4ec6-486f-937b-97cc89a1f2bd-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-864b9a-567c79f95-lrm59\" (UID: \"92c84132-4ec6-486f-937b-97cc89a1f2bd\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-864b9a-567c79f95-lrm59"
Sep 15 09:36:53.062883 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:53.062770    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgqh8\" (UniqueName: \"kubernetes.io/projected/92c84132-4ec6-486f-937b-97cc89a1f2bd-kube-api-access-cgqh8\") pod \"payload-processing-e2e-shared-a-w3-864b9a-567c79f95-lrm59\" (UID: \"92c84132-4ec6-486f-937b-97cc89a1f2bd\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-864b9a-567c79f95-lrm59"
Sep 15 09:36:53.163831 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:53.163796    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgqh8\" (UniqueName: \"kubernetes.io/projected/92c84132-4ec6-486f-937b-97cc89a1f2bd-kube-api-access-cgqh8\") pod \"payload-processing-e2e-shared-a-w3-864b9a-567c79f95-lrm59\" (UID: \"92c84132-4ec6-486f-937b-97cc89a1f2bd\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-864b9a-567c79f95-lrm59"
Sep 15 09:36:53.164193 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:53.163882    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/92c84132-4ec6-486f-937b-97cc89a1f2bd-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-864b9a-567c79f95-lrm59\" (UID: \"92c84132-4ec6-486f-937b-97cc89a1f2bd\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-864b9a-567c79f95-lrm59"
Sep 15 09:36:53.164580 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:53.164560    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/92c84132-4ec6-486f-937b-97cc89a1f2bd-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-864b9a-567c79f95-lrm59\" (UID: \"92c84132-4ec6-486f-937b-97cc89a1f2bd\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-864b9a-567c79f95-lrm59"
Sep 15 09:36:53.171786 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:53.171761    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgqh8\" (UniqueName: \"kubernetes.io/projected/92c84132-4ec6-486f-937b-97cc89a1f2bd-kube-api-access-cgqh8\") pod \"payload-processing-e2e-shared-a-w3-864b9a-567c79f95-lrm59\" (UID: \"92c84132-4ec6-486f-937b-97cc89a1f2bd\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-864b9a-567c79f95-lrm59"
Sep 15 09:36:53.280940 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:53.280914    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-864b9a-567c79f95-lrm59"
Sep 15 09:36:53.559355 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:53.559329    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-864b9a-567c79f95-lrm59"]
Sep 15 09:36:53.560791 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:36:53.560705    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92c84132_4ec6_486f_937b_97cc89a1f2bd.slice/crio-7b3b4a902ab3ccca5d28d11478e2505278fa5bd14e62458d7328ea1347c8dfa3 WatchSource:0}: Error finding container 7b3b4a902ab3ccca5d28d11478e2505278fa5bd14e62458d7328ea1347c8dfa3: Status 404 returned error can't find the container with id 7b3b4a902ab3ccca5d28d11478e2505278fa5bd14e62458d7328ea1347c8dfa3
Sep 15 09:36:53.977775 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:53.977733    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-864b9a-567c79f95-lrm59" event={"ID":"92c84132-4ec6-486f-937b-97cc89a1f2bd","Type":"ContainerStarted","Data":"677e806c0eb8ae97761366f22cb47842d0e9572d9f9a915e3b902016f15f7b80"}
Sep 15 09:36:53.977992 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:53.977799    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-864b9a-567c79f95-lrm59" event={"ID":"92c84132-4ec6-486f-937b-97cc89a1f2bd","Type":"ContainerStarted","Data":"7b3b4a902ab3ccca5d28d11478e2505278fa5bd14e62458d7328ea1347c8dfa3"}
Sep 15 09:36:53.977992 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:53.977867    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-864b9a-567c79f95-lrm59"
Sep 15 09:36:53.996550 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:53.996430    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-864b9a-567c79f95-lrm59" podStartSLOduration=1.9964076450000001 podStartE2EDuration="1.996407645s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:36:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:36:53.992841972 +0000 UTC m=+1358.331287247" watchObservedRunningTime="2026-09-15 09:36:53.996407645 +0000 UTC m=+1358.334852921"
Sep 15 09:36:55.999815 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:55.999777    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-864b9a-65c8744b9d-btmfr" event={"ID":"f5202e88-6619-4158-b332-04e8ed44c4ca","Type":"ContainerStarted","Data":"8261830723d255583c1b34671f6ad6041ac7e5de71c9843fc5808509c719eb7a"}
Sep 15 09:36:56.000229 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:55.999838    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-864b9a-65c8744b9d-btmfr"
Sep 15 09:36:56.017390 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:36:56.017339    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-864b9a-65c8744b9d-btmfr" podStartSLOduration=1.592944359 podStartE2EDuration="4.017321428s" totalImagesPullingTime="2.424377069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:36:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:36:56.014393535 +0000 UTC m=+1360.352838813" watchObservedRunningTime="2026-09-15 09:36:56.017321428 +0000 UTC m=+1360.355766702"
Sep 15 09:37:02.018959 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:02.018914    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-864b9a-65c8744b9d-btmfr"
Sep 15 09:37:04.993920 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:04.993889    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-864b9a-567c79f95-lrm59"
Sep 15 09:37:05.583228 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:05.583194    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-312334ca-8488695b5-mgctt"]
Sep 15 09:37:05.583471 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:05.583443    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-312334ca-8488695b5-mgctt" podUID="14ee8f8e-a828-4be9-8267-80cd83f1a74b" containerName="payload-processing" containerID="cri-o://291d8ddffdfe804f0facfc011681e4ce3b866178e0bfd56c7634f0571acaff42" gracePeriod=30
Sep 15 09:37:05.763921 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:05.763889    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-312334ca-rqzdc"]
Sep 15 09:37:05.770513 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:05.770484    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-312334ca-rqzdc"]
Sep 15 09:37:05.839551 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:05.839498    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-312334ca-8488695b5-mgctt"
Sep 15 09:37:05.985490 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:05.985458    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2b2kg\" (UniqueName: \"kubernetes.io/projected/14ee8f8e-a828-4be9-8267-80cd83f1a74b-kube-api-access-2b2kg\") pod \"14ee8f8e-a828-4be9-8267-80cd83f1a74b\" (UID: \"14ee8f8e-a828-4be9-8267-80cd83f1a74b\") "
Sep 15 09:37:05.985677 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:05.985508    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14ee8f8e-a828-4be9-8267-80cd83f1a74b-plugins-config-volume\") pod \"14ee8f8e-a828-4be9-8267-80cd83f1a74b\" (UID: \"14ee8f8e-a828-4be9-8267-80cd83f1a74b\") "
Sep 15 09:37:05.985856 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:05.985832    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14ee8f8e-a828-4be9-8267-80cd83f1a74b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "14ee8f8e-a828-4be9-8267-80cd83f1a74b" (UID: "14ee8f8e-a828-4be9-8267-80cd83f1a74b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:37:05.985939 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:05.985923    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/14ee8f8e-a828-4be9-8267-80cd83f1a74b-plugins-config-volume\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:37:05.987492 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:05.987469    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14ee8f8e-a828-4be9-8267-80cd83f1a74b-kube-api-access-2b2kg" (OuterVolumeSpecName: "kube-api-access-2b2kg") pod "14ee8f8e-a828-4be9-8267-80cd83f1a74b" (UID: "14ee8f8e-a828-4be9-8267-80cd83f1a74b"). InnerVolumeSpecName "kube-api-access-2b2kg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:37:06.076514 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:06.076488    2578 generic.go:356] "Generic (PLEG): container finished" podID="14ee8f8e-a828-4be9-8267-80cd83f1a74b" containerID="291d8ddffdfe804f0facfc011681e4ce3b866178e0bfd56c7634f0571acaff42" exitCode=0
Sep 15 09:37:06.076871 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:06.076534    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-312334ca-8488695b5-mgctt"
Sep 15 09:37:06.076871 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:06.076540    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-312334ca-8488695b5-mgctt" event={"ID":"14ee8f8e-a828-4be9-8267-80cd83f1a74b","Type":"ContainerDied","Data":"291d8ddffdfe804f0facfc011681e4ce3b866178e0bfd56c7634f0571acaff42"}
Sep 15 09:37:06.076871 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:06.076582    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-312334ca-8488695b5-mgctt" event={"ID":"14ee8f8e-a828-4be9-8267-80cd83f1a74b","Type":"ContainerDied","Data":"3744b96b5a743b7f0c22018704bbea83531949192ff35e900fc952baece07538"}
Sep 15 09:37:06.076871 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:06.076603    2578 scope.go:117] "RemoveContainer" containerID="291d8ddffdfe804f0facfc011681e4ce3b866178e0bfd56c7634f0571acaff42"
Sep 15 09:37:06.085985 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:06.085965    2578 scope.go:117] "RemoveContainer" containerID="291d8ddffdfe804f0facfc011681e4ce3b866178e0bfd56c7634f0571acaff42"
Sep 15 09:37:06.086267 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:37:06.086245    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"291d8ddffdfe804f0facfc011681e4ce3b866178e0bfd56c7634f0571acaff42\": container with ID starting with 291d8ddffdfe804f0facfc011681e4ce3b866178e0bfd56c7634f0571acaff42 not found: ID does not exist" containerID="291d8ddffdfe804f0facfc011681e4ce3b866178e0bfd56c7634f0571acaff42"
Sep 15 09:37:06.086335 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:06.086274    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"291d8ddffdfe804f0facfc011681e4ce3b866178e0bfd56c7634f0571acaff42"} err="failed to get container status \"291d8ddffdfe804f0facfc011681e4ce3b866178e0bfd56c7634f0571acaff42\": rpc error: code = NotFound desc = could not find container \"291d8ddffdfe804f0facfc011681e4ce3b866178e0bfd56c7634f0571acaff42\": container with ID starting with 291d8ddffdfe804f0facfc011681e4ce3b866178e0bfd56c7634f0571acaff42 not found: ID does not exist"
Sep 15 09:37:06.086416 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:06.086399    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2b2kg\" (UniqueName: \"kubernetes.io/projected/14ee8f8e-a828-4be9-8267-80cd83f1a74b-kube-api-access-2b2kg\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:37:06.099521 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:06.099470    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-312334ca-8488695b5-mgctt"]
Sep 15 09:37:06.103484 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:06.103454    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-312334ca-8488695b5-mgctt"]
Sep 15 09:37:06.124112 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:06.124090    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14ee8f8e-a828-4be9-8267-80cd83f1a74b" path="/var/lib/kubelet/pods/14ee8f8e-a828-4be9-8267-80cd83f1a74b/volumes"
Sep 15 09:37:06.124417 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:06.124404    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5a7f0f3-d166-4ad9-a974-43c2926f2437" path="/var/lib/kubelet/pods/a5a7f0f3-d166-4ad9-a974-43c2926f2437/volumes"
Sep 15 09:37:13.587275 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:13.587244    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm"]
Sep 15 09:37:13.587653 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:13.587635    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14ee8f8e-a828-4be9-8267-80cd83f1a74b" containerName="payload-processing"
Sep 15 09:37:13.587653 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:13.587647    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="14ee8f8e-a828-4be9-8267-80cd83f1a74b" containerName="payload-processing"
Sep 15 09:37:13.587733 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:13.587723    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="14ee8f8e-a828-4be9-8267-80cd83f1a74b" containerName="payload-processing"
Sep 15 09:37:13.592520 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:13.592500    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm"
Sep 15 09:37:13.598480 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:13.598460    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-b283ee-openshift-default-dockercfg-csxnj\""
Sep 15 09:37:13.608969 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:13.608927    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm"]
Sep 15 09:37:13.762373 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:13.762339    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/124c68f3-c166-43b9-bfef-d5ba1b8fff7d-workload-certs\") pod \"e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm\" (UID: \"124c68f3-c166-43b9-bfef-d5ba1b8fff7d\") " pod="openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm"
Sep 15 09:37:13.762564 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:13.762398    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/124c68f3-c166-43b9-bfef-d5ba1b8fff7d-workload-socket\") pod \"e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm\" (UID: \"124c68f3-c166-43b9-bfef-d5ba1b8fff7d\") " pod="openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm"
Sep 15 09:37:13.762564 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:13.762471    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/124c68f3-c166-43b9-bfef-d5ba1b8fff7d-credential-socket\") pod \"e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm\" (UID: \"124c68f3-c166-43b9-bfef-d5ba1b8fff7d\") " pod="openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm"
Sep 15 09:37:13.762564 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:13.762542    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/124c68f3-c166-43b9-bfef-d5ba1b8fff7d-istio-data\") pod \"e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm\" (UID: \"124c68f3-c166-43b9-bfef-d5ba1b8fff7d\") " pod="openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm"
Sep 15 09:37:13.762730 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:13.762568    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cvgg\" (UniqueName: \"kubernetes.io/projected/124c68f3-c166-43b9-bfef-d5ba1b8fff7d-kube-api-access-4cvgg\") pod \"e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm\" (UID: \"124c68f3-c166-43b9-bfef-d5ba1b8fff7d\") " pod="openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm"
Sep 15 09:37:13.762730 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:13.762590    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/124c68f3-c166-43b9-bfef-d5ba1b8fff7d-istio-envoy\") pod \"e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm\" (UID: \"124c68f3-c166-43b9-bfef-d5ba1b8fff7d\") " pod="openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm"
Sep 15 09:37:13.762730 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:13.762670    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/124c68f3-c166-43b9-bfef-d5ba1b8fff7d-istiod-ca-cert\") pod \"e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm\" (UID: \"124c68f3-c166-43b9-bfef-d5ba1b8fff7d\") " pod="openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm"
Sep 15 09:37:13.762730 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:13.762706    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/124c68f3-c166-43b9-bfef-d5ba1b8fff7d-istio-token\") pod \"e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm\" (UID: \"124c68f3-c166-43b9-bfef-d5ba1b8fff7d\") " pod="openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm"
Sep 15 09:37:13.762871 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:13.762745    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/124c68f3-c166-43b9-bfef-d5ba1b8fff7d-istio-podinfo\") pod \"e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm\" (UID: \"124c68f3-c166-43b9-bfef-d5ba1b8fff7d\") " pod="openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm"
Sep 15 09:37:13.864060 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:13.863996    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/124c68f3-c166-43b9-bfef-d5ba1b8fff7d-istiod-ca-cert\") pod \"e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm\" (UID: \"124c68f3-c166-43b9-bfef-d5ba1b8fff7d\") " pod="openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm"
Sep 15 09:37:13.864060 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:13.864028    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/124c68f3-c166-43b9-bfef-d5ba1b8fff7d-istio-token\") pod \"e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm\" (UID: \"124c68f3-c166-43b9-bfef-d5ba1b8fff7d\") " pod="openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm"
Sep 15 09:37:13.864262 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:13.864061    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/124c68f3-c166-43b9-bfef-d5ba1b8fff7d-istio-podinfo\") pod \"e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm\" (UID: \"124c68f3-c166-43b9-bfef-d5ba1b8fff7d\") " pod="openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm"
Sep 15 09:37:13.864262 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:13.864137    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/124c68f3-c166-43b9-bfef-d5ba1b8fff7d-workload-certs\") pod \"e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm\" (UID: \"124c68f3-c166-43b9-bfef-d5ba1b8fff7d\") " pod="openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm"
Sep 15 09:37:13.864262 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:13.864189    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/124c68f3-c166-43b9-bfef-d5ba1b8fff7d-workload-socket\") pod \"e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm\" (UID: \"124c68f3-c166-43b9-bfef-d5ba1b8fff7d\") " pod="openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm"
Sep 15 09:37:13.864262 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:13.864223    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/124c68f3-c166-43b9-bfef-d5ba1b8fff7d-credential-socket\") pod \"e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm\" (UID: \"124c68f3-c166-43b9-bfef-d5ba1b8fff7d\") " pod="openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm"
Sep 15 09:37:13.864472 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:13.864293    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/124c68f3-c166-43b9-bfef-d5ba1b8fff7d-istio-data\") pod \"e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm\" (UID: \"124c68f3-c166-43b9-bfef-d5ba1b8fff7d\") " pod="openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm"
Sep 15 09:37:13.864472 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:13.864318    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cvgg\" (UniqueName: \"kubernetes.io/projected/124c68f3-c166-43b9-bfef-d5ba1b8fff7d-kube-api-access-4cvgg\") pod \"e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm\" (UID: \"124c68f3-c166-43b9-bfef-d5ba1b8fff7d\") " pod="openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm"
Sep 15 09:37:13.864472 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:13.864349    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/124c68f3-c166-43b9-bfef-d5ba1b8fff7d-istio-envoy\") pod \"e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm\" (UID: \"124c68f3-c166-43b9-bfef-d5ba1b8fff7d\") " pod="openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm"
Sep 15 09:37:13.864666 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:13.864630    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/124c68f3-c166-43b9-bfef-d5ba1b8fff7d-workload-socket\") pod \"e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm\" (UID: \"124c68f3-c166-43b9-bfef-d5ba1b8fff7d\") " pod="openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm"
Sep 15 09:37:13.864752 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:13.864671    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/124c68f3-c166-43b9-bfef-d5ba1b8fff7d-credential-socket\") pod \"e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm\" (UID: \"124c68f3-c166-43b9-bfef-d5ba1b8fff7d\") " pod="openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm"
Sep 15 09:37:13.864805 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:13.864782    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/124c68f3-c166-43b9-bfef-d5ba1b8fff7d-workload-certs\") pod \"e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm\" (UID: \"124c68f3-c166-43b9-bfef-d5ba1b8fff7d\") " pod="openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm"
Sep 15 09:37:13.864863 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:13.864832    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/124c68f3-c166-43b9-bfef-d5ba1b8fff7d-istio-data\") pod \"e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm\" (UID: \"124c68f3-c166-43b9-bfef-d5ba1b8fff7d\") " pod="openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm"
Sep 15 09:37:13.865152 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:13.865132    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/124c68f3-c166-43b9-bfef-d5ba1b8fff7d-istiod-ca-cert\") pod \"e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm\" (UID: \"124c68f3-c166-43b9-bfef-d5ba1b8fff7d\") " pod="openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm"
Sep 15 09:37:13.866632 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:13.866609    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/124c68f3-c166-43b9-bfef-d5ba1b8fff7d-istio-envoy\") pod \"e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm\" (UID: \"124c68f3-c166-43b9-bfef-d5ba1b8fff7d\") " pod="openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm"
Sep 15 09:37:13.866872 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:13.866850    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/124c68f3-c166-43b9-bfef-d5ba1b8fff7d-istio-podinfo\") pod \"e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm\" (UID: \"124c68f3-c166-43b9-bfef-d5ba1b8fff7d\") " pod="openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm"
Sep 15 09:37:13.872273 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:13.872250    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cvgg\" (UniqueName: \"kubernetes.io/projected/124c68f3-c166-43b9-bfef-d5ba1b8fff7d-kube-api-access-4cvgg\") pod \"e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm\" (UID: \"124c68f3-c166-43b9-bfef-d5ba1b8fff7d\") " pod="openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm"
Sep 15 09:37:13.873730 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:13.873709    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/124c68f3-c166-43b9-bfef-d5ba1b8fff7d-istio-token\") pod \"e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm\" (UID: \"124c68f3-c166-43b9-bfef-d5ba1b8fff7d\") " pod="openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm"
Sep 15 09:37:13.903741 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:13.903719    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm"
Sep 15 09:37:14.184912 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:14.184884    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm"]
Sep 15 09:37:14.185904 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:37:14.185877    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod124c68f3_c166_43b9_bfef_d5ba1b8fff7d.slice/crio-df7118eba7508435b638b9cb47248a3441ffba45ce0f2ac3f1d4b8adfdb2a85d WatchSource:0}: Error finding container df7118eba7508435b638b9cb47248a3441ffba45ce0f2ac3f1d4b8adfdb2a85d: Status 404 returned error can't find the container with id df7118eba7508435b638b9cb47248a3441ffba45ce0f2ac3f1d4b8adfdb2a85d
Sep 15 09:37:14.188145 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:14.188107    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:37:14.188239 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:14.188178    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:37:14.188239 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:14.188207    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:37:15.140664 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:15.140630    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm" event={"ID":"124c68f3-c166-43b9-bfef-d5ba1b8fff7d","Type":"ContainerStarted","Data":"0c24c350bba0c7e4cba790dca09f641d00c31f27cfba01f9f8929356da7f284d"}
Sep 15 09:37:15.141115 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:15.140682    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm" event={"ID":"124c68f3-c166-43b9-bfef-d5ba1b8fff7d","Type":"ContainerStarted","Data":"df7118eba7508435b638b9cb47248a3441ffba45ce0f2ac3f1d4b8adfdb2a85d"}
Sep 15 09:37:15.161179 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:15.161137    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm" podStartSLOduration=2.161121397 podStartE2EDuration="2.161121397s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:37:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:37:15.159519095 +0000 UTC m=+1379.497964372" watchObservedRunningTime="2026-09-15 09:37:15.161121397 +0000 UTC m=+1379.499566671"
Sep 15 09:37:15.904509 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:15.904479    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm"
Sep 15 09:37:15.909385 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:15.909362    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm"
Sep 15 09:37:16.146368 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:16.146339    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm"
Sep 15 09:37:16.147224 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:16.147204    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm"
Sep 15 09:37:16.325564 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:16.325539    2578 scope.go:117] "RemoveContainer" containerID="730e6170c0427a3481b46702df33af39dc3e5323613e131c3ffc7dd264251876"
Sep 15 09:37:16.334495 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:16.334478    2578 scope.go:117] "RemoveContainer" containerID="9fbe6223338c631cd5a7218833aca13dae36bdfc3a6ab4b366af5540434ab141"
Sep 15 09:37:16.342625 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:16.342606    2578 scope.go:117] "RemoveContainer" containerID="d71e1a17574d98d2f5b87bbe7fb8ade62055e2f51aa963646a6062aa9ab69dee"
Sep 15 09:37:25.879598 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:25.879560    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-c183a5/e2e-conflict-b-0b195997-kserve-858787f76f-r7h47"]
Sep 15 09:37:40.900299 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:40.900243    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-c183a5/e2e-conflict-b-0b195997-kserve-858787f76f-r7h47" podUID="d6696565-7769-4c30-90e3-826ebc19fe68" containerName="main" containerID="cri-o://f33238df5470590f56bc5108af1e05ec7a4ff05f8b78a36e3a9701995982b811" gracePeriod=45
Sep 15 09:37:41.157663 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:41.157639    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-c183a5/e2e-conflict-b-0b195997-kserve-858787f76f-r7h47"
Sep 15 09:37:41.226746 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:41.226716    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-flmlj\" (UniqueName: \"kubernetes.io/projected/d6696565-7769-4c30-90e3-826ebc19fe68-kube-api-access-flmlj\") pod \"d6696565-7769-4c30-90e3-826ebc19fe68\" (UID: \"d6696565-7769-4c30-90e3-826ebc19fe68\") "
Sep 15 09:37:41.226890 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:41.226770    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6696565-7769-4c30-90e3-826ebc19fe68-tls-certs\") pod \"d6696565-7769-4c30-90e3-826ebc19fe68\" (UID: \"d6696565-7769-4c30-90e3-826ebc19fe68\") "
Sep 15 09:37:41.226890 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:41.226801    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6696565-7769-4c30-90e3-826ebc19fe68-tmp-dir\") pod \"d6696565-7769-4c30-90e3-826ebc19fe68\" (UID: \"d6696565-7769-4c30-90e3-826ebc19fe68\") "
Sep 15 09:37:41.226890 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:41.226821    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6696565-7769-4c30-90e3-826ebc19fe68-home\") pod \"d6696565-7769-4c30-90e3-826ebc19fe68\" (UID: \"d6696565-7769-4c30-90e3-826ebc19fe68\") "
Sep 15 09:37:41.226890 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:41.226861    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6696565-7769-4c30-90e3-826ebc19fe68-model-cache\") pod \"d6696565-7769-4c30-90e3-826ebc19fe68\" (UID: \"d6696565-7769-4c30-90e3-826ebc19fe68\") "
Sep 15 09:37:41.227150 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:41.226983    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6696565-7769-4c30-90e3-826ebc19fe68-dshm\") pod \"d6696565-7769-4c30-90e3-826ebc19fe68\" (UID: \"d6696565-7769-4c30-90e3-826ebc19fe68\") "
Sep 15 09:37:41.227217 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:41.227140    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6696565-7769-4c30-90e3-826ebc19fe68-home" (OuterVolumeSpecName: "home") pod "d6696565-7769-4c30-90e3-826ebc19fe68" (UID: "d6696565-7769-4c30-90e3-826ebc19fe68"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:37:41.227217 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:41.227146    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6696565-7769-4c30-90e3-826ebc19fe68-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d6696565-7769-4c30-90e3-826ebc19fe68" (UID: "d6696565-7769-4c30-90e3-826ebc19fe68"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:37:41.227217 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:41.227186    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6696565-7769-4c30-90e3-826ebc19fe68-model-cache" (OuterVolumeSpecName: "model-cache") pod "d6696565-7769-4c30-90e3-826ebc19fe68" (UID: "d6696565-7769-4c30-90e3-826ebc19fe68"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:37:41.227532 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:41.227511    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6696565-7769-4c30-90e3-826ebc19fe68-tmp-dir\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:37:41.227610 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:41.227535    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6696565-7769-4c30-90e3-826ebc19fe68-home\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:37:41.227610 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:41.227549    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6696565-7769-4c30-90e3-826ebc19fe68-model-cache\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:37:41.229181 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:41.229156    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6696565-7769-4c30-90e3-826ebc19fe68-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d6696565-7769-4c30-90e3-826ebc19fe68" (UID: "d6696565-7769-4c30-90e3-826ebc19fe68"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:37:41.229277 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:41.229154    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6696565-7769-4c30-90e3-826ebc19fe68-dshm" (OuterVolumeSpecName: "dshm") pod "d6696565-7769-4c30-90e3-826ebc19fe68" (UID: "d6696565-7769-4c30-90e3-826ebc19fe68"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:37:41.229277 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:41.229202    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6696565-7769-4c30-90e3-826ebc19fe68-kube-api-access-flmlj" (OuterVolumeSpecName: "kube-api-access-flmlj") pod "d6696565-7769-4c30-90e3-826ebc19fe68" (UID: "d6696565-7769-4c30-90e3-826ebc19fe68"). InnerVolumeSpecName "kube-api-access-flmlj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:37:41.304568 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:41.304542    2578 generic.go:356] "Generic (PLEG): container finished" podID="d6696565-7769-4c30-90e3-826ebc19fe68" containerID="f33238df5470590f56bc5108af1e05ec7a4ff05f8b78a36e3a9701995982b811" exitCode=0
Sep 15 09:37:41.304683 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:41.304582    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-c183a5/e2e-conflict-b-0b195997-kserve-858787f76f-r7h47"
Sep 15 09:37:41.304683 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:41.304623    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-c183a5/e2e-conflict-b-0b195997-kserve-858787f76f-r7h47" event={"ID":"d6696565-7769-4c30-90e3-826ebc19fe68","Type":"ContainerDied","Data":"f33238df5470590f56bc5108af1e05ec7a4ff05f8b78a36e3a9701995982b811"}
Sep 15 09:37:41.304683 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:41.304665    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-c183a5/e2e-conflict-b-0b195997-kserve-858787f76f-r7h47" event={"ID":"d6696565-7769-4c30-90e3-826ebc19fe68","Type":"ContainerDied","Data":"c2646b095545d897141d62a7fb4af51485d4543cab9cf5e2d8ac3e2e9555ff02"}
Sep 15 09:37:41.304830 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:41.304687    2578 scope.go:117] "RemoveContainer" containerID="f33238df5470590f56bc5108af1e05ec7a4ff05f8b78a36e3a9701995982b811"
Sep 15 09:37:41.306326 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:41.306299    2578 generic.go:356] "Generic (PLEG): container finished" podID="124c68f3-c166-43b9-bfef-d5ba1b8fff7d" containerID="0c24c350bba0c7e4cba790dca09f641d00c31f27cfba01f9f8929356da7f284d" exitCode=0
Sep 15 09:37:41.306423 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:41.306382    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm" event={"ID":"124c68f3-c166-43b9-bfef-d5ba1b8fff7d","Type":"ContainerDied","Data":"0c24c350bba0c7e4cba790dca09f641d00c31f27cfba01f9f8929356da7f284d"}
Sep 15 09:37:41.306861 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:41.306844    2578 scope.go:117] "RemoveContainer" containerID="0c24c350bba0c7e4cba790dca09f641d00c31f27cfba01f9f8929356da7f284d"
Sep 15 09:37:41.308215 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:41.308185    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:37:41.308306 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:41.308257    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:37:41.308306 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:41.308289    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:37:41.315581 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:41.315562    2578 scope.go:117] "RemoveContainer" containerID="f33238df5470590f56bc5108af1e05ec7a4ff05f8b78a36e3a9701995982b811"
Sep 15 09:37:41.315865 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:37:41.315826    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f33238df5470590f56bc5108af1e05ec7a4ff05f8b78a36e3a9701995982b811\": container with ID starting with f33238df5470590f56bc5108af1e05ec7a4ff05f8b78a36e3a9701995982b811 not found: ID does not exist" containerID="f33238df5470590f56bc5108af1e05ec7a4ff05f8b78a36e3a9701995982b811"
Sep 15 09:37:41.315865 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:41.315850    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f33238df5470590f56bc5108af1e05ec7a4ff05f8b78a36e3a9701995982b811"} err="failed to get container status \"f33238df5470590f56bc5108af1e05ec7a4ff05f8b78a36e3a9701995982b811\": rpc error: code = NotFound desc = could not find container \"f33238df5470590f56bc5108af1e05ec7a4ff05f8b78a36e3a9701995982b811\": container with ID starting with f33238df5470590f56bc5108af1e05ec7a4ff05f8b78a36e3a9701995982b811 not found: ID does not exist"
Sep 15 09:37:41.329202 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:41.329176    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6696565-7769-4c30-90e3-826ebc19fe68-dshm\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:37:41.329202 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:41.329198    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-flmlj\" (UniqueName: \"kubernetes.io/projected/d6696565-7769-4c30-90e3-826ebc19fe68-kube-api-access-flmlj\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:37:41.329335 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:41.329211    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6696565-7769-4c30-90e3-826ebc19fe68-tls-certs\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:37:41.347094 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:41.347019    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-c183a5/e2e-conflict-b-0b195997-kserve-858787f76f-r7h47"]
Sep 15 09:37:41.352039 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:41.352011    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-c183a5/e2e-conflict-b-0b195997-kserve-858787f76f-r7h47"]
Sep 15 09:37:42.126664 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:42.126628    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6696565-7769-4c30-90e3-826ebc19fe68" path="/var/lib/kubelet/pods/d6696565-7769-4c30-90e3-826ebc19fe68/volumes"
Sep 15 09:37:42.315714 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:42.315683    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm" event={"ID":"124c68f3-c166-43b9-bfef-d5ba1b8fff7d","Type":"ContainerStarted","Data":"40cf8f931bb58bccfd8888d5555e49deb49744acb3271a6412919fc47c9fa337"}
Sep 15 09:37:42.904018 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:42.903984    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm"
Sep 15 09:37:42.904991 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:42.904962    2578 patch_prober.go:28] interesting pod/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused" start-of-body=
Sep 15 09:37:42.905108 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:42.905010    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm" podUID="124c68f3-c166-43b9-bfef-d5ba1b8fff7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused"
Sep 15 09:37:43.904271 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:43.904239    2578 patch_prober.go:28] interesting pod/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused" start-of-body=
Sep 15 09:37:43.904759 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:43.904298    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm" podUID="124c68f3-c166-43b9-bfef-d5ba1b8fff7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused"
Sep 15 09:37:44.904842 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:44.904810    2578 patch_prober.go:28] interesting pod/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused" start-of-body=
Sep 15 09:37:44.905245 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:44.904861    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm" podUID="124c68f3-c166-43b9-bfef-d5ba1b8fff7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused"
Sep 15 09:37:45.904370 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:45.904333    2578 patch_prober.go:28] interesting pod/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused" start-of-body=
Sep 15 09:37:45.904552 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:45.904385    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm" podUID="124c68f3-c166-43b9-bfef-d5ba1b8fff7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused"
Sep 15 09:37:46.147248 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:46.147197    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm"
Sep 15 09:37:46.904804 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:46.904766    2578 patch_prober.go:28] interesting pod/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused" start-of-body=
Sep 15 09:37:46.905019 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:46.904821    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm" podUID="124c68f3-c166-43b9-bfef-d5ba1b8fff7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused"
Sep 15 09:37:47.908200 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:47.908165    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm"
Sep 15 09:37:47.909324 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:37:47.909303    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm"
Sep 15 09:38:11.197319 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:11.197233    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx"]
Sep 15 09:38:11.197753 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:11.197494    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx" podUID="701f4de4-2cc6-42f4-bc3d-12f8e355b3dd" containerName="istio-proxy" containerID="cri-o://c19b8bb1645485a2a3ee6f6e940ac8472afb70f8c43e55759c9bd03a532cc2c1" gracePeriod=30
Sep 15 09:38:14.098157 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:14.098116    2578 patch_prober.go:28] interesting pod/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 15 09:38:14.098569 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:14.098190    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx" podUID="701f4de4-2cc6-42f4-bc3d-12f8e355b3dd" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 09:38:16.457020 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:16.456997    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx"
Sep 15 09:38:16.535796 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:16.535723    2578 generic.go:356] "Generic (PLEG): container finished" podID="701f4de4-2cc6-42f4-bc3d-12f8e355b3dd" containerID="c19b8bb1645485a2a3ee6f6e940ac8472afb70f8c43e55759c9bd03a532cc2c1" exitCode=0
Sep 15 09:38:16.535796 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:16.535760    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx"
Sep 15 09:38:16.535796 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:16.535788    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx" event={"ID":"701f4de4-2cc6-42f4-bc3d-12f8e355b3dd","Type":"ContainerDied","Data":"c19b8bb1645485a2a3ee6f6e940ac8472afb70f8c43e55759c9bd03a532cc2c1"}
Sep 15 09:38:16.535992 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:16.535833    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx" event={"ID":"701f4de4-2cc6-42f4-bc3d-12f8e355b3dd","Type":"ContainerDied","Data":"89299285c28b1d891c23cfa388c0c44afea3fed0ced08c0378743c2101938c52"}
Sep 15 09:38:16.535992 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:16.535858    2578 scope.go:117] "RemoveContainer" containerID="c19b8bb1645485a2a3ee6f6e940ac8472afb70f8c43e55759c9bd03a532cc2c1"
Sep 15 09:38:16.544858 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:16.544841    2578 scope.go:117] "RemoveContainer" containerID="07f2c0e5adf627723636ea9234625f1dd350a9143d93320f13da11d769055536"
Sep 15 09:38:16.552723 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:16.552709    2578 scope.go:117] "RemoveContainer" containerID="c19b8bb1645485a2a3ee6f6e940ac8472afb70f8c43e55759c9bd03a532cc2c1"
Sep 15 09:38:16.553022 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:38:16.553004    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c19b8bb1645485a2a3ee6f6e940ac8472afb70f8c43e55759c9bd03a532cc2c1\": container with ID starting with c19b8bb1645485a2a3ee6f6e940ac8472afb70f8c43e55759c9bd03a532cc2c1 not found: ID does not exist" containerID="c19b8bb1645485a2a3ee6f6e940ac8472afb70f8c43e55759c9bd03a532cc2c1"
Sep 15 09:38:16.553066 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:16.553032    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c19b8bb1645485a2a3ee6f6e940ac8472afb70f8c43e55759c9bd03a532cc2c1"} err="failed to get container status \"c19b8bb1645485a2a3ee6f6e940ac8472afb70f8c43e55759c9bd03a532cc2c1\": rpc error: code = NotFound desc = could not find container \"c19b8bb1645485a2a3ee6f6e940ac8472afb70f8c43e55759c9bd03a532cc2c1\": container with ID starting with c19b8bb1645485a2a3ee6f6e940ac8472afb70f8c43e55759c9bd03a532cc2c1 not found: ID does not exist"
Sep 15 09:38:16.553066 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:16.553049    2578 scope.go:117] "RemoveContainer" containerID="07f2c0e5adf627723636ea9234625f1dd350a9143d93320f13da11d769055536"
Sep 15 09:38:16.553290 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:38:16.553274    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07f2c0e5adf627723636ea9234625f1dd350a9143d93320f13da11d769055536\": container with ID starting with 07f2c0e5adf627723636ea9234625f1dd350a9143d93320f13da11d769055536 not found: ID does not exist" containerID="07f2c0e5adf627723636ea9234625f1dd350a9143d93320f13da11d769055536"
Sep 15 09:38:16.553339 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:16.553296    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07f2c0e5adf627723636ea9234625f1dd350a9143d93320f13da11d769055536"} err="failed to get container status \"07f2c0e5adf627723636ea9234625f1dd350a9143d93320f13da11d769055536\": rpc error: code = NotFound desc = could not find container \"07f2c0e5adf627723636ea9234625f1dd350a9143d93320f13da11d769055536\": container with ID starting with 07f2c0e5adf627723636ea9234625f1dd350a9143d93320f13da11d769055536 not found: ID does not exist"
Sep 15 09:38:16.569727 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:16.569707    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p6s7n\" (UniqueName: \"kubernetes.io/projected/701f4de4-2cc6-42f4-bc3d-12f8e355b3dd-kube-api-access-p6s7n\") pod \"701f4de4-2cc6-42f4-bc3d-12f8e355b3dd\" (UID: \"701f4de4-2cc6-42f4-bc3d-12f8e355b3dd\") "
Sep 15 09:38:16.569797 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:16.569765    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/701f4de4-2cc6-42f4-bc3d-12f8e355b3dd-workload-socket\") pod \"701f4de4-2cc6-42f4-bc3d-12f8e355b3dd\" (UID: \"701f4de4-2cc6-42f4-bc3d-12f8e355b3dd\") "
Sep 15 09:38:16.569835 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:16.569811    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/701f4de4-2cc6-42f4-bc3d-12f8e355b3dd-credential-socket\") pod \"701f4de4-2cc6-42f4-bc3d-12f8e355b3dd\" (UID: \"701f4de4-2cc6-42f4-bc3d-12f8e355b3dd\") "
Sep 15 09:38:16.569869 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:16.569831    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/701f4de4-2cc6-42f4-bc3d-12f8e355b3dd-istiod-ca-cert\") pod \"701f4de4-2cc6-42f4-bc3d-12f8e355b3dd\" (UID: \"701f4de4-2cc6-42f4-bc3d-12f8e355b3dd\") "
Sep 15 09:38:16.569970 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:16.569866    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/701f4de4-2cc6-42f4-bc3d-12f8e355b3dd-istio-data\") pod \"701f4de4-2cc6-42f4-bc3d-12f8e355b3dd\" (UID: \"701f4de4-2cc6-42f4-bc3d-12f8e355b3dd\") "
Sep 15 09:38:16.569970 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:16.569935    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/701f4de4-2cc6-42f4-bc3d-12f8e355b3dd-istio-podinfo\") pod \"701f4de4-2cc6-42f4-bc3d-12f8e355b3dd\" (UID: \"701f4de4-2cc6-42f4-bc3d-12f8e355b3dd\") "
Sep 15 09:38:16.570082 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:16.569985    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/701f4de4-2cc6-42f4-bc3d-12f8e355b3dd-istio-token\") pod \"701f4de4-2cc6-42f4-bc3d-12f8e355b3dd\" (UID: \"701f4de4-2cc6-42f4-bc3d-12f8e355b3dd\") "
Sep 15 09:38:16.570082 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:16.570013    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/701f4de4-2cc6-42f4-bc3d-12f8e355b3dd-istio-envoy\") pod \"701f4de4-2cc6-42f4-bc3d-12f8e355b3dd\" (UID: \"701f4de4-2cc6-42f4-bc3d-12f8e355b3dd\") "
Sep 15 09:38:16.570082 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:16.570048    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/701f4de4-2cc6-42f4-bc3d-12f8e355b3dd-workload-certs\") pod \"701f4de4-2cc6-42f4-bc3d-12f8e355b3dd\" (UID: \"701f4de4-2cc6-42f4-bc3d-12f8e355b3dd\") "
Sep 15 09:38:16.570241 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:16.570092    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/701f4de4-2cc6-42f4-bc3d-12f8e355b3dd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "701f4de4-2cc6-42f4-bc3d-12f8e355b3dd" (UID: "701f4de4-2cc6-42f4-bc3d-12f8e355b3dd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:38:16.570241 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:16.570106    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/701f4de4-2cc6-42f4-bc3d-12f8e355b3dd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "701f4de4-2cc6-42f4-bc3d-12f8e355b3dd" (UID: "701f4de4-2cc6-42f4-bc3d-12f8e355b3dd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:38:16.570241 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:16.570205    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/701f4de4-2cc6-42f4-bc3d-12f8e355b3dd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "701f4de4-2cc6-42f4-bc3d-12f8e355b3dd" (UID: "701f4de4-2cc6-42f4-bc3d-12f8e355b3dd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:38:16.570537 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:16.570427    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/701f4de4-2cc6-42f4-bc3d-12f8e355b3dd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "701f4de4-2cc6-42f4-bc3d-12f8e355b3dd" (UID: "701f4de4-2cc6-42f4-bc3d-12f8e355b3dd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:38:16.570537 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:16.570487    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/701f4de4-2cc6-42f4-bc3d-12f8e355b3dd-istio-data" (OuterVolumeSpecName: "istio-data") pod "701f4de4-2cc6-42f4-bc3d-12f8e355b3dd" (UID: "701f4de4-2cc6-42f4-bc3d-12f8e355b3dd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:38:16.570708 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:16.570552    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/701f4de4-2cc6-42f4-bc3d-12f8e355b3dd-workload-certs\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:38:16.570708 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:16.570571    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/701f4de4-2cc6-42f4-bc3d-12f8e355b3dd-workload-socket\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:38:16.570708 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:16.570584    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/701f4de4-2cc6-42f4-bc3d-12f8e355b3dd-credential-socket\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:38:16.570708 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:16.570597    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/701f4de4-2cc6-42f4-bc3d-12f8e355b3dd-istiod-ca-cert\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:38:16.571878 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:16.571857    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/701f4de4-2cc6-42f4-bc3d-12f8e355b3dd-kube-api-access-p6s7n" (OuterVolumeSpecName: "kube-api-access-p6s7n") pod "701f4de4-2cc6-42f4-bc3d-12f8e355b3dd" (UID: "701f4de4-2cc6-42f4-bc3d-12f8e355b3dd"). InnerVolumeSpecName "kube-api-access-p6s7n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:38:16.572155 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:16.572129    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/701f4de4-2cc6-42f4-bc3d-12f8e355b3dd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "701f4de4-2cc6-42f4-bc3d-12f8e355b3dd" (UID: "701f4de4-2cc6-42f4-bc3d-12f8e355b3dd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:38:16.572230 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:16.572150    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/701f4de4-2cc6-42f4-bc3d-12f8e355b3dd-istio-token" (OuterVolumeSpecName: "istio-token") pod "701f4de4-2cc6-42f4-bc3d-12f8e355b3dd" (UID: "701f4de4-2cc6-42f4-bc3d-12f8e355b3dd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:38:16.572230 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:16.572192    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/701f4de4-2cc6-42f4-bc3d-12f8e355b3dd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "701f4de4-2cc6-42f4-bc3d-12f8e355b3dd" (UID: "701f4de4-2cc6-42f4-bc3d-12f8e355b3dd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 09:38:16.672006 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:16.671936    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p6s7n\" (UniqueName: \"kubernetes.io/projected/701f4de4-2cc6-42f4-bc3d-12f8e355b3dd-kube-api-access-p6s7n\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:38:16.672006 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:16.671998    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/701f4de4-2cc6-42f4-bc3d-12f8e355b3dd-istio-data\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:38:16.672006 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:16.672011    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/701f4de4-2cc6-42f4-bc3d-12f8e355b3dd-istio-podinfo\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:38:16.672251 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:16.672021    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/701f4de4-2cc6-42f4-bc3d-12f8e355b3dd-istio-token\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:38:16.672251 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:16.672033    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/701f4de4-2cc6-42f4-bc3d-12f8e355b3dd-istio-envoy\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:38:16.861440 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:16.861398    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx"]
Sep 15 09:38:16.864521 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:16.864490    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-312334ca-openshift-default-564d7897d4-f6vpx"]
Sep 15 09:38:18.122205 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:18.122172    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="701f4de4-2cc6-42f4-bc3d-12f8e355b3dd" path="/var/lib/kubelet/pods/701f4de4-2cc6-42f4-bc3d-12f8e355b3dd/volumes"
Sep 15 09:38:39.792522 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:39.792491    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-c183a5/distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb"]
Sep 15 09:38:39.792969 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:39.792877    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="701f4de4-2cc6-42f4-bc3d-12f8e355b3dd" containerName="istio-proxy"
Sep 15 09:38:39.792969 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:39.792887    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="701f4de4-2cc6-42f4-bc3d-12f8e355b3dd" containerName="istio-proxy"
Sep 15 09:38:39.792969 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:39.792898    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6696565-7769-4c30-90e3-826ebc19fe68" containerName="main"
Sep 15 09:38:39.792969 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:39.792904    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6696565-7769-4c30-90e3-826ebc19fe68" containerName="main"
Sep 15 09:38:39.793124 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:39.792995    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="701f4de4-2cc6-42f4-bc3d-12f8e355b3dd" containerName="istio-proxy"
Sep 15 09:38:39.793124 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:39.793006    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6696565-7769-4c30-90e3-826ebc19fe68" containerName="main"
Sep 15 09:38:39.793124 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:39.793013    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="701f4de4-2cc6-42f4-bc3d-12f8e355b3dd" containerName="istio-proxy"
Sep 15 09:38:39.797355 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:39.797339    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-c183a5/distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb"
Sep 15 09:38:39.800434 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:39.800087    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-c183a5\"/\"distinct-2-w4-c183a5-kserve-self-signed-certs\""
Sep 15 09:38:39.800434 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:39.800167    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-c183a5\"/\"openshift-service-ca.crt\""
Sep 15 09:38:39.800434 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:39.800234    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-c183a5\"/\"kube-root-ca.crt\""
Sep 15 09:38:39.800434 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:39.800308    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-c183a5\"/\"default-dockercfg-k7hvd\""
Sep 15 09:38:39.803072 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:39.803046    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-c183a5/distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb"]
Sep 15 09:38:39.905601 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:39.905575    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/71a3e257-17c9-4929-88d5-336d32698d5b-model-cache\") pod \"distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb\" (UID: \"71a3e257-17c9-4929-88d5-336d32698d5b\") " pod="e2e-models-e2e-worker-w4-c183a5/distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb"
Sep 15 09:38:39.905601 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:39.905604    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/71a3e257-17c9-4929-88d5-336d32698d5b-dshm\") pod \"distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb\" (UID: \"71a3e257-17c9-4929-88d5-336d32698d5b\") " pod="e2e-models-e2e-worker-w4-c183a5/distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb"
Sep 15 09:38:39.905774 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:39.905626    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/71a3e257-17c9-4929-88d5-336d32698d5b-tls-certs\") pod \"distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb\" (UID: \"71a3e257-17c9-4929-88d5-336d32698d5b\") " pod="e2e-models-e2e-worker-w4-c183a5/distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb"
Sep 15 09:38:39.905774 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:39.905717    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71a3e257-17c9-4929-88d5-336d32698d5b-tmp-dir\") pod \"distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb\" (UID: \"71a3e257-17c9-4929-88d5-336d32698d5b\") " pod="e2e-models-e2e-worker-w4-c183a5/distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb"
Sep 15 09:38:39.905774 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:39.905757    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/71a3e257-17c9-4929-88d5-336d32698d5b-home\") pod \"distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb\" (UID: \"71a3e257-17c9-4929-88d5-336d32698d5b\") " pod="e2e-models-e2e-worker-w4-c183a5/distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb"
Sep 15 09:38:39.905882 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:39.905781    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs9bl\" (UniqueName: \"kubernetes.io/projected/71a3e257-17c9-4929-88d5-336d32698d5b-kube-api-access-rs9bl\") pod \"distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb\" (UID: \"71a3e257-17c9-4929-88d5-336d32698d5b\") " pod="e2e-models-e2e-worker-w4-c183a5/distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb"
Sep 15 09:38:40.006933 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:40.006900    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/71a3e257-17c9-4929-88d5-336d32698d5b-model-cache\") pod \"distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb\" (UID: \"71a3e257-17c9-4929-88d5-336d32698d5b\") " pod="e2e-models-e2e-worker-w4-c183a5/distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb"
Sep 15 09:38:40.006933 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:40.006933    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/71a3e257-17c9-4929-88d5-336d32698d5b-dshm\") pod \"distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb\" (UID: \"71a3e257-17c9-4929-88d5-336d32698d5b\") " pod="e2e-models-e2e-worker-w4-c183a5/distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb"
Sep 15 09:38:40.007203 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:40.006965    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/71a3e257-17c9-4929-88d5-336d32698d5b-tls-certs\") pod \"distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb\" (UID: \"71a3e257-17c9-4929-88d5-336d32698d5b\") " pod="e2e-models-e2e-worker-w4-c183a5/distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb"
Sep 15 09:38:40.007203 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:40.006989    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71a3e257-17c9-4929-88d5-336d32698d5b-tmp-dir\") pod \"distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb\" (UID: \"71a3e257-17c9-4929-88d5-336d32698d5b\") " pod="e2e-models-e2e-worker-w4-c183a5/distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb"
Sep 15 09:38:40.007203 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:40.007012    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/71a3e257-17c9-4929-88d5-336d32698d5b-home\") pod \"distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb\" (UID: \"71a3e257-17c9-4929-88d5-336d32698d5b\") " pod="e2e-models-e2e-worker-w4-c183a5/distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb"
Sep 15 09:38:40.007203 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:40.007031    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rs9bl\" (UniqueName: \"kubernetes.io/projected/71a3e257-17c9-4929-88d5-336d32698d5b-kube-api-access-rs9bl\") pod \"distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb\" (UID: \"71a3e257-17c9-4929-88d5-336d32698d5b\") " pod="e2e-models-e2e-worker-w4-c183a5/distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb"
Sep 15 09:38:40.007437 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:40.007327    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/71a3e257-17c9-4929-88d5-336d32698d5b-model-cache\") pod \"distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb\" (UID: \"71a3e257-17c9-4929-88d5-336d32698d5b\") " pod="e2e-models-e2e-worker-w4-c183a5/distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb"
Sep 15 09:38:40.007437 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:40.007399    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/71a3e257-17c9-4929-88d5-336d32698d5b-home\") pod \"distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb\" (UID: \"71a3e257-17c9-4929-88d5-336d32698d5b\") " pod="e2e-models-e2e-worker-w4-c183a5/distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb"
Sep 15 09:38:40.007531 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:40.007442    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71a3e257-17c9-4929-88d5-336d32698d5b-tmp-dir\") pod \"distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb\" (UID: \"71a3e257-17c9-4929-88d5-336d32698d5b\") " pod="e2e-models-e2e-worker-w4-c183a5/distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb"
Sep 15 09:38:40.009234 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:40.009214    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/71a3e257-17c9-4929-88d5-336d32698d5b-dshm\") pod \"distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb\" (UID: \"71a3e257-17c9-4929-88d5-336d32698d5b\") " pod="e2e-models-e2e-worker-w4-c183a5/distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb"
Sep 15 09:38:40.009403 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:40.009384    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/71a3e257-17c9-4929-88d5-336d32698d5b-tls-certs\") pod \"distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb\" (UID: \"71a3e257-17c9-4929-88d5-336d32698d5b\") " pod="e2e-models-e2e-worker-w4-c183a5/distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb"
Sep 15 09:38:40.014197 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:40.014172    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs9bl\" (UniqueName: \"kubernetes.io/projected/71a3e257-17c9-4929-88d5-336d32698d5b-kube-api-access-rs9bl\") pod \"distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb\" (UID: \"71a3e257-17c9-4929-88d5-336d32698d5b\") " pod="e2e-models-e2e-worker-w4-c183a5/distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb"
Sep 15 09:38:40.108572 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:40.108517    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-c183a5/distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb"
Sep 15 09:38:40.379556 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:40.379523    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-c183a5/distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb"]
Sep 15 09:38:40.380214 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:38:40.380186    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod71a3e257_17c9_4929_88d5_336d32698d5b.slice/crio-884abbb74dcb5316822d3e36311f46e196ba36ccece9220125d1f2ed803b59c3 WatchSource:0}: Error finding container 884abbb74dcb5316822d3e36311f46e196ba36ccece9220125d1f2ed803b59c3: Status 404 returned error can't find the container with id 884abbb74dcb5316822d3e36311f46e196ba36ccece9220125d1f2ed803b59c3
Sep 15 09:38:40.690640 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:40.690562    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-c183a5/distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb" event={"ID":"71a3e257-17c9-4929-88d5-336d32698d5b","Type":"ContainerStarted","Data":"0088fbfd02c3e8a05f976e05e1bf31ffbbf9fef1a863705e27e61793c4267ff2"}
Sep 15 09:38:40.690640 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:40.690597    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-c183a5/distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb" event={"ID":"71a3e257-17c9-4929-88d5-336d32698d5b","Type":"ContainerStarted","Data":"884abbb74dcb5316822d3e36311f46e196ba36ccece9220125d1f2ed803b59c3"}
Sep 15 09:38:40.708502 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:40.708452    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-c183a5/distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb" podStartSLOduration=1.70843823 podStartE2EDuration="1.70843823s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:38:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:38:40.70555797 +0000 UTC m=+1465.044003250" watchObservedRunningTime="2026-09-15 09:38:40.70843823 +0000 UTC m=+1465.046883511"
Sep 15 09:38:50.108611 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:50.108571    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-c183a5/distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb"
Sep 15 09:38:50.109115 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:50.108626    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-c183a5/distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb"
Sep 15 09:38:50.123570 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:50.123546    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-c183a5/distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb"
Sep 15 09:38:50.760980 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:38:50.760939    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-c183a5/distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb"
Sep 15 09:39:04.797186 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:04.797153    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh"]
Sep 15 09:39:04.797602 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:04.797588    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="701f4de4-2cc6-42f4-bc3d-12f8e355b3dd" containerName="istio-proxy"
Sep 15 09:39:04.797647 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:04.797605    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="701f4de4-2cc6-42f4-bc3d-12f8e355b3dd" containerName="istio-proxy"
Sep 15 09:39:04.800890 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:04.800866    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh"
Sep 15 09:39:04.803553 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:04.803529    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-c9d6bb-openshift-default-dockercfg-cj955\""
Sep 15 09:39:04.812017 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:04.811995    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh"]
Sep 15 09:39:04.842395 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:04.842368    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2fc38fe-a89f-4ed2-9991-f288e6ddd035-istio-token\") pod \"e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh\" (UID: \"a2fc38fe-a89f-4ed2-9991-f288e6ddd035\") " pod="openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh"
Sep 15 09:39:04.842553 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:04.842404    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2fc38fe-a89f-4ed2-9991-f288e6ddd035-workload-socket\") pod \"e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh\" (UID: \"a2fc38fe-a89f-4ed2-9991-f288e6ddd035\") " pod="openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh"
Sep 15 09:39:04.842553 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:04.842425    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2fc38fe-a89f-4ed2-9991-f288e6ddd035-istiod-ca-cert\") pod \"e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh\" (UID: \"a2fc38fe-a89f-4ed2-9991-f288e6ddd035\") " pod="openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh"
Sep 15 09:39:04.842553 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:04.842444    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2fc38fe-a89f-4ed2-9991-f288e6ddd035-istio-data\") pod \"e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh\" (UID: \"a2fc38fe-a89f-4ed2-9991-f288e6ddd035\") " pod="openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh"
Sep 15 09:39:04.842553 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:04.842502    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2fc38fe-a89f-4ed2-9991-f288e6ddd035-credential-socket\") pod \"e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh\" (UID: \"a2fc38fe-a89f-4ed2-9991-f288e6ddd035\") " pod="openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh"
Sep 15 09:39:04.842553 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:04.842538    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2fc38fe-a89f-4ed2-9991-f288e6ddd035-workload-certs\") pod \"e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh\" (UID: \"a2fc38fe-a89f-4ed2-9991-f288e6ddd035\") " pod="openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh"
Sep 15 09:39:04.842730 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:04.842562    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2fc38fe-a89f-4ed2-9991-f288e6ddd035-istio-podinfo\") pod \"e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh\" (UID: \"a2fc38fe-a89f-4ed2-9991-f288e6ddd035\") " pod="openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh"
Sep 15 09:39:04.842730 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:04.842626    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w77vf\" (UniqueName: \"kubernetes.io/projected/a2fc38fe-a89f-4ed2-9991-f288e6ddd035-kube-api-access-w77vf\") pod \"e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh\" (UID: \"a2fc38fe-a89f-4ed2-9991-f288e6ddd035\") " pod="openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh"
Sep 15 09:39:04.842730 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:04.842677    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2fc38fe-a89f-4ed2-9991-f288e6ddd035-istio-envoy\") pod \"e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh\" (UID: \"a2fc38fe-a89f-4ed2-9991-f288e6ddd035\") " pod="openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh"
Sep 15 09:39:04.944019 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:04.943987    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2fc38fe-a89f-4ed2-9991-f288e6ddd035-istio-envoy\") pod \"e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh\" (UID: \"a2fc38fe-a89f-4ed2-9991-f288e6ddd035\") " pod="openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh"
Sep 15 09:39:04.944203 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:04.944058    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2fc38fe-a89f-4ed2-9991-f288e6ddd035-istio-token\") pod \"e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh\" (UID: \"a2fc38fe-a89f-4ed2-9991-f288e6ddd035\") " pod="openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh"
Sep 15 09:39:04.944203 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:04.944092    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2fc38fe-a89f-4ed2-9991-f288e6ddd035-workload-socket\") pod \"e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh\" (UID: \"a2fc38fe-a89f-4ed2-9991-f288e6ddd035\") " pod="openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh"
Sep 15 09:39:04.944329 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:04.944252    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2fc38fe-a89f-4ed2-9991-f288e6ddd035-istiod-ca-cert\") pod \"e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh\" (UID: \"a2fc38fe-a89f-4ed2-9991-f288e6ddd035\") " pod="openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh"
Sep 15 09:39:04.944329 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:04.944306    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2fc38fe-a89f-4ed2-9991-f288e6ddd035-istio-data\") pod \"e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh\" (UID: \"a2fc38fe-a89f-4ed2-9991-f288e6ddd035\") " pod="openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh"
Sep 15 09:39:04.944434 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:04.944351    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2fc38fe-a89f-4ed2-9991-f288e6ddd035-credential-socket\") pod \"e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh\" (UID: \"a2fc38fe-a89f-4ed2-9991-f288e6ddd035\") " pod="openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh"
Sep 15 09:39:04.944434 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:04.944427    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2fc38fe-a89f-4ed2-9991-f288e6ddd035-workload-certs\") pod \"e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh\" (UID: \"a2fc38fe-a89f-4ed2-9991-f288e6ddd035\") " pod="openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh"
Sep 15 09:39:04.944541 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:04.944477    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2fc38fe-a89f-4ed2-9991-f288e6ddd035-istio-podinfo\") pod \"e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh\" (UID: \"a2fc38fe-a89f-4ed2-9991-f288e6ddd035\") " pod="openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh"
Sep 15 09:39:04.944541 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:04.944482    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2fc38fe-a89f-4ed2-9991-f288e6ddd035-workload-socket\") pod \"e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh\" (UID: \"a2fc38fe-a89f-4ed2-9991-f288e6ddd035\") " pod="openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh"
Sep 15 09:39:04.944836 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:04.944683    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2fc38fe-a89f-4ed2-9991-f288e6ddd035-istio-data\") pod \"e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh\" (UID: \"a2fc38fe-a89f-4ed2-9991-f288e6ddd035\") " pod="openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh"
Sep 15 09:39:04.944836 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:04.944698    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2fc38fe-a89f-4ed2-9991-f288e6ddd035-credential-socket\") pod \"e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh\" (UID: \"a2fc38fe-a89f-4ed2-9991-f288e6ddd035\") " pod="openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh"
Sep 15 09:39:04.944836 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:04.944747    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w77vf\" (UniqueName: \"kubernetes.io/projected/a2fc38fe-a89f-4ed2-9991-f288e6ddd035-kube-api-access-w77vf\") pod \"e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh\" (UID: \"a2fc38fe-a89f-4ed2-9991-f288e6ddd035\") " pod="openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh"
Sep 15 09:39:04.944836 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:04.944789    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2fc38fe-a89f-4ed2-9991-f288e6ddd035-workload-certs\") pod \"e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh\" (UID: \"a2fc38fe-a89f-4ed2-9991-f288e6ddd035\") " pod="openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh"
Sep 15 09:39:04.945143 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:04.944991    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2fc38fe-a89f-4ed2-9991-f288e6ddd035-istiod-ca-cert\") pod \"e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh\" (UID: \"a2fc38fe-a89f-4ed2-9991-f288e6ddd035\") " pod="openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh"
Sep 15 09:39:04.946477 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:04.946458    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2fc38fe-a89f-4ed2-9991-f288e6ddd035-istio-envoy\") pod \"e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh\" (UID: \"a2fc38fe-a89f-4ed2-9991-f288e6ddd035\") " pod="openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh"
Sep 15 09:39:04.946846 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:04.946828    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2fc38fe-a89f-4ed2-9991-f288e6ddd035-istio-podinfo\") pod \"e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh\" (UID: \"a2fc38fe-a89f-4ed2-9991-f288e6ddd035\") " pod="openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh"
Sep 15 09:39:04.952443 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:04.952410    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2fc38fe-a89f-4ed2-9991-f288e6ddd035-istio-token\") pod \"e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh\" (UID: \"a2fc38fe-a89f-4ed2-9991-f288e6ddd035\") " pod="openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh"
Sep 15 09:39:04.952611 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:04.952592    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w77vf\" (UniqueName: \"kubernetes.io/projected/a2fc38fe-a89f-4ed2-9991-f288e6ddd035-kube-api-access-w77vf\") pod \"e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh\" (UID: \"a2fc38fe-a89f-4ed2-9991-f288e6ddd035\") " pod="openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh"
Sep 15 09:39:05.115349 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:05.115261    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh"
Sep 15 09:39:05.391446 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:05.391421    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh"]
Sep 15 09:39:05.392659 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:39:05.392625    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2fc38fe_a89f_4ed2_9991_f288e6ddd035.slice/crio-f16fb41aa2fe69e90be1bce5eeb1b3fb5aaa0cc33f466d906b6c4712f905b7f8 WatchSource:0}: Error finding container f16fb41aa2fe69e90be1bce5eeb1b3fb5aaa0cc33f466d906b6c4712f905b7f8: Status 404 returned error can't find the container with id f16fb41aa2fe69e90be1bce5eeb1b3fb5aaa0cc33f466d906b6c4712f905b7f8
Sep 15 09:39:05.395139 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:05.395103    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:39:05.395228 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:05.395171    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:39:05.395228 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:05.395202    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:39:05.842259 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:05.842225    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh" event={"ID":"a2fc38fe-a89f-4ed2-9991-f288e6ddd035","Type":"ContainerStarted","Data":"7d2e1caf75d40672142b05c9a128c265a276db1d0033e243907fa30b0929cb83"}
Sep 15 09:39:05.842737 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:05.842274    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh" event={"ID":"a2fc38fe-a89f-4ed2-9991-f288e6ddd035","Type":"ContainerStarted","Data":"f16fb41aa2fe69e90be1bce5eeb1b3fb5aaa0cc33f466d906b6c4712f905b7f8"}
Sep 15 09:39:05.861511 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:05.861458    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh" podStartSLOduration=1.861443003 podStartE2EDuration="1.861443003s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:39:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:39:05.859166891 +0000 UTC m=+1490.197612165" watchObservedRunningTime="2026-09-15 09:39:05.861443003 +0000 UTC m=+1490.199888277"
Sep 15 09:39:06.122749 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:06.122676    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh"
Sep 15 09:39:06.122885 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:06.122759    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh"
Sep 15 09:39:06.848201 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:06.848164    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh"
Sep 15 09:39:06.849027 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:06.849004    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh"
Sep 15 09:39:13.103049 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:13.103013    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-c9d6bb-6944b69bcd-lll49"]
Sep 15 09:39:13.106907 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:13.106889    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-c9d6bb-6944b69bcd-lll49"
Sep 15 09:39:13.109273 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:13.109256    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-c9d6bb-dockercfg-vxxqs\""
Sep 15 09:39:13.109599 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:13.109584    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-c9d6bb\""
Sep 15 09:39:13.117592 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:13.117569    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-c9d6bb-6944b69bcd-lll49"]
Sep 15 09:39:13.130693 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:13.130668    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-c9d6bb-f6776bdf9-gkj5w"]
Sep 15 09:39:13.134052 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:13.134033    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-c9d6bb-f6776bdf9-gkj5w"
Sep 15 09:39:13.145173 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:13.145148    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-c9d6bb-f6776bdf9-gkj5w"]
Sep 15 09:39:13.232599 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:13.232551    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjh42\" (UniqueName: \"kubernetes.io/projected/3b7ce802-c6e6-40ce-bd59-43ed2af76f81-kube-api-access-rjh42\") pod \"payload-pre-processing-e2e-api-a-c9d6bb-6944b69bcd-lll49\" (UID: \"3b7ce802-c6e6-40ce-bd59-43ed2af76f81\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-c9d6bb-6944b69bcd-lll49"
Sep 15 09:39:13.232793 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:13.232613    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqq6x\" (UniqueName: \"kubernetes.io/projected/f7b0a0be-1283-407f-befc-807c497c6913-kube-api-access-cqq6x\") pod \"payload-processing-e2e-api-a-c9d6bb-f6776bdf9-gkj5w\" (UID: \"f7b0a0be-1283-407f-befc-807c497c6913\") " pod="openshift-ingress/payload-processing-e2e-api-a-c9d6bb-f6776bdf9-gkj5w"
Sep 15 09:39:13.232793 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:13.232681    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f7b0a0be-1283-407f-befc-807c497c6913-plugins-config-volume\") pod \"payload-processing-e2e-api-a-c9d6bb-f6776bdf9-gkj5w\" (UID: \"f7b0a0be-1283-407f-befc-807c497c6913\") " pod="openshift-ingress/payload-processing-e2e-api-a-c9d6bb-f6776bdf9-gkj5w"
Sep 15 09:39:13.232793 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:13.232707    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3b7ce802-c6e6-40ce-bd59-43ed2af76f81-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-c9d6bb-6944b69bcd-lll49\" (UID: \"3b7ce802-c6e6-40ce-bd59-43ed2af76f81\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-c9d6bb-6944b69bcd-lll49"
Sep 15 09:39:13.333928 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:13.333893    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjh42\" (UniqueName: \"kubernetes.io/projected/3b7ce802-c6e6-40ce-bd59-43ed2af76f81-kube-api-access-rjh42\") pod \"payload-pre-processing-e2e-api-a-c9d6bb-6944b69bcd-lll49\" (UID: \"3b7ce802-c6e6-40ce-bd59-43ed2af76f81\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-c9d6bb-6944b69bcd-lll49"
Sep 15 09:39:13.333928 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:13.333932    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqq6x\" (UniqueName: \"kubernetes.io/projected/f7b0a0be-1283-407f-befc-807c497c6913-kube-api-access-cqq6x\") pod \"payload-processing-e2e-api-a-c9d6bb-f6776bdf9-gkj5w\" (UID: \"f7b0a0be-1283-407f-befc-807c497c6913\") " pod="openshift-ingress/payload-processing-e2e-api-a-c9d6bb-f6776bdf9-gkj5w"
Sep 15 09:39:13.334189 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:13.334006    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f7b0a0be-1283-407f-befc-807c497c6913-plugins-config-volume\") pod \"payload-processing-e2e-api-a-c9d6bb-f6776bdf9-gkj5w\" (UID: \"f7b0a0be-1283-407f-befc-807c497c6913\") " pod="openshift-ingress/payload-processing-e2e-api-a-c9d6bb-f6776bdf9-gkj5w"
Sep 15 09:39:13.334189 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:13.334026    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3b7ce802-c6e6-40ce-bd59-43ed2af76f81-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-c9d6bb-6944b69bcd-lll49\" (UID: \"3b7ce802-c6e6-40ce-bd59-43ed2af76f81\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-c9d6bb-6944b69bcd-lll49"
Sep 15 09:39:13.334717 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:13.334693    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3b7ce802-c6e6-40ce-bd59-43ed2af76f81-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-c9d6bb-6944b69bcd-lll49\" (UID: \"3b7ce802-c6e6-40ce-bd59-43ed2af76f81\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-c9d6bb-6944b69bcd-lll49"
Sep 15 09:39:13.334823 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:13.334757    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f7b0a0be-1283-407f-befc-807c497c6913-plugins-config-volume\") pod \"payload-processing-e2e-api-a-c9d6bb-f6776bdf9-gkj5w\" (UID: \"f7b0a0be-1283-407f-befc-807c497c6913\") " pod="openshift-ingress/payload-processing-e2e-api-a-c9d6bb-f6776bdf9-gkj5w"
Sep 15 09:39:13.341758 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:13.341735    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqq6x\" (UniqueName: \"kubernetes.io/projected/f7b0a0be-1283-407f-befc-807c497c6913-kube-api-access-cqq6x\") pod \"payload-processing-e2e-api-a-c9d6bb-f6776bdf9-gkj5w\" (UID: \"f7b0a0be-1283-407f-befc-807c497c6913\") " pod="openshift-ingress/payload-processing-e2e-api-a-c9d6bb-f6776bdf9-gkj5w"
Sep 15 09:39:13.341920 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:13.341898    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjh42\" (UniqueName: \"kubernetes.io/projected/3b7ce802-c6e6-40ce-bd59-43ed2af76f81-kube-api-access-rjh42\") pod \"payload-pre-processing-e2e-api-a-c9d6bb-6944b69bcd-lll49\" (UID: \"3b7ce802-c6e6-40ce-bd59-43ed2af76f81\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-c9d6bb-6944b69bcd-lll49"
Sep 15 09:39:13.418759 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:13.418684    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-c9d6bb-6944b69bcd-lll49"
Sep 15 09:39:13.445818 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:13.445789    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-c9d6bb-f6776bdf9-gkj5w"
Sep 15 09:39:13.693854 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:13.693825    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-c9d6bb-6944b69bcd-lll49"]
Sep 15 09:39:13.694664 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:39:13.694632    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b7ce802_c6e6_40ce_bd59_43ed2af76f81.slice/crio-43349ff7f92fbb1c21c801ca61d889368e4d62f3473f2f4b34ae1b2202472d60 WatchSource:0}: Error finding container 43349ff7f92fbb1c21c801ca61d889368e4d62f3473f2f4b34ae1b2202472d60: Status 404 returned error can't find the container with id 43349ff7f92fbb1c21c801ca61d889368e4d62f3473f2f4b34ae1b2202472d60
Sep 15 09:39:13.733979 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:13.733955    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-c9d6bb-f6776bdf9-gkj5w"]
Sep 15 09:39:13.734424 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:39:13.734401    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7b0a0be_1283_407f_befc_807c497c6913.slice/crio-60e05ea77edd2bac1faa8b41747f44f63fffe13a955aa5f405e6257566a0f9b6 WatchSource:0}: Error finding container 60e05ea77edd2bac1faa8b41747f44f63fffe13a955aa5f405e6257566a0f9b6: Status 404 returned error can't find the container with id 60e05ea77edd2bac1faa8b41747f44f63fffe13a955aa5f405e6257566a0f9b6
Sep 15 09:39:13.891997 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:13.891960    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-c9d6bb-f6776bdf9-gkj5w" event={"ID":"f7b0a0be-1283-407f-befc-807c497c6913","Type":"ContainerStarted","Data":"2759aea7bd7a21ed9895c8b03505081b229a990586596973bc7f5d244f36b552"}
Sep 15 09:39:13.892182 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:13.892010    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-c9d6bb-f6776bdf9-gkj5w" event={"ID":"f7b0a0be-1283-407f-befc-807c497c6913","Type":"ContainerStarted","Data":"60e05ea77edd2bac1faa8b41747f44f63fffe13a955aa5f405e6257566a0f9b6"}
Sep 15 09:39:13.892182 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:13.892055    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-c9d6bb-f6776bdf9-gkj5w"
Sep 15 09:39:13.893708 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:13.893684    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-c9d6bb-6944b69bcd-lll49" event={"ID":"3b7ce802-c6e6-40ce-bd59-43ed2af76f81","Type":"ContainerStarted","Data":"55d0f2b4a0535b5106f9c457b9e098928da06ee09b6a58c527f33b540a40f4e4"}
Sep 15 09:39:13.893815 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:13.893721    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-c9d6bb-6944b69bcd-lll49" event={"ID":"3b7ce802-c6e6-40ce-bd59-43ed2af76f81","Type":"ContainerStarted","Data":"43349ff7f92fbb1c21c801ca61d889368e4d62f3473f2f4b34ae1b2202472d60"}
Sep 15 09:39:13.893815 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:13.893780    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-c9d6bb-6944b69bcd-lll49"
Sep 15 09:39:13.908220 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:13.908180    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-c9d6bb-f6776bdf9-gkj5w" podStartSLOduration=0.908166938 podStartE2EDuration="908.166938ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:39:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:39:13.905626133 +0000 UTC m=+1498.244071409" watchObservedRunningTime="2026-09-15 09:39:13.908166938 +0000 UTC m=+1498.246612222"
Sep 15 09:39:13.919784 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:13.919730    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-c9d6bb-6944b69bcd-lll49" podStartSLOduration=0.919718119 podStartE2EDuration="919.718119ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:39:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:39:13.919043241 +0000 UTC m=+1498.257488544" watchObservedRunningTime="2026-09-15 09:39:13.919718119 +0000 UTC m=+1498.258163444"
Sep 15 09:39:16.408574 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:16.408549    2578 scope.go:117] "RemoveContainer" containerID="18eb072872fd852157f01b46f83099d8c54ae506a9ff171aa063d65f82ce2958"
Sep 15 09:39:24.902441 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:24.902400    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-c9d6bb-f6776bdf9-gkj5w"
Sep 15 09:39:24.903054 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:24.902531    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-c9d6bb-6944b69bcd-lll49"
Sep 15 09:39:35.034540 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:35.034506    2578 generic.go:356] "Generic (PLEG): container finished" podID="a2fc38fe-a89f-4ed2-9991-f288e6ddd035" containerID="7d2e1caf75d40672142b05c9a128c265a276db1d0033e243907fa30b0929cb83" exitCode=0
Sep 15 09:39:35.034994 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:35.034581    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh" event={"ID":"a2fc38fe-a89f-4ed2-9991-f288e6ddd035","Type":"ContainerDied","Data":"7d2e1caf75d40672142b05c9a128c265a276db1d0033e243907fa30b0929cb83"}
Sep 15 09:39:35.035042 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:35.035013    2578 scope.go:117] "RemoveContainer" containerID="7d2e1caf75d40672142b05c9a128c265a276db1d0033e243907fa30b0929cb83"
Sep 15 09:39:35.036299 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:35.036268    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:39:35.036407 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:35.036340    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:39:35.036407 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:35.036372    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:39:36.045970 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:36.045922    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh" event={"ID":"a2fc38fe-a89f-4ed2-9991-f288e6ddd035","Type":"ContainerStarted","Data":"b9814566ec49fcc07006b652ae549f147017146dd18a8d48d5f0a7c41b537d40"}
Sep 15 09:39:36.133968 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:36.131035    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh"
Sep 15 09:39:36.140996 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:36.140487    2578 patch_prober.go:28] interesting pod/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused" start-of-body=
Sep 15 09:39:36.140996 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:36.140538    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh" podUID="a2fc38fe-a89f-4ed2-9991-f288e6ddd035" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused"
Sep 15 09:39:36.848705 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:36.848672    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh"
Sep 15 09:39:37.116907 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:37.116812    2578 patch_prober.go:28] interesting pod/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused" start-of-body=
Sep 15 09:39:37.116907 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:37.116874    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh" podUID="a2fc38fe-a89f-4ed2-9991-f288e6ddd035" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused"
Sep 15 09:39:38.116295 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:38.116254    2578 patch_prober.go:28] interesting pod/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused" start-of-body=
Sep 15 09:39:38.116505 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:38.116317    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh" podUID="a2fc38fe-a89f-4ed2-9991-f288e6ddd035" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused"
Sep 15 09:39:38.494882 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:38.494790    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p"]
Sep 15 09:39:38.498004 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:38.497977    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p"
Sep 15 09:39:38.500984 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:38.500937    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-e029b0-openshift-default-dockercfg-k2qqr\""
Sep 15 09:39:38.514801 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:38.514772    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p"]
Sep 15 09:39:38.580080 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:38.580007    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9b9d\" (UniqueName: \"kubernetes.io/projected/db2acd32-78bd-44ad-bdcc-63253a0950fd-kube-api-access-m9b9d\") pod \"e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p\" (UID: \"db2acd32-78bd-44ad-bdcc-63253a0950fd\") " pod="openshift-ingress/e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p"
Sep 15 09:39:38.580080 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:38.580076    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db2acd32-78bd-44ad-bdcc-63253a0950fd-workload-socket\") pod \"e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p\" (UID: \"db2acd32-78bd-44ad-bdcc-63253a0950fd\") " pod="openshift-ingress/e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p"
Sep 15 09:39:38.580286 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:38.580152    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db2acd32-78bd-44ad-bdcc-63253a0950fd-istio-podinfo\") pod \"e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p\" (UID: \"db2acd32-78bd-44ad-bdcc-63253a0950fd\") " pod="openshift-ingress/e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p"
Sep 15 09:39:38.580286 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:38.580187    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db2acd32-78bd-44ad-bdcc-63253a0950fd-istiod-ca-cert\") pod \"e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p\" (UID: \"db2acd32-78bd-44ad-bdcc-63253a0950fd\") " pod="openshift-ingress/e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p"
Sep 15 09:39:38.580286 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:38.580226    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db2acd32-78bd-44ad-bdcc-63253a0950fd-istio-envoy\") pod \"e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p\" (UID: \"db2acd32-78bd-44ad-bdcc-63253a0950fd\") " pod="openshift-ingress/e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p"
Sep 15 09:39:38.580431 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:38.580335    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db2acd32-78bd-44ad-bdcc-63253a0950fd-workload-certs\") pod \"e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p\" (UID: \"db2acd32-78bd-44ad-bdcc-63253a0950fd\") " pod="openshift-ingress/e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p"
Sep 15 09:39:38.580431 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:38.580377    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db2acd32-78bd-44ad-bdcc-63253a0950fd-istio-data\") pod \"e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p\" (UID: \"db2acd32-78bd-44ad-bdcc-63253a0950fd\") " pod="openshift-ingress/e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p"
Sep 15 09:39:38.580514 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:38.580438    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db2acd32-78bd-44ad-bdcc-63253a0950fd-credential-socket\") pod \"e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p\" (UID: \"db2acd32-78bd-44ad-bdcc-63253a0950fd\") " pod="openshift-ingress/e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p"
Sep 15 09:39:38.580514 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:38.580470    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db2acd32-78bd-44ad-bdcc-63253a0950fd-istio-token\") pod \"e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p\" (UID: \"db2acd32-78bd-44ad-bdcc-63253a0950fd\") " pod="openshift-ingress/e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p"
Sep 15 09:39:38.681164 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:38.681125    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db2acd32-78bd-44ad-bdcc-63253a0950fd-istiod-ca-cert\") pod \"e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p\" (UID: \"db2acd32-78bd-44ad-bdcc-63253a0950fd\") " pod="openshift-ingress/e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p"
Sep 15 09:39:38.681358 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:38.681175    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db2acd32-78bd-44ad-bdcc-63253a0950fd-istio-envoy\") pod \"e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p\" (UID: \"db2acd32-78bd-44ad-bdcc-63253a0950fd\") " pod="openshift-ingress/e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p"
Sep 15 09:39:38.681358 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:38.681220    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db2acd32-78bd-44ad-bdcc-63253a0950fd-workload-certs\") pod \"e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p\" (UID: \"db2acd32-78bd-44ad-bdcc-63253a0950fd\") " pod="openshift-ingress/e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p"
Sep 15 09:39:38.681358 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:38.681240    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db2acd32-78bd-44ad-bdcc-63253a0950fd-istio-data\") pod \"e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p\" (UID: \"db2acd32-78bd-44ad-bdcc-63253a0950fd\") " pod="openshift-ingress/e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p"
Sep 15 09:39:38.681358 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:38.681277    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db2acd32-78bd-44ad-bdcc-63253a0950fd-credential-socket\") pod \"e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p\" (UID: \"db2acd32-78bd-44ad-bdcc-63253a0950fd\") " pod="openshift-ingress/e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p"
Sep 15 09:39:38.681358 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:38.681310    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db2acd32-78bd-44ad-bdcc-63253a0950fd-istio-token\") pod \"e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p\" (UID: \"db2acd32-78bd-44ad-bdcc-63253a0950fd\") " pod="openshift-ingress/e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p"
Sep 15 09:39:38.681358 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:38.681343    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9b9d\" (UniqueName: \"kubernetes.io/projected/db2acd32-78bd-44ad-bdcc-63253a0950fd-kube-api-access-m9b9d\") pod \"e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p\" (UID: \"db2acd32-78bd-44ad-bdcc-63253a0950fd\") " pod="openshift-ingress/e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p"
Sep 15 09:39:38.681702 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:38.681391    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db2acd32-78bd-44ad-bdcc-63253a0950fd-workload-socket\") pod \"e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p\" (UID: \"db2acd32-78bd-44ad-bdcc-63253a0950fd\") " pod="openshift-ingress/e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p"
Sep 15 09:39:38.681702 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:38.681447    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db2acd32-78bd-44ad-bdcc-63253a0950fd-istio-podinfo\") pod \"e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p\" (UID: \"db2acd32-78bd-44ad-bdcc-63253a0950fd\") " pod="openshift-ingress/e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p"
Sep 15 09:39:38.681821 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:38.681708    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db2acd32-78bd-44ad-bdcc-63253a0950fd-istio-data\") pod \"e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p\" (UID: \"db2acd32-78bd-44ad-bdcc-63253a0950fd\") " pod="openshift-ingress/e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p"
Sep 15 09:39:38.681821 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:38.681781    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db2acd32-78bd-44ad-bdcc-63253a0950fd-workload-certs\") pod \"e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p\" (UID: \"db2acd32-78bd-44ad-bdcc-63253a0950fd\") " pod="openshift-ingress/e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p"
Sep 15 09:39:38.681821 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:38.681805    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db2acd32-78bd-44ad-bdcc-63253a0950fd-credential-socket\") pod \"e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p\" (UID: \"db2acd32-78bd-44ad-bdcc-63253a0950fd\") " pod="openshift-ingress/e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p"
Sep 15 09:39:38.682065 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:38.681978    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db2acd32-78bd-44ad-bdcc-63253a0950fd-istiod-ca-cert\") pod \"e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p\" (UID: \"db2acd32-78bd-44ad-bdcc-63253a0950fd\") " pod="openshift-ingress/e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p"
Sep 15 09:39:38.682065 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:38.682042    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db2acd32-78bd-44ad-bdcc-63253a0950fd-workload-socket\") pod \"e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p\" (UID: \"db2acd32-78bd-44ad-bdcc-63253a0950fd\") " pod="openshift-ingress/e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p"
Sep 15 09:39:38.683761 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:38.683741    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db2acd32-78bd-44ad-bdcc-63253a0950fd-istio-envoy\") pod \"e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p\" (UID: \"db2acd32-78bd-44ad-bdcc-63253a0950fd\") " pod="openshift-ingress/e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p"
Sep 15 09:39:38.684401 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:38.684380    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db2acd32-78bd-44ad-bdcc-63253a0950fd-istio-podinfo\") pod \"e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p\" (UID: \"db2acd32-78bd-44ad-bdcc-63253a0950fd\") " pod="openshift-ingress/e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p"
Sep 15 09:39:38.688940 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:38.688911    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db2acd32-78bd-44ad-bdcc-63253a0950fd-istio-token\") pod \"e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p\" (UID: \"db2acd32-78bd-44ad-bdcc-63253a0950fd\") " pod="openshift-ingress/e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p"
Sep 15 09:39:38.689357 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:38.689338    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9b9d\" (UniqueName: \"kubernetes.io/projected/db2acd32-78bd-44ad-bdcc-63253a0950fd-kube-api-access-m9b9d\") pod \"e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p\" (UID: \"db2acd32-78bd-44ad-bdcc-63253a0950fd\") " pod="openshift-ingress/e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p"
Sep 15 09:39:38.853785 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:38.853682    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p"
Sep 15 09:39:39.120836 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:39.120329    2578 patch_prober.go:28] interesting pod/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused" start-of-body=
Sep 15 09:39:39.120836 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:39.120397    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh" podUID="a2fc38fe-a89f-4ed2-9991-f288e6ddd035" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused"
Sep 15 09:39:39.138499 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:39.138453    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p"]
Sep 15 09:39:39.141384 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:39:39.141347    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb2acd32_78bd_44ad_bdcc_63253a0950fd.slice/crio-c3f9a108a0353b63497cdb0df43868e42dcbb5abe5fe74ddbebbecd5c491f046 WatchSource:0}: Error finding container c3f9a108a0353b63497cdb0df43868e42dcbb5abe5fe74ddbebbecd5c491f046: Status 404 returned error can't find the container with id c3f9a108a0353b63497cdb0df43868e42dcbb5abe5fe74ddbebbecd5c491f046
Sep 15 09:39:39.144217 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:39.144186    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:39:39.144330 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:39.144247    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:39:39.144330 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:39.144278    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:39:40.071660 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:40.071621    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p" event={"ID":"db2acd32-78bd-44ad-bdcc-63253a0950fd","Type":"ContainerStarted","Data":"75f62726329517485e3a4f6741ca1cd1b3da052e28155d22367fcd477eac95b6"}
Sep 15 09:39:40.072108 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:40.071679    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p" event={"ID":"db2acd32-78bd-44ad-bdcc-63253a0950fd","Type":"ContainerStarted","Data":"c3f9a108a0353b63497cdb0df43868e42dcbb5abe5fe74ddbebbecd5c491f046"}
Sep 15 09:39:40.093039 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:40.092988    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p" podStartSLOduration=2.092970347 podStartE2EDuration="2.092970347s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:39:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:39:40.090340051 +0000 UTC m=+1524.428785327" watchObservedRunningTime="2026-09-15 09:39:40.092970347 +0000 UTC m=+1524.431415625"
Sep 15 09:39:40.115918 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:40.115885    2578 patch_prober.go:28] interesting pod/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused" start-of-body=
Sep 15 09:39:40.116068 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:40.115940    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh" podUID="a2fc38fe-a89f-4ed2-9991-f288e6ddd035" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.92:15021/healthz/ready\": dial tcp 10.134.0.92:15021: connect: connection refused"
Sep 15 09:39:40.854582 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:40.854542    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p"
Sep 15 09:39:40.859830 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:40.859800    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p"
Sep 15 09:39:41.079008 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:41.078976    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p"
Sep 15 09:39:41.080116 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:41.080097    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p"
Sep 15 09:39:41.193632 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:41.193543    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh"
Sep 15 09:39:41.195207 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:41.195179    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh"
Sep 15 09:39:47.767172 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:47.767139    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-e029b0-5747849ddf-tlpmv"]
Sep 15 09:39:47.770647 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:47.770631    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-e029b0-5747849ddf-tlpmv"
Sep 15 09:39:47.773104 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:47.773082    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-e029b0\""
Sep 15 09:39:47.773250 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:47.773106    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-e029b0-dockercfg-l9nbv\""
Sep 15 09:39:47.780017 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:47.779999    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-e029b0-5747849ddf-tlpmv"]
Sep 15 09:39:47.862518 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:47.862481    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b50cece-20cd-47a8-83af-4d04adf95c1a-plugins-config-volume\") pod \"payload-processing-e2e-api-b-e029b0-5747849ddf-tlpmv\" (UID: \"4b50cece-20cd-47a8-83af-4d04adf95c1a\") " pod="openshift-ingress/payload-processing-e2e-api-b-e029b0-5747849ddf-tlpmv"
Sep 15 09:39:47.863036 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:47.863000    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ngb5\" (UniqueName: \"kubernetes.io/projected/4b50cece-20cd-47a8-83af-4d04adf95c1a-kube-api-access-9ngb5\") pod \"payload-processing-e2e-api-b-e029b0-5747849ddf-tlpmv\" (UID: \"4b50cece-20cd-47a8-83af-4d04adf95c1a\") " pod="openshift-ingress/payload-processing-e2e-api-b-e029b0-5747849ddf-tlpmv"
Sep 15 09:39:47.963700 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:47.963669    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ngb5\" (UniqueName: \"kubernetes.io/projected/4b50cece-20cd-47a8-83af-4d04adf95c1a-kube-api-access-9ngb5\") pod \"payload-processing-e2e-api-b-e029b0-5747849ddf-tlpmv\" (UID: \"4b50cece-20cd-47a8-83af-4d04adf95c1a\") " pod="openshift-ingress/payload-processing-e2e-api-b-e029b0-5747849ddf-tlpmv"
Sep 15 09:39:47.963819 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:47.963713    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b50cece-20cd-47a8-83af-4d04adf95c1a-plugins-config-volume\") pod \"payload-processing-e2e-api-b-e029b0-5747849ddf-tlpmv\" (UID: \"4b50cece-20cd-47a8-83af-4d04adf95c1a\") " pod="openshift-ingress/payload-processing-e2e-api-b-e029b0-5747849ddf-tlpmv"
Sep 15 09:39:47.964374 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:47.964356    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b50cece-20cd-47a8-83af-4d04adf95c1a-plugins-config-volume\") pod \"payload-processing-e2e-api-b-e029b0-5747849ddf-tlpmv\" (UID: \"4b50cece-20cd-47a8-83af-4d04adf95c1a\") " pod="openshift-ingress/payload-processing-e2e-api-b-e029b0-5747849ddf-tlpmv"
Sep 15 09:39:47.971213 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:47.971190    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ngb5\" (UniqueName: \"kubernetes.io/projected/4b50cece-20cd-47a8-83af-4d04adf95c1a-kube-api-access-9ngb5\") pod \"payload-processing-e2e-api-b-e029b0-5747849ddf-tlpmv\" (UID: \"4b50cece-20cd-47a8-83af-4d04adf95c1a\") " pod="openshift-ingress/payload-processing-e2e-api-b-e029b0-5747849ddf-tlpmv"
Sep 15 09:39:48.084382 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:48.084324    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-e029b0-5747849ddf-tlpmv"
Sep 15 09:39:48.369407 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:48.369379    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-e029b0-5747849ddf-tlpmv"]
Sep 15 09:39:48.370329 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:39:48.370302    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b50cece_20cd_47a8_83af_4d04adf95c1a.slice/crio-19c19c6a00b2b7f19f1ab0c31bdb986ba9fd1bccc8414d89105086d7a39136a6 WatchSource:0}: Error finding container 19c19c6a00b2b7f19f1ab0c31bdb986ba9fd1bccc8414d89105086d7a39136a6: Status 404 returned error can't find the container with id 19c19c6a00b2b7f19f1ab0c31bdb986ba9fd1bccc8414d89105086d7a39136a6
Sep 15 09:39:49.135838 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:49.135801    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-e029b0-5747849ddf-tlpmv" event={"ID":"4b50cece-20cd-47a8-83af-4d04adf95c1a","Type":"ContainerStarted","Data":"c89702234038493c8ae1725ce668e557d1ee80d99efb02b351416c4d4cfc18f1"}
Sep 15 09:39:49.136312 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:49.135861    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-e029b0-5747849ddf-tlpmv"
Sep 15 09:39:49.136312 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:49.135877    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-e029b0-5747849ddf-tlpmv" event={"ID":"4b50cece-20cd-47a8-83af-4d04adf95c1a","Type":"ContainerStarted","Data":"19c19c6a00b2b7f19f1ab0c31bdb986ba9fd1bccc8414d89105086d7a39136a6"}
Sep 15 09:39:49.152068 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:39:49.152023    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-e029b0-5747849ddf-tlpmv" podStartSLOduration=2.152009545 podStartE2EDuration="2.152009545s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:39:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:39:49.150703605 +0000 UTC m=+1533.489148882" watchObservedRunningTime="2026-09-15 09:39:49.152009545 +0000 UTC m=+1533.490454820"
Sep 15 09:40:00.143733 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:00.143700    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-e029b0-5747849ddf-tlpmv"
Sep 15 09:40:16.435059 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:16.435025    2578 scope.go:117] "RemoveContainer" containerID="9353724eb563c5bbb0be1965d324138b011f9af7508c42c71fe23beca3362806"
Sep 15 09:40:26.080768 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:26.080733    2578 patch_prober.go:28] interesting pod/e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused" start-of-body=
Sep 15 09:40:26.081187 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:26.080792    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p" podUID="db2acd32-78bd-44ad-bdcc-63253a0950fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.95:15021/healthz/ready\": dial tcp 10.134.0.95:15021: connect: connection refused"
Sep 15 09:40:26.380254 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:26.380172    2578 generic.go:356] "Generic (PLEG): container finished" podID="db2acd32-78bd-44ad-bdcc-63253a0950fd" containerID="75f62726329517485e3a4f6741ca1cd1b3da052e28155d22367fcd477eac95b6" exitCode=0
Sep 15 09:40:26.380390 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:26.380249    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p" event={"ID":"db2acd32-78bd-44ad-bdcc-63253a0950fd","Type":"ContainerDied","Data":"75f62726329517485e3a4f6741ca1cd1b3da052e28155d22367fcd477eac95b6"}
Sep 15 09:40:26.380631 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:26.380617    2578 scope.go:117] "RemoveContainer" containerID="75f62726329517485e3a4f6741ca1cd1b3da052e28155d22367fcd477eac95b6"
Sep 15 09:40:26.381773 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:26.381743    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:40:26.381885 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:26.381826    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:40:26.381885 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:26.381871    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:40:27.388508 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:27.388478    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p" event={"ID":"db2acd32-78bd-44ad-bdcc-63253a0950fd","Type":"ContainerStarted","Data":"a4df37b45e7b37624830aea3f5796da8a1a590b2ebac4e9376e38d5cf76a11a5"}
Sep 15 09:40:27.854128 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:27.854097    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p"
Sep 15 09:40:27.858367 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:27.858341    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p"
Sep 15 09:40:28.394353 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:28.394324    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p"
Sep 15 09:40:28.395097 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:28.395082    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p"
Sep 15 09:40:30.744747 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:30.744712    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-c9d6bb-f6776bdf9-gkj5w"]
Sep 15 09:40:30.745253 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:30.745001    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-c9d6bb-f6776bdf9-gkj5w" podUID="f7b0a0be-1283-407f-befc-807c497c6913" containerName="payload-processing" containerID="cri-o://2759aea7bd7a21ed9895c8b03505081b229a990586596973bc7f5d244f36b552" gracePeriod=30
Sep 15 09:40:30.751532 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:30.751508    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-c9d6bb-6944b69bcd-lll49"]
Sep 15 09:40:30.751739 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:30.751713    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-c9d6bb-6944b69bcd-lll49" podUID="3b7ce802-c6e6-40ce-bd59-43ed2af76f81" containerName="payload-pre-processing" containerID="cri-o://55d0f2b4a0535b5106f9c457b9e098928da06ee09b6a58c527f33b540a40f4e4" gracePeriod=30
Sep 15 09:40:31.074454 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:31.073995    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-c9d6bb-f6776bdf9-gkj5w"
Sep 15 09:40:31.076362 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:31.076336    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-c9d6bb-6944b69bcd-lll49"
Sep 15 09:40:31.178033 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:31.178004    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f7b0a0be-1283-407f-befc-807c497c6913-plugins-config-volume\") pod \"f7b0a0be-1283-407f-befc-807c497c6913\" (UID: \"f7b0a0be-1283-407f-befc-807c497c6913\") "
Sep 15 09:40:31.178192 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:31.178072    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3b7ce802-c6e6-40ce-bd59-43ed2af76f81-plugins-config-volume\") pod \"3b7ce802-c6e6-40ce-bd59-43ed2af76f81\" (UID: \"3b7ce802-c6e6-40ce-bd59-43ed2af76f81\") "
Sep 15 09:40:31.178192 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:31.178141    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cqq6x\" (UniqueName: \"kubernetes.io/projected/f7b0a0be-1283-407f-befc-807c497c6913-kube-api-access-cqq6x\") pod \"f7b0a0be-1283-407f-befc-807c497c6913\" (UID: \"f7b0a0be-1283-407f-befc-807c497c6913\") "
Sep 15 09:40:31.178289 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:31.178259    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjh42\" (UniqueName: \"kubernetes.io/projected/3b7ce802-c6e6-40ce-bd59-43ed2af76f81-kube-api-access-rjh42\") pod \"3b7ce802-c6e6-40ce-bd59-43ed2af76f81\" (UID: \"3b7ce802-c6e6-40ce-bd59-43ed2af76f81\") "
Sep 15 09:40:31.178403 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:31.178381    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7b0a0be-1283-407f-befc-807c497c6913-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f7b0a0be-1283-407f-befc-807c497c6913" (UID: "f7b0a0be-1283-407f-befc-807c497c6913"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:40:31.178500 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:31.178481    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b7ce802-c6e6-40ce-bd59-43ed2af76f81-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3b7ce802-c6e6-40ce-bd59-43ed2af76f81" (UID: "3b7ce802-c6e6-40ce-bd59-43ed2af76f81"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:40:31.178630 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:31.178616    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f7b0a0be-1283-407f-befc-807c497c6913-plugins-config-volume\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:40:31.178674 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:31.178632    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3b7ce802-c6e6-40ce-bd59-43ed2af76f81-plugins-config-volume\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:40:31.180201 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:31.180180    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b7ce802-c6e6-40ce-bd59-43ed2af76f81-kube-api-access-rjh42" (OuterVolumeSpecName: "kube-api-access-rjh42") pod "3b7ce802-c6e6-40ce-bd59-43ed2af76f81" (UID: "3b7ce802-c6e6-40ce-bd59-43ed2af76f81"). InnerVolumeSpecName "kube-api-access-rjh42". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:40:31.180281 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:31.180259    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7b0a0be-1283-407f-befc-807c497c6913-kube-api-access-cqq6x" (OuterVolumeSpecName: "kube-api-access-cqq6x") pod "f7b0a0be-1283-407f-befc-807c497c6913" (UID: "f7b0a0be-1283-407f-befc-807c497c6913"). InnerVolumeSpecName "kube-api-access-cqq6x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:40:31.279090 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:31.279070    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cqq6x\" (UniqueName: \"kubernetes.io/projected/f7b0a0be-1283-407f-befc-807c497c6913-kube-api-access-cqq6x\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:40:31.279090 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:31.279088    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjh42\" (UniqueName: \"kubernetes.io/projected/3b7ce802-c6e6-40ce-bd59-43ed2af76f81-kube-api-access-rjh42\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:40:31.413255 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:31.413196    2578 generic.go:356] "Generic (PLEG): container finished" podID="f7b0a0be-1283-407f-befc-807c497c6913" containerID="2759aea7bd7a21ed9895c8b03505081b229a990586596973bc7f5d244f36b552" exitCode=0
Sep 15 09:40:31.413255 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:31.413240    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-c9d6bb-f6776bdf9-gkj5w"
Sep 15 09:40:31.413386 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:31.413288    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-c9d6bb-f6776bdf9-gkj5w" event={"ID":"f7b0a0be-1283-407f-befc-807c497c6913","Type":"ContainerDied","Data":"2759aea7bd7a21ed9895c8b03505081b229a990586596973bc7f5d244f36b552"}
Sep 15 09:40:31.413386 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:31.413333    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-c9d6bb-f6776bdf9-gkj5w" event={"ID":"f7b0a0be-1283-407f-befc-807c497c6913","Type":"ContainerDied","Data":"60e05ea77edd2bac1faa8b41747f44f63fffe13a955aa5f405e6257566a0f9b6"}
Sep 15 09:40:31.413386 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:31.413359    2578 scope.go:117] "RemoveContainer" containerID="2759aea7bd7a21ed9895c8b03505081b229a990586596973bc7f5d244f36b552"
Sep 15 09:40:31.414863 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:31.414837    2578 generic.go:356] "Generic (PLEG): container finished" podID="3b7ce802-c6e6-40ce-bd59-43ed2af76f81" containerID="55d0f2b4a0535b5106f9c457b9e098928da06ee09b6a58c527f33b540a40f4e4" exitCode=0
Sep 15 09:40:31.414990 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:31.414886    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-c9d6bb-6944b69bcd-lll49"
Sep 15 09:40:31.414990 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:31.414883    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-c9d6bb-6944b69bcd-lll49" event={"ID":"3b7ce802-c6e6-40ce-bd59-43ed2af76f81","Type":"ContainerDied","Data":"55d0f2b4a0535b5106f9c457b9e098928da06ee09b6a58c527f33b540a40f4e4"}
Sep 15 09:40:31.415117 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:31.415014    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-c9d6bb-6944b69bcd-lll49" event={"ID":"3b7ce802-c6e6-40ce-bd59-43ed2af76f81","Type":"ContainerDied","Data":"43349ff7f92fbb1c21c801ca61d889368e4d62f3473f2f4b34ae1b2202472d60"}
Sep 15 09:40:31.432276 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:31.432257    2578 scope.go:117] "RemoveContainer" containerID="2759aea7bd7a21ed9895c8b03505081b229a990586596973bc7f5d244f36b552"
Sep 15 09:40:31.432565 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:40:31.432547    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2759aea7bd7a21ed9895c8b03505081b229a990586596973bc7f5d244f36b552\": container with ID starting with 2759aea7bd7a21ed9895c8b03505081b229a990586596973bc7f5d244f36b552 not found: ID does not exist" containerID="2759aea7bd7a21ed9895c8b03505081b229a990586596973bc7f5d244f36b552"
Sep 15 09:40:31.432617 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:31.432572    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2759aea7bd7a21ed9895c8b03505081b229a990586596973bc7f5d244f36b552"} err="failed to get container status \"2759aea7bd7a21ed9895c8b03505081b229a990586596973bc7f5d244f36b552\": rpc error: code = NotFound desc = could not find container \"2759aea7bd7a21ed9895c8b03505081b229a990586596973bc7f5d244f36b552\": container with ID starting with 2759aea7bd7a21ed9895c8b03505081b229a990586596973bc7f5d244f36b552 not found: ID does not exist"
Sep 15 09:40:31.432617 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:31.432588    2578 scope.go:117] "RemoveContainer" containerID="55d0f2b4a0535b5106f9c457b9e098928da06ee09b6a58c527f33b540a40f4e4"
Sep 15 09:40:31.441694 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:31.441678    2578 scope.go:117] "RemoveContainer" containerID="55d0f2b4a0535b5106f9c457b9e098928da06ee09b6a58c527f33b540a40f4e4"
Sep 15 09:40:31.441981 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:40:31.441940    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55d0f2b4a0535b5106f9c457b9e098928da06ee09b6a58c527f33b540a40f4e4\": container with ID starting with 55d0f2b4a0535b5106f9c457b9e098928da06ee09b6a58c527f33b540a40f4e4 not found: ID does not exist" containerID="55d0f2b4a0535b5106f9c457b9e098928da06ee09b6a58c527f33b540a40f4e4"
Sep 15 09:40:31.442056 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:31.441987    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55d0f2b4a0535b5106f9c457b9e098928da06ee09b6a58c527f33b540a40f4e4"} err="failed to get container status \"55d0f2b4a0535b5106f9c457b9e098928da06ee09b6a58c527f33b540a40f4e4\": rpc error: code = NotFound desc = could not find container \"55d0f2b4a0535b5106f9c457b9e098928da06ee09b6a58c527f33b540a40f4e4\": container with ID starting with 55d0f2b4a0535b5106f9c457b9e098928da06ee09b6a58c527f33b540a40f4e4 not found: ID does not exist"
Sep 15 09:40:31.442464 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:31.442453    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-c9d6bb-6944b69bcd-lll49"]
Sep 15 09:40:31.445185 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:31.445164    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-c9d6bb-6944b69bcd-lll49"]
Sep 15 09:40:31.454204 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:31.454185    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-c9d6bb-f6776bdf9-gkj5w"]
Sep 15 09:40:31.457766 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:31.457746    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-c9d6bb-f6776bdf9-gkj5w"]
Sep 15 09:40:32.122617 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:32.122580    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b7ce802-c6e6-40ce-bd59-43ed2af76f81" path="/var/lib/kubelet/pods/3b7ce802-c6e6-40ce-bd59-43ed2af76f81/volumes"
Sep 15 09:40:32.123104 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:32.123085    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7b0a0be-1283-407f-befc-807c497c6913" path="/var/lib/kubelet/pods/f7b0a0be-1283-407f-befc-807c497c6913/volumes"
Sep 15 09:40:37.574063 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:37.574032    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh"]
Sep 15 09:40:37.574600 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:37.574290    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh" podUID="a2fc38fe-a89f-4ed2-9991-f288e6ddd035" containerName="istio-proxy" containerID="cri-o://b9814566ec49fcc07006b652ae549f147017146dd18a8d48d5f0a7c41b537d40" gracePeriod=30
Sep 15 09:40:41.196126 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:41.196081    2578 patch_prober.go:28] interesting pod/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 15 09:40:41.196506 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:41.196165    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh" podUID="a2fc38fe-a89f-4ed2-9991-f288e6ddd035" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 09:40:42.832453 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:42.832425    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh"
Sep 15 09:40:43.000786 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:43.000758    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2fc38fe-a89f-4ed2-9991-f288e6ddd035-istiod-ca-cert\") pod \"a2fc38fe-a89f-4ed2-9991-f288e6ddd035\" (UID: \"a2fc38fe-a89f-4ed2-9991-f288e6ddd035\") "
Sep 15 09:40:43.000977 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:43.000793    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2fc38fe-a89f-4ed2-9991-f288e6ddd035-istio-token\") pod \"a2fc38fe-a89f-4ed2-9991-f288e6ddd035\" (UID: \"a2fc38fe-a89f-4ed2-9991-f288e6ddd035\") "
Sep 15 09:40:43.000977 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:43.000840    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2fc38fe-a89f-4ed2-9991-f288e6ddd035-istio-data\") pod \"a2fc38fe-a89f-4ed2-9991-f288e6ddd035\" (UID: \"a2fc38fe-a89f-4ed2-9991-f288e6ddd035\") "
Sep 15 09:40:43.000977 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:43.000873    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2fc38fe-a89f-4ed2-9991-f288e6ddd035-workload-certs\") pod \"a2fc38fe-a89f-4ed2-9991-f288e6ddd035\" (UID: \"a2fc38fe-a89f-4ed2-9991-f288e6ddd035\") "
Sep 15 09:40:43.000977 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:43.000894    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2fc38fe-a89f-4ed2-9991-f288e6ddd035-credential-socket\") pod \"a2fc38fe-a89f-4ed2-9991-f288e6ddd035\" (UID: \"a2fc38fe-a89f-4ed2-9991-f288e6ddd035\") "
Sep 15 09:40:43.000977 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:43.000939    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2fc38fe-a89f-4ed2-9991-f288e6ddd035-istio-envoy\") pod \"a2fc38fe-a89f-4ed2-9991-f288e6ddd035\" (UID: \"a2fc38fe-a89f-4ed2-9991-f288e6ddd035\") "
Sep 15 09:40:43.001255 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:43.001005    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2fc38fe-a89f-4ed2-9991-f288e6ddd035-workload-socket\") pod \"a2fc38fe-a89f-4ed2-9991-f288e6ddd035\" (UID: \"a2fc38fe-a89f-4ed2-9991-f288e6ddd035\") "
Sep 15 09:40:43.001255 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:43.001062    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2fc38fe-a89f-4ed2-9991-f288e6ddd035-istio-podinfo\") pod \"a2fc38fe-a89f-4ed2-9991-f288e6ddd035\" (UID: \"a2fc38fe-a89f-4ed2-9991-f288e6ddd035\") "
Sep 15 09:40:43.001255 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:43.001092    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w77vf\" (UniqueName: \"kubernetes.io/projected/a2fc38fe-a89f-4ed2-9991-f288e6ddd035-kube-api-access-w77vf\") pod \"a2fc38fe-a89f-4ed2-9991-f288e6ddd035\" (UID: \"a2fc38fe-a89f-4ed2-9991-f288e6ddd035\") "
Sep 15 09:40:43.001255 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:43.001131    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2fc38fe-a89f-4ed2-9991-f288e6ddd035-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a2fc38fe-a89f-4ed2-9991-f288e6ddd035" (UID: "a2fc38fe-a89f-4ed2-9991-f288e6ddd035"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:40:43.001255 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:43.001180    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2fc38fe-a89f-4ed2-9991-f288e6ddd035-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a2fc38fe-a89f-4ed2-9991-f288e6ddd035" (UID: "a2fc38fe-a89f-4ed2-9991-f288e6ddd035"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:40:43.001255 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:43.001214    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2fc38fe-a89f-4ed2-9991-f288e6ddd035-istio-data" (OuterVolumeSpecName: "istio-data") pod "a2fc38fe-a89f-4ed2-9991-f288e6ddd035" (UID: "a2fc38fe-a89f-4ed2-9991-f288e6ddd035"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:40:43.001255 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:43.001230    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2fc38fe-a89f-4ed2-9991-f288e6ddd035-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a2fc38fe-a89f-4ed2-9991-f288e6ddd035" (UID: "a2fc38fe-a89f-4ed2-9991-f288e6ddd035"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:40:43.001601 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:43.001304    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2fc38fe-a89f-4ed2-9991-f288e6ddd035-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a2fc38fe-a89f-4ed2-9991-f288e6ddd035" (UID: "a2fc38fe-a89f-4ed2-9991-f288e6ddd035"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:40:43.001601 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:43.001498    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2fc38fe-a89f-4ed2-9991-f288e6ddd035-workload-socket\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:40:43.001601 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:43.001510    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2fc38fe-a89f-4ed2-9991-f288e6ddd035-istiod-ca-cert\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:40:43.001601 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:43.001519    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2fc38fe-a89f-4ed2-9991-f288e6ddd035-istio-data\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:40:43.001601 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:43.001528    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2fc38fe-a89f-4ed2-9991-f288e6ddd035-workload-certs\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:40:43.001601 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:43.001535    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2fc38fe-a89f-4ed2-9991-f288e6ddd035-credential-socket\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:40:43.003154 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:43.003126    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2fc38fe-a89f-4ed2-9991-f288e6ddd035-istio-token" (OuterVolumeSpecName: "istio-token") pod "a2fc38fe-a89f-4ed2-9991-f288e6ddd035" (UID: "a2fc38fe-a89f-4ed2-9991-f288e6ddd035"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:40:43.003264 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:43.003209    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2fc38fe-a89f-4ed2-9991-f288e6ddd035-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a2fc38fe-a89f-4ed2-9991-f288e6ddd035" (UID: "a2fc38fe-a89f-4ed2-9991-f288e6ddd035"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:40:43.003264 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:43.003213    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a2fc38fe-a89f-4ed2-9991-f288e6ddd035-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a2fc38fe-a89f-4ed2-9991-f288e6ddd035" (UID: "a2fc38fe-a89f-4ed2-9991-f288e6ddd035"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 09:40:43.003376 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:43.003355    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2fc38fe-a89f-4ed2-9991-f288e6ddd035-kube-api-access-w77vf" (OuterVolumeSpecName: "kube-api-access-w77vf") pod "a2fc38fe-a89f-4ed2-9991-f288e6ddd035" (UID: "a2fc38fe-a89f-4ed2-9991-f288e6ddd035"). InnerVolumeSpecName "kube-api-access-w77vf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:40:43.102051 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:43.102025    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2fc38fe-a89f-4ed2-9991-f288e6ddd035-istio-token\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:40:43.102051 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:43.102046    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2fc38fe-a89f-4ed2-9991-f288e6ddd035-istio-envoy\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:40:43.102051 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:43.102054    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2fc38fe-a89f-4ed2-9991-f288e6ddd035-istio-podinfo\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:40:43.102220 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:43.102062    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w77vf\" (UniqueName: \"kubernetes.io/projected/a2fc38fe-a89f-4ed2-9991-f288e6ddd035-kube-api-access-w77vf\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:40:43.492985 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:43.492935    2578 generic.go:356] "Generic (PLEG): container finished" podID="a2fc38fe-a89f-4ed2-9991-f288e6ddd035" containerID="b9814566ec49fcc07006b652ae549f147017146dd18a8d48d5f0a7c41b537d40" exitCode=0
Sep 15 09:40:43.492985 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:43.492978    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh" event={"ID":"a2fc38fe-a89f-4ed2-9991-f288e6ddd035","Type":"ContainerDied","Data":"b9814566ec49fcc07006b652ae549f147017146dd18a8d48d5f0a7c41b537d40"}
Sep 15 09:40:43.493234 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:43.493021    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh"
Sep 15 09:40:43.493234 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:43.493036    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh" event={"ID":"a2fc38fe-a89f-4ed2-9991-f288e6ddd035","Type":"ContainerDied","Data":"f16fb41aa2fe69e90be1bce5eeb1b3fb5aaa0cc33f466d906b6c4712f905b7f8"}
Sep 15 09:40:43.493234 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:43.493059    2578 scope.go:117] "RemoveContainer" containerID="b9814566ec49fcc07006b652ae549f147017146dd18a8d48d5f0a7c41b537d40"
Sep 15 09:40:43.502904 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:43.502890    2578 scope.go:117] "RemoveContainer" containerID="7d2e1caf75d40672142b05c9a128c265a276db1d0033e243907fa30b0929cb83"
Sep 15 09:40:43.512031 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:43.511791    2578 scope.go:117] "RemoveContainer" containerID="b9814566ec49fcc07006b652ae549f147017146dd18a8d48d5f0a7c41b537d40"
Sep 15 09:40:43.512206 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:40:43.512185    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9814566ec49fcc07006b652ae549f147017146dd18a8d48d5f0a7c41b537d40\": container with ID starting with b9814566ec49fcc07006b652ae549f147017146dd18a8d48d5f0a7c41b537d40 not found: ID does not exist" containerID="b9814566ec49fcc07006b652ae549f147017146dd18a8d48d5f0a7c41b537d40"
Sep 15 09:40:43.512284 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:43.512218    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9814566ec49fcc07006b652ae549f147017146dd18a8d48d5f0a7c41b537d40"} err="failed to get container status \"b9814566ec49fcc07006b652ae549f147017146dd18a8d48d5f0a7c41b537d40\": rpc error: code = NotFound desc = could not find container \"b9814566ec49fcc07006b652ae549f147017146dd18a8d48d5f0a7c41b537d40\": container with ID starting with b9814566ec49fcc07006b652ae549f147017146dd18a8d48d5f0a7c41b537d40 not found: ID does not exist"
Sep 15 09:40:43.512284 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:43.512241    2578 scope.go:117] "RemoveContainer" containerID="7d2e1caf75d40672142b05c9a128c265a276db1d0033e243907fa30b0929cb83"
Sep 15 09:40:43.512576 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:40:43.512554    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d2e1caf75d40672142b05c9a128c265a276db1d0033e243907fa30b0929cb83\": container with ID starting with 7d2e1caf75d40672142b05c9a128c265a276db1d0033e243907fa30b0929cb83 not found: ID does not exist" containerID="7d2e1caf75d40672142b05c9a128c265a276db1d0033e243907fa30b0929cb83"
Sep 15 09:40:43.512637 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:43.512585    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d2e1caf75d40672142b05c9a128c265a276db1d0033e243907fa30b0929cb83"} err="failed to get container status \"7d2e1caf75d40672142b05c9a128c265a276db1d0033e243907fa30b0929cb83\": rpc error: code = NotFound desc = could not find container \"7d2e1caf75d40672142b05c9a128c265a276db1d0033e243907fa30b0929cb83\": container with ID starting with 7d2e1caf75d40672142b05c9a128c265a276db1d0033e243907fa30b0929cb83 not found: ID does not exist"
Sep 15 09:40:43.515237 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:43.515125    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh"]
Sep 15 09:40:43.518055 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:43.518035    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-c9d6bb-openshift-default-84b997f5b4-4qkkh"]
Sep 15 09:40:44.122187 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:44.122159    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2fc38fe-a89f-4ed2-9991-f288e6ddd035" path="/var/lib/kubelet/pods/a2fc38fe-a89f-4ed2-9991-f288e6ddd035/volumes"
Sep 15 09:40:53.413660 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:53.413297    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-e029b0-5747849ddf-tlpmv"]
Sep 15 09:40:53.414861 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:53.413601    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-e029b0-5747849ddf-tlpmv" podUID="4b50cece-20cd-47a8-83af-4d04adf95c1a" containerName="payload-processing" containerID="cri-o://c89702234038493c8ae1725ce668e557d1ee80d99efb02b351416c4d4cfc18f1" gracePeriod=30
Sep 15 09:40:53.561074 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:53.561042    2578 generic.go:356] "Generic (PLEG): container finished" podID="4b50cece-20cd-47a8-83af-4d04adf95c1a" containerID="c89702234038493c8ae1725ce668e557d1ee80d99efb02b351416c4d4cfc18f1" exitCode=0
Sep 15 09:40:53.561206 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:53.561115    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-e029b0-5747849ddf-tlpmv" event={"ID":"4b50cece-20cd-47a8-83af-4d04adf95c1a","Type":"ContainerDied","Data":"c89702234038493c8ae1725ce668e557d1ee80d99efb02b351416c4d4cfc18f1"}
Sep 15 09:40:53.674802 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:53.674751    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-e029b0-5747849ddf-tlpmv"
Sep 15 09:40:53.798189 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:53.798159    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b50cece-20cd-47a8-83af-4d04adf95c1a-plugins-config-volume\") pod \"4b50cece-20cd-47a8-83af-4d04adf95c1a\" (UID: \"4b50cece-20cd-47a8-83af-4d04adf95c1a\") "
Sep 15 09:40:53.798364 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:53.798204    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9ngb5\" (UniqueName: \"kubernetes.io/projected/4b50cece-20cd-47a8-83af-4d04adf95c1a-kube-api-access-9ngb5\") pod \"4b50cece-20cd-47a8-83af-4d04adf95c1a\" (UID: \"4b50cece-20cd-47a8-83af-4d04adf95c1a\") "
Sep 15 09:40:53.798583 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:53.798554    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b50cece-20cd-47a8-83af-4d04adf95c1a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4b50cece-20cd-47a8-83af-4d04adf95c1a" (UID: "4b50cece-20cd-47a8-83af-4d04adf95c1a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:40:53.800306 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:53.800287    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b50cece-20cd-47a8-83af-4d04adf95c1a-kube-api-access-9ngb5" (OuterVolumeSpecName: "kube-api-access-9ngb5") pod "4b50cece-20cd-47a8-83af-4d04adf95c1a" (UID: "4b50cece-20cd-47a8-83af-4d04adf95c1a"). InnerVolumeSpecName "kube-api-access-9ngb5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:40:53.899895 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:53.899875    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b50cece-20cd-47a8-83af-4d04adf95c1a-plugins-config-volume\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:40:53.899983 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:53.899896    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9ngb5\" (UniqueName: \"kubernetes.io/projected/4b50cece-20cd-47a8-83af-4d04adf95c1a-kube-api-access-9ngb5\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:40:54.568618 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:54.568594    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-e029b0-5747849ddf-tlpmv"
Sep 15 09:40:54.569037 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:54.568593    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-e029b0-5747849ddf-tlpmv" event={"ID":"4b50cece-20cd-47a8-83af-4d04adf95c1a","Type":"ContainerDied","Data":"19c19c6a00b2b7f19f1ab0c31bdb986ba9fd1bccc8414d89105086d7a39136a6"}
Sep 15 09:40:54.569037 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:54.568732    2578 scope.go:117] "RemoveContainer" containerID="c89702234038493c8ae1725ce668e557d1ee80d99efb02b351416c4d4cfc18f1"
Sep 15 09:40:54.585291 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:54.585271    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-e029b0-5747849ddf-tlpmv"]
Sep 15 09:40:54.591019 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:54.590990    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-e029b0-5747849ddf-tlpmv"]
Sep 15 09:40:56.126129 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:40:56.126089    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b50cece-20cd-47a8-83af-4d04adf95c1a" path="/var/lib/kubelet/pods/4b50cece-20cd-47a8-83af-4d04adf95c1a/volumes"
Sep 15 09:41:00.364207 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:00.364173    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p"]
Sep 15 09:41:00.364654 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:00.364413    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p" podUID="db2acd32-78bd-44ad-bdcc-63253a0950fd" containerName="istio-proxy" containerID="cri-o://a4df37b45e7b37624830aea3f5796da8a1a590b2ebac4e9376e38d5cf76a11a5" gracePeriod=30
Sep 15 09:41:03.629778 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:03.629714    2578 generic.go:356] "Generic (PLEG): container finished" podID="db2acd32-78bd-44ad-bdcc-63253a0950fd" containerID="a4df37b45e7b37624830aea3f5796da8a1a590b2ebac4e9376e38d5cf76a11a5" exitCode=0
Sep 15 09:41:03.630176 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:03.629783    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p" event={"ID":"db2acd32-78bd-44ad-bdcc-63253a0950fd","Type":"ContainerDied","Data":"a4df37b45e7b37624830aea3f5796da8a1a590b2ebac4e9376e38d5cf76a11a5"}
Sep 15 09:41:03.630176 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:03.629840    2578 scope.go:117] "RemoveContainer" containerID="75f62726329517485e3a4f6741ca1cd1b3da052e28155d22367fcd477eac95b6"
Sep 15 09:41:04.130308 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:04.130287    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p"
Sep 15 09:41:04.218016 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:04.217991    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db2acd32-78bd-44ad-bdcc-63253a0950fd-credential-socket\") pod \"db2acd32-78bd-44ad-bdcc-63253a0950fd\" (UID: \"db2acd32-78bd-44ad-bdcc-63253a0950fd\") "
Sep 15 09:41:04.218153 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:04.218090    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db2acd32-78bd-44ad-bdcc-63253a0950fd-istio-data\") pod \"db2acd32-78bd-44ad-bdcc-63253a0950fd\" (UID: \"db2acd32-78bd-44ad-bdcc-63253a0950fd\") "
Sep 15 09:41:04.218153 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:04.218121    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db2acd32-78bd-44ad-bdcc-63253a0950fd-workload-socket\") pod \"db2acd32-78bd-44ad-bdcc-63253a0950fd\" (UID: \"db2acd32-78bd-44ad-bdcc-63253a0950fd\") "
Sep 15 09:41:04.218240 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:04.218159    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db2acd32-78bd-44ad-bdcc-63253a0950fd-istio-envoy\") pod \"db2acd32-78bd-44ad-bdcc-63253a0950fd\" (UID: \"db2acd32-78bd-44ad-bdcc-63253a0950fd\") "
Sep 15 09:41:04.218240 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:04.218191    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db2acd32-78bd-44ad-bdcc-63253a0950fd-istio-podinfo\") pod \"db2acd32-78bd-44ad-bdcc-63253a0950fd\" (UID: \"db2acd32-78bd-44ad-bdcc-63253a0950fd\") "
Sep 15 09:41:04.218240 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:04.218220    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db2acd32-78bd-44ad-bdcc-63253a0950fd-workload-certs\") pod \"db2acd32-78bd-44ad-bdcc-63253a0950fd\" (UID: \"db2acd32-78bd-44ad-bdcc-63253a0950fd\") "
Sep 15 09:41:04.218388 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:04.218246    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db2acd32-78bd-44ad-bdcc-63253a0950fd-istiod-ca-cert\") pod \"db2acd32-78bd-44ad-bdcc-63253a0950fd\" (UID: \"db2acd32-78bd-44ad-bdcc-63253a0950fd\") "
Sep 15 09:41:04.218388 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:04.218245    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db2acd32-78bd-44ad-bdcc-63253a0950fd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "db2acd32-78bd-44ad-bdcc-63253a0950fd" (UID: "db2acd32-78bd-44ad-bdcc-63253a0950fd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:41:04.218388 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:04.218302    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db2acd32-78bd-44ad-bdcc-63253a0950fd-istio-token\") pod \"db2acd32-78bd-44ad-bdcc-63253a0950fd\" (UID: \"db2acd32-78bd-44ad-bdcc-63253a0950fd\") "
Sep 15 09:41:04.218388 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:04.218352    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db2acd32-78bd-44ad-bdcc-63253a0950fd-istio-data" (OuterVolumeSpecName: "istio-data") pod "db2acd32-78bd-44ad-bdcc-63253a0950fd" (UID: "db2acd32-78bd-44ad-bdcc-63253a0950fd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:41:04.218600 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:04.218408    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9b9d\" (UniqueName: \"kubernetes.io/projected/db2acd32-78bd-44ad-bdcc-63253a0950fd-kube-api-access-m9b9d\") pod \"db2acd32-78bd-44ad-bdcc-63253a0950fd\" (UID: \"db2acd32-78bd-44ad-bdcc-63253a0950fd\") "
Sep 15 09:41:04.218600 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:04.218536    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db2acd32-78bd-44ad-bdcc-63253a0950fd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "db2acd32-78bd-44ad-bdcc-63253a0950fd" (UID: "db2acd32-78bd-44ad-bdcc-63253a0950fd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:41:04.218719 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:04.218617    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db2acd32-78bd-44ad-bdcc-63253a0950fd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "db2acd32-78bd-44ad-bdcc-63253a0950fd" (UID: "db2acd32-78bd-44ad-bdcc-63253a0950fd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:41:04.218719 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:04.218689    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db2acd32-78bd-44ad-bdcc-63253a0950fd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "db2acd32-78bd-44ad-bdcc-63253a0950fd" (UID: "db2acd32-78bd-44ad-bdcc-63253a0950fd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:41:04.218821 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:04.218786    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db2acd32-78bd-44ad-bdcc-63253a0950fd-istio-data\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:41:04.218821 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:04.218803    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db2acd32-78bd-44ad-bdcc-63253a0950fd-workload-socket\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:41:04.218821 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:04.218817    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db2acd32-78bd-44ad-bdcc-63253a0950fd-workload-certs\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:41:04.219016 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:04.218830    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db2acd32-78bd-44ad-bdcc-63253a0950fd-istiod-ca-cert\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:41:04.219016 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:04.218837    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db2acd32-78bd-44ad-bdcc-63253a0950fd-credential-socket\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:41:04.220489 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:04.220464    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/db2acd32-78bd-44ad-bdcc-63253a0950fd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "db2acd32-78bd-44ad-bdcc-63253a0950fd" (UID: "db2acd32-78bd-44ad-bdcc-63253a0950fd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 09:41:04.220712 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:04.220693    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db2acd32-78bd-44ad-bdcc-63253a0950fd-kube-api-access-m9b9d" (OuterVolumeSpecName: "kube-api-access-m9b9d") pod "db2acd32-78bd-44ad-bdcc-63253a0950fd" (UID: "db2acd32-78bd-44ad-bdcc-63253a0950fd"). InnerVolumeSpecName "kube-api-access-m9b9d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:41:04.220894 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:04.220870    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db2acd32-78bd-44ad-bdcc-63253a0950fd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "db2acd32-78bd-44ad-bdcc-63253a0950fd" (UID: "db2acd32-78bd-44ad-bdcc-63253a0950fd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:41:04.220894 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:04.220874    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db2acd32-78bd-44ad-bdcc-63253a0950fd-istio-token" (OuterVolumeSpecName: "istio-token") pod "db2acd32-78bd-44ad-bdcc-63253a0950fd" (UID: "db2acd32-78bd-44ad-bdcc-63253a0950fd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:41:04.320011 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:04.319925    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db2acd32-78bd-44ad-bdcc-63253a0950fd-istio-token\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:41:04.320011 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:04.319973    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9b9d\" (UniqueName: \"kubernetes.io/projected/db2acd32-78bd-44ad-bdcc-63253a0950fd-kube-api-access-m9b9d\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:41:04.320011 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:04.319986    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db2acd32-78bd-44ad-bdcc-63253a0950fd-istio-envoy\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:41:04.320011 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:04.319995    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db2acd32-78bd-44ad-bdcc-63253a0950fd-istio-podinfo\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:41:04.645500 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:04.645403    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p" event={"ID":"db2acd32-78bd-44ad-bdcc-63253a0950fd","Type":"ContainerDied","Data":"c3f9a108a0353b63497cdb0df43868e42dcbb5abe5fe74ddbebbecd5c491f046"}
Sep 15 09:41:04.645500 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:04.645446    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p"
Sep 15 09:41:04.645990 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:04.645547    2578 scope.go:117] "RemoveContainer" containerID="a4df37b45e7b37624830aea3f5796da8a1a590b2ebac4e9376e38d5cf76a11a5"
Sep 15 09:41:04.668257 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:04.668233    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p"]
Sep 15 09:41:04.675385 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:04.675362    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-e029b0-openshift-default-74fcfc54c4-9j96p"]
Sep 15 09:41:06.121553 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:06.121516    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db2acd32-78bd-44ad-bdcc-63253a0950fd" path="/var/lib/kubelet/pods/db2acd32-78bd-44ad-bdcc-63253a0950fd/volumes"
Sep 15 09:41:11.195228 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:11.195150    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f514a4-6c487f8bcd-z8xt7"]
Sep 15 09:41:11.195764 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:11.195418    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f514a4-6c487f8bcd-z8xt7" podUID="36e2331e-b1da-4571-86c9-f09f18a44844" containerName="payload-pre-processing" containerID="cri-o://f0374d57e978aa20c470a2c184417e979c1ccf77291565cc1b243005f52ca6d3" gracePeriod=30
Sep 15 09:41:11.452404 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:11.452343    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f514a4-6c487f8bcd-z8xt7"
Sep 15 09:41:11.590162 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:11.590124    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36e2331e-b1da-4571-86c9-f09f18a44844-plugins-config-volume\") pod \"36e2331e-b1da-4571-86c9-f09f18a44844\" (UID: \"36e2331e-b1da-4571-86c9-f09f18a44844\") "
Sep 15 09:41:11.590335 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:11.590237    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k26gv\" (UniqueName: \"kubernetes.io/projected/36e2331e-b1da-4571-86c9-f09f18a44844-kube-api-access-k26gv\") pod \"36e2331e-b1da-4571-86c9-f09f18a44844\" (UID: \"36e2331e-b1da-4571-86c9-f09f18a44844\") "
Sep 15 09:41:11.590481 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:11.590458    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36e2331e-b1da-4571-86c9-f09f18a44844-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "36e2331e-b1da-4571-86c9-f09f18a44844" (UID: "36e2331e-b1da-4571-86c9-f09f18a44844"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:41:11.592322 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:11.592299    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36e2331e-b1da-4571-86c9-f09f18a44844-kube-api-access-k26gv" (OuterVolumeSpecName: "kube-api-access-k26gv") pod "36e2331e-b1da-4571-86c9-f09f18a44844" (UID: "36e2331e-b1da-4571-86c9-f09f18a44844"). InnerVolumeSpecName "kube-api-access-k26gv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:41:11.691036 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:11.691007    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36e2331e-b1da-4571-86c9-f09f18a44844-plugins-config-volume\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:41:11.691036 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:11.691033    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k26gv\" (UniqueName: \"kubernetes.io/projected/36e2331e-b1da-4571-86c9-f09f18a44844-kube-api-access-k26gv\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:41:11.691908 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:11.691882    2578 generic.go:356] "Generic (PLEG): container finished" podID="36e2331e-b1da-4571-86c9-f09f18a44844" containerID="f0374d57e978aa20c470a2c184417e979c1ccf77291565cc1b243005f52ca6d3" exitCode=0
Sep 15 09:41:11.692040 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:11.691926    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f514a4-6c487f8bcd-z8xt7"
Sep 15 09:41:11.692040 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:11.691969    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f514a4-6c487f8bcd-z8xt7" event={"ID":"36e2331e-b1da-4571-86c9-f09f18a44844","Type":"ContainerDied","Data":"f0374d57e978aa20c470a2c184417e979c1ccf77291565cc1b243005f52ca6d3"}
Sep 15 09:41:11.692040 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:11.692026    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f514a4-6c487f8bcd-z8xt7" event={"ID":"36e2331e-b1da-4571-86c9-f09f18a44844","Type":"ContainerDied","Data":"7684c29a4685611b2390c6ca25cd0175849a73d62eb86894b8c6e9f706efdc7a"}
Sep 15 09:41:11.692197 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:11.692048    2578 scope.go:117] "RemoveContainer" containerID="f0374d57e978aa20c470a2c184417e979c1ccf77291565cc1b243005f52ca6d3"
Sep 15 09:41:11.704142 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:11.704123    2578 scope.go:117] "RemoveContainer" containerID="f0374d57e978aa20c470a2c184417e979c1ccf77291565cc1b243005f52ca6d3"
Sep 15 09:41:11.704416 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:41:11.704394    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0374d57e978aa20c470a2c184417e979c1ccf77291565cc1b243005f52ca6d3\": container with ID starting with f0374d57e978aa20c470a2c184417e979c1ccf77291565cc1b243005f52ca6d3 not found: ID does not exist" containerID="f0374d57e978aa20c470a2c184417e979c1ccf77291565cc1b243005f52ca6d3"
Sep 15 09:41:11.704468 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:11.704425    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0374d57e978aa20c470a2c184417e979c1ccf77291565cc1b243005f52ca6d3"} err="failed to get container status \"f0374d57e978aa20c470a2c184417e979c1ccf77291565cc1b243005f52ca6d3\": rpc error: code = NotFound desc = could not find container \"f0374d57e978aa20c470a2c184417e979c1ccf77291565cc1b243005f52ca6d3\": container with ID starting with f0374d57e978aa20c470a2c184417e979c1ccf77291565cc1b243005f52ca6d3 not found: ID does not exist"
Sep 15 09:41:11.716844 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:11.716821    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f514a4-6c487f8bcd-z8xt7"]
Sep 15 09:41:11.720808 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:11.720785    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f514a4-6c487f8bcd-z8xt7"]
Sep 15 09:41:12.122458 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:12.122380    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36e2331e-b1da-4571-86c9-f09f18a44844" path="/var/lib/kubelet/pods/36e2331e-b1da-4571-86c9-f09f18a44844/volumes"
Sep 15 09:41:18.247193 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:18.247160    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-161187-4rcqm"]
Sep 15 09:41:18.247561 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:18.247524    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db2acd32-78bd-44ad-bdcc-63253a0950fd" containerName="istio-proxy"
Sep 15 09:41:18.247561 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:18.247535    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="db2acd32-78bd-44ad-bdcc-63253a0950fd" containerName="istio-proxy"
Sep 15 09:41:18.247561 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:18.247546    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36e2331e-b1da-4571-86c9-f09f18a44844" containerName="payload-pre-processing"
Sep 15 09:41:18.247561 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:18.247552    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="36e2331e-b1da-4571-86c9-f09f18a44844" containerName="payload-pre-processing"
Sep 15 09:41:18.247561 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:18.247563    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2fc38fe-a89f-4ed2-9991-f288e6ddd035" containerName="istio-proxy"
Sep 15 09:41:18.247726 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:18.247569    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2fc38fe-a89f-4ed2-9991-f288e6ddd035" containerName="istio-proxy"
Sep 15 09:41:18.247726 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:18.247577    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2fc38fe-a89f-4ed2-9991-f288e6ddd035" containerName="istio-proxy"
Sep 15 09:41:18.247726 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:18.247583    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2fc38fe-a89f-4ed2-9991-f288e6ddd035" containerName="istio-proxy"
Sep 15 09:41:18.247726 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:18.247594    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b7ce802-c6e6-40ce-bd59-43ed2af76f81" containerName="payload-pre-processing"
Sep 15 09:41:18.247726 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:18.247600    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b7ce802-c6e6-40ce-bd59-43ed2af76f81" containerName="payload-pre-processing"
Sep 15 09:41:18.247726 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:18.247607    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db2acd32-78bd-44ad-bdcc-63253a0950fd" containerName="istio-proxy"
Sep 15 09:41:18.247726 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:18.247612    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="db2acd32-78bd-44ad-bdcc-63253a0950fd" containerName="istio-proxy"
Sep 15 09:41:18.247726 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:18.247621    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7b0a0be-1283-407f-befc-807c497c6913" containerName="payload-processing"
Sep 15 09:41:18.247726 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:18.247627    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7b0a0be-1283-407f-befc-807c497c6913" containerName="payload-processing"
Sep 15 09:41:18.247726 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:18.247633    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b50cece-20cd-47a8-83af-4d04adf95c1a" containerName="payload-processing"
Sep 15 09:41:18.247726 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:18.247638    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b50cece-20cd-47a8-83af-4d04adf95c1a" containerName="payload-processing"
Sep 15 09:41:18.247726 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:18.247694    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b50cece-20cd-47a8-83af-4d04adf95c1a" containerName="payload-processing"
Sep 15 09:41:18.247726 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:18.247702    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2fc38fe-a89f-4ed2-9991-f288e6ddd035" containerName="istio-proxy"
Sep 15 09:41:18.247726 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:18.247707    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="db2acd32-78bd-44ad-bdcc-63253a0950fd" containerName="istio-proxy"
Sep 15 09:41:18.247726 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:18.247713    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b7ce802-c6e6-40ce-bd59-43ed2af76f81" containerName="payload-pre-processing"
Sep 15 09:41:18.247726 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:18.247718    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="db2acd32-78bd-44ad-bdcc-63253a0950fd" containerName="istio-proxy"
Sep 15 09:41:18.247726 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:18.247723    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7b0a0be-1283-407f-befc-807c497c6913" containerName="payload-processing"
Sep 15 09:41:18.247726 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:18.247730    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="36e2331e-b1da-4571-86c9-f09f18a44844" containerName="payload-pre-processing"
Sep 15 09:41:18.249779 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:18.249764    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-161187-4rcqm"
Sep 15 09:41:18.252352 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:18.252329    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cbqnn\""
Sep 15 09:41:18.258365 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:18.258228    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-161187-4rcqm"]
Sep 15 09:41:18.359531 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:18.359497    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a62ca0b8-51c5-48af-94a3-62e52af6da4b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-161187-4rcqm\" (UID: \"a62ca0b8-51c5-48af-94a3-62e52af6da4b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-161187-4rcqm"
Sep 15 09:41:18.460986 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:18.460929    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a62ca0b8-51c5-48af-94a3-62e52af6da4b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-161187-4rcqm\" (UID: \"a62ca0b8-51c5-48af-94a3-62e52af6da4b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-161187-4rcqm"
Sep 15 09:41:18.461529 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:18.461511    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a62ca0b8-51c5-48af-94a3-62e52af6da4b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-161187-4rcqm\" (UID: \"a62ca0b8-51c5-48af-94a3-62e52af6da4b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-161187-4rcqm"
Sep 15 09:41:18.562184 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:18.562108    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-161187-4rcqm"
Sep 15 09:41:18.834848 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:18.834820    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-161187-4rcqm"]
Sep 15 09:41:18.836282 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:41:18.836256    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda62ca0b8_51c5_48af_94a3_62e52af6da4b.slice/crio-38522b2997adbaabb980e4e5bd5d0a5c44c80660b944de945aa770d562b076e6 WatchSource:0}: Error finding container 38522b2997adbaabb980e4e5bd5d0a5c44c80660b944de945aa770d562b076e6: Status 404 returned error can't find the container with id 38522b2997adbaabb980e4e5bd5d0a5c44c80660b944de945aa770d562b076e6
Sep 15 09:41:19.740709 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:19.740681    2578 generic.go:356] "Generic (PLEG): container finished" podID="a62ca0b8-51c5-48af-94a3-62e52af6da4b" containerID="400fcf1d15ea5552aea1094d8699489a15dc1df31783b01a5b553ea6f85acd37" exitCode=0
Sep 15 09:41:19.741088 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:19.740773    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-161187-4rcqm" event={"ID":"a62ca0b8-51c5-48af-94a3-62e52af6da4b","Type":"ContainerDied","Data":"400fcf1d15ea5552aea1094d8699489a15dc1df31783b01a5b553ea6f85acd37"}
Sep 15 09:41:19.741088 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:19.740837    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-161187-4rcqm" event={"ID":"a62ca0b8-51c5-48af-94a3-62e52af6da4b","Type":"ContainerStarted","Data":"38522b2997adbaabb980e4e5bd5d0a5c44c80660b944de945aa770d562b076e6"}
Sep 15 09:41:20.878195 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:20.878173    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-161187-4rcqm"
Sep 15 09:41:20.985752 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:20.985720    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a62ca0b8-51c5-48af-94a3-62e52af6da4b-maas-api-service-ca\") pod \"a62ca0b8-51c5-48af-94a3-62e52af6da4b\" (UID: \"a62ca0b8-51c5-48af-94a3-62e52af6da4b\") "
Sep 15 09:41:20.986120 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:20.986099    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a62ca0b8-51c5-48af-94a3-62e52af6da4b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a62ca0b8-51c5-48af-94a3-62e52af6da4b" (UID: "a62ca0b8-51c5-48af-94a3-62e52af6da4b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:41:21.087001 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:21.086927    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a62ca0b8-51c5-48af-94a3-62e52af6da4b-maas-api-service-ca\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:41:21.753492 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:21.753462    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-161187-4rcqm"
Sep 15 09:41:21.753492 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:21.753477    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-161187-4rcqm" event={"ID":"a62ca0b8-51c5-48af-94a3-62e52af6da4b","Type":"ContainerDied","Data":"38522b2997adbaabb980e4e5bd5d0a5c44c80660b944de945aa770d562b076e6"}
Sep 15 09:41:21.753703 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:21.753527    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="38522b2997adbaabb980e4e5bd5d0a5c44c80660b944de945aa770d562b076e6"
Sep 15 09:41:22.234708 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:22.234677    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-e76bac/premium-w0-e76bac-kserve-d76cf5596-9x78l"]
Sep 15 09:41:29.199413 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:29.199379    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-161187-5bc98c8587-4zgsr"]
Sep 15 09:41:29.199875 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:29.199578    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-161187-5bc98c8587-4zgsr" podUID="7a49e99f-a9f6-4323-a753-e44f5e4b2064" containerName="payload-processing" containerID="cri-o://689841f3f60cf7b8f87fd17b0443c87174c5fb79754380a906f1e4206aa4ad14" gracePeriod=30
Sep 15 09:41:29.208235 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:29.207755    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-161187-864c7c86b6-7qn5b"]
Sep 15 09:41:29.208235 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:29.208015    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-161187-864c7c86b6-7qn5b" podUID="e14f7d4a-07d1-469b-833d-08659608ff1e" containerName="payload-pre-processing" containerID="cri-o://ea7041bcf12262307283c7a80b19fbf9d6754c88e5f6c3b1af1e25a78d50d2f1" gracePeriod=30
Sep 15 09:41:29.363731 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:29.363665    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-161187-4rcqm"]
Sep 15 09:41:29.366421 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:29.366394    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-161187-4rcqm"]
Sep 15 09:41:29.476809 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:29.476788    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-161187-5bc98c8587-4zgsr"
Sep 15 09:41:29.479291 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:29.479276    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-161187-864c7c86b6-7qn5b"
Sep 15 09:41:29.566910 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:29.566874    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a49e99f-a9f6-4323-a753-e44f5e4b2064-plugins-config-volume\") pod \"7a49e99f-a9f6-4323-a753-e44f5e4b2064\" (UID: \"7a49e99f-a9f6-4323-a753-e44f5e4b2064\") "
Sep 15 09:41:29.567110 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:29.567030    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jv9g7\" (UniqueName: \"kubernetes.io/projected/7a49e99f-a9f6-4323-a753-e44f5e4b2064-kube-api-access-jv9g7\") pod \"7a49e99f-a9f6-4323-a753-e44f5e4b2064\" (UID: \"7a49e99f-a9f6-4323-a753-e44f5e4b2064\") "
Sep 15 09:41:29.567181 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:29.567132    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e14f7d4a-07d1-469b-833d-08659608ff1e-plugins-config-volume\") pod \"e14f7d4a-07d1-469b-833d-08659608ff1e\" (UID: \"e14f7d4a-07d1-469b-833d-08659608ff1e\") "
Sep 15 09:41:29.567245 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:29.567207    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sqp9b\" (UniqueName: \"kubernetes.io/projected/e14f7d4a-07d1-469b-833d-08659608ff1e-kube-api-access-sqp9b\") pod \"e14f7d4a-07d1-469b-833d-08659608ff1e\" (UID: \"e14f7d4a-07d1-469b-833d-08659608ff1e\") "
Sep 15 09:41:29.567369 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:29.567347    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a49e99f-a9f6-4323-a753-e44f5e4b2064-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7a49e99f-a9f6-4323-a753-e44f5e4b2064" (UID: "7a49e99f-a9f6-4323-a753-e44f5e4b2064"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:41:29.567442 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:29.567427    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e14f7d4a-07d1-469b-833d-08659608ff1e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e14f7d4a-07d1-469b-833d-08659608ff1e" (UID: "e14f7d4a-07d1-469b-833d-08659608ff1e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:41:29.567641 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:29.567596    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a49e99f-a9f6-4323-a753-e44f5e4b2064-plugins-config-volume\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:41:29.567641 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:29.567617    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e14f7d4a-07d1-469b-833d-08659608ff1e-plugins-config-volume\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:41:29.570522 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:29.570498    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e14f7d4a-07d1-469b-833d-08659608ff1e-kube-api-access-sqp9b" (OuterVolumeSpecName: "kube-api-access-sqp9b") pod "e14f7d4a-07d1-469b-833d-08659608ff1e" (UID: "e14f7d4a-07d1-469b-833d-08659608ff1e"). InnerVolumeSpecName "kube-api-access-sqp9b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:41:29.570620 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:29.570532    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a49e99f-a9f6-4323-a753-e44f5e4b2064-kube-api-access-jv9g7" (OuterVolumeSpecName: "kube-api-access-jv9g7") pod "7a49e99f-a9f6-4323-a753-e44f5e4b2064" (UID: "7a49e99f-a9f6-4323-a753-e44f5e4b2064"). InnerVolumeSpecName "kube-api-access-jv9g7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:41:29.668988 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:29.668929    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jv9g7\" (UniqueName: \"kubernetes.io/projected/7a49e99f-a9f6-4323-a753-e44f5e4b2064-kube-api-access-jv9g7\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:41:29.668988 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:29.668989    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqp9b\" (UniqueName: \"kubernetes.io/projected/e14f7d4a-07d1-469b-833d-08659608ff1e-kube-api-access-sqp9b\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:41:29.804349 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:29.804294    2578 generic.go:356] "Generic (PLEG): container finished" podID="7a49e99f-a9f6-4323-a753-e44f5e4b2064" containerID="689841f3f60cf7b8f87fd17b0443c87174c5fb79754380a906f1e4206aa4ad14" exitCode=0
Sep 15 09:41:29.804531 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:29.804504    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-161187-5bc98c8587-4zgsr" event={"ID":"7a49e99f-a9f6-4323-a753-e44f5e4b2064","Type":"ContainerDied","Data":"689841f3f60cf7b8f87fd17b0443c87174c5fb79754380a906f1e4206aa4ad14"}
Sep 15 09:41:29.804618 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:29.804576    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-161187-5bc98c8587-4zgsr" event={"ID":"7a49e99f-a9f6-4323-a753-e44f5e4b2064","Type":"ContainerDied","Data":"6bd77ff0978e2281b368c14206c9d4d8e698137ff01256ef0c16804ff996cac8"}
Sep 15 09:41:29.804688 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:29.804609    2578 scope.go:117] "RemoveContainer" containerID="689841f3f60cf7b8f87fd17b0443c87174c5fb79754380a906f1e4206aa4ad14"
Sep 15 09:41:29.805068 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:29.805045    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-161187-5bc98c8587-4zgsr"
Sep 15 09:41:29.810355 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:29.810320    2578 generic.go:356] "Generic (PLEG): container finished" podID="e14f7d4a-07d1-469b-833d-08659608ff1e" containerID="ea7041bcf12262307283c7a80b19fbf9d6754c88e5f6c3b1af1e25a78d50d2f1" exitCode=0
Sep 15 09:41:29.810521 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:29.810495    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-161187-864c7c86b6-7qn5b" event={"ID":"e14f7d4a-07d1-469b-833d-08659608ff1e","Type":"ContainerDied","Data":"ea7041bcf12262307283c7a80b19fbf9d6754c88e5f6c3b1af1e25a78d50d2f1"}
Sep 15 09:41:29.810586 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:29.810560    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-161187-864c7c86b6-7qn5b" event={"ID":"e14f7d4a-07d1-469b-833d-08659608ff1e","Type":"ContainerDied","Data":"c8bd9911f93f77e033d863cdfd533bfd4a61ea142cded7045d82ace40e6495ab"}
Sep 15 09:41:29.810660 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:29.810644    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-161187-864c7c86b6-7qn5b"
Sep 15 09:41:29.821343 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:29.821322    2578 scope.go:117] "RemoveContainer" containerID="689841f3f60cf7b8f87fd17b0443c87174c5fb79754380a906f1e4206aa4ad14"
Sep 15 09:41:29.821686 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:41:29.821660    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"689841f3f60cf7b8f87fd17b0443c87174c5fb79754380a906f1e4206aa4ad14\": container with ID starting with 689841f3f60cf7b8f87fd17b0443c87174c5fb79754380a906f1e4206aa4ad14 not found: ID does not exist" containerID="689841f3f60cf7b8f87fd17b0443c87174c5fb79754380a906f1e4206aa4ad14"
Sep 15 09:41:29.821755 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:29.821694    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"689841f3f60cf7b8f87fd17b0443c87174c5fb79754380a906f1e4206aa4ad14"} err="failed to get container status \"689841f3f60cf7b8f87fd17b0443c87174c5fb79754380a906f1e4206aa4ad14\": rpc error: code = NotFound desc = could not find container \"689841f3f60cf7b8f87fd17b0443c87174c5fb79754380a906f1e4206aa4ad14\": container with ID starting with 689841f3f60cf7b8f87fd17b0443c87174c5fb79754380a906f1e4206aa4ad14 not found: ID does not exist"
Sep 15 09:41:29.821755 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:29.821710    2578 scope.go:117] "RemoveContainer" containerID="ea7041bcf12262307283c7a80b19fbf9d6754c88e5f6c3b1af1e25a78d50d2f1"
Sep 15 09:41:29.830121 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:29.830104    2578 scope.go:117] "RemoveContainer" containerID="ea7041bcf12262307283c7a80b19fbf9d6754c88e5f6c3b1af1e25a78d50d2f1"
Sep 15 09:41:29.830395 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:41:29.830376    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea7041bcf12262307283c7a80b19fbf9d6754c88e5f6c3b1af1e25a78d50d2f1\": container with ID starting with ea7041bcf12262307283c7a80b19fbf9d6754c88e5f6c3b1af1e25a78d50d2f1 not found: ID does not exist" containerID="ea7041bcf12262307283c7a80b19fbf9d6754c88e5f6c3b1af1e25a78d50d2f1"
Sep 15 09:41:29.830460 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:29.830403    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea7041bcf12262307283c7a80b19fbf9d6754c88e5f6c3b1af1e25a78d50d2f1"} err="failed to get container status \"ea7041bcf12262307283c7a80b19fbf9d6754c88e5f6c3b1af1e25a78d50d2f1\": rpc error: code = NotFound desc = could not find container \"ea7041bcf12262307283c7a80b19fbf9d6754c88e5f6c3b1af1e25a78d50d2f1\": container with ID starting with ea7041bcf12262307283c7a80b19fbf9d6754c88e5f6c3b1af1e25a78d50d2f1 not found: ID does not exist"
Sep 15 09:41:29.836140 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:29.836118    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-161187-5bc98c8587-4zgsr"]
Sep 15 09:41:29.843924 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:29.843907    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-161187-5bc98c8587-4zgsr"]
Sep 15 09:41:29.853801 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:29.853781    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-161187-864c7c86b6-7qn5b"]
Sep 15 09:41:29.858751 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:29.858728    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-161187-864c7c86b6-7qn5b"]
Sep 15 09:41:30.122201 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:30.122126    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a49e99f-a9f6-4323-a753-e44f5e4b2064" path="/var/lib/kubelet/pods/7a49e99f-a9f6-4323-a753-e44f5e4b2064/volumes"
Sep 15 09:41:30.122493 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:30.122479    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a62ca0b8-51c5-48af-94a3-62e52af6da4b" path="/var/lib/kubelet/pods/a62ca0b8-51c5-48af-94a3-62e52af6da4b/volumes"
Sep 15 09:41:30.122801 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:30.122790    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e14f7d4a-07d1-469b-833d-08659608ff1e" path="/var/lib/kubelet/pods/e14f7d4a-07d1-469b-833d-08659608ff1e/volumes"
Sep 15 09:41:35.646848 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:35.646816    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd"]
Sep 15 09:41:35.647317 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:35.647082    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd" podUID="4b9aa140-0520-470a-98d1-3c711a74a0b9" containerName="istio-proxy" containerID="cri-o://2e77971a720ed3495f0d6ee76b9bee3d91ad8503b0f2314d55d022af27da9e8e" gracePeriod=30
Sep 15 09:41:36.552042 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:36.552006    2578 patch_prober.go:28] interesting pod/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 15 09:41:36.552221 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:36.552064    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd" podUID="4b9aa140-0520-470a-98d1-3c711a74a0b9" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 09:41:37.253244 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:37.253179    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-e76bac/premium-w0-e76bac-kserve-d76cf5596-9x78l" podUID="a747a805-27dc-455a-94bd-bd53ff1700e1" containerName="main" containerID="cri-o://08c26661eaeb350447aa792cf29b196ba06485e19920259bb205afca8677a617" gracePeriod=45
Sep 15 09:41:37.522193 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:37.522170    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e76bac/premium-w0-e76bac-kserve-d76cf5596-9x78l"
Sep 15 09:41:37.544716 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:37.544606    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a747a805-27dc-455a-94bd-bd53ff1700e1-dshm\") pod \"a747a805-27dc-455a-94bd-bd53ff1700e1\" (UID: \"a747a805-27dc-455a-94bd-bd53ff1700e1\") "
Sep 15 09:41:37.544716 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:37.544661    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a747a805-27dc-455a-94bd-bd53ff1700e1-home\") pod \"a747a805-27dc-455a-94bd-bd53ff1700e1\" (UID: \"a747a805-27dc-455a-94bd-bd53ff1700e1\") "
Sep 15 09:41:37.544716 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:37.544708    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-drw4k\" (UniqueName: \"kubernetes.io/projected/a747a805-27dc-455a-94bd-bd53ff1700e1-kube-api-access-drw4k\") pod \"a747a805-27dc-455a-94bd-bd53ff1700e1\" (UID: \"a747a805-27dc-455a-94bd-bd53ff1700e1\") "
Sep 15 09:41:37.545010 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:37.544755    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a747a805-27dc-455a-94bd-bd53ff1700e1-tls-certs\") pod \"a747a805-27dc-455a-94bd-bd53ff1700e1\" (UID: \"a747a805-27dc-455a-94bd-bd53ff1700e1\") "
Sep 15 09:41:37.545010 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:37.544902    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a747a805-27dc-455a-94bd-bd53ff1700e1-model-cache\") pod \"a747a805-27dc-455a-94bd-bd53ff1700e1\" (UID: \"a747a805-27dc-455a-94bd-bd53ff1700e1\") "
Sep 15 09:41:37.546073 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:37.545407    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a747a805-27dc-455a-94bd-bd53ff1700e1-tmp-dir\") pod \"a747a805-27dc-455a-94bd-bd53ff1700e1\" (UID: \"a747a805-27dc-455a-94bd-bd53ff1700e1\") "
Sep 15 09:41:37.546073 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:37.545885    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a747a805-27dc-455a-94bd-bd53ff1700e1-home" (OuterVolumeSpecName: "home") pod "a747a805-27dc-455a-94bd-bd53ff1700e1" (UID: "a747a805-27dc-455a-94bd-bd53ff1700e1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:41:37.546073 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:37.545998    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a747a805-27dc-455a-94bd-bd53ff1700e1-model-cache" (OuterVolumeSpecName: "model-cache") pod "a747a805-27dc-455a-94bd-bd53ff1700e1" (UID: "a747a805-27dc-455a-94bd-bd53ff1700e1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:41:37.546073 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:37.546052    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a747a805-27dc-455a-94bd-bd53ff1700e1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a747a805-27dc-455a-94bd-bd53ff1700e1" (UID: "a747a805-27dc-455a-94bd-bd53ff1700e1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:41:37.547773 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:37.547731    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a747a805-27dc-455a-94bd-bd53ff1700e1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a747a805-27dc-455a-94bd-bd53ff1700e1" (UID: "a747a805-27dc-455a-94bd-bd53ff1700e1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:41:37.548359 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:37.548339    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a747a805-27dc-455a-94bd-bd53ff1700e1-dshm" (OuterVolumeSpecName: "dshm") pod "a747a805-27dc-455a-94bd-bd53ff1700e1" (UID: "a747a805-27dc-455a-94bd-bd53ff1700e1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:41:37.548448 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:37.548379    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a747a805-27dc-455a-94bd-bd53ff1700e1-kube-api-access-drw4k" (OuterVolumeSpecName: "kube-api-access-drw4k") pod "a747a805-27dc-455a-94bd-bd53ff1700e1" (UID: "a747a805-27dc-455a-94bd-bd53ff1700e1"). InnerVolumeSpecName "kube-api-access-drw4k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:41:37.647233 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:37.647193    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a747a805-27dc-455a-94bd-bd53ff1700e1-dshm\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:41:37.647233 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:37.647231    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a747a805-27dc-455a-94bd-bd53ff1700e1-home\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:41:37.647433 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:37.647246    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-drw4k\" (UniqueName: \"kubernetes.io/projected/a747a805-27dc-455a-94bd-bd53ff1700e1-kube-api-access-drw4k\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:41:37.647433 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:37.647258    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a747a805-27dc-455a-94bd-bd53ff1700e1-tls-certs\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:41:37.647433 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:37.647270    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a747a805-27dc-455a-94bd-bd53ff1700e1-model-cache\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:41:37.647433 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:37.647280    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a747a805-27dc-455a-94bd-bd53ff1700e1-tmp-dir\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:41:37.861481 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:37.861395    2578 generic.go:356] "Generic (PLEG): container finished" podID="a747a805-27dc-455a-94bd-bd53ff1700e1" containerID="08c26661eaeb350447aa792cf29b196ba06485e19920259bb205afca8677a617" exitCode=0
Sep 15 09:41:37.861481 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:37.861440    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e76bac/premium-w0-e76bac-kserve-d76cf5596-9x78l"
Sep 15 09:41:37.861661 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:37.861478    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e76bac/premium-w0-e76bac-kserve-d76cf5596-9x78l" event={"ID":"a747a805-27dc-455a-94bd-bd53ff1700e1","Type":"ContainerDied","Data":"08c26661eaeb350447aa792cf29b196ba06485e19920259bb205afca8677a617"}
Sep 15 09:41:37.861661 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:37.861523    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e76bac/premium-w0-e76bac-kserve-d76cf5596-9x78l" event={"ID":"a747a805-27dc-455a-94bd-bd53ff1700e1","Type":"ContainerDied","Data":"b71a9cf28e813eab409c07159e966ae7e3f7f70286579946689fe5b5082ac780"}
Sep 15 09:41:37.861661 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:37.861542    2578 scope.go:117] "RemoveContainer" containerID="08c26661eaeb350447aa792cf29b196ba06485e19920259bb205afca8677a617"
Sep 15 09:41:37.873635 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:37.873621    2578 scope.go:117] "RemoveContainer" containerID="08c26661eaeb350447aa792cf29b196ba06485e19920259bb205afca8677a617"
Sep 15 09:41:37.873913 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:41:37.873894    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08c26661eaeb350447aa792cf29b196ba06485e19920259bb205afca8677a617\": container with ID starting with 08c26661eaeb350447aa792cf29b196ba06485e19920259bb205afca8677a617 not found: ID does not exist" containerID="08c26661eaeb350447aa792cf29b196ba06485e19920259bb205afca8677a617"
Sep 15 09:41:37.873991 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:37.873920    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08c26661eaeb350447aa792cf29b196ba06485e19920259bb205afca8677a617"} err="failed to get container status \"08c26661eaeb350447aa792cf29b196ba06485e19920259bb205afca8677a617\": rpc error: code = NotFound desc = could not find container \"08c26661eaeb350447aa792cf29b196ba06485e19920259bb205afca8677a617\": container with ID starting with 08c26661eaeb350447aa792cf29b196ba06485e19920259bb205afca8677a617 not found: ID does not exist"
Sep 15 09:41:37.883256 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:37.883228    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-e76bac/premium-w0-e76bac-kserve-d76cf5596-9x78l"]
Sep 15 09:41:37.886406 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:37.886382    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-e76bac/premium-w0-e76bac-kserve-d76cf5596-9x78l"]
Sep 15 09:41:38.121540 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:38.121462    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a747a805-27dc-455a-94bd-bd53ff1700e1" path="/var/lib/kubelet/pods/a747a805-27dc-455a-94bd-bd53ff1700e1/volumes"
Sep 15 09:41:40.881467 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:40.881437    2578 generic.go:356] "Generic (PLEG): container finished" podID="4b9aa140-0520-470a-98d1-3c711a74a0b9" containerID="2e77971a720ed3495f0d6ee76b9bee3d91ad8503b0f2314d55d022af27da9e8e" exitCode=0
Sep 15 09:41:40.881894 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:40.881507    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd" event={"ID":"4b9aa140-0520-470a-98d1-3c711a74a0b9","Type":"ContainerDied","Data":"2e77971a720ed3495f0d6ee76b9bee3d91ad8503b0f2314d55d022af27da9e8e"}
Sep 15 09:41:40.881894 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:40.881573    2578 scope.go:117] "RemoveContainer" containerID="06bdc72f51e16701d3c55cc30747085a82f4951d88fc853170819f37416d91ab"
Sep 15 09:41:40.909815 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:40.909759    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd"
Sep 15 09:41:40.979564 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:40.979513    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b9aa140-0520-470a-98d1-3c711a74a0b9-credential-socket\") pod \"4b9aa140-0520-470a-98d1-3c711a74a0b9\" (UID: \"4b9aa140-0520-470a-98d1-3c711a74a0b9\") "
Sep 15 09:41:40.979564 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:40.979561    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b9aa140-0520-470a-98d1-3c711a74a0b9-workload-socket\") pod \"4b9aa140-0520-470a-98d1-3c711a74a0b9\" (UID: \"4b9aa140-0520-470a-98d1-3c711a74a0b9\") "
Sep 15 09:41:40.979564 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:40.979582    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b6kqw\" (UniqueName: \"kubernetes.io/projected/4b9aa140-0520-470a-98d1-3c711a74a0b9-kube-api-access-b6kqw\") pod \"4b9aa140-0520-470a-98d1-3c711a74a0b9\" (UID: \"4b9aa140-0520-470a-98d1-3c711a74a0b9\") "
Sep 15 09:41:40.979848 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:40.979618    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b9aa140-0520-470a-98d1-3c711a74a0b9-istio-envoy\") pod \"4b9aa140-0520-470a-98d1-3c711a74a0b9\" (UID: \"4b9aa140-0520-470a-98d1-3c711a74a0b9\") "
Sep 15 09:41:40.979848 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:40.979681    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b9aa140-0520-470a-98d1-3c711a74a0b9-workload-certs\") pod \"4b9aa140-0520-470a-98d1-3c711a74a0b9\" (UID: \"4b9aa140-0520-470a-98d1-3c711a74a0b9\") "
Sep 15 09:41:40.979848 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:40.979737    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b9aa140-0520-470a-98d1-3c711a74a0b9-istio-podinfo\") pod \"4b9aa140-0520-470a-98d1-3c711a74a0b9\" (UID: \"4b9aa140-0520-470a-98d1-3c711a74a0b9\") "
Sep 15 09:41:40.979848 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:40.979773    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b9aa140-0520-470a-98d1-3c711a74a0b9-istio-token\") pod \"4b9aa140-0520-470a-98d1-3c711a74a0b9\" (UID: \"4b9aa140-0520-470a-98d1-3c711a74a0b9\") "
Sep 15 09:41:40.979848 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:40.979818    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b9aa140-0520-470a-98d1-3c711a74a0b9-istiod-ca-cert\") pod \"4b9aa140-0520-470a-98d1-3c711a74a0b9\" (UID: \"4b9aa140-0520-470a-98d1-3c711a74a0b9\") "
Sep 15 09:41:40.979848 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:40.979815    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b9aa140-0520-470a-98d1-3c711a74a0b9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4b9aa140-0520-470a-98d1-3c711a74a0b9" (UID: "4b9aa140-0520-470a-98d1-3c711a74a0b9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:41:40.980188 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:40.979851    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b9aa140-0520-470a-98d1-3c711a74a0b9-istio-data\") pod \"4b9aa140-0520-470a-98d1-3c711a74a0b9\" (UID: \"4b9aa140-0520-470a-98d1-3c711a74a0b9\") "
Sep 15 09:41:40.980188 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:40.979868    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b9aa140-0520-470a-98d1-3c711a74a0b9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4b9aa140-0520-470a-98d1-3c711a74a0b9" (UID: "4b9aa140-0520-470a-98d1-3c711a74a0b9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:41:40.980188 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:40.980095    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b9aa140-0520-470a-98d1-3c711a74a0b9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4b9aa140-0520-470a-98d1-3c711a74a0b9" (UID: "4b9aa140-0520-470a-98d1-3c711a74a0b9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:41:40.980188 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:40.980110    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b9aa140-0520-470a-98d1-3c711a74a0b9-istio-data" (OuterVolumeSpecName: "istio-data") pod "4b9aa140-0520-470a-98d1-3c711a74a0b9" (UID: "4b9aa140-0520-470a-98d1-3c711a74a0b9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:41:40.980371 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:40.980272    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b9aa140-0520-470a-98d1-3c711a74a0b9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4b9aa140-0520-470a-98d1-3c711a74a0b9" (UID: "4b9aa140-0520-470a-98d1-3c711a74a0b9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:41:40.980371 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:40.980339    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b9aa140-0520-470a-98d1-3c711a74a0b9-credential-socket\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:41:40.980371 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:40.980360    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b9aa140-0520-470a-98d1-3c711a74a0b9-workload-socket\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:41:40.980482 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:40.980376    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b9aa140-0520-470a-98d1-3c711a74a0b9-workload-certs\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:41:40.980482 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:40.980389    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b9aa140-0520-470a-98d1-3c711a74a0b9-istio-data\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:41:40.981974 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:40.981941    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b9aa140-0520-470a-98d1-3c711a74a0b9-istio-token" (OuterVolumeSpecName: "istio-token") pod "4b9aa140-0520-470a-98d1-3c711a74a0b9" (UID: "4b9aa140-0520-470a-98d1-3c711a74a0b9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:41:40.982050 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:40.981989    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b9aa140-0520-470a-98d1-3c711a74a0b9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4b9aa140-0520-470a-98d1-3c711a74a0b9" (UID: "4b9aa140-0520-470a-98d1-3c711a74a0b9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:41:40.982379 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:40.982362    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4b9aa140-0520-470a-98d1-3c711a74a0b9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4b9aa140-0520-470a-98d1-3c711a74a0b9" (UID: "4b9aa140-0520-470a-98d1-3c711a74a0b9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 09:41:40.982426 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:40.982398    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b9aa140-0520-470a-98d1-3c711a74a0b9-kube-api-access-b6kqw" (OuterVolumeSpecName: "kube-api-access-b6kqw") pod "4b9aa140-0520-470a-98d1-3c711a74a0b9" (UID: "4b9aa140-0520-470a-98d1-3c711a74a0b9"). InnerVolumeSpecName "kube-api-access-b6kqw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:41:41.087493 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:41.081584    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b9aa140-0520-470a-98d1-3c711a74a0b9-istiod-ca-cert\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:41:41.087493 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:41.081651    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b6kqw\" (UniqueName: \"kubernetes.io/projected/4b9aa140-0520-470a-98d1-3c711a74a0b9-kube-api-access-b6kqw\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:41:41.087493 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:41.081677    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b9aa140-0520-470a-98d1-3c711a74a0b9-istio-envoy\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:41:41.087493 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:41.081692    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b9aa140-0520-470a-98d1-3c711a74a0b9-istio-podinfo\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:41:41.087493 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:41.081705    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b9aa140-0520-470a-98d1-3c711a74a0b9-istio-token\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:41:41.889123 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:41.889084    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd" event={"ID":"4b9aa140-0520-470a-98d1-3c711a74a0b9","Type":"ContainerDied","Data":"c4dee6a642961c57010bdccc2f373d87791651be1744354b3231fd38a65d6876"}
Sep 15 09:41:41.889123 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:41.889119    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd"
Sep 15 09:41:41.889613 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:41.889153    2578 scope.go:117] "RemoveContainer" containerID="2e77971a720ed3495f0d6ee76b9bee3d91ad8503b0f2314d55d022af27da9e8e"
Sep 15 09:41:41.910781 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:41.910733    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd"]
Sep 15 09:41:41.914774 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:41.914750    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-161187-openshift-default-66fb897cd8-96xqd"]
Sep 15 09:41:42.121928 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:41:42.121893    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b9aa140-0520-470a-98d1-3c711a74a0b9" path="/var/lib/kubelet/pods/4b9aa140-0520-470a-98d1-3c711a74a0b9/volumes"
Sep 15 09:42:16.491511 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:16.491483    2578 scope.go:117] "RemoveContainer" containerID="83c76ccdd4a7614e2c9e3b3ee1702bdd5732bc4c9e08b823c812ecc104ebb254"
Sep 15 09:42:22.930912 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:22.930879    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-c183a5/distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb"]
Sep 15 09:42:37.950830 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:37.950783    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-c183a5/distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb" podUID="71a3e257-17c9-4929-88d5-336d32698d5b" containerName="main" containerID="cri-o://0088fbfd02c3e8a05f976e05e1bf31ffbbf9fef1a863705e27e61793c4267ff2" gracePeriod=45
Sep 15 09:42:38.200299 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:38.200274    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-c183a5/distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb"
Sep 15 09:42:38.220574 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:38.220551    2578 generic.go:356] "Generic (PLEG): container finished" podID="71a3e257-17c9-4929-88d5-336d32698d5b" containerID="0088fbfd02c3e8a05f976e05e1bf31ffbbf9fef1a863705e27e61793c4267ff2" exitCode=0
Sep 15 09:42:38.220723 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:38.220606    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-c183a5/distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb"
Sep 15 09:42:38.220723 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:38.220640    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-c183a5/distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb" event={"ID":"71a3e257-17c9-4929-88d5-336d32698d5b","Type":"ContainerDied","Data":"0088fbfd02c3e8a05f976e05e1bf31ffbbf9fef1a863705e27e61793c4267ff2"}
Sep 15 09:42:38.220723 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:38.220692    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-c183a5/distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb" event={"ID":"71a3e257-17c9-4929-88d5-336d32698d5b","Type":"ContainerDied","Data":"884abbb74dcb5316822d3e36311f46e196ba36ccece9220125d1f2ed803b59c3"}
Sep 15 09:42:38.220723 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:38.220716    2578 scope.go:117] "RemoveContainer" containerID="0088fbfd02c3e8a05f976e05e1bf31ffbbf9fef1a863705e27e61793c4267ff2"
Sep 15 09:42:38.231453 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:38.231434    2578 scope.go:117] "RemoveContainer" containerID="0088fbfd02c3e8a05f976e05e1bf31ffbbf9fef1a863705e27e61793c4267ff2"
Sep 15 09:42:38.231762 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:42:38.231737    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0088fbfd02c3e8a05f976e05e1bf31ffbbf9fef1a863705e27e61793c4267ff2\": container with ID starting with 0088fbfd02c3e8a05f976e05e1bf31ffbbf9fef1a863705e27e61793c4267ff2 not found: ID does not exist" containerID="0088fbfd02c3e8a05f976e05e1bf31ffbbf9fef1a863705e27e61793c4267ff2"
Sep 15 09:42:38.231861 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:38.231774    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0088fbfd02c3e8a05f976e05e1bf31ffbbf9fef1a863705e27e61793c4267ff2"} err="failed to get container status \"0088fbfd02c3e8a05f976e05e1bf31ffbbf9fef1a863705e27e61793c4267ff2\": rpc error: code = NotFound desc = could not find container \"0088fbfd02c3e8a05f976e05e1bf31ffbbf9fef1a863705e27e61793c4267ff2\": container with ID starting with 0088fbfd02c3e8a05f976e05e1bf31ffbbf9fef1a863705e27e61793c4267ff2 not found: ID does not exist"
Sep 15 09:42:38.283859 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:38.283837    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rs9bl\" (UniqueName: \"kubernetes.io/projected/71a3e257-17c9-4929-88d5-336d32698d5b-kube-api-access-rs9bl\") pod \"71a3e257-17c9-4929-88d5-336d32698d5b\" (UID: \"71a3e257-17c9-4929-88d5-336d32698d5b\") "
Sep 15 09:42:38.284001 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:38.283899    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/71a3e257-17c9-4929-88d5-336d32698d5b-home\") pod \"71a3e257-17c9-4929-88d5-336d32698d5b\" (UID: \"71a3e257-17c9-4929-88d5-336d32698d5b\") "
Sep 15 09:42:38.284001 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:38.283987    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/71a3e257-17c9-4929-88d5-336d32698d5b-model-cache\") pod \"71a3e257-17c9-4929-88d5-336d32698d5b\" (UID: \"71a3e257-17c9-4929-88d5-336d32698d5b\") "
Sep 15 09:42:38.284136 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:38.284009    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/71a3e257-17c9-4929-88d5-336d32698d5b-tls-certs\") pod \"71a3e257-17c9-4929-88d5-336d32698d5b\" (UID: \"71a3e257-17c9-4929-88d5-336d32698d5b\") "
Sep 15 09:42:38.284136 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:38.284026    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/71a3e257-17c9-4929-88d5-336d32698d5b-dshm\") pod \"71a3e257-17c9-4929-88d5-336d32698d5b\" (UID: \"71a3e257-17c9-4929-88d5-336d32698d5b\") "
Sep 15 09:42:38.284136 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:38.284055    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71a3e257-17c9-4929-88d5-336d32698d5b-tmp-dir\") pod \"71a3e257-17c9-4929-88d5-336d32698d5b\" (UID: \"71a3e257-17c9-4929-88d5-336d32698d5b\") "
Sep 15 09:42:38.284299 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:38.284182    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71a3e257-17c9-4929-88d5-336d32698d5b-home" (OuterVolumeSpecName: "home") pod "71a3e257-17c9-4929-88d5-336d32698d5b" (UID: "71a3e257-17c9-4929-88d5-336d32698d5b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:42:38.284299 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:38.284263    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71a3e257-17c9-4929-88d5-336d32698d5b-model-cache" (OuterVolumeSpecName: "model-cache") pod "71a3e257-17c9-4929-88d5-336d32698d5b" (UID: "71a3e257-17c9-4929-88d5-336d32698d5b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:42:38.284404 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:38.284379    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/71a3e257-17c9-4929-88d5-336d32698d5b-home\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:42:38.284404 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:38.284395    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/71a3e257-17c9-4929-88d5-336d32698d5b-model-cache\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:42:38.284404 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:38.284377    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71a3e257-17c9-4929-88d5-336d32698d5b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "71a3e257-17c9-4929-88d5-336d32698d5b" (UID: "71a3e257-17c9-4929-88d5-336d32698d5b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:42:38.286222 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:38.286175    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71a3e257-17c9-4929-88d5-336d32698d5b-dshm" (OuterVolumeSpecName: "dshm") pod "71a3e257-17c9-4929-88d5-336d32698d5b" (UID: "71a3e257-17c9-4929-88d5-336d32698d5b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:42:38.286222 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:38.286215    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71a3e257-17c9-4929-88d5-336d32698d5b-kube-api-access-rs9bl" (OuterVolumeSpecName: "kube-api-access-rs9bl") pod "71a3e257-17c9-4929-88d5-336d32698d5b" (UID: "71a3e257-17c9-4929-88d5-336d32698d5b"). InnerVolumeSpecName "kube-api-access-rs9bl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:42:38.286373 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:38.286264    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71a3e257-17c9-4929-88d5-336d32698d5b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "71a3e257-17c9-4929-88d5-336d32698d5b" (UID: "71a3e257-17c9-4929-88d5-336d32698d5b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:42:38.385005 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:38.384981    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/71a3e257-17c9-4929-88d5-336d32698d5b-tls-certs\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:42:38.385005 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:38.385002    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/71a3e257-17c9-4929-88d5-336d32698d5b-dshm\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:42:38.385005 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:38.385010    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71a3e257-17c9-4929-88d5-336d32698d5b-tmp-dir\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:42:38.385192 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:38.385019    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rs9bl\" (UniqueName: \"kubernetes.io/projected/71a3e257-17c9-4929-88d5-336d32698d5b-kube-api-access-rs9bl\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:42:38.542838 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:38.542808    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-c183a5/distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb"]
Sep 15 09:42:38.551454 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:38.551425    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-c183a5/distinct-2-w4-c183a5-kserve-574c6645c9-dmfnb"]
Sep 15 09:42:39.994940 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:39.994902    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd"]
Sep 15 09:42:39.995782 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:39.995722    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd" podUID="4660a7ba-4f49-4385-bb4e-e62f977d5aca" containerName="istio-proxy" containerID="cri-o://ca8f0765d7496262aa965e1f875c446722af42807ac96afa1455a05714ead1da" gracePeriod=30
Sep 15 09:42:40.124611 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:40.124578    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71a3e257-17c9-4929-88d5-336d32698d5b" path="/var/lib/kubelet/pods/71a3e257-17c9-4929-88d5-336d32698d5b/volumes"
Sep 15 09:42:45.252645 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:45.252620    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd"
Sep 15 09:42:45.262864 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:45.262842    2578 generic.go:356] "Generic (PLEG): container finished" podID="4660a7ba-4f49-4385-bb4e-e62f977d5aca" containerID="ca8f0765d7496262aa965e1f875c446722af42807ac96afa1455a05714ead1da" exitCode=0
Sep 15 09:42:45.263007 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:45.262882    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd"
Sep 15 09:42:45.263007 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:45.262925    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd" event={"ID":"4660a7ba-4f49-4385-bb4e-e62f977d5aca","Type":"ContainerDied","Data":"ca8f0765d7496262aa965e1f875c446722af42807ac96afa1455a05714ead1da"}
Sep 15 09:42:45.263007 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:45.262999    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd" event={"ID":"4660a7ba-4f49-4385-bb4e-e62f977d5aca","Type":"ContainerDied","Data":"91c12b3e0e96e94479c1e2699e1199eb1fae4817674ad35aa810cf1d971ead02"}
Sep 15 09:42:45.263187 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:45.263030    2578 scope.go:117] "RemoveContainer" containerID="ca8f0765d7496262aa965e1f875c446722af42807ac96afa1455a05714ead1da"
Sep 15 09:42:45.271552 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:45.271538    2578 scope.go:117] "RemoveContainer" containerID="70fc3a8d8557d7ca827499a4ed63fd31d56928c7608a9386aabaf52e7d4c7941"
Sep 15 09:42:45.280920 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:45.280905    2578 scope.go:117] "RemoveContainer" containerID="ca8f0765d7496262aa965e1f875c446722af42807ac96afa1455a05714ead1da"
Sep 15 09:42:45.281216 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:42:45.281197    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca8f0765d7496262aa965e1f875c446722af42807ac96afa1455a05714ead1da\": container with ID starting with ca8f0765d7496262aa965e1f875c446722af42807ac96afa1455a05714ead1da not found: ID does not exist" containerID="ca8f0765d7496262aa965e1f875c446722af42807ac96afa1455a05714ead1da"
Sep 15 09:42:45.281292 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:45.281224    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca8f0765d7496262aa965e1f875c446722af42807ac96afa1455a05714ead1da"} err="failed to get container status \"ca8f0765d7496262aa965e1f875c446722af42807ac96afa1455a05714ead1da\": rpc error: code = NotFound desc = could not find container \"ca8f0765d7496262aa965e1f875c446722af42807ac96afa1455a05714ead1da\": container with ID starting with ca8f0765d7496262aa965e1f875c446722af42807ac96afa1455a05714ead1da not found: ID does not exist"
Sep 15 09:42:45.281292 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:45.281241    2578 scope.go:117] "RemoveContainer" containerID="70fc3a8d8557d7ca827499a4ed63fd31d56928c7608a9386aabaf52e7d4c7941"
Sep 15 09:42:45.281526 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:42:45.281507    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70fc3a8d8557d7ca827499a4ed63fd31d56928c7608a9386aabaf52e7d4c7941\": container with ID starting with 70fc3a8d8557d7ca827499a4ed63fd31d56928c7608a9386aabaf52e7d4c7941 not found: ID does not exist" containerID="70fc3a8d8557d7ca827499a4ed63fd31d56928c7608a9386aabaf52e7d4c7941"
Sep 15 09:42:45.281578 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:45.281532    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70fc3a8d8557d7ca827499a4ed63fd31d56928c7608a9386aabaf52e7d4c7941"} err="failed to get container status \"70fc3a8d8557d7ca827499a4ed63fd31d56928c7608a9386aabaf52e7d4c7941\": rpc error: code = NotFound desc = could not find container \"70fc3a8d8557d7ca827499a4ed63fd31d56928c7608a9386aabaf52e7d4c7941\": container with ID starting with 70fc3a8d8557d7ca827499a4ed63fd31d56928c7608a9386aabaf52e7d4c7941 not found: ID does not exist"
Sep 15 09:42:45.346886 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:45.346865    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4660a7ba-4f49-4385-bb4e-e62f977d5aca-workload-socket\") pod \"4660a7ba-4f49-4385-bb4e-e62f977d5aca\" (UID: \"4660a7ba-4f49-4385-bb4e-e62f977d5aca\") "
Sep 15 09:42:45.346992 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:45.346893    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-phhls\" (UniqueName: \"kubernetes.io/projected/4660a7ba-4f49-4385-bb4e-e62f977d5aca-kube-api-access-phhls\") pod \"4660a7ba-4f49-4385-bb4e-e62f977d5aca\" (UID: \"4660a7ba-4f49-4385-bb4e-e62f977d5aca\") "
Sep 15 09:42:45.346992 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:45.346910    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4660a7ba-4f49-4385-bb4e-e62f977d5aca-istio-podinfo\") pod \"4660a7ba-4f49-4385-bb4e-e62f977d5aca\" (UID: \"4660a7ba-4f49-4385-bb4e-e62f977d5aca\") "
Sep 15 09:42:45.346992 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:45.346978    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4660a7ba-4f49-4385-bb4e-e62f977d5aca-istio-data\") pod \"4660a7ba-4f49-4385-bb4e-e62f977d5aca\" (UID: \"4660a7ba-4f49-4385-bb4e-e62f977d5aca\") "
Sep 15 09:42:45.347160 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:45.346998    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4660a7ba-4f49-4385-bb4e-e62f977d5aca-istio-envoy\") pod \"4660a7ba-4f49-4385-bb4e-e62f977d5aca\" (UID: \"4660a7ba-4f49-4385-bb4e-e62f977d5aca\") "
Sep 15 09:42:45.347160 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:45.347013    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4660a7ba-4f49-4385-bb4e-e62f977d5aca-istiod-ca-cert\") pod \"4660a7ba-4f49-4385-bb4e-e62f977d5aca\" (UID: \"4660a7ba-4f49-4385-bb4e-e62f977d5aca\") "
Sep 15 09:42:45.347160 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:45.347027    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4660a7ba-4f49-4385-bb4e-e62f977d5aca-credential-socket\") pod \"4660a7ba-4f49-4385-bb4e-e62f977d5aca\" (UID: \"4660a7ba-4f49-4385-bb4e-e62f977d5aca\") "
Sep 15 09:42:45.347160 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:45.347064    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4660a7ba-4f49-4385-bb4e-e62f977d5aca-workload-certs\") pod \"4660a7ba-4f49-4385-bb4e-e62f977d5aca\" (UID: \"4660a7ba-4f49-4385-bb4e-e62f977d5aca\") "
Sep 15 09:42:45.347160 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:45.347125    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4660a7ba-4f49-4385-bb4e-e62f977d5aca-istio-token\") pod \"4660a7ba-4f49-4385-bb4e-e62f977d5aca\" (UID: \"4660a7ba-4f49-4385-bb4e-e62f977d5aca\") "
Sep 15 09:42:45.347160 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:45.347140    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4660a7ba-4f49-4385-bb4e-e62f977d5aca-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4660a7ba-4f49-4385-bb4e-e62f977d5aca" (UID: "4660a7ba-4f49-4385-bb4e-e62f977d5aca"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:42:45.347438 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:45.347254    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4660a7ba-4f49-4385-bb4e-e62f977d5aca-istio-data" (OuterVolumeSpecName: "istio-data") pod "4660a7ba-4f49-4385-bb4e-e62f977d5aca" (UID: "4660a7ba-4f49-4385-bb4e-e62f977d5aca"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:42:45.347438 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:45.347370    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4660a7ba-4f49-4385-bb4e-e62f977d5aca-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4660a7ba-4f49-4385-bb4e-e62f977d5aca" (UID: "4660a7ba-4f49-4385-bb4e-e62f977d5aca"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:42:45.347532 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:45.347497    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4660a7ba-4f49-4385-bb4e-e62f977d5aca-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4660a7ba-4f49-4385-bb4e-e62f977d5aca" (UID: "4660a7ba-4f49-4385-bb4e-e62f977d5aca"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:42:45.347532 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:45.347514    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4660a7ba-4f49-4385-bb4e-e62f977d5aca-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4660a7ba-4f49-4385-bb4e-e62f977d5aca" (UID: "4660a7ba-4f49-4385-bb4e-e62f977d5aca"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:42:45.347609 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:45.347534    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4660a7ba-4f49-4385-bb4e-e62f977d5aca-workload-socket\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:42:45.347609 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:45.347554    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4660a7ba-4f49-4385-bb4e-e62f977d5aca-istio-data\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:42:45.347609 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:45.347568    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4660a7ba-4f49-4385-bb4e-e62f977d5aca-credential-socket\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:42:45.349101 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:45.349081    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4660a7ba-4f49-4385-bb4e-e62f977d5aca-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4660a7ba-4f49-4385-bb4e-e62f977d5aca" (UID: "4660a7ba-4f49-4385-bb4e-e62f977d5aca"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:42:45.349298 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:45.349283    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4660a7ba-4f49-4385-bb4e-e62f977d5aca-istio-token" (OuterVolumeSpecName: "istio-token") pod "4660a7ba-4f49-4385-bb4e-e62f977d5aca" (UID: "4660a7ba-4f49-4385-bb4e-e62f977d5aca"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:42:45.349466 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:45.349449    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4660a7ba-4f49-4385-bb4e-e62f977d5aca-kube-api-access-phhls" (OuterVolumeSpecName: "kube-api-access-phhls") pod "4660a7ba-4f49-4385-bb4e-e62f977d5aca" (UID: "4660a7ba-4f49-4385-bb4e-e62f977d5aca"). InnerVolumeSpecName "kube-api-access-phhls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:42:45.349564 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:45.349468    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4660a7ba-4f49-4385-bb4e-e62f977d5aca-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4660a7ba-4f49-4385-bb4e-e62f977d5aca" (UID: "4660a7ba-4f49-4385-bb4e-e62f977d5aca"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 09:42:45.448821 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:45.448793    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-phhls\" (UniqueName: \"kubernetes.io/projected/4660a7ba-4f49-4385-bb4e-e62f977d5aca-kube-api-access-phhls\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:42:45.448821 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:45.448815    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4660a7ba-4f49-4385-bb4e-e62f977d5aca-istio-podinfo\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:42:45.448998 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:45.448828    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4660a7ba-4f49-4385-bb4e-e62f977d5aca-istio-envoy\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:42:45.448998 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:45.448840    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4660a7ba-4f49-4385-bb4e-e62f977d5aca-istiod-ca-cert\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:42:45.448998 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:45.448854    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4660a7ba-4f49-4385-bb4e-e62f977d5aca-workload-certs\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:42:45.448998 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:45.448865    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4660a7ba-4f49-4385-bb4e-e62f977d5aca-istio-token\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:42:45.585027 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:45.585003    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd"]
Sep 15 09:42:45.589580 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:45.589558    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-c183a5-openshift-default-8fc968fd6-x9nsd"]
Sep 15 09:42:46.122558 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:42:46.122525    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4660a7ba-4f49-4385-bb4e-e62f977d5aca" path="/var/lib/kubelet/pods/4660a7ba-4f49-4385-bb4e-e62f977d5aca/volumes"
Sep 15 09:43:16.527595 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:43:16.527567    2578 scope.go:117] "RemoveContainer" containerID="c070d2758a48ae26be3ff18649732cba4ee3b2c70366a72929df22f96f0fa9b9"
Sep 15 09:43:16.535708 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:43:16.535684    2578 scope.go:117] "RemoveContainer" containerID="8ca2087a4b0ef67e0e59a550a8b83b7a5ee30fbc1140a5308c2d24f3fea5eb2c"
Sep 15 09:45:00.138266 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:00.138238    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29824425-b8dvc"]
Sep 15 09:45:00.138694 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:00.138589    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e14f7d4a-07d1-469b-833d-08659608ff1e" containerName="payload-pre-processing"
Sep 15 09:45:00.138694 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:00.138600    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e14f7d4a-07d1-469b-833d-08659608ff1e" containerName="payload-pre-processing"
Sep 15 09:45:00.138694 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:00.138612    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4660a7ba-4f49-4385-bb4e-e62f977d5aca" containerName="istio-proxy"
Sep 15 09:45:00.138694 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:00.138617    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4660a7ba-4f49-4385-bb4e-e62f977d5aca" containerName="istio-proxy"
Sep 15 09:45:00.138694 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:00.138622    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b9aa140-0520-470a-98d1-3c711a74a0b9" containerName="istio-proxy"
Sep 15 09:45:00.138694 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:00.138627    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b9aa140-0520-470a-98d1-3c711a74a0b9" containerName="istio-proxy"
Sep 15 09:45:00.138694 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:00.138634    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a49e99f-a9f6-4323-a753-e44f5e4b2064" containerName="payload-processing"
Sep 15 09:45:00.138694 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:00.138639    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a49e99f-a9f6-4323-a753-e44f5e4b2064" containerName="payload-processing"
Sep 15 09:45:00.138694 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:00.138645    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b9aa140-0520-470a-98d1-3c711a74a0b9" containerName="istio-proxy"
Sep 15 09:45:00.138694 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:00.138651    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b9aa140-0520-470a-98d1-3c711a74a0b9" containerName="istio-proxy"
Sep 15 09:45:00.138694 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:00.138660    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a747a805-27dc-455a-94bd-bd53ff1700e1" containerName="main"
Sep 15 09:45:00.138694 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:00.138665    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a747a805-27dc-455a-94bd-bd53ff1700e1" containerName="main"
Sep 15 09:45:00.138694 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:00.138672    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4660a7ba-4f49-4385-bb4e-e62f977d5aca" containerName="istio-proxy"
Sep 15 09:45:00.138694 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:00.138676    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4660a7ba-4f49-4385-bb4e-e62f977d5aca" containerName="istio-proxy"
Sep 15 09:45:00.138694 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:00.138683    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a62ca0b8-51c5-48af-94a3-62e52af6da4b" containerName="revoke-keys"
Sep 15 09:45:00.138694 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:00.138687    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a62ca0b8-51c5-48af-94a3-62e52af6da4b" containerName="revoke-keys"
Sep 15 09:45:00.138694 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:00.138695    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71a3e257-17c9-4929-88d5-336d32698d5b" containerName="main"
Sep 15 09:45:00.138694 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:00.138700    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="71a3e257-17c9-4929-88d5-336d32698d5b" containerName="main"
Sep 15 09:45:00.139245 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:00.138748    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a747a805-27dc-455a-94bd-bd53ff1700e1" containerName="main"
Sep 15 09:45:00.139245 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:00.138754    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a49e99f-a9f6-4323-a753-e44f5e4b2064" containerName="payload-processing"
Sep 15 09:45:00.139245 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:00.138760    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b9aa140-0520-470a-98d1-3c711a74a0b9" containerName="istio-proxy"
Sep 15 09:45:00.139245 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:00.138765    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2fc38fe-a89f-4ed2-9991-f288e6ddd035" containerName="istio-proxy"
Sep 15 09:45:00.139245 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:00.138770    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a62ca0b8-51c5-48af-94a3-62e52af6da4b" containerName="revoke-keys"
Sep 15 09:45:00.139245 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:00.138775    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4660a7ba-4f49-4385-bb4e-e62f977d5aca" containerName="istio-proxy"
Sep 15 09:45:00.139245 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:00.138780    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e14f7d4a-07d1-469b-833d-08659608ff1e" containerName="payload-pre-processing"
Sep 15 09:45:00.139245 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:00.138785    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="71a3e257-17c9-4929-88d5-336d32698d5b" containerName="main"
Sep 15 09:45:00.141701 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:00.141686    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824425-b8dvc"
Sep 15 09:45:00.143762 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:00.143737    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cbqnn\""
Sep 15 09:45:00.149449 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:00.148968    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29824425-b8dvc"]
Sep 15 09:45:00.153015 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:00.152997    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824425-b8dvc"
Sep 15 09:45:00.423116 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:00.423086    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29824425-b8dvc"]
Sep 15 09:45:00.424657 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:45:00.424632    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod707de139_aac2_494d_b72d_f7b4192a4308.slice/crio-3c7a4c09a0b1dd1987bed43f671aae70d56150620c52269049cdca042c8d4640 WatchSource:0}: Error finding container 3c7a4c09a0b1dd1987bed43f671aae70d56150620c52269049cdca042c8d4640: Status 404 returned error can't find the container with id 3c7a4c09a0b1dd1987bed43f671aae70d56150620c52269049cdca042c8d4640
Sep 15 09:45:01.013807 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:01.013779    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824425-b8dvc" event={"ID":"707de139-aac2-494d-b72d-f7b4192a4308","Type":"ContainerStarted","Data":"e7175dbc09814fe3aac914ff59116972ab3d1f77eae47a85d7d24c930274d209"}
Sep 15 09:45:01.014040 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:01.013840    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824425-b8dvc" event={"ID":"707de139-aac2-494d-b72d-f7b4192a4308","Type":"ContainerStarted","Data":"3c7a4c09a0b1dd1987bed43f671aae70d56150620c52269049cdca042c8d4640"}
Sep 15 09:45:01.027391 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:01.027349    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824425-b8dvc" podStartSLOduration=1.02733073 podStartE2EDuration="1.02733073s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:45:01.02653782 +0000 UTC m=+1845.364983105" watchObservedRunningTime="2026-09-15 09:45:01.02733073 +0000 UTC m=+1845.365776006"
Sep 15 09:45:02.020776 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:02.020751    2578 generic.go:356] "Generic (PLEG): container finished" podID="707de139-aac2-494d-b72d-f7b4192a4308" containerID="e7175dbc09814fe3aac914ff59116972ab3d1f77eae47a85d7d24c930274d209" exitCode=0
Sep 15 09:45:02.021132 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:02.020838    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824425-b8dvc" event={"ID":"707de139-aac2-494d-b72d-f7b4192a4308","Type":"ContainerDied","Data":"e7175dbc09814fe3aac914ff59116972ab3d1f77eae47a85d7d24c930274d209"}
Sep 15 09:45:03.150017 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:03.149986    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824425-b8dvc"
Sep 15 09:45:04.034652 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:04.034626    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824425-b8dvc"
Sep 15 09:45:04.034803 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:04.034630    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824425-b8dvc" event={"ID":"707de139-aac2-494d-b72d-f7b4192a4308","Type":"ContainerDied","Data":"3c7a4c09a0b1dd1987bed43f671aae70d56150620c52269049cdca042c8d4640"}
Sep 15 09:45:04.034803 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:04.034771    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3c7a4c09a0b1dd1987bed43f671aae70d56150620c52269049cdca042c8d4640"
Sep 15 09:45:23.535260 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:23.535226    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn"]
Sep 15 09:45:23.535764 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:23.535746    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="707de139-aac2-494d-b72d-f7b4192a4308" containerName="cleanup"
Sep 15 09:45:23.535845 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:23.535767    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="707de139-aac2-494d-b72d-f7b4192a4308" containerName="cleanup"
Sep 15 09:45:23.535902 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:23.535859    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4660a7ba-4f49-4385-bb4e-e62f977d5aca" containerName="istio-proxy"
Sep 15 09:45:23.535902 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:23.535880    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="707de139-aac2-494d-b72d-f7b4192a4308" containerName="cleanup"
Sep 15 09:45:23.535902 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:23.535889    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b9aa140-0520-470a-98d1-3c711a74a0b9" containerName="istio-proxy"
Sep 15 09:45:23.539245 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:23.539222    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn"
Sep 15 09:45:23.542709 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:23.542687    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-6593fe-openshift-default-dockercfg-n8hh8\""
Sep 15 09:45:23.554899 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:23.554866    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn"]
Sep 15 09:45:23.614336 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:23.614294    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e77a5d7e-8896-42bd-ada3-ec2532f7717a-credential-socket\") pod \"e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn\" (UID: \"e77a5d7e-8896-42bd-ada3-ec2532f7717a\") " pod="openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn"
Sep 15 09:45:23.614336 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:23.614323    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e77a5d7e-8896-42bd-ada3-ec2532f7717a-workload-certs\") pod \"e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn\" (UID: \"e77a5d7e-8896-42bd-ada3-ec2532f7717a\") " pod="openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn"
Sep 15 09:45:23.614488 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:23.614346    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e77a5d7e-8896-42bd-ada3-ec2532f7717a-istiod-ca-cert\") pod \"e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn\" (UID: \"e77a5d7e-8896-42bd-ada3-ec2532f7717a\") " pod="openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn"
Sep 15 09:45:23.614488 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:23.614409    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e77a5d7e-8896-42bd-ada3-ec2532f7717a-istio-data\") pod \"e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn\" (UID: \"e77a5d7e-8896-42bd-ada3-ec2532f7717a\") " pod="openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn"
Sep 15 09:45:23.614488 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:23.614451    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e77a5d7e-8896-42bd-ada3-ec2532f7717a-istio-podinfo\") pod \"e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn\" (UID: \"e77a5d7e-8896-42bd-ada3-ec2532f7717a\") " pod="openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn"
Sep 15 09:45:23.614488 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:23.614481    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e77a5d7e-8896-42bd-ada3-ec2532f7717a-workload-socket\") pod \"e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn\" (UID: \"e77a5d7e-8896-42bd-ada3-ec2532f7717a\") " pod="openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn"
Sep 15 09:45:23.614651 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:23.614552    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e77a5d7e-8896-42bd-ada3-ec2532f7717a-istio-token\") pod \"e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn\" (UID: \"e77a5d7e-8896-42bd-ada3-ec2532f7717a\") " pod="openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn"
Sep 15 09:45:23.614651 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:23.614572    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e77a5d7e-8896-42bd-ada3-ec2532f7717a-istio-envoy\") pod \"e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn\" (UID: \"e77a5d7e-8896-42bd-ada3-ec2532f7717a\") " pod="openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn"
Sep 15 09:45:23.614651 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:23.614605    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qr56\" (UniqueName: \"kubernetes.io/projected/e77a5d7e-8896-42bd-ada3-ec2532f7717a-kube-api-access-8qr56\") pod \"e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn\" (UID: \"e77a5d7e-8896-42bd-ada3-ec2532f7717a\") " pod="openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn"
Sep 15 09:45:23.715141 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:23.715105    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e77a5d7e-8896-42bd-ada3-ec2532f7717a-workload-socket\") pod \"e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn\" (UID: \"e77a5d7e-8896-42bd-ada3-ec2532f7717a\") " pod="openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn"
Sep 15 09:45:23.715306 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:23.715158    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e77a5d7e-8896-42bd-ada3-ec2532f7717a-istio-token\") pod \"e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn\" (UID: \"e77a5d7e-8896-42bd-ada3-ec2532f7717a\") " pod="openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn"
Sep 15 09:45:23.715306 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:23.715174    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e77a5d7e-8896-42bd-ada3-ec2532f7717a-istio-envoy\") pod \"e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn\" (UID: \"e77a5d7e-8896-42bd-ada3-ec2532f7717a\") " pod="openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn"
Sep 15 09:45:23.715306 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:23.715204    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qr56\" (UniqueName: \"kubernetes.io/projected/e77a5d7e-8896-42bd-ada3-ec2532f7717a-kube-api-access-8qr56\") pod \"e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn\" (UID: \"e77a5d7e-8896-42bd-ada3-ec2532f7717a\") " pod="openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn"
Sep 15 09:45:23.715306 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:23.715229    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e77a5d7e-8896-42bd-ada3-ec2532f7717a-credential-socket\") pod \"e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn\" (UID: \"e77a5d7e-8896-42bd-ada3-ec2532f7717a\") " pod="openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn"
Sep 15 09:45:23.715306 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:23.715251    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e77a5d7e-8896-42bd-ada3-ec2532f7717a-workload-certs\") pod \"e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn\" (UID: \"e77a5d7e-8896-42bd-ada3-ec2532f7717a\") " pod="openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn"
Sep 15 09:45:23.715306 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:23.715292    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e77a5d7e-8896-42bd-ada3-ec2532f7717a-istiod-ca-cert\") pod \"e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn\" (UID: \"e77a5d7e-8896-42bd-ada3-ec2532f7717a\") " pod="openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn"
Sep 15 09:45:23.715614 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:23.715332    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e77a5d7e-8896-42bd-ada3-ec2532f7717a-istio-data\") pod \"e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn\" (UID: \"e77a5d7e-8896-42bd-ada3-ec2532f7717a\") " pod="openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn"
Sep 15 09:45:23.715614 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:23.715361    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e77a5d7e-8896-42bd-ada3-ec2532f7717a-istio-podinfo\") pod \"e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn\" (UID: \"e77a5d7e-8896-42bd-ada3-ec2532f7717a\") " pod="openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn"
Sep 15 09:45:23.715722 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:23.715613    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e77a5d7e-8896-42bd-ada3-ec2532f7717a-workload-socket\") pod \"e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn\" (UID: \"e77a5d7e-8896-42bd-ada3-ec2532f7717a\") " pod="openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn"
Sep 15 09:45:23.715722 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:23.715704    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e77a5d7e-8896-42bd-ada3-ec2532f7717a-credential-socket\") pod \"e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn\" (UID: \"e77a5d7e-8896-42bd-ada3-ec2532f7717a\") " pod="openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn"
Sep 15 09:45:23.715829 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:23.715787    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e77a5d7e-8896-42bd-ada3-ec2532f7717a-workload-certs\") pod \"e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn\" (UID: \"e77a5d7e-8896-42bd-ada3-ec2532f7717a\") " pod="openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn"
Sep 15 09:45:23.715886 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:23.715876    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e77a5d7e-8896-42bd-ada3-ec2532f7717a-istio-data\") pod \"e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn\" (UID: \"e77a5d7e-8896-42bd-ada3-ec2532f7717a\") " pod="openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn"
Sep 15 09:45:23.716146 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:23.716105    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e77a5d7e-8896-42bd-ada3-ec2532f7717a-istiod-ca-cert\") pod \"e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn\" (UID: \"e77a5d7e-8896-42bd-ada3-ec2532f7717a\") " pod="openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn"
Sep 15 09:45:23.717517 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:23.717489    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e77a5d7e-8896-42bd-ada3-ec2532f7717a-istio-envoy\") pod \"e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn\" (UID: \"e77a5d7e-8896-42bd-ada3-ec2532f7717a\") " pod="openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn"
Sep 15 09:45:23.717806 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:23.717791    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e77a5d7e-8896-42bd-ada3-ec2532f7717a-istio-podinfo\") pod \"e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn\" (UID: \"e77a5d7e-8896-42bd-ada3-ec2532f7717a\") " pod="openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn"
Sep 15 09:45:23.722241 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:23.722221    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e77a5d7e-8896-42bd-ada3-ec2532f7717a-istio-token\") pod \"e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn\" (UID: \"e77a5d7e-8896-42bd-ada3-ec2532f7717a\") " pod="openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn"
Sep 15 09:45:23.722393 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:23.722375    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qr56\" (UniqueName: \"kubernetes.io/projected/e77a5d7e-8896-42bd-ada3-ec2532f7717a-kube-api-access-8qr56\") pod \"e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn\" (UID: \"e77a5d7e-8896-42bd-ada3-ec2532f7717a\") " pod="openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn"
Sep 15 09:45:23.850239 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:23.850174    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn"
Sep 15 09:45:24.122702 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:24.122678    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn"]
Sep 15 09:45:24.122814 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:45:24.122697    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode77a5d7e_8896_42bd_ada3_ec2532f7717a.slice/crio-6b6ae262f301731fa45ff394da3642608f75f092d644dc5f127771e9f8966491 WatchSource:0}: Error finding container 6b6ae262f301731fa45ff394da3642608f75f092d644dc5f127771e9f8966491: Status 404 returned error can't find the container with id 6b6ae262f301731fa45ff394da3642608f75f092d644dc5f127771e9f8966491
Sep 15 09:45:24.125089 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:24.125055    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:45:24.125191 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:24.125120    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:45:24.125191 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:24.125150    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:45:24.139000 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:24.138980    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn" event={"ID":"e77a5d7e-8896-42bd-ada3-ec2532f7717a","Type":"ContainerStarted","Data":"6b6ae262f301731fa45ff394da3642608f75f092d644dc5f127771e9f8966491"}
Sep 15 09:45:25.145603 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:25.145571    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn" event={"ID":"e77a5d7e-8896-42bd-ada3-ec2532f7717a","Type":"ContainerStarted","Data":"75a5113575a815cc2d884fa66e99dd263470e050d078eec808cf0630174d7247"}
Sep 15 09:45:25.165539 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:25.165497    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn" podStartSLOduration=2.16548317 podStartE2EDuration="2.16548317s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:45:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:45:25.163336027 +0000 UTC m=+1869.501781307" watchObservedRunningTime="2026-09-15 09:45:25.16548317 +0000 UTC m=+1869.503928443"
Sep 15 09:45:25.850853 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:25.850824    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn"
Sep 15 09:45:25.855264 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:25.855243    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn"
Sep 15 09:45:26.150546 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:26.150491    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn"
Sep 15 09:45:26.151166 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:26.151150    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn"
Sep 15 09:45:42.192078 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:42.192046    2578 patch_prober.go:28] interesting pod/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.99:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 15 09:45:42.192498 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:42.192114    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn" podUID="e77a5d7e-8896-42bd-ada3-ec2532f7717a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.99:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 15 09:45:44.252958 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:44.252922    2578 generic.go:356] "Generic (PLEG): container finished" podID="e77a5d7e-8896-42bd-ada3-ec2532f7717a" containerID="75a5113575a815cc2d884fa66e99dd263470e050d078eec808cf0630174d7247" exitCode=0
Sep 15 09:45:44.253414 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:44.252998    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn" event={"ID":"e77a5d7e-8896-42bd-ada3-ec2532f7717a","Type":"ContainerDied","Data":"75a5113575a815cc2d884fa66e99dd263470e050d078eec808cf0630174d7247"}
Sep 15 09:45:44.253480 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:44.253438    2578 scope.go:117] "RemoveContainer" containerID="75a5113575a815cc2d884fa66e99dd263470e050d078eec808cf0630174d7247"
Sep 15 09:45:44.254412 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:44.254385    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:45:44.254500 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:44.254452    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:45:44.254500 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:44.254493    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 15 09:45:45.260198 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:45.260165    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn" event={"ID":"e77a5d7e-8896-42bd-ada3-ec2532f7717a","Type":"ContainerStarted","Data":"a25f151292c6edd615d8f89b3a558c46bf261444826779547465385f7cab9574"}
Sep 15 09:45:45.851020 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:45.850986    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn"
Sep 15 09:45:45.851191 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:45.851110    2578 patch_prober.go:28] interesting pod/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.99:15021/healthz/ready\": dial tcp 10.134.0.99:15021: connect: connection refused" start-of-body=
Sep 15 09:45:45.851191 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:45.851151    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn" podUID="e77a5d7e-8896-42bd-ada3-ec2532f7717a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.99:15021/healthz/ready\": dial tcp 10.134.0.99:15021: connect: connection refused"
Sep 15 09:45:46.850795 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:46.850760    2578 patch_prober.go:28] interesting pod/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.99:15021/healthz/ready\": dial tcp 10.134.0.99:15021: connect: connection refused" start-of-body=
Sep 15 09:45:46.851258 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:46.850814    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn" podUID="e77a5d7e-8896-42bd-ada3-ec2532f7717a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.99:15021/healthz/ready\": dial tcp 10.134.0.99:15021: connect: connection refused"
Sep 15 09:45:47.851263 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:47.851229    2578 patch_prober.go:28] interesting pod/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.99:15021/healthz/ready\": dial tcp 10.134.0.99:15021: connect: connection refused" start-of-body=
Sep 15 09:45:47.851635 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:47.851279    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn" podUID="e77a5d7e-8896-42bd-ada3-ec2532f7717a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.99:15021/healthz/ready\": dial tcp 10.134.0.99:15021: connect: connection refused"
Sep 15 09:45:48.851447 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:48.851412    2578 patch_prober.go:28] interesting pod/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.99:15021/healthz/ready\": dial tcp 10.134.0.99:15021: connect: connection refused" start-of-body=
Sep 15 09:45:48.851814 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:48.851459    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn" podUID="e77a5d7e-8896-42bd-ada3-ec2532f7717a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.99:15021/healthz/ready\": dial tcp 10.134.0.99:15021: connect: connection refused"
Sep 15 09:45:49.851248 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:49.851210    2578 patch_prober.go:28] interesting pod/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.99:15021/healthz/ready\": dial tcp 10.134.0.99:15021: connect: connection refused" start-of-body=
Sep 15 09:45:49.851429 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:49.851276    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn" podUID="e77a5d7e-8896-42bd-ada3-ec2532f7717a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.99:15021/healthz/ready\": dial tcp 10.134.0.99:15021: connect: connection refused"
Sep 15 09:45:50.854696 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:50.854659    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn"
Sep 15 09:45:50.855165 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:50.854918    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn"
Sep 15 09:45:50.855627 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:50.855612    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn"
Sep 15 09:45:59.286647 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:59.286612    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-527142-548bf89b5d-xhf6b"]
Sep 15 09:45:59.289230 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:59.289212    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-527142-548bf89b5d-xhf6b"
Sep 15 09:45:59.291525 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:59.291502    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-527142\""
Sep 15 09:45:59.291633 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:59.291503    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-527142-dockercfg-2tbqp\""
Sep 15 09:45:59.298088 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:59.298068    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-527142-548bf89b5d-xhf6b"]
Sep 15 09:45:59.320476 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:59.320455    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-527142-66dd5bc457-7fstk"]
Sep 15 09:45:59.322714 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:59.322701    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-527142-66dd5bc457-7fstk"
Sep 15 09:45:59.335290 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:59.335269    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-527142-66dd5bc457-7fstk"]
Sep 15 09:45:59.446422 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:59.446389    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gdk2\" (UniqueName: \"kubernetes.io/projected/e6fcac4b-8c0d-423e-af56-ebc5a97540ba-kube-api-access-8gdk2\") pod \"payload-pre-processing-e2e-ipp-b-527142-548bf89b5d-xhf6b\" (UID: \"e6fcac4b-8c0d-423e-af56-ebc5a97540ba\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-527142-548bf89b5d-xhf6b"
Sep 15 09:45:59.446602 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:59.446430    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqd5b\" (UniqueName: \"kubernetes.io/projected/f8f1a9bb-45c3-42a5-82cf-1fdc9ba05591-kube-api-access-rqd5b\") pod \"payload-processing-e2e-ipp-b-527142-66dd5bc457-7fstk\" (UID: \"f8f1a9bb-45c3-42a5-82cf-1fdc9ba05591\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-527142-66dd5bc457-7fstk"
Sep 15 09:45:59.446602 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:59.446565    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e6fcac4b-8c0d-423e-af56-ebc5a97540ba-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-527142-548bf89b5d-xhf6b\" (UID: \"e6fcac4b-8c0d-423e-af56-ebc5a97540ba\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-527142-548bf89b5d-xhf6b"
Sep 15 09:45:59.446726 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:59.446611    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8f1a9bb-45c3-42a5-82cf-1fdc9ba05591-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-527142-66dd5bc457-7fstk\" (UID: \"f8f1a9bb-45c3-42a5-82cf-1fdc9ba05591\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-527142-66dd5bc457-7fstk"
Sep 15 09:45:59.547503 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:59.547440    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8f1a9bb-45c3-42a5-82cf-1fdc9ba05591-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-527142-66dd5bc457-7fstk\" (UID: \"f8f1a9bb-45c3-42a5-82cf-1fdc9ba05591\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-527142-66dd5bc457-7fstk"
Sep 15 09:45:59.547503 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:59.547492    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gdk2\" (UniqueName: \"kubernetes.io/projected/e6fcac4b-8c0d-423e-af56-ebc5a97540ba-kube-api-access-8gdk2\") pod \"payload-pre-processing-e2e-ipp-b-527142-548bf89b5d-xhf6b\" (UID: \"e6fcac4b-8c0d-423e-af56-ebc5a97540ba\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-527142-548bf89b5d-xhf6b"
Sep 15 09:45:59.547645 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:59.547513    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqd5b\" (UniqueName: \"kubernetes.io/projected/f8f1a9bb-45c3-42a5-82cf-1fdc9ba05591-kube-api-access-rqd5b\") pod \"payload-processing-e2e-ipp-b-527142-66dd5bc457-7fstk\" (UID: \"f8f1a9bb-45c3-42a5-82cf-1fdc9ba05591\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-527142-66dd5bc457-7fstk"
Sep 15 09:45:59.547645 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:59.547559    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e6fcac4b-8c0d-423e-af56-ebc5a97540ba-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-527142-548bf89b5d-xhf6b\" (UID: \"e6fcac4b-8c0d-423e-af56-ebc5a97540ba\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-527142-548bf89b5d-xhf6b"
Sep 15 09:45:59.548208 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:59.548191    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e6fcac4b-8c0d-423e-af56-ebc5a97540ba-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-527142-548bf89b5d-xhf6b\" (UID: \"e6fcac4b-8c0d-423e-af56-ebc5a97540ba\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-527142-548bf89b5d-xhf6b"
Sep 15 09:45:59.548250 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:59.548222    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8f1a9bb-45c3-42a5-82cf-1fdc9ba05591-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-527142-66dd5bc457-7fstk\" (UID: \"f8f1a9bb-45c3-42a5-82cf-1fdc9ba05591\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-527142-66dd5bc457-7fstk"
Sep 15 09:45:59.555014 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:59.554987    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqd5b\" (UniqueName: \"kubernetes.io/projected/f8f1a9bb-45c3-42a5-82cf-1fdc9ba05591-kube-api-access-rqd5b\") pod \"payload-processing-e2e-ipp-b-527142-66dd5bc457-7fstk\" (UID: \"f8f1a9bb-45c3-42a5-82cf-1fdc9ba05591\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-527142-66dd5bc457-7fstk"
Sep 15 09:45:59.555438 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:59.555422    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gdk2\" (UniqueName: \"kubernetes.io/projected/e6fcac4b-8c0d-423e-af56-ebc5a97540ba-kube-api-access-8gdk2\") pod \"payload-pre-processing-e2e-ipp-b-527142-548bf89b5d-xhf6b\" (UID: \"e6fcac4b-8c0d-423e-af56-ebc5a97540ba\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-527142-548bf89b5d-xhf6b"
Sep 15 09:45:59.600366 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:59.600341    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-527142-548bf89b5d-xhf6b"
Sep 15 09:45:59.632293 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:59.632258    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-527142-66dd5bc457-7fstk"
Sep 15 09:45:59.869850 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:59.869821    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-527142-548bf89b5d-xhf6b"]
Sep 15 09:45:59.870308 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:45:59.870275    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6fcac4b_8c0d_423e_af56_ebc5a97540ba.slice/crio-f91e875f6ae1b38c62fe725359f76dfc988c3c82e255b3a5be088b3b60409b23 WatchSource:0}: Error finding container f91e875f6ae1b38c62fe725359f76dfc988c3c82e255b3a5be088b3b60409b23: Status 404 returned error can't find the container with id f91e875f6ae1b38c62fe725359f76dfc988c3c82e255b3a5be088b3b60409b23
Sep 15 09:45:59.911991 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:45:59.911966    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8f1a9bb_45c3_42a5_82cf_1fdc9ba05591.slice/crio-8689a6d9c475cd856c4798c9341409ed2b79169d0500abe660ed63c3358b9e69 WatchSource:0}: Error finding container 8689a6d9c475cd856c4798c9341409ed2b79169d0500abe660ed63c3358b9e69: Status 404 returned error can't find the container with id 8689a6d9c475cd856c4798c9341409ed2b79169d0500abe660ed63c3358b9e69
Sep 15 09:45:59.913063 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:45:59.913042    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-527142-66dd5bc457-7fstk"]
Sep 15 09:46:00.345688 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:46:00.345653    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-527142-548bf89b5d-xhf6b" event={"ID":"e6fcac4b-8c0d-423e-af56-ebc5a97540ba","Type":"ContainerStarted","Data":"78969b39ff58b8f76d6129883873393c6457203730cb730138cdf530426f63e3"}
Sep 15 09:46:00.346142 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:46:00.345846    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-527142-548bf89b5d-xhf6b"
Sep 15 09:46:00.346142 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:46:00.345902    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-527142-548bf89b5d-xhf6b" event={"ID":"e6fcac4b-8c0d-423e-af56-ebc5a97540ba","Type":"ContainerStarted","Data":"f91e875f6ae1b38c62fe725359f76dfc988c3c82e255b3a5be088b3b60409b23"}
Sep 15 09:46:00.347511 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:46:00.347488    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-527142-66dd5bc457-7fstk" event={"ID":"f8f1a9bb-45c3-42a5-82cf-1fdc9ba05591","Type":"ContainerStarted","Data":"761e6e5c835127cbaa5154298b101481c86249db2cf3ad5c1b430db10b9aa5e9"}
Sep 15 09:46:00.347627 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:46:00.347530    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-527142-66dd5bc457-7fstk" event={"ID":"f8f1a9bb-45c3-42a5-82cf-1fdc9ba05591","Type":"ContainerStarted","Data":"8689a6d9c475cd856c4798c9341409ed2b79169d0500abe660ed63c3358b9e69"}
Sep 15 09:46:00.347627 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:46:00.347563    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-527142-66dd5bc457-7fstk"
Sep 15 09:46:00.366080 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:46:00.366035    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-527142-548bf89b5d-xhf6b" podStartSLOduration=1.36601899 podStartE2EDuration="1.36601899s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:45:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:46:00.36153702 +0000 UTC m=+1904.699982295" watchObservedRunningTime="2026-09-15 09:46:00.36601899 +0000 UTC m=+1904.704464265"
Sep 15 09:46:00.378208 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:46:00.378167    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-527142-66dd5bc457-7fstk" podStartSLOduration=1.3781570300000001 podStartE2EDuration="1.37815703s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:45:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:46:00.376563567 +0000 UTC m=+1904.715008843" watchObservedRunningTime="2026-09-15 09:46:00.37815703 +0000 UTC m=+1904.716602304"
Sep 15 09:46:11.355541 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:46:11.355513    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-527142-66dd5bc457-7fstk"
Sep 15 09:46:11.355906 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:46:11.355567    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-527142-548bf89b5d-xhf6b"
Sep 15 09:46:26.632532 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:46:26.632502    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-527142-66dd5bc457-7fstk_f8f1a9bb-45c3-42a5-82cf-1fdc9ba05591/payload-processing/0.log"
Sep 15 09:47:28.445565 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:47:28.445491    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-527142-66dd5bc457-7fstk_f8f1a9bb-45c3-42a5-82cf-1fdc9ba05591/payload-processing/0.log"
Sep 15 09:47:35.714060 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:47:35.714027    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-29a3ae-5bbd76fdbb-4dm6v"]
Sep 15 09:47:35.717760 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:47:35.717737    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-29a3ae-5bbd76fdbb-4dm6v"
Sep 15 09:47:35.720278 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:47:35.720255    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-29a3ae\""
Sep 15 09:47:35.729186 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:47:35.729165    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-29a3ae-5bbd76fdbb-4dm6v"]
Sep 15 09:47:35.890106 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:47:35.890076    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgrk9\" (UniqueName: \"kubernetes.io/projected/2d769dcd-3b8f-4974-9257-807f11fdcd1c-kube-api-access-jgrk9\") pod \"payload-pre-processing-e2e-ipp-cleanup-29a3ae-5bbd76fdbb-4dm6v\" (UID: \"2d769dcd-3b8f-4974-9257-807f11fdcd1c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-29a3ae-5bbd76fdbb-4dm6v"
Sep 15 09:47:35.890251 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:47:35.890223    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d769dcd-3b8f-4974-9257-807f11fdcd1c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-29a3ae-5bbd76fdbb-4dm6v\" (UID: \"2d769dcd-3b8f-4974-9257-807f11fdcd1c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-29a3ae-5bbd76fdbb-4dm6v"
Sep 15 09:47:35.991221 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:47:35.991141    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d769dcd-3b8f-4974-9257-807f11fdcd1c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-29a3ae-5bbd76fdbb-4dm6v\" (UID: \"2d769dcd-3b8f-4974-9257-807f11fdcd1c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-29a3ae-5bbd76fdbb-4dm6v"
Sep 15 09:47:35.991221 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:47:35.991193    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgrk9\" (UniqueName: \"kubernetes.io/projected/2d769dcd-3b8f-4974-9257-807f11fdcd1c-kube-api-access-jgrk9\") pod \"payload-pre-processing-e2e-ipp-cleanup-29a3ae-5bbd76fdbb-4dm6v\" (UID: \"2d769dcd-3b8f-4974-9257-807f11fdcd1c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-29a3ae-5bbd76fdbb-4dm6v"
Sep 15 09:47:35.992122 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:47:35.992092    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d769dcd-3b8f-4974-9257-807f11fdcd1c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-29a3ae-5bbd76fdbb-4dm6v\" (UID: \"2d769dcd-3b8f-4974-9257-807f11fdcd1c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-29a3ae-5bbd76fdbb-4dm6v"
Sep 15 09:47:36.000676 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:47:36.000649    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgrk9\" (UniqueName: \"kubernetes.io/projected/2d769dcd-3b8f-4974-9257-807f11fdcd1c-kube-api-access-jgrk9\") pod \"payload-pre-processing-e2e-ipp-cleanup-29a3ae-5bbd76fdbb-4dm6v\" (UID: \"2d769dcd-3b8f-4974-9257-807f11fdcd1c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-29a3ae-5bbd76fdbb-4dm6v"
Sep 15 09:47:36.028339 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:47:36.028316    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-29a3ae-5bbd76fdbb-4dm6v"
Sep 15 09:47:36.299556 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:47:36.299524    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-29a3ae-5bbd76fdbb-4dm6v"]
Sep 15 09:47:36.300287 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:47:36.300261    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d769dcd_3b8f_4974_9257_807f11fdcd1c.slice/crio-ce9140836e1f8795f548039f42258db720fc8b0d7d244128da5565243b345d1b WatchSource:0}: Error finding container ce9140836e1f8795f548039f42258db720fc8b0d7d244128da5565243b345d1b: Status 404 returned error can't find the container with id ce9140836e1f8795f548039f42258db720fc8b0d7d244128da5565243b345d1b
Sep 15 09:47:36.876579 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:47:36.876545    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-29a3ae-5bbd76fdbb-4dm6v" event={"ID":"2d769dcd-3b8f-4974-9257-807f11fdcd1c","Type":"ContainerStarted","Data":"b440ead081130462ea505508e58550754946edb684ec4a8119885ab243c89562"}
Sep 15 09:47:36.877024 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:47:36.876595    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-29a3ae-5bbd76fdbb-4dm6v" event={"ID":"2d769dcd-3b8f-4974-9257-807f11fdcd1c","Type":"ContainerStarted","Data":"ce9140836e1f8795f548039f42258db720fc8b0d7d244128da5565243b345d1b"}
Sep 15 09:47:36.877024 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:47:36.876676    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-29a3ae-5bbd76fdbb-4dm6v"
Sep 15 09:47:36.891432 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:47:36.891385    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-29a3ae-5bbd76fdbb-4dm6v" podStartSLOduration=1.891370317 podStartE2EDuration="1.891370317s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:47:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:47:36.890186306 +0000 UTC m=+2001.228631586" watchObservedRunningTime="2026-09-15 09:47:36.891370317 +0000 UTC m=+2001.229815592"
Sep 15 09:47:47.885149 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:47:47.885109    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-29a3ae-5bbd76fdbb-4dm6v"
Sep 15 09:48:13.736025 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:48:13.735988    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-29a3ae-5bbd76fdbb-4dm6v"]
Sep 15 09:48:13.736517 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:48:13.736254    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-29a3ae-5bbd76fdbb-4dm6v" podUID="2d769dcd-3b8f-4974-9257-807f11fdcd1c" containerName="payload-pre-processing" containerID="cri-o://b440ead081130462ea505508e58550754946edb684ec4a8119885ab243c89562" gracePeriod=30
Sep 15 09:48:13.990834 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:48:13.990782    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-29a3ae-5bbd76fdbb-4dm6v"
Sep 15 09:48:14.089722 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:48:14.089687    2578 generic.go:356] "Generic (PLEG): container finished" podID="2d769dcd-3b8f-4974-9257-807f11fdcd1c" containerID="b440ead081130462ea505508e58550754946edb684ec4a8119885ab243c89562" exitCode=0
Sep 15 09:48:14.089887 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:48:14.089728    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-29a3ae-5bbd76fdbb-4dm6v" event={"ID":"2d769dcd-3b8f-4974-9257-807f11fdcd1c","Type":"ContainerDied","Data":"b440ead081130462ea505508e58550754946edb684ec4a8119885ab243c89562"}
Sep 15 09:48:14.089887 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:48:14.089735    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-29a3ae-5bbd76fdbb-4dm6v"
Sep 15 09:48:14.089887 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:48:14.089769    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-29a3ae-5bbd76fdbb-4dm6v" event={"ID":"2d769dcd-3b8f-4974-9257-807f11fdcd1c","Type":"ContainerDied","Data":"ce9140836e1f8795f548039f42258db720fc8b0d7d244128da5565243b345d1b"}
Sep 15 09:48:14.089887 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:48:14.089792    2578 scope.go:117] "RemoveContainer" containerID="b440ead081130462ea505508e58550754946edb684ec4a8119885ab243c89562"
Sep 15 09:48:14.099098 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:48:14.099078    2578 scope.go:117] "RemoveContainer" containerID="b440ead081130462ea505508e58550754946edb684ec4a8119885ab243c89562"
Sep 15 09:48:14.099341 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:48:14.099326    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b440ead081130462ea505508e58550754946edb684ec4a8119885ab243c89562\": container with ID starting with b440ead081130462ea505508e58550754946edb684ec4a8119885ab243c89562 not found: ID does not exist" containerID="b440ead081130462ea505508e58550754946edb684ec4a8119885ab243c89562"
Sep 15 09:48:14.099386 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:48:14.099348    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b440ead081130462ea505508e58550754946edb684ec4a8119885ab243c89562"} err="failed to get container status \"b440ead081130462ea505508e58550754946edb684ec4a8119885ab243c89562\": rpc error: code = NotFound desc = could not find container \"b440ead081130462ea505508e58550754946edb684ec4a8119885ab243c89562\": container with ID starting with b440ead081130462ea505508e58550754946edb684ec4a8119885ab243c89562 not found: ID does not exist"
Sep 15 09:48:14.142714 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:48:14.142694    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jgrk9\" (UniqueName: \"kubernetes.io/projected/2d769dcd-3b8f-4974-9257-807f11fdcd1c-kube-api-access-jgrk9\") pod \"2d769dcd-3b8f-4974-9257-807f11fdcd1c\" (UID: \"2d769dcd-3b8f-4974-9257-807f11fdcd1c\") "
Sep 15 09:48:14.142825 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:48:14.142781    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d769dcd-3b8f-4974-9257-807f11fdcd1c-plugins-config-volume\") pod \"2d769dcd-3b8f-4974-9257-807f11fdcd1c\" (UID: \"2d769dcd-3b8f-4974-9257-807f11fdcd1c\") "
Sep 15 09:48:14.143177 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:48:14.143145    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d769dcd-3b8f-4974-9257-807f11fdcd1c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2d769dcd-3b8f-4974-9257-807f11fdcd1c" (UID: "2d769dcd-3b8f-4974-9257-807f11fdcd1c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:48:14.144713 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:48:14.144692    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d769dcd-3b8f-4974-9257-807f11fdcd1c-kube-api-access-jgrk9" (OuterVolumeSpecName: "kube-api-access-jgrk9") pod "2d769dcd-3b8f-4974-9257-807f11fdcd1c" (UID: "2d769dcd-3b8f-4974-9257-807f11fdcd1c"). InnerVolumeSpecName "kube-api-access-jgrk9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:48:14.244313 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:48:14.244265    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d769dcd-3b8f-4974-9257-807f11fdcd1c-plugins-config-volume\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:48:14.244313 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:48:14.244283    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jgrk9\" (UniqueName: \"kubernetes.io/projected/2d769dcd-3b8f-4974-9257-807f11fdcd1c-kube-api-access-jgrk9\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:48:14.424898 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:48:14.424875    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-29a3ae-5bbd76fdbb-4dm6v"]
Sep 15 09:48:14.429833 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:48:14.429807    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-29a3ae-5bbd76fdbb-4dm6v"]
Sep 15 09:48:16.123505 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:48:16.123475    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d769dcd-3b8f-4974-9257-807f11fdcd1c" path="/var/lib/kubelet/pods/2d769dcd-3b8f-4974-9257-807f11fdcd1c/volumes"
Sep 15 09:48:16.598606 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:48:16.598579    2578 scope.go:117] "RemoveContainer" containerID="400fcf1d15ea5552aea1094d8699489a15dc1df31783b01a5b553ea6f85acd37"
Sep 15 09:49:30.830360 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:30.830323    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn"]
Sep 15 09:49:30.830988 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:30.830529    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn" podUID="e77a5d7e-8896-42bd-ada3-ec2532f7717a" containerName="istio-proxy" containerID="cri-o://a25f151292c6edd615d8f89b3a558c46bf261444826779547465385f7cab9574" gracePeriod=30
Sep 15 09:49:35.856079 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:35.856042    2578 patch_prober.go:28] interesting pod/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.99:15021/healthz/ready\": dial tcp 10.134.0.99:15021: connect: connection refused" start-of-body=
Sep 15 09:49:35.856399 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:35.856113    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn" podUID="e77a5d7e-8896-42bd-ada3-ec2532f7717a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.99:15021/healthz/ready\": dial tcp 10.134.0.99:15021: connect: connection refused"
Sep 15 09:49:36.092540 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:36.092510    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn"
Sep 15 09:49:36.164910 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:36.164827    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e77a5d7e-8896-42bd-ada3-ec2532f7717a-workload-socket\") pod \"e77a5d7e-8896-42bd-ada3-ec2532f7717a\" (UID: \"e77a5d7e-8896-42bd-ada3-ec2532f7717a\") "
Sep 15 09:49:36.165135 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:36.164926    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e77a5d7e-8896-42bd-ada3-ec2532f7717a-istio-token\") pod \"e77a5d7e-8896-42bd-ada3-ec2532f7717a\" (UID: \"e77a5d7e-8896-42bd-ada3-ec2532f7717a\") "
Sep 15 09:49:36.165135 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:36.164980    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e77a5d7e-8896-42bd-ada3-ec2532f7717a-istio-data\") pod \"e77a5d7e-8896-42bd-ada3-ec2532f7717a\" (UID: \"e77a5d7e-8896-42bd-ada3-ec2532f7717a\") "
Sep 15 09:49:36.165135 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:36.165048    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e77a5d7e-8896-42bd-ada3-ec2532f7717a-workload-certs\") pod \"e77a5d7e-8896-42bd-ada3-ec2532f7717a\" (UID: \"e77a5d7e-8896-42bd-ada3-ec2532f7717a\") "
Sep 15 09:49:36.165135 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:36.165082    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e77a5d7e-8896-42bd-ada3-ec2532f7717a-istio-podinfo\") pod \"e77a5d7e-8896-42bd-ada3-ec2532f7717a\" (UID: \"e77a5d7e-8896-42bd-ada3-ec2532f7717a\") "
Sep 15 09:49:36.165135 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:36.165109    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8qr56\" (UniqueName: \"kubernetes.io/projected/e77a5d7e-8896-42bd-ada3-ec2532f7717a-kube-api-access-8qr56\") pod \"e77a5d7e-8896-42bd-ada3-ec2532f7717a\" (UID: \"e77a5d7e-8896-42bd-ada3-ec2532f7717a\") "
Sep 15 09:49:36.165416 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:36.165137    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e77a5d7e-8896-42bd-ada3-ec2532f7717a-istiod-ca-cert\") pod \"e77a5d7e-8896-42bd-ada3-ec2532f7717a\" (UID: \"e77a5d7e-8896-42bd-ada3-ec2532f7717a\") "
Sep 15 09:49:36.165416 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:36.165164    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e77a5d7e-8896-42bd-ada3-ec2532f7717a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e77a5d7e-8896-42bd-ada3-ec2532f7717a" (UID: "e77a5d7e-8896-42bd-ada3-ec2532f7717a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:49:36.165416 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:36.165180    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e77a5d7e-8896-42bd-ada3-ec2532f7717a-istio-envoy\") pod \"e77a5d7e-8896-42bd-ada3-ec2532f7717a\" (UID: \"e77a5d7e-8896-42bd-ada3-ec2532f7717a\") "
Sep 15 09:49:36.165416 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:36.165305    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e77a5d7e-8896-42bd-ada3-ec2532f7717a-credential-socket\") pod \"e77a5d7e-8896-42bd-ada3-ec2532f7717a\" (UID: \"e77a5d7e-8896-42bd-ada3-ec2532f7717a\") "
Sep 15 09:49:36.165416 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:36.165351    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e77a5d7e-8896-42bd-ada3-ec2532f7717a-istio-data" (OuterVolumeSpecName: "istio-data") pod "e77a5d7e-8896-42bd-ada3-ec2532f7717a" (UID: "e77a5d7e-8896-42bd-ada3-ec2532f7717a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:49:36.165687 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:36.165553    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e77a5d7e-8896-42bd-ada3-ec2532f7717a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e77a5d7e-8896-42bd-ada3-ec2532f7717a" (UID: "e77a5d7e-8896-42bd-ada3-ec2532f7717a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:49:36.165687 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:36.165632    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e77a5d7e-8896-42bd-ada3-ec2532f7717a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e77a5d7e-8896-42bd-ada3-ec2532f7717a" (UID: "e77a5d7e-8896-42bd-ada3-ec2532f7717a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:49:36.165802 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:36.165711    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e77a5d7e-8896-42bd-ada3-ec2532f7717a-istio-data\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:49:36.165802 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:36.165730    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e77a5d7e-8896-42bd-ada3-ec2532f7717a-workload-socket\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:49:36.165921 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:36.165823    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e77a5d7e-8896-42bd-ada3-ec2532f7717a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e77a5d7e-8896-42bd-ada3-ec2532f7717a" (UID: "e77a5d7e-8896-42bd-ada3-ec2532f7717a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:49:36.167381 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:36.167343    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e77a5d7e-8896-42bd-ada3-ec2532f7717a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e77a5d7e-8896-42bd-ada3-ec2532f7717a" (UID: "e77a5d7e-8896-42bd-ada3-ec2532f7717a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 09:49:36.167492 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:36.167390    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e77a5d7e-8896-42bd-ada3-ec2532f7717a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e77a5d7e-8896-42bd-ada3-ec2532f7717a" (UID: "e77a5d7e-8896-42bd-ada3-ec2532f7717a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:49:36.167492 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:36.167399    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e77a5d7e-8896-42bd-ada3-ec2532f7717a-istio-token" (OuterVolumeSpecName: "istio-token") pod "e77a5d7e-8896-42bd-ada3-ec2532f7717a" (UID: "e77a5d7e-8896-42bd-ada3-ec2532f7717a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:49:36.167492 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:36.167422    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e77a5d7e-8896-42bd-ada3-ec2532f7717a-kube-api-access-8qr56" (OuterVolumeSpecName: "kube-api-access-8qr56") pod "e77a5d7e-8896-42bd-ada3-ec2532f7717a" (UID: "e77a5d7e-8896-42bd-ada3-ec2532f7717a"). InnerVolumeSpecName "kube-api-access-8qr56". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:49:36.266453 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:36.266399    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e77a5d7e-8896-42bd-ada3-ec2532f7717a-istio-token\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:49:36.266453 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:36.266448    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e77a5d7e-8896-42bd-ada3-ec2532f7717a-workload-certs\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:49:36.266453 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:36.266460    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e77a5d7e-8896-42bd-ada3-ec2532f7717a-istio-podinfo\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:49:36.266751 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:36.266474    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8qr56\" (UniqueName: \"kubernetes.io/projected/e77a5d7e-8896-42bd-ada3-ec2532f7717a-kube-api-access-8qr56\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:49:36.266751 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:36.266488    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e77a5d7e-8896-42bd-ada3-ec2532f7717a-istiod-ca-cert\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:49:36.266751 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:36.266499    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e77a5d7e-8896-42bd-ada3-ec2532f7717a-istio-envoy\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:49:36.266751 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:36.266509    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e77a5d7e-8896-42bd-ada3-ec2532f7717a-credential-socket\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:49:36.546998 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:36.546961    2578 generic.go:356] "Generic (PLEG): container finished" podID="e77a5d7e-8896-42bd-ada3-ec2532f7717a" containerID="a25f151292c6edd615d8f89b3a558c46bf261444826779547465385f7cab9574" exitCode=0
Sep 15 09:49:36.547177 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:36.547016    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn"
Sep 15 09:49:36.547177 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:36.547053    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn" event={"ID":"e77a5d7e-8896-42bd-ada3-ec2532f7717a","Type":"ContainerDied","Data":"a25f151292c6edd615d8f89b3a558c46bf261444826779547465385f7cab9574"}
Sep 15 09:49:36.547177 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:36.547112    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn" event={"ID":"e77a5d7e-8896-42bd-ada3-ec2532f7717a","Type":"ContainerDied","Data":"6b6ae262f301731fa45ff394da3642608f75f092d644dc5f127771e9f8966491"}
Sep 15 09:49:36.547177 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:36.547135    2578 scope.go:117] "RemoveContainer" containerID="a25f151292c6edd615d8f89b3a558c46bf261444826779547465385f7cab9574"
Sep 15 09:49:36.557497 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:36.557478    2578 scope.go:117] "RemoveContainer" containerID="75a5113575a815cc2d884fa66e99dd263470e050d078eec808cf0630174d7247"
Sep 15 09:49:36.566139 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:36.566121    2578 scope.go:117] "RemoveContainer" containerID="a25f151292c6edd615d8f89b3a558c46bf261444826779547465385f7cab9574"
Sep 15 09:49:36.566404 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:49:36.566387    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a25f151292c6edd615d8f89b3a558c46bf261444826779547465385f7cab9574\": container with ID starting with a25f151292c6edd615d8f89b3a558c46bf261444826779547465385f7cab9574 not found: ID does not exist" containerID="a25f151292c6edd615d8f89b3a558c46bf261444826779547465385f7cab9574"
Sep 15 09:49:36.566457 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:36.566413    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a25f151292c6edd615d8f89b3a558c46bf261444826779547465385f7cab9574"} err="failed to get container status \"a25f151292c6edd615d8f89b3a558c46bf261444826779547465385f7cab9574\": rpc error: code = NotFound desc = could not find container \"a25f151292c6edd615d8f89b3a558c46bf261444826779547465385f7cab9574\": container with ID starting with a25f151292c6edd615d8f89b3a558c46bf261444826779547465385f7cab9574 not found: ID does not exist"
Sep 15 09:49:36.566457 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:36.566430    2578 scope.go:117] "RemoveContainer" containerID="75a5113575a815cc2d884fa66e99dd263470e050d078eec808cf0630174d7247"
Sep 15 09:49:36.566690 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:49:36.566670    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75a5113575a815cc2d884fa66e99dd263470e050d078eec808cf0630174d7247\": container with ID starting with 75a5113575a815cc2d884fa66e99dd263470e050d078eec808cf0630174d7247 not found: ID does not exist" containerID="75a5113575a815cc2d884fa66e99dd263470e050d078eec808cf0630174d7247"
Sep 15 09:49:36.566745 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:36.566700    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75a5113575a815cc2d884fa66e99dd263470e050d078eec808cf0630174d7247"} err="failed to get container status \"75a5113575a815cc2d884fa66e99dd263470e050d078eec808cf0630174d7247\": rpc error: code = NotFound desc = could not find container \"75a5113575a815cc2d884fa66e99dd263470e050d078eec808cf0630174d7247\": container with ID starting with 75a5113575a815cc2d884fa66e99dd263470e050d078eec808cf0630174d7247 not found: ID does not exist"
Sep 15 09:49:36.571491 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:36.571465    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn"]
Sep 15 09:49:36.578066 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:36.578037    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-6593fe-openshift-default-58674846d6-dgtkn"]
Sep 15 09:49:38.122189 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:38.122153    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e77a5d7e-8896-42bd-ada3-ec2532f7717a" path="/var/lib/kubelet/pods/e77a5d7e-8896-42bd-ada3-ec2532f7717a/volumes"
Sep 15 09:49:41.832236 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:41.832202    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-527142-66dd5bc457-7fstk"]
Sep 15 09:49:41.832614 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:41.832444    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-527142-66dd5bc457-7fstk" podUID="f8f1a9bb-45c3-42a5-82cf-1fdc9ba05591" containerName="payload-processing" containerID="cri-o://761e6e5c835127cbaa5154298b101481c86249db2cf3ad5c1b430db10b9aa5e9" gracePeriod=30
Sep 15 09:49:41.838842 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:41.838816    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-527142-548bf89b5d-xhf6b"]
Sep 15 09:49:41.839226 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:41.839040    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-527142-548bf89b5d-xhf6b" podUID="e6fcac4b-8c0d-423e-af56-ebc5a97540ba" containerName="payload-pre-processing" containerID="cri-o://78969b39ff58b8f76d6129883873393c6457203730cb730138cdf530426f63e3" gracePeriod=30
Sep 15 09:49:42.128653 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:42.128629    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-527142-66dd5bc457-7fstk"
Sep 15 09:49:42.131836 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:42.131814    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-527142-548bf89b5d-xhf6b"
Sep 15 09:49:42.220911 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:42.220881    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8gdk2\" (UniqueName: \"kubernetes.io/projected/e6fcac4b-8c0d-423e-af56-ebc5a97540ba-kube-api-access-8gdk2\") pod \"e6fcac4b-8c0d-423e-af56-ebc5a97540ba\" (UID: \"e6fcac4b-8c0d-423e-af56-ebc5a97540ba\") "
Sep 15 09:49:42.221089 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:42.220923    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e6fcac4b-8c0d-423e-af56-ebc5a97540ba-plugins-config-volume\") pod \"e6fcac4b-8c0d-423e-af56-ebc5a97540ba\" (UID: \"e6fcac4b-8c0d-423e-af56-ebc5a97540ba\") "
Sep 15 09:49:42.221089 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:42.221020    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rqd5b\" (UniqueName: \"kubernetes.io/projected/f8f1a9bb-45c3-42a5-82cf-1fdc9ba05591-kube-api-access-rqd5b\") pod \"f8f1a9bb-45c3-42a5-82cf-1fdc9ba05591\" (UID: \"f8f1a9bb-45c3-42a5-82cf-1fdc9ba05591\") "
Sep 15 09:49:42.221169 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:42.221139    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8f1a9bb-45c3-42a5-82cf-1fdc9ba05591-plugins-config-volume\") pod \"f8f1a9bb-45c3-42a5-82cf-1fdc9ba05591\" (UID: \"f8f1a9bb-45c3-42a5-82cf-1fdc9ba05591\") "
Sep 15 09:49:42.221335 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:42.221310    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6fcac4b-8c0d-423e-af56-ebc5a97540ba-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e6fcac4b-8c0d-423e-af56-ebc5a97540ba" (UID: "e6fcac4b-8c0d-423e-af56-ebc5a97540ba"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:49:42.221442 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:42.221418    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e6fcac4b-8c0d-423e-af56-ebc5a97540ba-plugins-config-volume\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:49:42.221518 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:42.221498    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8f1a9bb-45c3-42a5-82cf-1fdc9ba05591-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f8f1a9bb-45c3-42a5-82cf-1fdc9ba05591" (UID: "f8f1a9bb-45c3-42a5-82cf-1fdc9ba05591"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:49:42.223101 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:42.223078    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8f1a9bb-45c3-42a5-82cf-1fdc9ba05591-kube-api-access-rqd5b" (OuterVolumeSpecName: "kube-api-access-rqd5b") pod "f8f1a9bb-45c3-42a5-82cf-1fdc9ba05591" (UID: "f8f1a9bb-45c3-42a5-82cf-1fdc9ba05591"). InnerVolumeSpecName "kube-api-access-rqd5b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:49:42.223212 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:42.223133    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6fcac4b-8c0d-423e-af56-ebc5a97540ba-kube-api-access-8gdk2" (OuterVolumeSpecName: "kube-api-access-8gdk2") pod "e6fcac4b-8c0d-423e-af56-ebc5a97540ba" (UID: "e6fcac4b-8c0d-423e-af56-ebc5a97540ba"). InnerVolumeSpecName "kube-api-access-8gdk2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:49:42.322015 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:42.321987    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rqd5b\" (UniqueName: \"kubernetes.io/projected/f8f1a9bb-45c3-42a5-82cf-1fdc9ba05591-kube-api-access-rqd5b\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:49:42.322015 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:42.322009    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8f1a9bb-45c3-42a5-82cf-1fdc9ba05591-plugins-config-volume\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:49:42.322146 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:42.322023    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8gdk2\" (UniqueName: \"kubernetes.io/projected/e6fcac4b-8c0d-423e-af56-ebc5a97540ba-kube-api-access-8gdk2\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:49:42.582757 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:42.582728    2578 generic.go:356] "Generic (PLEG): container finished" podID="e6fcac4b-8c0d-423e-af56-ebc5a97540ba" containerID="78969b39ff58b8f76d6129883873393c6457203730cb730138cdf530426f63e3" exitCode=0
Sep 15 09:49:42.582875 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:42.582769    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-527142-548bf89b5d-xhf6b"
Sep 15 09:49:42.582875 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:42.582781    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-527142-548bf89b5d-xhf6b" event={"ID":"e6fcac4b-8c0d-423e-af56-ebc5a97540ba","Type":"ContainerDied","Data":"78969b39ff58b8f76d6129883873393c6457203730cb730138cdf530426f63e3"}
Sep 15 09:49:42.582875 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:42.582830    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-527142-548bf89b5d-xhf6b" event={"ID":"e6fcac4b-8c0d-423e-af56-ebc5a97540ba","Type":"ContainerDied","Data":"f91e875f6ae1b38c62fe725359f76dfc988c3c82e255b3a5be088b3b60409b23"}
Sep 15 09:49:42.582875 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:42.582863    2578 scope.go:117] "RemoveContainer" containerID="78969b39ff58b8f76d6129883873393c6457203730cb730138cdf530426f63e3"
Sep 15 09:49:42.584508 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:42.584482    2578 generic.go:356] "Generic (PLEG): container finished" podID="f8f1a9bb-45c3-42a5-82cf-1fdc9ba05591" containerID="761e6e5c835127cbaa5154298b101481c86249db2cf3ad5c1b430db10b9aa5e9" exitCode=0
Sep 15 09:49:42.584599 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:42.584518    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-527142-66dd5bc457-7fstk"
Sep 15 09:49:42.584599 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:42.584542    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-527142-66dd5bc457-7fstk" event={"ID":"f8f1a9bb-45c3-42a5-82cf-1fdc9ba05591","Type":"ContainerDied","Data":"761e6e5c835127cbaa5154298b101481c86249db2cf3ad5c1b430db10b9aa5e9"}
Sep 15 09:49:42.584599 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:42.584584    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-527142-66dd5bc457-7fstk" event={"ID":"f8f1a9bb-45c3-42a5-82cf-1fdc9ba05591","Type":"ContainerDied","Data":"8689a6d9c475cd856c4798c9341409ed2b79169d0500abe660ed63c3358b9e69"}
Sep 15 09:49:42.592827 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:42.592811    2578 scope.go:117] "RemoveContainer" containerID="78969b39ff58b8f76d6129883873393c6457203730cb730138cdf530426f63e3"
Sep 15 09:49:42.593094 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:49:42.593074    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78969b39ff58b8f76d6129883873393c6457203730cb730138cdf530426f63e3\": container with ID starting with 78969b39ff58b8f76d6129883873393c6457203730cb730138cdf530426f63e3 not found: ID does not exist" containerID="78969b39ff58b8f76d6129883873393c6457203730cb730138cdf530426f63e3"
Sep 15 09:49:42.593152 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:42.593100    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78969b39ff58b8f76d6129883873393c6457203730cb730138cdf530426f63e3"} err="failed to get container status \"78969b39ff58b8f76d6129883873393c6457203730cb730138cdf530426f63e3\": rpc error: code = NotFound desc = could not find container \"78969b39ff58b8f76d6129883873393c6457203730cb730138cdf530426f63e3\": container with ID starting with 78969b39ff58b8f76d6129883873393c6457203730cb730138cdf530426f63e3 not found: ID does not exist"
Sep 15 09:49:42.593152 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:42.593115    2578 scope.go:117] "RemoveContainer" containerID="761e6e5c835127cbaa5154298b101481c86249db2cf3ad5c1b430db10b9aa5e9"
Sep 15 09:49:42.601206 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:42.601185    2578 scope.go:117] "RemoveContainer" containerID="761e6e5c835127cbaa5154298b101481c86249db2cf3ad5c1b430db10b9aa5e9"
Sep 15 09:49:42.601449 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:49:42.601433    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"761e6e5c835127cbaa5154298b101481c86249db2cf3ad5c1b430db10b9aa5e9\": container with ID starting with 761e6e5c835127cbaa5154298b101481c86249db2cf3ad5c1b430db10b9aa5e9 not found: ID does not exist" containerID="761e6e5c835127cbaa5154298b101481c86249db2cf3ad5c1b430db10b9aa5e9"
Sep 15 09:49:42.601493 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:42.601453    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"761e6e5c835127cbaa5154298b101481c86249db2cf3ad5c1b430db10b9aa5e9"} err="failed to get container status \"761e6e5c835127cbaa5154298b101481c86249db2cf3ad5c1b430db10b9aa5e9\": rpc error: code = NotFound desc = could not find container \"761e6e5c835127cbaa5154298b101481c86249db2cf3ad5c1b430db10b9aa5e9\": container with ID starting with 761e6e5c835127cbaa5154298b101481c86249db2cf3ad5c1b430db10b9aa5e9 not found: ID does not exist"
Sep 15 09:49:42.611003 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:42.610982    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-527142-548bf89b5d-xhf6b"]
Sep 15 09:49:42.617976 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:42.617938    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-527142-548bf89b5d-xhf6b"]
Sep 15 09:49:42.652993 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:42.652965    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-527142-66dd5bc457-7fstk"]
Sep 15 09:49:42.662255 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:42.662229    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-527142-66dd5bc457-7fstk"]
Sep 15 09:49:44.121139 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:44.121106    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6fcac4b-8c0d-423e-af56-ebc5a97540ba" path="/var/lib/kubelet/pods/e6fcac4b-8c0d-423e-af56-ebc5a97540ba/volumes"
Sep 15 09:49:44.121500 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:44.121452    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8f1a9bb-45c3-42a5-82cf-1fdc9ba05591" path="/var/lib/kubelet/pods/f8f1a9bb-45c3-42a5-82cf-1fdc9ba05591/volumes"
Sep 15 09:49:59.547320 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:59.547278    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-864b9a-65c8744b9d-btmfr"]
Sep 15 09:49:59.548272 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:59.547562    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-864b9a-65c8744b9d-btmfr" podUID="f5202e88-6619-4158-b332-04e8ed44c4ca" containerName="maas-api" containerID="cri-o://8261830723d255583c1b34671f6ad6041ac7e5de71c9843fc5808509c719eb7a" gracePeriod=30
Sep 15 09:49:59.633891 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:59.633860    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-864b9a-567c79f95-lrm59"]
Sep 15 09:49:59.634158 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:59.634130    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-864b9a-567c79f95-lrm59" podUID="92c84132-4ec6-486f-937b-97cc89a1f2bd" containerName="payload-processing" containerID="cri-o://677e806c0eb8ae97761366f22cb47842d0e9572d9f9a915e3b902016f15f7b80" gracePeriod=30
Sep 15 09:49:59.691531 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:59.691506    2578 generic.go:356] "Generic (PLEG): container finished" podID="f5202e88-6619-4158-b332-04e8ed44c4ca" containerID="8261830723d255583c1b34671f6ad6041ac7e5de71c9843fc5808509c719eb7a" exitCode=0
Sep 15 09:49:59.691662 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:59.691571    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-864b9a-65c8744b9d-btmfr" event={"ID":"f5202e88-6619-4158-b332-04e8ed44c4ca","Type":"ContainerDied","Data":"8261830723d255583c1b34671f6ad6041ac7e5de71c9843fc5808509c719eb7a"}
Sep 15 09:49:59.903582 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:59.903560    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-864b9a-65c8744b9d-btmfr"
Sep 15 09:49:59.906389 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:49:59.906371    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-864b9a-567c79f95-lrm59"
Sep 15 09:50:00.071666 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:00.071638    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/92c84132-4ec6-486f-937b-97cc89a1f2bd-plugins-config-volume\") pod \"92c84132-4ec6-486f-937b-97cc89a1f2bd\" (UID: \"92c84132-4ec6-486f-937b-97cc89a1f2bd\") "
Sep 15 09:50:00.071832 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:00.071680    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5202e88-6619-4158-b332-04e8ed44c4ca-metrics-certs\") pod \"f5202e88-6619-4158-b332-04e8ed44c4ca\" (UID: \"f5202e88-6619-4158-b332-04e8ed44c4ca\") "
Sep 15 09:50:00.071832 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:00.071714    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5202e88-6619-4158-b332-04e8ed44c4ca-maas-api-tls\") pod \"f5202e88-6619-4158-b332-04e8ed44c4ca\" (UID: \"f5202e88-6619-4158-b332-04e8ed44c4ca\") "
Sep 15 09:50:00.071832 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:00.071743    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cgqh8\" (UniqueName: \"kubernetes.io/projected/92c84132-4ec6-486f-937b-97cc89a1f2bd-kube-api-access-cgqh8\") pod \"92c84132-4ec6-486f-937b-97cc89a1f2bd\" (UID: \"92c84132-4ec6-486f-937b-97cc89a1f2bd\") "
Sep 15 09:50:00.072042 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:00.071844    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5202e88-6619-4158-b332-04e8ed44c4ca-openshift-service-ca\") pod \"f5202e88-6619-4158-b332-04e8ed44c4ca\" (UID: \"f5202e88-6619-4158-b332-04e8ed44c4ca\") "
Sep 15 09:50:00.072042 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:00.071927    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n27kx\" (UniqueName: \"kubernetes.io/projected/f5202e88-6619-4158-b332-04e8ed44c4ca-kube-api-access-n27kx\") pod \"f5202e88-6619-4158-b332-04e8ed44c4ca\" (UID: \"f5202e88-6619-4158-b332-04e8ed44c4ca\") "
Sep 15 09:50:00.072163 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:00.072084    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92c84132-4ec6-486f-937b-97cc89a1f2bd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "92c84132-4ec6-486f-937b-97cc89a1f2bd" (UID: "92c84132-4ec6-486f-937b-97cc89a1f2bd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:50:00.072317 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:00.072297    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/92c84132-4ec6-486f-937b-97cc89a1f2bd-plugins-config-volume\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:50:00.072394 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:00.072305    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5202e88-6619-4158-b332-04e8ed44c4ca-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f5202e88-6619-4158-b332-04e8ed44c4ca" (UID: "f5202e88-6619-4158-b332-04e8ed44c4ca"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:50:00.073995 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:00.073965    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92c84132-4ec6-486f-937b-97cc89a1f2bd-kube-api-access-cgqh8" (OuterVolumeSpecName: "kube-api-access-cgqh8") pod "92c84132-4ec6-486f-937b-97cc89a1f2bd" (UID: "92c84132-4ec6-486f-937b-97cc89a1f2bd"). InnerVolumeSpecName "kube-api-access-cgqh8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:50:00.074111 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:00.074084    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5202e88-6619-4158-b332-04e8ed44c4ca-kube-api-access-n27kx" (OuterVolumeSpecName: "kube-api-access-n27kx") pod "f5202e88-6619-4158-b332-04e8ed44c4ca" (UID: "f5202e88-6619-4158-b332-04e8ed44c4ca"). InnerVolumeSpecName "kube-api-access-n27kx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:50:00.074111 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:00.074086    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5202e88-6619-4158-b332-04e8ed44c4ca-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f5202e88-6619-4158-b332-04e8ed44c4ca" (UID: "f5202e88-6619-4158-b332-04e8ed44c4ca"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:50:00.074215 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:00.074153    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5202e88-6619-4158-b332-04e8ed44c4ca-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f5202e88-6619-4158-b332-04e8ed44c4ca" (UID: "f5202e88-6619-4158-b332-04e8ed44c4ca"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:50:00.172842 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:00.172821    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5202e88-6619-4158-b332-04e8ed44c4ca-openshift-service-ca\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:50:00.172842 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:00.172840    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n27kx\" (UniqueName: \"kubernetes.io/projected/f5202e88-6619-4158-b332-04e8ed44c4ca-kube-api-access-n27kx\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:50:00.172988 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:00.172849    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5202e88-6619-4158-b332-04e8ed44c4ca-metrics-certs\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:50:00.172988 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:00.172859    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5202e88-6619-4158-b332-04e8ed44c4ca-maas-api-tls\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:50:00.172988 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:00.172872    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cgqh8\" (UniqueName: \"kubernetes.io/projected/92c84132-4ec6-486f-937b-97cc89a1f2bd-kube-api-access-cgqh8\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:50:00.698279 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:00.698249    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-864b9a-65c8744b9d-btmfr"
Sep 15 09:50:00.698646 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:00.698308    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-864b9a-65c8744b9d-btmfr" event={"ID":"f5202e88-6619-4158-b332-04e8ed44c4ca","Type":"ContainerDied","Data":"04e2356c311fa2e1ae6de5edeb62e71e8cb03ca2008feae3cf2bdb187fb7b8ba"}
Sep 15 09:50:00.698646 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:00.698368    2578 scope.go:117] "RemoveContainer" containerID="8261830723d255583c1b34671f6ad6041ac7e5de71c9843fc5808509c719eb7a"
Sep 15 09:50:00.699884 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:00.699786    2578 generic.go:356] "Generic (PLEG): container finished" podID="92c84132-4ec6-486f-937b-97cc89a1f2bd" containerID="677e806c0eb8ae97761366f22cb47842d0e9572d9f9a915e3b902016f15f7b80" exitCode=0
Sep 15 09:50:00.699884 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:00.699823    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-864b9a-567c79f95-lrm59"
Sep 15 09:50:00.699884 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:00.699850    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-864b9a-567c79f95-lrm59" event={"ID":"92c84132-4ec6-486f-937b-97cc89a1f2bd","Type":"ContainerDied","Data":"677e806c0eb8ae97761366f22cb47842d0e9572d9f9a915e3b902016f15f7b80"}
Sep 15 09:50:00.700363 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:00.699889    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-864b9a-567c79f95-lrm59" event={"ID":"92c84132-4ec6-486f-937b-97cc89a1f2bd","Type":"ContainerDied","Data":"7b3b4a902ab3ccca5d28d11478e2505278fa5bd14e62458d7328ea1347c8dfa3"}
Sep 15 09:50:00.707893 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:00.707868    2578 scope.go:117] "RemoveContainer" containerID="677e806c0eb8ae97761366f22cb47842d0e9572d9f9a915e3b902016f15f7b80"
Sep 15 09:50:00.716200 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:00.716170    2578 scope.go:117] "RemoveContainer" containerID="677e806c0eb8ae97761366f22cb47842d0e9572d9f9a915e3b902016f15f7b80"
Sep 15 09:50:00.716471 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:50:00.716450    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"677e806c0eb8ae97761366f22cb47842d0e9572d9f9a915e3b902016f15f7b80\": container with ID starting with 677e806c0eb8ae97761366f22cb47842d0e9572d9f9a915e3b902016f15f7b80 not found: ID does not exist" containerID="677e806c0eb8ae97761366f22cb47842d0e9572d9f9a915e3b902016f15f7b80"
Sep 15 09:50:00.716559 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:00.716476    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"677e806c0eb8ae97761366f22cb47842d0e9572d9f9a915e3b902016f15f7b80"} err="failed to get container status \"677e806c0eb8ae97761366f22cb47842d0e9572d9f9a915e3b902016f15f7b80\": rpc error: code = NotFound desc = could not find container \"677e806c0eb8ae97761366f22cb47842d0e9572d9f9a915e3b902016f15f7b80\": container with ID starting with 677e806c0eb8ae97761366f22cb47842d0e9572d9f9a915e3b902016f15f7b80 not found: ID does not exist"
Sep 15 09:50:00.718032 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:00.718011    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-864b9a-65c8744b9d-btmfr"]
Sep 15 09:50:00.720334 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:00.720315    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-864b9a-65c8744b9d-btmfr"]
Sep 15 09:50:00.734783 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:00.734753    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-864b9a-567c79f95-lrm59"]
Sep 15 09:50:00.743566 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:00.743544    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-864b9a-567c79f95-lrm59"]
Sep 15 09:50:02.121178 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:02.121145    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92c84132-4ec6-486f-937b-97cc89a1f2bd" path="/var/lib/kubelet/pods/92c84132-4ec6-486f-937b-97cc89a1f2bd/volumes"
Sep 15 09:50:02.121845 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:02.121821    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5202e88-6619-4158-b332-04e8ed44c4ca" path="/var/lib/kubelet/pods/f5202e88-6619-4158-b332-04e8ed44c4ca/volumes"
Sep 15 09:50:06.867627 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:06.867594    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-b283ee-l5vfs"]
Sep 15 09:50:06.868032 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:06.867965    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92c84132-4ec6-486f-937b-97cc89a1f2bd" containerName="payload-processing"
Sep 15 09:50:06.868032 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:06.867983    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="92c84132-4ec6-486f-937b-97cc89a1f2bd" containerName="payload-processing"
Sep 15 09:50:06.868032 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:06.867996    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e77a5d7e-8896-42bd-ada3-ec2532f7717a" containerName="istio-proxy"
Sep 15 09:50:06.868032 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:06.868001    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e77a5d7e-8896-42bd-ada3-ec2532f7717a" containerName="istio-proxy"
Sep 15 09:50:06.868032 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:06.868011    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5202e88-6619-4158-b332-04e8ed44c4ca" containerName="maas-api"
Sep 15 09:50:06.868032 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:06.868017    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5202e88-6619-4158-b332-04e8ed44c4ca" containerName="maas-api"
Sep 15 09:50:06.868032 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:06.868023    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d769dcd-3b8f-4974-9257-807f11fdcd1c" containerName="payload-pre-processing"
Sep 15 09:50:06.868032 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:06.868029    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d769dcd-3b8f-4974-9257-807f11fdcd1c" containerName="payload-pre-processing"
Sep 15 09:50:06.868338 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:06.868039    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6fcac4b-8c0d-423e-af56-ebc5a97540ba" containerName="payload-pre-processing"
Sep 15 09:50:06.868338 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:06.868048    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6fcac4b-8c0d-423e-af56-ebc5a97540ba" containerName="payload-pre-processing"
Sep 15 09:50:06.868338 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:06.868062    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8f1a9bb-45c3-42a5-82cf-1fdc9ba05591" containerName="payload-processing"
Sep 15 09:50:06.868338 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:06.868067    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8f1a9bb-45c3-42a5-82cf-1fdc9ba05591" containerName="payload-processing"
Sep 15 09:50:06.868338 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:06.868133    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="92c84132-4ec6-486f-937b-97cc89a1f2bd" containerName="payload-processing"
Sep 15 09:50:06.868338 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:06.868144    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5202e88-6619-4158-b332-04e8ed44c4ca" containerName="maas-api"
Sep 15 09:50:06.868338 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:06.868151    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e77a5d7e-8896-42bd-ada3-ec2532f7717a" containerName="istio-proxy"
Sep 15 09:50:06.868338 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:06.868157    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6fcac4b-8c0d-423e-af56-ebc5a97540ba" containerName="payload-pre-processing"
Sep 15 09:50:06.868338 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:06.868165    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8f1a9bb-45c3-42a5-82cf-1fdc9ba05591" containerName="payload-processing"
Sep 15 09:50:06.868338 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:06.868171    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e77a5d7e-8896-42bd-ada3-ec2532f7717a" containerName="istio-proxy"
Sep 15 09:50:06.868338 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:06.868176    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d769dcd-3b8f-4974-9257-807f11fdcd1c" containerName="payload-pre-processing"
Sep 15 09:50:06.872803 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:06.872783    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-b283ee-l5vfs"
Sep 15 09:50:06.875564 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:06.875538    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 09:50:06.875671 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:06.875571    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cbqnn\""
Sep 15 09:50:06.878066 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:06.878041    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-b283ee-l5vfs"]
Sep 15 09:50:06.928693 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:06.928667    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d3c284d-bb72-4800-a303-547ff29323e4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-b283ee-l5vfs\" (UID: \"0d3c284d-bb72-4800-a303-547ff29323e4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-b283ee-l5vfs"
Sep 15 09:50:07.029671 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:07.029641    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d3c284d-bb72-4800-a303-547ff29323e4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-b283ee-l5vfs\" (UID: \"0d3c284d-bb72-4800-a303-547ff29323e4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-b283ee-l5vfs"
Sep 15 09:50:07.030241 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:07.030223    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d3c284d-bb72-4800-a303-547ff29323e4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-b283ee-l5vfs\" (UID: \"0d3c284d-bb72-4800-a303-547ff29323e4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-b283ee-l5vfs"
Sep 15 09:50:07.184563 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:07.184512    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-b283ee-l5vfs"
Sep 15 09:50:07.456792 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:07.456761    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-b283ee-l5vfs"]
Sep 15 09:50:07.458149 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:50:07.458118    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d3c284d_bb72_4800_a303_547ff29323e4.slice/crio-2e66780fe2d44ed0721192e4c4ec81cfe9cfa64897fb058f44647abb7ec29292 WatchSource:0}: Error finding container 2e66780fe2d44ed0721192e4c4ec81cfe9cfa64897fb058f44647abb7ec29292: Status 404 returned error can't find the container with id 2e66780fe2d44ed0721192e4c4ec81cfe9cfa64897fb058f44647abb7ec29292
Sep 15 09:50:07.742410 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:07.742382    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-b283ee-l5vfs" event={"ID":"0d3c284d-bb72-4800-a303-547ff29323e4","Type":"ContainerStarted","Data":"20cc6e750bbc7444458d54cef750afe836205bdb7ea5625bf1571bef2d50c28b"}
Sep 15 09:50:07.742551 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:07.742434    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-b283ee-l5vfs" event={"ID":"0d3c284d-bb72-4800-a303-547ff29323e4","Type":"ContainerStarted","Data":"2e66780fe2d44ed0721192e4c4ec81cfe9cfa64897fb058f44647abb7ec29292"}
Sep 15 09:50:07.761286 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:07.761248    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-b283ee-l5vfs" podStartSLOduration=1.761233286 podStartE2EDuration="1.761233286s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:50:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:50:07.760058631 +0000 UTC m=+2152.098503906" watchObservedRunningTime="2026-09-15 09:50:07.761233286 +0000 UTC m=+2152.099678561"
Sep 15 09:50:08.748876 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:08.748797    2578 generic.go:356] "Generic (PLEG): container finished" podID="0d3c284d-bb72-4800-a303-547ff29323e4" containerID="20cc6e750bbc7444458d54cef750afe836205bdb7ea5625bf1571bef2d50c28b" exitCode=0
Sep 15 09:50:08.749260 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:08.748875    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-b283ee-l5vfs" event={"ID":"0d3c284d-bb72-4800-a303-547ff29323e4","Type":"ContainerDied","Data":"20cc6e750bbc7444458d54cef750afe836205bdb7ea5625bf1571bef2d50c28b"}
Sep 15 09:50:09.886916 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:09.886894    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-b283ee-l5vfs"
Sep 15 09:50:09.953760 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:09.953738    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d3c284d-bb72-4800-a303-547ff29323e4-maas-api-service-ca\") pod \"0d3c284d-bb72-4800-a303-547ff29323e4\" (UID: \"0d3c284d-bb72-4800-a303-547ff29323e4\") "
Sep 15 09:50:09.954134 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:09.954112    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d3c284d-bb72-4800-a303-547ff29323e4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0d3c284d-bb72-4800-a303-547ff29323e4" (UID: "0d3c284d-bb72-4800-a303-547ff29323e4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:50:10.054573 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:10.054514    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d3c284d-bb72-4800-a303-547ff29323e4-maas-api-service-ca\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:50:10.762149 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:10.762126    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-b283ee-l5vfs"
Sep 15 09:50:10.762276 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:10.762121    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-b283ee-l5vfs" event={"ID":"0d3c284d-bb72-4800-a303-547ff29323e4","Type":"ContainerDied","Data":"2e66780fe2d44ed0721192e4c4ec81cfe9cfa64897fb058f44647abb7ec29292"}
Sep 15 09:50:10.762276 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:10.762260    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2e66780fe2d44ed0721192e4c4ec81cfe9cfa64897fb058f44647abb7ec29292"
Sep 15 09:50:17.794435 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:17.794394    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-b283ee-l5vfs"]
Sep 15 09:50:17.797658 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:17.797632    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-b283ee-l5vfs"]
Sep 15 09:50:18.121738 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:18.121652    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d3c284d-bb72-4800-a303-547ff29323e4" path="/var/lib/kubelet/pods/0d3c284d-bb72-4800-a303-547ff29323e4/volumes"
Sep 15 09:50:24.343160 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:24.343127    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm"]
Sep 15 09:50:24.343548 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:24.343343    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm" podUID="124c68f3-c166-43b9-bfef-d5ba1b8fff7d" containerName="istio-proxy" containerID="cri-o://40cf8f931bb58bccfd8888d5555e49deb49744acb3271a6412919fc47c9fa337" gracePeriod=30
Sep 15 09:50:29.606611 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:29.606582    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm"
Sep 15 09:50:29.723837 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:29.723804    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/124c68f3-c166-43b9-bfef-d5ba1b8fff7d-istiod-ca-cert\") pod \"124c68f3-c166-43b9-bfef-d5ba1b8fff7d\" (UID: \"124c68f3-c166-43b9-bfef-d5ba1b8fff7d\") "
Sep 15 09:50:29.724040 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:29.723880    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/124c68f3-c166-43b9-bfef-d5ba1b8fff7d-istio-token\") pod \"124c68f3-c166-43b9-bfef-d5ba1b8fff7d\" (UID: \"124c68f3-c166-43b9-bfef-d5ba1b8fff7d\") "
Sep 15 09:50:29.724040 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:29.723921    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/124c68f3-c166-43b9-bfef-d5ba1b8fff7d-istio-envoy\") pod \"124c68f3-c166-43b9-bfef-d5ba1b8fff7d\" (UID: \"124c68f3-c166-43b9-bfef-d5ba1b8fff7d\") "
Sep 15 09:50:29.724040 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:29.723971    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/124c68f3-c166-43b9-bfef-d5ba1b8fff7d-credential-socket\") pod \"124c68f3-c166-43b9-bfef-d5ba1b8fff7d\" (UID: \"124c68f3-c166-43b9-bfef-d5ba1b8fff7d\") "
Sep 15 09:50:29.724040 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:29.724030    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/124c68f3-c166-43b9-bfef-d5ba1b8fff7d-workload-certs\") pod \"124c68f3-c166-43b9-bfef-d5ba1b8fff7d\" (UID: \"124c68f3-c166-43b9-bfef-d5ba1b8fff7d\") "
Sep 15 09:50:29.724274 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:29.724063    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/124c68f3-c166-43b9-bfef-d5ba1b8fff7d-istio-data\") pod \"124c68f3-c166-43b9-bfef-d5ba1b8fff7d\" (UID: \"124c68f3-c166-43b9-bfef-d5ba1b8fff7d\") "
Sep 15 09:50:29.724274 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:29.724108    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/124c68f3-c166-43b9-bfef-d5ba1b8fff7d-workload-socket\") pod \"124c68f3-c166-43b9-bfef-d5ba1b8fff7d\" (UID: \"124c68f3-c166-43b9-bfef-d5ba1b8fff7d\") "
Sep 15 09:50:29.724274 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:29.724151    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4cvgg\" (UniqueName: \"kubernetes.io/projected/124c68f3-c166-43b9-bfef-d5ba1b8fff7d-kube-api-access-4cvgg\") pod \"124c68f3-c166-43b9-bfef-d5ba1b8fff7d\" (UID: \"124c68f3-c166-43b9-bfef-d5ba1b8fff7d\") "
Sep 15 09:50:29.724274 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:29.724176    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/124c68f3-c166-43b9-bfef-d5ba1b8fff7d-istio-podinfo\") pod \"124c68f3-c166-43b9-bfef-d5ba1b8fff7d\" (UID: \"124c68f3-c166-43b9-bfef-d5ba1b8fff7d\") "
Sep 15 09:50:29.724477 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:29.724271    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/124c68f3-c166-43b9-bfef-d5ba1b8fff7d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "124c68f3-c166-43b9-bfef-d5ba1b8fff7d" (UID: "124c68f3-c166-43b9-bfef-d5ba1b8fff7d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:50:29.724477 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:29.724309    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/124c68f3-c166-43b9-bfef-d5ba1b8fff7d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "124c68f3-c166-43b9-bfef-d5ba1b8fff7d" (UID: "124c68f3-c166-43b9-bfef-d5ba1b8fff7d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:50:29.724586 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:29.724524    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/124c68f3-c166-43b9-bfef-d5ba1b8fff7d-istiod-ca-cert\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:50:29.724586 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:29.724546    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/124c68f3-c166-43b9-bfef-d5ba1b8fff7d-credential-socket\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:50:29.724710 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:29.724599    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/124c68f3-c166-43b9-bfef-d5ba1b8fff7d-istio-data" (OuterVolumeSpecName: "istio-data") pod "124c68f3-c166-43b9-bfef-d5ba1b8fff7d" (UID: "124c68f3-c166-43b9-bfef-d5ba1b8fff7d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:50:29.724710 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:29.724681    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/124c68f3-c166-43b9-bfef-d5ba1b8fff7d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "124c68f3-c166-43b9-bfef-d5ba1b8fff7d" (UID: "124c68f3-c166-43b9-bfef-d5ba1b8fff7d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:50:29.724817 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:29.724777    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/124c68f3-c166-43b9-bfef-d5ba1b8fff7d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "124c68f3-c166-43b9-bfef-d5ba1b8fff7d" (UID: "124c68f3-c166-43b9-bfef-d5ba1b8fff7d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:50:29.726343 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:29.726314    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/124c68f3-c166-43b9-bfef-d5ba1b8fff7d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "124c68f3-c166-43b9-bfef-d5ba1b8fff7d" (UID: "124c68f3-c166-43b9-bfef-d5ba1b8fff7d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:50:29.726450 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:29.726336    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/124c68f3-c166-43b9-bfef-d5ba1b8fff7d-kube-api-access-4cvgg" (OuterVolumeSpecName: "kube-api-access-4cvgg") pod "124c68f3-c166-43b9-bfef-d5ba1b8fff7d" (UID: "124c68f3-c166-43b9-bfef-d5ba1b8fff7d"). InnerVolumeSpecName "kube-api-access-4cvgg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:50:29.726450 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:29.726317    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/124c68f3-c166-43b9-bfef-d5ba1b8fff7d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "124c68f3-c166-43b9-bfef-d5ba1b8fff7d" (UID: "124c68f3-c166-43b9-bfef-d5ba1b8fff7d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 09:50:29.726547 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:29.726528    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/124c68f3-c166-43b9-bfef-d5ba1b8fff7d-istio-token" (OuterVolumeSpecName: "istio-token") pod "124c68f3-c166-43b9-bfef-d5ba1b8fff7d" (UID: "124c68f3-c166-43b9-bfef-d5ba1b8fff7d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:50:29.825219 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:29.825166    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/124c68f3-c166-43b9-bfef-d5ba1b8fff7d-istio-token\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:50:29.825219 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:29.825211    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/124c68f3-c166-43b9-bfef-d5ba1b8fff7d-istio-envoy\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:50:29.825219 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:29.825223    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/124c68f3-c166-43b9-bfef-d5ba1b8fff7d-workload-certs\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:50:29.825219 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:29.825233    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/124c68f3-c166-43b9-bfef-d5ba1b8fff7d-istio-data\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:50:29.825503 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:29.825243    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/124c68f3-c166-43b9-bfef-d5ba1b8fff7d-workload-socket\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:50:29.825503 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:29.825256    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4cvgg\" (UniqueName: \"kubernetes.io/projected/124c68f3-c166-43b9-bfef-d5ba1b8fff7d-kube-api-access-4cvgg\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:50:29.825503 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:29.825268    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/124c68f3-c166-43b9-bfef-d5ba1b8fff7d-istio-podinfo\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:50:29.876300 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:29.876263    2578 generic.go:356] "Generic (PLEG): container finished" podID="124c68f3-c166-43b9-bfef-d5ba1b8fff7d" containerID="40cf8f931bb58bccfd8888d5555e49deb49744acb3271a6412919fc47c9fa337" exitCode=0
Sep 15 09:50:29.876300 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:29.876302    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm"
Sep 15 09:50:29.876524 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:29.876342    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm" event={"ID":"124c68f3-c166-43b9-bfef-d5ba1b8fff7d","Type":"ContainerDied","Data":"40cf8f931bb58bccfd8888d5555e49deb49744acb3271a6412919fc47c9fa337"}
Sep 15 09:50:29.876524 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:29.876415    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm" event={"ID":"124c68f3-c166-43b9-bfef-d5ba1b8fff7d","Type":"ContainerDied","Data":"df7118eba7508435b638b9cb47248a3441ffba45ce0f2ac3f1d4b8adfdb2a85d"}
Sep 15 09:50:29.876524 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:29.876440    2578 scope.go:117] "RemoveContainer" containerID="40cf8f931bb58bccfd8888d5555e49deb49744acb3271a6412919fc47c9fa337"
Sep 15 09:50:29.886578 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:29.886559    2578 scope.go:117] "RemoveContainer" containerID="0c24c350bba0c7e4cba790dca09f641d00c31f27cfba01f9f8929356da7f284d"
Sep 15 09:50:29.894936 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:29.894891    2578 scope.go:117] "RemoveContainer" containerID="40cf8f931bb58bccfd8888d5555e49deb49744acb3271a6412919fc47c9fa337"
Sep 15 09:50:29.895229 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:50:29.895169    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40cf8f931bb58bccfd8888d5555e49deb49744acb3271a6412919fc47c9fa337\": container with ID starting with 40cf8f931bb58bccfd8888d5555e49deb49744acb3271a6412919fc47c9fa337 not found: ID does not exist" containerID="40cf8f931bb58bccfd8888d5555e49deb49744acb3271a6412919fc47c9fa337"
Sep 15 09:50:29.895229 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:29.895199    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40cf8f931bb58bccfd8888d5555e49deb49744acb3271a6412919fc47c9fa337"} err="failed to get container status \"40cf8f931bb58bccfd8888d5555e49deb49744acb3271a6412919fc47c9fa337\": rpc error: code = NotFound desc = could not find container \"40cf8f931bb58bccfd8888d5555e49deb49744acb3271a6412919fc47c9fa337\": container with ID starting with 40cf8f931bb58bccfd8888d5555e49deb49744acb3271a6412919fc47c9fa337 not found: ID does not exist"
Sep 15 09:50:29.895229 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:29.895215    2578 scope.go:117] "RemoveContainer" containerID="0c24c350bba0c7e4cba790dca09f641d00c31f27cfba01f9f8929356da7f284d"
Sep 15 09:50:29.895540 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:50:29.895459    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c24c350bba0c7e4cba790dca09f641d00c31f27cfba01f9f8929356da7f284d\": container with ID starting with 0c24c350bba0c7e4cba790dca09f641d00c31f27cfba01f9f8929356da7f284d not found: ID does not exist" containerID="0c24c350bba0c7e4cba790dca09f641d00c31f27cfba01f9f8929356da7f284d"
Sep 15 09:50:29.895540 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:29.895484    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c24c350bba0c7e4cba790dca09f641d00c31f27cfba01f9f8929356da7f284d"} err="failed to get container status \"0c24c350bba0c7e4cba790dca09f641d00c31f27cfba01f9f8929356da7f284d\": rpc error: code = NotFound desc = could not find container \"0c24c350bba0c7e4cba790dca09f641d00c31f27cfba01f9f8929356da7f284d\": container with ID starting with 0c24c350bba0c7e4cba790dca09f641d00c31f27cfba01f9f8929356da7f284d not found: ID does not exist"
Sep 15 09:50:29.898442 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:29.898420    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm"]
Sep 15 09:50:29.902546 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:29.902524    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-b283ee-openshift-default-7d76f5f87b-5zlpm"]
Sep 15 09:50:30.124139 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:50:30.124041    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="124c68f3-c166-43b9-bfef-d5ba1b8fff7d" path="/var/lib/kubelet/pods/124c68f3-c166-43b9-bfef-d5ba1b8fff7d/volumes"
Sep 15 09:55:57.950173 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:55:57.950134    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-68fc5fb999-kktkq"]
Sep 15 09:55:57.950707 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:55:57.950657    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e77a5d7e-8896-42bd-ada3-ec2532f7717a" containerName="istio-proxy"
Sep 15 09:55:57.950707 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:55:57.950678    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e77a5d7e-8896-42bd-ada3-ec2532f7717a" containerName="istio-proxy"
Sep 15 09:55:57.950707 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:55:57.950692    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d3c284d-bb72-4800-a303-547ff29323e4" containerName="revoke-keys"
Sep 15 09:55:57.950707 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:55:57.950700    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d3c284d-bb72-4800-a303-547ff29323e4" containerName="revoke-keys"
Sep 15 09:55:57.950934 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:55:57.950720    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="124c68f3-c166-43b9-bfef-d5ba1b8fff7d" containerName="istio-proxy"
Sep 15 09:55:57.950934 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:55:57.950729    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="124c68f3-c166-43b9-bfef-d5ba1b8fff7d" containerName="istio-proxy"
Sep 15 09:55:57.950934 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:55:57.950749    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="124c68f3-c166-43b9-bfef-d5ba1b8fff7d" containerName="istio-proxy"
Sep 15 09:55:57.950934 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:55:57.950757    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="124c68f3-c166-43b9-bfef-d5ba1b8fff7d" containerName="istio-proxy"
Sep 15 09:55:57.950934 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:55:57.950846    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d3c284d-bb72-4800-a303-547ff29323e4" containerName="revoke-keys"
Sep 15 09:55:57.950934 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:55:57.950858    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="124c68f3-c166-43b9-bfef-d5ba1b8fff7d" containerName="istio-proxy"
Sep 15 09:55:57.953836 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:55:57.953811    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-68fc5fb999-kktkq"
Sep 15 09:55:57.957485 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:55:57.957460    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 15 09:55:57.957596 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:55:57.957460    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-hb4ml\""
Sep 15 09:55:57.957596 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:55:57.957502    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 15 09:55:57.957596 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:55:57.957507    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 15 09:55:57.957596 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:55:57.957507    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 09:55:57.973254 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:55:57.973230    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-68fc5fb999-kktkq"]
Sep 15 09:55:57.978795 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:55:57.978773    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c2c16bc-16c9-47a3-8668-f8972f6dc7f9-maas-api-tls\") pod \"maas-api-68fc5fb999-kktkq\" (UID: \"8c2c16bc-16c9-47a3-8668-f8972f6dc7f9\") " pod="odh-ai-gateway-infra/maas-api-68fc5fb999-kktkq"
Sep 15 09:55:57.978931 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:55:57.978807    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjnqn\" (UniqueName: \"kubernetes.io/projected/8c2c16bc-16c9-47a3-8668-f8972f6dc7f9-kube-api-access-zjnqn\") pod \"maas-api-68fc5fb999-kktkq\" (UID: \"8c2c16bc-16c9-47a3-8668-f8972f6dc7f9\") " pod="odh-ai-gateway-infra/maas-api-68fc5fb999-kktkq"
Sep 15 09:55:57.978931 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:55:57.978841    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c2c16bc-16c9-47a3-8668-f8972f6dc7f9-openshift-service-ca\") pod \"maas-api-68fc5fb999-kktkq\" (UID: \"8c2c16bc-16c9-47a3-8668-f8972f6dc7f9\") " pod="odh-ai-gateway-infra/maas-api-68fc5fb999-kktkq"
Sep 15 09:55:57.978931 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:55:57.978890    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c2c16bc-16c9-47a3-8668-f8972f6dc7f9-metrics-certs\") pod \"maas-api-68fc5fb999-kktkq\" (UID: \"8c2c16bc-16c9-47a3-8668-f8972f6dc7f9\") " pod="odh-ai-gateway-infra/maas-api-68fc5fb999-kktkq"
Sep 15 09:55:58.079273 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:55:58.079253    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c2c16bc-16c9-47a3-8668-f8972f6dc7f9-openshift-service-ca\") pod \"maas-api-68fc5fb999-kktkq\" (UID: \"8c2c16bc-16c9-47a3-8668-f8972f6dc7f9\") " pod="odh-ai-gateway-infra/maas-api-68fc5fb999-kktkq"
Sep 15 09:55:58.079390 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:55:58.079282    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c2c16bc-16c9-47a3-8668-f8972f6dc7f9-metrics-certs\") pod \"maas-api-68fc5fb999-kktkq\" (UID: \"8c2c16bc-16c9-47a3-8668-f8972f6dc7f9\") " pod="odh-ai-gateway-infra/maas-api-68fc5fb999-kktkq"
Sep 15 09:55:58.079390 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:55:58.079340    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c2c16bc-16c9-47a3-8668-f8972f6dc7f9-maas-api-tls\") pod \"maas-api-68fc5fb999-kktkq\" (UID: \"8c2c16bc-16c9-47a3-8668-f8972f6dc7f9\") " pod="odh-ai-gateway-infra/maas-api-68fc5fb999-kktkq"
Sep 15 09:55:58.079390 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:55:58.079359    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjnqn\" (UniqueName: \"kubernetes.io/projected/8c2c16bc-16c9-47a3-8668-f8972f6dc7f9-kube-api-access-zjnqn\") pod \"maas-api-68fc5fb999-kktkq\" (UID: \"8c2c16bc-16c9-47a3-8668-f8972f6dc7f9\") " pod="odh-ai-gateway-infra/maas-api-68fc5fb999-kktkq"
Sep 15 09:55:58.079902 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:55:58.079882    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c2c16bc-16c9-47a3-8668-f8972f6dc7f9-openshift-service-ca\") pod \"maas-api-68fc5fb999-kktkq\" (UID: \"8c2c16bc-16c9-47a3-8668-f8972f6dc7f9\") " pod="odh-ai-gateway-infra/maas-api-68fc5fb999-kktkq"
Sep 15 09:55:58.081746 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:55:58.081718    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c2c16bc-16c9-47a3-8668-f8972f6dc7f9-maas-api-tls\") pod \"maas-api-68fc5fb999-kktkq\" (UID: \"8c2c16bc-16c9-47a3-8668-f8972f6dc7f9\") " pod="odh-ai-gateway-infra/maas-api-68fc5fb999-kktkq"
Sep 15 09:55:58.081833 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:55:58.081759    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c2c16bc-16c9-47a3-8668-f8972f6dc7f9-metrics-certs\") pod \"maas-api-68fc5fb999-kktkq\" (UID: \"8c2c16bc-16c9-47a3-8668-f8972f6dc7f9\") " pod="odh-ai-gateway-infra/maas-api-68fc5fb999-kktkq"
Sep 15 09:55:58.087032 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:55:58.087007    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjnqn\" (UniqueName: \"kubernetes.io/projected/8c2c16bc-16c9-47a3-8668-f8972f6dc7f9-kube-api-access-zjnqn\") pod \"maas-api-68fc5fb999-kktkq\" (UID: \"8c2c16bc-16c9-47a3-8668-f8972f6dc7f9\") " pod="odh-ai-gateway-infra/maas-api-68fc5fb999-kktkq"
Sep 15 09:55:58.263664 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:55:58.263643    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-68fc5fb999-kktkq"
Sep 15 09:55:58.534713 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:55:58.534689    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-68fc5fb999-kktkq"]
Sep 15 09:55:58.537210 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:55:58.537182    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c2c16bc_16c9_47a3_8668_f8972f6dc7f9.slice/crio-0f39fc0fc8381f30f29306324df7924c9644e215a239e7a80af3e26ac140ed26 WatchSource:0}: Error finding container 0f39fc0fc8381f30f29306324df7924c9644e215a239e7a80af3e26ac140ed26: Status 404 returned error can't find the container with id 0f39fc0fc8381f30f29306324df7924c9644e215a239e7a80af3e26ac140ed26
Sep 15 09:55:58.538617 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:55:58.538597    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 09:55:58.661674 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:55:58.661650    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-68fc5fb999-kktkq" event={"ID":"8c2c16bc-16c9-47a3-8668-f8972f6dc7f9","Type":"ContainerStarted","Data":"0f39fc0fc8381f30f29306324df7924c9644e215a239e7a80af3e26ac140ed26"}
Sep 15 09:55:59.671805 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:55:59.671757    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-68fc5fb999-kktkq" event={"ID":"8c2c16bc-16c9-47a3-8668-f8972f6dc7f9","Type":"ContainerStarted","Data":"88a2deff3cdab370209a1856370cf51799899758be35e8860ae5e8918489b15b"}
Sep 15 09:55:59.672274 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:55:59.671970    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-68fc5fb999-kktkq"
Sep 15 09:55:59.697445 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:55:59.697402    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-68fc5fb999-kktkq" podStartSLOduration=2.270926085 podStartE2EDuration="2.697390342s" totalImagesPullingTime="426.464257ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:55:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:55:59.696960956 +0000 UTC m=+2504.035406224" watchObservedRunningTime="2026-09-15 09:55:59.697390342 +0000 UTC m=+2504.035835665"
Sep 15 09:56:05.683272 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:05.683234    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-68fc5fb999-kktkq"
Sep 15 09:56:06.121751 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:06.121720    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-c4664ccd7-mm2t8"]
Sep 15 09:56:06.122098 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:06.122086    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="124c68f3-c166-43b9-bfef-d5ba1b8fff7d" containerName="istio-proxy"
Sep 15 09:56:06.125286 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:06.125270    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-c4664ccd7-mm2t8"
Sep 15 09:56:06.137584 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:06.137560    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-c4664ccd7-mm2t8"]
Sep 15 09:56:06.138454 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:06.138431    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c40234f-838e-4804-8db5-9362b4715417-openshift-service-ca\") pod \"maas-api-c4664ccd7-mm2t8\" (UID: \"2c40234f-838e-4804-8db5-9362b4715417\") " pod="odh-ai-gateway-infra/maas-api-c4664ccd7-mm2t8"
Sep 15 09:56:06.138563 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:06.138504    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c40234f-838e-4804-8db5-9362b4715417-metrics-certs\") pod \"maas-api-c4664ccd7-mm2t8\" (UID: \"2c40234f-838e-4804-8db5-9362b4715417\") " pod="odh-ai-gateway-infra/maas-api-c4664ccd7-mm2t8"
Sep 15 09:56:06.138629 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:06.138575    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c40234f-838e-4804-8db5-9362b4715417-maas-api-tls\") pod \"maas-api-c4664ccd7-mm2t8\" (UID: \"2c40234f-838e-4804-8db5-9362b4715417\") " pod="odh-ai-gateway-infra/maas-api-c4664ccd7-mm2t8"
Sep 15 09:56:06.138629 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:06.138614    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8klbp\" (UniqueName: \"kubernetes.io/projected/2c40234f-838e-4804-8db5-9362b4715417-kube-api-access-8klbp\") pod \"maas-api-c4664ccd7-mm2t8\" (UID: \"2c40234f-838e-4804-8db5-9362b4715417\") " pod="odh-ai-gateway-infra/maas-api-c4664ccd7-mm2t8"
Sep 15 09:56:06.240172 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:06.239887    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c40234f-838e-4804-8db5-9362b4715417-openshift-service-ca\") pod \"maas-api-c4664ccd7-mm2t8\" (UID: \"2c40234f-838e-4804-8db5-9362b4715417\") " pod="odh-ai-gateway-infra/maas-api-c4664ccd7-mm2t8"
Sep 15 09:56:06.240172 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:06.239985    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c40234f-838e-4804-8db5-9362b4715417-metrics-certs\") pod \"maas-api-c4664ccd7-mm2t8\" (UID: \"2c40234f-838e-4804-8db5-9362b4715417\") " pod="odh-ai-gateway-infra/maas-api-c4664ccd7-mm2t8"
Sep 15 09:56:06.240172 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:06.240041    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c40234f-838e-4804-8db5-9362b4715417-maas-api-tls\") pod \"maas-api-c4664ccd7-mm2t8\" (UID: \"2c40234f-838e-4804-8db5-9362b4715417\") " pod="odh-ai-gateway-infra/maas-api-c4664ccd7-mm2t8"
Sep 15 09:56:06.240172 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:06.240068    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8klbp\" (UniqueName: \"kubernetes.io/projected/2c40234f-838e-4804-8db5-9362b4715417-kube-api-access-8klbp\") pod \"maas-api-c4664ccd7-mm2t8\" (UID: \"2c40234f-838e-4804-8db5-9362b4715417\") " pod="odh-ai-gateway-infra/maas-api-c4664ccd7-mm2t8"
Sep 15 09:56:06.240762 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:06.240724    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c40234f-838e-4804-8db5-9362b4715417-openshift-service-ca\") pod \"maas-api-c4664ccd7-mm2t8\" (UID: \"2c40234f-838e-4804-8db5-9362b4715417\") " pod="odh-ai-gateway-infra/maas-api-c4664ccd7-mm2t8"
Sep 15 09:56:06.242875 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:06.242854    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c40234f-838e-4804-8db5-9362b4715417-metrics-certs\") pod \"maas-api-c4664ccd7-mm2t8\" (UID: \"2c40234f-838e-4804-8db5-9362b4715417\") " pod="odh-ai-gateway-infra/maas-api-c4664ccd7-mm2t8"
Sep 15 09:56:06.243019 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:06.242994    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c40234f-838e-4804-8db5-9362b4715417-maas-api-tls\") pod \"maas-api-c4664ccd7-mm2t8\" (UID: \"2c40234f-838e-4804-8db5-9362b4715417\") " pod="odh-ai-gateway-infra/maas-api-c4664ccd7-mm2t8"
Sep 15 09:56:06.247830 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:06.247812    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8klbp\" (UniqueName: \"kubernetes.io/projected/2c40234f-838e-4804-8db5-9362b4715417-kube-api-access-8klbp\") pod \"maas-api-c4664ccd7-mm2t8\" (UID: \"2c40234f-838e-4804-8db5-9362b4715417\") " pod="odh-ai-gateway-infra/maas-api-c4664ccd7-mm2t8"
Sep 15 09:56:06.437835 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:06.437753    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-c4664ccd7-mm2t8"
Sep 15 09:56:06.711526 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:06.711496    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-c4664ccd7-mm2t8"]
Sep 15 09:56:06.713024 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:56:06.712996    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c40234f_838e_4804_8db5_9362b4715417.slice/crio-34f70871db31be2a5754fc346e0cfa8e2e09bc99472fc08dd7f03464253f160f WatchSource:0}: Error finding container 34f70871db31be2a5754fc346e0cfa8e2e09bc99472fc08dd7f03464253f160f: Status 404 returned error can't find the container with id 34f70871db31be2a5754fc346e0cfa8e2e09bc99472fc08dd7f03464253f160f
Sep 15 09:56:07.719286 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:07.719252    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-c4664ccd7-mm2t8" event={"ID":"2c40234f-838e-4804-8db5-9362b4715417","Type":"ContainerStarted","Data":"40c857846257b447ec94e6784c63ad30e116d7a287e9cafcf404d78c8945a4b0"}
Sep 15 09:56:07.719737 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:07.719309    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-c4664ccd7-mm2t8" event={"ID":"2c40234f-838e-4804-8db5-9362b4715417","Type":"ContainerStarted","Data":"34f70871db31be2a5754fc346e0cfa8e2e09bc99472fc08dd7f03464253f160f"}
Sep 15 09:56:07.719737 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:07.719356    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-c4664ccd7-mm2t8"
Sep 15 09:56:07.739355 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:07.739314    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-c4664ccd7-mm2t8" podStartSLOduration=1.410979037 podStartE2EDuration="1.739301267s" totalImagesPullingTime="328.32223ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:56:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:56:07.737979348 +0000 UTC m=+2512.076424625" watchObservedRunningTime="2026-09-15 09:56:07.739301267 +0000 UTC m=+2512.077746543"
Sep 15 09:56:13.730081 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:13.730004    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-c4664ccd7-mm2t8"
Sep 15 09:56:13.779451 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:13.779417    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-68fc5fb999-kktkq"]
Sep 15 09:56:13.779667 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:13.779644    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-68fc5fb999-kktkq" podUID="8c2c16bc-16c9-47a3-8668-f8972f6dc7f9" containerName="maas-api" containerID="cri-o://88a2deff3cdab370209a1856370cf51799899758be35e8860ae5e8918489b15b" gracePeriod=30
Sep 15 09:56:14.019326 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:14.019300    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-68fc5fb999-kktkq"
Sep 15 09:56:14.101582 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:14.101556    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c2c16bc-16c9-47a3-8668-f8972f6dc7f9-metrics-certs\") pod \"8c2c16bc-16c9-47a3-8668-f8972f6dc7f9\" (UID: \"8c2c16bc-16c9-47a3-8668-f8972f6dc7f9\") "
Sep 15 09:56:14.101697 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:14.101599    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zjnqn\" (UniqueName: \"kubernetes.io/projected/8c2c16bc-16c9-47a3-8668-f8972f6dc7f9-kube-api-access-zjnqn\") pod \"8c2c16bc-16c9-47a3-8668-f8972f6dc7f9\" (UID: \"8c2c16bc-16c9-47a3-8668-f8972f6dc7f9\") "
Sep 15 09:56:14.101697 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:14.101623    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c2c16bc-16c9-47a3-8668-f8972f6dc7f9-openshift-service-ca\") pod \"8c2c16bc-16c9-47a3-8668-f8972f6dc7f9\" (UID: \"8c2c16bc-16c9-47a3-8668-f8972f6dc7f9\") "
Sep 15 09:56:14.101697 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:14.101666    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c2c16bc-16c9-47a3-8668-f8972f6dc7f9-maas-api-tls\") pod \"8c2c16bc-16c9-47a3-8668-f8972f6dc7f9\" (UID: \"8c2c16bc-16c9-47a3-8668-f8972f6dc7f9\") "
Sep 15 09:56:14.102013 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:14.101991    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c2c16bc-16c9-47a3-8668-f8972f6dc7f9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8c2c16bc-16c9-47a3-8668-f8972f6dc7f9" (UID: "8c2c16bc-16c9-47a3-8668-f8972f6dc7f9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:56:14.103666 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:14.103637    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c2c16bc-16c9-47a3-8668-f8972f6dc7f9-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8c2c16bc-16c9-47a3-8668-f8972f6dc7f9" (UID: "8c2c16bc-16c9-47a3-8668-f8972f6dc7f9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:56:14.103738 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:14.103677    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c2c16bc-16c9-47a3-8668-f8972f6dc7f9-kube-api-access-zjnqn" (OuterVolumeSpecName: "kube-api-access-zjnqn") pod "8c2c16bc-16c9-47a3-8668-f8972f6dc7f9" (UID: "8c2c16bc-16c9-47a3-8668-f8972f6dc7f9"). InnerVolumeSpecName "kube-api-access-zjnqn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:56:14.103738 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:14.103725    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c2c16bc-16c9-47a3-8668-f8972f6dc7f9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8c2c16bc-16c9-47a3-8668-f8972f6dc7f9" (UID: "8c2c16bc-16c9-47a3-8668-f8972f6dc7f9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:56:14.202330 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:14.202303    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c2c16bc-16c9-47a3-8668-f8972f6dc7f9-metrics-certs\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:56:14.202330 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:14.202326    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zjnqn\" (UniqueName: \"kubernetes.io/projected/8c2c16bc-16c9-47a3-8668-f8972f6dc7f9-kube-api-access-zjnqn\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:56:14.202471 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:14.202340    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c2c16bc-16c9-47a3-8668-f8972f6dc7f9-openshift-service-ca\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:56:14.202471 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:14.202354    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c2c16bc-16c9-47a3-8668-f8972f6dc7f9-maas-api-tls\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Sep 15 09:56:14.759426 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:14.759395    2578 generic.go:356] "Generic (PLEG): container finished" podID="8c2c16bc-16c9-47a3-8668-f8972f6dc7f9" containerID="88a2deff3cdab370209a1856370cf51799899758be35e8860ae5e8918489b15b" exitCode=0
Sep 15 09:56:14.759815 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:14.759438    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-68fc5fb999-kktkq"
Sep 15 09:56:14.759815 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:14.759442    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-68fc5fb999-kktkq" event={"ID":"8c2c16bc-16c9-47a3-8668-f8972f6dc7f9","Type":"ContainerDied","Data":"88a2deff3cdab370209a1856370cf51799899758be35e8860ae5e8918489b15b"}
Sep 15 09:56:14.759815 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:14.759497    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-68fc5fb999-kktkq" event={"ID":"8c2c16bc-16c9-47a3-8668-f8972f6dc7f9","Type":"ContainerDied","Data":"0f39fc0fc8381f30f29306324df7924c9644e215a239e7a80af3e26ac140ed26"}
Sep 15 09:56:14.759815 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:14.759519    2578 scope.go:117] "RemoveContainer" containerID="88a2deff3cdab370209a1856370cf51799899758be35e8860ae5e8918489b15b"
Sep 15 09:56:14.768650 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:14.768633    2578 scope.go:117] "RemoveContainer" containerID="88a2deff3cdab370209a1856370cf51799899758be35e8860ae5e8918489b15b"
Sep 15 09:56:14.768919 ip-10-0-141-235 kubenswrapper[2578]: E0915 09:56:14.768896    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88a2deff3cdab370209a1856370cf51799899758be35e8860ae5e8918489b15b\": container with ID starting with 88a2deff3cdab370209a1856370cf51799899758be35e8860ae5e8918489b15b not found: ID does not exist" containerID="88a2deff3cdab370209a1856370cf51799899758be35e8860ae5e8918489b15b"
Sep 15 09:56:14.769035 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:14.768920    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88a2deff3cdab370209a1856370cf51799899758be35e8860ae5e8918489b15b"} err="failed to get container status \"88a2deff3cdab370209a1856370cf51799899758be35e8860ae5e8918489b15b\": rpc error: code = NotFound desc = could not find container \"88a2deff3cdab370209a1856370cf51799899758be35e8860ae5e8918489b15b\": container with ID starting with 88a2deff3cdab370209a1856370cf51799899758be35e8860ae5e8918489b15b not found: ID does not exist"
Sep 15 09:56:14.778014 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:14.777989    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-68fc5fb999-kktkq"]
Sep 15 09:56:14.781097 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:14.781076    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-68fc5fb999-kktkq"]
Sep 15 09:56:16.122552 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:16.122512    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c2c16bc-16c9-47a3-8668-f8972f6dc7f9" path="/var/lib/kubelet/pods/8c2c16bc-16c9-47a3-8668-f8972f6dc7f9/volumes"
Sep 15 09:56:16.715735 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:16.715695    2578 scope.go:117] "RemoveContainer" containerID="20cc6e750bbc7444458d54cef750afe836205bdb7ea5625bf1571bef2d50c28b"
Sep 15 09:56:36.580619 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:36.580589    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-qlv9b_e0a9edc3-3b09-43d0-a303-b989fa3d4656/server/0.log"
Sep 15 09:56:36.697894 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:36.697858    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-t4dnj_d3d9b371-4a0b-4729-8f9e-eddf8e262286/manager/0.log"
Sep 15 09:56:36.814883 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:36.814858    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-767c4c8b76-jmwcb_ced6aa23-9676-4cc4-a15a-1d18d5aeedf1/copy-manifests/0.log"
Sep 15 09:56:36.821269 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:36.821242    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-767c4c8b76-jmwcb_ced6aa23-9676-4cc4-a15a-1d18d5aeedf1/manager/0.log"
Sep 15 09:56:37.536015 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:37.535987    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-c4664ccd7-mm2t8_2c40234f-838e-4804-8db5-9362b4715417/maas-api/0.log"
Sep 15 09:56:37.656007 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:37.655977    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29824410-n6qss_46d8501f-6414-451e-9abe-a2f0d62e3a09/cleanup/0.log"
Sep 15 09:56:37.767103 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:37.767077    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29824425-b8dvc_707de139-aac2-494d-b72d-f7b4192a4308/cleanup/0.log"
Sep 15 09:56:39.720740 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:39.720705    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799c795f6_5d1fbe79-bd03-4730-8b84-2b8e7bb949fc/istio-proxy/0.log"
Sep 15 09:56:39.837520 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:39.837495    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-rfsfx_7d25c4bb-e3cb-4a38-a42c-242dc96a724e/discovery/0.log"
Sep 15 09:56:40.192785 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:40.192721    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-648hw_32fe6fe4-c078-4a0e-82dc-47182c507813/istio-proxy/1.log"
Sep 15 09:56:40.989229 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:40.989202    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-jc92s_aa70fdfc-2414-4b44-b057-9bda2c7bb1fa/main/0.log"
Sep 15 09:56:41.340132 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:41.340058    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ff7sdk_8e5f457f-493f-468d-bb2e-fb24ca2c02b4/main/0.log"
Sep 15 09:56:50.145673 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:50.145640    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hqkrc_4d4126b6-996d-46d2-8abe-9fb14423f0ac/global-pull-secret-syncer/0.log"
Sep 15 09:56:50.330687 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:50.330661    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-nhzm4_552c9685-d39f-40b0-8f8d-79ba6b12fee7/konnectivity-agent/0.log"
Sep 15 09:56:50.398671 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:50.398615    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-235.ec2.internal_2b3d6833f74b07abf73dd136dadede80/haproxy/0.log"
Sep 15 09:56:56.384351 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:56.384317    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_878b5bc4-e521-4ed1-a955-ccc71231091c/alertmanager/0.log"
Sep 15 09:56:56.409334 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:56.409308    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_878b5bc4-e521-4ed1-a955-ccc71231091c/config-reloader/0.log"
Sep 15 09:56:56.431124 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:56.431103    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_878b5bc4-e521-4ed1-a955-ccc71231091c/kube-rbac-proxy-web/0.log"
Sep 15 09:56:56.458385 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:56.458336    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_878b5bc4-e521-4ed1-a955-ccc71231091c/kube-rbac-proxy/0.log"
Sep 15 09:56:56.481633 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:56.481616    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_878b5bc4-e521-4ed1-a955-ccc71231091c/kube-rbac-proxy-metric/0.log"
Sep 15 09:56:56.507127 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:56.507106    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_878b5bc4-e521-4ed1-a955-ccc71231091c/prom-label-proxy/0.log"
Sep 15 09:56:56.530937 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:56.530917    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_878b5bc4-e521-4ed1-a955-ccc71231091c/init-config-reloader/0.log"
Sep 15 09:56:56.713606 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:56.713583    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-pjbp5_92994fee-bac9-48c3-8df6-573abbdea0af/monitoring-plugin/0.log"
Sep 15 09:56:56.933862 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:56.933835    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r6hz5_055c959d-7967-47ee-a400-1ae39bf5d1ae/node-exporter/0.log"
Sep 15 09:56:56.958351 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:56.958327    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r6hz5_055c959d-7967-47ee-a400-1ae39bf5d1ae/kube-rbac-proxy/0.log"
Sep 15 09:56:56.982116 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:56.982059    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r6hz5_055c959d-7967-47ee-a400-1ae39bf5d1ae/init-textfile/0.log"
Sep 15 09:56:57.501284 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:57.501254    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-76f96fd4cf-8h5p5_0904cc42-29a0-415d-a910-dc6de8788b86/telemeter-client/0.log"
Sep 15 09:56:57.539192 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:57.539170    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-76f96fd4cf-8h5p5_0904cc42-29a0-415d-a910-dc6de8788b86/reload/0.log"
Sep 15 09:56:57.569694 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:56:57.569669    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-76f96fd4cf-8h5p5_0904cc42-29a0-415d-a910-dc6de8788b86/kube-rbac-proxy/0.log"
Sep 15 09:57:00.587837 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:00.587802    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tznnh/perf-node-gather-daemonset-bs8w4"]
Sep 15 09:57:00.588263 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:00.588236    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c2c16bc-16c9-47a3-8668-f8972f6dc7f9" containerName="maas-api"
Sep 15 09:57:00.588263 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:00.588251    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c2c16bc-16c9-47a3-8668-f8972f6dc7f9" containerName="maas-api"
Sep 15 09:57:00.588336 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:00.588312    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c2c16bc-16c9-47a3-8668-f8972f6dc7f9" containerName="maas-api"
Sep 15 09:57:00.591291 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:00.591268    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tznnh/perf-node-gather-daemonset-bs8w4"
Sep 15 09:57:00.594430 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:00.594411    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tznnh\"/\"default-dockercfg-7ll79\""
Sep 15 09:57:00.594540 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:00.594411    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tznnh\"/\"openshift-service-ca.crt\""
Sep 15 09:57:00.596065 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:00.596045    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tznnh\"/\"kube-root-ca.crt\""
Sep 15 09:57:00.600817 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:00.600790    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tznnh/perf-node-gather-daemonset-bs8w4"]
Sep 15 09:57:00.678095 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:00.678070    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3f0ea4dd-69a1-461b-8577-04147f2f249c-podres\") pod \"perf-node-gather-daemonset-bs8w4\" (UID: \"3f0ea4dd-69a1-461b-8577-04147f2f249c\") " pod="openshift-must-gather-tznnh/perf-node-gather-daemonset-bs8w4"
Sep 15 09:57:00.678191 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:00.678106    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3f0ea4dd-69a1-461b-8577-04147f2f249c-sys\") pod \"perf-node-gather-daemonset-bs8w4\" (UID: \"3f0ea4dd-69a1-461b-8577-04147f2f249c\") " pod="openshift-must-gather-tznnh/perf-node-gather-daemonset-bs8w4"
Sep 15 09:57:00.678191 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:00.678141    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2bgw\" (UniqueName: \"kubernetes.io/projected/3f0ea4dd-69a1-461b-8577-04147f2f249c-kube-api-access-z2bgw\") pod \"perf-node-gather-daemonset-bs8w4\" (UID: \"3f0ea4dd-69a1-461b-8577-04147f2f249c\") " pod="openshift-must-gather-tznnh/perf-node-gather-daemonset-bs8w4"
Sep 15 09:57:00.678191 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:00.678163    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3f0ea4dd-69a1-461b-8577-04147f2f249c-lib-modules\") pod \"perf-node-gather-daemonset-bs8w4\" (UID: \"3f0ea4dd-69a1-461b-8577-04147f2f249c\") " pod="openshift-must-gather-tznnh/perf-node-gather-daemonset-bs8w4"
Sep 15 09:57:00.678303 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:00.678211    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3f0ea4dd-69a1-461b-8577-04147f2f249c-proc\") pod \"perf-node-gather-daemonset-bs8w4\" (UID: \"3f0ea4dd-69a1-461b-8577-04147f2f249c\") " pod="openshift-must-gather-tznnh/perf-node-gather-daemonset-bs8w4"
Sep 15 09:57:00.700822 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:00.700800    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7445bbdc5b-mzrk4_20173696-7b4b-4743-a55f-024bc73a8a30/console/0.log"
Sep 15 09:57:00.736611 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:00.736586    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-wjsdn_5bb7f43b-83cd-4018-9c7b-03b85b554e8a/download-server/0.log"
Sep 15 09:57:00.778675 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:00.778654    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3f0ea4dd-69a1-461b-8577-04147f2f249c-lib-modules\") pod \"perf-node-gather-daemonset-bs8w4\" (UID: \"3f0ea4dd-69a1-461b-8577-04147f2f249c\") " pod="openshift-must-gather-tznnh/perf-node-gather-daemonset-bs8w4"
Sep 15 09:57:00.778750 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:00.778693    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3f0ea4dd-69a1-461b-8577-04147f2f249c-proc\") pod \"perf-node-gather-daemonset-bs8w4\" (UID: \"3f0ea4dd-69a1-461b-8577-04147f2f249c\") " pod="openshift-must-gather-tznnh/perf-node-gather-daemonset-bs8w4"
Sep 15 09:57:00.778806 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:00.778794    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3f0ea4dd-69a1-461b-8577-04147f2f249c-proc\") pod \"perf-node-gather-daemonset-bs8w4\" (UID: \"3f0ea4dd-69a1-461b-8577-04147f2f249c\") " pod="openshift-must-gather-tznnh/perf-node-gather-daemonset-bs8w4"
Sep 15 09:57:00.778847 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:00.778811    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3f0ea4dd-69a1-461b-8577-04147f2f249c-lib-modules\") pod \"perf-node-gather-daemonset-bs8w4\" (UID: \"3f0ea4dd-69a1-461b-8577-04147f2f249c\") " pod="openshift-must-gather-tznnh/perf-node-gather-daemonset-bs8w4"
Sep 15 09:57:00.778847 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:00.778818    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3f0ea4dd-69a1-461b-8577-04147f2f249c-podres\") pod \"perf-node-gather-daemonset-bs8w4\" (UID: \"3f0ea4dd-69a1-461b-8577-04147f2f249c\") " pod="openshift-must-gather-tznnh/perf-node-gather-daemonset-bs8w4"
Sep 15 09:57:00.778913 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:00.778846    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3f0ea4dd-69a1-461b-8577-04147f2f249c-sys\") pod \"perf-node-gather-daemonset-bs8w4\" (UID: \"3f0ea4dd-69a1-461b-8577-04147f2f249c\") " pod="openshift-must-gather-tznnh/perf-node-gather-daemonset-bs8w4"
Sep 15 09:57:00.778913 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:00.778867    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3f0ea4dd-69a1-461b-8577-04147f2f249c-podres\") pod \"perf-node-gather-daemonset-bs8w4\" (UID: \"3f0ea4dd-69a1-461b-8577-04147f2f249c\") " pod="openshift-must-gather-tznnh/perf-node-gather-daemonset-bs8w4"
Sep 15 09:57:00.778913 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:00.778880    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2bgw\" (UniqueName: \"kubernetes.io/projected/3f0ea4dd-69a1-461b-8577-04147f2f249c-kube-api-access-z2bgw\") pod \"perf-node-gather-daemonset-bs8w4\" (UID: \"3f0ea4dd-69a1-461b-8577-04147f2f249c\") " pod="openshift-must-gather-tznnh/perf-node-gather-daemonset-bs8w4"
Sep 15 09:57:00.778913 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:00.778900    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3f0ea4dd-69a1-461b-8577-04147f2f249c-sys\") pod \"perf-node-gather-daemonset-bs8w4\" (UID: \"3f0ea4dd-69a1-461b-8577-04147f2f249c\") " pod="openshift-must-gather-tznnh/perf-node-gather-daemonset-bs8w4"
Sep 15 09:57:00.788773 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:00.788754    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2bgw\" (UniqueName: \"kubernetes.io/projected/3f0ea4dd-69a1-461b-8577-04147f2f249c-kube-api-access-z2bgw\") pod \"perf-node-gather-daemonset-bs8w4\" (UID: \"3f0ea4dd-69a1-461b-8577-04147f2f249c\") " pod="openshift-must-gather-tznnh/perf-node-gather-daemonset-bs8w4"
Sep 15 09:57:00.902128 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:00.902082    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tznnh/perf-node-gather-daemonset-bs8w4"
Sep 15 09:57:01.177523 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:01.177497    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tznnh/perf-node-gather-daemonset-bs8w4"]
Sep 15 09:57:01.179155 ip-10-0-141-235 kubenswrapper[2578]: W0915 09:57:01.179129    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3f0ea4dd_69a1_461b_8577_04147f2f249c.slice/crio-6f822f671b1a72bb4d4515c66900cd6acbc933bfaac10f2c9021acc0988b70ab WatchSource:0}: Error finding container 6f822f671b1a72bb4d4515c66900cd6acbc933bfaac10f2c9021acc0988b70ab: Status 404 returned error can't find the container with id 6f822f671b1a72bb4d4515c66900cd6acbc933bfaac10f2c9021acc0988b70ab
Sep 15 09:57:02.026691 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:02.026657    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tznnh/perf-node-gather-daemonset-bs8w4" event={"ID":"3f0ea4dd-69a1-461b-8577-04147f2f249c","Type":"ContainerStarted","Data":"77781e438df08e782099890281e267e1f8cd79ea944a2fa093e8a61192c8ae30"}
Sep 15 09:57:02.027067 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:02.026847    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-tznnh/perf-node-gather-daemonset-bs8w4"
Sep 15 09:57:02.027067 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:02.026892    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tznnh/perf-node-gather-daemonset-bs8w4" event={"ID":"3f0ea4dd-69a1-461b-8577-04147f2f249c","Type":"ContainerStarted","Data":"6f822f671b1a72bb4d4515c66900cd6acbc933bfaac10f2c9021acc0988b70ab"}
Sep 15 09:57:02.047354 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:02.047310    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tznnh/perf-node-gather-daemonset-bs8w4" podStartSLOduration=2.047295895 podStartE2EDuration="2.047295895s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:57:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:57:02.045240533 +0000 UTC m=+2566.383685808" watchObservedRunningTime="2026-09-15 09:57:02.047295895 +0000 UTC m=+2566.385741170"
Sep 15 09:57:02.612138 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:02.612109    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w6zwc_5c97256c-a8d4-44f2-b32d-903189a7cbdf/dns/0.log"
Sep 15 09:57:02.633963 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:02.633908    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w6zwc_5c97256c-a8d4-44f2-b32d-903189a7cbdf/kube-rbac-proxy/0.log"
Sep 15 09:57:02.728879 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:02.728858    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6lwmm_5b0fcbbe-ae50-4282-ab2f-3d85fc2457a7/dns-node-resolver/0.log"
Sep 15 09:57:03.320752 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:03.320720    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-756984fb65-j28xh_ad8afefa-a88b-4788-9a11-97bad041e1c0/registry/0.log"
Sep 15 09:57:03.364882 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:03.364863    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-n5h5g_60e02ffe-03b0-4ac9-b5d0-492856f7d07a/node-ca/0.log"
Sep 15 09:57:04.395534 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:04.395509    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799c795f6_5d1fbe79-bd03-4730-8b84-2b8e7bb949fc/istio-proxy/0.log"
Sep 15 09:57:04.825079 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:04.825051    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-rfsfx_7d25c4bb-e3cb-4a38-a42c-242dc96a724e/discovery/0.log"
Sep 15 09:57:04.922135 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:04.922106    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-648hw_32fe6fe4-c078-4a0e-82dc-47182c507813/istio-proxy/0.log"
Sep 15 09:57:04.924558 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:04.924540    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-648hw_32fe6fe4-c078-4a0e-82dc-47182c507813/istio-proxy/1.log"
Sep 15 09:57:05.988519 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:05.988475    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6qsww_f5b07bb7-60da-43c0-97b9-5d7e86227ddd/serve-healthcheck-canary/0.log"
Sep 15 09:57:06.733926 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:06.733884    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xm6vk_78b77780-8e3d-47c9-97ba-16744e7ad8f1/kube-rbac-proxy/0.log"
Sep 15 09:57:06.758196 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:06.758175    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xm6vk_78b77780-8e3d-47c9-97ba-16744e7ad8f1/exporter/0.log"
Sep 15 09:57:06.779495 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:06.779472    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xm6vk_78b77780-8e3d-47c9-97ba-16744e7ad8f1/extractor/0.log"
Sep 15 09:57:08.042674 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:08.042649    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-tznnh/perf-node-gather-daemonset-bs8w4"
Sep 15 09:57:09.383348 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:09.383328    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-qlv9b_e0a9edc3-3b09-43d0-a303-b989fa3d4656/server/0.log"
Sep 15 09:57:09.476590 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:09.476566    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-t4dnj_d3d9b371-4a0b-4729-8f9e-eddf8e262286/manager/0.log"
Sep 15 09:57:09.505585 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:09.505563    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-767c4c8b76-jmwcb_ced6aa23-9676-4cc4-a15a-1d18d5aeedf1/manager/0.log"
Sep 15 09:57:09.536214 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:09.536195    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-767c4c8b76-jmwcb_ced6aa23-9676-4cc4-a15a-1d18d5aeedf1/copy-manifests/0.log"
Sep 15 09:57:11.087953 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:11.087918    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799c795f6_5d1fbe79-bd03-4730-8b84-2b8e7bb949fc/istio-proxy/0.log"
Sep 15 09:57:11.107849 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:11.107829    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6f69b6c8dc-jbrrx_c3409cbc-028e-4c4a-8bb6-4b058b3972af/manager/0.log"
Sep 15 09:57:11.168058 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:11.168034    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-rwm4b_84b1c034-6ed8-4af2-bee6-7e328644151b/openshift-lws-operator/0.log"
Sep 15 09:57:11.495833 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:11.495805    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-rfsfx_7d25c4bb-e3cb-4a38-a42c-242dc96a724e/discovery/0.log"
Sep 15 09:57:11.547772 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:11.547749    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-648hw_32fe6fe4-c078-4a0e-82dc-47182c507813/istio-proxy/0.log"
Sep 15 09:57:11.550203 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:11.550186    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-648hw_32fe6fe4-c078-4a0e-82dc-47182c507813/istio-proxy/1.log"
Sep 15 09:57:13.094692 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:13.094663    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799c795f6_5d1fbe79-bd03-4730-8b84-2b8e7bb949fc/istio-proxy/0.log"
Sep 15 09:57:13.537610 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:13.537582    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-rfsfx_7d25c4bb-e3cb-4a38-a42c-242dc96a724e/discovery/0.log"
Sep 15 09:57:13.598994 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:13.598956    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-648hw_32fe6fe4-c078-4a0e-82dc-47182c507813/istio-proxy/0.log"
Sep 15 09:57:13.601190 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:13.601172    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-648hw_32fe6fe4-c078-4a0e-82dc-47182c507813/istio-proxy/1.log"
Sep 15 09:57:17.537050 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:17.537015    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-826mj_621cf06d-684f-4bbb-a194-d944fa6d1752/kube-multus-additional-cni-plugins/0.log"
Sep 15 09:57:17.579572 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:17.579519    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-826mj_621cf06d-684f-4bbb-a194-d944fa6d1752/egress-router-binary-copy/0.log"
Sep 15 09:57:17.641933 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:17.641887    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-826mj_621cf06d-684f-4bbb-a194-d944fa6d1752/cni-plugins/0.log"
Sep 15 09:57:17.681413 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:17.681390    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-826mj_621cf06d-684f-4bbb-a194-d944fa6d1752/bond-cni-plugin/0.log"
Sep 15 09:57:17.714199 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:17.714177    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-826mj_621cf06d-684f-4bbb-a194-d944fa6d1752/routeoverride-cni/0.log"
Sep 15 09:57:17.741027 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:17.740991    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-826mj_621cf06d-684f-4bbb-a194-d944fa6d1752/whereabouts-cni-bincopy/0.log"
Sep 15 09:57:17.778144 ip-10-0-141-235 kubenswrapper[2578]: I0915 09:57:17.778112    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-826mj_621cf06d-684f-4bbb-a194-d944fa6d1752/whereabouts-cni/0.log"