Sep 17 01:35:25.584933 ip-10-0-143-95 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 17 01:35:25.584945 ip-10-0-143-95 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 17 01:35:25.584955 ip-10-0-143-95 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 17 01:35:25.585322 ip-10-0-143-95 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 17 01:35:35.834397 ip-10-0-143-95 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 17 01:35:35.834416 ip-10-0-143-95 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 5a91a1afcc3d4b1fbd9d29cd21b9e4c5 --
Sep 17 01:37:21.620671 ip-10-0-143-95 systemd[1]: Starting Kubernetes Kubelet...
Sep 17 01:37:22.074399 ip-10-0-143-95 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 01:37:22.074399 ip-10-0-143-95 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 17 01:37:22.074399 ip-10-0-143-95 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 01:37:22.074399 ip-10-0-143-95 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 17 01:37:22.074399 ip-10-0-143-95 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 01:37:22.075401 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.075311    2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 17 01:37:22.079641 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079621    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 01:37:22.079641 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079638    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 01:37:22.079641 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079644    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 01:37:22.079641 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079648    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 01:37:22.079893 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079652    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 01:37:22.079893 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079656    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 01:37:22.079893 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079660    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 01:37:22.079893 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079663    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 01:37:22.079893 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079668    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 01:37:22.079893 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079672    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 01:37:22.079893 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079676    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 01:37:22.079893 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079679    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 01:37:22.079893 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079683    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 01:37:22.079893 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079687    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 01:37:22.079893 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079691    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 01:37:22.079893 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079695    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 01:37:22.079893 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079699    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 01:37:22.079893 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079703    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 01:37:22.079893 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079707    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 01:37:22.079893 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079710    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 01:37:22.079893 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079721    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 01:37:22.079893 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079726    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 01:37:22.079893 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079730    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 01:37:22.079893 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079734    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 01:37:22.080534 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079739    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 01:37:22.080534 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079742    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 01:37:22.080534 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079746    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 01:37:22.080534 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079750    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 01:37:22.080534 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079755    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 01:37:22.080534 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079759    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 01:37:22.080534 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079763    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 01:37:22.080534 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079767    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 01:37:22.080534 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079771    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 01:37:22.080534 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079775    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 01:37:22.080534 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079779    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 01:37:22.080534 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079784    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 01:37:22.080534 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079788    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 01:37:22.080534 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079793    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 01:37:22.080534 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079798    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 01:37:22.080534 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079802    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 01:37:22.080534 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079806    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 01:37:22.080534 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079815    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 01:37:22.080534 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079821    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 01:37:22.081008 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079826    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 01:37:22.081008 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079833    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 01:37:22.081008 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079839    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 01:37:22.081008 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079843    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 01:37:22.081008 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079848    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 01:37:22.081008 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079852    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 01:37:22.081008 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079856    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 01:37:22.081008 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079862    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 01:37:22.081008 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079866    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 01:37:22.081008 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079871    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 01:37:22.081008 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079875    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 01:37:22.081008 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079879    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 01:37:22.081008 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079884    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 01:37:22.081008 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079888    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 01:37:22.081008 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079893    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 01:37:22.081008 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079897    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 01:37:22.081008 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079909    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 01:37:22.081008 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079914    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 01:37:22.081008 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079919    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 01:37:22.081008 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079923    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 01:37:22.081753 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079927    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 01:37:22.081753 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079933    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 01:37:22.081753 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079937    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 01:37:22.081753 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079942    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 01:37:22.081753 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079946    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 01:37:22.081753 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079951    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 01:37:22.081753 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079956    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 01:37:22.081753 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079960    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 01:37:22.081753 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079966    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 01:37:22.081753 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079970    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 01:37:22.081753 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079975    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 01:37:22.081753 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079979    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 01:37:22.081753 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079983    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 01:37:22.081753 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079987    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 01:37:22.081753 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079991    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 01:37:22.081753 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079995    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 01:37:22.081753 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.079999    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 01:37:22.081753 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.080003    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 01:37:22.081753 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.080008    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 01:37:22.082637 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.080015    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 01:37:22.082637 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.080020    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 01:37:22.082637 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.080026    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 01:37:22.082637 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.080030    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 01:37:22.082637 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.080036    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 01:37:22.082637 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.080040    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 01:37:22.082637 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.080045    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 01:37:22.082637 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.080050    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 01:37:22.082637 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.080055    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 01:37:22.082637 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.080059    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 01:37:22.082637 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.080063    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 01:37:22.082637 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.080068    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 01:37:22.082637 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.080072    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 01:37:22.082637 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.080076    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 01:37:22.082637 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.080080    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 01:37:22.082637 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.080084    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 01:37:22.082637 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.080088    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 01:37:22.082637 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082295    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 01:37:22.082637 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082308    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 01:37:22.082637 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082316    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 01:37:22.083487 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082323    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 01:37:22.083487 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082329    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 01:37:22.083487 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082335    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 01:37:22.083487 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082340    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 01:37:22.083487 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082345    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 01:37:22.083487 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082349    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 01:37:22.083487 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082354    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 01:37:22.083487 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082358    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 01:37:22.083487 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082362    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 01:37:22.083487 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082366    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 01:37:22.083487 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082370    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 01:37:22.083487 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082374    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 01:37:22.083487 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082379    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 01:37:22.083487 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082382    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 01:37:22.083487 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082387    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 01:37:22.083487 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082391    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 01:37:22.083487 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082396    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 01:37:22.083487 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082400    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 01:37:22.083487 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082405    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 01:37:22.084341 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082409    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 01:37:22.084341 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082413    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 01:37:22.084341 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082418    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 01:37:22.084341 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082422    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 01:37:22.084341 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082426    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 01:37:22.084341 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082430    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 01:37:22.084341 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082435    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 01:37:22.084341 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082439    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 01:37:22.084341 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082444    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 01:37:22.084341 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082449    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 01:37:22.084341 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082453    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 01:37:22.084341 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082458    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 01:37:22.084341 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082461    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 01:37:22.084341 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082465    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 01:37:22.084341 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082470    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 01:37:22.084341 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082474    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 01:37:22.084341 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082479    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 01:37:22.084341 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082485    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 01:37:22.084341 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082489    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 01:37:22.084341 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082494    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 01:37:22.085212 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082498    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 01:37:22.085212 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082502    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 01:37:22.085212 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082506    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 01:37:22.085212 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082510    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 01:37:22.085212 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082515    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 01:37:22.085212 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082519    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 01:37:22.085212 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082524    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 01:37:22.085212 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082528    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 01:37:22.085212 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082532    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 01:37:22.085212 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082536    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 01:37:22.085212 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082541    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 01:37:22.085212 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082545    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 01:37:22.085212 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082549    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 01:37:22.085212 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082555    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 01:37:22.085212 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082559    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 01:37:22.085212 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082564    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 01:37:22.085212 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082568    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 01:37:22.085212 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082572    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 01:37:22.085212 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082577    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 01:37:22.085212 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082581    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 01:37:22.085891 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082585    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 01:37:22.085891 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082589    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 01:37:22.085891 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082593    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 01:37:22.085891 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082597    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 01:37:22.085891 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082601    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 01:37:22.085891 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082605    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 01:37:22.085891 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082609    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 01:37:22.085891 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082614    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 01:37:22.085891 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082618    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 01:37:22.085891 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082623    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 01:37:22.085891 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082627    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 01:37:22.085891 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082633    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 01:37:22.085891 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082638    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 01:37:22.085891 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082642    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 01:37:22.085891 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082646    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 01:37:22.085891 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082650    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 01:37:22.085891 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082653    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 01:37:22.085891 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082657    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 01:37:22.085891 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082663    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 01:37:22.086463 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082667    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 01:37:22.086463 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082672    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 01:37:22.086463 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082677    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 01:37:22.086463 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082681    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 01:37:22.086463 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082685    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 01:37:22.086463 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082690    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 01:37:22.086463 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082696    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 01:37:22.086463 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082701    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 01:37:22.086463 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082706    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 01:37:22.086463 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082712    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 01:37:22.086463 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082716    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 01:37:22.086463 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082721    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 01:37:22.086463 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082726    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 01:37:22.086463 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082730    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 01:37:22.086463 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082734    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 01:37:22.086463 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082739    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 01:37:22.086463 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082742    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 01:37:22.086463 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.082747    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 01:37:22.086463 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083356    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 01:37:22.086463 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083364    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 01:37:22.086961 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083369    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 01:37:22.086961 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083376    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 01:37:22.086961 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083383    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 01:37:22.086961 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083388    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 01:37:22.086961 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083394    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 01:37:22.086961 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083398    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 01:37:22.086961 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083402    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 01:37:22.086961 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083407    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 01:37:22.086961 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083411    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 01:37:22.086961 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083416    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 01:37:22.086961 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083419    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 01:37:22.086961 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083424    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 01:37:22.086961 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083428    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 01:37:22.086961 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083432    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 01:37:22.086961 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083437    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 01:37:22.086961 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083441    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 01:37:22.086961 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083446    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 01:37:22.086961 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083450    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 01:37:22.086961 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083454    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 01:37:22.087469 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083459    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 01:37:22.087469 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083463    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 01:37:22.087469 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083467    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 01:37:22.087469 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083471    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 01:37:22.087469 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083475    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 01:37:22.087469 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083479    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 01:37:22.087469 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083483    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 01:37:22.087469 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083487    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 01:37:22.087469 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083491    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 01:37:22.087469 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083495    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 01:37:22.087469 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083499    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 01:37:22.087469 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083503    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 01:37:22.087469 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083507    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 01:37:22.087469 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083511    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 01:37:22.087469 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083515    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 01:37:22.087469 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083519    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 01:37:22.087469 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083524    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 01:37:22.087469 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083529    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 01:37:22.087469 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083534    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 01:37:22.087993 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083540    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 01:37:22.087993 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083546    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 01:37:22.087993 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083550    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 01:37:22.087993 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083555    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 01:37:22.087993 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083560    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 01:37:22.087993 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083565    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 01:37:22.087993 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083569    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 01:37:22.087993 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083573    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 01:37:22.087993 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083577    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 01:37:22.087993 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083583    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 01:37:22.087993 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083590    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 01:37:22.087993 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083594    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 01:37:22.087993 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083598    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 01:37:22.087993 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083602    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 01:37:22.087993 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083606    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 01:37:22.087993 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083611    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 01:37:22.087993 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083616    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 01:37:22.087993 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083620    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 01:37:22.087993 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083624    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 01:37:22.088481 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083628    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 01:37:22.088481 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083632    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 01:37:22.088481 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083636    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 01:37:22.088481 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083640    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 01:37:22.088481 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083644    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 01:37:22.088481 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083648    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 01:37:22.088481 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083652    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 01:37:22.088481 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083656    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 01:37:22.088481 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083660    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 01:37:22.088481 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083664    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 01:37:22.088481 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083668    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 01:37:22.088481 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083674    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 01:37:22.088481 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083678    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 01:37:22.088481 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083682    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 01:37:22.088481 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083686    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 01:37:22.088481 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083692    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 01:37:22.088481 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083697    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 01:37:22.088481 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083701    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 01:37:22.088481 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083705    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 01:37:22.088481 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083709    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 01:37:22.089002 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083713    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 01:37:22.089002 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083717    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 01:37:22.089002 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083722    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 01:37:22.089002 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083726    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 01:37:22.089002 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083730    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 01:37:22.089002 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083734    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 01:37:22.089002 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083738    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 01:37:22.089002 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083742    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 01:37:22.089002 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083746    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 01:37:22.089002 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083750    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 01:37:22.089002 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083754    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 01:37:22.089002 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083758    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 01:37:22.089002 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083763    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 01:37:22.089002 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083766    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 01:37:22.089002 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083770    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 01:37:22.089002 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083774    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 01:37:22.089002 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083778    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 01:37:22.089002 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083782    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 01:37:22.089002 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083786    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 01:37:22.089002 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.083790    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 01:37:22.089002 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.083895    2560 flags.go:64] FLAG: --address="0.0.0.0"
Sep 17 01:37:22.089538 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.083957    2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 17 01:37:22.089538 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.083969    2560 flags.go:64] FLAG: --anonymous-auth="true"
Sep 17 01:37:22.089538 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.083976    2560 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 17 01:37:22.089538 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.083983    2560 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 17 01:37:22.089538 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.083989    2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 17 01:37:22.089538 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.083996    2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 17 01:37:22.089538 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084002    2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 17 01:37:22.089538 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084008    2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 17 01:37:22.089538 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084013    2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 17 01:37:22.089538 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084018    2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 17 01:37:22.089538 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084023    2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 17 01:37:22.089538 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084028    2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 17 01:37:22.089538 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084033    2560 flags.go:64] FLAG: --cgroup-root=""
Sep 17 01:37:22.089538 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084038    2560 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 17 01:37:22.089538 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084045    2560 flags.go:64] FLAG: --client-ca-file=""
Sep 17 01:37:22.089538 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084050    2560 flags.go:64] FLAG: --cloud-provider="external"
Sep 17 01:37:22.089538 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084055    2560 flags.go:64] FLAG: --cluster-dns="[]"
Sep 17 01:37:22.089538 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084062    2560 flags.go:64] FLAG: --cluster-domain=""
Sep 17 01:37:22.089538 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084066    2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 17 01:37:22.089538 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084072    2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 17 01:37:22.089538 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084077    2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 17 01:37:22.089538 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084082    2560 flags.go:64] FLAG: --container-log-max-files="5"
Sep 17 01:37:22.089538 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084088    2560 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 17 01:37:22.089538 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084093    2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 17 01:37:22.090123 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084098    2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 17 01:37:22.090123 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084104    2560 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 17 01:37:22.090123 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084108    2560 flags.go:64] FLAG: --contention-profiling="false"
Sep 17 01:37:22.090123 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084113    2560 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 17 01:37:22.090123 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084118    2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 17 01:37:22.090123 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084123    2560 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 17 01:37:22.090123 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084128    2560 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 17 01:37:22.090123 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084134    2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 17 01:37:22.090123 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084139    2560 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 17 01:37:22.090123 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084145    2560 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 17 01:37:22.090123 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084150    2560 flags.go:64] FLAG: --enable-load-reader="false"
Sep 17 01:37:22.090123 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084155    2560 flags.go:64] FLAG: --enable-server="true"
Sep 17 01:37:22.090123 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084161    2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 17 01:37:22.090123 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084168    2560 flags.go:64] FLAG: --event-burst="100"
Sep 17 01:37:22.090123 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084173    2560 flags.go:64] FLAG: --event-qps="50"
Sep 17 01:37:22.090123 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084177    2560 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 17 01:37:22.090123 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084183    2560 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 17 01:37:22.090123 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084187    2560 flags.go:64] FLAG: --eviction-hard=""
Sep 17 01:37:22.090123 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084193    2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 17 01:37:22.090123 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084199    2560 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 17 01:37:22.090123 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084204    2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 17 01:37:22.090123 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084209    2560 flags.go:64] FLAG: --eviction-soft=""
Sep 17 01:37:22.090123 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084215    2560 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 17 01:37:22.090123 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084220    2560 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 17 01:37:22.090123 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084225    2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 17 01:37:22.090761 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084229    2560 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 17 01:37:22.090761 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084234    2560 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 17 01:37:22.090761 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084239    2560 flags.go:64] FLAG: --fail-swap-on="true"
Sep 17 01:37:22.090761 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084264    2560 flags.go:64] FLAG: --feature-gates=""
Sep 17 01:37:22.090761 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084271    2560 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 17 01:37:22.090761 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084277    2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 17 01:37:22.090761 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084282    2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 17 01:37:22.090761 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084287    2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 17 01:37:22.090761 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084292    2560 flags.go:64] FLAG: --healthz-port="10248"
Sep 17 01:37:22.090761 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084297    2560 flags.go:64] FLAG: --help="false"
Sep 17 01:37:22.090761 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084302    2560 flags.go:64] FLAG: --hostname-override="ip-10-0-143-95.ec2.internal"
Sep 17 01:37:22.090761 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084307    2560 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 17 01:37:22.090761 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084312    2560 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 17 01:37:22.090761 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084317    2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 17 01:37:22.090761 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084323    2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 17 01:37:22.090761 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084328    2560 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 17 01:37:22.090761 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084335    2560 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 17 01:37:22.090761 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084339    2560 flags.go:64] FLAG: --image-service-endpoint=""
Sep 17 01:37:22.090761 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084344    2560 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 17 01:37:22.090761 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084348    2560 flags.go:64] FLAG: --kube-api-burst="100"
Sep 17 01:37:22.090761 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084354    2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 17 01:37:22.090761 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084359    2560 flags.go:64] FLAG: --kube-api-qps="50"
Sep 17 01:37:22.090761 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084364    2560 flags.go:64] FLAG: --kube-reserved=""
Sep 17 01:37:22.090761 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084370    2560 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 17 01:37:22.091390 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084375    2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 17 01:37:22.091390 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084380    2560 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 17 01:37:22.091390 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084384    2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 17 01:37:22.091390 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084389    2560 flags.go:64] FLAG: --lock-file=""
Sep 17 01:37:22.091390 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084394    2560 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 17 01:37:22.091390 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084401    2560 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 17 01:37:22.091390 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084406    2560 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 17 01:37:22.091390 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084415    2560 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 17 01:37:22.091390 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084420    2560 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 17 01:37:22.091390 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084424    2560 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 17 01:37:22.091390 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084429    2560 flags.go:64] FLAG: --logging-format="text"
Sep 17 01:37:22.091390 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084434    2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 17 01:37:22.091390 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084439    2560 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 17 01:37:22.091390 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084444    2560 flags.go:64] FLAG: --manifest-url=""
Sep 17 01:37:22.091390 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084449    2560 flags.go:64] FLAG: --manifest-url-header=""
Sep 17 01:37:22.091390 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084455    2560 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 17 01:37:22.091390 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084460    2560 flags.go:64] FLAG: --max-open-files="1000000"
Sep 17 01:37:22.091390 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084466    2560 flags.go:64] FLAG: --max-pods="110"
Sep 17 01:37:22.091390 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084471    2560 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 17 01:37:22.091390 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084476    2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 17 01:37:22.091390 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084481    2560 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 17 01:37:22.091390 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084486    2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 17 01:37:22.091390 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084490    2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 17 01:37:22.091390 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084495    2560 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 17 01:37:22.091390 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084502    2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 17 01:37:22.092023 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084514    2560 flags.go:64] FLAG: --node-status-max-images="50"
Sep 17 01:37:22.092023 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084519    2560 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 17 01:37:22.092023 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084524    2560 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 17 01:37:22.092023 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084529    2560 flags.go:64] FLAG: --pod-cidr=""
Sep 17 01:37:22.092023 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084534    2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 17 01:37:22.092023 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084542    2560 flags.go:64] FLAG: --pod-manifest-path=""
Sep 17 01:37:22.092023 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084547    2560 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 17 01:37:22.092023 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084552    2560 flags.go:64] FLAG: --pods-per-core="0"
Sep 17 01:37:22.092023 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084557    2560 flags.go:64] FLAG: --port="10250"
Sep 17 01:37:22.092023 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084562    2560 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 17 01:37:22.092023 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084566    2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c810079190679824"
Sep 17 01:37:22.092023 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084571    2560 flags.go:64] FLAG: --qos-reserved=""
Sep 17 01:37:22.092023 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084576    2560 flags.go:64] FLAG: --read-only-port="10255"
Sep 17 01:37:22.092023 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084583    2560 flags.go:64] FLAG: --register-node="true"
Sep 17 01:37:22.092023 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084587    2560 flags.go:64] FLAG: --register-with-taints=""
Sep 17 01:37:22.092023 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084593    2560 flags.go:64] FLAG: --registry-burst="10"
Sep 17 01:37:22.092023 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084598    2560 flags.go:64] FLAG: --registry-qps="5"
Sep 17 01:37:22.092023 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084603    2560 flags.go:64] FLAG: --reserved-cpus=""
Sep 17 01:37:22.092023 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084607    2560 flags.go:64] FLAG: --reserved-memory=""
Sep 17 01:37:22.092023 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084613    2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 17 01:37:22.092023 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084619    2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 17 01:37:22.092023 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084624    2560 flags.go:64] FLAG: --rotate-certificates="false"
Sep 17 01:37:22.092023 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084628    2560 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 17 01:37:22.092023 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084633    2560 flags.go:64] FLAG: --runonce="false"
Sep 17 01:37:22.092023 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084638    2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 17 01:37:22.092727 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084643    2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 17 01:37:22.092727 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084648    2560 flags.go:64] FLAG: --seccomp-default="false"
Sep 17 01:37:22.092727 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084653    2560 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 17 01:37:22.092727 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084657    2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 17 01:37:22.092727 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084662    2560 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 17 01:37:22.092727 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084667    2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 17 01:37:22.092727 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084674    2560 flags.go:64] FLAG: --storage-driver-password="root"
Sep 17 01:37:22.092727 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084679    2560 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 17 01:37:22.092727 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084684    2560 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 17 01:37:22.092727 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084688    2560 flags.go:64] FLAG: --storage-driver-user="root"
Sep 17 01:37:22.092727 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084693    2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 17 01:37:22.092727 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084698    2560 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 17 01:37:22.092727 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084704    2560 flags.go:64] FLAG: --system-cgroups=""
Sep 17 01:37:22.092727 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084708    2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 17 01:37:22.092727 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084717    2560 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 17 01:37:22.092727 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084722    2560 flags.go:64] FLAG: --tls-cert-file=""
Sep 17 01:37:22.092727 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084727    2560 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 17 01:37:22.092727 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084739    2560 flags.go:64] FLAG: --tls-min-version=""
Sep 17 01:37:22.092727 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084744    2560 flags.go:64] FLAG: --tls-private-key-file=""
Sep 17 01:37:22.092727 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084748    2560 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 17 01:37:22.092727 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084754    2560 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 17 01:37:22.092727 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084760    2560 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 17 01:37:22.092727 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084764    2560 flags.go:64] FLAG: --v="2"
Sep 17 01:37:22.092727 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084777    2560 flags.go:64] FLAG: --version="false"
Sep 17 01:37:22.092727 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084783    2560 flags.go:64] FLAG: --vmodule=""
Sep 17 01:37:22.093362 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084788    2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 17 01:37:22.093362 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.084794    2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 17 01:37:22.093362 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.084973    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 01:37:22.093362 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.084979    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 01:37:22.093362 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.084984    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 01:37:22.093362 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.084989    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 01:37:22.093362 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.084993    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 01:37:22.093362 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.084997    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 01:37:22.093362 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085002    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 01:37:22.093362 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085006    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 01:37:22.093362 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085010    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 01:37:22.093362 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085014    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 01:37:22.093362 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085018    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 01:37:22.093362 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085024    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 01:37:22.093362 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085029    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 01:37:22.093362 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085033    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 01:37:22.093362 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085037    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 01:37:22.093362 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085042    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 01:37:22.093362 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085046    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 01:37:22.093362 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085050    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 01:37:22.093853 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085055    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 01:37:22.093853 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085059    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 01:37:22.093853 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085064    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 01:37:22.093853 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085068    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 01:37:22.093853 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085072    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 01:37:22.093853 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085076    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 01:37:22.093853 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085080    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 01:37:22.093853 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085086    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 01:37:22.093853 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085090    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 01:37:22.093853 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085094    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 01:37:22.093853 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085099    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 01:37:22.093853 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085103    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 01:37:22.093853 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085107    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 01:37:22.093853 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085111    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 01:37:22.093853 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085116    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 01:37:22.093853 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085120    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 01:37:22.093853 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085124    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 01:37:22.093853 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085127    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 01:37:22.093853 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085132    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 01:37:22.094344 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085139    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 01:37:22.094344 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085144    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 01:37:22.094344 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085149    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 01:37:22.094344 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085154    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 01:37:22.094344 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085158    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 01:37:22.094344 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085163    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 01:37:22.094344 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085169    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 01:37:22.094344 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085173    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 01:37:22.094344 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085177    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 01:37:22.094344 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085182    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 01:37:22.094344 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085186    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 01:37:22.094344 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085190    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 01:37:22.094344 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085194    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 01:37:22.094344 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085198    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 01:37:22.094344 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085203    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 01:37:22.094344 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085207    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 01:37:22.094344 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085210    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 01:37:22.094344 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085214    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 01:37:22.094344 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085218    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 01:37:22.094823 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085224    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 01:37:22.094823 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085231    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 01:37:22.094823 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085235    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 01:37:22.094823 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085239    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 01:37:22.094823 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085261    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 01:37:22.094823 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085266    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 01:37:22.094823 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085271    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 01:37:22.094823 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085276    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 01:37:22.094823 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085280    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 01:37:22.094823 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085284    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 01:37:22.094823 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085288    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 01:37:22.094823 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085293    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 01:37:22.094823 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085298    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 01:37:22.094823 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085301    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 01:37:22.094823 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085306    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 01:37:22.094823 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085310    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 01:37:22.094823 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085316    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 01:37:22.094823 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085322    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 01:37:22.094823 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085327    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 01:37:22.094823 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085332    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 01:37:22.095340 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085337    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 01:37:22.095340 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085341    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 01:37:22.095340 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085346    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 01:37:22.095340 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085350    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 01:37:22.095340 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085354    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 01:37:22.095340 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085358    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 01:37:22.095340 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085363    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 01:37:22.095340 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085366    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 01:37:22.095340 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085371    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 01:37:22.095340 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085374    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 01:37:22.095340 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085378    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 01:37:22.095340 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085382    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 01:37:22.095340 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085385    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 01:37:22.095340 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085394    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 01:37:22.095340 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085397    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 01:37:22.095340 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085401    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 01:37:22.095340 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085405    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 01:37:22.095340 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085409    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 01:37:22.095340 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085413    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 01:37:22.095340 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085416    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 01:37:22.095864 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085420    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 01:37:22.095864 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085424    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 01:37:22.095864 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.085429    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 01:37:22.095864 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.086212    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 01:37:22.095864 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.093946    2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 17 01:37:22.095864 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.094097    2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 17 01:37:22.095864 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.094112    2560 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 17 01:37:22.095864 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.094117    2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 17 01:37:22.095864 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094173    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 01:37:22.095864 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094178    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 01:37:22.095864 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094182    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 01:37:22.095864 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094184    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 01:37:22.095864 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094189    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 01:37:22.095864 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094192    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 01:37:22.096231 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094196    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 01:37:22.096231 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094199    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 01:37:22.096231 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094202    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 01:37:22.096231 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094205    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 01:37:22.096231 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094208    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 01:37:22.096231 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094211    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 01:37:22.096231 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094215    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 01:37:22.096231 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094218    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 01:37:22.096231 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094221    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 01:37:22.096231 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094224    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 01:37:22.096231 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094226    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 01:37:22.096231 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094229    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 01:37:22.096231 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094233    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 01:37:22.096231 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094237    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 01:37:22.096231 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094240    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 01:37:22.096231 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094260    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 01:37:22.096231 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094264    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 01:37:22.096231 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094267    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 01:37:22.096231 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094270    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 01:37:22.096710 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094273    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 01:37:22.096710 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094276    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 01:37:22.096710 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094279    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 01:37:22.096710 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094282    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 01:37:22.096710 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094286    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 01:37:22.096710 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094289    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 01:37:22.096710 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094292    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 01:37:22.096710 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094295    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 01:37:22.096710 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094297    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 01:37:22.096710 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094300    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 01:37:22.096710 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094303    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 01:37:22.096710 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094306    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 01:37:22.096710 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094308    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 01:37:22.096710 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094311    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 01:37:22.096710 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094314    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 01:37:22.096710 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094317    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 01:37:22.096710 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094319    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 01:37:22.096710 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094322    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 01:37:22.096710 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094325    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 01:37:22.096710 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094327    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 01:37:22.097201 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094332    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 01:37:22.097201 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094336    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 01:37:22.097201 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094339    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 01:37:22.097201 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094342    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 01:37:22.097201 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094344    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 01:37:22.097201 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094347    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 01:37:22.097201 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094350    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 01:37:22.097201 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094353    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 01:37:22.097201 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094356    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 01:37:22.097201 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094359    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 01:37:22.097201 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094362    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 01:37:22.097201 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094364    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 01:37:22.097201 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094367    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 01:37:22.097201 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094370    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 01:37:22.097201 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094372    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 01:37:22.097201 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094375    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 01:37:22.097201 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094379    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 01:37:22.097201 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094382    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 01:37:22.097201 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094385    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 01:37:22.097201 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094388    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 01:37:22.097715 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094390    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 01:37:22.097715 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094393    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 01:37:22.097715 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094396    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 01:37:22.097715 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094398    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 01:37:22.097715 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094401    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 01:37:22.097715 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094403    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 01:37:22.097715 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094406    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 01:37:22.097715 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094408    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 01:37:22.097715 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094411    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 01:37:22.097715 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094414    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 01:37:22.097715 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094416    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 01:37:22.097715 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094419    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 01:37:22.097715 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094422    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 01:37:22.097715 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094425    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 01:37:22.097715 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094427    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 01:37:22.097715 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094430    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 01:37:22.097715 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094433    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 01:37:22.097715 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094435    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 01:37:22.097715 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094437    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 01:37:22.097715 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094440    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 01:37:22.097715 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094443    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 01:37:22.098267 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094445    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 01:37:22.098267 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094448    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 01:37:22.098267 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094450    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 01:37:22.098267 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094453    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 01:37:22.098267 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094455    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 01:37:22.098267 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094458    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 01:37:22.098267 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094461    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 01:37:22.098267 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094464    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 01:37:22.098267 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094467    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 01:37:22.098267 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094469    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 01:37:22.098267 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094472    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 01:37:22.098267 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094474    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 01:37:22.098267 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094477    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 01:37:22.098267 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.094482    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 01:37:22.098267 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094599    2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 01:37:22.098655 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094611    2560 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 01:37:22.098655 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094614    2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 01:37:22.098655 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094617    2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 01:37:22.098655 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094620    2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 01:37:22.098655 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094623    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 01:37:22.098655 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094626    2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 01:37:22.098655 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094628    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 01:37:22.098655 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094631    2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 01:37:22.098655 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094633    2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 01:37:22.098655 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094636    2560 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 01:37:22.098655 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094640    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 01:37:22.098655 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094642    2560 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 01:37:22.098655 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094645    2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 01:37:22.098655 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094648    2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 01:37:22.098655 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094651    2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 01:37:22.098655 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094655    2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 01:37:22.098655 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094659    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 01:37:22.098655 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094662    2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 01:37:22.098655 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094665    2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 01:37:22.099235 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094667    2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 01:37:22.099235 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094670    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 01:37:22.099235 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094673    2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 01:37:22.099235 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094676    2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 01:37:22.099235 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094678    2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 01:37:22.099235 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094682    2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 01:37:22.099235 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094684    2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 01:37:22.099235 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094687    2560 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 01:37:22.099235 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094690    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 01:37:22.099235 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094693    2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 01:37:22.099235 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094695    2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 01:37:22.099235 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094698    2560 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 01:37:22.099235 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094700    2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 01:37:22.099235 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094703    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 01:37:22.099235 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094705    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 01:37:22.099235 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094708    2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 01:37:22.099235 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094710    2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 01:37:22.099235 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094713    2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 01:37:22.099235 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094715    2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 01:37:22.099235 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094718    2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 01:37:22.099741 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094721    2560 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 01:37:22.099741 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094724    2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 01:37:22.099741 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094727    2560 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 01:37:22.099741 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094730    2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 01:37:22.099741 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094733    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 01:37:22.099741 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094735    2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 01:37:22.099741 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094738    2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 01:37:22.099741 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094741    2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 01:37:22.099741 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094743    2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 01:37:22.099741 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094746    2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 01:37:22.099741 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094748    2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 01:37:22.099741 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094751    2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 01:37:22.099741 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094754    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 01:37:22.099741 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094756    2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 01:37:22.099741 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094758    2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 01:37:22.099741 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094761    2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 01:37:22.099741 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094764    2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 01:37:22.099741 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094767    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 01:37:22.099741 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094770    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 01:37:22.099741 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094773    2560 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 01:37:22.100461 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094775    2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 01:37:22.100461 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094778    2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 01:37:22.100461 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094780    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 01:37:22.100461 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094783    2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 01:37:22.100461 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094785    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 01:37:22.100461 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094788    2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 01:37:22.100461 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094791    2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 01:37:22.100461 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094794    2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 01:37:22.100461 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094797    2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 01:37:22.100461 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094799    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 01:37:22.100461 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094802    2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 01:37:22.100461 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094804    2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 01:37:22.100461 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094807    2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 01:37:22.100461 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094809    2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 01:37:22.100461 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094812    2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 01:37:22.100461 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094814    2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 01:37:22.100461 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094817    2560 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 01:37:22.100461 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094820    2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 01:37:22.100461 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094823    2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 01:37:22.100461 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094825    2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 01:37:22.101152 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094828    2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 01:37:22.101152 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094831    2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 01:37:22.101152 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094834    2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 01:37:22.101152 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094837    2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 01:37:22.101152 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094839    2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 01:37:22.101152 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094842    2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 01:37:22.101152 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094845    2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 01:37:22.101152 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094847    2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 01:37:22.101152 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094850    2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 01:37:22.101152 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094852    2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 01:37:22.101152 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094855    2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 01:37:22.101152 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094859    2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 01:37:22.101152 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094862    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 01:37:22.101152 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094865    2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 01:37:22.101152 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094867    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 01:37:22.101152 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094870    2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 01:37:22.101152 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094872    2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 01:37:22.101152 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094875    2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 01:37:22.101152 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:22.094877    2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 01:37:22.101719 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.094882    2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 01:37:22.101719 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.094995    2560 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 17 01:37:22.101719 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.097684    2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 17 01:37:22.101719 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.098740    2560 server.go:1019] "Starting client certificate rotation"
Sep 17 01:37:22.101719 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.098853    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 17 01:37:22.101719 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.098905    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 17 01:37:22.101719 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.101570    2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 17 01:37:22.106755 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.106725    2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 17 01:37:22.118829 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.118810    2560 log.go:25] "Validated CRI v1 runtime API"
Sep 17 01:37:22.122480 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.122464    2560 log.go:25] "Validated CRI v1 image API"
Sep 17 01:37:22.123219 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.123204    2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 17 01:37:22.125808 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.125775    2560 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7b48388b-159b-4648-a586-e32e0963b1a7:/dev/nvme0n1p3 ed6ce028-8955-4c11-a2b2-ca8f43440be2:/dev/nvme0n1p4]
Sep 17 01:37:22.125877 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.125807    2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 17 01:37:22.128836 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.128818    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 17 01:37:22.131143 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.131023    2560 manager.go:216] Machine: {Timestamp:2026-09-17 01:37:22.12959414 +0000 UTC m=+0.379571444 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3002989 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f88f87bd4e93e29981d4ed9441f5d SystemUUID:ec2f88f8-7bd4-e93e-2998-1d4ed9441f5d BootID:5a91a1af-cc3d-4b1f-bd9d-29cd21b9e4c5 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:cb:47:bf:e9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:cb:47:bf:e9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8a:a0:c4:e8:d3:37 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 17 01:37:22.131143 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.131139    2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 17 01:37:22.131293 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.131280    2560 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 17 01:37:22.134671 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.134647    2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 17 01:37:22.134828 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.134676    2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-95.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 17 01:37:22.135572 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.135561    2560 topology_manager.go:138] "Creating topology manager with none policy"
Sep 17 01:37:22.135603 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.135574    2560 container_manager_linux.go:309] "Creating device plugin manager"
Sep 17 01:37:22.135603 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.135582    2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 17 01:37:22.135603 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.135595    2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 17 01:37:22.136906 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.136895    2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 17 01:37:22.141441 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.141430    2560 state_mem.go:36] "Initialized new in-memory state store"
Sep 17 01:37:22.141726 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.141716    2560 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 17 01:37:22.141761 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.141748    2560 kubelet.go:486] "Attempting to sync node with API server"
Sep 17 01:37:22.141761 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.141759    2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 17 01:37:22.141818 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.141775    2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 17 01:37:22.141818 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.141787    2560 kubelet.go:398] "Adding apiserver pod source"
Sep 17 01:37:22.141818 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.141795    2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 17 01:37:22.142153 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.142142    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 17 01:37:22.142195 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.142161    2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 17 01:37:22.144675 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.144659    2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 17 01:37:22.146968 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.146955    2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 17 01:37:22.147005 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.146985    2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 17 01:37:22.149032 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.149021    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 17 01:37:22.149066 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.149038    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 17 01:37:22.149066 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.149044    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 17 01:37:22.149066 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.149049    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 17 01:37:22.150979 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.150314    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 17 01:37:22.150979 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.150360    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 17 01:37:22.150979 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.150400    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 17 01:37:22.150979 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.150410    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 17 01:37:22.150979 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.150423    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 17 01:37:22.150979 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.150433    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 17 01:37:22.150979 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.150463    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 17 01:37:22.150979 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.150473    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 17 01:37:22.151310 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.151296    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 17 01:37:22.151353 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.151312    2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 17 01:37:22.152945 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:22.152916    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-95.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 17 01:37:22.152945 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:22.152930    2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 17 01:37:22.155379 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.155365    2560 server.go:1268] "Started kubelet"
Sep 17 01:37:22.155459 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.155415    2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 17 01:37:22.155509 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.155469    2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 17 01:37:22.155558 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.155529    2560 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 17 01:37:22.156026 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.156006    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mh6hd"
Sep 17 01:37:22.156186 ip-10-0-143-95 systemd[1]: Started Kubernetes Kubelet.
Sep 17 01:37:22.157652 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.157633    2560 server.go:310] "Adding debug handlers to kubelet server"
Sep 17 01:37:22.159966 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.159945    2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 17 01:37:22.161669 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:22.161650    2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 17 01:37:22.161757 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.161679    2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-95.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 17 01:37:22.162911 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:22.161771    2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-95.ec2.internal.18d5f7f12c7f0452  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-95.ec2.internal,UID:ip-10-0-143-95.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-95.ec2.internal,},FirstTimestamp:2026-09-17 01:37:22.155340882 +0000 UTC m=+0.405318186,LastTimestamp:2026-09-17 01:37:22.155340882 +0000 UTC m=+0.405318186,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-95.ec2.internal,}"
Sep 17 01:37:22.164558 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.164543    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mh6hd"
Sep 17 01:37:22.166017 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.166004    2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 17 01:37:22.166097 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.166018    2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 17 01:37:22.166343 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:22.166323    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-95.ec2.internal\" not found"
Sep 17 01:37:22.166786 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.166760    2560 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 17 01:37:22.166909 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.166899    2560 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 17 01:37:22.166965 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.166774    2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 17 01:37:22.167032 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.167017    2560 reconstruct.go:97] "Volume reconstruction finished"
Sep 17 01:37:22.167032 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.167029    2560 reconciler.go:29] "Reconciler: start to sync state"
Sep 17 01:37:22.167157 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.167035    2560 factory.go:55] Registering systemd factory
Sep 17 01:37:22.167157 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.167049    2560 factory.go:223] Registration of the systemd container factory successfully
Sep 17 01:37:22.167292 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.167278    2560 factory.go:153] Registering CRI-O factory
Sep 17 01:37:22.167344 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.167296    2560 factory.go:223] Registration of the crio container factory successfully
Sep 17 01:37:22.167391 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.167344    2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 17 01:37:22.167391 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.167361    2560 factory.go:103] Registering Raw factory
Sep 17 01:37:22.167391 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.167376    2560 manager.go:1196] Started watching for new ooms in manager
Sep 17 01:37:22.167698 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.167684    2560 manager.go:349] Starting recovery of all containers
Sep 17 01:37:22.175110 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.175081    2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 01:37:22.177991 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:22.177968    2560 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-143-95.ec2.internal\" not found" node="ip-10-0-143-95.ec2.internal"
Sep 17 01:37:22.181971 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.180492    2560 manager.go:354] Recovery completed
Sep 17 01:37:22.186818 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.186805    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 01:37:22.188567 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.188550    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-95.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 01:37:22.188637 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.188577    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-95.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 01:37:22.188637 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.188587    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-95.ec2.internal" event="NodeHasSufficientPID"
Sep 17 01:37:22.189119 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.189106    2560 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 17 01:37:22.189177 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.189118    2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 17 01:37:22.189177 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.189124    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 01:37:22.189177 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.189135    2560 state_mem.go:36] "Initialized new in-memory state store"
Sep 17 01:37:22.189813 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.189801    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-95.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 01:37:22.189857 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.189824    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-95.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 01:37:22.189857 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.189834    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-95.ec2.internal" event="NodeHasSufficientPID"
Sep 17 01:37:22.191159 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.191147    2560 policy_none.go:49] "None policy: Start"
Sep 17 01:37:22.191205 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.191163    2560 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 17 01:37:22.191205 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.191172    2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 17 01:37:22.193097 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.193086    2560 policy_none.go:47] "Start"
Sep 17 01:37:22.231333 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.231321    2560 manager.go:337] "Starting Device Plugin manager"
Sep 17 01:37:22.231398 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:22.231362    2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 17 01:37:22.231398 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.231372    2560 server.go:87] "Starting device plugin registration server"
Sep 17 01:37:22.231659 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.231645    2560 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 17 01:37:22.231724 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.231661    2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 17 01:37:22.231811 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.231792    2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 17 01:37:22.231928 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.231868    2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 17 01:37:22.231928 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.231877    2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 17 01:37:22.232645 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:22.232622    2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 17 01:37:22.232729 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:22.232678    2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-95.ec2.internal\" not found"
Sep 17 01:37:22.268402 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.268381    2560 container_manager_linux.go:676] "Failed to ensure state" containerName="/system.slice" err="failed to move PID 2589 into the system container \"/system.slice\": <nil>"
Sep 17 01:37:22.332845 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.332769    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 01:37:22.333872 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.333855    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-95.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 01:37:22.353969 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.333890    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-95.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 01:37:22.353969 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.333905    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-95.ec2.internal" event="NodeHasSufficientPID"
Sep 17 01:37:22.353969 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.333937    2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-95.ec2.internal"
Sep 17 01:37:22.353969 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.340528    2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-95.ec2.internal"
Sep 17 01:37:22.353969 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:22.340548    2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-95.ec2.internal\": node \"ip-10-0-143-95.ec2.internal\" not found"
Sep 17 01:37:22.353969 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.348926    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 17 01:37:22.353969 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.350191    2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 17 01:37:22.353969 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.350263    2560 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 17 01:37:22.353969 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.350295    2560 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 17 01:37:22.353969 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:22.350331    2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 17 01:37:22.353969 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.352405    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 01:37:22.359955 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:22.359941    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-95.ec2.internal\" not found"
Sep 17 01:37:22.450814 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.450765    2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-95.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-95.ec2.internal"]
Sep 17 01:37:22.450998 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.450886    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 01:37:22.452815 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.452797    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-95.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 01:37:22.452896 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.452825    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-95.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 01:37:22.452896 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.452835    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-95.ec2.internal" event="NodeHasSufficientPID"
Sep 17 01:37:22.455150 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.455138    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 01:37:22.455282 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.455267    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-95.ec2.internal"
Sep 17 01:37:22.455327 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.455297    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 01:37:22.455889 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.455873    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-95.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 01:37:22.455959 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.455873    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-95.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 01:37:22.455959 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.455928    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-95.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 01:37:22.455959 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.455939    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-95.ec2.internal" event="NodeHasSufficientPID"
Sep 17 01:37:22.455959 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.455909    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-95.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 01:37:22.456086 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.455985    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-95.ec2.internal" event="NodeHasSufficientPID"
Sep 17 01:37:22.458056 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.458039    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-95.ec2.internal"
Sep 17 01:37:22.458153 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.458077    2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 01:37:22.458734 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.458717    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-95.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 01:37:22.458828 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.458749    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-95.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 01:37:22.458828 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.458762    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-95.ec2.internal" event="NodeHasSufficientPID"
Sep 17 01:37:22.460515 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:22.460501    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-95.ec2.internal\" not found"
Sep 17 01:37:22.468403 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.468386    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bca4e8b3696e5d2a45a5c2e759a3cb06-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-95.ec2.internal\" (UID: \"bca4e8b3696e5d2a45a5c2e759a3cb06\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-95.ec2.internal"
Sep 17 01:37:22.468475 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.468410    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bca4e8b3696e5d2a45a5c2e759a3cb06-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-95.ec2.internal\" (UID: \"bca4e8b3696e5d2a45a5c2e759a3cb06\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-95.ec2.internal"
Sep 17 01:37:22.468475 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.468429    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/182c03c78ab71663e42db8a5ead7b76b-config\") pod \"kube-apiserver-proxy-ip-10-0-143-95.ec2.internal\" (UID: \"182c03c78ab71663e42db8a5ead7b76b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-95.ec2.internal"
Sep 17 01:37:22.476798 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:22.476779    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-95.ec2.internal\" not found" node="ip-10-0-143-95.ec2.internal"
Sep 17 01:37:22.480650 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:22.480634    2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-95.ec2.internal\" not found" node="ip-10-0-143-95.ec2.internal"
Sep 17 01:37:22.560869 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:22.560838    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-95.ec2.internal\" not found"
Sep 17 01:37:22.568613 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.568590    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bca4e8b3696e5d2a45a5c2e759a3cb06-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-95.ec2.internal\" (UID: \"bca4e8b3696e5d2a45a5c2e759a3cb06\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-95.ec2.internal"
Sep 17 01:37:22.568695 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.568631    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bca4e8b3696e5d2a45a5c2e759a3cb06-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-95.ec2.internal\" (UID: \"bca4e8b3696e5d2a45a5c2e759a3cb06\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-95.ec2.internal"
Sep 17 01:37:22.568695 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.568662    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/182c03c78ab71663e42db8a5ead7b76b-config\") pod \"kube-apiserver-proxy-ip-10-0-143-95.ec2.internal\" (UID: \"182c03c78ab71663e42db8a5ead7b76b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-95.ec2.internal"
Sep 17 01:37:22.568695 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.568679    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bca4e8b3696e5d2a45a5c2e759a3cb06-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-95.ec2.internal\" (UID: \"bca4e8b3696e5d2a45a5c2e759a3cb06\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-95.ec2.internal"
Sep 17 01:37:22.568789 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.568699    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bca4e8b3696e5d2a45a5c2e759a3cb06-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-95.ec2.internal\" (UID: \"bca4e8b3696e5d2a45a5c2e759a3cb06\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-95.ec2.internal"
Sep 17 01:37:22.568789 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.568723    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/182c03c78ab71663e42db8a5ead7b76b-config\") pod \"kube-apiserver-proxy-ip-10-0-143-95.ec2.internal\" (UID: \"182c03c78ab71663e42db8a5ead7b76b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-95.ec2.internal"
Sep 17 01:37:22.661905 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:22.661822    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-95.ec2.internal\" not found"
Sep 17 01:37:22.762358 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:22.762332    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-95.ec2.internal\" not found"
Sep 17 01:37:22.779764 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.779745    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-95.ec2.internal"
Sep 17 01:37:22.784932 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:22.784913    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-95.ec2.internal"
Sep 17 01:37:22.863422 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:22.863390    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-95.ec2.internal\" not found"
Sep 17 01:37:22.963978 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:22.963894    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-95.ec2.internal\" not found"
Sep 17 01:37:23.066343 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:23.066293    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-95.ec2.internal\" not found"
Sep 17 01:37:23.099106 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:23.099075    2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 17 01:37:23.099602 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:23.099214    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 17 01:37:23.099602 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:23.099270    2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 17 01:37:23.166840 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:23.166799    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-95.ec2.internal\" not found"
Sep 17 01:37:23.171129 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:23.171084    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-16 01:32:22 +0000 UTC" deadline="2028-06-08 04:31:14.525123586 +0000 UTC"
Sep 17 01:37:23.171129 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:23.171119    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15122h53m51.354008757s"
Sep 17 01:37:23.171704 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:23.171687    2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 01:37:23.268051 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:23.267985    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-95.ec2.internal\" not found"
Sep 17 01:37:23.369298 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:23.369103    2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-95.ec2.internal\" not found"
Sep 17 01:37:23.410574 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:23.410543    2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 01:37:23.425779 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:23.425748    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod182c03c78ab71663e42db8a5ead7b76b.slice/crio-fea3c9aae38105695efb33d3249ba2ec9edec4a56095a1aae4c0650cdae476dd WatchSource:0}: Error finding container fea3c9aae38105695efb33d3249ba2ec9edec4a56095a1aae4c0650cdae476dd: Status 404 returned error can't find the container with id fea3c9aae38105695efb33d3249ba2ec9edec4a56095a1aae4c0650cdae476dd
Sep 17 01:37:23.431213 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:23.431196    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 01:37:23.466503 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:23.466473    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-95.ec2.internal"
Sep 17 01:37:23.478674 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:23.478652    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 17 01:37:23.479814 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:23.479801    2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-95.ec2.internal"
Sep 17 01:37:23.488366 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:23.488352    2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 17 01:37:23.608533 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:23.608508    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbca4e8b3696e5d2a45a5c2e759a3cb06.slice/crio-d016cbca224e44e07ab9c4a38624406815514aea78016623da1802f0b51ca3a9 WatchSource:0}: Error finding container d016cbca224e44e07ab9c4a38624406815514aea78016623da1802f0b51ca3a9: Status 404 returned error can't find the container with id d016cbca224e44e07ab9c4a38624406815514aea78016623da1802f0b51ca3a9
Sep 17 01:37:24.144322 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.144285    2560 apiserver.go:52] "Watching apiserver"
Sep 17 01:37:24.149936 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.149751    2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 17 01:37:24.150257 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.150218    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qkl9","openshift-cluster-node-tuning-operator/tuned-x7xcv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-95.ec2.internal","openshift-multus/multus-additional-cni-plugins-5jxkd","openshift-network-diagnostics/network-check-target-t5bgg","openshift-dns/node-resolver-vjfz5","openshift-image-registry/node-ca-tgvzc","openshift-multus/multus-8xnbz","openshift-multus/network-metrics-daemon-p8bbk","openshift-network-operator/iptables-alerter-ts6q2","openshift-ovn-kubernetes/ovnkube-node-4sjxl","kube-system/global-pull-secret-syncer-bzxlf","kube-system/konnectivity-agent-9cvt8","kube-system/kube-apiserver-proxy-ip-10-0-143-95.ec2.internal"]
Sep 17 01:37:24.152992 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.152967    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tgvzc"
Sep 17 01:37:24.155062 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.155041    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 17 01:37:24.155378 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.155043    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 17 01:37:24.155378 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.155318    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 17 01:37:24.155378 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.155346    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mc6jn\""
Sep 17 01:37:24.155583 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.155508    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9cvt8"
Sep 17 01:37:24.157828 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.157563    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 17 01:37:24.157828 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.157548    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-b9vck\""
Sep 17 01:37:24.157828 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.157603    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 17 01:37:24.158053 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.157922    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8xnbz"
Sep 17 01:37:24.159578 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.159555    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 17 01:37:24.159678 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.159567    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 17 01:37:24.159845 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.159829    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 17 01:37:24.159911 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.159857    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 17 01:37:24.160115 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.160098    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2bsqq\""
Sep 17 01:37:24.160408 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.160390    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5jxkd"
Sep 17 01:37:24.162043 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.162023    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 17 01:37:24.162300 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.162248    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 17 01:37:24.162521 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.162499    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mdvvn\""
Sep 17 01:37:24.163103 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.163084    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5bgg"
Sep 17 01:37:24.163224 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:24.163168    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5bgg" podUID="1adde053-a235-4e41-a52e-39e2f75da8a3"
Sep 17 01:37:24.165045 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.165021    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vjfz5"
Sep 17 01:37:24.166768 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.166747    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jsb6n\""
Sep 17 01:37:24.166874 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.166782    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 17 01:37:24.167018 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.166996    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 17 01:37:24.167134 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.167105    2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 17 01:37:24.168246 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.168226    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8bbk"
Sep 17 01:37:24.168390 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:24.168307    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8bbk" podUID="091f4d92-aca2-45ac-9c63-6b73cf983b35"
Sep 17 01:37:24.171125 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.170882    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qkl9"
Sep 17 01:37:24.172615 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.172592    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zwql2\""
Sep 17 01:37:24.172895 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.172872    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 17 01:37:24.173106 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.173087    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 17 01:37:24.173192 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.172881    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 17 01:37:24.173561 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.173525    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x7xcv"
Sep 17 01:37:24.175195 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.175049    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 17 01:37:24.175856 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.175651    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 17 01:37:24.176331 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.176053    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hlcpq\""
Sep 17 01:37:24.178366 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.176624    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ts6q2"
Sep 17 01:37:24.178366 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.177761    2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 17 01:37:24.178366 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.178057    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 17 01:37:24.178366 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.178364    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/777686bc-ef43-4350-9276-ce9cde09811c-hosts-file\") pod \"node-resolver-vjfz5\" (UID: \"777686bc-ef43-4350-9276-ce9cde09811c\") " pod="openshift-dns/node-resolver-vjfz5"
Sep 17 01:37:24.178631 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.178404    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/df44a97e-9c59-4dc9-abd9-3d1bd20972b9-agent-certs\") pod \"konnectivity-agent-9cvt8\" (UID: \"df44a97e-9c59-4dc9-abd9-3d1bd20972b9\") " pod="kube-system/konnectivity-agent-9cvt8"
Sep 17 01:37:24.178631 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.178436    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6-multus-daemon-config\") pod \"multus-8xnbz\" (UID: \"a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6\") " pod="openshift-multus/multus-8xnbz"
Sep 17 01:37:24.178631 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.178470    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8c26e78f-6e4c-489e-98c8-fa49ca563945-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5jxkd\" (UID: \"8c26e78f-6e4c-489e-98c8-fa49ca563945\") " pod="openshift-multus/multus-additional-cni-plugins-5jxkd"
Sep 17 01:37:24.178631 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.178506    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6-host-var-lib-cni-multus\") pod \"multus-8xnbz\" (UID: \"a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6\") " pod="openshift-multus/multus-8xnbz"
Sep 17 01:37:24.178631 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.178533    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvmqn\" (UniqueName: \"kubernetes.io/projected/777686bc-ef43-4350-9276-ce9cde09811c-kube-api-access-hvmqn\") pod \"node-resolver-vjfz5\" (UID: \"777686bc-ef43-4350-9276-ce9cde09811c\") " pod="openshift-dns/node-resolver-vjfz5"
Sep 17 01:37:24.178631 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.178564    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6-system-cni-dir\") pod \"multus-8xnbz\" (UID: \"a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6\") " pod="openshift-multus/multus-8xnbz"
Sep 17 01:37:24.178631 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.178596    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6-host-run-multus-certs\") pod \"multus-8xnbz\" (UID: \"a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6\") " pod="openshift-multus/multus-8xnbz"
Sep 17 01:37:24.178631 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.178628    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6-etc-kubernetes\") pod \"multus-8xnbz\" (UID: \"a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6\") " pod="openshift-multus/multus-8xnbz"
Sep 17 01:37:24.179037 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.178659    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8c26e78f-6e4c-489e-98c8-fa49ca563945-cnibin\") pod \"multus-additional-cni-plugins-5jxkd\" (UID: \"8c26e78f-6e4c-489e-98c8-fa49ca563945\") " pod="openshift-multus/multus-additional-cni-plugins-5jxkd"
Sep 17 01:37:24.179037 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.178687    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6-host-var-lib-cni-bin\") pod \"multus-8xnbz\" (UID: \"a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6\") " pod="openshift-multus/multus-8xnbz"
Sep 17 01:37:24.179037 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.178719    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6-hostroot\") pod \"multus-8xnbz\" (UID: \"a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6\") " pod="openshift-multus/multus-8xnbz"
Sep 17 01:37:24.179037 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.178750    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6-multus-conf-dir\") pod \"multus-8xnbz\" (UID: \"a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6\") " pod="openshift-multus/multus-8xnbz"
Sep 17 01:37:24.179037 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.178780    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/02474a41-dc47-48ca-a66b-8bd035e916bc-serviceca\") pod \"node-ca-tgvzc\" (UID: \"02474a41-dc47-48ca-a66b-8bd035e916bc\") " pod="openshift-image-registry/node-ca-tgvzc"
Sep 17 01:37:24.179037 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.178823    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmlh5\" (UniqueName: \"kubernetes.io/projected/02474a41-dc47-48ca-a66b-8bd035e916bc-kube-api-access-xmlh5\") pod \"node-ca-tgvzc\" (UID: \"02474a41-dc47-48ca-a66b-8bd035e916bc\") " pod="openshift-image-registry/node-ca-tgvzc"
Sep 17 01:37:24.179037 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.178906    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6-cni-binary-copy\") pod \"multus-8xnbz\" (UID: \"a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6\") " pod="openshift-multus/multus-8xnbz"
Sep 17 01:37:24.179037 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.178943    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6-multus-socket-dir-parent\") pod \"multus-8xnbz\" (UID: \"a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6\") " pod="openshift-multus/multus-8xnbz"
Sep 17 01:37:24.179037 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.178980    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/091f4d92-aca2-45ac-9c63-6b73cf983b35-metrics-certs\") pod \"network-metrics-daemon-p8bbk\" (UID: \"091f4d92-aca2-45ac-9c63-6b73cf983b35\") " pod="openshift-multus/network-metrics-daemon-p8bbk"
Sep 17 01:37:24.179037 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.179012    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6gq5\" (UniqueName: \"kubernetes.io/projected/091f4d92-aca2-45ac-9c63-6b73cf983b35-kube-api-access-g6gq5\") pod \"network-metrics-daemon-p8bbk\" (UID: \"091f4d92-aca2-45ac-9c63-6b73cf983b35\") " pod="openshift-multus/network-metrics-daemon-p8bbk"
Sep 17 01:37:24.179037 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.179040    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8c26e78f-6e4c-489e-98c8-fa49ca563945-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5jxkd\" (UID: \"8c26e78f-6e4c-489e-98c8-fa49ca563945\") " pod="openshift-multus/multus-additional-cni-plugins-5jxkd"
Sep 17 01:37:24.179607 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.179084    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/777686bc-ef43-4350-9276-ce9cde09811c-tmp-dir\") pod \"node-resolver-vjfz5\" (UID: \"777686bc-ef43-4350-9276-ce9cde09811c\") " pod="openshift-dns/node-resolver-vjfz5"
Sep 17 01:37:24.179607 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.179125    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6-multus-cni-dir\") pod \"multus-8xnbz\" (UID: \"a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6\") " pod="openshift-multus/multus-8xnbz"
Sep 17 01:37:24.179607 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.179174    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6-cnibin\") pod \"multus-8xnbz\" (UID: \"a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6\") " pod="openshift-multus/multus-8xnbz"
Sep 17 01:37:24.179607 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.179209    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6-host-run-k8s-cni-cncf-io\") pod \"multus-8xnbz\" (UID: \"a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6\") " pod="openshift-multus/multus-8xnbz"
Sep 17 01:37:24.179607 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.179237    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6-host-run-netns\") pod \"multus-8xnbz\" (UID: \"a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6\") " pod="openshift-multus/multus-8xnbz"
Sep 17 01:37:24.179607 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.179289    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6-host-var-lib-kubelet\") pod \"multus-8xnbz\" (UID: \"a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6\") " pod="openshift-multus/multus-8xnbz"
Sep 17 01:37:24.179607 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.179350    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c26e78f-6e4c-489e-98c8-fa49ca563945-system-cni-dir\") pod \"multus-additional-cni-plugins-5jxkd\" (UID: \"8c26e78f-6e4c-489e-98c8-fa49ca563945\") " pod="openshift-multus/multus-additional-cni-plugins-5jxkd"
Sep 17 01:37:24.179607 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.179399    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/df44a97e-9c59-4dc9-abd9-3d1bd20972b9-konnectivity-ca\") pod \"konnectivity-agent-9cvt8\" (UID: \"df44a97e-9c59-4dc9-abd9-3d1bd20972b9\") " pod="kube-system/konnectivity-agent-9cvt8"
Sep 17 01:37:24.179607 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.179434    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/02474a41-dc47-48ca-a66b-8bd035e916bc-host\") pod \"node-ca-tgvzc\" (UID: \"02474a41-dc47-48ca-a66b-8bd035e916bc\") " pod="openshift-image-registry/node-ca-tgvzc"
Sep 17 01:37:24.179607 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.179482    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8c26e78f-6e4c-489e-98c8-fa49ca563945-cni-binary-copy\") pod \"multus-additional-cni-plugins-5jxkd\" (UID: \"8c26e78f-6e4c-489e-98c8-fa49ca563945\") " pod="openshift-multus/multus-additional-cni-plugins-5jxkd"
Sep 17 01:37:24.179607 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.179517    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4x6g5\" (UniqueName: \"kubernetes.io/projected/8c26e78f-6e4c-489e-98c8-fa49ca563945-kube-api-access-4x6g5\") pod \"multus-additional-cni-plugins-5jxkd\" (UID: \"8c26e78f-6e4c-489e-98c8-fa49ca563945\") " pod="openshift-multus/multus-additional-cni-plugins-5jxkd"
Sep 17 01:37:24.179607 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.179596    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zt7t4\" (UniqueName: \"kubernetes.io/projected/1adde053-a235-4e41-a52e-39e2f75da8a3-kube-api-access-zt7t4\") pod \"network-check-target-t5bgg\" (UID: \"1adde053-a235-4e41-a52e-39e2f75da8a3\") " pod="openshift-network-diagnostics/network-check-target-t5bgg"
Sep 17 01:37:24.180231 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.179645    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcchr\" (UniqueName: \"kubernetes.io/projected/a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6-kube-api-access-rcchr\") pod \"multus-8xnbz\" (UID: \"a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6\") " pod="openshift-multus/multus-8xnbz"
Sep 17 01:37:24.180231 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.179739    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8c26e78f-6e4c-489e-98c8-fa49ca563945-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5jxkd\" (UID: \"8c26e78f-6e4c-489e-98c8-fa49ca563945\") " pod="openshift-multus/multus-additional-cni-plugins-5jxkd"
Sep 17 01:37:24.180483 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.180459    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 17 01:37:24.180810 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.180792    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-254nl\""
Sep 17 01:37:24.182712 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.182688    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 17 01:37:24.184374 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.184325    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.186052 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.186025    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 17 01:37:24.186184 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.186166    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 17 01:37:24.186274 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.186237    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 17 01:37:24.186829 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.186807    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 17 01:37:24.186934 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.186830    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzxlf"
Sep 17 01:37:24.186934 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.186853    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-w6c5b\""
Sep 17 01:37:24.186934 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:24.186893    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzxlf" podUID="d0de4f20-0902-4f4f-b1cf-48f5e4119117"
Sep 17 01:37:24.187141 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.186937    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 17 01:37:24.187141 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.187037    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 17 01:37:24.199161 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.199137    2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-n8zgr"
Sep 17 01:37:24.202159 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.202134    2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 01:37:24.207137 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.207110    2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-n8zgr"
Sep 17 01:37:24.268190 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.268163    2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 17 01:37:24.279973 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.279948    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/777686bc-ef43-4350-9276-ce9cde09811c-hosts-file\") pod \"node-resolver-vjfz5\" (UID: \"777686bc-ef43-4350-9276-ce9cde09811c\") " pod="openshift-dns/node-resolver-vjfz5"
Sep 17 01:37:24.280118 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.279979    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6-multus-daemon-config\") pod \"multus-8xnbz\" (UID: \"a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6\") " pod="openshift-multus/multus-8xnbz"
Sep 17 01:37:24.280118 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.279999    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8c26e78f-6e4c-489e-98c8-fa49ca563945-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5jxkd\" (UID: \"8c26e78f-6e4c-489e-98c8-fa49ca563945\") " pod="openshift-multus/multus-additional-cni-plugins-5jxkd"
Sep 17 01:37:24.280118 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.280025    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/38f9ed16-f914-40ea-9002-f639cd385ab1-run\") pod \"tuned-x7xcv\" (UID: \"38f9ed16-f914-40ea-9002-f639cd385ab1\") " pod="openshift-cluster-node-tuning-operator/tuned-x7xcv"
Sep 17 01:37:24.280118 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.280051    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d0de4f20-0902-4f4f-b1cf-48f5e4119117-kubelet-config\") pod \"global-pull-secret-syncer-bzxlf\" (UID: \"d0de4f20-0902-4f4f-b1cf-48f5e4119117\") " pod="kube-system/global-pull-secret-syncer-bzxlf"
Sep 17 01:37:24.280118 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.280078    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e31174bc-2069-49d7-91ad-0ba96101ebb1-registration-dir\") pod \"aws-ebs-csi-driver-node-8qkl9\" (UID: \"e31174bc-2069-49d7-91ad-0ba96101ebb1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qkl9"
Sep 17 01:37:24.280118 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.280107    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0c8eb12a-bc19-47f6-9b1d-c5aabe88546f-host-slash\") pod \"iptables-alerter-ts6q2\" (UID: \"0c8eb12a-bc19-47f6-9b1d-c5aabe88546f\") " pod="openshift-network-operator/iptables-alerter-ts6q2"
Sep 17 01:37:24.280444 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.280132    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-var-lib-openvswitch\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.280444 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.280106    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/777686bc-ef43-4350-9276-ce9cde09811c-hosts-file\") pod \"node-resolver-vjfz5\" (UID: \"777686bc-ef43-4350-9276-ce9cde09811c\") " pod="openshift-dns/node-resolver-vjfz5"
Sep 17 01:37:24.280444 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.280176    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/38f9ed16-f914-40ea-9002-f639cd385ab1-lib-modules\") pod \"tuned-x7xcv\" (UID: \"38f9ed16-f914-40ea-9002-f639cd385ab1\") " pod="openshift-cluster-node-tuning-operator/tuned-x7xcv"
Sep 17 01:37:24.280444 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.280212    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-host-slash\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.280444 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.280259    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvmqn\" (UniqueName: \"kubernetes.io/projected/777686bc-ef43-4350-9276-ce9cde09811c-kube-api-access-hvmqn\") pod \"node-resolver-vjfz5\" (UID: \"777686bc-ef43-4350-9276-ce9cde09811c\") " pod="openshift-dns/node-resolver-vjfz5"
Sep 17 01:37:24.280444 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.280316    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6-system-cni-dir\") pod \"multus-8xnbz\" (UID: \"a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6\") " pod="openshift-multus/multus-8xnbz"
Sep 17 01:37:24.280808 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.280452    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6-system-cni-dir\") pod \"multus-8xnbz\" (UID: \"a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6\") " pod="openshift-multus/multus-8xnbz"
Sep 17 01:37:24.280808 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.280498    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6-etc-kubernetes\") pod \"multus-8xnbz\" (UID: \"a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6\") " pod="openshift-multus/multus-8xnbz"
Sep 17 01:37:24.280808 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.280542    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/38f9ed16-f914-40ea-9002-f639cd385ab1-etc-sysctl-conf\") pod \"tuned-x7xcv\" (UID: \"38f9ed16-f914-40ea-9002-f639cd385ab1\") " pod="openshift-cluster-node-tuning-operator/tuned-x7xcv"
Sep 17 01:37:24.280808 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.280589    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6-etc-kubernetes\") pod \"multus-8xnbz\" (UID: \"a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6\") " pod="openshift-multus/multus-8xnbz"
Sep 17 01:37:24.280808 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.280664    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-host-kubelet\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.280808 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.280693    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-run-systemd\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.280808 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.280719    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-etc-openvswitch\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.280808 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.280744    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e31174bc-2069-49d7-91ad-0ba96101ebb1-socket-dir\") pod \"aws-ebs-csi-driver-node-8qkl9\" (UID: \"e31174bc-2069-49d7-91ad-0ba96101ebb1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qkl9"
Sep 17 01:37:24.280808 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.280753    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8c26e78f-6e4c-489e-98c8-fa49ca563945-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5jxkd\" (UID: \"8c26e78f-6e4c-489e-98c8-fa49ca563945\") " pod="openshift-multus/multus-additional-cni-plugins-5jxkd"
Sep 17 01:37:24.280808 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.280771    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6-hostroot\") pod \"multus-8xnbz\" (UID: \"a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6\") " pod="openshift-multus/multus-8xnbz"
Sep 17 01:37:24.280808 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.280790    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6-multus-conf-dir\") pod \"multus-8xnbz\" (UID: \"a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6\") " pod="openshift-multus/multus-8xnbz"
Sep 17 01:37:24.280808 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.280756    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6-multus-daemon-config\") pod \"multus-8xnbz\" (UID: \"a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6\") " pod="openshift-multus/multus-8xnbz"
Sep 17 01:37:24.281481 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.280812    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmlh5\" (UniqueName: \"kubernetes.io/projected/02474a41-dc47-48ca-a66b-8bd035e916bc-kube-api-access-xmlh5\") pod \"node-ca-tgvzc\" (UID: \"02474a41-dc47-48ca-a66b-8bd035e916bc\") " pod="openshift-image-registry/node-ca-tgvzc"
Sep 17 01:37:24.281481 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.280843    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6-hostroot\") pod \"multus-8xnbz\" (UID: \"a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6\") " pod="openshift-multus/multus-8xnbz"
Sep 17 01:37:24.281481 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.280859    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e31174bc-2069-49d7-91ad-0ba96101ebb1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8qkl9\" (UID: \"e31174bc-2069-49d7-91ad-0ba96101ebb1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qkl9"
Sep 17 01:37:24.281481 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.280865    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6-multus-conf-dir\") pod \"multus-8xnbz\" (UID: \"a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6\") " pod="openshift-multus/multus-8xnbz"
Sep 17 01:37:24.281481 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.280891    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.281481 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.280921    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-ovn-node-metrics-cert\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.281481 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.280954    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6-cni-binary-copy\") pod \"multus-8xnbz\" (UID: \"a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6\") " pod="openshift-multus/multus-8xnbz"
Sep 17 01:37:24.281481 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.280985    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6-multus-socket-dir-parent\") pod \"multus-8xnbz\" (UID: \"a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6\") " pod="openshift-multus/multus-8xnbz"
Sep 17 01:37:24.281481 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.281013    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6gq5\" (UniqueName: \"kubernetes.io/projected/091f4d92-aca2-45ac-9c63-6b73cf983b35-kube-api-access-g6gq5\") pod \"network-metrics-daemon-p8bbk\" (UID: \"091f4d92-aca2-45ac-9c63-6b73cf983b35\") " pod="openshift-multus/network-metrics-daemon-p8bbk"
Sep 17 01:37:24.281481 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.281040    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8c26e78f-6e4c-489e-98c8-fa49ca563945-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5jxkd\" (UID: \"8c26e78f-6e4c-489e-98c8-fa49ca563945\") " pod="openshift-multus/multus-additional-cni-plugins-5jxkd"
Sep 17 01:37:24.281481 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.281065    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/38f9ed16-f914-40ea-9002-f639cd385ab1-host\") pod \"tuned-x7xcv\" (UID: \"38f9ed16-f914-40ea-9002-f639cd385ab1\") " pod="openshift-cluster-node-tuning-operator/tuned-x7xcv"
Sep 17 01:37:24.281481 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.281091    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d0de4f20-0902-4f4f-b1cf-48f5e4119117-dbus\") pod \"global-pull-secret-syncer-bzxlf\" (UID: \"d0de4f20-0902-4f4f-b1cf-48f5e4119117\") " pod="kube-system/global-pull-secret-syncer-bzxlf"
Sep 17 01:37:24.281481 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.281117    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/777686bc-ef43-4350-9276-ce9cde09811c-tmp-dir\") pod \"node-resolver-vjfz5\" (UID: \"777686bc-ef43-4350-9276-ce9cde09811c\") " pod="openshift-dns/node-resolver-vjfz5"
Sep 17 01:37:24.281481 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.281143    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6-cnibin\") pod \"multus-8xnbz\" (UID: \"a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6\") " pod="openshift-multus/multus-8xnbz"
Sep 17 01:37:24.281481 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.281160    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6-multus-socket-dir-parent\") pod \"multus-8xnbz\" (UID: \"a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6\") " pod="openshift-multus/multus-8xnbz"
Sep 17 01:37:24.281481 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.281169    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6-host-run-k8s-cni-cncf-io\") pod \"multus-8xnbz\" (UID: \"a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6\") " pod="openshift-multus/multus-8xnbz"
Sep 17 01:37:24.281481 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.281215    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6-host-run-k8s-cni-cncf-io\") pod \"multus-8xnbz\" (UID: \"a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6\") " pod="openshift-multus/multus-8xnbz"
Sep 17 01:37:24.282294 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.281217    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6-host-run-netns\") pod \"multus-8xnbz\" (UID: \"a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6\") " pod="openshift-multus/multus-8xnbz"
Sep 17 01:37:24.282294 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.281251    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6-host-run-netns\") pod \"multus-8xnbz\" (UID: \"a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6\") " pod="openshift-multus/multus-8xnbz"
Sep 17 01:37:24.282294 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.281254    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38f9ed16-f914-40ea-9002-f639cd385ab1-sys\") pod \"tuned-x7xcv\" (UID: \"38f9ed16-f914-40ea-9002-f639cd385ab1\") " pod="openshift-cluster-node-tuning-operator/tuned-x7xcv"
Sep 17 01:37:24.282294 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.281250    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8c26e78f-6e4c-489e-98c8-fa49ca563945-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5jxkd\" (UID: \"8c26e78f-6e4c-489e-98c8-fa49ca563945\") " pod="openshift-multus/multus-additional-cni-plugins-5jxkd"
Sep 17 01:37:24.282294 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.281408    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-host-run-netns\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.282294 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.281443    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/df44a97e-9c59-4dc9-abd9-3d1bd20972b9-konnectivity-ca\") pod \"konnectivity-agent-9cvt8\" (UID: \"df44a97e-9c59-4dc9-abd9-3d1bd20972b9\") " pod="kube-system/konnectivity-agent-9cvt8"
Sep 17 01:37:24.282294 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.281484    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/02474a41-dc47-48ca-a66b-8bd035e916bc-host\") pod \"node-ca-tgvzc\" (UID: \"02474a41-dc47-48ca-a66b-8bd035e916bc\") " pod="openshift-image-registry/node-ca-tgvzc"
Sep 17 01:37:24.282294 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.281505    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-run-ovn\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.282294 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.281542    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6-cni-binary-copy\") pod \"multus-8xnbz\" (UID: \"a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6\") " pod="openshift-multus/multus-8xnbz"
Sep 17 01:37:24.282294 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.281553    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/02474a41-dc47-48ca-a66b-8bd035e916bc-host\") pod \"node-ca-tgvzc\" (UID: \"02474a41-dc47-48ca-a66b-8bd035e916bc\") " pod="openshift-image-registry/node-ca-tgvzc"
Sep 17 01:37:24.282294 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.281591    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcchr\" (UniqueName: \"kubernetes.io/projected/a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6-kube-api-access-rcchr\") pod \"multus-8xnbz\" (UID: \"a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6\") " pod="openshift-multus/multus-8xnbz"
Sep 17 01:37:24.282294 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.281623    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/777686bc-ef43-4350-9276-ce9cde09811c-tmp-dir\") pod \"node-resolver-vjfz5\" (UID: \"777686bc-ef43-4350-9276-ce9cde09811c\") " pod="openshift-dns/node-resolver-vjfz5"
Sep 17 01:37:24.282294 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.281640    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8c26e78f-6e4c-489e-98c8-fa49ca563945-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5jxkd\" (UID: \"8c26e78f-6e4c-489e-98c8-fa49ca563945\") " pod="openshift-multus/multus-additional-cni-plugins-5jxkd"
Sep 17 01:37:24.282294 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.281655    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6-cnibin\") pod \"multus-8xnbz\" (UID: \"a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6\") " pod="openshift-multus/multus-8xnbz"
Sep 17 01:37:24.282294 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.281673    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/38f9ed16-f914-40ea-9002-f639cd385ab1-etc-sysctl-d\") pod \"tuned-x7xcv\" (UID: \"38f9ed16-f914-40ea-9002-f639cd385ab1\") " pod="openshift-cluster-node-tuning-operator/tuned-x7xcv"
Sep 17 01:37:24.282294 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.281789    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/38f9ed16-f914-40ea-9002-f639cd385ab1-var-lib-kubelet\") pod \"tuned-x7xcv\" (UID: \"38f9ed16-f914-40ea-9002-f639cd385ab1\") " pod="openshift-cluster-node-tuning-operator/tuned-x7xcv"
Sep 17 01:37:24.282294 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.281816    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/df44a97e-9c59-4dc9-abd9-3d1bd20972b9-agent-certs\") pod \"konnectivity-agent-9cvt8\" (UID: \"df44a97e-9c59-4dc9-abd9-3d1bd20972b9\") " pod="kube-system/konnectivity-agent-9cvt8"
Sep 17 01:37:24.282294 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.281878    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/38f9ed16-f914-40ea-9002-f639cd385ab1-etc-tuned\") pod \"tuned-x7xcv\" (UID: \"38f9ed16-f914-40ea-9002-f639cd385ab1\") " pod="openshift-cluster-node-tuning-operator/tuned-x7xcv"
Sep 17 01:37:24.283217 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.281910    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e31174bc-2069-49d7-91ad-0ba96101ebb1-device-dir\") pod \"aws-ebs-csi-driver-node-8qkl9\" (UID: \"e31174bc-2069-49d7-91ad-0ba96101ebb1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qkl9"
Sep 17 01:37:24.283217 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.281946    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6-host-var-lib-cni-multus\") pod \"multus-8xnbz\" (UID: \"a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6\") " pod="openshift-multus/multus-8xnbz"
Sep 17 01:37:24.283217 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.281970    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-host-cni-bin\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.283217 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.281986    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/df44a97e-9c59-4dc9-abd9-3d1bd20972b9-konnectivity-ca\") pod \"konnectivity-agent-9cvt8\" (UID: \"df44a97e-9c59-4dc9-abd9-3d1bd20972b9\") " pod="kube-system/konnectivity-agent-9cvt8"
Sep 17 01:37:24.283217 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.281996    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6-host-run-multus-certs\") pod \"multus-8xnbz\" (UID: \"a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6\") " pod="openshift-multus/multus-8xnbz"
Sep 17 01:37:24.283217 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.282031    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8c26e78f-6e4c-489e-98c8-fa49ca563945-cnibin\") pod \"multus-additional-cni-plugins-5jxkd\" (UID: \"8c26e78f-6e4c-489e-98c8-fa49ca563945\") " pod="openshift-multus/multus-additional-cni-plugins-5jxkd"
Sep 17 01:37:24.283217 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.282033    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6-host-var-lib-cni-multus\") pod \"multus-8xnbz\" (UID: \"a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6\") " pod="openshift-multus/multus-8xnbz"
Sep 17 01:37:24.283217 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.282042    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6-host-run-multus-certs\") pod \"multus-8xnbz\" (UID: \"a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6\") " pod="openshift-multus/multus-8xnbz"
Sep 17 01:37:24.283217 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.282060    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/38f9ed16-f914-40ea-9002-f639cd385ab1-etc-sysconfig\") pod \"tuned-x7xcv\" (UID: \"38f9ed16-f914-40ea-9002-f639cd385ab1\") " pod="openshift-cluster-node-tuning-operator/tuned-x7xcv"
Sep 17 01:37:24.283217 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.282087    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8c26e78f-6e4c-489e-98c8-fa49ca563945-cnibin\") pod \"multus-additional-cni-plugins-5jxkd\" (UID: \"8c26e78f-6e4c-489e-98c8-fa49ca563945\") " pod="openshift-multus/multus-additional-cni-plugins-5jxkd"
Sep 17 01:37:24.283217 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.282090    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d0de4f20-0902-4f4f-b1cf-48f5e4119117-original-pull-secret\") pod \"global-pull-secret-syncer-bzxlf\" (UID: \"d0de4f20-0902-4f4f-b1cf-48f5e4119117\") " pod="kube-system/global-pull-secret-syncer-bzxlf"
Sep 17 01:37:24.283217 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.282122    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-log-socket\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.283217 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.282127    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8c26e78f-6e4c-489e-98c8-fa49ca563945-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5jxkd\" (UID: \"8c26e78f-6e4c-489e-98c8-fa49ca563945\") " pod="openshift-multus/multus-additional-cni-plugins-5jxkd"
Sep 17 01:37:24.283217 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.282142    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-env-overrides\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.283217 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.282159    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-ovnkube-script-lib\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.283217 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.282180    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6-host-var-lib-cni-bin\") pod \"multus-8xnbz\" (UID: \"a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6\") " pod="openshift-multus/multus-8xnbz"
Sep 17 01:37:24.283217 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.282210    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/02474a41-dc47-48ca-a66b-8bd035e916bc-serviceca\") pod \"node-ca-tgvzc\" (UID: \"02474a41-dc47-48ca-a66b-8bd035e916bc\") " pod="openshift-image-registry/node-ca-tgvzc"
Sep 17 01:37:24.283981 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.282235    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6-host-var-lib-cni-bin\") pod \"multus-8xnbz\" (UID: \"a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6\") " pod="openshift-multus/multus-8xnbz"
Sep 17 01:37:24.283981 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.282268    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/38f9ed16-f914-40ea-9002-f639cd385ab1-etc-modprobe-d\") pod \"tuned-x7xcv\" (UID: \"38f9ed16-f914-40ea-9002-f639cd385ab1\") " pod="openshift-cluster-node-tuning-operator/tuned-x7xcv"
Sep 17 01:37:24.283981 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.282367    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-host-cni-netd\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.283981 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.282413    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89zlv\" (UniqueName: \"kubernetes.io/projected/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-kube-api-access-89zlv\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.283981 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.282460    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/091f4d92-aca2-45ac-9c63-6b73cf983b35-metrics-certs\") pod \"network-metrics-daemon-p8bbk\" (UID: \"091f4d92-aca2-45ac-9c63-6b73cf983b35\") " pod="openshift-multus/network-metrics-daemon-p8bbk"
Sep 17 01:37:24.283981 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.282488    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38f9ed16-f914-40ea-9002-f639cd385ab1-etc-kubernetes\") pod \"tuned-x7xcv\" (UID: \"38f9ed16-f914-40ea-9002-f639cd385ab1\") " pod="openshift-cluster-node-tuning-operator/tuned-x7xcv"
Sep 17 01:37:24.283981 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.282514    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-run-openvswitch\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.283981 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.282540    2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 17 01:37:24.283981 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.282572    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6-multus-cni-dir\") pod \"multus-8xnbz\" (UID: \"a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6\") " pod="openshift-multus/multus-8xnbz"
Sep 17 01:37:24.283981 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:24.282667    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 01:37:24.283981 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.282703    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6-host-var-lib-kubelet\") pod \"multus-8xnbz\" (UID: \"a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6\") " pod="openshift-multus/multus-8xnbz"
Sep 17 01:37:24.283981 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.282720    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/02474a41-dc47-48ca-a66b-8bd035e916bc-serviceca\") pod \"node-ca-tgvzc\" (UID: \"02474a41-dc47-48ca-a66b-8bd035e916bc\") " pod="openshift-image-registry/node-ca-tgvzc"
Sep 17 01:37:24.283981 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.282730    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c26e78f-6e4c-489e-98c8-fa49ca563945-system-cni-dir\") pod \"multus-additional-cni-plugins-5jxkd\" (UID: \"8c26e78f-6e4c-489e-98c8-fa49ca563945\") " pod="openshift-multus/multus-additional-cni-plugins-5jxkd"
Sep 17 01:37:24.283981 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.282757    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8c26e78f-6e4c-489e-98c8-fa49ca563945-cni-binary-copy\") pod \"multus-additional-cni-plugins-5jxkd\" (UID: \"8c26e78f-6e4c-489e-98c8-fa49ca563945\") " pod="openshift-multus/multus-additional-cni-plugins-5jxkd"
Sep 17 01:37:24.283981 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.282784    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4x6g5\" (UniqueName: \"kubernetes.io/projected/8c26e78f-6e4c-489e-98c8-fa49ca563945-kube-api-access-4x6g5\") pod \"multus-additional-cni-plugins-5jxkd\" (UID: \"8c26e78f-6e4c-489e-98c8-fa49ca563945\") " pod="openshift-multus/multus-additional-cni-plugins-5jxkd"
Sep 17 01:37:24.283981 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.282815    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt7t4\" (UniqueName: \"kubernetes.io/projected/1adde053-a235-4e41-a52e-39e2f75da8a3-kube-api-access-zt7t4\") pod \"network-check-target-t5bgg\" (UID: \"1adde053-a235-4e41-a52e-39e2f75da8a3\") " pod="openshift-network-diagnostics/network-check-target-t5bgg"
Sep 17 01:37:24.283981 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:24.282849    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/091f4d92-aca2-45ac-9c63-6b73cf983b35-metrics-certs podName:091f4d92-aca2-45ac-9c63-6b73cf983b35 nodeName:}" failed. No retries permitted until 2026-09-17 01:37:24.782809814 +0000 UTC m=+3.032787107 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/091f4d92-aca2-45ac-9c63-6b73cf983b35-metrics-certs") pod "network-metrics-daemon-p8bbk" (UID: "091f4d92-aca2-45ac-9c63-6b73cf983b35") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 01:37:24.284574 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.283017    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/38f9ed16-f914-40ea-9002-f639cd385ab1-etc-systemd\") pod \"tuned-x7xcv\" (UID: \"38f9ed16-f914-40ea-9002-f639cd385ab1\") " pod="openshift-cluster-node-tuning-operator/tuned-x7xcv"
Sep 17 01:37:24.284574 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.283055    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjf6f\" (UniqueName: \"kubernetes.io/projected/38f9ed16-f914-40ea-9002-f639cd385ab1-kube-api-access-zjf6f\") pod \"tuned-x7xcv\" (UID: \"38f9ed16-f914-40ea-9002-f639cd385ab1\") " pod="openshift-cluster-node-tuning-operator/tuned-x7xcv"
Sep 17 01:37:24.284574 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.283098    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e31174bc-2069-49d7-91ad-0ba96101ebb1-etc-selinux\") pod \"aws-ebs-csi-driver-node-8qkl9\" (UID: \"e31174bc-2069-49d7-91ad-0ba96101ebb1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qkl9"
Sep 17 01:37:24.284574 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.283132    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e31174bc-2069-49d7-91ad-0ba96101ebb1-sys-fs\") pod \"aws-ebs-csi-driver-node-8qkl9\" (UID: \"e31174bc-2069-49d7-91ad-0ba96101ebb1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qkl9"
Sep 17 01:37:24.284574 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.283131    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c26e78f-6e4c-489e-98c8-fa49ca563945-system-cni-dir\") pod \"multus-additional-cni-plugins-5jxkd\" (UID: \"8c26e78f-6e4c-489e-98c8-fa49ca563945\") " pod="openshift-multus/multus-additional-cni-plugins-5jxkd"
Sep 17 01:37:24.284574 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.283185    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6-host-var-lib-kubelet\") pod \"multus-8xnbz\" (UID: \"a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6\") " pod="openshift-multus/multus-8xnbz"
Sep 17 01:37:24.284574 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.283226    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6-multus-cni-dir\") pod \"multus-8xnbz\" (UID: \"a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6\") " pod="openshift-multus/multus-8xnbz"
Sep 17 01:37:24.284574 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.283225    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nj77m\" (UniqueName: \"kubernetes.io/projected/e31174bc-2069-49d7-91ad-0ba96101ebb1-kube-api-access-nj77m\") pod \"aws-ebs-csi-driver-node-8qkl9\" (UID: \"e31174bc-2069-49d7-91ad-0ba96101ebb1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qkl9"
Sep 17 01:37:24.284574 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.283287    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0c8eb12a-bc19-47f6-9b1d-c5aabe88546f-iptables-alerter-script\") pod \"iptables-alerter-ts6q2\" (UID: \"0c8eb12a-bc19-47f6-9b1d-c5aabe88546f\") " pod="openshift-network-operator/iptables-alerter-ts6q2"
Sep 17 01:37:24.284574 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.283380    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-systemd-units\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.284574 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.283419    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-ovnkube-config\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.284574 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.283447    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38f9ed16-f914-40ea-9002-f639cd385ab1-tmp\") pod \"tuned-x7xcv\" (UID: \"38f9ed16-f914-40ea-9002-f639cd385ab1\") " pod="openshift-cluster-node-tuning-operator/tuned-x7xcv"
Sep 17 01:37:24.284574 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.283497    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qvlm\" (UniqueName: \"kubernetes.io/projected/0c8eb12a-bc19-47f6-9b1d-c5aabe88546f-kube-api-access-4qvlm\") pod \"iptables-alerter-ts6q2\" (UID: \"0c8eb12a-bc19-47f6-9b1d-c5aabe88546f\") " pod="openshift-network-operator/iptables-alerter-ts6q2"
Sep 17 01:37:24.284574 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.283541    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-node-log\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.284574 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.283576    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-host-run-ovn-kubernetes\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.284574 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.283671    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8c26e78f-6e4c-489e-98c8-fa49ca563945-cni-binary-copy\") pod \"multus-additional-cni-plugins-5jxkd\" (UID: \"8c26e78f-6e4c-489e-98c8-fa49ca563945\") " pod="openshift-multus/multus-additional-cni-plugins-5jxkd"
Sep 17 01:37:24.288263 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.287886    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/df44a97e-9c59-4dc9-abd9-3d1bd20972b9-agent-certs\") pod \"konnectivity-agent-9cvt8\" (UID: \"df44a97e-9c59-4dc9-abd9-3d1bd20972b9\") " pod="kube-system/konnectivity-agent-9cvt8"
Sep 17 01:37:24.289384 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.289216    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmlh5\" (UniqueName: \"kubernetes.io/projected/02474a41-dc47-48ca-a66b-8bd035e916bc-kube-api-access-xmlh5\") pod \"node-ca-tgvzc\" (UID: \"02474a41-dc47-48ca-a66b-8bd035e916bc\") " pod="openshift-image-registry/node-ca-tgvzc"
Sep 17 01:37:24.289482 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.289389    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvmqn\" (UniqueName: \"kubernetes.io/projected/777686bc-ef43-4350-9276-ce9cde09811c-kube-api-access-hvmqn\") pod \"node-resolver-vjfz5\" (UID: \"777686bc-ef43-4350-9276-ce9cde09811c\") " pod="openshift-dns/node-resolver-vjfz5"
Sep 17 01:37:24.290217 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.290190    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcchr\" (UniqueName: \"kubernetes.io/projected/a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6-kube-api-access-rcchr\") pod \"multus-8xnbz\" (UID: \"a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6\") " pod="openshift-multus/multus-8xnbz"
Sep 17 01:37:24.291517 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:24.291492    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 01:37:24.291517 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:24.291519    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 01:37:24.291709 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:24.291533    2560 projected.go:196] Error preparing data for projected volume kube-api-access-zt7t4 for pod openshift-network-diagnostics/network-check-target-t5bgg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 01:37:24.291709 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:24.291592    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1adde053-a235-4e41-a52e-39e2f75da8a3-kube-api-access-zt7t4 podName:1adde053-a235-4e41-a52e-39e2f75da8a3 nodeName:}" failed. No retries permitted until 2026-09-17 01:37:24.791574044 +0000 UTC m=+3.041551355 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zt7t4" (UniqueName: "kubernetes.io/projected/1adde053-a235-4e41-a52e-39e2f75da8a3-kube-api-access-zt7t4") pod "network-check-target-t5bgg" (UID: "1adde053-a235-4e41-a52e-39e2f75da8a3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 01:37:24.291709 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.291621    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6gq5\" (UniqueName: \"kubernetes.io/projected/091f4d92-aca2-45ac-9c63-6b73cf983b35-kube-api-access-g6gq5\") pod \"network-metrics-daemon-p8bbk\" (UID: \"091f4d92-aca2-45ac-9c63-6b73cf983b35\") " pod="openshift-multus/network-metrics-daemon-p8bbk"
Sep 17 01:37:24.293743 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.293707    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4x6g5\" (UniqueName: \"kubernetes.io/projected/8c26e78f-6e4c-489e-98c8-fa49ca563945-kube-api-access-4x6g5\") pod \"multus-additional-cni-plugins-5jxkd\" (UID: \"8c26e78f-6e4c-489e-98c8-fa49ca563945\") " pod="openshift-multus/multus-additional-cni-plugins-5jxkd"
Sep 17 01:37:24.356324 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.356265    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-95.ec2.internal" event={"ID":"bca4e8b3696e5d2a45a5c2e759a3cb06","Type":"ContainerStarted","Data":"d016cbca224e44e07ab9c4a38624406815514aea78016623da1802f0b51ca3a9"}
Sep 17 01:37:24.357670 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.357630    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-95.ec2.internal" event={"ID":"182c03c78ab71663e42db8a5ead7b76b","Type":"ContainerStarted","Data":"fea3c9aae38105695efb33d3249ba2ec9edec4a56095a1aae4c0650cdae476dd"}
Sep 17 01:37:24.384371 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.384340    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/38f9ed16-f914-40ea-9002-f639cd385ab1-etc-tuned\") pod \"tuned-x7xcv\" (UID: \"38f9ed16-f914-40ea-9002-f639cd385ab1\") " pod="openshift-cluster-node-tuning-operator/tuned-x7xcv"
Sep 17 01:37:24.384529 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.384380    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e31174bc-2069-49d7-91ad-0ba96101ebb1-device-dir\") pod \"aws-ebs-csi-driver-node-8qkl9\" (UID: \"e31174bc-2069-49d7-91ad-0ba96101ebb1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qkl9"
Sep 17 01:37:24.384529 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.384457    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e31174bc-2069-49d7-91ad-0ba96101ebb1-device-dir\") pod \"aws-ebs-csi-driver-node-8qkl9\" (UID: \"e31174bc-2069-49d7-91ad-0ba96101ebb1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qkl9"
Sep 17 01:37:24.384529 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.384479    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-host-cni-bin\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.384529 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.384520    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/38f9ed16-f914-40ea-9002-f639cd385ab1-etc-sysconfig\") pod \"tuned-x7xcv\" (UID: \"38f9ed16-f914-40ea-9002-f639cd385ab1\") " pod="openshift-cluster-node-tuning-operator/tuned-x7xcv"
Sep 17 01:37:24.384741 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.384548    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d0de4f20-0902-4f4f-b1cf-48f5e4119117-original-pull-secret\") pod \"global-pull-secret-syncer-bzxlf\" (UID: \"d0de4f20-0902-4f4f-b1cf-48f5e4119117\") " pod="kube-system/global-pull-secret-syncer-bzxlf"
Sep 17 01:37:24.384741 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.384575    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-log-socket\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.384741 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.384601    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-env-overrides\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.384741 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.384606    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/38f9ed16-f914-40ea-9002-f639cd385ab1-etc-sysconfig\") pod \"tuned-x7xcv\" (UID: \"38f9ed16-f914-40ea-9002-f639cd385ab1\") " pod="openshift-cluster-node-tuning-operator/tuned-x7xcv"
Sep 17 01:37:24.384741 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.384626    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-ovnkube-script-lib\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.384741 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.384626    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-host-cni-bin\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.384741 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.384654    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/38f9ed16-f914-40ea-9002-f639cd385ab1-etc-modprobe-d\") pod \"tuned-x7xcv\" (UID: \"38f9ed16-f914-40ea-9002-f639cd385ab1\") " pod="openshift-cluster-node-tuning-operator/tuned-x7xcv"
Sep 17 01:37:24.384741 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.384656    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-log-socket\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.384741 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.384705    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-host-cni-netd\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.384741 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.384739    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89zlv\" (UniqueName: \"kubernetes.io/projected/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-kube-api-access-89zlv\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.385254 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.384781    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38f9ed16-f914-40ea-9002-f639cd385ab1-etc-kubernetes\") pod \"tuned-x7xcv\" (UID: \"38f9ed16-f914-40ea-9002-f639cd385ab1\") " pod="openshift-cluster-node-tuning-operator/tuned-x7xcv"
Sep 17 01:37:24.385254 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:24.384802    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 01:37:24.385254 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.384819    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-host-cni-netd\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.385254 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.384844    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-run-openvswitch\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.385254 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:24.384884    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0de4f20-0902-4f4f-b1cf-48f5e4119117-original-pull-secret podName:d0de4f20-0902-4f4f-b1cf-48f5e4119117 nodeName:}" failed. No retries permitted until 2026-09-17 01:37:24.884860106 +0000 UTC m=+3.134837417 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d0de4f20-0902-4f4f-b1cf-48f5e4119117-original-pull-secret") pod "global-pull-secret-syncer-bzxlf" (UID: "d0de4f20-0902-4f4f-b1cf-48f5e4119117") : object "kube-system"/"original-pull-secret" not registered
Sep 17 01:37:24.385254 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.384808    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-run-openvswitch\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.385254 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.384939    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/38f9ed16-f914-40ea-9002-f639cd385ab1-etc-systemd\") pod \"tuned-x7xcv\" (UID: \"38f9ed16-f914-40ea-9002-f639cd385ab1\") " pod="openshift-cluster-node-tuning-operator/tuned-x7xcv"
Sep 17 01:37:24.385254 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.384971    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjf6f\" (UniqueName: \"kubernetes.io/projected/38f9ed16-f914-40ea-9002-f639cd385ab1-kube-api-access-zjf6f\") pod \"tuned-x7xcv\" (UID: \"38f9ed16-f914-40ea-9002-f639cd385ab1\") " pod="openshift-cluster-node-tuning-operator/tuned-x7xcv"
Sep 17 01:37:24.385254 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.384975    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/38f9ed16-f914-40ea-9002-f639cd385ab1-etc-modprobe-d\") pod \"tuned-x7xcv\" (UID: \"38f9ed16-f914-40ea-9002-f639cd385ab1\") " pod="openshift-cluster-node-tuning-operator/tuned-x7xcv"
Sep 17 01:37:24.385254 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.384887    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/38f9ed16-f914-40ea-9002-f639cd385ab1-etc-kubernetes\") pod \"tuned-x7xcv\" (UID: \"38f9ed16-f914-40ea-9002-f639cd385ab1\") " pod="openshift-cluster-node-tuning-operator/tuned-x7xcv"
Sep 17 01:37:24.385254 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.384997    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e31174bc-2069-49d7-91ad-0ba96101ebb1-etc-selinux\") pod \"aws-ebs-csi-driver-node-8qkl9\" (UID: \"e31174bc-2069-49d7-91ad-0ba96101ebb1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qkl9"
Sep 17 01:37:24.385254 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.385018    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/38f9ed16-f914-40ea-9002-f639cd385ab1-etc-systemd\") pod \"tuned-x7xcv\" (UID: \"38f9ed16-f914-40ea-9002-f639cd385ab1\") " pod="openshift-cluster-node-tuning-operator/tuned-x7xcv"
Sep 17 01:37:24.385254 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.385045    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e31174bc-2069-49d7-91ad-0ba96101ebb1-sys-fs\") pod \"aws-ebs-csi-driver-node-8qkl9\" (UID: \"e31174bc-2069-49d7-91ad-0ba96101ebb1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qkl9"
Sep 17 01:37:24.385254 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.385078    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nj77m\" (UniqueName: \"kubernetes.io/projected/e31174bc-2069-49d7-91ad-0ba96101ebb1-kube-api-access-nj77m\") pod \"aws-ebs-csi-driver-node-8qkl9\" (UID: \"e31174bc-2069-49d7-91ad-0ba96101ebb1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qkl9"
Sep 17 01:37:24.385254 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.385109    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0c8eb12a-bc19-47f6-9b1d-c5aabe88546f-iptables-alerter-script\") pod \"iptables-alerter-ts6q2\" (UID: \"0c8eb12a-bc19-47f6-9b1d-c5aabe88546f\") " pod="openshift-network-operator/iptables-alerter-ts6q2"
Sep 17 01:37:24.385254 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.385112    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e31174bc-2069-49d7-91ad-0ba96101ebb1-etc-selinux\") pod \"aws-ebs-csi-driver-node-8qkl9\" (UID: \"e31174bc-2069-49d7-91ad-0ba96101ebb1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qkl9"
Sep 17 01:37:24.385254 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.385136    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-systemd-units\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.386083 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.385153    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e31174bc-2069-49d7-91ad-0ba96101ebb1-sys-fs\") pod \"aws-ebs-csi-driver-node-8qkl9\" (UID: \"e31174bc-2069-49d7-91ad-0ba96101ebb1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qkl9"
Sep 17 01:37:24.386083 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.385163    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-env-overrides\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.386083 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.385356    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-ovnkube-config\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.386083 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.385372    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-ovnkube-script-lib\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.386083 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.385408    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-systemd-units\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.386083 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.385385    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38f9ed16-f914-40ea-9002-f639cd385ab1-tmp\") pod \"tuned-x7xcv\" (UID: \"38f9ed16-f914-40ea-9002-f639cd385ab1\") " pod="openshift-cluster-node-tuning-operator/tuned-x7xcv"
Sep 17 01:37:24.386083 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.385455    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qvlm\" (UniqueName: \"kubernetes.io/projected/0c8eb12a-bc19-47f6-9b1d-c5aabe88546f-kube-api-access-4qvlm\") pod \"iptables-alerter-ts6q2\" (UID: \"0c8eb12a-bc19-47f6-9b1d-c5aabe88546f\") " pod="openshift-network-operator/iptables-alerter-ts6q2"
Sep 17 01:37:24.386083 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.385482    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-node-log\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.386083 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.385507    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-host-run-ovn-kubernetes\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.386083 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.385533    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/38f9ed16-f914-40ea-9002-f639cd385ab1-run\") pod \"tuned-x7xcv\" (UID: \"38f9ed16-f914-40ea-9002-f639cd385ab1\") " pod="openshift-cluster-node-tuning-operator/tuned-x7xcv"
Sep 17 01:37:24.386083 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.385557    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d0de4f20-0902-4f4f-b1cf-48f5e4119117-kubelet-config\") pod \"global-pull-secret-syncer-bzxlf\" (UID: \"d0de4f20-0902-4f4f-b1cf-48f5e4119117\") " pod="kube-system/global-pull-secret-syncer-bzxlf"
Sep 17 01:37:24.386083 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.385583    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e31174bc-2069-49d7-91ad-0ba96101ebb1-registration-dir\") pod \"aws-ebs-csi-driver-node-8qkl9\" (UID: \"e31174bc-2069-49d7-91ad-0ba96101ebb1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qkl9"
Sep 17 01:37:24.386083 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.385612    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0c8eb12a-bc19-47f6-9b1d-c5aabe88546f-host-slash\") pod \"iptables-alerter-ts6q2\" (UID: \"0c8eb12a-bc19-47f6-9b1d-c5aabe88546f\") " pod="openshift-network-operator/iptables-alerter-ts6q2"
Sep 17 01:37:24.386083 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.385685    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-var-lib-openvswitch\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.386083 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.385711    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/38f9ed16-f914-40ea-9002-f639cd385ab1-lib-modules\") pod \"tuned-x7xcv\" (UID: \"38f9ed16-f914-40ea-9002-f639cd385ab1\") " pod="openshift-cluster-node-tuning-operator/tuned-x7xcv"
Sep 17 01:37:24.386083 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.385737    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-host-slash\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.386083 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.385767    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/38f9ed16-f914-40ea-9002-f639cd385ab1-etc-sysctl-conf\") pod \"tuned-x7xcv\" (UID: \"38f9ed16-f914-40ea-9002-f639cd385ab1\") " pod="openshift-cluster-node-tuning-operator/tuned-x7xcv"
Sep 17 01:37:24.386985 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.385791    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-host-kubelet\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.386985 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.385801    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0c8eb12a-bc19-47f6-9b1d-c5aabe88546f-iptables-alerter-script\") pod \"iptables-alerter-ts6q2\" (UID: \"0c8eb12a-bc19-47f6-9b1d-c5aabe88546f\") " pod="openshift-network-operator/iptables-alerter-ts6q2"
Sep 17 01:37:24.386985 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.385816    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-run-systemd\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.386985 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.385841    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-etc-openvswitch\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.386985 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.385862    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-ovnkube-config\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.386985 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.385871    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-node-log\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.386985 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.385868    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e31174bc-2069-49d7-91ad-0ba96101ebb1-socket-dir\") pod \"aws-ebs-csi-driver-node-8qkl9\" (UID: \"e31174bc-2069-49d7-91ad-0ba96101ebb1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qkl9"
Sep 17 01:37:24.386985 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.385899    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-var-lib-openvswitch\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.386985 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.385924    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-host-slash\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.386985 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.385949    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e31174bc-2069-49d7-91ad-0ba96101ebb1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8qkl9\" (UID: \"e31174bc-2069-49d7-91ad-0ba96101ebb1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qkl9"
Sep 17 01:37:24.386985 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.385955    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-host-kubelet\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.386985 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.385971    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e31174bc-2069-49d7-91ad-0ba96101ebb1-socket-dir\") pod \"aws-ebs-csi-driver-node-8qkl9\" (UID: \"e31174bc-2069-49d7-91ad-0ba96101ebb1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qkl9"
Sep 17 01:37:24.386985 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.385978    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-run-systemd\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.386985 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.385981    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.386985 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.386007    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-ovn-node-metrics-cert\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.386985 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.386060    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0c8eb12a-bc19-47f6-9b1d-c5aabe88546f-host-slash\") pod \"iptables-alerter-ts6q2\" (UID: \"0c8eb12a-bc19-47f6-9b1d-c5aabe88546f\") " pod="openshift-network-operator/iptables-alerter-ts6q2"
Sep 17 01:37:24.386985 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.386056    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-etc-openvswitch\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.387870 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.386078    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/38f9ed16-f914-40ea-9002-f639cd385ab1-lib-modules\") pod \"tuned-x7xcv\" (UID: \"38f9ed16-f914-40ea-9002-f639cd385ab1\") " pod="openshift-cluster-node-tuning-operator/tuned-x7xcv"
Sep 17 01:37:24.387870 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.386091    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/38f9ed16-f914-40ea-9002-f639cd385ab1-etc-sysctl-conf\") pod \"tuned-x7xcv\" (UID: \"38f9ed16-f914-40ea-9002-f639cd385ab1\") " pod="openshift-cluster-node-tuning-operator/tuned-x7xcv"
Sep 17 01:37:24.387870 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.386093    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/38f9ed16-f914-40ea-9002-f639cd385ab1-host\") pod \"tuned-x7xcv\" (UID: \"38f9ed16-f914-40ea-9002-f639cd385ab1\") " pod="openshift-cluster-node-tuning-operator/tuned-x7xcv"
Sep 17 01:37:24.387870 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.386099    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-host-run-ovn-kubernetes\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.387870 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.386133    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.387870 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.386141    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/38f9ed16-f914-40ea-9002-f639cd385ab1-host\") pod \"tuned-x7xcv\" (UID: \"38f9ed16-f914-40ea-9002-f639cd385ab1\") " pod="openshift-cluster-node-tuning-operator/tuned-x7xcv"
Sep 17 01:37:24.387870 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.386147    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e31174bc-2069-49d7-91ad-0ba96101ebb1-registration-dir\") pod \"aws-ebs-csi-driver-node-8qkl9\" (UID: \"e31174bc-2069-49d7-91ad-0ba96101ebb1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qkl9"
Sep 17 01:37:24.387870 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.386157    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/38f9ed16-f914-40ea-9002-f639cd385ab1-run\") pod \"tuned-x7xcv\" (UID: \"38f9ed16-f914-40ea-9002-f639cd385ab1\") " pod="openshift-cluster-node-tuning-operator/tuned-x7xcv"
Sep 17 01:37:24.387870 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.386186    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d0de4f20-0902-4f4f-b1cf-48f5e4119117-dbus\") pod \"global-pull-secret-syncer-bzxlf\" (UID: \"d0de4f20-0902-4f4f-b1cf-48f5e4119117\") " pod="kube-system/global-pull-secret-syncer-bzxlf"
Sep 17 01:37:24.387870 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.386195    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d0de4f20-0902-4f4f-b1cf-48f5e4119117-kubelet-config\") pod \"global-pull-secret-syncer-bzxlf\" (UID: \"d0de4f20-0902-4f4f-b1cf-48f5e4119117\") " pod="kube-system/global-pull-secret-syncer-bzxlf"
Sep 17 01:37:24.387870 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.386200    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e31174bc-2069-49d7-91ad-0ba96101ebb1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8qkl9\" (UID: \"e31174bc-2069-49d7-91ad-0ba96101ebb1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qkl9"
Sep 17 01:37:24.387870 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.386213    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38f9ed16-f914-40ea-9002-f639cd385ab1-sys\") pod \"tuned-x7xcv\" (UID: \"38f9ed16-f914-40ea-9002-f639cd385ab1\") " pod="openshift-cluster-node-tuning-operator/tuned-x7xcv"
Sep 17 01:37:24.387870 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.386238    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-host-run-netns\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.387870 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.386263    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-run-ovn\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.387870 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.386288    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/38f9ed16-f914-40ea-9002-f639cd385ab1-etc-sysctl-d\") pod \"tuned-x7xcv\" (UID: \"38f9ed16-f914-40ea-9002-f639cd385ab1\") " pod="openshift-cluster-node-tuning-operator/tuned-x7xcv"
Sep 17 01:37:24.387870 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.386312    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/38f9ed16-f914-40ea-9002-f639cd385ab1-var-lib-kubelet\") pod \"tuned-x7xcv\" (UID: \"38f9ed16-f914-40ea-9002-f639cd385ab1\") " pod="openshift-cluster-node-tuning-operator/tuned-x7xcv"
Sep 17 01:37:24.387870 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.386359    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d0de4f20-0902-4f4f-b1cf-48f5e4119117-dbus\") pod \"global-pull-secret-syncer-bzxlf\" (UID: \"d0de4f20-0902-4f4f-b1cf-48f5e4119117\") " pod="kube-system/global-pull-secret-syncer-bzxlf"
Sep 17 01:37:24.387870 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.386387    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-host-run-netns\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.388669 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.386404    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-run-ovn\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.388669 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.386411    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/38f9ed16-f914-40ea-9002-f639cd385ab1-var-lib-kubelet\") pod \"tuned-x7xcv\" (UID: \"38f9ed16-f914-40ea-9002-f639cd385ab1\") " pod="openshift-cluster-node-tuning-operator/tuned-x7xcv"
Sep 17 01:37:24.388669 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.386439    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38f9ed16-f914-40ea-9002-f639cd385ab1-sys\") pod \"tuned-x7xcv\" (UID: \"38f9ed16-f914-40ea-9002-f639cd385ab1\") " pod="openshift-cluster-node-tuning-operator/tuned-x7xcv"
Sep 17 01:37:24.388669 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.386507    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/38f9ed16-f914-40ea-9002-f639cd385ab1-etc-sysctl-d\") pod \"tuned-x7xcv\" (UID: \"38f9ed16-f914-40ea-9002-f639cd385ab1\") " pod="openshift-cluster-node-tuning-operator/tuned-x7xcv"
Sep 17 01:37:24.388669 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.388338    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38f9ed16-f914-40ea-9002-f639cd385ab1-tmp\") pod \"tuned-x7xcv\" (UID: \"38f9ed16-f914-40ea-9002-f639cd385ab1\") " pod="openshift-cluster-node-tuning-operator/tuned-x7xcv"
Sep 17 01:37:24.388901 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.388788    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/38f9ed16-f914-40ea-9002-f639cd385ab1-etc-tuned\") pod \"tuned-x7xcv\" (UID: \"38f9ed16-f914-40ea-9002-f639cd385ab1\") " pod="openshift-cluster-node-tuning-operator/tuned-x7xcv"
Sep 17 01:37:24.388901 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.388838    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-ovn-node-metrics-cert\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.394713 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.394630    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nj77m\" (UniqueName: \"kubernetes.io/projected/e31174bc-2069-49d7-91ad-0ba96101ebb1-kube-api-access-nj77m\") pod \"aws-ebs-csi-driver-node-8qkl9\" (UID: \"e31174bc-2069-49d7-91ad-0ba96101ebb1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qkl9"
Sep 17 01:37:24.395108 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.394898    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qvlm\" (UniqueName: \"kubernetes.io/projected/0c8eb12a-bc19-47f6-9b1d-c5aabe88546f-kube-api-access-4qvlm\") pod \"iptables-alerter-ts6q2\" (UID: \"0c8eb12a-bc19-47f6-9b1d-c5aabe88546f\") " pod="openshift-network-operator/iptables-alerter-ts6q2"
Sep 17 01:37:24.395547 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.395522    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjf6f\" (UniqueName: \"kubernetes.io/projected/38f9ed16-f914-40ea-9002-f639cd385ab1-kube-api-access-zjf6f\") pod \"tuned-x7xcv\" (UID: \"38f9ed16-f914-40ea-9002-f639cd385ab1\") " pod="openshift-cluster-node-tuning-operator/tuned-x7xcv"
Sep 17 01:37:24.395643 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.395569    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89zlv\" (UniqueName: \"kubernetes.io/projected/f6c9e227-299b-4d98-93dc-bd53cb3f37b4-kube-api-access-89zlv\") pod \"ovnkube-node-4sjxl\" (UID: \"f6c9e227-299b-4d98-93dc-bd53cb3f37b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.466464 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.466406    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tgvzc"
Sep 17 01:37:24.475413 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.475387    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9cvt8"
Sep 17 01:37:24.486471 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.486444    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8xnbz"
Sep 17 01:37:24.493412 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.493392    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5jxkd"
Sep 17 01:37:24.502459 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.502294    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vjfz5"
Sep 17 01:37:24.511389 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.511320    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qkl9"
Sep 17 01:37:24.519897 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.519872    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x7xcv"
Sep 17 01:37:24.530088 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.530063    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ts6q2"
Sep 17 01:37:24.536067 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.536043    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:24.558818 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.558792    2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 01:37:24.789724 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.789615    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/091f4d92-aca2-45ac-9c63-6b73cf983b35-metrics-certs\") pod \"network-metrics-daemon-p8bbk\" (UID: \"091f4d92-aca2-45ac-9c63-6b73cf983b35\") " pod="openshift-multus/network-metrics-daemon-p8bbk"
Sep 17 01:37:24.789916 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:24.789806    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 01:37:24.789916 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:24.789900    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/091f4d92-aca2-45ac-9c63-6b73cf983b35-metrics-certs podName:091f4d92-aca2-45ac-9c63-6b73cf983b35 nodeName:}" failed. No retries permitted until 2026-09-17 01:37:25.789880007 +0000 UTC m=+4.039857320 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/091f4d92-aca2-45ac-9c63-6b73cf983b35-metrics-certs") pod "network-metrics-daemon-p8bbk" (UID: "091f4d92-aca2-45ac-9c63-6b73cf983b35") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 01:37:24.890076 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.890036    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d0de4f20-0902-4f4f-b1cf-48f5e4119117-original-pull-secret\") pod \"global-pull-secret-syncer-bzxlf\" (UID: \"d0de4f20-0902-4f4f-b1cf-48f5e4119117\") " pod="kube-system/global-pull-secret-syncer-bzxlf"
Sep 17 01:37:24.890277 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:24.890118    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt7t4\" (UniqueName: \"kubernetes.io/projected/1adde053-a235-4e41-a52e-39e2f75da8a3-kube-api-access-zt7t4\") pod \"network-check-target-t5bgg\" (UID: \"1adde053-a235-4e41-a52e-39e2f75da8a3\") " pod="openshift-network-diagnostics/network-check-target-t5bgg"
Sep 17 01:37:24.890277 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:24.890181    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 01:37:24.890277 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:24.890219    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 01:37:24.890277 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:24.890241    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 01:37:24.890277 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:24.890273    2560 projected.go:196] Error preparing data for projected volume kube-api-access-zt7t4 for pod openshift-network-diagnostics/network-check-target-t5bgg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 01:37:24.890277 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:24.890280    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0de4f20-0902-4f4f-b1cf-48f5e4119117-original-pull-secret podName:d0de4f20-0902-4f4f-b1cf-48f5e4119117 nodeName:}" failed. No retries permitted until 2026-09-17 01:37:25.890243001 +0000 UTC m=+4.140220313 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d0de4f20-0902-4f4f-b1cf-48f5e4119117-original-pull-secret") pod "global-pull-secret-syncer-bzxlf" (UID: "d0de4f20-0902-4f4f-b1cf-48f5e4119117") : object "kube-system"/"original-pull-secret" not registered
Sep 17 01:37:24.890569 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:24.890322    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1adde053-a235-4e41-a52e-39e2f75da8a3-kube-api-access-zt7t4 podName:1adde053-a235-4e41-a52e-39e2f75da8a3 nodeName:}" failed. No retries permitted until 2026-09-17 01:37:25.890311139 +0000 UTC m=+4.140288452 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-zt7t4" (UniqueName: "kubernetes.io/projected/1adde053-a235-4e41-a52e-39e2f75da8a3-kube-api-access-zt7t4") pod "network-check-target-t5bgg" (UID: "1adde053-a235-4e41-a52e-39e2f75da8a3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 01:37:25.211172 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:25.211137    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 01:32:24 +0000 UTC" deadline="2028-06-02 06:04:39.575324744 +0000 UTC"
Sep 17 01:37:25.211172 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:25.211166    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14980h27m14.364161891s"
Sep 17 01:37:25.423635 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:25.423600    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c26e78f_6e4c_489e_98c8_fa49ca563945.slice/crio-73964f96a303d5e5007acc0aecd92ff4dbf287b6ecef884bd638cb6b52b98625 WatchSource:0}: Error finding container 73964f96a303d5e5007acc0aecd92ff4dbf287b6ecef884bd638cb6b52b98625: Status 404 returned error can't find the container with id 73964f96a303d5e5007acc0aecd92ff4dbf287b6ecef884bd638cb6b52b98625
Sep 17 01:37:25.425067 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:25.425036    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf44a97e_9c59_4dc9_abd9_3d1bd20972b9.slice/crio-c5ccd3b70c42a428cdb34297ea40d0d7430b0d9003002924e449059de1fa6754 WatchSource:0}: Error finding container c5ccd3b70c42a428cdb34297ea40d0d7430b0d9003002924e449059de1fa6754: Status 404 returned error can't find the container with id c5ccd3b70c42a428cdb34297ea40d0d7430b0d9003002924e449059de1fa6754
Sep 17 01:37:25.426084 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:25.425935    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6ef4b82_3568_4d70_a62a_2e3eb3fdaed6.slice/crio-367ffde4ca0635f72435b19e3ad9bcba7d9691bfedd6623f0f54530149dc7930 WatchSource:0}: Error finding container 367ffde4ca0635f72435b19e3ad9bcba7d9691bfedd6623f0f54530149dc7930: Status 404 returned error can't find the container with id 367ffde4ca0635f72435b19e3ad9bcba7d9691bfedd6623f0f54530149dc7930
Sep 17 01:37:25.427851 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:25.427821    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode31174bc_2069_49d7_91ad_0ba96101ebb1.slice/crio-7d7fd0ef9cb96aba3037784862f0b487541c9eb74a56f418bcb73f2cc32931bd WatchSource:0}: Error finding container 7d7fd0ef9cb96aba3037784862f0b487541c9eb74a56f418bcb73f2cc32931bd: Status 404 returned error can't find the container with id 7d7fd0ef9cb96aba3037784862f0b487541c9eb74a56f418bcb73f2cc32931bd
Sep 17 01:37:25.431836 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:25.431814    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6c9e227_299b_4d98_93dc_bd53cb3f37b4.slice/crio-da8f41c3e00057548b713162a167b4f86f9d1270167ef285786678699476011f WatchSource:0}: Error finding container da8f41c3e00057548b713162a167b4f86f9d1270167ef285786678699476011f: Status 404 returned error can't find the container with id da8f41c3e00057548b713162a167b4f86f9d1270167ef285786678699476011f
Sep 17 01:37:25.433510 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:25.433487    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02474a41_dc47_48ca_a66b_8bd035e916bc.slice/crio-78bad467f495c99ce2df791e0bc601f4319e8962443123d1a433ef39a8e8e9c4 WatchSource:0}: Error finding container 78bad467f495c99ce2df791e0bc601f4319e8962443123d1a433ef39a8e8e9c4: Status 404 returned error can't find the container with id 78bad467f495c99ce2df791e0bc601f4319e8962443123d1a433ef39a8e8e9c4
Sep 17 01:37:25.434475 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:25.434451    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38f9ed16_f914_40ea_9002_f639cd385ab1.slice/crio-b919745b8fe96ce35e10412e98078976cb9c22800c4686756a98ff4bdcf8652d WatchSource:0}: Error finding container b919745b8fe96ce35e10412e98078976cb9c22800c4686756a98ff4bdcf8652d: Status 404 returned error can't find the container with id b919745b8fe96ce35e10412e98078976cb9c22800c4686756a98ff4bdcf8652d
Sep 17 01:37:25.436591 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:25.436556    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c8eb12a_bc19_47f6_9b1d_c5aabe88546f.slice/crio-c9f481eb9e43fd16c54e104ac39e8da43c41a21a39a8dce25c8de09a756722c9 WatchSource:0}: Error finding container c9f481eb9e43fd16c54e104ac39e8da43c41a21a39a8dce25c8de09a756722c9: Status 404 returned error can't find the container with id c9f481eb9e43fd16c54e104ac39e8da43c41a21a39a8dce25c8de09a756722c9
Sep 17 01:37:25.439125 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:25.438995    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod777686bc_ef43_4350_9276_ce9cde09811c.slice/crio-23b97c36e707565cf30351b9b7d06fccccaa4336fa5600be84dd2d78157eb362 WatchSource:0}: Error finding container 23b97c36e707565cf30351b9b7d06fccccaa4336fa5600be84dd2d78157eb362: Status 404 returned error can't find the container with id 23b97c36e707565cf30351b9b7d06fccccaa4336fa5600be84dd2d78157eb362
Sep 17 01:37:25.797393 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:25.797355    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/091f4d92-aca2-45ac-9c63-6b73cf983b35-metrics-certs\") pod \"network-metrics-daemon-p8bbk\" (UID: \"091f4d92-aca2-45ac-9c63-6b73cf983b35\") " pod="openshift-multus/network-metrics-daemon-p8bbk"
Sep 17 01:37:25.797630 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:25.797522    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 01:37:25.797630 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:25.797593    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/091f4d92-aca2-45ac-9c63-6b73cf983b35-metrics-certs podName:091f4d92-aca2-45ac-9c63-6b73cf983b35 nodeName:}" failed. No retries permitted until 2026-09-17 01:37:27.797577106 +0000 UTC m=+6.047554399 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/091f4d92-aca2-45ac-9c63-6b73cf983b35-metrics-certs") pod "network-metrics-daemon-p8bbk" (UID: "091f4d92-aca2-45ac-9c63-6b73cf983b35") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 01:37:25.898476 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:25.898434    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d0de4f20-0902-4f4f-b1cf-48f5e4119117-original-pull-secret\") pod \"global-pull-secret-syncer-bzxlf\" (UID: \"d0de4f20-0902-4f4f-b1cf-48f5e4119117\") " pod="kube-system/global-pull-secret-syncer-bzxlf"
Sep 17 01:37:25.898655 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:25.898509    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt7t4\" (UniqueName: \"kubernetes.io/projected/1adde053-a235-4e41-a52e-39e2f75da8a3-kube-api-access-zt7t4\") pod \"network-check-target-t5bgg\" (UID: \"1adde053-a235-4e41-a52e-39e2f75da8a3\") " pod="openshift-network-diagnostics/network-check-target-t5bgg"
Sep 17 01:37:25.898737 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:25.898711    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 01:37:25.898803 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:25.898742    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 01:37:25.898803 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:25.898757    2560 projected.go:196] Error preparing data for projected volume kube-api-access-zt7t4 for pod openshift-network-diagnostics/network-check-target-t5bgg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 01:37:25.898909 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:25.898829    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1adde053-a235-4e41-a52e-39e2f75da8a3-kube-api-access-zt7t4 podName:1adde053-a235-4e41-a52e-39e2f75da8a3 nodeName:}" failed. No retries permitted until 2026-09-17 01:37:27.898809172 +0000 UTC m=+6.148786470 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-zt7t4" (UniqueName: "kubernetes.io/projected/1adde053-a235-4e41-a52e-39e2f75da8a3-kube-api-access-zt7t4") pod "network-check-target-t5bgg" (UID: "1adde053-a235-4e41-a52e-39e2f75da8a3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 01:37:25.898909 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:25.898865    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 01:37:25.899036 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:25.898967    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0de4f20-0902-4f4f-b1cf-48f5e4119117-original-pull-secret podName:d0de4f20-0902-4f4f-b1cf-48f5e4119117 nodeName:}" failed. No retries permitted until 2026-09-17 01:37:27.898916367 +0000 UTC m=+6.148893675 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d0de4f20-0902-4f4f-b1cf-48f5e4119117-original-pull-secret") pod "global-pull-secret-syncer-bzxlf" (UID: "d0de4f20-0902-4f4f-b1cf-48f5e4119117") : object "kube-system"/"original-pull-secret" not registered
Sep 17 01:37:26.212028 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:26.211929    2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 01:32:24 +0000 UTC" deadline="2028-03-23 13:42:03.436341766 +0000 UTC"
Sep 17 01:37:26.212028 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:26.211994    2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13284h4m37.22435216s"
Sep 17 01:37:26.351456 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:26.350875    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8bbk"
Sep 17 01:37:26.351456 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:26.350875    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzxlf"
Sep 17 01:37:26.351456 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:26.351039    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8bbk" podUID="091f4d92-aca2-45ac-9c63-6b73cf983b35"
Sep 17 01:37:26.351456 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:26.351099    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzxlf" podUID="d0de4f20-0902-4f4f-b1cf-48f5e4119117"
Sep 17 01:37:26.351456 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:26.351147    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5bgg"
Sep 17 01:37:26.351456 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:26.351244    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5bgg" podUID="1adde053-a235-4e41-a52e-39e2f75da8a3"
Sep 17 01:37:26.371728 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:26.371685    2560 generic.go:356] "Generic (PLEG): container finished" podID="bca4e8b3696e5d2a45a5c2e759a3cb06" containerID="ad29d696013e753a3a90bc05904e80aca51ae6f2bf3f5f14899332af3b2ea332" exitCode=0
Sep 17 01:37:26.371931 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:26.371816    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-95.ec2.internal" event={"ID":"bca4e8b3696e5d2a45a5c2e759a3cb06","Type":"ContainerDied","Data":"ad29d696013e753a3a90bc05904e80aca51ae6f2bf3f5f14899332af3b2ea332"}
Sep 17 01:37:26.382063 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:26.382019    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-95.ec2.internal" event={"ID":"182c03c78ab71663e42db8a5ead7b76b","Type":"ContainerStarted","Data":"215a4336a18f5be9540b025deb6cca25593bf2d6812cca7d97e57d95771680a4"}
Sep 17 01:37:26.391830 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:26.391697    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl" event={"ID":"f6c9e227-299b-4d98-93dc-bd53cb3f37b4","Type":"ContainerStarted","Data":"da8f41c3e00057548b713162a167b4f86f9d1270167ef285786678699476011f"}
Sep 17 01:37:26.403345 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:26.403174    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-95.ec2.internal" podStartSLOduration=2.403151106 podStartE2EDuration="2.403151106s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 01:37:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:37:26.402120337 +0000 UTC m=+4.652097654" watchObservedRunningTime="2026-09-17 01:37:26.403151106 +0000 UTC m=+4.653128423"
Sep 17 01:37:26.405369 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:26.405283    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qkl9" event={"ID":"e31174bc-2069-49d7-91ad-0ba96101ebb1","Type":"ContainerStarted","Data":"7d7fd0ef9cb96aba3037784862f0b487541c9eb74a56f418bcb73f2cc32931bd"}
Sep 17 01:37:26.417264 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:26.417174    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8xnbz" event={"ID":"a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6","Type":"ContainerStarted","Data":"367ffde4ca0635f72435b19e3ad9bcba7d9691bfedd6623f0f54530149dc7930"}
Sep 17 01:37:26.424050 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:26.423960    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5jxkd" event={"ID":"8c26e78f-6e4c-489e-98c8-fa49ca563945","Type":"ContainerStarted","Data":"73964f96a303d5e5007acc0aecd92ff4dbf287b6ecef884bd638cb6b52b98625"}
Sep 17 01:37:26.432924 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:26.432843    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x7xcv" event={"ID":"38f9ed16-f914-40ea-9002-f639cd385ab1","Type":"ContainerStarted","Data":"b919745b8fe96ce35e10412e98078976cb9c22800c4686756a98ff4bdcf8652d"}
Sep 17 01:37:26.437445 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:26.437272    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tgvzc" event={"ID":"02474a41-dc47-48ca-a66b-8bd035e916bc","Type":"ContainerStarted","Data":"78bad467f495c99ce2df791e0bc601f4319e8962443123d1a433ef39a8e8e9c4"}
Sep 17 01:37:26.454640 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:26.454600    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vjfz5" event={"ID":"777686bc-ef43-4350-9276-ce9cde09811c","Type":"ContainerStarted","Data":"23b97c36e707565cf30351b9b7d06fccccaa4336fa5600be84dd2d78157eb362"}
Sep 17 01:37:26.481411 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:26.481215    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ts6q2" event={"ID":"0c8eb12a-bc19-47f6-9b1d-c5aabe88546f","Type":"ContainerStarted","Data":"c9f481eb9e43fd16c54e104ac39e8da43c41a21a39a8dce25c8de09a756722c9"}
Sep 17 01:37:26.510606 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:26.510562    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9cvt8" event={"ID":"df44a97e-9c59-4dc9-abd9-3d1bd20972b9","Type":"ContainerStarted","Data":"c5ccd3b70c42a428cdb34297ea40d0d7430b0d9003002924e449059de1fa6754"}
Sep 17 01:37:27.534719 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:27.534391    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-95.ec2.internal" event={"ID":"bca4e8b3696e5d2a45a5c2e759a3cb06","Type":"ContainerStarted","Data":"f6d62c7eb4db3c06375d461bc0fc30f9169dc0c22ef91c93c3fe9bd9b0f4bdef"}
Sep 17 01:37:27.814719 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:27.814679    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/091f4d92-aca2-45ac-9c63-6b73cf983b35-metrics-certs\") pod \"network-metrics-daemon-p8bbk\" (UID: \"091f4d92-aca2-45ac-9c63-6b73cf983b35\") " pod="openshift-multus/network-metrics-daemon-p8bbk"
Sep 17 01:37:27.814925 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:27.814826    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 01:37:27.814925 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:27.814896    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/091f4d92-aca2-45ac-9c63-6b73cf983b35-metrics-certs podName:091f4d92-aca2-45ac-9c63-6b73cf983b35 nodeName:}" failed. No retries permitted until 2026-09-17 01:37:31.814875019 +0000 UTC m=+10.064852334 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/091f4d92-aca2-45ac-9c63-6b73cf983b35-metrics-certs") pod "network-metrics-daemon-p8bbk" (UID: "091f4d92-aca2-45ac-9c63-6b73cf983b35") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 01:37:27.915731 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:27.915690    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d0de4f20-0902-4f4f-b1cf-48f5e4119117-original-pull-secret\") pod \"global-pull-secret-syncer-bzxlf\" (UID: \"d0de4f20-0902-4f4f-b1cf-48f5e4119117\") " pod="kube-system/global-pull-secret-syncer-bzxlf"
Sep 17 01:37:27.915929 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:27.915766    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt7t4\" (UniqueName: \"kubernetes.io/projected/1adde053-a235-4e41-a52e-39e2f75da8a3-kube-api-access-zt7t4\") pod \"network-check-target-t5bgg\" (UID: \"1adde053-a235-4e41-a52e-39e2f75da8a3\") " pod="openshift-network-diagnostics/network-check-target-t5bgg"
Sep 17 01:37:27.916002 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:27.915961    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 01:37:27.916002 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:27.915983    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 01:37:27.916002 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:27.915997    2560 projected.go:196] Error preparing data for projected volume kube-api-access-zt7t4 for pod openshift-network-diagnostics/network-check-target-t5bgg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 01:37:27.916155 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:27.916111    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1adde053-a235-4e41-a52e-39e2f75da8a3-kube-api-access-zt7t4 podName:1adde053-a235-4e41-a52e-39e2f75da8a3 nodeName:}" failed. No retries permitted until 2026-09-17 01:37:31.916053174 +0000 UTC m=+10.166030483 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-zt7t4" (UniqueName: "kubernetes.io/projected/1adde053-a235-4e41-a52e-39e2f75da8a3-kube-api-access-zt7t4") pod "network-check-target-t5bgg" (UID: "1adde053-a235-4e41-a52e-39e2f75da8a3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 01:37:27.916606 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:27.916583    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 01:37:27.916738 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:27.916642    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0de4f20-0902-4f4f-b1cf-48f5e4119117-original-pull-secret podName:d0de4f20-0902-4f4f-b1cf-48f5e4119117 nodeName:}" failed. No retries permitted until 2026-09-17 01:37:31.916626245 +0000 UTC m=+10.166603538 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d0de4f20-0902-4f4f-b1cf-48f5e4119117-original-pull-secret") pod "global-pull-secret-syncer-bzxlf" (UID: "d0de4f20-0902-4f4f-b1cf-48f5e4119117") : object "kube-system"/"original-pull-secret" not registered
Sep 17 01:37:28.353912 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:28.353878    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5bgg"
Sep 17 01:37:28.354113 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:28.354008    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5bgg" podUID="1adde053-a235-4e41-a52e-39e2f75da8a3"
Sep 17 01:37:28.355245 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:28.354506    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8bbk"
Sep 17 01:37:28.355245 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:28.354623    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8bbk" podUID="091f4d92-aca2-45ac-9c63-6b73cf983b35"
Sep 17 01:37:28.355245 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:28.354688    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzxlf"
Sep 17 01:37:28.355245 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:28.354760    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzxlf" podUID="d0de4f20-0902-4f4f-b1cf-48f5e4119117"
Sep 17 01:37:30.351204 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:30.351166    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8bbk"
Sep 17 01:37:30.351204 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:30.351198    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5bgg"
Sep 17 01:37:30.351785 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:30.351167    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzxlf"
Sep 17 01:37:30.351785 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:30.351355    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8bbk" podUID="091f4d92-aca2-45ac-9c63-6b73cf983b35"
Sep 17 01:37:30.351785 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:30.351432    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzxlf" podUID="d0de4f20-0902-4f4f-b1cf-48f5e4119117"
Sep 17 01:37:30.351785 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:30.351535    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5bgg" podUID="1adde053-a235-4e41-a52e-39e2f75da8a3"
Sep 17 01:37:31.851719 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:31.851595    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/091f4d92-aca2-45ac-9c63-6b73cf983b35-metrics-certs\") pod \"network-metrics-daemon-p8bbk\" (UID: \"091f4d92-aca2-45ac-9c63-6b73cf983b35\") " pod="openshift-multus/network-metrics-daemon-p8bbk"
Sep 17 01:37:31.852146 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:31.851775    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 01:37:31.852146 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:31.851852    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/091f4d92-aca2-45ac-9c63-6b73cf983b35-metrics-certs podName:091f4d92-aca2-45ac-9c63-6b73cf983b35 nodeName:}" failed. No retries permitted until 2026-09-17 01:37:39.851834992 +0000 UTC m=+18.101812284 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/091f4d92-aca2-45ac-9c63-6b73cf983b35-metrics-certs") pod "network-metrics-daemon-p8bbk" (UID: "091f4d92-aca2-45ac-9c63-6b73cf983b35") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 01:37:31.953644 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:31.952979    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d0de4f20-0902-4f4f-b1cf-48f5e4119117-original-pull-secret\") pod \"global-pull-secret-syncer-bzxlf\" (UID: \"d0de4f20-0902-4f4f-b1cf-48f5e4119117\") " pod="kube-system/global-pull-secret-syncer-bzxlf"
Sep 17 01:37:31.953644 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:31.953032    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt7t4\" (UniqueName: \"kubernetes.io/projected/1adde053-a235-4e41-a52e-39e2f75da8a3-kube-api-access-zt7t4\") pod \"network-check-target-t5bgg\" (UID: \"1adde053-a235-4e41-a52e-39e2f75da8a3\") " pod="openshift-network-diagnostics/network-check-target-t5bgg"
Sep 17 01:37:31.953644 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:31.953145    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 01:37:31.953644 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:31.953161    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 01:37:31.953644 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:31.953171    2560 projected.go:196] Error preparing data for projected volume kube-api-access-zt7t4 for pod openshift-network-diagnostics/network-check-target-t5bgg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 01:37:31.953644 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:31.953219    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1adde053-a235-4e41-a52e-39e2f75da8a3-kube-api-access-zt7t4 podName:1adde053-a235-4e41-a52e-39e2f75da8a3 nodeName:}" failed. No retries permitted until 2026-09-17 01:37:39.953203216 +0000 UTC m=+18.203180510 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-zt7t4" (UniqueName: "kubernetes.io/projected/1adde053-a235-4e41-a52e-39e2f75da8a3-kube-api-access-zt7t4") pod "network-check-target-t5bgg" (UID: "1adde053-a235-4e41-a52e-39e2f75da8a3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 01:37:31.953644 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:31.953572    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 01:37:31.953644 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:31.953610    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0de4f20-0902-4f4f-b1cf-48f5e4119117-original-pull-secret podName:d0de4f20-0902-4f4f-b1cf-48f5e4119117 nodeName:}" failed. No retries permitted until 2026-09-17 01:37:39.953599853 +0000 UTC m=+18.203577146 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d0de4f20-0902-4f4f-b1cf-48f5e4119117-original-pull-secret") pod "global-pull-secret-syncer-bzxlf" (UID: "d0de4f20-0902-4f4f-b1cf-48f5e4119117") : object "kube-system"/"original-pull-secret" not registered
Sep 17 01:37:32.354619 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:32.354582    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzxlf"
Sep 17 01:37:32.354827 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:32.354752    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzxlf" podUID="d0de4f20-0902-4f4f-b1cf-48f5e4119117"
Sep 17 01:37:32.355061 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:32.355039    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8bbk"
Sep 17 01:37:32.355061 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:32.355052    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5bgg"
Sep 17 01:37:32.355204 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:32.355173    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8bbk" podUID="091f4d92-aca2-45ac-9c63-6b73cf983b35"
Sep 17 01:37:32.355401 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:32.355288    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5bgg" podUID="1adde053-a235-4e41-a52e-39e2f75da8a3"
Sep 17 01:37:34.351263 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:34.351219    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8bbk"
Sep 17 01:37:34.351707 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:34.351381    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8bbk" podUID="091f4d92-aca2-45ac-9c63-6b73cf983b35"
Sep 17 01:37:34.351806 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:34.351739    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzxlf"
Sep 17 01:37:34.351919 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:34.351897    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzxlf" podUID="d0de4f20-0902-4f4f-b1cf-48f5e4119117"
Sep 17 01:37:34.352008 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:34.351958    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5bgg"
Sep 17 01:37:34.352072 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:34.352054    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5bgg" podUID="1adde053-a235-4e41-a52e-39e2f75da8a3"
Sep 17 01:37:36.351642 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:36.351599    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzxlf"
Sep 17 01:37:36.352039 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:36.351599    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8bbk"
Sep 17 01:37:36.352039 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:36.351723    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzxlf" podUID="d0de4f20-0902-4f4f-b1cf-48f5e4119117"
Sep 17 01:37:36.352039 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:36.351735    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5bgg"
Sep 17 01:37:36.352039 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:36.351862    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8bbk" podUID="091f4d92-aca2-45ac-9c63-6b73cf983b35"
Sep 17 01:37:36.352196 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:36.351983    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5bgg" podUID="1adde053-a235-4e41-a52e-39e2f75da8a3"
Sep 17 01:37:38.350731 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:38.350698    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzxlf"
Sep 17 01:37:38.351175 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:38.350698    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8bbk"
Sep 17 01:37:38.351175 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:38.350822    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzxlf" podUID="d0de4f20-0902-4f4f-b1cf-48f5e4119117"
Sep 17 01:37:38.351175 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:38.350849    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5bgg"
Sep 17 01:37:38.351175 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:38.350936    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8bbk" podUID="091f4d92-aca2-45ac-9c63-6b73cf983b35"
Sep 17 01:37:38.351175 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:38.351024    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5bgg" podUID="1adde053-a235-4e41-a52e-39e2f75da8a3"
Sep 17 01:37:39.911595 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:39.911559    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/091f4d92-aca2-45ac-9c63-6b73cf983b35-metrics-certs\") pod \"network-metrics-daemon-p8bbk\" (UID: \"091f4d92-aca2-45ac-9c63-6b73cf983b35\") " pod="openshift-multus/network-metrics-daemon-p8bbk"
Sep 17 01:37:39.911989 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:39.911679    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 01:37:39.911989 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:39.911731    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/091f4d92-aca2-45ac-9c63-6b73cf983b35-metrics-certs podName:091f4d92-aca2-45ac-9c63-6b73cf983b35 nodeName:}" failed. No retries permitted until 2026-09-17 01:37:55.911717255 +0000 UTC m=+34.161694546 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/091f4d92-aca2-45ac-9c63-6b73cf983b35-metrics-certs") pod "network-metrics-daemon-p8bbk" (UID: "091f4d92-aca2-45ac-9c63-6b73cf983b35") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 01:37:40.012615 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:40.012525    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d0de4f20-0902-4f4f-b1cf-48f5e4119117-original-pull-secret\") pod \"global-pull-secret-syncer-bzxlf\" (UID: \"d0de4f20-0902-4f4f-b1cf-48f5e4119117\") " pod="kube-system/global-pull-secret-syncer-bzxlf"
Sep 17 01:37:40.012773 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:40.012682    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 01:37:40.012773 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:40.012698    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt7t4\" (UniqueName: \"kubernetes.io/projected/1adde053-a235-4e41-a52e-39e2f75da8a3-kube-api-access-zt7t4\") pod \"network-check-target-t5bgg\" (UID: \"1adde053-a235-4e41-a52e-39e2f75da8a3\") " pod="openshift-network-diagnostics/network-check-target-t5bgg"
Sep 17 01:37:40.012773 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:40.012752    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0de4f20-0902-4f4f-b1cf-48f5e4119117-original-pull-secret podName:d0de4f20-0902-4f4f-b1cf-48f5e4119117 nodeName:}" failed. No retries permitted until 2026-09-17 01:37:56.012734416 +0000 UTC m=+34.262711714 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d0de4f20-0902-4f4f-b1cf-48f5e4119117-original-pull-secret") pod "global-pull-secret-syncer-bzxlf" (UID: "d0de4f20-0902-4f4f-b1cf-48f5e4119117") : object "kube-system"/"original-pull-secret" not registered
Sep 17 01:37:40.012943 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:40.012817    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 01:37:40.012943 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:40.012842    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 01:37:40.012943 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:40.012853    2560 projected.go:196] Error preparing data for projected volume kube-api-access-zt7t4 for pod openshift-network-diagnostics/network-check-target-t5bgg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 01:37:40.012943 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:40.012905    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1adde053-a235-4e41-a52e-39e2f75da8a3-kube-api-access-zt7t4 podName:1adde053-a235-4e41-a52e-39e2f75da8a3 nodeName:}" failed. No retries permitted until 2026-09-17 01:37:56.012892066 +0000 UTC m=+34.262869357 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-zt7t4" (UniqueName: "kubernetes.io/projected/1adde053-a235-4e41-a52e-39e2f75da8a3-kube-api-access-zt7t4") pod "network-check-target-t5bgg" (UID: "1adde053-a235-4e41-a52e-39e2f75da8a3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 01:37:40.350913 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:40.350877    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8bbk"
Sep 17 01:37:40.351100 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:40.350893    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzxlf"
Sep 17 01:37:40.351100 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:40.351007    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5bgg"
Sep 17 01:37:40.351100 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:40.351011    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8bbk" podUID="091f4d92-aca2-45ac-9c63-6b73cf983b35"
Sep 17 01:37:40.351100 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:40.351087    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzxlf" podUID="d0de4f20-0902-4f4f-b1cf-48f5e4119117"
Sep 17 01:37:40.351333 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:40.351155    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5bgg" podUID="1adde053-a235-4e41-a52e-39e2f75da8a3"
Sep 17 01:37:42.351909 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:42.351868    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8bbk"
Sep 17 01:37:42.352373 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:42.351998    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5bgg"
Sep 17 01:37:42.352373 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:42.352008    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8bbk" podUID="091f4d92-aca2-45ac-9c63-6b73cf983b35"
Sep 17 01:37:42.352373 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:42.352123    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzxlf"
Sep 17 01:37:42.352373 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:42.352179    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5bgg" podUID="1adde053-a235-4e41-a52e-39e2f75da8a3"
Sep 17 01:37:42.352373 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:42.352201    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzxlf" podUID="d0de4f20-0902-4f4f-b1cf-48f5e4119117"
Sep 17 01:37:44.351790 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:44.351342    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzxlf"
Sep 17 01:37:44.352564 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:44.351386    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5bgg"
Sep 17 01:37:44.352564 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:44.351896    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzxlf" podUID="d0de4f20-0902-4f4f-b1cf-48f5e4119117"
Sep 17 01:37:44.352564 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:44.351414    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8bbk"
Sep 17 01:37:44.352564 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:44.351934    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5bgg" podUID="1adde053-a235-4e41-a52e-39e2f75da8a3"
Sep 17 01:37:44.352564 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:44.352057    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8bbk" podUID="091f4d92-aca2-45ac-9c63-6b73cf983b35"
Sep 17 01:37:44.571992 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:44.571959    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl" event={"ID":"f6c9e227-299b-4d98-93dc-bd53cb3f37b4","Type":"ContainerStarted","Data":"a0bf661767f4b0679cbbead6f5f1caa232f823099bee629037a3946385e895a4"}
Sep 17 01:37:44.572169 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:44.572043    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl" event={"ID":"f6c9e227-299b-4d98-93dc-bd53cb3f37b4","Type":"ContainerStarted","Data":"3b854488f9c43363e9cf1550acaa9953acc60b2e6018fa21d2faab072c1213bf"}
Sep 17 01:37:44.572169 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:44.572088    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl" event={"ID":"f6c9e227-299b-4d98-93dc-bd53cb3f37b4","Type":"ContainerStarted","Data":"1a43d18af0387beedc955ad3990b16e1ac89b5f7c98f373b76d2d47120885977"}
Sep 17 01:37:44.572169 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:44.572131    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl" event={"ID":"f6c9e227-299b-4d98-93dc-bd53cb3f37b4","Type":"ContainerStarted","Data":"70d23ce9bd98767868b0265dae38f5bcb845affa2d0f6f6dedc434224b0e49d6"}
Sep 17 01:37:44.572352 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:44.572171    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl" event={"ID":"f6c9e227-299b-4d98-93dc-bd53cb3f37b4","Type":"ContainerStarted","Data":"62f497fd404a9b55012dfcb6fb39f900600f45e27cd036b928e04d4aaf55ef9e"}
Sep 17 01:37:44.572352 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:44.572218    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl" event={"ID":"f6c9e227-299b-4d98-93dc-bd53cb3f37b4","Type":"ContainerStarted","Data":"9efa4a6fa2a7c5597bce48e6439de0aa8564198afefd17646e154d8c80279b54"}
Sep 17 01:37:44.573687 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:44.573660    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qkl9" event={"ID":"e31174bc-2069-49d7-91ad-0ba96101ebb1","Type":"ContainerStarted","Data":"0dc43c5670af89e8b16879b3b651223442a56d1951f04de712df74dcf441ec4f"}
Sep 17 01:37:44.575013 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:44.574989    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8xnbz" event={"ID":"a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6","Type":"ContainerStarted","Data":"e1d9b24c4a94102fdecfe3c622e3c99d871d59b1168fa312b1c84208b69b348e"}
Sep 17 01:37:44.576284 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:44.576259    2560 generic.go:356] "Generic (PLEG): container finished" podID="8c26e78f-6e4c-489e-98c8-fa49ca563945" containerID="23ece373adb0a4da7b90fbae91985fa97f619751a515249cd6b2b9d12c247ee6" exitCode=0
Sep 17 01:37:44.576400 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:44.576340    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5jxkd" event={"ID":"8c26e78f-6e4c-489e-98c8-fa49ca563945","Type":"ContainerDied","Data":"23ece373adb0a4da7b90fbae91985fa97f619751a515249cd6b2b9d12c247ee6"}
Sep 17 01:37:44.577801 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:44.577779    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x7xcv" event={"ID":"38f9ed16-f914-40ea-9002-f639cd385ab1","Type":"ContainerStarted","Data":"70377e6d60de75589848813cf24ebd5182ee6bbad95e56d17775bee435b34216"}
Sep 17 01:37:44.579394 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:44.579369    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tgvzc" event={"ID":"02474a41-dc47-48ca-a66b-8bd035e916bc","Type":"ContainerStarted","Data":"dd5691b84dbd0cbd364d0a2af4cdf881154ece9602ad1d10a1a89beb6681373b"}
Sep 17 01:37:44.580670 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:44.580647    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vjfz5" event={"ID":"777686bc-ef43-4350-9276-ce9cde09811c","Type":"ContainerStarted","Data":"efde04f8d08ed3369b2d0fa3933da14bffc5f4106ceb53f21fc863aa73d28037"}
Sep 17 01:37:44.581951 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:44.581932    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9cvt8" event={"ID":"df44a97e-9c59-4dc9-abd9-3d1bd20972b9","Type":"ContainerStarted","Data":"1a0e9c09def2853e2318323ce12771eca3e655d403c4649ba4eb1b13ce1854be"}
Sep 17 01:37:44.591755 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:44.591712    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-95.ec2.internal" podStartSLOduration=20.591700524 podStartE2EDuration="20.591700524s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 01:37:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:37:27.550763323 +0000 UTC m=+5.800740641" watchObservedRunningTime="2026-09-17 01:37:44.591700524 +0000 UTC m=+22.841677836"
Sep 17 01:37:44.603077 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:44.603036    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vjfz5" podStartSLOduration=3.398943059 podStartE2EDuration="21.603021555s" totalImagesPullingTime="18.204078496s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 01:37:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:37:44.602825321 +0000 UTC m=+22.852802635" watchObservedRunningTime="2026-09-17 01:37:44.603021555 +0000 UTC m=+22.852998868"
Sep 17 01:37:44.603195 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:44.603134    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8xnbz" podStartSLOduration=3.330563311 podStartE2EDuration="21.603129851s" totalImagesPullingTime="18.27256654s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 01:37:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:37:44.591344206 +0000 UTC m=+22.841321518" watchObservedRunningTime="2026-09-17 01:37:44.603129851 +0000 UTC m=+22.853107249"
Sep 17 01:37:44.617268 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:44.617212    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-x7xcv" podStartSLOduration=3.391659378 podStartE2EDuration="21.617196903s" totalImagesPullingTime="18.225537525s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 01:37:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:37:44.617149163 +0000 UTC m=+22.867126479" watchObservedRunningTime="2026-09-17 01:37:44.617196903 +0000 UTC m=+22.867174215"
Sep 17 01:37:44.633880 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:44.633828    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9cvt8" podStartSLOduration=3.460564263 podStartE2EDuration="21.633810387s" totalImagesPullingTime="18.173246124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:37:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:37:44.629658834 +0000 UTC m=+22.879636148" watchObservedRunningTime="2026-09-17 01:37:44.633810387 +0000 UTC m=+22.883787697"
Sep 17 01:37:44.646700 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:44.646652    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-tgvzc" podStartSLOduration=3.481573859 podStartE2EDuration="21.646634404s" totalImagesPullingTime="18.165060545s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 01:37:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:37:44.646320334 +0000 UTC m=+22.896297648" watchObservedRunningTime="2026-09-17 01:37:44.646634404 +0000 UTC m=+22.896611722"
Sep 17 01:37:45.250206 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:45.250109    2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 17 01:37:45.586778 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:45.586741    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qkl9" event={"ID":"e31174bc-2069-49d7-91ad-0ba96101ebb1","Type":"ContainerStarted","Data":"ff03d268930c97b2a56848f5e30425f3d1c6aed0d53a6a5da269a3cac9a7473b"}
Sep 17 01:37:45.588388 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:45.588328    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ts6q2" event={"ID":"0c8eb12a-bc19-47f6-9b1d-c5aabe88546f","Type":"ContainerStarted","Data":"e3df6bc2f8cff5337734dd19297a094fbd80cb1d2e2794f6aa6d16d0e1c66d9f"}
Sep 17 01:37:45.601497 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:45.601433    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ts6q2" podStartSLOduration=4.388616514 podStartE2EDuration="22.601413708s" totalImagesPullingTime="18.212797194s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 01:37:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:37:45.601285075 +0000 UTC m=+23.851262388" watchObservedRunningTime="2026-09-17 01:37:45.601413708 +0000 UTC m=+23.851391023"
Sep 17 01:37:46.243813 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:46.243726    2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-17T01:37:45.250130564Z","UUID":"43ce931f-14b9-413e-b307-a18a4c988d89","Handler":null,"Name":"","Endpoint":""}
Sep 17 01:37:46.245283 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:46.245260    2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 17 01:37:46.245391 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:46.245305    2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 17 01:37:46.351485 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:46.351455    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzxlf"
Sep 17 01:37:46.351658 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:46.351467    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5bgg"
Sep 17 01:37:46.351658 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:46.351595    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8bbk"
Sep 17 01:37:46.351658 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:46.351594    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzxlf" podUID="d0de4f20-0902-4f4f-b1cf-48f5e4119117"
Sep 17 01:37:46.351815 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:46.351666    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5bgg" podUID="1adde053-a235-4e41-a52e-39e2f75da8a3"
Sep 17 01:37:46.351815 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:46.351742    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8bbk" podUID="091f4d92-aca2-45ac-9c63-6b73cf983b35"
Sep 17 01:37:46.595008 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:46.594971    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl" event={"ID":"f6c9e227-299b-4d98-93dc-bd53cb3f37b4","Type":"ContainerStarted","Data":"ae583dd07e59343dfe84634c4cf6e9c31cd00f13c7ab4c9de339ac9f3bb1003c"}
Sep 17 01:37:46.597258 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:46.597215    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qkl9" event={"ID":"e31174bc-2069-49d7-91ad-0ba96101ebb1","Type":"ContainerStarted","Data":"e75c6b40bfb01805ffafb464204d622423b1831c020ec1556a1ebb772e28e7b7"}
Sep 17 01:37:46.613896 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:46.613821    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8qkl9" podStartSLOduration=7.055773426 podStartE2EDuration="23.613796441s" totalImagesPullingTime="16.558023015s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 01:37:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:37:46.612352401 +0000 UTC m=+24.862329716" watchObservedRunningTime="2026-09-17 01:37:46.613796441 +0000 UTC m=+24.863773756"
Sep 17 01:37:47.394467 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:47.394431    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9cvt8"
Sep 17 01:37:47.395383 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:47.395364    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9cvt8"
Sep 17 01:37:47.600468 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:47.600437    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9cvt8"
Sep 17 01:37:47.600896 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:47.600871    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9cvt8"
Sep 17 01:37:48.351015 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:48.350973    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzxlf"
Sep 17 01:37:48.351175 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:48.350979    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5bgg"
Sep 17 01:37:48.351175 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:48.351111    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzxlf" podUID="d0de4f20-0902-4f4f-b1cf-48f5e4119117"
Sep 17 01:37:48.351322 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:48.351206    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5bgg" podUID="1adde053-a235-4e41-a52e-39e2f75da8a3"
Sep 17 01:37:48.351322 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:48.350987    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8bbk"
Sep 17 01:37:48.351422 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:48.351375    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8bbk" podUID="091f4d92-aca2-45ac-9c63-6b73cf983b35"
Sep 17 01:37:49.607823 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:49.607512    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl" event={"ID":"f6c9e227-299b-4d98-93dc-bd53cb3f37b4","Type":"ContainerStarted","Data":"eb8a4d4174d8a81797275aaa2b0671608f3bb57609a165ae059a7319d181f5d7"}
Sep 17 01:37:49.608626 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:49.607823    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:49.608626 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:49.607872    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:49.609799 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:49.609776    2560 generic.go:356] "Generic (PLEG): container finished" podID="8c26e78f-6e4c-489e-98c8-fa49ca563945" containerID="a2c95433368bbb58d02e6983939d893076572cf2cf0b10b3e280aaf3173a1cfb" exitCode=0
Sep 17 01:37:49.609924 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:49.609855    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5jxkd" event={"ID":"8c26e78f-6e4c-489e-98c8-fa49ca563945","Type":"ContainerDied","Data":"a2c95433368bbb58d02e6983939d893076572cf2cf0b10b3e280aaf3173a1cfb"}
Sep 17 01:37:49.623425 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:49.623402    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:49.623573 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:49.623560    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:49.638706 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:49.638667    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl" podStartSLOduration=8.370681319 podStartE2EDuration="26.638653496s" totalImagesPullingTime="18.267972177s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 01:37:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:37:49.638154781 +0000 UTC m=+27.888132096" watchObservedRunningTime="2026-09-17 01:37:49.638653496 +0000 UTC m=+27.888630833"
Sep 17 01:37:50.351095 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:50.350971    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzxlf"
Sep 17 01:37:50.351095 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:50.350971    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8bbk"
Sep 17 01:37:50.351095 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:50.351091    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzxlf" podUID="d0de4f20-0902-4f4f-b1cf-48f5e4119117"
Sep 17 01:37:50.351095 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:50.351115    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5bgg"
Sep 17 01:37:50.351576 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:50.351229    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8bbk" podUID="091f4d92-aca2-45ac-9c63-6b73cf983b35"
Sep 17 01:37:50.351576 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:50.351326    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5bgg" podUID="1adde053-a235-4e41-a52e-39e2f75da8a3"
Sep 17 01:37:50.612535 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:50.612477    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:37:50.996181 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:50.996035    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-t5bgg"]
Sep 17 01:37:50.996181 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:50.996163    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5bgg"
Sep 17 01:37:50.996427 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:50.996298    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5bgg" podUID="1adde053-a235-4e41-a52e-39e2f75da8a3"
Sep 17 01:37:50.996756 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:50.996732    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bzxlf"]
Sep 17 01:37:50.996877 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:50.996829    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzxlf"
Sep 17 01:37:50.996952 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:50.996928    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzxlf" podUID="d0de4f20-0902-4f4f-b1cf-48f5e4119117"
Sep 17 01:37:50.998554 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:50.998532    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-p8bbk"]
Sep 17 01:37:50.998664 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:50.998628    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8bbk"
Sep 17 01:37:50.998782 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:50.998760    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8bbk" podUID="091f4d92-aca2-45ac-9c63-6b73cf983b35"
Sep 17 01:37:51.616677 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:51.616641    2560 generic.go:356] "Generic (PLEG): container finished" podID="8c26e78f-6e4c-489e-98c8-fa49ca563945" containerID="076d5ed9c5d54d44686cc482a3db90dd38ab31d94109619839ca8bef70da5492" exitCode=0
Sep 17 01:37:51.617264 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:51.616717    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5jxkd" event={"ID":"8c26e78f-6e4c-489e-98c8-fa49ca563945","Type":"ContainerDied","Data":"076d5ed9c5d54d44686cc482a3db90dd38ab31d94109619839ca8bef70da5492"}
Sep 17 01:37:52.621488 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:52.621455    2560 generic.go:356] "Generic (PLEG): container finished" podID="8c26e78f-6e4c-489e-98c8-fa49ca563945" containerID="b054aa1f9e00f8234e081e90339f392d2e989fa55ecdb198649ab9ae8b489bff" exitCode=0
Sep 17 01:37:52.621868 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:52.621502    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5jxkd" event={"ID":"8c26e78f-6e4c-489e-98c8-fa49ca563945","Type":"ContainerDied","Data":"b054aa1f9e00f8234e081e90339f392d2e989fa55ecdb198649ab9ae8b489bff"}
Sep 17 01:37:53.350544 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:53.350479    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5bgg"
Sep 17 01:37:53.350720 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:53.350594    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8bbk"
Sep 17 01:37:53.350720 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:53.350604    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzxlf"
Sep 17 01:37:53.350720 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:53.350601    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5bgg" podUID="1adde053-a235-4e41-a52e-39e2f75da8a3"
Sep 17 01:37:53.350868 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:53.350712    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8bbk" podUID="091f4d92-aca2-45ac-9c63-6b73cf983b35"
Sep 17 01:37:53.350868 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:53.350795    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzxlf" podUID="d0de4f20-0902-4f4f-b1cf-48f5e4119117"
Sep 17 01:37:53.755108 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:53.754981    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9cvt8_df44a97e-9c59-4dc9-abd9-3d1bd20972b9/konnectivity-agent/0.log" limit=1024
Sep 17 01:37:53.837380 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:53.837348    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9cvt8_df44a97e-9c59-4dc9-abd9-3d1bd20972b9/konnectivity-agent/0.log" limit=1024
Sep 17 01:37:55.351473 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:55.351280    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8bbk"
Sep 17 01:37:55.351892 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:55.351280    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzxlf"
Sep 17 01:37:55.351892 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:55.351280    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5bgg"
Sep 17 01:37:55.351892 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:55.351599    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p8bbk" podUID="091f4d92-aca2-45ac-9c63-6b73cf983b35"
Sep 17 01:37:55.351892 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:55.351685    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5bgg" podUID="1adde053-a235-4e41-a52e-39e2f75da8a3"
Sep 17 01:37:55.351892 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:55.351787    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzxlf" podUID="d0de4f20-0902-4f4f-b1cf-48f5e4119117"
Sep 17 01:37:55.933791 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:55.933755    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/091f4d92-aca2-45ac-9c63-6b73cf983b35-metrics-certs\") pod \"network-metrics-daemon-p8bbk\" (UID: \"091f4d92-aca2-45ac-9c63-6b73cf983b35\") " pod="openshift-multus/network-metrics-daemon-p8bbk"
Sep 17 01:37:55.933990 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:55.933924    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 01:37:55.934060 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:55.933999    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/091f4d92-aca2-45ac-9c63-6b73cf983b35-metrics-certs podName:091f4d92-aca2-45ac-9c63-6b73cf983b35 nodeName:}" failed. No retries permitted until 2026-09-17 01:38:27.933978123 +0000 UTC m=+66.183955413 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/091f4d92-aca2-45ac-9c63-6b73cf983b35-metrics-certs") pod "network-metrics-daemon-p8bbk" (UID: "091f4d92-aca2-45ac-9c63-6b73cf983b35") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 01:37:56.035083 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:56.035047    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt7t4\" (UniqueName: \"kubernetes.io/projected/1adde053-a235-4e41-a52e-39e2f75da8a3-kube-api-access-zt7t4\") pod \"network-check-target-t5bgg\" (UID: \"1adde053-a235-4e41-a52e-39e2f75da8a3\") " pod="openshift-network-diagnostics/network-check-target-t5bgg"
Sep 17 01:37:56.035265 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:56.035134    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d0de4f20-0902-4f4f-b1cf-48f5e4119117-original-pull-secret\") pod \"global-pull-secret-syncer-bzxlf\" (UID: \"d0de4f20-0902-4f4f-b1cf-48f5e4119117\") " pod="kube-system/global-pull-secret-syncer-bzxlf"
Sep 17 01:37:56.035265 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:56.035219    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 01:37:56.035265 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:56.035230    2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 01:37:56.035265 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:56.035253    2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 01:37:56.035265 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:56.035266    2560 projected.go:196] Error preparing data for projected volume kube-api-access-zt7t4 for pod openshift-network-diagnostics/network-check-target-t5bgg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 01:37:56.035476 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:56.035315    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0de4f20-0902-4f4f-b1cf-48f5e4119117-original-pull-secret podName:d0de4f20-0902-4f4f-b1cf-48f5e4119117 nodeName:}" failed. No retries permitted until 2026-09-17 01:38:28.035295341 +0000 UTC m=+66.285272636 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d0de4f20-0902-4f4f-b1cf-48f5e4119117-original-pull-secret") pod "global-pull-secret-syncer-bzxlf" (UID: "d0de4f20-0902-4f4f-b1cf-48f5e4119117") : object "kube-system"/"original-pull-secret" not registered
Sep 17 01:37:56.035476 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:56.035333    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1adde053-a235-4e41-a52e-39e2f75da8a3-kube-api-access-zt7t4 podName:1adde053-a235-4e41-a52e-39e2f75da8a3 nodeName:}" failed. No retries permitted until 2026-09-17 01:38:28.035323469 +0000 UTC m=+66.285300765 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-zt7t4" (UniqueName: "kubernetes.io/projected/1adde053-a235-4e41-a52e-39e2f75da8a3-kube-api-access-zt7t4") pod "network-check-target-t5bgg" (UID: "1adde053-a235-4e41-a52e-39e2f75da8a3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 01:37:56.597161 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:56.597133    2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-95.ec2.internal" event="NodeReady"
Sep 17 01:37:56.597629 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:56.597293    2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 17 01:37:56.637966 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:56.637936    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-cjxjr"]
Sep 17 01:37:56.674305 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:56.674218    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4rxjm"]
Sep 17 01:37:56.674455 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:56.674352    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cjxjr"
Sep 17 01:37:56.676524 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:56.676485    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-crsck\""
Sep 17 01:37:56.676524 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:56.676515    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 17 01:37:56.676981 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:56.676954    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 17 01:37:56.690131 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:56.690104    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cjxjr"]
Sep 17 01:37:56.690227 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:56.690208    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4rxjm"
Sep 17 01:37:56.690307 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:56.690236    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4rxjm"]
Sep 17 01:37:56.692097 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:56.692076    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 17 01:37:56.692206 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:56.692103    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 17 01:37:56.692206 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:56.692132    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 17 01:37:56.692206 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:56.692165    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gfnxn\""
Sep 17 01:37:56.760099 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:56.760063    2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9cvt8_df44a97e-9c59-4dc9-abd9-3d1bd20972b9/konnectivity-agent/0.log" limit=1024
Sep 17 01:37:56.840767 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:56.840727    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23eb4c89-97d5-44b9-9775-02f25ce8ed5c-metrics-tls\") pod \"dns-default-cjxjr\" (UID: \"23eb4c89-97d5-44b9-9775-02f25ce8ed5c\") " pod="openshift-dns/dns-default-cjxjr"
Sep 17 01:37:56.840934 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:56.840784    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzfjx\" (UniqueName: \"kubernetes.io/projected/23eb4c89-97d5-44b9-9775-02f25ce8ed5c-kube-api-access-rzfjx\") pod \"dns-default-cjxjr\" (UID: \"23eb4c89-97d5-44b9-9775-02f25ce8ed5c\") " pod="openshift-dns/dns-default-cjxjr"
Sep 17 01:37:56.840934 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:56.840820    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b98a580-e689-4636-8f7b-5962006de1a5-cert\") pod \"ingress-canary-4rxjm\" (UID: \"1b98a580-e689-4636-8f7b-5962006de1a5\") " pod="openshift-ingress-canary/ingress-canary-4rxjm"
Sep 17 01:37:56.840934 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:56.840866    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23eb4c89-97d5-44b9-9775-02f25ce8ed5c-tmp-dir\") pod \"dns-default-cjxjr\" (UID: \"23eb4c89-97d5-44b9-9775-02f25ce8ed5c\") " pod="openshift-dns/dns-default-cjxjr"
Sep 17 01:37:56.840934 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:56.840889    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/23eb4c89-97d5-44b9-9775-02f25ce8ed5c-config-volume\") pod \"dns-default-cjxjr\" (UID: \"23eb4c89-97d5-44b9-9775-02f25ce8ed5c\") " pod="openshift-dns/dns-default-cjxjr"
Sep 17 01:37:56.841108 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:56.840977    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fv8sj\" (UniqueName: \"kubernetes.io/projected/1b98a580-e689-4636-8f7b-5962006de1a5-kube-api-access-fv8sj\") pod \"ingress-canary-4rxjm\" (UID: \"1b98a580-e689-4636-8f7b-5962006de1a5\") " pod="openshift-ingress-canary/ingress-canary-4rxjm"
Sep 17 01:37:56.942117 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:56.942033    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23eb4c89-97d5-44b9-9775-02f25ce8ed5c-metrics-tls\") pod \"dns-default-cjxjr\" (UID: \"23eb4c89-97d5-44b9-9775-02f25ce8ed5c\") " pod="openshift-dns/dns-default-cjxjr"
Sep 17 01:37:56.942117 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:56.942079    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzfjx\" (UniqueName: \"kubernetes.io/projected/23eb4c89-97d5-44b9-9775-02f25ce8ed5c-kube-api-access-rzfjx\") pod \"dns-default-cjxjr\" (UID: \"23eb4c89-97d5-44b9-9775-02f25ce8ed5c\") " pod="openshift-dns/dns-default-cjxjr"
Sep 17 01:37:56.942117 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:56.942105    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b98a580-e689-4636-8f7b-5962006de1a5-cert\") pod \"ingress-canary-4rxjm\" (UID: \"1b98a580-e689-4636-8f7b-5962006de1a5\") " pod="openshift-ingress-canary/ingress-canary-4rxjm"
Sep 17 01:37:56.942415 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:56.942134    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23eb4c89-97d5-44b9-9775-02f25ce8ed5c-tmp-dir\") pod \"dns-default-cjxjr\" (UID: \"23eb4c89-97d5-44b9-9775-02f25ce8ed5c\") " pod="openshift-dns/dns-default-cjxjr"
Sep 17 01:37:56.942415 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:56.942167    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/23eb4c89-97d5-44b9-9775-02f25ce8ed5c-config-volume\") pod \"dns-default-cjxjr\" (UID: \"23eb4c89-97d5-44b9-9775-02f25ce8ed5c\") " pod="openshift-dns/dns-default-cjxjr"
Sep 17 01:37:56.942415 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:56.942194    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fv8sj\" (UniqueName: \"kubernetes.io/projected/1b98a580-e689-4636-8f7b-5962006de1a5-kube-api-access-fv8sj\") pod \"ingress-canary-4rxjm\" (UID: \"1b98a580-e689-4636-8f7b-5962006de1a5\") " pod="openshift-ingress-canary/ingress-canary-4rxjm"
Sep 17 01:37:56.942415 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:56.942210    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 01:37:56.942415 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:56.942303    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23eb4c89-97d5-44b9-9775-02f25ce8ed5c-metrics-tls podName:23eb4c89-97d5-44b9-9775-02f25ce8ed5c nodeName:}" failed. No retries permitted until 2026-09-17 01:37:57.442286308 +0000 UTC m=+35.692263599 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/23eb4c89-97d5-44b9-9775-02f25ce8ed5c-metrics-tls") pod "dns-default-cjxjr" (UID: "23eb4c89-97d5-44b9-9775-02f25ce8ed5c") : secret "dns-default-metrics-tls" not found
Sep 17 01:37:56.942702 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:56.942683    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23eb4c89-97d5-44b9-9775-02f25ce8ed5c-tmp-dir\") pod \"dns-default-cjxjr\" (UID: \"23eb4c89-97d5-44b9-9775-02f25ce8ed5c\") " pod="openshift-dns/dns-default-cjxjr"
Sep 17 01:37:56.943034 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:56.943013    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/23eb4c89-97d5-44b9-9775-02f25ce8ed5c-config-volume\") pod \"dns-default-cjxjr\" (UID: \"23eb4c89-97d5-44b9-9775-02f25ce8ed5c\") " pod="openshift-dns/dns-default-cjxjr"
Sep 17 01:37:56.946815 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:56.946795    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b98a580-e689-4636-8f7b-5962006de1a5-cert\") pod \"ingress-canary-4rxjm\" (UID: \"1b98a580-e689-4636-8f7b-5962006de1a5\") " pod="openshift-ingress-canary/ingress-canary-4rxjm"
Sep 17 01:37:56.949687 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:56.949666    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzfjx\" (UniqueName: \"kubernetes.io/projected/23eb4c89-97d5-44b9-9775-02f25ce8ed5c-kube-api-access-rzfjx\") pod \"dns-default-cjxjr\" (UID: \"23eb4c89-97d5-44b9-9775-02f25ce8ed5c\") " pod="openshift-dns/dns-default-cjxjr"
Sep 17 01:37:56.950029 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:56.950009    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fv8sj\" (UniqueName: \"kubernetes.io/projected/1b98a580-e689-4636-8f7b-5962006de1a5-kube-api-access-fv8sj\") pod \"ingress-canary-4rxjm\" (UID: \"1b98a580-e689-4636-8f7b-5962006de1a5\") " pod="openshift-ingress-canary/ingress-canary-4rxjm"
Sep 17 01:37:57.011051 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:57.011004    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4rxjm"
Sep 17 01:37:57.351114 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:57.351081    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzxlf"
Sep 17 01:37:57.351114 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:57.351109    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5bgg"
Sep 17 01:37:57.354131 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:57.351497    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8bbk"
Sep 17 01:37:57.354667 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:57.354648    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 17 01:37:57.354877 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:57.354853    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 17 01:37:57.354987 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:57.354860    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5fdmc\""
Sep 17 01:37:57.354987 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:57.354926    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 17 01:37:57.354987 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:57.354926    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hdsht\""
Sep 17 01:37:57.355139 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:57.354992    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 17 01:37:57.446094 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:57.446063    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23eb4c89-97d5-44b9-9775-02f25ce8ed5c-metrics-tls\") pod \"dns-default-cjxjr\" (UID: \"23eb4c89-97d5-44b9-9775-02f25ce8ed5c\") " pod="openshift-dns/dns-default-cjxjr"
Sep 17 01:37:57.446285 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:57.446238    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 01:37:57.446359 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:57.446330    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23eb4c89-97d5-44b9-9775-02f25ce8ed5c-metrics-tls podName:23eb4c89-97d5-44b9-9775-02f25ce8ed5c nodeName:}" failed. No retries permitted until 2026-09-17 01:37:58.446309319 +0000 UTC m=+36.696286610 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/23eb4c89-97d5-44b9-9775-02f25ce8ed5c-metrics-tls") pod "dns-default-cjxjr" (UID: "23eb4c89-97d5-44b9-9775-02f25ce8ed5c") : secret "dns-default-metrics-tls" not found
Sep 17 01:37:57.446877 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:57.446853    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4rxjm"]
Sep 17 01:37:57.451544 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:37:57.451522    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b98a580_e689_4636_8f7b_5962006de1a5.slice/crio-c8e7cba6d64f19b8ac732135d633ca1eb03c83b91250284197aa07e18f98f392 WatchSource:0}: Error finding container c8e7cba6d64f19b8ac732135d633ca1eb03c83b91250284197aa07e18f98f392: Status 404 returned error can't find the container with id c8e7cba6d64f19b8ac732135d633ca1eb03c83b91250284197aa07e18f98f392
Sep 17 01:37:57.637012 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:57.636968    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5jxkd" event={"ID":"8c26e78f-6e4c-489e-98c8-fa49ca563945","Type":"ContainerStarted","Data":"d73b6a0159777b0b5351a7d2ec7024a7c1df19bc7344206f0bdd79a671751511"}
Sep 17 01:37:57.638418 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:57.638233    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4rxjm" event={"ID":"1b98a580-e689-4636-8f7b-5962006de1a5","Type":"ContainerStarted","Data":"c8e7cba6d64f19b8ac732135d633ca1eb03c83b91250284197aa07e18f98f392"}
Sep 17 01:37:58.456128 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:58.456091    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23eb4c89-97d5-44b9-9775-02f25ce8ed5c-metrics-tls\") pod \"dns-default-cjxjr\" (UID: \"23eb4c89-97d5-44b9-9775-02f25ce8ed5c\") " pod="openshift-dns/dns-default-cjxjr"
Sep 17 01:37:58.456358 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:58.456213    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 01:37:58.456358 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:37:58.456282    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23eb4c89-97d5-44b9-9775-02f25ce8ed5c-metrics-tls podName:23eb4c89-97d5-44b9-9775-02f25ce8ed5c nodeName:}" failed. No retries permitted until 2026-09-17 01:38:00.456264247 +0000 UTC m=+38.706241538 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/23eb4c89-97d5-44b9-9775-02f25ce8ed5c-metrics-tls") pod "dns-default-cjxjr" (UID: "23eb4c89-97d5-44b9-9775-02f25ce8ed5c") : secret "dns-default-metrics-tls" not found
Sep 17 01:37:58.644207 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:58.644176    2560 generic.go:356] "Generic (PLEG): container finished" podID="8c26e78f-6e4c-489e-98c8-fa49ca563945" containerID="d73b6a0159777b0b5351a7d2ec7024a7c1df19bc7344206f0bdd79a671751511" exitCode=0
Sep 17 01:37:58.644702 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:58.644235    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5jxkd" event={"ID":"8c26e78f-6e4c-489e-98c8-fa49ca563945","Type":"ContainerDied","Data":"d73b6a0159777b0b5351a7d2ec7024a7c1df19bc7344206f0bdd79a671751511"}
Sep 17 01:37:59.650851 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:59.650811    2560 generic.go:356] "Generic (PLEG): container finished" podID="8c26e78f-6e4c-489e-98c8-fa49ca563945" containerID="a71df2ac5a6874cedb59483f1d8c01d8bf2e01bc85a16d6371b2fcac9db52038" exitCode=0
Sep 17 01:37:59.651317 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:37:59.650910    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5jxkd" event={"ID":"8c26e78f-6e4c-489e-98c8-fa49ca563945","Type":"ContainerDied","Data":"a71df2ac5a6874cedb59483f1d8c01d8bf2e01bc85a16d6371b2fcac9db52038"}
Sep 17 01:38:00.470014 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:00.469933    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23eb4c89-97d5-44b9-9775-02f25ce8ed5c-metrics-tls\") pod \"dns-default-cjxjr\" (UID: \"23eb4c89-97d5-44b9-9775-02f25ce8ed5c\") " pod="openshift-dns/dns-default-cjxjr"
Sep 17 01:38:00.470149 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:38:00.470058    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 01:38:00.470149 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:38:00.470106    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23eb4c89-97d5-44b9-9775-02f25ce8ed5c-metrics-tls podName:23eb4c89-97d5-44b9-9775-02f25ce8ed5c nodeName:}" failed. No retries permitted until 2026-09-17 01:38:04.470093699 +0000 UTC m=+42.720070990 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/23eb4c89-97d5-44b9-9775-02f25ce8ed5c-metrics-tls") pod "dns-default-cjxjr" (UID: "23eb4c89-97d5-44b9-9775-02f25ce8ed5c") : secret "dns-default-metrics-tls" not found
Sep 17 01:38:00.654940 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:00.654909    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4rxjm" event={"ID":"1b98a580-e689-4636-8f7b-5962006de1a5","Type":"ContainerStarted","Data":"dc6206b81b36ef15807aa611a097652a64d077f11f607de55fd15b21be877ee2"}
Sep 17 01:38:00.658511 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:00.658486    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5jxkd" event={"ID":"8c26e78f-6e4c-489e-98c8-fa49ca563945","Type":"ContainerStarted","Data":"482dab584e8849e97f8fa0beeefaf39737362d9cadf5d2229b54a023bb1ba484"}
Sep 17 01:38:00.671601 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:00.671559    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4rxjm" podStartSLOduration=1.9588120180000002 podStartE2EDuration="4.671546609s" totalImagesPullingTime="2.712734591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:37:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:38:00.671179267 +0000 UTC m=+38.921156579" watchObservedRunningTime="2026-09-17 01:38:00.671546609 +0000 UTC m=+38.921523921"
Sep 17 01:38:00.688803 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:00.688757    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5jxkd" podStartSLOduration=8.361790175 podStartE2EDuration="37.688744062s" totalImagesPullingTime="29.326953887s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 01:37:23 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:38:00.688285237 +0000 UTC m=+38.938262549" watchObservedRunningTime="2026-09-17 01:38:00.688744062 +0000 UTC m=+38.938721374"
Sep 17 01:38:04.497371 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:04.497324    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23eb4c89-97d5-44b9-9775-02f25ce8ed5c-metrics-tls\") pod \"dns-default-cjxjr\" (UID: \"23eb4c89-97d5-44b9-9775-02f25ce8ed5c\") " pod="openshift-dns/dns-default-cjxjr"
Sep 17 01:38:04.497798 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:38:04.497467    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 01:38:04.497798 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:38:04.497527    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23eb4c89-97d5-44b9-9775-02f25ce8ed5c-metrics-tls podName:23eb4c89-97d5-44b9-9775-02f25ce8ed5c nodeName:}" failed. No retries permitted until 2026-09-17 01:38:12.497511716 +0000 UTC m=+50.747489009 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/23eb4c89-97d5-44b9-9775-02f25ce8ed5c-metrics-tls") pod "dns-default-cjxjr" (UID: "23eb4c89-97d5-44b9-9775-02f25ce8ed5c") : secret "dns-default-metrics-tls" not found
Sep 17 01:38:12.553415 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:12.553370    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23eb4c89-97d5-44b9-9775-02f25ce8ed5c-metrics-tls\") pod \"dns-default-cjxjr\" (UID: \"23eb4c89-97d5-44b9-9775-02f25ce8ed5c\") " pod="openshift-dns/dns-default-cjxjr"
Sep 17 01:38:12.553841 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:38:12.553490    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 01:38:12.553841 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:38:12.553559    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23eb4c89-97d5-44b9-9775-02f25ce8ed5c-metrics-tls podName:23eb4c89-97d5-44b9-9775-02f25ce8ed5c nodeName:}" failed. No retries permitted until 2026-09-17 01:38:28.553540417 +0000 UTC m=+66.803517711 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/23eb4c89-97d5-44b9-9775-02f25ce8ed5c-metrics-tls") pod "dns-default-cjxjr" (UID: "23eb4c89-97d5-44b9-9775-02f25ce8ed5c") : secret "dns-default-metrics-tls" not found
Sep 17 01:38:21.626877 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:21.626845    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4sjxl"
Sep 17 01:38:27.957143 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:27.957104    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/091f4d92-aca2-45ac-9c63-6b73cf983b35-metrics-certs\") pod \"network-metrics-daemon-p8bbk\" (UID: \"091f4d92-aca2-45ac-9c63-6b73cf983b35\") " pod="openshift-multus/network-metrics-daemon-p8bbk"
Sep 17 01:38:27.959417 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:27.959389    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 17 01:38:27.967865 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:38:27.967844    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 17 01:38:27.967968 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:38:27.967913    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/091f4d92-aca2-45ac-9c63-6b73cf983b35-metrics-certs podName:091f4d92-aca2-45ac-9c63-6b73cf983b35 nodeName:}" failed. No retries permitted until 2026-09-17 01:39:31.967892093 +0000 UTC m=+130.217869398 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/091f4d92-aca2-45ac-9c63-6b73cf983b35-metrics-certs") pod "network-metrics-daemon-p8bbk" (UID: "091f4d92-aca2-45ac-9c63-6b73cf983b35") : secret "metrics-daemon-secret" not found
Sep 17 01:38:28.058288 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:28.058230    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d0de4f20-0902-4f4f-b1cf-48f5e4119117-original-pull-secret\") pod \"global-pull-secret-syncer-bzxlf\" (UID: \"d0de4f20-0902-4f4f-b1cf-48f5e4119117\") " pod="kube-system/global-pull-secret-syncer-bzxlf"
Sep 17 01:38:28.058288 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:28.058298    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt7t4\" (UniqueName: \"kubernetes.io/projected/1adde053-a235-4e41-a52e-39e2f75da8a3-kube-api-access-zt7t4\") pod \"network-check-target-t5bgg\" (UID: \"1adde053-a235-4e41-a52e-39e2f75da8a3\") " pod="openshift-network-diagnostics/network-check-target-t5bgg"
Sep 17 01:38:28.060224 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:28.060202    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 17 01:38:28.060224 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:28.060220    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 17 01:38:28.070700 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:28.070682    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 17 01:38:28.073140 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:28.073117    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d0de4f20-0902-4f4f-b1cf-48f5e4119117-original-pull-secret\") pod \"global-pull-secret-syncer-bzxlf\" (UID: \"d0de4f20-0902-4f4f-b1cf-48f5e4119117\") " pod="kube-system/global-pull-secret-syncer-bzxlf"
Sep 17 01:38:28.081588 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:28.081567    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zt7t4\" (UniqueName: \"kubernetes.io/projected/1adde053-a235-4e41-a52e-39e2f75da8a3-kube-api-access-zt7t4\") pod \"network-check-target-t5bgg\" (UID: \"1adde053-a235-4e41-a52e-39e2f75da8a3\") " pod="openshift-network-diagnostics/network-check-target-t5bgg"
Sep 17 01:38:28.263624 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:28.263540    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzxlf"
Sep 17 01:38:28.275357 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:28.275330    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hdsht\""
Sep 17 01:38:28.283766 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:28.283742    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5bgg"
Sep 17 01:38:28.535229 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:28.535139    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bzxlf"]
Sep 17 01:38:28.540007 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:38:28.539979    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0de4f20_0902_4f4f_b1cf_48f5e4119117.slice/crio-aec4f63f1f6bdddfc9adab503a7532294e847ec0f7954a1d56eb5c5116118a51 WatchSource:0}: Error finding container aec4f63f1f6bdddfc9adab503a7532294e847ec0f7954a1d56eb5c5116118a51: Status 404 returned error can't find the container with id aec4f63f1f6bdddfc9adab503a7532294e847ec0f7954a1d56eb5c5116118a51
Sep 17 01:38:28.557947 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:28.557919    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-t5bgg"]
Sep 17 01:38:28.565095 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:28.561353    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23eb4c89-97d5-44b9-9775-02f25ce8ed5c-metrics-tls\") pod \"dns-default-cjxjr\" (UID: \"23eb4c89-97d5-44b9-9775-02f25ce8ed5c\") " pod="openshift-dns/dns-default-cjxjr"
Sep 17 01:38:28.565095 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:38:28.561451    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 01:38:28.565095 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:38:28.561509    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23eb4c89-97d5-44b9-9775-02f25ce8ed5c-metrics-tls podName:23eb4c89-97d5-44b9-9775-02f25ce8ed5c nodeName:}" failed. No retries permitted until 2026-09-17 01:39:00.561495259 +0000 UTC m=+98.811472549 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/23eb4c89-97d5-44b9-9775-02f25ce8ed5c-metrics-tls") pod "dns-default-cjxjr" (UID: "23eb4c89-97d5-44b9-9775-02f25ce8ed5c") : secret "dns-default-metrics-tls" not found
Sep 17 01:38:28.565095 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:38:28.561745    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1adde053_a235_4e41_a52e_39e2f75da8a3.slice/crio-e9d7b05c86c4166b981f585b6804fe2c46df4d69a1a953d694685b6133710b8e WatchSource:0}: Error finding container e9d7b05c86c4166b981f585b6804fe2c46df4d69a1a953d694685b6133710b8e: Status 404 returned error can't find the container with id e9d7b05c86c4166b981f585b6804fe2c46df4d69a1a953d694685b6133710b8e
Sep 17 01:38:28.722676 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:28.722635    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bzxlf" event={"ID":"d0de4f20-0902-4f4f-b1cf-48f5e4119117","Type":"ContainerStarted","Data":"aec4f63f1f6bdddfc9adab503a7532294e847ec0f7954a1d56eb5c5116118a51"}
Sep 17 01:38:28.723778 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:28.723749    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-t5bgg" event={"ID":"1adde053-a235-4e41-a52e-39e2f75da8a3","Type":"ContainerStarted","Data":"e9d7b05c86c4166b981f585b6804fe2c46df4d69a1a953d694685b6133710b8e"}
Sep 17 01:38:33.738064 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:33.738012    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-t5bgg" event={"ID":"1adde053-a235-4e41-a52e-39e2f75da8a3","Type":"ContainerStarted","Data":"668c9fe279a85aa5c912dcd46efb8a90a9ed5d7226bf4d05b9d80b509df0e647"}
Sep 17 01:38:33.738524 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:33.738127    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-t5bgg"
Sep 17 01:38:33.742894 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:33.742869    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bzxlf" event={"ID":"d0de4f20-0902-4f4f-b1cf-48f5e4119117","Type":"ContainerStarted","Data":"aced15b4701136eb56baa2c17816820f60ad8487a337d96027a31dcb98a8d527"}
Sep 17 01:38:33.751816 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:33.751756    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-t5bgg" podStartSLOduration=66.442158274 podStartE2EDuration="1m10.751745171s" totalImagesPullingTime="4.309586897s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:37:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:38:33.751485146 +0000 UTC m=+72.001462459" watchObservedRunningTime="2026-09-17 01:38:33.751745171 +0000 UTC m=+72.001722483"
Sep 17 01:38:59.412458 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:59.412320    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bzxlf" podStartSLOduration=92.077185904 podStartE2EDuration="1m36.412301023s" totalImagesPullingTime="4.335115119s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 01:37:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:38:33.763387867 +0000 UTC m=+72.013365176" watchObservedRunningTime="2026-09-17 01:38:59.412301023 +0000 UTC m=+97.662278336"
Sep 17 01:38:59.412911 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:59.412466    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79785894-9kx5s"]
Sep 17 01:38:59.416465 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:59.416447    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79785894-9kx5s"
Sep 17 01:38:59.418655 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:59.418629    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 17 01:38:59.418761 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:59.418680    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 17 01:38:59.418761 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:59.418682    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 17 01:38:59.419350 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:59.419306    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 17 01:38:59.419350 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:59.419347    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 17 01:38:59.419532 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:59.419506    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 17 01:38:59.419871 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:59.419851    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 17 01:38:59.425226 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:59.425183    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79785894-9kx5s"]
Sep 17 01:38:59.470195 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:59.470159    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f81151c2-6453-473a-98be-23c88ae560f9-hub\") pod \"cluster-proxy-proxy-agent-5b79785894-9kx5s\" (UID: \"f81151c2-6453-473a-98be-23c88ae560f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79785894-9kx5s"
Sep 17 01:38:59.470195 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:59.470195    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f81151c2-6453-473a-98be-23c88ae560f9-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5b79785894-9kx5s\" (UID: \"f81151c2-6453-473a-98be-23c88ae560f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79785894-9kx5s"
Sep 17 01:38:59.470453 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:59.470225    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f81151c2-6453-473a-98be-23c88ae560f9-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5b79785894-9kx5s\" (UID: \"f81151c2-6453-473a-98be-23c88ae560f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79785894-9kx5s"
Sep 17 01:38:59.470453 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:59.470365    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f81151c2-6453-473a-98be-23c88ae560f9-ca\") pod \"cluster-proxy-proxy-agent-5b79785894-9kx5s\" (UID: \"f81151c2-6453-473a-98be-23c88ae560f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79785894-9kx5s"
Sep 17 01:38:59.470453 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:59.470419    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f81151c2-6453-473a-98be-23c88ae560f9-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5b79785894-9kx5s\" (UID: \"f81151c2-6453-473a-98be-23c88ae560f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79785894-9kx5s"
Sep 17 01:38:59.470453 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:59.470450    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqvts\" (UniqueName: \"kubernetes.io/projected/f81151c2-6453-473a-98be-23c88ae560f9-kube-api-access-fqvts\") pod \"cluster-proxy-proxy-agent-5b79785894-9kx5s\" (UID: \"f81151c2-6453-473a-98be-23c88ae560f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79785894-9kx5s"
Sep 17 01:38:59.571481 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:59.571444    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f81151c2-6453-473a-98be-23c88ae560f9-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5b79785894-9kx5s\" (UID: \"f81151c2-6453-473a-98be-23c88ae560f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79785894-9kx5s"
Sep 17 01:38:59.571686 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:59.571486    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqvts\" (UniqueName: \"kubernetes.io/projected/f81151c2-6453-473a-98be-23c88ae560f9-kube-api-access-fqvts\") pod \"cluster-proxy-proxy-agent-5b79785894-9kx5s\" (UID: \"f81151c2-6453-473a-98be-23c88ae560f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79785894-9kx5s"
Sep 17 01:38:59.571686 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:59.571667    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f81151c2-6453-473a-98be-23c88ae560f9-hub\") pod \"cluster-proxy-proxy-agent-5b79785894-9kx5s\" (UID: \"f81151c2-6453-473a-98be-23c88ae560f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79785894-9kx5s"
Sep 17 01:38:59.571794 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:59.571705    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f81151c2-6453-473a-98be-23c88ae560f9-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5b79785894-9kx5s\" (UID: \"f81151c2-6453-473a-98be-23c88ae560f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79785894-9kx5s"
Sep 17 01:38:59.571844 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:59.571804    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f81151c2-6453-473a-98be-23c88ae560f9-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5b79785894-9kx5s\" (UID: \"f81151c2-6453-473a-98be-23c88ae560f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79785894-9kx5s"
Sep 17 01:38:59.571887 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:59.571842    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f81151c2-6453-473a-98be-23c88ae560f9-ca\") pod \"cluster-proxy-proxy-agent-5b79785894-9kx5s\" (UID: \"f81151c2-6453-473a-98be-23c88ae560f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79785894-9kx5s"
Sep 17 01:38:59.572455 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:59.572421    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f81151c2-6453-473a-98be-23c88ae560f9-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5b79785894-9kx5s\" (UID: \"f81151c2-6453-473a-98be-23c88ae560f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79785894-9kx5s"
Sep 17 01:38:59.574170 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:59.574144    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f81151c2-6453-473a-98be-23c88ae560f9-ca\") pod \"cluster-proxy-proxy-agent-5b79785894-9kx5s\" (UID: \"f81151c2-6453-473a-98be-23c88ae560f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79785894-9kx5s"
Sep 17 01:38:59.574276 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:59.574186    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f81151c2-6453-473a-98be-23c88ae560f9-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5b79785894-9kx5s\" (UID: \"f81151c2-6453-473a-98be-23c88ae560f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79785894-9kx5s"
Sep 17 01:38:59.574454 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:59.574437    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f81151c2-6453-473a-98be-23c88ae560f9-hub\") pod \"cluster-proxy-proxy-agent-5b79785894-9kx5s\" (UID: \"f81151c2-6453-473a-98be-23c88ae560f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79785894-9kx5s"
Sep 17 01:38:59.574491 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:59.574449    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f81151c2-6453-473a-98be-23c88ae560f9-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5b79785894-9kx5s\" (UID: \"f81151c2-6453-473a-98be-23c88ae560f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79785894-9kx5s"
Sep 17 01:38:59.583422 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:59.583401    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqvts\" (UniqueName: \"kubernetes.io/projected/f81151c2-6453-473a-98be-23c88ae560f9-kube-api-access-fqvts\") pod \"cluster-proxy-proxy-agent-5b79785894-9kx5s\" (UID: \"f81151c2-6453-473a-98be-23c88ae560f9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79785894-9kx5s"
Sep 17 01:38:59.739581 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:38:59.739493    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79785894-9kx5s"
Sep 17 01:39:00.009267 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:39:00.009175    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79785894-9kx5s"]
Sep 17 01:39:00.012426 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:39:00.012397    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf81151c2_6453_473a_98be_23c88ae560f9.slice/crio-fdf47884bdb78187d9a40da8b0bdad779919157256665ffbd03b0c51a4415271 WatchSource:0}: Error finding container fdf47884bdb78187d9a40da8b0bdad779919157256665ffbd03b0c51a4415271: Status 404 returned error can't find the container with id fdf47884bdb78187d9a40da8b0bdad779919157256665ffbd03b0c51a4415271
Sep 17 01:39:00.578026 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:39:00.577996    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23eb4c89-97d5-44b9-9775-02f25ce8ed5c-metrics-tls\") pod \"dns-default-cjxjr\" (UID: \"23eb4c89-97d5-44b9-9775-02f25ce8ed5c\") " pod="openshift-dns/dns-default-cjxjr"
Sep 17 01:39:00.578394 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:39:00.578150    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 01:39:00.578394 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:39:00.578224    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23eb4c89-97d5-44b9-9775-02f25ce8ed5c-metrics-tls podName:23eb4c89-97d5-44b9-9775-02f25ce8ed5c nodeName:}" failed. No retries permitted until 2026-09-17 01:40:04.578207407 +0000 UTC m=+162.828184703 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/23eb4c89-97d5-44b9-9775-02f25ce8ed5c-metrics-tls") pod "dns-default-cjxjr" (UID: "23eb4c89-97d5-44b9-9775-02f25ce8ed5c") : secret "dns-default-metrics-tls" not found
Sep 17 01:39:00.808283 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:39:00.808234    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79785894-9kx5s" event={"ID":"f81151c2-6453-473a-98be-23c88ae560f9","Type":"ContainerStarted","Data":"fdf47884bdb78187d9a40da8b0bdad779919157256665ffbd03b0c51a4415271"}
Sep 17 01:39:04.748498 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:39:04.748466    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-t5bgg"
Sep 17 01:39:06.826555 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:39:06.826524    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79785894-9kx5s" event={"ID":"f81151c2-6453-473a-98be-23c88ae560f9","Type":"ContainerStarted","Data":"533b854f963bacdfb0b1b2577574b4d9325c9cdd0974e1fc0fb7cf6ab690ff9f"}
Sep 17 01:39:06.826918 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:39:06.826565    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79785894-9kx5s" event={"ID":"f81151c2-6453-473a-98be-23c88ae560f9","Type":"ContainerStarted","Data":"8d9146b63e28e3ca5d0dbe4528d159f89f543456da98a90cb81f68732fdbf564"}
Sep 17 01:39:06.826918 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:39:06.826579    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79785894-9kx5s" event={"ID":"f81151c2-6453-473a-98be-23c88ae560f9","Type":"ContainerStarted","Data":"b443121695b1165a5937079641752841edc95176e2effda7c548b8a6e2835844"}
Sep 17 01:39:06.842487 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:39:06.842404    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79785894-9kx5s" podStartSLOduration=1.5168324800000001 podStartE2EDuration="7.842388387s" totalImagesPullingTime="6.325555907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:38:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:39:06.841204466 +0000 UTC m=+105.091181779" watchObservedRunningTime="2026-09-17 01:39:06.842388387 +0000 UTC m=+105.092365700"
Sep 17 01:39:31.998342 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:39:31.998305    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/091f4d92-aca2-45ac-9c63-6b73cf983b35-metrics-certs\") pod \"network-metrics-daemon-p8bbk\" (UID: \"091f4d92-aca2-45ac-9c63-6b73cf983b35\") " pod="openshift-multus/network-metrics-daemon-p8bbk"
Sep 17 01:39:31.998819 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:39:31.998437    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 17 01:39:31.998819 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:39:31.998486    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/091f4d92-aca2-45ac-9c63-6b73cf983b35-metrics-certs podName:091f4d92-aca2-45ac-9c63-6b73cf983b35 nodeName:}" failed. No retries permitted until 2026-09-17 01:41:33.998473655 +0000 UTC m=+252.248450946 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/091f4d92-aca2-45ac-9c63-6b73cf983b35-metrics-certs") pod "network-metrics-daemon-p8bbk" (UID: "091f4d92-aca2-45ac-9c63-6b73cf983b35") : secret "metrics-daemon-secret" not found
Sep 17 01:39:59.684993 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:39:59.684931    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-cjxjr" podUID="23eb4c89-97d5-44b9-9775-02f25ce8ed5c"
Sep 17 01:39:59.973621 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:39:59.973544    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cjxjr"
Sep 17 01:40:00.369044 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:40:00.369010    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-p8bbk" podUID="091f4d92-aca2-45ac-9c63-6b73cf983b35"
Sep 17 01:40:04.617409 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:40:04.617359    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23eb4c89-97d5-44b9-9775-02f25ce8ed5c-metrics-tls\") pod \"dns-default-cjxjr\" (UID: \"23eb4c89-97d5-44b9-9775-02f25ce8ed5c\") " pod="openshift-dns/dns-default-cjxjr"
Sep 17 01:40:04.617836 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:40:04.617483    2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 01:40:04.617836 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:40:04.617534    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23eb4c89-97d5-44b9-9775-02f25ce8ed5c-metrics-tls podName:23eb4c89-97d5-44b9-9775-02f25ce8ed5c nodeName:}" failed. No retries permitted until 2026-09-17 01:42:06.617520866 +0000 UTC m=+284.867498157 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/23eb4c89-97d5-44b9-9775-02f25ce8ed5c-metrics-tls") pod "dns-default-cjxjr" (UID: "23eb4c89-97d5-44b9-9775-02f25ce8ed5c") : secret "dns-default-metrics-tls" not found
Sep 17 01:40:11.351223 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:40:11.351188    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8bbk"
Sep 17 01:41:26.323758 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:26.323719    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-dvfht"]
Sep 17 01:41:26.326669 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:26.326647    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-dvfht"
Sep 17 01:41:26.328531 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:26.328505    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 17 01:41:26.329016 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:26.328998    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 17 01:41:26.329149 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:26.329087    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-gsvt2\""
Sep 17 01:41:26.336616 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:26.336596    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-dvfht"]
Sep 17 01:41:26.455374 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:26.455330    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2pb4\" (UniqueName: \"kubernetes.io/projected/e78acd85-6286-43cc-8079-3779ce03633f-kube-api-access-l2pb4\") pod \"migrator-8b4d697c5-dvfht\" (UID: \"e78acd85-6286-43cc-8079-3779ce03633f\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-dvfht"
Sep 17 01:41:26.556638 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:26.556605    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2pb4\" (UniqueName: \"kubernetes.io/projected/e78acd85-6286-43cc-8079-3779ce03633f-kube-api-access-l2pb4\") pod \"migrator-8b4d697c5-dvfht\" (UID: \"e78acd85-6286-43cc-8079-3779ce03633f\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-dvfht"
Sep 17 01:41:26.563863 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:26.563833    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2pb4\" (UniqueName: \"kubernetes.io/projected/e78acd85-6286-43cc-8079-3779ce03633f-kube-api-access-l2pb4\") pod \"migrator-8b4d697c5-dvfht\" (UID: \"e78acd85-6286-43cc-8079-3779ce03633f\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-dvfht"
Sep 17 01:41:26.635239 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:26.635157    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-dvfht"
Sep 17 01:41:26.899562 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:26.899480    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-dvfht"]
Sep 17 01:41:26.903034 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:41:26.903005    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode78acd85_6286_43cc_8079_3779ce03633f.slice/crio-88b1ee69c9b2fcc6fb898185f4987c78341b87b6589cab15251e55e1fb96af24 WatchSource:0}: Error finding container 88b1ee69c9b2fcc6fb898185f4987c78341b87b6589cab15251e55e1fb96af24: Status 404 returned error can't find the container with id 88b1ee69c9b2fcc6fb898185f4987c78341b87b6589cab15251e55e1fb96af24
Sep 17 01:41:27.213659 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:27.213577    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-dvfht" event={"ID":"e78acd85-6286-43cc-8079-3779ce03633f","Type":"ContainerStarted","Data":"88b1ee69c9b2fcc6fb898185f4987c78341b87b6589cab15251e55e1fb96af24"}
Sep 17 01:41:27.594487 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:27.594449    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-c64g7"]
Sep 17 01:41:27.597778 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:27.597754    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-c64g7"
Sep 17 01:41:27.599463 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:27.599425    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 17 01:41:27.599611 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:27.599524    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 17 01:41:27.599869 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:27.599840    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 17 01:41:27.599997 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:27.599891    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 17 01:41:27.599997 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:27.599925    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-l4q7v\""
Sep 17 01:41:27.605168 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:27.605144    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-c64g7"]
Sep 17 01:41:27.663909 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:27.663879    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ed45f248-7d90-4484-a2ee-aae4cb046145-crio-socket\") pod \"insights-runtime-extractor-c64g7\" (UID: \"ed45f248-7d90-4484-a2ee-aae4cb046145\") " pod="openshift-insights/insights-runtime-extractor-c64g7"
Sep 17 01:41:27.664070 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:27.663922    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed45f248-7d90-4484-a2ee-aae4cb046145-data-volume\") pod \"insights-runtime-extractor-c64g7\" (UID: \"ed45f248-7d90-4484-a2ee-aae4cb046145\") " pod="openshift-insights/insights-runtime-extractor-c64g7"
Sep 17 01:41:27.664070 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:27.663949    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ed45f248-7d90-4484-a2ee-aae4cb046145-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c64g7\" (UID: \"ed45f248-7d90-4484-a2ee-aae4cb046145\") " pod="openshift-insights/insights-runtime-extractor-c64g7"
Sep 17 01:41:27.664070 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:27.663969    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ed45f248-7d90-4484-a2ee-aae4cb046145-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c64g7\" (UID: \"ed45f248-7d90-4484-a2ee-aae4cb046145\") " pod="openshift-insights/insights-runtime-extractor-c64g7"
Sep 17 01:41:27.664173 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:27.664084    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9ssp\" (UniqueName: \"kubernetes.io/projected/ed45f248-7d90-4484-a2ee-aae4cb046145-kube-api-access-l9ssp\") pod \"insights-runtime-extractor-c64g7\" (UID: \"ed45f248-7d90-4484-a2ee-aae4cb046145\") " pod="openshift-insights/insights-runtime-extractor-c64g7"
Sep 17 01:41:27.764656 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:27.764609    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ed45f248-7d90-4484-a2ee-aae4cb046145-crio-socket\") pod \"insights-runtime-extractor-c64g7\" (UID: \"ed45f248-7d90-4484-a2ee-aae4cb046145\") " pod="openshift-insights/insights-runtime-extractor-c64g7"
Sep 17 01:41:27.764835 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:27.764670    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed45f248-7d90-4484-a2ee-aae4cb046145-data-volume\") pod \"insights-runtime-extractor-c64g7\" (UID: \"ed45f248-7d90-4484-a2ee-aae4cb046145\") " pod="openshift-insights/insights-runtime-extractor-c64g7"
Sep 17 01:41:27.764835 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:27.764699    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ed45f248-7d90-4484-a2ee-aae4cb046145-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c64g7\" (UID: \"ed45f248-7d90-4484-a2ee-aae4cb046145\") " pod="openshift-insights/insights-runtime-extractor-c64g7"
Sep 17 01:41:27.764835 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:27.764710    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ed45f248-7d90-4484-a2ee-aae4cb046145-crio-socket\") pod \"insights-runtime-extractor-c64g7\" (UID: \"ed45f248-7d90-4484-a2ee-aae4cb046145\") " pod="openshift-insights/insights-runtime-extractor-c64g7"
Sep 17 01:41:27.764835 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:27.764722    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ed45f248-7d90-4484-a2ee-aae4cb046145-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c64g7\" (UID: \"ed45f248-7d90-4484-a2ee-aae4cb046145\") " pod="openshift-insights/insights-runtime-extractor-c64g7"
Sep 17 01:41:27.764835 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:41:27.764797    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 01:41:27.765018 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:41:27.764873    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ed45f248-7d90-4484-a2ee-aae4cb046145-kube-rbac-proxy-cm podName:ed45f248-7d90-4484-a2ee-aae4cb046145 nodeName:}" failed. No retries permitted until 2026-09-17 01:41:28.264852409 +0000 UTC m=+246.514829705 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ed45f248-7d90-4484-a2ee-aae4cb046145-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c64g7" (UID: "ed45f248-7d90-4484-a2ee-aae4cb046145") : configmap "kube-rbac-proxy" not found
Sep 17 01:41:27.765018 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:27.764800    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9ssp\" (UniqueName: \"kubernetes.io/projected/ed45f248-7d90-4484-a2ee-aae4cb046145-kube-api-access-l9ssp\") pod \"insights-runtime-extractor-c64g7\" (UID: \"ed45f248-7d90-4484-a2ee-aae4cb046145\") " pod="openshift-insights/insights-runtime-extractor-c64g7"
Sep 17 01:41:27.765102 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:27.765036    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed45f248-7d90-4484-a2ee-aae4cb046145-data-volume\") pod \"insights-runtime-extractor-c64g7\" (UID: \"ed45f248-7d90-4484-a2ee-aae4cb046145\") " pod="openshift-insights/insights-runtime-extractor-c64g7"
Sep 17 01:41:27.765102 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:41:27.765074    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 01:41:27.765197 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:41:27.765116    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed45f248-7d90-4484-a2ee-aae4cb046145-insights-runtime-extractor-tls podName:ed45f248-7d90-4484-a2ee-aae4cb046145 nodeName:}" failed. No retries permitted until 2026-09-17 01:41:28.265102564 +0000 UTC m=+246.515079878 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ed45f248-7d90-4484-a2ee-aae4cb046145-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c64g7" (UID: "ed45f248-7d90-4484-a2ee-aae4cb046145") : secret "insights-runtime-extractor-tls" not found
Sep 17 01:41:27.772427 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:27.772400    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9ssp\" (UniqueName: \"kubernetes.io/projected/ed45f248-7d90-4484-a2ee-aae4cb046145-kube-api-access-l9ssp\") pod \"insights-runtime-extractor-c64g7\" (UID: \"ed45f248-7d90-4484-a2ee-aae4cb046145\") " pod="openshift-insights/insights-runtime-extractor-c64g7"
Sep 17 01:41:28.217768 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:28.217660    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-dvfht" event={"ID":"e78acd85-6286-43cc-8079-3779ce03633f","Type":"ContainerStarted","Data":"0045cb4194a6d5a7b0df249cd9b2146a754fcbb6c404a11ddafe8dc31c803744"}
Sep 17 01:41:28.217768 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:28.217711    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-dvfht" event={"ID":"e78acd85-6286-43cc-8079-3779ce03633f","Type":"ContainerStarted","Data":"6e61a97f1bc89adbf4410ca9a0aeff07baed192ac2882ed1b5f1bfa140e58a59"}
Sep 17 01:41:28.229808 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:28.229756    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-dvfht" podStartSLOduration=1.215505844 podStartE2EDuration="2.229739558s" totalImagesPullingTime="1.014233714s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:41:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:41:28.229097602 +0000 UTC m=+246.479075070" watchObservedRunningTime="2026-09-17 01:41:28.229739558 +0000 UTC m=+246.479716870"
Sep 17 01:41:28.268522 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:28.268492    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ed45f248-7d90-4484-a2ee-aae4cb046145-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c64g7\" (UID: \"ed45f248-7d90-4484-a2ee-aae4cb046145\") " pod="openshift-insights/insights-runtime-extractor-c64g7"
Sep 17 01:41:28.268629 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:28.268529    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ed45f248-7d90-4484-a2ee-aae4cb046145-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c64g7\" (UID: \"ed45f248-7d90-4484-a2ee-aae4cb046145\") " pod="openshift-insights/insights-runtime-extractor-c64g7"
Sep 17 01:41:28.268686 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:41:28.268630    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 01:41:28.268734 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:41:28.268706    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ed45f248-7d90-4484-a2ee-aae4cb046145-kube-rbac-proxy-cm podName:ed45f248-7d90-4484-a2ee-aae4cb046145 nodeName:}" failed. No retries permitted until 2026-09-17 01:41:29.26868505 +0000 UTC m=+247.518662360 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ed45f248-7d90-4484-a2ee-aae4cb046145-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c64g7" (UID: "ed45f248-7d90-4484-a2ee-aae4cb046145") : configmap "kube-rbac-proxy" not found
Sep 17 01:41:28.268734 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:41:28.268641    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 01:41:28.268834 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:41:28.268762    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed45f248-7d90-4484-a2ee-aae4cb046145-insights-runtime-extractor-tls podName:ed45f248-7d90-4484-a2ee-aae4cb046145 nodeName:}" failed. No retries permitted until 2026-09-17 01:41:29.268750924 +0000 UTC m=+247.518728217 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ed45f248-7d90-4484-a2ee-aae4cb046145-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c64g7" (UID: "ed45f248-7d90-4484-a2ee-aae4cb046145") : secret "insights-runtime-extractor-tls" not found
Sep 17 01:41:29.276661 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:29.276613    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ed45f248-7d90-4484-a2ee-aae4cb046145-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c64g7\" (UID: \"ed45f248-7d90-4484-a2ee-aae4cb046145\") " pod="openshift-insights/insights-runtime-extractor-c64g7"
Sep 17 01:41:29.276661 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:29.276658    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ed45f248-7d90-4484-a2ee-aae4cb046145-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c64g7\" (UID: \"ed45f248-7d90-4484-a2ee-aae4cb046145\") " pod="openshift-insights/insights-runtime-extractor-c64g7"
Sep 17 01:41:29.277068 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:41:29.276740    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 01:41:29.277068 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:41:29.276797    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 01:41:29.277068 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:41:29.276806    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ed45f248-7d90-4484-a2ee-aae4cb046145-kube-rbac-proxy-cm podName:ed45f248-7d90-4484-a2ee-aae4cb046145 nodeName:}" failed. No retries permitted until 2026-09-17 01:41:31.276787836 +0000 UTC m=+249.526765147 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ed45f248-7d90-4484-a2ee-aae4cb046145-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c64g7" (UID: "ed45f248-7d90-4484-a2ee-aae4cb046145") : configmap "kube-rbac-proxy" not found
Sep 17 01:41:29.277068 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:41:29.276834    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed45f248-7d90-4484-a2ee-aae4cb046145-insights-runtime-extractor-tls podName:ed45f248-7d90-4484-a2ee-aae4cb046145 nodeName:}" failed. No retries permitted until 2026-09-17 01:41:31.276822126 +0000 UTC m=+249.526799427 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ed45f248-7d90-4484-a2ee-aae4cb046145-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c64g7" (UID: "ed45f248-7d90-4484-a2ee-aae4cb046145") : secret "insights-runtime-extractor-tls" not found
Sep 17 01:41:30.557895 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:30.557863    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vjfz5_777686bc-ef43-4350-9276-ce9cde09811c/dns-node-resolver/0.log"
Sep 17 01:41:31.293564 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:31.293503    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ed45f248-7d90-4484-a2ee-aae4cb046145-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c64g7\" (UID: \"ed45f248-7d90-4484-a2ee-aae4cb046145\") " pod="openshift-insights/insights-runtime-extractor-c64g7"
Sep 17 01:41:31.293564 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:31.293557    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ed45f248-7d90-4484-a2ee-aae4cb046145-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c64g7\" (UID: \"ed45f248-7d90-4484-a2ee-aae4cb046145\") " pod="openshift-insights/insights-runtime-extractor-c64g7"
Sep 17 01:41:31.293782 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:41:31.293638    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 01:41:31.293782 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:41:31.293664    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 01:41:31.293782 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:41:31.293705    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed45f248-7d90-4484-a2ee-aae4cb046145-insights-runtime-extractor-tls podName:ed45f248-7d90-4484-a2ee-aae4cb046145 nodeName:}" failed. No retries permitted until 2026-09-17 01:41:35.293688417 +0000 UTC m=+253.543665714 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ed45f248-7d90-4484-a2ee-aae4cb046145-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c64g7" (UID: "ed45f248-7d90-4484-a2ee-aae4cb046145") : secret "insights-runtime-extractor-tls" not found
Sep 17 01:41:31.293782 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:41:31.293721    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ed45f248-7d90-4484-a2ee-aae4cb046145-kube-rbac-proxy-cm podName:ed45f248-7d90-4484-a2ee-aae4cb046145 nodeName:}" failed. No retries permitted until 2026-09-17 01:41:35.293712486 +0000 UTC m=+253.543689787 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ed45f248-7d90-4484-a2ee-aae4cb046145-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c64g7" (UID: "ed45f248-7d90-4484-a2ee-aae4cb046145") : configmap "kube-rbac-proxy" not found
Sep 17 01:41:31.559154 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:31.559127    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tgvzc_02474a41-dc47-48ca-a66b-8bd035e916bc/node-ca/0.log"
Sep 17 01:41:32.159005 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:32.158978    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4rxjm_1b98a580-e689-4636-8f7b-5962006de1a5/serve-healthcheck-canary/0.log"
Sep 17 01:41:32.559702 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:32.559674    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-dvfht_e78acd85-6286-43cc-8079-3779ce03633f/migrator/0.log"
Sep 17 01:41:32.758239 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:32.758214    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-dvfht_e78acd85-6286-43cc-8079-3779ce03633f/graceful-termination/0.log"
Sep 17 01:41:34.012890 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:34.012840    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/091f4d92-aca2-45ac-9c63-6b73cf983b35-metrics-certs\") pod \"network-metrics-daemon-p8bbk\" (UID: \"091f4d92-aca2-45ac-9c63-6b73cf983b35\") " pod="openshift-multus/network-metrics-daemon-p8bbk"
Sep 17 01:41:34.013296 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:41:34.012987    2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 17 01:41:34.013296 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:41:34.013046    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/091f4d92-aca2-45ac-9c63-6b73cf983b35-metrics-certs podName:091f4d92-aca2-45ac-9c63-6b73cf983b35 nodeName:}" failed. No retries permitted until 2026-09-17 01:43:36.013028864 +0000 UTC m=+374.263006169 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/091f4d92-aca2-45ac-9c63-6b73cf983b35-metrics-certs") pod "network-metrics-daemon-p8bbk" (UID: "091f4d92-aca2-45ac-9c63-6b73cf983b35") : secret "metrics-daemon-secret" not found
Sep 17 01:41:35.320354 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:35.320317    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ed45f248-7d90-4484-a2ee-aae4cb046145-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c64g7\" (UID: \"ed45f248-7d90-4484-a2ee-aae4cb046145\") " pod="openshift-insights/insights-runtime-extractor-c64g7"
Sep 17 01:41:35.320354 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:35.320353    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ed45f248-7d90-4484-a2ee-aae4cb046145-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c64g7\" (UID: \"ed45f248-7d90-4484-a2ee-aae4cb046145\") " pod="openshift-insights/insights-runtime-extractor-c64g7"
Sep 17 01:41:35.320806 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:41:35.320432    2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 01:41:35.320806 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:41:35.320479    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 01:41:35.320806 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:41:35.320496    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ed45f248-7d90-4484-a2ee-aae4cb046145-kube-rbac-proxy-cm podName:ed45f248-7d90-4484-a2ee-aae4cb046145 nodeName:}" failed. No retries permitted until 2026-09-17 01:41:43.320481116 +0000 UTC m=+261.570458406 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ed45f248-7d90-4484-a2ee-aae4cb046145-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c64g7" (UID: "ed45f248-7d90-4484-a2ee-aae4cb046145") : configmap "kube-rbac-proxy" not found
Sep 17 01:41:35.320806 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:41:35.320526    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed45f248-7d90-4484-a2ee-aae4cb046145-insights-runtime-extractor-tls podName:ed45f248-7d90-4484-a2ee-aae4cb046145 nodeName:}" failed. No retries permitted until 2026-09-17 01:41:43.320514591 +0000 UTC m=+261.570491882 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ed45f248-7d90-4484-a2ee-aae4cb046145-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c64g7" (UID: "ed45f248-7d90-4484-a2ee-aae4cb046145") : secret "insights-runtime-extractor-tls" not found
Sep 17 01:41:39.741538 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:39.741494    2560 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79785894-9kx5s" podUID="f81151c2-6453-473a-98be-23c88ae560f9" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 17 01:41:43.379232 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:43.379194    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ed45f248-7d90-4484-a2ee-aae4cb046145-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c64g7\" (UID: \"ed45f248-7d90-4484-a2ee-aae4cb046145\") " pod="openshift-insights/insights-runtime-extractor-c64g7"
Sep 17 01:41:43.379232 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:43.379236    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ed45f248-7d90-4484-a2ee-aae4cb046145-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c64g7\" (UID: \"ed45f248-7d90-4484-a2ee-aae4cb046145\") " pod="openshift-insights/insights-runtime-extractor-c64g7"
Sep 17 01:41:43.379648 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:41:43.379390    2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 01:41:43.379648 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:41:43.379456    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed45f248-7d90-4484-a2ee-aae4cb046145-insights-runtime-extractor-tls podName:ed45f248-7d90-4484-a2ee-aae4cb046145 nodeName:}" failed. No retries permitted until 2026-09-17 01:41:59.379438572 +0000 UTC m=+277.629415878 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ed45f248-7d90-4484-a2ee-aae4cb046145-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c64g7" (UID: "ed45f248-7d90-4484-a2ee-aae4cb046145") : secret "insights-runtime-extractor-tls" not found
Sep 17 01:41:43.379841 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:43.379816    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ed45f248-7d90-4484-a2ee-aae4cb046145-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c64g7\" (UID: \"ed45f248-7d90-4484-a2ee-aae4cb046145\") " pod="openshift-insights/insights-runtime-extractor-c64g7"
Sep 17 01:41:49.740557 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:49.740475    2560 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79785894-9kx5s" podUID="f81151c2-6453-473a-98be-23c88ae560f9" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 17 01:41:51.022528 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:51.022491    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-556656868b-6qdkj"]
Sep 17 01:41:51.025395 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:51.025375    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-556656868b-6qdkj"
Sep 17 01:41:51.027496 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:51.027473    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 17 01:41:51.027593 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:51.027473    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7d5d6\""
Sep 17 01:41:51.027593 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:51.027473    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 17 01:41:51.027874 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:51.027860    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 17 01:41:51.036152 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:51.036133    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 17 01:41:51.039624 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:51.039602    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-556656868b-6qdkj"]
Sep 17 01:41:51.130733 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:51.130696    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4bef8068-4aab-450b-a13b-87a1c7f6b323-image-registry-private-configuration\") pod \"image-registry-556656868b-6qdkj\" (UID: \"4bef8068-4aab-450b-a13b-87a1c7f6b323\") " pod="openshift-image-registry/image-registry-556656868b-6qdkj"
Sep 17 01:41:51.130733 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:51.130733    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4bef8068-4aab-450b-a13b-87a1c7f6b323-registry-certificates\") pod \"image-registry-556656868b-6qdkj\" (UID: \"4bef8068-4aab-450b-a13b-87a1c7f6b323\") " pod="openshift-image-registry/image-registry-556656868b-6qdkj"
Sep 17 01:41:51.130952 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:51.130765    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4bef8068-4aab-450b-a13b-87a1c7f6b323-installation-pull-secrets\") pod \"image-registry-556656868b-6qdkj\" (UID: \"4bef8068-4aab-450b-a13b-87a1c7f6b323\") " pod="openshift-image-registry/image-registry-556656868b-6qdkj"
Sep 17 01:41:51.130952 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:51.130785    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ck6h2\" (UniqueName: \"kubernetes.io/projected/4bef8068-4aab-450b-a13b-87a1c7f6b323-kube-api-access-ck6h2\") pod \"image-registry-556656868b-6qdkj\" (UID: \"4bef8068-4aab-450b-a13b-87a1c7f6b323\") " pod="openshift-image-registry/image-registry-556656868b-6qdkj"
Sep 17 01:41:51.130952 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:51.130855    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4bef8068-4aab-450b-a13b-87a1c7f6b323-registry-tls\") pod \"image-registry-556656868b-6qdkj\" (UID: \"4bef8068-4aab-450b-a13b-87a1c7f6b323\") " pod="openshift-image-registry/image-registry-556656868b-6qdkj"
Sep 17 01:41:51.130952 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:51.130912    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4bef8068-4aab-450b-a13b-87a1c7f6b323-ca-trust-extracted\") pod \"image-registry-556656868b-6qdkj\" (UID: \"4bef8068-4aab-450b-a13b-87a1c7f6b323\") " pod="openshift-image-registry/image-registry-556656868b-6qdkj"
Sep 17 01:41:51.130952 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:51.130929    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4bef8068-4aab-450b-a13b-87a1c7f6b323-trusted-ca\") pod \"image-registry-556656868b-6qdkj\" (UID: \"4bef8068-4aab-450b-a13b-87a1c7f6b323\") " pod="openshift-image-registry/image-registry-556656868b-6qdkj"
Sep 17 01:41:51.131102 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:51.130952    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4bef8068-4aab-450b-a13b-87a1c7f6b323-bound-sa-token\") pod \"image-registry-556656868b-6qdkj\" (UID: \"4bef8068-4aab-450b-a13b-87a1c7f6b323\") " pod="openshift-image-registry/image-registry-556656868b-6qdkj"
Sep 17 01:41:51.231879 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:51.231837    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4bef8068-4aab-450b-a13b-87a1c7f6b323-ca-trust-extracted\") pod \"image-registry-556656868b-6qdkj\" (UID: \"4bef8068-4aab-450b-a13b-87a1c7f6b323\") " pod="openshift-image-registry/image-registry-556656868b-6qdkj"
Sep 17 01:41:51.231879 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:51.231876    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4bef8068-4aab-450b-a13b-87a1c7f6b323-trusted-ca\") pod \"image-registry-556656868b-6qdkj\" (UID: \"4bef8068-4aab-450b-a13b-87a1c7f6b323\") " pod="openshift-image-registry/image-registry-556656868b-6qdkj"
Sep 17 01:41:51.232083 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:51.231892    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4bef8068-4aab-450b-a13b-87a1c7f6b323-bound-sa-token\") pod \"image-registry-556656868b-6qdkj\" (UID: \"4bef8068-4aab-450b-a13b-87a1c7f6b323\") " pod="openshift-image-registry/image-registry-556656868b-6qdkj"
Sep 17 01:41:51.232083 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:51.231927    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4bef8068-4aab-450b-a13b-87a1c7f6b323-image-registry-private-configuration\") pod \"image-registry-556656868b-6qdkj\" (UID: \"4bef8068-4aab-450b-a13b-87a1c7f6b323\") " pod="openshift-image-registry/image-registry-556656868b-6qdkj"
Sep 17 01:41:51.232083 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:51.231943    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4bef8068-4aab-450b-a13b-87a1c7f6b323-registry-certificates\") pod \"image-registry-556656868b-6qdkj\" (UID: \"4bef8068-4aab-450b-a13b-87a1c7f6b323\") " pod="openshift-image-registry/image-registry-556656868b-6qdkj"
Sep 17 01:41:51.232083 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:51.231971    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4bef8068-4aab-450b-a13b-87a1c7f6b323-installation-pull-secrets\") pod \"image-registry-556656868b-6qdkj\" (UID: \"4bef8068-4aab-450b-a13b-87a1c7f6b323\") " pod="openshift-image-registry/image-registry-556656868b-6qdkj"
Sep 17 01:41:51.232083 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:51.231986    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck6h2\" (UniqueName: \"kubernetes.io/projected/4bef8068-4aab-450b-a13b-87a1c7f6b323-kube-api-access-ck6h2\") pod \"image-registry-556656868b-6qdkj\" (UID: \"4bef8068-4aab-450b-a13b-87a1c7f6b323\") " pod="openshift-image-registry/image-registry-556656868b-6qdkj"
Sep 17 01:41:51.232083 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:51.232020    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4bef8068-4aab-450b-a13b-87a1c7f6b323-registry-tls\") pod \"image-registry-556656868b-6qdkj\" (UID: \"4bef8068-4aab-450b-a13b-87a1c7f6b323\") " pod="openshift-image-registry/image-registry-556656868b-6qdkj"
Sep 17 01:41:51.232451 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:51.232322    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4bef8068-4aab-450b-a13b-87a1c7f6b323-ca-trust-extracted\") pod \"image-registry-556656868b-6qdkj\" (UID: \"4bef8068-4aab-450b-a13b-87a1c7f6b323\") " pod="openshift-image-registry/image-registry-556656868b-6qdkj"
Sep 17 01:41:51.232881 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:51.232858    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4bef8068-4aab-450b-a13b-87a1c7f6b323-registry-certificates\") pod \"image-registry-556656868b-6qdkj\" (UID: \"4bef8068-4aab-450b-a13b-87a1c7f6b323\") " pod="openshift-image-registry/image-registry-556656868b-6qdkj"
Sep 17 01:41:51.233177 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:51.233151    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4bef8068-4aab-450b-a13b-87a1c7f6b323-trusted-ca\") pod \"image-registry-556656868b-6qdkj\" (UID: \"4bef8068-4aab-450b-a13b-87a1c7f6b323\") " pod="openshift-image-registry/image-registry-556656868b-6qdkj"
Sep 17 01:41:51.234446 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:51.234422    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4bef8068-4aab-450b-a13b-87a1c7f6b323-installation-pull-secrets\") pod \"image-registry-556656868b-6qdkj\" (UID: \"4bef8068-4aab-450b-a13b-87a1c7f6b323\") " pod="openshift-image-registry/image-registry-556656868b-6qdkj"
Sep 17 01:41:51.234547 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:51.234504    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4bef8068-4aab-450b-a13b-87a1c7f6b323-registry-tls\") pod \"image-registry-556656868b-6qdkj\" (UID: \"4bef8068-4aab-450b-a13b-87a1c7f6b323\") " pod="openshift-image-registry/image-registry-556656868b-6qdkj"
Sep 17 01:41:51.234547 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:51.234526    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4bef8068-4aab-450b-a13b-87a1c7f6b323-image-registry-private-configuration\") pod \"image-registry-556656868b-6qdkj\" (UID: \"4bef8068-4aab-450b-a13b-87a1c7f6b323\") " pod="openshift-image-registry/image-registry-556656868b-6qdkj"
Sep 17 01:41:51.241126 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:51.241106    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4bef8068-4aab-450b-a13b-87a1c7f6b323-bound-sa-token\") pod \"image-registry-556656868b-6qdkj\" (UID: \"4bef8068-4aab-450b-a13b-87a1c7f6b323\") " pod="openshift-image-registry/image-registry-556656868b-6qdkj"
Sep 17 01:41:51.241285 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:51.241265    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ck6h2\" (UniqueName: \"kubernetes.io/projected/4bef8068-4aab-450b-a13b-87a1c7f6b323-kube-api-access-ck6h2\") pod \"image-registry-556656868b-6qdkj\" (UID: \"4bef8068-4aab-450b-a13b-87a1c7f6b323\") " pod="openshift-image-registry/image-registry-556656868b-6qdkj"
Sep 17 01:41:51.338511 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:51.338473    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-556656868b-6qdkj"
Sep 17 01:41:51.608676 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:51.608599    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-556656868b-6qdkj"]
Sep 17 01:41:51.611745 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:41:51.611717    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bef8068_4aab_450b_a13b_87a1c7f6b323.slice/crio-4617cd515e3490899c35acb19f1ddb50afc2719da86266819036c19506457069 WatchSource:0}: Error finding container 4617cd515e3490899c35acb19f1ddb50afc2719da86266819036c19506457069: Status 404 returned error can't find the container with id 4617cd515e3490899c35acb19f1ddb50afc2719da86266819036c19506457069
Sep 17 01:41:52.285087 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:52.285055    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-556656868b-6qdkj" event={"ID":"4bef8068-4aab-450b-a13b-87a1c7f6b323","Type":"ContainerStarted","Data":"e8861f367d45bff3f288b180c3c14bd0f046a89e0ea3a093adeee8ee49083db9"}
Sep 17 01:41:52.285519 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:52.285102    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-556656868b-6qdkj" event={"ID":"4bef8068-4aab-450b-a13b-87a1c7f6b323","Type":"ContainerStarted","Data":"4617cd515e3490899c35acb19f1ddb50afc2719da86266819036c19506457069"}
Sep 17 01:41:52.285519 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:52.285172    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-556656868b-6qdkj"
Sep 17 01:41:52.302022 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:52.301975    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-556656868b-6qdkj" podStartSLOduration=1.301960657 podStartE2EDuration="1.301960657s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:41:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:41:52.300506959 +0000 UTC m=+270.550484271" watchObservedRunningTime="2026-09-17 01:41:52.301960657 +0000 UTC m=+270.551937967"
Sep 17 01:41:59.394598 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:59.394542    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ed45f248-7d90-4484-a2ee-aae4cb046145-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c64g7\" (UID: \"ed45f248-7d90-4484-a2ee-aae4cb046145\") " pod="openshift-insights/insights-runtime-extractor-c64g7"
Sep 17 01:41:59.396872 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:59.396850    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ed45f248-7d90-4484-a2ee-aae4cb046145-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c64g7\" (UID: \"ed45f248-7d90-4484-a2ee-aae4cb046145\") " pod="openshift-insights/insights-runtime-extractor-c64g7"
Sep 17 01:41:59.409859 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:59.409829    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-c64g7"
Sep 17 01:41:59.680681 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:59.680605    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-c64g7"]
Sep 17 01:41:59.684414 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:41:59.684369    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded45f248_7d90_4484_a2ee_aae4cb046145.slice/crio-375c2987b9b55ffc8dd6cdff0ca3d7b3d4c1aaec2aec7bf005d9440ea2dda0a4 WatchSource:0}: Error finding container 375c2987b9b55ffc8dd6cdff0ca3d7b3d4c1aaec2aec7bf005d9440ea2dda0a4: Status 404 returned error can't find the container with id 375c2987b9b55ffc8dd6cdff0ca3d7b3d4c1aaec2aec7bf005d9440ea2dda0a4
Sep 17 01:41:59.740841 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:59.740809    2560 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79785894-9kx5s" podUID="f81151c2-6453-473a-98be-23c88ae560f9" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 17 01:41:59.740967 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:59.740870    2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79785894-9kx5s"
Sep 17 01:41:59.741391 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:59.741350    2560 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"533b854f963bacdfb0b1b2577574b4d9325c9cdd0974e1fc0fb7cf6ab690ff9f"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79785894-9kx5s" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Sep 17 01:41:59.741450 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:41:59.741411    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79785894-9kx5s" podUID="f81151c2-6453-473a-98be-23c88ae560f9" containerName="service-proxy" containerID="cri-o://533b854f963bacdfb0b1b2577574b4d9325c9cdd0974e1fc0fb7cf6ab690ff9f" gracePeriod=30
Sep 17 01:42:00.313199 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:00.313159    2560 generic.go:356] "Generic (PLEG): container finished" podID="f81151c2-6453-473a-98be-23c88ae560f9" containerID="533b854f963bacdfb0b1b2577574b4d9325c9cdd0974e1fc0fb7cf6ab690ff9f" exitCode=2
Sep 17 01:42:00.313405 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:00.313236    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79785894-9kx5s" event={"ID":"f81151c2-6453-473a-98be-23c88ae560f9","Type":"ContainerDied","Data":"533b854f963bacdfb0b1b2577574b4d9325c9cdd0974e1fc0fb7cf6ab690ff9f"}
Sep 17 01:42:00.313405 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:00.313311    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b79785894-9kx5s" event={"ID":"f81151c2-6453-473a-98be-23c88ae560f9","Type":"ContainerStarted","Data":"54380d95e36c3119fc8671b19475d4cb3ff7c47cc43dbc6c2fd9f2db3c173b8b"}
Sep 17 01:42:00.314988 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:00.314962    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c64g7" event={"ID":"ed45f248-7d90-4484-a2ee-aae4cb046145","Type":"ContainerStarted","Data":"8fc96f3b31dd1e114ebe58d7344aeb35939594e5548e4b7aca15ed6dcde2aecf"}
Sep 17 01:42:00.315115 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:00.315020    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c64g7" event={"ID":"ed45f248-7d90-4484-a2ee-aae4cb046145","Type":"ContainerStarted","Data":"375c2987b9b55ffc8dd6cdff0ca3d7b3d4c1aaec2aec7bf005d9440ea2dda0a4"}
Sep 17 01:42:01.320116 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:01.320080    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c64g7" event={"ID":"ed45f248-7d90-4484-a2ee-aae4cb046145","Type":"ContainerStarted","Data":"83b6587ebc3d1c0d0e4d7443dc367b8906d098a337a8edd1accebc033348a7a0"}
Sep 17 01:42:02.325220 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:02.325188    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c64g7" event={"ID":"ed45f248-7d90-4484-a2ee-aae4cb046145","Type":"ContainerStarted","Data":"da816c9d7df6dfc194cd584379ee803b2e95ffd51243447ebcbcb4bd97be78c7"}
Sep 17 01:42:02.341722 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:02.341672    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-c64g7" podStartSLOduration=33.284123532 podStartE2EDuration="35.34165574s" totalImagesPullingTime="2.057532208s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 01:41:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:42:02.340075749 +0000 UTC m=+280.590053063" watchObservedRunningTime="2026-09-17 01:42:02.34165574 +0000 UTC m=+280.591633052"
Sep 17 01:42:02.974149 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:42:02.974079    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-cjxjr" podUID="23eb4c89-97d5-44b9-9775-02f25ce8ed5c"
Sep 17 01:42:03.328384 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:03.328349    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cjxjr"
Sep 17 01:42:05.781445 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:05.781411    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9lncg"]
Sep 17 01:42:05.785384 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:05.785363    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9lncg"
Sep 17 01:42:05.787218 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:05.787195    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 17 01:42:05.787376 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:05.787221    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 17 01:42:05.787376 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:05.787323    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 17 01:42:05.787630 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:05.787600    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9bxmv\""
Sep 17 01:42:05.787719 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:05.787634    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 17 01:42:05.787719 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:05.787657    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 17 01:42:05.787719 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:05.787677    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 17 01:42:05.836111 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:05.836074    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b5bd5e52-63dc-468a-abdc-4d08afa3489e-node-exporter-textfile\") pod \"node-exporter-9lncg\" (UID: \"b5bd5e52-63dc-468a-abdc-4d08afa3489e\") " pod="openshift-monitoring/node-exporter-9lncg"
Sep 17 01:42:05.836111 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:05.836108    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b5bd5e52-63dc-468a-abdc-4d08afa3489e-node-exporter-wtmp\") pod \"node-exporter-9lncg\" (UID: \"b5bd5e52-63dc-468a-abdc-4d08afa3489e\") " pod="openshift-monitoring/node-exporter-9lncg"
Sep 17 01:42:05.836360 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:05.836129    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b5bd5e52-63dc-468a-abdc-4d08afa3489e-node-exporter-tls\") pod \"node-exporter-9lncg\" (UID: \"b5bd5e52-63dc-468a-abdc-4d08afa3489e\") " pod="openshift-monitoring/node-exporter-9lncg"
Sep 17 01:42:05.836360 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:05.836205    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b5bd5e52-63dc-468a-abdc-4d08afa3489e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9lncg\" (UID: \"b5bd5e52-63dc-468a-abdc-4d08afa3489e\") " pod="openshift-monitoring/node-exporter-9lncg"
Sep 17 01:42:05.836360 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:05.836242    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b5bd5e52-63dc-468a-abdc-4d08afa3489e-root\") pod \"node-exporter-9lncg\" (UID: \"b5bd5e52-63dc-468a-abdc-4d08afa3489e\") " pod="openshift-monitoring/node-exporter-9lncg"
Sep 17 01:42:05.836360 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:05.836280    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5bd5e52-63dc-468a-abdc-4d08afa3489e-metrics-client-ca\") pod \"node-exporter-9lncg\" (UID: \"b5bd5e52-63dc-468a-abdc-4d08afa3489e\") " pod="openshift-monitoring/node-exporter-9lncg"
Sep 17 01:42:05.836360 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:05.836313    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b5bd5e52-63dc-468a-abdc-4d08afa3489e-sys\") pod \"node-exporter-9lncg\" (UID: \"b5bd5e52-63dc-468a-abdc-4d08afa3489e\") " pod="openshift-monitoring/node-exporter-9lncg"
Sep 17 01:42:05.836360 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:05.836336    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b5bd5e52-63dc-468a-abdc-4d08afa3489e-node-exporter-accelerators-collector-config\") pod \"node-exporter-9lncg\" (UID: \"b5bd5e52-63dc-468a-abdc-4d08afa3489e\") " pod="openshift-monitoring/node-exporter-9lncg"
Sep 17 01:42:05.836605 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:05.836387    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5rck\" (UniqueName: \"kubernetes.io/projected/b5bd5e52-63dc-468a-abdc-4d08afa3489e-kube-api-access-b5rck\") pod \"node-exporter-9lncg\" (UID: \"b5bd5e52-63dc-468a-abdc-4d08afa3489e\") " pod="openshift-monitoring/node-exporter-9lncg"
Sep 17 01:42:05.936990 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:05.936950    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b5bd5e52-63dc-468a-abdc-4d08afa3489e-node-exporter-tls\") pod \"node-exporter-9lncg\" (UID: \"b5bd5e52-63dc-468a-abdc-4d08afa3489e\") " pod="openshift-monitoring/node-exporter-9lncg"
Sep 17 01:42:05.936990 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:05.936992    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b5bd5e52-63dc-468a-abdc-4d08afa3489e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9lncg\" (UID: \"b5bd5e52-63dc-468a-abdc-4d08afa3489e\") " pod="openshift-monitoring/node-exporter-9lncg"
Sep 17 01:42:05.937214 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:05.937010    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b5bd5e52-63dc-468a-abdc-4d08afa3489e-root\") pod \"node-exporter-9lncg\" (UID: \"b5bd5e52-63dc-468a-abdc-4d08afa3489e\") " pod="openshift-monitoring/node-exporter-9lncg"
Sep 17 01:42:05.937214 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:05.937029    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5bd5e52-63dc-468a-abdc-4d08afa3489e-metrics-client-ca\") pod \"node-exporter-9lncg\" (UID: \"b5bd5e52-63dc-468a-abdc-4d08afa3489e\") " pod="openshift-monitoring/node-exporter-9lncg"
Sep 17 01:42:05.937214 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:05.937069    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b5bd5e52-63dc-468a-abdc-4d08afa3489e-sys\") pod \"node-exporter-9lncg\" (UID: \"b5bd5e52-63dc-468a-abdc-4d08afa3489e\") " pod="openshift-monitoring/node-exporter-9lncg"
Sep 17 01:42:05.937214 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:05.937080    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b5bd5e52-63dc-468a-abdc-4d08afa3489e-root\") pod \"node-exporter-9lncg\" (UID: \"b5bd5e52-63dc-468a-abdc-4d08afa3489e\") " pod="openshift-monitoring/node-exporter-9lncg"
Sep 17 01:42:05.937214 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:05.937089    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b5bd5e52-63dc-468a-abdc-4d08afa3489e-node-exporter-accelerators-collector-config\") pod \"node-exporter-9lncg\" (UID: \"b5bd5e52-63dc-468a-abdc-4d08afa3489e\") " pod="openshift-monitoring/node-exporter-9lncg"
Sep 17 01:42:05.937214 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:42:05.937114    2560 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 17 01:42:05.937214 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:05.937167    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5rck\" (UniqueName: \"kubernetes.io/projected/b5bd5e52-63dc-468a-abdc-4d08afa3489e-kube-api-access-b5rck\") pod \"node-exporter-9lncg\" (UID: \"b5bd5e52-63dc-468a-abdc-4d08afa3489e\") " pod="openshift-monitoring/node-exporter-9lncg"
Sep 17 01:42:05.937214 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:05.937179    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b5bd5e52-63dc-468a-abdc-4d08afa3489e-sys\") pod \"node-exporter-9lncg\" (UID: \"b5bd5e52-63dc-468a-abdc-4d08afa3489e\") " pod="openshift-monitoring/node-exporter-9lncg"
Sep 17 01:42:05.937214 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:42:05.937184    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5bd5e52-63dc-468a-abdc-4d08afa3489e-node-exporter-tls podName:b5bd5e52-63dc-468a-abdc-4d08afa3489e nodeName:}" failed. No retries permitted until 2026-09-17 01:42:06.437165455 +0000 UTC m=+284.687142761 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/b5bd5e52-63dc-468a-abdc-4d08afa3489e-node-exporter-tls") pod "node-exporter-9lncg" (UID: "b5bd5e52-63dc-468a-abdc-4d08afa3489e") : secret "node-exporter-tls" not found
Sep 17 01:42:05.937624 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:05.937267    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b5bd5e52-63dc-468a-abdc-4d08afa3489e-node-exporter-textfile\") pod \"node-exporter-9lncg\" (UID: \"b5bd5e52-63dc-468a-abdc-4d08afa3489e\") " pod="openshift-monitoring/node-exporter-9lncg"
Sep 17 01:42:05.937624 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:05.937300    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b5bd5e52-63dc-468a-abdc-4d08afa3489e-node-exporter-wtmp\") pod \"node-exporter-9lncg\" (UID: \"b5bd5e52-63dc-468a-abdc-4d08afa3489e\") " pod="openshift-monitoring/node-exporter-9lncg"
Sep 17 01:42:05.937624 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:05.937449    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b5bd5e52-63dc-468a-abdc-4d08afa3489e-node-exporter-wtmp\") pod \"node-exporter-9lncg\" (UID: \"b5bd5e52-63dc-468a-abdc-4d08afa3489e\") " pod="openshift-monitoring/node-exporter-9lncg"
Sep 17 01:42:05.937624 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:05.937569    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b5bd5e52-63dc-468a-abdc-4d08afa3489e-node-exporter-textfile\") pod \"node-exporter-9lncg\" (UID: \"b5bd5e52-63dc-468a-abdc-4d08afa3489e\") " pod="openshift-monitoring/node-exporter-9lncg"
Sep 17 01:42:05.937762 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:05.937740    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5bd5e52-63dc-468a-abdc-4d08afa3489e-metrics-client-ca\") pod \"node-exporter-9lncg\" (UID: \"b5bd5e52-63dc-468a-abdc-4d08afa3489e\") " pod="openshift-monitoring/node-exporter-9lncg"
Sep 17 01:42:05.937799 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:05.937740    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b5bd5e52-63dc-468a-abdc-4d08afa3489e-node-exporter-accelerators-collector-config\") pod \"node-exporter-9lncg\" (UID: \"b5bd5e52-63dc-468a-abdc-4d08afa3489e\") " pod="openshift-monitoring/node-exporter-9lncg"
Sep 17 01:42:05.939360 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:05.939342    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b5bd5e52-63dc-468a-abdc-4d08afa3489e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9lncg\" (UID: \"b5bd5e52-63dc-468a-abdc-4d08afa3489e\") " pod="openshift-monitoring/node-exporter-9lncg"
Sep 17 01:42:05.946412 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:05.946392    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5rck\" (UniqueName: \"kubernetes.io/projected/b5bd5e52-63dc-468a-abdc-4d08afa3489e-kube-api-access-b5rck\") pod \"node-exporter-9lncg\" (UID: \"b5bd5e52-63dc-468a-abdc-4d08afa3489e\") " pod="openshift-monitoring/node-exporter-9lncg"
Sep 17 01:42:06.441721 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:06.441673    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b5bd5e52-63dc-468a-abdc-4d08afa3489e-node-exporter-tls\") pod \"node-exporter-9lncg\" (UID: \"b5bd5e52-63dc-468a-abdc-4d08afa3489e\") " pod="openshift-monitoring/node-exporter-9lncg"
Sep 17 01:42:06.443974 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:06.443956    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b5bd5e52-63dc-468a-abdc-4d08afa3489e-node-exporter-tls\") pod \"node-exporter-9lncg\" (UID: \"b5bd5e52-63dc-468a-abdc-4d08afa3489e\") " pod="openshift-monitoring/node-exporter-9lncg"
Sep 17 01:42:06.643768 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:06.643723    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23eb4c89-97d5-44b9-9775-02f25ce8ed5c-metrics-tls\") pod \"dns-default-cjxjr\" (UID: \"23eb4c89-97d5-44b9-9775-02f25ce8ed5c\") " pod="openshift-dns/dns-default-cjxjr"
Sep 17 01:42:06.646004 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:06.645985    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23eb4c89-97d5-44b9-9775-02f25ce8ed5c-metrics-tls\") pod \"dns-default-cjxjr\" (UID: \"23eb4c89-97d5-44b9-9775-02f25ce8ed5c\") " pod="openshift-dns/dns-default-cjxjr"
Sep 17 01:42:06.693511 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:06.693450    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9lncg"
Sep 17 01:42:06.704841 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:42:06.704816    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5bd5e52_63dc_468a_abdc_4d08afa3489e.slice/crio-5a7e6d8e4e92a79bbe1efd987d21f5abb63bee436ecf3f5fcd35a85808c43ec8 WatchSource:0}: Error finding container 5a7e6d8e4e92a79bbe1efd987d21f5abb63bee436ecf3f5fcd35a85808c43ec8: Status 404 returned error can't find the container with id 5a7e6d8e4e92a79bbe1efd987d21f5abb63bee436ecf3f5fcd35a85808c43ec8
Sep 17 01:42:06.930763 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:06.930733    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-crsck\""
Sep 17 01:42:06.940078 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:06.940054    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cjxjr"
Sep 17 01:42:07.209179 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:07.209090    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cjxjr"]
Sep 17 01:42:07.212449 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:42:07.212419    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23eb4c89_97d5_44b9_9775_02f25ce8ed5c.slice/crio-83c88163f014f1d1bd7f2bc4775bde03cf28bfe4cb5eb82506b14ee81972670c WatchSource:0}: Error finding container 83c88163f014f1d1bd7f2bc4775bde03cf28bfe4cb5eb82506b14ee81972670c: Status 404 returned error can't find the container with id 83c88163f014f1d1bd7f2bc4775bde03cf28bfe4cb5eb82506b14ee81972670c
Sep 17 01:42:07.342160 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:07.342120    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9lncg" event={"ID":"b5bd5e52-63dc-468a-abdc-4d08afa3489e","Type":"ContainerStarted","Data":"5a7e6d8e4e92a79bbe1efd987d21f5abb63bee436ecf3f5fcd35a85808c43ec8"}
Sep 17 01:42:07.343525 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:07.343491    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cjxjr" event={"ID":"23eb4c89-97d5-44b9-9775-02f25ce8ed5c","Type":"ContainerStarted","Data":"83c88163f014f1d1bd7f2bc4775bde03cf28bfe4cb5eb82506b14ee81972670c"}
Sep 17 01:42:08.348889 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:08.348848    2560 generic.go:356] "Generic (PLEG): container finished" podID="b5bd5e52-63dc-468a-abdc-4d08afa3489e" containerID="b102be0ecd29949d333b1058bff87d28336390f7cd93f25cf851abed19a663c5" exitCode=0
Sep 17 01:42:08.349337 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:08.348899    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9lncg" event={"ID":"b5bd5e52-63dc-468a-abdc-4d08afa3489e","Type":"ContainerDied","Data":"b102be0ecd29949d333b1058bff87d28336390f7cd93f25cf851abed19a663c5"}
Sep 17 01:42:09.354237 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:09.354201    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9lncg" event={"ID":"b5bd5e52-63dc-468a-abdc-4d08afa3489e","Type":"ContainerStarted","Data":"9549e3878dac94afb6399ebea596827067c111debfe45f4f379ffb0aae16b61c"}
Sep 17 01:42:09.354680 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:09.354322    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9lncg" event={"ID":"b5bd5e52-63dc-468a-abdc-4d08afa3489e","Type":"ContainerStarted","Data":"7085f8142cdaf890e55424d9bc8700c611df87e87511ffe80ef5c6053bcf691c"}
Sep 17 01:42:09.356030 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:09.356008    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cjxjr" event={"ID":"23eb4c89-97d5-44b9-9775-02f25ce8ed5c","Type":"ContainerStarted","Data":"b35296d9d21565ee0214191fd41ac3062a77e62329fe2d7a2ffa985c8793652f"}
Sep 17 01:42:09.356142 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:09.356045    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cjxjr" event={"ID":"23eb4c89-97d5-44b9-9775-02f25ce8ed5c","Type":"ContainerStarted","Data":"263a985cd2f596b2007f403f24811bfda8ed76bef9cd1bd936a22640c9cd36b2"}
Sep 17 01:42:09.356142 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:09.356083    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-cjxjr"
Sep 17 01:42:09.369278 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:09.369212    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9lncg" podStartSLOduration=3.378997183 podStartE2EDuration="4.369197608s" totalImagesPullingTime="921.561156ms" totalInitContainerRuntime="68.639269ms" isStatefulPod=true podCreationTimestamp="2026-09-17 01:42:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:42:09.368759996 +0000 UTC m=+287.618737308" watchObservedRunningTime="2026-09-17 01:42:09.369197608 +0000 UTC m=+287.619174923"
Sep 17 01:42:09.383881 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:09.383837    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-cjxjr" podStartSLOduration=251.854118248 podStartE2EDuration="4m13.383825214s" totalImagesPullingTime="1.529706966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:37:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:42:09.3825509 +0000 UTC m=+287.632528213" watchObservedRunningTime="2026-09-17 01:42:09.383825214 +0000 UTC m=+287.633802524"
Sep 17 01:42:10.534091 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:10.534057    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-d5ffb"]
Sep 17 01:42:10.537036 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:10.537020    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-d5ffb"
Sep 17 01:42:10.538822 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:10.538803    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 17 01:42:10.538895 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:10.538820    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-jg245\""
Sep 17 01:42:10.545874 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:10.545852    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-d5ffb"]
Sep 17 01:42:10.573410 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:10.573372    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a0f66d44-d240-4e20-ad17-e6ae05f0780d-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-d5ffb\" (UID: \"a0f66d44-d240-4e20-ad17-e6ae05f0780d\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-d5ffb"
Sep 17 01:42:10.573565 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:10.573414    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xplc2\" (UniqueName: \"kubernetes.io/projected/a0f66d44-d240-4e20-ad17-e6ae05f0780d-kube-api-access-xplc2\") pod \"monitoring-plugin-5d85778b9d-d5ffb\" (UID: \"a0f66d44-d240-4e20-ad17-e6ae05f0780d\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-d5ffb"
Sep 17 01:42:10.674562 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:10.674530    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a0f66d44-d240-4e20-ad17-e6ae05f0780d-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-d5ffb\" (UID: \"a0f66d44-d240-4e20-ad17-e6ae05f0780d\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-d5ffb"
Sep 17 01:42:10.674562 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:10.674566    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xplc2\" (UniqueName: \"kubernetes.io/projected/a0f66d44-d240-4e20-ad17-e6ae05f0780d-kube-api-access-xplc2\") pod \"monitoring-plugin-5d85778b9d-d5ffb\" (UID: \"a0f66d44-d240-4e20-ad17-e6ae05f0780d\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-d5ffb"
Sep 17 01:42:10.674726 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:42:10.674675    2560 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Sep 17 01:42:10.674758 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:42:10.674739    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0f66d44-d240-4e20-ad17-e6ae05f0780d-monitoring-plugin-cert podName:a0f66d44-d240-4e20-ad17-e6ae05f0780d nodeName:}" failed. No retries permitted until 2026-09-17 01:42:11.174721979 +0000 UTC m=+289.424699276 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/a0f66d44-d240-4e20-ad17-e6ae05f0780d-monitoring-plugin-cert") pod "monitoring-plugin-5d85778b9d-d5ffb" (UID: "a0f66d44-d240-4e20-ad17-e6ae05f0780d") : secret "monitoring-plugin-cert" not found
Sep 17 01:42:10.684000 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:10.683968    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xplc2\" (UniqueName: \"kubernetes.io/projected/a0f66d44-d240-4e20-ad17-e6ae05f0780d-kube-api-access-xplc2\") pod \"monitoring-plugin-5d85778b9d-d5ffb\" (UID: \"a0f66d44-d240-4e20-ad17-e6ae05f0780d\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-d5ffb"
Sep 17 01:42:11.178034 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:11.177995    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a0f66d44-d240-4e20-ad17-e6ae05f0780d-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-d5ffb\" (UID: \"a0f66d44-d240-4e20-ad17-e6ae05f0780d\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-d5ffb"
Sep 17 01:42:11.180418 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:11.180397    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a0f66d44-d240-4e20-ad17-e6ae05f0780d-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-d5ffb\" (UID: \"a0f66d44-d240-4e20-ad17-e6ae05f0780d\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-d5ffb"
Sep 17 01:42:11.343412 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:11.343374    2560 patch_prober.go:28] interesting pod/image-registry-556656868b-6qdkj container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 17 01:42:11.343551 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:11.343427    2560 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-556656868b-6qdkj" podUID="4bef8068-4aab-450b-a13b-87a1c7f6b323" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 01:42:11.446280 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:11.446179    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-d5ffb"
Sep 17 01:42:11.712354 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:11.712282    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-d5ffb"]
Sep 17 01:42:11.715005 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:42:11.714980    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0f66d44_d240_4e20_ad17_e6ae05f0780d.slice/crio-f7a4333ebc954b52df5519106eecf13a2ca1452a19191165d8a0c0c7201f6a27 WatchSource:0}: Error finding container f7a4333ebc954b52df5519106eecf13a2ca1452a19191165d8a0c0c7201f6a27: Status 404 returned error can't find the container with id f7a4333ebc954b52df5519106eecf13a2ca1452a19191165d8a0c0c7201f6a27
Sep 17 01:42:12.372551 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:12.372484    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-d5ffb" event={"ID":"a0f66d44-d240-4e20-ad17-e6ae05f0780d","Type":"ContainerStarted","Data":"f7a4333ebc954b52df5519106eecf13a2ca1452a19191165d8a0c0c7201f6a27"}
Sep 17 01:42:13.292185 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:13.292151    2560 patch_prober.go:28] interesting pod/image-registry-556656868b-6qdkj container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 17 01:42:13.292569 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:13.292206    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-556656868b-6qdkj" podUID="4bef8068-4aab-450b-a13b-87a1c7f6b323" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 01:42:13.377687 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:13.377652    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-d5ffb" event={"ID":"a0f66d44-d240-4e20-ad17-e6ae05f0780d","Type":"ContainerStarted","Data":"754bd3bf94e8782594e0383254a661f816519301f03c51be6b5a5fc051b7512b"}
Sep 17 01:42:13.377873 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:13.377853    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-d5ffb"
Sep 17 01:42:13.382428 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:13.382405    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-d5ffb"
Sep 17 01:42:13.390545 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:13.390509    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-d5ffb" podStartSLOduration=2.063013867 podStartE2EDuration="3.390497543s" totalImagesPullingTime="1.327483676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:42:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:42:13.390123198 +0000 UTC m=+291.640100511" watchObservedRunningTime="2026-09-17 01:42:13.390497543 +0000 UTC m=+291.640474856"
Sep 17 01:42:14.352168 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:42:14.352114    2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-p8bbk" podUID="091f4d92-aca2-45ac-9c63-6b73cf983b35"
Sep 17 01:42:17.721539 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:17.721505    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-nwn7d"]
Sep 17 01:42:17.724502 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:17.724484    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-nwn7d"
Sep 17 01:42:17.726223 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:17.726203    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-g2zqc\""
Sep 17 01:42:17.726381 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:17.726362    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 17 01:42:17.726421 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:17.726367    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 17 01:42:17.734782 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:17.734758    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-nwn7d"]
Sep 17 01:42:17.826530 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:17.826494    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m99l7\" (UniqueName: \"kubernetes.io/projected/a5a2b676-e9e1-4d35-bec9-8abc03bacced-kube-api-access-m99l7\") pod \"downloads-76f99584f4-nwn7d\" (UID: \"a5a2b676-e9e1-4d35-bec9-8abc03bacced\") " pod="openshift-console/downloads-76f99584f4-nwn7d"
Sep 17 01:42:17.927874 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:17.927833    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m99l7\" (UniqueName: \"kubernetes.io/projected/a5a2b676-e9e1-4d35-bec9-8abc03bacced-kube-api-access-m99l7\") pod \"downloads-76f99584f4-nwn7d\" (UID: \"a5a2b676-e9e1-4d35-bec9-8abc03bacced\") " pod="openshift-console/downloads-76f99584f4-nwn7d"
Sep 17 01:42:17.935342 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:17.935322    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m99l7\" (UniqueName: \"kubernetes.io/projected/a5a2b676-e9e1-4d35-bec9-8abc03bacced-kube-api-access-m99l7\") pod \"downloads-76f99584f4-nwn7d\" (UID: \"a5a2b676-e9e1-4d35-bec9-8abc03bacced\") " pod="openshift-console/downloads-76f99584f4-nwn7d"
Sep 17 01:42:18.036545 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:18.036456    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-nwn7d"
Sep 17 01:42:18.303728 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:18.303622    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-nwn7d"]
Sep 17 01:42:18.306273 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:42:18.306223    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5a2b676_e9e1_4d35_bec9_8abc03bacced.slice/crio-cd19943f878a46412d3e67e4fe53fadbcc33114db07eb57f8507e6103dec14d5 WatchSource:0}: Error finding container cd19943f878a46412d3e67e4fe53fadbcc33114db07eb57f8507e6103dec14d5: Status 404 returned error can't find the container with id cd19943f878a46412d3e67e4fe53fadbcc33114db07eb57f8507e6103dec14d5
Sep 17 01:42:18.393903 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:18.393863    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-nwn7d" event={"ID":"a5a2b676-e9e1-4d35-bec9-8abc03bacced","Type":"ContainerStarted","Data":"cd19943f878a46412d3e67e4fe53fadbcc33114db07eb57f8507e6103dec14d5"}
Sep 17 01:42:19.362344 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:19.362313    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-cjxjr"
Sep 17 01:42:21.343684 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:21.343645    2560 patch_prober.go:28] interesting pod/image-registry-556656868b-6qdkj container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 17 01:42:21.344091 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:21.343709    2560 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-556656868b-6qdkj" podUID="4bef8068-4aab-450b-a13b-87a1c7f6b323" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 01:42:22.193773 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:22.193745    2560 kubelet.go:1648] "Image garbage collection succeeded"
Sep 17 01:42:23.294317 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:23.294286    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-556656868b-6qdkj"
Sep 17 01:42:26.351362 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:26.351327    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8bbk"
Sep 17 01:42:27.674712 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:27.674671    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5fc685d75f-nmsvh"]
Sep 17 01:42:27.678587 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:27.678559    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fc685d75f-nmsvh"
Sep 17 01:42:27.680536 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:27.680506    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 17 01:42:27.680975 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:27.680907    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 17 01:42:27.680975 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:27.680953    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2hv8q\""
Sep 17 01:42:27.681162 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:27.680977    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 17 01:42:27.681162 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:27.680977    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 17 01:42:27.681162 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:27.680953    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 17 01:42:27.687695 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:27.687674    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fc685d75f-nmsvh"]
Sep 17 01:42:27.817542 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:27.817435    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b41f4627-18ab-41f0-85e4-53a9a03b0a79-service-ca\") pod \"console-5fc685d75f-nmsvh\" (UID: \"b41f4627-18ab-41f0-85e4-53a9a03b0a79\") " pod="openshift-console/console-5fc685d75f-nmsvh"
Sep 17 01:42:27.817723 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:27.817551    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b41f4627-18ab-41f0-85e4-53a9a03b0a79-oauth-serving-cert\") pod \"console-5fc685d75f-nmsvh\" (UID: \"b41f4627-18ab-41f0-85e4-53a9a03b0a79\") " pod="openshift-console/console-5fc685d75f-nmsvh"
Sep 17 01:42:27.817723 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:27.817587    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b41f4627-18ab-41f0-85e4-53a9a03b0a79-console-oauth-config\") pod \"console-5fc685d75f-nmsvh\" (UID: \"b41f4627-18ab-41f0-85e4-53a9a03b0a79\") " pod="openshift-console/console-5fc685d75f-nmsvh"
Sep 17 01:42:27.817723 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:27.817692    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b41f4627-18ab-41f0-85e4-53a9a03b0a79-console-config\") pod \"console-5fc685d75f-nmsvh\" (UID: \"b41f4627-18ab-41f0-85e4-53a9a03b0a79\") " pod="openshift-console/console-5fc685d75f-nmsvh"
Sep 17 01:42:27.817884 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:27.817748    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmgmz\" (UniqueName: \"kubernetes.io/projected/b41f4627-18ab-41f0-85e4-53a9a03b0a79-kube-api-access-dmgmz\") pod \"console-5fc685d75f-nmsvh\" (UID: \"b41f4627-18ab-41f0-85e4-53a9a03b0a79\") " pod="openshift-console/console-5fc685d75f-nmsvh"
Sep 17 01:42:27.817884 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:27.817789    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b41f4627-18ab-41f0-85e4-53a9a03b0a79-console-serving-cert\") pod \"console-5fc685d75f-nmsvh\" (UID: \"b41f4627-18ab-41f0-85e4-53a9a03b0a79\") " pod="openshift-console/console-5fc685d75f-nmsvh"
Sep 17 01:42:27.918309 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:27.918268    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b41f4627-18ab-41f0-85e4-53a9a03b0a79-console-serving-cert\") pod \"console-5fc685d75f-nmsvh\" (UID: \"b41f4627-18ab-41f0-85e4-53a9a03b0a79\") " pod="openshift-console/console-5fc685d75f-nmsvh"
Sep 17 01:42:27.918499 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:27.918324    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b41f4627-18ab-41f0-85e4-53a9a03b0a79-service-ca\") pod \"console-5fc685d75f-nmsvh\" (UID: \"b41f4627-18ab-41f0-85e4-53a9a03b0a79\") " pod="openshift-console/console-5fc685d75f-nmsvh"
Sep 17 01:42:27.918499 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:27.918393    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b41f4627-18ab-41f0-85e4-53a9a03b0a79-oauth-serving-cert\") pod \"console-5fc685d75f-nmsvh\" (UID: \"b41f4627-18ab-41f0-85e4-53a9a03b0a79\") " pod="openshift-console/console-5fc685d75f-nmsvh"
Sep 17 01:42:27.918499 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:27.918422    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b41f4627-18ab-41f0-85e4-53a9a03b0a79-console-oauth-config\") pod \"console-5fc685d75f-nmsvh\" (UID: \"b41f4627-18ab-41f0-85e4-53a9a03b0a79\") " pod="openshift-console/console-5fc685d75f-nmsvh"
Sep 17 01:42:27.918499 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:27.918457    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b41f4627-18ab-41f0-85e4-53a9a03b0a79-console-config\") pod \"console-5fc685d75f-nmsvh\" (UID: \"b41f4627-18ab-41f0-85e4-53a9a03b0a79\") " pod="openshift-console/console-5fc685d75f-nmsvh"
Sep 17 01:42:27.918662 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:27.918499    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmgmz\" (UniqueName: \"kubernetes.io/projected/b41f4627-18ab-41f0-85e4-53a9a03b0a79-kube-api-access-dmgmz\") pod \"console-5fc685d75f-nmsvh\" (UID: \"b41f4627-18ab-41f0-85e4-53a9a03b0a79\") " pod="openshift-console/console-5fc685d75f-nmsvh"
Sep 17 01:42:27.919235 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:27.919190    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b41f4627-18ab-41f0-85e4-53a9a03b0a79-service-ca\") pod \"console-5fc685d75f-nmsvh\" (UID: \"b41f4627-18ab-41f0-85e4-53a9a03b0a79\") " pod="openshift-console/console-5fc685d75f-nmsvh"
Sep 17 01:42:27.919391 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:27.919275    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b41f4627-18ab-41f0-85e4-53a9a03b0a79-console-config\") pod \"console-5fc685d75f-nmsvh\" (UID: \"b41f4627-18ab-41f0-85e4-53a9a03b0a79\") " pod="openshift-console/console-5fc685d75f-nmsvh"
Sep 17 01:42:27.919391 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:27.919302    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b41f4627-18ab-41f0-85e4-53a9a03b0a79-oauth-serving-cert\") pod \"console-5fc685d75f-nmsvh\" (UID: \"b41f4627-18ab-41f0-85e4-53a9a03b0a79\") " pod="openshift-console/console-5fc685d75f-nmsvh"
Sep 17 01:42:27.921277 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:27.921227    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b41f4627-18ab-41f0-85e4-53a9a03b0a79-console-oauth-config\") pod \"console-5fc685d75f-nmsvh\" (UID: \"b41f4627-18ab-41f0-85e4-53a9a03b0a79\") " pod="openshift-console/console-5fc685d75f-nmsvh"
Sep 17 01:42:27.921403 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:27.921236    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b41f4627-18ab-41f0-85e4-53a9a03b0a79-console-serving-cert\") pod \"console-5fc685d75f-nmsvh\" (UID: \"b41f4627-18ab-41f0-85e4-53a9a03b0a79\") " pod="openshift-console/console-5fc685d75f-nmsvh"
Sep 17 01:42:27.926119 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:27.926062    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmgmz\" (UniqueName: \"kubernetes.io/projected/b41f4627-18ab-41f0-85e4-53a9a03b0a79-kube-api-access-dmgmz\") pod \"console-5fc685d75f-nmsvh\" (UID: \"b41f4627-18ab-41f0-85e4-53a9a03b0a79\") " pod="openshift-console/console-5fc685d75f-nmsvh"
Sep 17 01:42:27.990285 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:27.990123    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fc685d75f-nmsvh"
Sep 17 01:42:34.025180 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:34.025102    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fc685d75f-nmsvh"]
Sep 17 01:42:34.028317 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:42:34.028286    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb41f4627_18ab_41f0_85e4_53a9a03b0a79.slice/crio-852f2bb8c5927cec2bf4a925ef0efd8b743d4c49fbe8718541bc17d1337c997f WatchSource:0}: Error finding container 852f2bb8c5927cec2bf4a925ef0efd8b743d4c49fbe8718541bc17d1337c997f: Status 404 returned error can't find the container with id 852f2bb8c5927cec2bf4a925ef0efd8b743d4c49fbe8718541bc17d1337c997f
Sep 17 01:42:34.030873 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:34.030853    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 01:42:34.459037 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:34.458989    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-nwn7d" event={"ID":"a5a2b676-e9e1-4d35-bec9-8abc03bacced","Type":"ContainerStarted","Data":"4799fb713ebc1cbbccb807b8afe672401f0e0a055975fec644eff52f9fe205f2"}
Sep 17 01:42:34.459228 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:34.459175    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-nwn7d"
Sep 17 01:42:34.460548 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:34.460516    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fc685d75f-nmsvh" event={"ID":"b41f4627-18ab-41f0-85e4-53a9a03b0a79","Type":"ContainerStarted","Data":"852f2bb8c5927cec2bf4a925ef0efd8b743d4c49fbe8718541bc17d1337c997f"}
Sep 17 01:42:34.473643 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:34.473615    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-nwn7d"
Sep 17 01:42:34.474897 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:34.474848    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-nwn7d" podStartSLOduration=1.94259786 podStartE2EDuration="17.474830854s" totalImagesPullingTime="15.532232994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:42:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:42:34.473629076 +0000 UTC m=+312.723606389" watchObservedRunningTime="2026-09-17 01:42:34.474830854 +0000 UTC m=+312.724808166"
Sep 17 01:42:37.413841 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:37.413805    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-556867c888-d7zgn"]
Sep 17 01:42:37.440492 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:37.440459    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-556867c888-d7zgn"]
Sep 17 01:42:37.440661 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:37.440584    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-556867c888-d7zgn"
Sep 17 01:42:37.447108 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:37.447084    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 17 01:42:37.604718 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:37.604679    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3348beea-828f-4e1c-a4ad-ba72be421838-console-config\") pod \"console-556867c888-d7zgn\" (UID: \"3348beea-828f-4e1c-a4ad-ba72be421838\") " pod="openshift-console/console-556867c888-d7zgn"
Sep 17 01:42:37.604921 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:37.604733    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3348beea-828f-4e1c-a4ad-ba72be421838-service-ca\") pod \"console-556867c888-d7zgn\" (UID: \"3348beea-828f-4e1c-a4ad-ba72be421838\") " pod="openshift-console/console-556867c888-d7zgn"
Sep 17 01:42:37.604921 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:37.604815    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3348beea-828f-4e1c-a4ad-ba72be421838-trusted-ca-bundle\") pod \"console-556867c888-d7zgn\" (UID: \"3348beea-828f-4e1c-a4ad-ba72be421838\") " pod="openshift-console/console-556867c888-d7zgn"
Sep 17 01:42:37.604921 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:37.604852    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrq46\" (UniqueName: \"kubernetes.io/projected/3348beea-828f-4e1c-a4ad-ba72be421838-kube-api-access-vrq46\") pod \"console-556867c888-d7zgn\" (UID: \"3348beea-828f-4e1c-a4ad-ba72be421838\") " pod="openshift-console/console-556867c888-d7zgn"
Sep 17 01:42:37.605079 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:37.604926    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3348beea-828f-4e1c-a4ad-ba72be421838-console-oauth-config\") pod \"console-556867c888-d7zgn\" (UID: \"3348beea-828f-4e1c-a4ad-ba72be421838\") " pod="openshift-console/console-556867c888-d7zgn"
Sep 17 01:42:37.605079 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:37.604985    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3348beea-828f-4e1c-a4ad-ba72be421838-console-serving-cert\") pod \"console-556867c888-d7zgn\" (UID: \"3348beea-828f-4e1c-a4ad-ba72be421838\") " pod="openshift-console/console-556867c888-d7zgn"
Sep 17 01:42:37.605079 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:37.605011    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3348beea-828f-4e1c-a4ad-ba72be421838-oauth-serving-cert\") pod \"console-556867c888-d7zgn\" (UID: \"3348beea-828f-4e1c-a4ad-ba72be421838\") " pod="openshift-console/console-556867c888-d7zgn"
Sep 17 01:42:37.706586 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:37.706500    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3348beea-828f-4e1c-a4ad-ba72be421838-console-serving-cert\") pod \"console-556867c888-d7zgn\" (UID: \"3348beea-828f-4e1c-a4ad-ba72be421838\") " pod="openshift-console/console-556867c888-d7zgn"
Sep 17 01:42:37.706747 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:37.706602    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3348beea-828f-4e1c-a4ad-ba72be421838-oauth-serving-cert\") pod \"console-556867c888-d7zgn\" (UID: \"3348beea-828f-4e1c-a4ad-ba72be421838\") " pod="openshift-console/console-556867c888-d7zgn"
Sep 17 01:42:37.706747 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:37.706687    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3348beea-828f-4e1c-a4ad-ba72be421838-console-config\") pod \"console-556867c888-d7zgn\" (UID: \"3348beea-828f-4e1c-a4ad-ba72be421838\") " pod="openshift-console/console-556867c888-d7zgn"
Sep 17 01:42:37.706747 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:37.706719    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3348beea-828f-4e1c-a4ad-ba72be421838-service-ca\") pod \"console-556867c888-d7zgn\" (UID: \"3348beea-828f-4e1c-a4ad-ba72be421838\") " pod="openshift-console/console-556867c888-d7zgn"
Sep 17 01:42:37.706912 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:37.706757    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3348beea-828f-4e1c-a4ad-ba72be421838-trusted-ca-bundle\") pod \"console-556867c888-d7zgn\" (UID: \"3348beea-828f-4e1c-a4ad-ba72be421838\") " pod="openshift-console/console-556867c888-d7zgn"
Sep 17 01:42:37.706912 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:37.706789    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrq46\" (UniqueName: \"kubernetes.io/projected/3348beea-828f-4e1c-a4ad-ba72be421838-kube-api-access-vrq46\") pod \"console-556867c888-d7zgn\" (UID: \"3348beea-828f-4e1c-a4ad-ba72be421838\") " pod="openshift-console/console-556867c888-d7zgn"
Sep 17 01:42:37.706912 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:37.706856    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3348beea-828f-4e1c-a4ad-ba72be421838-console-oauth-config\") pod \"console-556867c888-d7zgn\" (UID: \"3348beea-828f-4e1c-a4ad-ba72be421838\") " pod="openshift-console/console-556867c888-d7zgn"
Sep 17 01:42:37.711815 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:37.708167    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3348beea-828f-4e1c-a4ad-ba72be421838-service-ca\") pod \"console-556867c888-d7zgn\" (UID: \"3348beea-828f-4e1c-a4ad-ba72be421838\") " pod="openshift-console/console-556867c888-d7zgn"
Sep 17 01:42:37.711815 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:37.708622    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3348beea-828f-4e1c-a4ad-ba72be421838-trusted-ca-bundle\") pod \"console-556867c888-d7zgn\" (UID: \"3348beea-828f-4e1c-a4ad-ba72be421838\") " pod="openshift-console/console-556867c888-d7zgn"
Sep 17 01:42:37.711815 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:37.708839    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3348beea-828f-4e1c-a4ad-ba72be421838-oauth-serving-cert\") pod \"console-556867c888-d7zgn\" (UID: \"3348beea-828f-4e1c-a4ad-ba72be421838\") " pod="openshift-console/console-556867c888-d7zgn"
Sep 17 01:42:37.711815 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:37.709867    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3348beea-828f-4e1c-a4ad-ba72be421838-console-config\") pod \"console-556867c888-d7zgn\" (UID: \"3348beea-828f-4e1c-a4ad-ba72be421838\") " pod="openshift-console/console-556867c888-d7zgn"
Sep 17 01:42:37.711815 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:37.709958    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3348beea-828f-4e1c-a4ad-ba72be421838-console-oauth-config\") pod \"console-556867c888-d7zgn\" (UID: \"3348beea-828f-4e1c-a4ad-ba72be421838\") " pod="openshift-console/console-556867c888-d7zgn"
Sep 17 01:42:37.712624 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:37.712601    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3348beea-828f-4e1c-a4ad-ba72be421838-console-serving-cert\") pod \"console-556867c888-d7zgn\" (UID: \"3348beea-828f-4e1c-a4ad-ba72be421838\") " pod="openshift-console/console-556867c888-d7zgn"
Sep 17 01:42:37.716200 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:37.716173    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrq46\" (UniqueName: \"kubernetes.io/projected/3348beea-828f-4e1c-a4ad-ba72be421838-kube-api-access-vrq46\") pod \"console-556867c888-d7zgn\" (UID: \"3348beea-828f-4e1c-a4ad-ba72be421838\") " pod="openshift-console/console-556867c888-d7zgn"
Sep 17 01:42:37.751731 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:37.751693    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-556867c888-d7zgn"
Sep 17 01:42:38.181514 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:38.181484    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-556867c888-d7zgn"]
Sep 17 01:42:38.184124 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:42:38.184096    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3348beea_828f_4e1c_a4ad_ba72be421838.slice/crio-42536050917adb3d86e7513bbaef3d5e1ad030cea328db43b6a978fb4a00c92f WatchSource:0}: Error finding container 42536050917adb3d86e7513bbaef3d5e1ad030cea328db43b6a978fb4a00c92f: Status 404 returned error can't find the container with id 42536050917adb3d86e7513bbaef3d5e1ad030cea328db43b6a978fb4a00c92f
Sep 17 01:42:38.479990 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:38.479907    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-556867c888-d7zgn" event={"ID":"3348beea-828f-4e1c-a4ad-ba72be421838","Type":"ContainerStarted","Data":"757d88217cf3ec4a73a10f1153f642d25ea34635b7408223588ddab848db1e34"}
Sep 17 01:42:38.479990 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:38.479972    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-556867c888-d7zgn" event={"ID":"3348beea-828f-4e1c-a4ad-ba72be421838","Type":"ContainerStarted","Data":"42536050917adb3d86e7513bbaef3d5e1ad030cea328db43b6a978fb4a00c92f"}
Sep 17 01:42:38.482024 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:38.481995    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fc685d75f-nmsvh" event={"ID":"b41f4627-18ab-41f0-85e4-53a9a03b0a79","Type":"ContainerStarted","Data":"d383aa8cc29f57f4a047ddc7c4543fcf14085c80308f11cfe90cabb1718eafc4"}
Sep 17 01:42:38.494971 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:38.494921    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-556867c888-d7zgn" podStartSLOduration=1.494901008 podStartE2EDuration="1.494901008s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:42:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:42:38.493538659 +0000 UTC m=+316.743515972" watchObservedRunningTime="2026-09-17 01:42:38.494901008 +0000 UTC m=+316.744878322"
Sep 17 01:42:38.508448 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:38.508387    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5fc685d75f-nmsvh" podStartSLOduration=7.637644999 podStartE2EDuration="11.508372392s" totalImagesPullingTime="3.870727393s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:42:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:42:38.507055423 +0000 UTC m=+316.757032747" watchObservedRunningTime="2026-09-17 01:42:38.508372392 +0000 UTC m=+316.758349703"
Sep 17 01:42:47.752755 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:47.752706    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-556867c888-d7zgn"
Sep 17 01:42:47.753595 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:47.752785    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-556867c888-d7zgn"
Sep 17 01:42:47.757580 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:47.757555    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-556867c888-d7zgn"
Sep 17 01:42:47.990593 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:47.990547    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5fc685d75f-nmsvh"
Sep 17 01:42:47.990837 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:47.990647    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5fc685d75f-nmsvh"
Sep 17 01:42:47.995347 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:47.995319    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5fc685d75f-nmsvh"
Sep 17 01:42:48.520915 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:48.520887    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-556867c888-d7zgn"
Sep 17 01:42:48.521367 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:48.521348    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5fc685d75f-nmsvh"
Sep 17 01:42:48.575747 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:42:48.575712    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5fc685d75f-nmsvh"]
Sep 17 01:43:15.542120 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:15.542025    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5fc685d75f-nmsvh" podUID="b41f4627-18ab-41f0-85e4-53a9a03b0a79" containerName="console" containerID="cri-o://d383aa8cc29f57f4a047ddc7c4543fcf14085c80308f11cfe90cabb1718eafc4" gracePeriod=15
Sep 17 01:43:15.803491 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:15.803416    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fc685d75f-nmsvh"
Sep 17 01:43:15.907700 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:15.907657    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b41f4627-18ab-41f0-85e4-53a9a03b0a79-oauth-serving-cert\") pod \"b41f4627-18ab-41f0-85e4-53a9a03b0a79\" (UID: \"b41f4627-18ab-41f0-85e4-53a9a03b0a79\") "
Sep 17 01:43:15.907700 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:15.907708    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b41f4627-18ab-41f0-85e4-53a9a03b0a79-console-config\") pod \"b41f4627-18ab-41f0-85e4-53a9a03b0a79\" (UID: \"b41f4627-18ab-41f0-85e4-53a9a03b0a79\") "
Sep 17 01:43:15.907906 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:15.907737    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dmgmz\" (UniqueName: \"kubernetes.io/projected/b41f4627-18ab-41f0-85e4-53a9a03b0a79-kube-api-access-dmgmz\") pod \"b41f4627-18ab-41f0-85e4-53a9a03b0a79\" (UID: \"b41f4627-18ab-41f0-85e4-53a9a03b0a79\") "
Sep 17 01:43:15.907906 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:15.907769    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b41f4627-18ab-41f0-85e4-53a9a03b0a79-console-oauth-config\") pod \"b41f4627-18ab-41f0-85e4-53a9a03b0a79\" (UID: \"b41f4627-18ab-41f0-85e4-53a9a03b0a79\") "
Sep 17 01:43:15.907906 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:15.907801    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b41f4627-18ab-41f0-85e4-53a9a03b0a79-service-ca\") pod \"b41f4627-18ab-41f0-85e4-53a9a03b0a79\" (UID: \"b41f4627-18ab-41f0-85e4-53a9a03b0a79\") "
Sep 17 01:43:15.907906 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:15.907831    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b41f4627-18ab-41f0-85e4-53a9a03b0a79-console-serving-cert\") pod \"b41f4627-18ab-41f0-85e4-53a9a03b0a79\" (UID: \"b41f4627-18ab-41f0-85e4-53a9a03b0a79\") "
Sep 17 01:43:15.908242 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:15.908208    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b41f4627-18ab-41f0-85e4-53a9a03b0a79-service-ca" (OuterVolumeSpecName: "service-ca") pod "b41f4627-18ab-41f0-85e4-53a9a03b0a79" (UID: "b41f4627-18ab-41f0-85e4-53a9a03b0a79"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:43:15.908416 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:15.908219    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b41f4627-18ab-41f0-85e4-53a9a03b0a79-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b41f4627-18ab-41f0-85e4-53a9a03b0a79" (UID: "b41f4627-18ab-41f0-85e4-53a9a03b0a79"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:43:15.908416 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:15.908277    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b41f4627-18ab-41f0-85e4-53a9a03b0a79-console-config" (OuterVolumeSpecName: "console-config") pod "b41f4627-18ab-41f0-85e4-53a9a03b0a79" (UID: "b41f4627-18ab-41f0-85e4-53a9a03b0a79"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:43:15.909966 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:15.909940    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b41f4627-18ab-41f0-85e4-53a9a03b0a79-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b41f4627-18ab-41f0-85e4-53a9a03b0a79" (UID: "b41f4627-18ab-41f0-85e4-53a9a03b0a79"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 01:43:15.910081 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:15.910059    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b41f4627-18ab-41f0-85e4-53a9a03b0a79-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b41f4627-18ab-41f0-85e4-53a9a03b0a79" (UID: "b41f4627-18ab-41f0-85e4-53a9a03b0a79"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 01:43:15.910153 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:15.910132    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b41f4627-18ab-41f0-85e4-53a9a03b0a79-kube-api-access-dmgmz" (OuterVolumeSpecName: "kube-api-access-dmgmz") pod "b41f4627-18ab-41f0-85e4-53a9a03b0a79" (UID: "b41f4627-18ab-41f0-85e4-53a9a03b0a79"). InnerVolumeSpecName "kube-api-access-dmgmz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:43:16.008725 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:16.008684    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b41f4627-18ab-41f0-85e4-53a9a03b0a79-console-config\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:43:16.008725 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:16.008719    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dmgmz\" (UniqueName: \"kubernetes.io/projected/b41f4627-18ab-41f0-85e4-53a9a03b0a79-kube-api-access-dmgmz\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:43:16.008725 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:16.008732    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b41f4627-18ab-41f0-85e4-53a9a03b0a79-console-oauth-config\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:43:16.008957 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:16.008744    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b41f4627-18ab-41f0-85e4-53a9a03b0a79-service-ca\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:43:16.008957 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:16.008756    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b41f4627-18ab-41f0-85e4-53a9a03b0a79-console-serving-cert\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:43:16.008957 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:16.008768    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b41f4627-18ab-41f0-85e4-53a9a03b0a79-oauth-serving-cert\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:43:16.615232 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:16.615151    2560 generic.go:356] "Generic (PLEG): container finished" podID="b41f4627-18ab-41f0-85e4-53a9a03b0a79" containerID="d383aa8cc29f57f4a047ddc7c4543fcf14085c80308f11cfe90cabb1718eafc4" exitCode=0
Sep 17 01:43:16.615232 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:16.615207    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fc685d75f-nmsvh"
Sep 17 01:43:16.615744 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:16.615216    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fc685d75f-nmsvh" event={"ID":"b41f4627-18ab-41f0-85e4-53a9a03b0a79","Type":"ContainerDied","Data":"d383aa8cc29f57f4a047ddc7c4543fcf14085c80308f11cfe90cabb1718eafc4"}
Sep 17 01:43:16.615744 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:16.615295    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fc685d75f-nmsvh" event={"ID":"b41f4627-18ab-41f0-85e4-53a9a03b0a79","Type":"ContainerDied","Data":"852f2bb8c5927cec2bf4a925ef0efd8b743d4c49fbe8718541bc17d1337c997f"}
Sep 17 01:43:16.615744 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:16.615314    2560 scope.go:117] "RemoveContainer" containerID="d383aa8cc29f57f4a047ddc7c4543fcf14085c80308f11cfe90cabb1718eafc4"
Sep 17 01:43:16.628264 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:16.628223    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5fc685d75f-nmsvh"]
Sep 17 01:43:16.630418 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:16.630398    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5fc685d75f-nmsvh"]
Sep 17 01:43:16.631671 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:16.631655    2560 scope.go:117] "RemoveContainer" containerID="d383aa8cc29f57f4a047ddc7c4543fcf14085c80308f11cfe90cabb1718eafc4"
Sep 17 01:43:16.631966 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:43:16.631945    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d383aa8cc29f57f4a047ddc7c4543fcf14085c80308f11cfe90cabb1718eafc4\": container with ID starting with d383aa8cc29f57f4a047ddc7c4543fcf14085c80308f11cfe90cabb1718eafc4 not found: ID does not exist" containerID="d383aa8cc29f57f4a047ddc7c4543fcf14085c80308f11cfe90cabb1718eafc4"
Sep 17 01:43:16.632030 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:16.631979    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d383aa8cc29f57f4a047ddc7c4543fcf14085c80308f11cfe90cabb1718eafc4"} err="failed to get container status \"d383aa8cc29f57f4a047ddc7c4543fcf14085c80308f11cfe90cabb1718eafc4\": rpc error: code = NotFound desc = could not find container \"d383aa8cc29f57f4a047ddc7c4543fcf14085c80308f11cfe90cabb1718eafc4\": container with ID starting with d383aa8cc29f57f4a047ddc7c4543fcf14085c80308f11cfe90cabb1718eafc4 not found: ID does not exist"
Sep 17 01:43:18.359175 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:18.359142    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b41f4627-18ab-41f0-85e4-53a9a03b0a79" path="/var/lib/kubelet/pods/b41f4627-18ab-41f0-85e4-53a9a03b0a79/volumes"
Sep 17 01:43:33.257471 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:33.257438    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57bbcb6467-66rm9"]
Sep 17 01:43:33.257884 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:33.257710    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b41f4627-18ab-41f0-85e4-53a9a03b0a79" containerName="console"
Sep 17 01:43:33.257884 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:33.257722    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b41f4627-18ab-41f0-85e4-53a9a03b0a79" containerName="console"
Sep 17 01:43:33.257884 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:33.257765    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b41f4627-18ab-41f0-85e4-53a9a03b0a79" containerName="console"
Sep 17 01:43:33.262184 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:33.262158    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57bbcb6467-66rm9"
Sep 17 01:43:33.270733 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:33.270708    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57bbcb6467-66rm9"]
Sep 17 01:43:33.335293 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:33.335229    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e68b55b1-d083-47b3-8495-56d2bdcd2c90-service-ca\") pod \"console-57bbcb6467-66rm9\" (UID: \"e68b55b1-d083-47b3-8495-56d2bdcd2c90\") " pod="openshift-console/console-57bbcb6467-66rm9"
Sep 17 01:43:33.335487 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:33.335302    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czc9q\" (UniqueName: \"kubernetes.io/projected/e68b55b1-d083-47b3-8495-56d2bdcd2c90-kube-api-access-czc9q\") pod \"console-57bbcb6467-66rm9\" (UID: \"e68b55b1-d083-47b3-8495-56d2bdcd2c90\") " pod="openshift-console/console-57bbcb6467-66rm9"
Sep 17 01:43:33.335487 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:33.335385    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e68b55b1-d083-47b3-8495-56d2bdcd2c90-console-oauth-config\") pod \"console-57bbcb6467-66rm9\" (UID: \"e68b55b1-d083-47b3-8495-56d2bdcd2c90\") " pod="openshift-console/console-57bbcb6467-66rm9"
Sep 17 01:43:33.335487 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:33.335451    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e68b55b1-d083-47b3-8495-56d2bdcd2c90-console-config\") pod \"console-57bbcb6467-66rm9\" (UID: \"e68b55b1-d083-47b3-8495-56d2bdcd2c90\") " pod="openshift-console/console-57bbcb6467-66rm9"
Sep 17 01:43:33.335487 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:33.335475    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e68b55b1-d083-47b3-8495-56d2bdcd2c90-oauth-serving-cert\") pod \"console-57bbcb6467-66rm9\" (UID: \"e68b55b1-d083-47b3-8495-56d2bdcd2c90\") " pod="openshift-console/console-57bbcb6467-66rm9"
Sep 17 01:43:33.335653 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:33.335506    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e68b55b1-d083-47b3-8495-56d2bdcd2c90-trusted-ca-bundle\") pod \"console-57bbcb6467-66rm9\" (UID: \"e68b55b1-d083-47b3-8495-56d2bdcd2c90\") " pod="openshift-console/console-57bbcb6467-66rm9"
Sep 17 01:43:33.335653 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:33.335558    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e68b55b1-d083-47b3-8495-56d2bdcd2c90-console-serving-cert\") pod \"console-57bbcb6467-66rm9\" (UID: \"e68b55b1-d083-47b3-8495-56d2bdcd2c90\") " pod="openshift-console/console-57bbcb6467-66rm9"
Sep 17 01:43:33.436054 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:33.436018    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czc9q\" (UniqueName: \"kubernetes.io/projected/e68b55b1-d083-47b3-8495-56d2bdcd2c90-kube-api-access-czc9q\") pod \"console-57bbcb6467-66rm9\" (UID: \"e68b55b1-d083-47b3-8495-56d2bdcd2c90\") " pod="openshift-console/console-57bbcb6467-66rm9"
Sep 17 01:43:33.436054 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:33.436056    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e68b55b1-d083-47b3-8495-56d2bdcd2c90-console-oauth-config\") pod \"console-57bbcb6467-66rm9\" (UID: \"e68b55b1-d083-47b3-8495-56d2bdcd2c90\") " pod="openshift-console/console-57bbcb6467-66rm9"
Sep 17 01:43:33.436322 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:33.436160    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e68b55b1-d083-47b3-8495-56d2bdcd2c90-console-config\") pod \"console-57bbcb6467-66rm9\" (UID: \"e68b55b1-d083-47b3-8495-56d2bdcd2c90\") " pod="openshift-console/console-57bbcb6467-66rm9"
Sep 17 01:43:33.436322 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:33.436282    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e68b55b1-d083-47b3-8495-56d2bdcd2c90-oauth-serving-cert\") pod \"console-57bbcb6467-66rm9\" (UID: \"e68b55b1-d083-47b3-8495-56d2bdcd2c90\") " pod="openshift-console/console-57bbcb6467-66rm9"
Sep 17 01:43:33.436426 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:33.436328    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e68b55b1-d083-47b3-8495-56d2bdcd2c90-trusted-ca-bundle\") pod \"console-57bbcb6467-66rm9\" (UID: \"e68b55b1-d083-47b3-8495-56d2bdcd2c90\") " pod="openshift-console/console-57bbcb6467-66rm9"
Sep 17 01:43:33.436426 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:33.436365    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e68b55b1-d083-47b3-8495-56d2bdcd2c90-console-serving-cert\") pod \"console-57bbcb6467-66rm9\" (UID: \"e68b55b1-d083-47b3-8495-56d2bdcd2c90\") " pod="openshift-console/console-57bbcb6467-66rm9"
Sep 17 01:43:33.436426 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:33.436397    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e68b55b1-d083-47b3-8495-56d2bdcd2c90-service-ca\") pod \"console-57bbcb6467-66rm9\" (UID: \"e68b55b1-d083-47b3-8495-56d2bdcd2c90\") " pod="openshift-console/console-57bbcb6467-66rm9"
Sep 17 01:43:33.436893 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:33.436862    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e68b55b1-d083-47b3-8495-56d2bdcd2c90-console-config\") pod \"console-57bbcb6467-66rm9\" (UID: \"e68b55b1-d083-47b3-8495-56d2bdcd2c90\") " pod="openshift-console/console-57bbcb6467-66rm9"
Sep 17 01:43:33.437057 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:33.437033    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e68b55b1-d083-47b3-8495-56d2bdcd2c90-oauth-serving-cert\") pod \"console-57bbcb6467-66rm9\" (UID: \"e68b55b1-d083-47b3-8495-56d2bdcd2c90\") " pod="openshift-console/console-57bbcb6467-66rm9"
Sep 17 01:43:33.437125 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:33.437057    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e68b55b1-d083-47b3-8495-56d2bdcd2c90-service-ca\") pod \"console-57bbcb6467-66rm9\" (UID: \"e68b55b1-d083-47b3-8495-56d2bdcd2c90\") " pod="openshift-console/console-57bbcb6467-66rm9"
Sep 17 01:43:33.437168 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:33.437131    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e68b55b1-d083-47b3-8495-56d2bdcd2c90-trusted-ca-bundle\") pod \"console-57bbcb6467-66rm9\" (UID: \"e68b55b1-d083-47b3-8495-56d2bdcd2c90\") " pod="openshift-console/console-57bbcb6467-66rm9"
Sep 17 01:43:33.439173 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:33.439145    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e68b55b1-d083-47b3-8495-56d2bdcd2c90-console-serving-cert\") pod \"console-57bbcb6467-66rm9\" (UID: \"e68b55b1-d083-47b3-8495-56d2bdcd2c90\") " pod="openshift-console/console-57bbcb6467-66rm9"
Sep 17 01:43:33.439290 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:33.439269    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e68b55b1-d083-47b3-8495-56d2bdcd2c90-console-oauth-config\") pod \"console-57bbcb6467-66rm9\" (UID: \"e68b55b1-d083-47b3-8495-56d2bdcd2c90\") " pod="openshift-console/console-57bbcb6467-66rm9"
Sep 17 01:43:33.442771 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:33.442747    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czc9q\" (UniqueName: \"kubernetes.io/projected/e68b55b1-d083-47b3-8495-56d2bdcd2c90-kube-api-access-czc9q\") pod \"console-57bbcb6467-66rm9\" (UID: \"e68b55b1-d083-47b3-8495-56d2bdcd2c90\") " pod="openshift-console/console-57bbcb6467-66rm9"
Sep 17 01:43:33.571763 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:33.571728    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57bbcb6467-66rm9"
Sep 17 01:43:33.840948 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:33.840873    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57bbcb6467-66rm9"]
Sep 17 01:43:33.844537 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:43:33.844509    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode68b55b1_d083_47b3_8495_56d2bdcd2c90.slice/crio-38db70a198bdb0dd6b4ac2032212298fffdc4c1a554f29e8254ac071712ee42e WatchSource:0}: Error finding container 38db70a198bdb0dd6b4ac2032212298fffdc4c1a554f29e8254ac071712ee42e: Status 404 returned error can't find the container with id 38db70a198bdb0dd6b4ac2032212298fffdc4c1a554f29e8254ac071712ee42e
Sep 17 01:43:34.680299 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:34.680259    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57bbcb6467-66rm9" event={"ID":"e68b55b1-d083-47b3-8495-56d2bdcd2c90","Type":"ContainerStarted","Data":"427ff50d689afef2734fa0c86cdbb4c85a177b3312975ab5e933cbe2d7a1683f"}
Sep 17 01:43:34.680680 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:34.680316    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57bbcb6467-66rm9" event={"ID":"e68b55b1-d083-47b3-8495-56d2bdcd2c90","Type":"ContainerStarted","Data":"38db70a198bdb0dd6b4ac2032212298fffdc4c1a554f29e8254ac071712ee42e"}
Sep 17 01:43:34.698949 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:34.698891    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57bbcb6467-66rm9" podStartSLOduration=1.6988794459999998 podStartE2EDuration="1.698879446s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:43:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:43:34.698484752 +0000 UTC m=+372.948462064" watchObservedRunningTime="2026-09-17 01:43:34.698879446 +0000 UTC m=+372.948856758"
Sep 17 01:43:36.062002 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:36.061966    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/091f4d92-aca2-45ac-9c63-6b73cf983b35-metrics-certs\") pod \"network-metrics-daemon-p8bbk\" (UID: \"091f4d92-aca2-45ac-9c63-6b73cf983b35\") " pod="openshift-multus/network-metrics-daemon-p8bbk"
Sep 17 01:43:36.064297 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:36.064263    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/091f4d92-aca2-45ac-9c63-6b73cf983b35-metrics-certs\") pod \"network-metrics-daemon-p8bbk\" (UID: \"091f4d92-aca2-45ac-9c63-6b73cf983b35\") " pod="openshift-multus/network-metrics-daemon-p8bbk"
Sep 17 01:43:36.254667 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:36.254631    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5fdmc\""
Sep 17 01:43:36.263093 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:36.263070    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p8bbk"
Sep 17 01:43:36.530185 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:36.530155    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-p8bbk"]
Sep 17 01:43:36.533399 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:43:36.533369    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod091f4d92_aca2_45ac_9c63_6b73cf983b35.slice/crio-155e2391efa9ee488bfb2e80e19b877903b40dd31d58b6e8796333a94f708285 WatchSource:0}: Error finding container 155e2391efa9ee488bfb2e80e19b877903b40dd31d58b6e8796333a94f708285: Status 404 returned error can't find the container with id 155e2391efa9ee488bfb2e80e19b877903b40dd31d58b6e8796333a94f708285
Sep 17 01:43:36.688348 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:36.688268    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p8bbk" event={"ID":"091f4d92-aca2-45ac-9c63-6b73cf983b35","Type":"ContainerStarted","Data":"155e2391efa9ee488bfb2e80e19b877903b40dd31d58b6e8796333a94f708285"}
Sep 17 01:43:37.693163 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:37.693136    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p8bbk" event={"ID":"091f4d92-aca2-45ac-9c63-6b73cf983b35","Type":"ContainerStarted","Data":"84f0b18eb98a015062d353d5343d8fed3bc9ed4eb2a03d6dcc9d6729189c072a"}
Sep 17 01:43:38.698750 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:38.698715    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p8bbk" event={"ID":"091f4d92-aca2-45ac-9c63-6b73cf983b35","Type":"ContainerStarted","Data":"12c8480b762164eacf578db97edfac41d67b484747754cddaf2b3a7f6e5264c7"}
Sep 17 01:43:38.712936 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:38.712884    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-p8bbk" podStartSLOduration=374.649663816 podStartE2EDuration="6m15.712867975s" totalImagesPullingTime="1.063204159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:37:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:43:38.711094939 +0000 UTC m=+376.961072252" watchObservedRunningTime="2026-09-17 01:43:38.712867975 +0000 UTC m=+376.962845288"
Sep 17 01:43:43.571962 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:43.571912    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57bbcb6467-66rm9"
Sep 17 01:43:43.572423 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:43.571988    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57bbcb6467-66rm9"
Sep 17 01:43:43.576722 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:43.576693    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57bbcb6467-66rm9"
Sep 17 01:43:43.719990 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:43.719957    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57bbcb6467-66rm9"
Sep 17 01:43:43.761376 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:43:43.761338    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-556867c888-d7zgn"]
Sep 17 01:44:08.780763 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:08.780697    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-556867c888-d7zgn" podUID="3348beea-828f-4e1c-a4ad-ba72be421838" containerName="console" containerID="cri-o://757d88217cf3ec4a73a10f1153f642d25ea34635b7408223588ddab848db1e34" gracePeriod=15
Sep 17 01:44:09.015318 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:09.015293    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-556867c888-d7zgn"
Sep 17 01:44:09.109716 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:09.109689    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3348beea-828f-4e1c-a4ad-ba72be421838-console-config\") pod \"3348beea-828f-4e1c-a4ad-ba72be421838\" (UID: \"3348beea-828f-4e1c-a4ad-ba72be421838\") "
Sep 17 01:44:09.109889 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:09.109728    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vrq46\" (UniqueName: \"kubernetes.io/projected/3348beea-828f-4e1c-a4ad-ba72be421838-kube-api-access-vrq46\") pod \"3348beea-828f-4e1c-a4ad-ba72be421838\" (UID: \"3348beea-828f-4e1c-a4ad-ba72be421838\") "
Sep 17 01:44:09.109889 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:09.109763    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3348beea-828f-4e1c-a4ad-ba72be421838-console-serving-cert\") pod \"3348beea-828f-4e1c-a4ad-ba72be421838\" (UID: \"3348beea-828f-4e1c-a4ad-ba72be421838\") "
Sep 17 01:44:09.109889 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:09.109799    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3348beea-828f-4e1c-a4ad-ba72be421838-console-oauth-config\") pod \"3348beea-828f-4e1c-a4ad-ba72be421838\" (UID: \"3348beea-828f-4e1c-a4ad-ba72be421838\") "
Sep 17 01:44:09.109889 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:09.109851    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3348beea-828f-4e1c-a4ad-ba72be421838-service-ca\") pod \"3348beea-828f-4e1c-a4ad-ba72be421838\" (UID: \"3348beea-828f-4e1c-a4ad-ba72be421838\") "
Sep 17 01:44:09.109889 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:09.109884    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3348beea-828f-4e1c-a4ad-ba72be421838-trusted-ca-bundle\") pod \"3348beea-828f-4e1c-a4ad-ba72be421838\" (UID: \"3348beea-828f-4e1c-a4ad-ba72be421838\") "
Sep 17 01:44:09.110136 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:09.109999    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3348beea-828f-4e1c-a4ad-ba72be421838-oauth-serving-cert\") pod \"3348beea-828f-4e1c-a4ad-ba72be421838\" (UID: \"3348beea-828f-4e1c-a4ad-ba72be421838\") "
Sep 17 01:44:09.110196 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:09.110163    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3348beea-828f-4e1c-a4ad-ba72be421838-console-config" (OuterVolumeSpecName: "console-config") pod "3348beea-828f-4e1c-a4ad-ba72be421838" (UID: "3348beea-828f-4e1c-a4ad-ba72be421838"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:44:09.110300 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:09.110274    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3348beea-828f-4e1c-a4ad-ba72be421838-service-ca" (OuterVolumeSpecName: "service-ca") pod "3348beea-828f-4e1c-a4ad-ba72be421838" (UID: "3348beea-828f-4e1c-a4ad-ba72be421838"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:44:09.110360 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:09.110305    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3348beea-828f-4e1c-a4ad-ba72be421838-console-config\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:44:09.110360 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:09.110325    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3348beea-828f-4e1c-a4ad-ba72be421838-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3348beea-828f-4e1c-a4ad-ba72be421838" (UID: "3348beea-828f-4e1c-a4ad-ba72be421838"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:44:09.110547 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:09.110524    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3348beea-828f-4e1c-a4ad-ba72be421838-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3348beea-828f-4e1c-a4ad-ba72be421838" (UID: "3348beea-828f-4e1c-a4ad-ba72be421838"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:44:09.111884 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:09.111861    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3348beea-828f-4e1c-a4ad-ba72be421838-kube-api-access-vrq46" (OuterVolumeSpecName: "kube-api-access-vrq46") pod "3348beea-828f-4e1c-a4ad-ba72be421838" (UID: "3348beea-828f-4e1c-a4ad-ba72be421838"). InnerVolumeSpecName "kube-api-access-vrq46". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:44:09.111985 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:09.111885    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3348beea-828f-4e1c-a4ad-ba72be421838-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3348beea-828f-4e1c-a4ad-ba72be421838" (UID: "3348beea-828f-4e1c-a4ad-ba72be421838"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 01:44:09.112050 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:09.111976    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3348beea-828f-4e1c-a4ad-ba72be421838-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3348beea-828f-4e1c-a4ad-ba72be421838" (UID: "3348beea-828f-4e1c-a4ad-ba72be421838"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 01:44:09.211653 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:09.211607    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3348beea-828f-4e1c-a4ad-ba72be421838-console-oauth-config\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:44:09.211653 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:09.211647    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3348beea-828f-4e1c-a4ad-ba72be421838-service-ca\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:44:09.211653 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:09.211656    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3348beea-828f-4e1c-a4ad-ba72be421838-trusted-ca-bundle\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:44:09.211653 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:09.211665    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3348beea-828f-4e1c-a4ad-ba72be421838-oauth-serving-cert\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:44:09.211904 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:09.211674    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrq46\" (UniqueName: \"kubernetes.io/projected/3348beea-828f-4e1c-a4ad-ba72be421838-kube-api-access-vrq46\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:44:09.211904 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:09.211684    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3348beea-828f-4e1c-a4ad-ba72be421838-console-serving-cert\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:44:09.804077 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:09.804044    2560 generic.go:356] "Generic (PLEG): container finished" podID="3348beea-828f-4e1c-a4ad-ba72be421838" containerID="757d88217cf3ec4a73a10f1153f642d25ea34635b7408223588ddab848db1e34" exitCode=0
Sep 17 01:44:09.804487 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:09.804087    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-556867c888-d7zgn"
Sep 17 01:44:09.804487 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:09.804106    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-556867c888-d7zgn" event={"ID":"3348beea-828f-4e1c-a4ad-ba72be421838","Type":"ContainerDied","Data":"757d88217cf3ec4a73a10f1153f642d25ea34635b7408223588ddab848db1e34"}
Sep 17 01:44:09.804487 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:09.804143    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-556867c888-d7zgn" event={"ID":"3348beea-828f-4e1c-a4ad-ba72be421838","Type":"ContainerDied","Data":"42536050917adb3d86e7513bbaef3d5e1ad030cea328db43b6a978fb4a00c92f"}
Sep 17 01:44:09.804487 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:09.804163    2560 scope.go:117] "RemoveContainer" containerID="757d88217cf3ec4a73a10f1153f642d25ea34635b7408223588ddab848db1e34"
Sep 17 01:44:09.812554 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:09.812536    2560 scope.go:117] "RemoveContainer" containerID="757d88217cf3ec4a73a10f1153f642d25ea34635b7408223588ddab848db1e34"
Sep 17 01:44:09.812827 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:44:09.812808    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"757d88217cf3ec4a73a10f1153f642d25ea34635b7408223588ddab848db1e34\": container with ID starting with 757d88217cf3ec4a73a10f1153f642d25ea34635b7408223588ddab848db1e34 not found: ID does not exist" containerID="757d88217cf3ec4a73a10f1153f642d25ea34635b7408223588ddab848db1e34"
Sep 17 01:44:09.812886 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:09.812834    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"757d88217cf3ec4a73a10f1153f642d25ea34635b7408223588ddab848db1e34"} err="failed to get container status \"757d88217cf3ec4a73a10f1153f642d25ea34635b7408223588ddab848db1e34\": rpc error: code = NotFound desc = could not find container \"757d88217cf3ec4a73a10f1153f642d25ea34635b7408223588ddab848db1e34\": container with ID starting with 757d88217cf3ec4a73a10f1153f642d25ea34635b7408223588ddab848db1e34 not found: ID does not exist"
Sep 17 01:44:09.822959 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:09.822933    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-556867c888-d7zgn"]
Sep 17 01:44:09.825617 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:09.825597    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-556867c888-d7zgn"]
Sep 17 01:44:10.355438 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:10.355403    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3348beea-828f-4e1c-a4ad-ba72be421838" path="/var/lib/kubelet/pods/3348beea-828f-4e1c-a4ad-ba72be421838/volumes"
Sep 17 01:44:43.569220 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:43.569185    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6879f7bb68-q8c9m"]
Sep 17 01:44:43.569653 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:43.569440    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3348beea-828f-4e1c-a4ad-ba72be421838" containerName="console"
Sep 17 01:44:43.569653 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:43.569452    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3348beea-828f-4e1c-a4ad-ba72be421838" containerName="console"
Sep 17 01:44:43.569653 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:43.569488    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3348beea-828f-4e1c-a4ad-ba72be421838" containerName="console"
Sep 17 01:44:43.573400 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:43.573374    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6879f7bb68-q8c9m"
Sep 17 01:44:43.586763 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:43.586742    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6879f7bb68-q8c9m"]
Sep 17 01:44:43.650966 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:43.650921    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ca49a1de-828e-46ad-8a3e-e0e944be0bca-console-serving-cert\") pod \"console-6879f7bb68-q8c9m\" (UID: \"ca49a1de-828e-46ad-8a3e-e0e944be0bca\") " pod="openshift-console/console-6879f7bb68-q8c9m"
Sep 17 01:44:43.650966 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:43.650964    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ca49a1de-828e-46ad-8a3e-e0e944be0bca-oauth-serving-cert\") pod \"console-6879f7bb68-q8c9m\" (UID: \"ca49a1de-828e-46ad-8a3e-e0e944be0bca\") " pod="openshift-console/console-6879f7bb68-q8c9m"
Sep 17 01:44:43.651207 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:43.650986    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ca49a1de-828e-46ad-8a3e-e0e944be0bca-service-ca\") pod \"console-6879f7bb68-q8c9m\" (UID: \"ca49a1de-828e-46ad-8a3e-e0e944be0bca\") " pod="openshift-console/console-6879f7bb68-q8c9m"
Sep 17 01:44:43.651207 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:43.651043    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ca49a1de-828e-46ad-8a3e-e0e944be0bca-console-config\") pod \"console-6879f7bb68-q8c9m\" (UID: \"ca49a1de-828e-46ad-8a3e-e0e944be0bca\") " pod="openshift-console/console-6879f7bb68-q8c9m"
Sep 17 01:44:43.651207 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:43.651066    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pftjz\" (UniqueName: \"kubernetes.io/projected/ca49a1de-828e-46ad-8a3e-e0e944be0bca-kube-api-access-pftjz\") pod \"console-6879f7bb68-q8c9m\" (UID: \"ca49a1de-828e-46ad-8a3e-e0e944be0bca\") " pod="openshift-console/console-6879f7bb68-q8c9m"
Sep 17 01:44:43.651207 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:43.651090    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ca49a1de-828e-46ad-8a3e-e0e944be0bca-console-oauth-config\") pod \"console-6879f7bb68-q8c9m\" (UID: \"ca49a1de-828e-46ad-8a3e-e0e944be0bca\") " pod="openshift-console/console-6879f7bb68-q8c9m"
Sep 17 01:44:43.651207 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:43.651131    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca49a1de-828e-46ad-8a3e-e0e944be0bca-trusted-ca-bundle\") pod \"console-6879f7bb68-q8c9m\" (UID: \"ca49a1de-828e-46ad-8a3e-e0e944be0bca\") " pod="openshift-console/console-6879f7bb68-q8c9m"
Sep 17 01:44:43.752094 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:43.752059    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ca49a1de-828e-46ad-8a3e-e0e944be0bca-console-serving-cert\") pod \"console-6879f7bb68-q8c9m\" (UID: \"ca49a1de-828e-46ad-8a3e-e0e944be0bca\") " pod="openshift-console/console-6879f7bb68-q8c9m"
Sep 17 01:44:43.752094 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:43.752097    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ca49a1de-828e-46ad-8a3e-e0e944be0bca-oauth-serving-cert\") pod \"console-6879f7bb68-q8c9m\" (UID: \"ca49a1de-828e-46ad-8a3e-e0e944be0bca\") " pod="openshift-console/console-6879f7bb68-q8c9m"
Sep 17 01:44:43.752341 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:43.752123    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ca49a1de-828e-46ad-8a3e-e0e944be0bca-service-ca\") pod \"console-6879f7bb68-q8c9m\" (UID: \"ca49a1de-828e-46ad-8a3e-e0e944be0bca\") " pod="openshift-console/console-6879f7bb68-q8c9m"
Sep 17 01:44:43.752341 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:43.752155    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ca49a1de-828e-46ad-8a3e-e0e944be0bca-console-config\") pod \"console-6879f7bb68-q8c9m\" (UID: \"ca49a1de-828e-46ad-8a3e-e0e944be0bca\") " pod="openshift-console/console-6879f7bb68-q8c9m"
Sep 17 01:44:43.752341 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:43.752177    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pftjz\" (UniqueName: \"kubernetes.io/projected/ca49a1de-828e-46ad-8a3e-e0e944be0bca-kube-api-access-pftjz\") pod \"console-6879f7bb68-q8c9m\" (UID: \"ca49a1de-828e-46ad-8a3e-e0e944be0bca\") " pod="openshift-console/console-6879f7bb68-q8c9m"
Sep 17 01:44:43.752341 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:43.752208    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ca49a1de-828e-46ad-8a3e-e0e944be0bca-console-oauth-config\") pod \"console-6879f7bb68-q8c9m\" (UID: \"ca49a1de-828e-46ad-8a3e-e0e944be0bca\") " pod="openshift-console/console-6879f7bb68-q8c9m"
Sep 17 01:44:43.752341 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:43.752230    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca49a1de-828e-46ad-8a3e-e0e944be0bca-trusted-ca-bundle\") pod \"console-6879f7bb68-q8c9m\" (UID: \"ca49a1de-828e-46ad-8a3e-e0e944be0bca\") " pod="openshift-console/console-6879f7bb68-q8c9m"
Sep 17 01:44:43.752904 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:43.752876    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ca49a1de-828e-46ad-8a3e-e0e944be0bca-oauth-serving-cert\") pod \"console-6879f7bb68-q8c9m\" (UID: \"ca49a1de-828e-46ad-8a3e-e0e944be0bca\") " pod="openshift-console/console-6879f7bb68-q8c9m"
Sep 17 01:44:43.753023 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:43.752980    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ca49a1de-828e-46ad-8a3e-e0e944be0bca-service-ca\") pod \"console-6879f7bb68-q8c9m\" (UID: \"ca49a1de-828e-46ad-8a3e-e0e944be0bca\") " pod="openshift-console/console-6879f7bb68-q8c9m"
Sep 17 01:44:43.753023 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:43.752980    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ca49a1de-828e-46ad-8a3e-e0e944be0bca-console-config\") pod \"console-6879f7bb68-q8c9m\" (UID: \"ca49a1de-828e-46ad-8a3e-e0e944be0bca\") " pod="openshift-console/console-6879f7bb68-q8c9m"
Sep 17 01:44:43.753277 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:43.753238    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca49a1de-828e-46ad-8a3e-e0e944be0bca-trusted-ca-bundle\") pod \"console-6879f7bb68-q8c9m\" (UID: \"ca49a1de-828e-46ad-8a3e-e0e944be0bca\") " pod="openshift-console/console-6879f7bb68-q8c9m"
Sep 17 01:44:43.754715 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:43.754684    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ca49a1de-828e-46ad-8a3e-e0e944be0bca-console-oauth-config\") pod \"console-6879f7bb68-q8c9m\" (UID: \"ca49a1de-828e-46ad-8a3e-e0e944be0bca\") " pod="openshift-console/console-6879f7bb68-q8c9m"
Sep 17 01:44:43.754877 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:43.754856    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ca49a1de-828e-46ad-8a3e-e0e944be0bca-console-serving-cert\") pod \"console-6879f7bb68-q8c9m\" (UID: \"ca49a1de-828e-46ad-8a3e-e0e944be0bca\") " pod="openshift-console/console-6879f7bb68-q8c9m"
Sep 17 01:44:43.758866 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:43.758844    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pftjz\" (UniqueName: \"kubernetes.io/projected/ca49a1de-828e-46ad-8a3e-e0e944be0bca-kube-api-access-pftjz\") pod \"console-6879f7bb68-q8c9m\" (UID: \"ca49a1de-828e-46ad-8a3e-e0e944be0bca\") " pod="openshift-console/console-6879f7bb68-q8c9m"
Sep 17 01:44:43.883607 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:43.883515    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6879f7bb68-q8c9m"
Sep 17 01:44:44.153023 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:44.152884    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6879f7bb68-q8c9m"]
Sep 17 01:44:44.155552 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:44:44.155526    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca49a1de_828e_46ad_8a3e_e0e944be0bca.slice/crio-a5d93f2cc5e8cdc277d9fdadac4c6cb678fb24cd6a9c9bafc623c1c1262367b0 WatchSource:0}: Error finding container a5d93f2cc5e8cdc277d9fdadac4c6cb678fb24cd6a9c9bafc623c1c1262367b0: Status 404 returned error can't find the container with id a5d93f2cc5e8cdc277d9fdadac4c6cb678fb24cd6a9c9bafc623c1c1262367b0
Sep 17 01:44:44.928444 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:44.928356    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6879f7bb68-q8c9m" event={"ID":"ca49a1de-828e-46ad-8a3e-e0e944be0bca","Type":"ContainerStarted","Data":"b9c16dba9debdd78c089edde7e9819dbc37f7eb7743201ebb820cce59f57d811"}
Sep 17 01:44:44.928444 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:44.928406    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6879f7bb68-q8c9m" event={"ID":"ca49a1de-828e-46ad-8a3e-e0e944be0bca","Type":"ContainerStarted","Data":"a5d93f2cc5e8cdc277d9fdadac4c6cb678fb24cd6a9c9bafc623c1c1262367b0"}
Sep 17 01:44:44.945627 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:44.945564    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6879f7bb68-q8c9m" podStartSLOduration=1.945549428 podStartE2EDuration="1.945549428s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:44:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:44:44.943809338 +0000 UTC m=+443.193786653" watchObservedRunningTime="2026-09-17 01:44:44.945549428 +0000 UTC m=+443.195526741"
Sep 17 01:44:53.883999 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:53.883937    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6879f7bb68-q8c9m"
Sep 17 01:44:53.884632 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:53.884016    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6879f7bb68-q8c9m"
Sep 17 01:44:53.888689 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:53.888662    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6879f7bb68-q8c9m"
Sep 17 01:44:53.963189 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:53.963155    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6879f7bb68-q8c9m"
Sep 17 01:44:54.010965 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:44:54.010930    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57bbcb6467-66rm9"]
Sep 17 01:45:19.034993 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:45:19.034925    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-57bbcb6467-66rm9" podUID="e68b55b1-d083-47b3-8495-56d2bdcd2c90" containerName="console" containerID="cri-o://427ff50d689afef2734fa0c86cdbb4c85a177b3312975ab5e933cbe2d7a1683f" gracePeriod=15
Sep 17 01:45:19.268469 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:45:19.268445    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57bbcb6467-66rm9"
Sep 17 01:45:19.428471 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:45:19.428435    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e68b55b1-d083-47b3-8495-56d2bdcd2c90-oauth-serving-cert\") pod \"e68b55b1-d083-47b3-8495-56d2bdcd2c90\" (UID: \"e68b55b1-d083-47b3-8495-56d2bdcd2c90\") "
Sep 17 01:45:19.428659 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:45:19.428486    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e68b55b1-d083-47b3-8495-56d2bdcd2c90-service-ca\") pod \"e68b55b1-d083-47b3-8495-56d2bdcd2c90\" (UID: \"e68b55b1-d083-47b3-8495-56d2bdcd2c90\") "
Sep 17 01:45:19.428659 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:45:19.428508    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e68b55b1-d083-47b3-8495-56d2bdcd2c90-console-config\") pod \"e68b55b1-d083-47b3-8495-56d2bdcd2c90\" (UID: \"e68b55b1-d083-47b3-8495-56d2bdcd2c90\") "
Sep 17 01:45:19.428659 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:45:19.428638    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czc9q\" (UniqueName: \"kubernetes.io/projected/e68b55b1-d083-47b3-8495-56d2bdcd2c90-kube-api-access-czc9q\") pod \"e68b55b1-d083-47b3-8495-56d2bdcd2c90\" (UID: \"e68b55b1-d083-47b3-8495-56d2bdcd2c90\") "
Sep 17 01:45:19.428836 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:45:19.428679    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e68b55b1-d083-47b3-8495-56d2bdcd2c90-console-oauth-config\") pod \"e68b55b1-d083-47b3-8495-56d2bdcd2c90\" (UID: \"e68b55b1-d083-47b3-8495-56d2bdcd2c90\") "
Sep 17 01:45:19.428836 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:45:19.428725    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e68b55b1-d083-47b3-8495-56d2bdcd2c90-console-serving-cert\") pod \"e68b55b1-d083-47b3-8495-56d2bdcd2c90\" (UID: \"e68b55b1-d083-47b3-8495-56d2bdcd2c90\") "
Sep 17 01:45:19.428836 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:45:19.428757    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e68b55b1-d083-47b3-8495-56d2bdcd2c90-trusted-ca-bundle\") pod \"e68b55b1-d083-47b3-8495-56d2bdcd2c90\" (UID: \"e68b55b1-d083-47b3-8495-56d2bdcd2c90\") "
Sep 17 01:45:19.428977 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:45:19.428887    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e68b55b1-d083-47b3-8495-56d2bdcd2c90-console-config" (OuterVolumeSpecName: "console-config") pod "e68b55b1-d083-47b3-8495-56d2bdcd2c90" (UID: "e68b55b1-d083-47b3-8495-56d2bdcd2c90"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:45:19.428977 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:45:19.428898    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e68b55b1-d083-47b3-8495-56d2bdcd2c90-service-ca" (OuterVolumeSpecName: "service-ca") pod "e68b55b1-d083-47b3-8495-56d2bdcd2c90" (UID: "e68b55b1-d083-47b3-8495-56d2bdcd2c90"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:45:19.428977 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:45:19.428919    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e68b55b1-d083-47b3-8495-56d2bdcd2c90-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e68b55b1-d083-47b3-8495-56d2bdcd2c90" (UID: "e68b55b1-d083-47b3-8495-56d2bdcd2c90"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:45:19.429213 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:45:19.429153    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e68b55b1-d083-47b3-8495-56d2bdcd2c90-service-ca\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:45:19.429213 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:45:19.429174    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e68b55b1-d083-47b3-8495-56d2bdcd2c90-console-config\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:45:19.429213 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:45:19.429189    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e68b55b1-d083-47b3-8495-56d2bdcd2c90-oauth-serving-cert\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:45:19.429489 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:45:19.429365    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e68b55b1-d083-47b3-8495-56d2bdcd2c90-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e68b55b1-d083-47b3-8495-56d2bdcd2c90" (UID: "e68b55b1-d083-47b3-8495-56d2bdcd2c90"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:45:19.430895 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:45:19.430867    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e68b55b1-d083-47b3-8495-56d2bdcd2c90-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e68b55b1-d083-47b3-8495-56d2bdcd2c90" (UID: "e68b55b1-d083-47b3-8495-56d2bdcd2c90"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 01:45:19.430984 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:45:19.430904    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e68b55b1-d083-47b3-8495-56d2bdcd2c90-kube-api-access-czc9q" (OuterVolumeSpecName: "kube-api-access-czc9q") pod "e68b55b1-d083-47b3-8495-56d2bdcd2c90" (UID: "e68b55b1-d083-47b3-8495-56d2bdcd2c90"). InnerVolumeSpecName "kube-api-access-czc9q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:45:19.430984 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:45:19.430952    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e68b55b1-d083-47b3-8495-56d2bdcd2c90-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e68b55b1-d083-47b3-8495-56d2bdcd2c90" (UID: "e68b55b1-d083-47b3-8495-56d2bdcd2c90"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 01:45:19.530389 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:45:19.530351    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czc9q\" (UniqueName: \"kubernetes.io/projected/e68b55b1-d083-47b3-8495-56d2bdcd2c90-kube-api-access-czc9q\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:45:19.530389 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:45:19.530382    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e68b55b1-d083-47b3-8495-56d2bdcd2c90-console-oauth-config\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:45:19.530389 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:45:19.530392    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e68b55b1-d083-47b3-8495-56d2bdcd2c90-console-serving-cert\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:45:19.530389 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:45:19.530400    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e68b55b1-d083-47b3-8495-56d2bdcd2c90-trusted-ca-bundle\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:45:20.049758 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:45:20.049723    2560 generic.go:356] "Generic (PLEG): container finished" podID="e68b55b1-d083-47b3-8495-56d2bdcd2c90" containerID="427ff50d689afef2734fa0c86cdbb4c85a177b3312975ab5e933cbe2d7a1683f" exitCode=0
Sep 17 01:45:20.050157 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:45:20.049773    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57bbcb6467-66rm9"
Sep 17 01:45:20.050157 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:45:20.049787    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57bbcb6467-66rm9" event={"ID":"e68b55b1-d083-47b3-8495-56d2bdcd2c90","Type":"ContainerDied","Data":"427ff50d689afef2734fa0c86cdbb4c85a177b3312975ab5e933cbe2d7a1683f"}
Sep 17 01:45:20.050157 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:45:20.049834    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57bbcb6467-66rm9" event={"ID":"e68b55b1-d083-47b3-8495-56d2bdcd2c90","Type":"ContainerDied","Data":"38db70a198bdb0dd6b4ac2032212298fffdc4c1a554f29e8254ac071712ee42e"}
Sep 17 01:45:20.050157 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:45:20.049874    2560 scope.go:117] "RemoveContainer" containerID="427ff50d689afef2734fa0c86cdbb4c85a177b3312975ab5e933cbe2d7a1683f"
Sep 17 01:45:20.057915 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:45:20.057895    2560 scope.go:117] "RemoveContainer" containerID="427ff50d689afef2734fa0c86cdbb4c85a177b3312975ab5e933cbe2d7a1683f"
Sep 17 01:45:20.058218 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:45:20.058196    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"427ff50d689afef2734fa0c86cdbb4c85a177b3312975ab5e933cbe2d7a1683f\": container with ID starting with 427ff50d689afef2734fa0c86cdbb4c85a177b3312975ab5e933cbe2d7a1683f not found: ID does not exist" containerID="427ff50d689afef2734fa0c86cdbb4c85a177b3312975ab5e933cbe2d7a1683f"
Sep 17 01:45:20.058289 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:45:20.058226    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"427ff50d689afef2734fa0c86cdbb4c85a177b3312975ab5e933cbe2d7a1683f"} err="failed to get container status \"427ff50d689afef2734fa0c86cdbb4c85a177b3312975ab5e933cbe2d7a1683f\": rpc error: code = NotFound desc = could not find container \"427ff50d689afef2734fa0c86cdbb4c85a177b3312975ab5e933cbe2d7a1683f\": container with ID starting with 427ff50d689afef2734fa0c86cdbb4c85a177b3312975ab5e933cbe2d7a1683f not found: ID does not exist"
Sep 17 01:45:20.071326 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:45:20.071305    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57bbcb6467-66rm9"]
Sep 17 01:45:20.075536 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:45:20.075514    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-57bbcb6467-66rm9"]
Sep 17 01:45:20.355620 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:45:20.355589    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e68b55b1-d083-47b3-8495-56d2bdcd2c90" path="/var/lib/kubelet/pods/e68b55b1-d083-47b3-8495-56d2bdcd2c90/volumes"
Sep 17 01:46:30.338912 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:46:30.338876    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7z9fw"]
Sep 17 01:46:30.339403 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:46:30.339132    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e68b55b1-d083-47b3-8495-56d2bdcd2c90" containerName="console"
Sep 17 01:46:30.339403 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:46:30.339144    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e68b55b1-d083-47b3-8495-56d2bdcd2c90" containerName="console"
Sep 17 01:46:30.339403 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:46:30.339195    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e68b55b1-d083-47b3-8495-56d2bdcd2c90" containerName="console"
Sep 17 01:46:30.341962 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:46:30.341945    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7z9fw"
Sep 17 01:46:30.343677 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:46:30.343654    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 17 01:46:30.343957 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:46:30.343940    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 17 01:46:30.344009 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:46:30.343948    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-4pt9f\""
Sep 17 01:46:30.355349 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:46:30.355324    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7z9fw"]
Sep 17 01:46:30.417103 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:46:30.417064    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d6ff127c-158d-44d2-80bb-8e519faf9a72-tmp\") pod \"openshift-lws-operator-fd8ccff4c-7z9fw\" (UID: \"d6ff127c-158d-44d2-80bb-8e519faf9a72\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7z9fw"
Sep 17 01:46:30.417318 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:46:30.417130    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmbh4\" (UniqueName: \"kubernetes.io/projected/d6ff127c-158d-44d2-80bb-8e519faf9a72-kube-api-access-xmbh4\") pod \"openshift-lws-operator-fd8ccff4c-7z9fw\" (UID: \"d6ff127c-158d-44d2-80bb-8e519faf9a72\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7z9fw"
Sep 17 01:46:30.517847 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:46:30.517805    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmbh4\" (UniqueName: \"kubernetes.io/projected/d6ff127c-158d-44d2-80bb-8e519faf9a72-kube-api-access-xmbh4\") pod \"openshift-lws-operator-fd8ccff4c-7z9fw\" (UID: \"d6ff127c-158d-44d2-80bb-8e519faf9a72\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7z9fw"
Sep 17 01:46:30.518024 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:46:30.517855    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d6ff127c-158d-44d2-80bb-8e519faf9a72-tmp\") pod \"openshift-lws-operator-fd8ccff4c-7z9fw\" (UID: \"d6ff127c-158d-44d2-80bb-8e519faf9a72\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7z9fw"
Sep 17 01:46:30.518226 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:46:30.518206    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d6ff127c-158d-44d2-80bb-8e519faf9a72-tmp\") pod \"openshift-lws-operator-fd8ccff4c-7z9fw\" (UID: \"d6ff127c-158d-44d2-80bb-8e519faf9a72\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7z9fw"
Sep 17 01:46:30.525158 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:46:30.525138    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmbh4\" (UniqueName: \"kubernetes.io/projected/d6ff127c-158d-44d2-80bb-8e519faf9a72-kube-api-access-xmbh4\") pod \"openshift-lws-operator-fd8ccff4c-7z9fw\" (UID: \"d6ff127c-158d-44d2-80bb-8e519faf9a72\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7z9fw"
Sep 17 01:46:30.651072 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:46:30.650983    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7z9fw"
Sep 17 01:46:30.918989 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:46:30.918905    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7z9fw"]
Sep 17 01:46:30.921920 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:46:30.921892    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd6ff127c_158d_44d2_80bb_8e519faf9a72.slice/crio-ebf0573e24eeb1aa551022f8f013f8cc62c1eea8af1d9c619051a2a00786fded WatchSource:0}: Error finding container ebf0573e24eeb1aa551022f8f013f8cc62c1eea8af1d9c619051a2a00786fded: Status 404 returned error can't find the container with id ebf0573e24eeb1aa551022f8f013f8cc62c1eea8af1d9c619051a2a00786fded
Sep 17 01:46:31.286892 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:46:31.286806    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7z9fw" event={"ID":"d6ff127c-158d-44d2-80bb-8e519faf9a72","Type":"ContainerStarted","Data":"ebf0573e24eeb1aa551022f8f013f8cc62c1eea8af1d9c619051a2a00786fded"}
Sep 17 01:46:34.301968 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:46:34.301925    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7z9fw" event={"ID":"d6ff127c-158d-44d2-80bb-8e519faf9a72","Type":"ContainerStarted","Data":"018ef49cb40052cdf2188a7634f49da8ec5fe48677a1a37bcc617af8137dfe86"}
Sep 17 01:46:34.316713 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:46:34.316665    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-7z9fw" podStartSLOduration=1.8665302339999998 podStartE2EDuration="4.316648394s" totalImagesPullingTime="2.45011816s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:46:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:46:34.315600365 +0000 UTC m=+552.565577681" watchObservedRunningTime="2026-09-17 01:46:34.316648394 +0000 UTC m=+552.566625749"
Sep 17 01:46:50.407337 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:46:50.407298    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f5f459ff6-2x8xn"]
Sep 17 01:46:50.410330 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:46:50.410314    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f5f459ff6-2x8xn"
Sep 17 01:46:50.413619 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:46:50.413596    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 17 01:46:50.414164 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:46:50.414132    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 17 01:46:50.414443 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:46:50.414422    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 17 01:46:50.414535 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:46:50.414447    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-994j7\""
Sep 17 01:46:50.414535 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:46:50.414497    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 17 01:46:50.440140 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:46:50.440107    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f5f459ff6-2x8xn"]
Sep 17 01:46:50.466822 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:46:50.466788    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/14f9cb94-5a00-47a2-8500-9e6b2355c953-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f5f459ff6-2x8xn\" (UID: \"14f9cb94-5a00-47a2-8500-9e6b2355c953\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5f459ff6-2x8xn"
Sep 17 01:46:50.467010 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:46:50.466829    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14f9cb94-5a00-47a2-8500-9e6b2355c953-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f5f459ff6-2x8xn\" (UID: \"14f9cb94-5a00-47a2-8500-9e6b2355c953\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5f459ff6-2x8xn"
Sep 17 01:46:50.467010 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:46:50.466876    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14f9cb94-5a00-47a2-8500-9e6b2355c953-tmp\") pod \"opendatahub-operator-controller-manager-7f5f459ff6-2x8xn\" (UID: \"14f9cb94-5a00-47a2-8500-9e6b2355c953\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5f459ff6-2x8xn"
Sep 17 01:46:50.467010 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:46:50.466951    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/14f9cb94-5a00-47a2-8500-9e6b2355c953-manifests\") pod \"opendatahub-operator-controller-manager-7f5f459ff6-2x8xn\" (UID: \"14f9cb94-5a00-47a2-8500-9e6b2355c953\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5f459ff6-2x8xn"
Sep 17 01:46:50.467010 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:46:50.466985    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfvhr\" (UniqueName: \"kubernetes.io/projected/14f9cb94-5a00-47a2-8500-9e6b2355c953-kube-api-access-wfvhr\") pod \"opendatahub-operator-controller-manager-7f5f459ff6-2x8xn\" (UID: \"14f9cb94-5a00-47a2-8500-9e6b2355c953\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5f459ff6-2x8xn"
Sep 17 01:46:50.567519 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:46:50.567476    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14f9cb94-5a00-47a2-8500-9e6b2355c953-tmp\") pod \"opendatahub-operator-controller-manager-7f5f459ff6-2x8xn\" (UID: \"14f9cb94-5a00-47a2-8500-9e6b2355c953\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5f459ff6-2x8xn"
Sep 17 01:46:50.567519 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:46:50.567527    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/14f9cb94-5a00-47a2-8500-9e6b2355c953-manifests\") pod \"opendatahub-operator-controller-manager-7f5f459ff6-2x8xn\" (UID: \"14f9cb94-5a00-47a2-8500-9e6b2355c953\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5f459ff6-2x8xn"
Sep 17 01:46:50.567774 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:46:50.567548    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfvhr\" (UniqueName: \"kubernetes.io/projected/14f9cb94-5a00-47a2-8500-9e6b2355c953-kube-api-access-wfvhr\") pod \"opendatahub-operator-controller-manager-7f5f459ff6-2x8xn\" (UID: \"14f9cb94-5a00-47a2-8500-9e6b2355c953\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5f459ff6-2x8xn"
Sep 17 01:46:50.567774 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:46:50.567570    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/14f9cb94-5a00-47a2-8500-9e6b2355c953-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f5f459ff6-2x8xn\" (UID: \"14f9cb94-5a00-47a2-8500-9e6b2355c953\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5f459ff6-2x8xn"
Sep 17 01:46:50.567774 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:46:50.567607    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14f9cb94-5a00-47a2-8500-9e6b2355c953-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f5f459ff6-2x8xn\" (UID: \"14f9cb94-5a00-47a2-8500-9e6b2355c953\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5f459ff6-2x8xn"
Sep 17 01:46:50.567988 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:46:50.567966    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/14f9cb94-5a00-47a2-8500-9e6b2355c953-manifests\") pod \"opendatahub-operator-controller-manager-7f5f459ff6-2x8xn\" (UID: \"14f9cb94-5a00-47a2-8500-9e6b2355c953\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5f459ff6-2x8xn"
Sep 17 01:46:50.569682 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:46:50.569654    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/14f9cb94-5a00-47a2-8500-9e6b2355c953-tmp\") pod \"opendatahub-operator-controller-manager-7f5f459ff6-2x8xn\" (UID: \"14f9cb94-5a00-47a2-8500-9e6b2355c953\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5f459ff6-2x8xn"
Sep 17 01:46:50.569921 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:46:50.569905    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14f9cb94-5a00-47a2-8500-9e6b2355c953-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f5f459ff6-2x8xn\" (UID: \"14f9cb94-5a00-47a2-8500-9e6b2355c953\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5f459ff6-2x8xn"
Sep 17 01:46:50.569973 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:46:50.569955    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/14f9cb94-5a00-47a2-8500-9e6b2355c953-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f5f459ff6-2x8xn\" (UID: \"14f9cb94-5a00-47a2-8500-9e6b2355c953\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5f459ff6-2x8xn"
Sep 17 01:46:50.577304 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:46:50.577262    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfvhr\" (UniqueName: \"kubernetes.io/projected/14f9cb94-5a00-47a2-8500-9e6b2355c953-kube-api-access-wfvhr\") pod \"opendatahub-operator-controller-manager-7f5f459ff6-2x8xn\" (UID: \"14f9cb94-5a00-47a2-8500-9e6b2355c953\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5f459ff6-2x8xn"
Sep 17 01:46:50.720562 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:46:50.720478    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f5f459ff6-2x8xn"
Sep 17 01:46:51.001156 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:46:50.996690    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f5f459ff6-2x8xn"]
Sep 17 01:46:51.001707 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:46:51.001674    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14f9cb94_5a00_47a2_8500_9e6b2355c953.slice/crio-b5810bb2b89a83915fe85d3a36cd1b7687e8ebd3c6180a93a774bdb84518c054 WatchSource:0}: Error finding container b5810bb2b89a83915fe85d3a36cd1b7687e8ebd3c6180a93a774bdb84518c054: Status 404 returned error can't find the container with id b5810bb2b89a83915fe85d3a36cd1b7687e8ebd3c6180a93a774bdb84518c054
Sep 17 01:46:51.361048 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:46:51.361014    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f5f459ff6-2x8xn" event={"ID":"14f9cb94-5a00-47a2-8500-9e6b2355c953","Type":"ContainerStarted","Data":"b5810bb2b89a83915fe85d3a36cd1b7687e8ebd3c6180a93a774bdb84518c054"}
Sep 17 01:46:54.373413 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:46:54.373378    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f5f459ff6-2x8xn" event={"ID":"14f9cb94-5a00-47a2-8500-9e6b2355c953","Type":"ContainerStarted","Data":"c781b1e8bfb5d860e295c2e601aadc9db0f9969ba9f9f18ef80fdf0de67d3610"}
Sep 17 01:46:55.378282 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:46:55.378228    2560 generic.go:356] "Generic (PLEG): container finished" podID="14f9cb94-5a00-47a2-8500-9e6b2355c953" containerID="c781b1e8bfb5d860e295c2e601aadc9db0f9969ba9f9f18ef80fdf0de67d3610" exitCode=0
Sep 17 01:46:55.378661 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:46:55.378308    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f5f459ff6-2x8xn" event={"ID":"14f9cb94-5a00-47a2-8500-9e6b2355c953","Type":"ContainerDied","Data":"c781b1e8bfb5d860e295c2e601aadc9db0f9969ba9f9f18ef80fdf0de67d3610"}
Sep 17 01:46:56.385153 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:46:56.385113    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f5f459ff6-2x8xn" event={"ID":"14f9cb94-5a00-47a2-8500-9e6b2355c953","Type":"ContainerStarted","Data":"4bd85386906e4ce0c157195591813df480e6dd9dd09897522e107f8e2961a446"}
Sep 17 01:46:56.385595 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:46:56.385282    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7f5f459ff6-2x8xn"
Sep 17 01:46:56.406825 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:46:56.406768    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7f5f459ff6-2x8xn" podStartSLOduration=2.326095344 podStartE2EDuration="6.4067083s" totalImagesPullingTime="3.064825564s" totalInitContainerRuntime="1.015787392s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:46:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:46:56.405647638 +0000 UTC m=+574.655624950" watchObservedRunningTime="2026-09-17 01:46:56.4067083 +0000 UTC m=+574.656685591"
Sep 17 01:47:07.391449 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:07.391420    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7f5f459ff6-2x8xn"
Sep 17 01:47:10.129961 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:10.129925    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6b79c4dfc8-cs6db"]
Sep 17 01:47:10.144743 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:10.144709    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6b79c4dfc8-cs6db"
Sep 17 01:47:10.146998 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:10.146967    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 17 01:47:10.147109 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:10.146975    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 17 01:47:10.147109 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:10.147071    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 17 01:47:10.147448 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:10.147430    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 17 01:47:10.147511 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:10.147495    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-zthpz\""
Sep 17 01:47:10.150430 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:10.150409    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6b79c4dfc8-cs6db"]
Sep 17 01:47:10.320681 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:10.320645    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd462ce5-798b-46ab-ab9a-542df781ab42-tls-certs\") pod \"kube-auth-proxy-6b79c4dfc8-cs6db\" (UID: \"bd462ce5-798b-46ab-ab9a-542df781ab42\") " pod="openshift-ingress/kube-auth-proxy-6b79c4dfc8-cs6db"
Sep 17 01:47:10.320861 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:10.320689    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgfvz\" (UniqueName: \"kubernetes.io/projected/bd462ce5-798b-46ab-ab9a-542df781ab42-kube-api-access-sgfvz\") pod \"kube-auth-proxy-6b79c4dfc8-cs6db\" (UID: \"bd462ce5-798b-46ab-ab9a-542df781ab42\") " pod="openshift-ingress/kube-auth-proxy-6b79c4dfc8-cs6db"
Sep 17 01:47:10.320861 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:10.320713    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd462ce5-798b-46ab-ab9a-542df781ab42-tmp\") pod \"kube-auth-proxy-6b79c4dfc8-cs6db\" (UID: \"bd462ce5-798b-46ab-ab9a-542df781ab42\") " pod="openshift-ingress/kube-auth-proxy-6b79c4dfc8-cs6db"
Sep 17 01:47:10.421159 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:10.421082    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd462ce5-798b-46ab-ab9a-542df781ab42-tls-certs\") pod \"kube-auth-proxy-6b79c4dfc8-cs6db\" (UID: \"bd462ce5-798b-46ab-ab9a-542df781ab42\") " pod="openshift-ingress/kube-auth-proxy-6b79c4dfc8-cs6db"
Sep 17 01:47:10.421159 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:10.421133    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgfvz\" (UniqueName: \"kubernetes.io/projected/bd462ce5-798b-46ab-ab9a-542df781ab42-kube-api-access-sgfvz\") pod \"kube-auth-proxy-6b79c4dfc8-cs6db\" (UID: \"bd462ce5-798b-46ab-ab9a-542df781ab42\") " pod="openshift-ingress/kube-auth-proxy-6b79c4dfc8-cs6db"
Sep 17 01:47:10.421380 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:10.421260    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd462ce5-798b-46ab-ab9a-542df781ab42-tmp\") pod \"kube-auth-proxy-6b79c4dfc8-cs6db\" (UID: \"bd462ce5-798b-46ab-ab9a-542df781ab42\") " pod="openshift-ingress/kube-auth-proxy-6b79c4dfc8-cs6db"
Sep 17 01:47:10.423655 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:10.423619    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd462ce5-798b-46ab-ab9a-542df781ab42-tmp\") pod \"kube-auth-proxy-6b79c4dfc8-cs6db\" (UID: \"bd462ce5-798b-46ab-ab9a-542df781ab42\") " pod="openshift-ingress/kube-auth-proxy-6b79c4dfc8-cs6db"
Sep 17 01:47:10.423784 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:10.423769    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd462ce5-798b-46ab-ab9a-542df781ab42-tls-certs\") pod \"kube-auth-proxy-6b79c4dfc8-cs6db\" (UID: \"bd462ce5-798b-46ab-ab9a-542df781ab42\") " pod="openshift-ingress/kube-auth-proxy-6b79c4dfc8-cs6db"
Sep 17 01:47:10.428052 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:10.428028    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgfvz\" (UniqueName: \"kubernetes.io/projected/bd462ce5-798b-46ab-ab9a-542df781ab42-kube-api-access-sgfvz\") pod \"kube-auth-proxy-6b79c4dfc8-cs6db\" (UID: \"bd462ce5-798b-46ab-ab9a-542df781ab42\") " pod="openshift-ingress/kube-auth-proxy-6b79c4dfc8-cs6db"
Sep 17 01:47:10.455008 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:10.454978    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6b79c4dfc8-cs6db"
Sep 17 01:47:10.739369 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:10.739295    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6b79c4dfc8-cs6db"]
Sep 17 01:47:10.742211 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:47:10.742181    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd462ce5_798b_46ab_ab9a_542df781ab42.slice/crio-98caedb31dfba293584676ddee6b68b6fc16e3a5da4ad1ea7cfb0f19876b736b WatchSource:0}: Error finding container 98caedb31dfba293584676ddee6b68b6fc16e3a5da4ad1ea7cfb0f19876b736b: Status 404 returned error can't find the container with id 98caedb31dfba293584676ddee6b68b6fc16e3a5da4ad1ea7cfb0f19876b736b
Sep 17 01:47:11.358751 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:11.358716    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t6dws"]
Sep 17 01:47:11.362158 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:11.362133    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t6dws"
Sep 17 01:47:11.364169 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:11.364142    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 17 01:47:11.364169 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:11.364157    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-4vtfw\""
Sep 17 01:47:11.364397 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:11.364166    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 17 01:47:11.364397 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:11.364205    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 17 01:47:11.364397 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:11.364240    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 17 01:47:11.377266 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:11.377217    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t6dws"]
Sep 17 01:47:11.440999 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:11.440954    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6b79c4dfc8-cs6db" event={"ID":"bd462ce5-798b-46ab-ab9a-542df781ab42","Type":"ContainerStarted","Data":"98caedb31dfba293584676ddee6b68b6fc16e3a5da4ad1ea7cfb0f19876b736b"}
Sep 17 01:47:11.529103 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:11.529029    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41c5ed13-c3df-42e2-846d-3a1cd7df0d00-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-t6dws\" (UID: \"41c5ed13-c3df-42e2-846d-3a1cd7df0d00\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t6dws"
Sep 17 01:47:11.529323 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:11.529147    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/41c5ed13-c3df-42e2-846d-3a1cd7df0d00-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-t6dws\" (UID: \"41c5ed13-c3df-42e2-846d-3a1cd7df0d00\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t6dws"
Sep 17 01:47:11.529323 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:11.529176    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/41c5ed13-c3df-42e2-846d-3a1cd7df0d00-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-t6dws\" (UID: \"41c5ed13-c3df-42e2-846d-3a1cd7df0d00\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t6dws"
Sep 17 01:47:11.529323 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:11.529211    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/41c5ed13-c3df-42e2-846d-3a1cd7df0d00-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-t6dws\" (UID: \"41c5ed13-c3df-42e2-846d-3a1cd7df0d00\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t6dws"
Sep 17 01:47:11.529323 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:11.529305    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/41c5ed13-c3df-42e2-846d-3a1cd7df0d00-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-t6dws\" (UID: \"41c5ed13-c3df-42e2-846d-3a1cd7df0d00\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t6dws"
Sep 17 01:47:11.529551 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:11.529356    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngd48\" (UniqueName: \"kubernetes.io/projected/41c5ed13-c3df-42e2-846d-3a1cd7df0d00-kube-api-access-ngd48\") pod \"istiod-openshift-gateway-7b7995d5cd-t6dws\" (UID: \"41c5ed13-c3df-42e2-846d-3a1cd7df0d00\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t6dws"
Sep 17 01:47:11.529551 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:11.529378    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/41c5ed13-c3df-42e2-846d-3a1cd7df0d00-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-t6dws\" (UID: \"41c5ed13-c3df-42e2-846d-3a1cd7df0d00\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t6dws"
Sep 17 01:47:11.630551 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:11.630464    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41c5ed13-c3df-42e2-846d-3a1cd7df0d00-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-t6dws\" (UID: \"41c5ed13-c3df-42e2-846d-3a1cd7df0d00\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t6dws"
Sep 17 01:47:11.630551 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:11.630530    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/41c5ed13-c3df-42e2-846d-3a1cd7df0d00-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-t6dws\" (UID: \"41c5ed13-c3df-42e2-846d-3a1cd7df0d00\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t6dws"
Sep 17 01:47:11.630781 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:11.630557    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/41c5ed13-c3df-42e2-846d-3a1cd7df0d00-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-t6dws\" (UID: \"41c5ed13-c3df-42e2-846d-3a1cd7df0d00\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t6dws"
Sep 17 01:47:11.630781 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:11.630593    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/41c5ed13-c3df-42e2-846d-3a1cd7df0d00-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-t6dws\" (UID: \"41c5ed13-c3df-42e2-846d-3a1cd7df0d00\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t6dws"
Sep 17 01:47:11.630781 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:11.630643    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/41c5ed13-c3df-42e2-846d-3a1cd7df0d00-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-t6dws\" (UID: \"41c5ed13-c3df-42e2-846d-3a1cd7df0d00\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t6dws"
Sep 17 01:47:11.630781 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:11.630679    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngd48\" (UniqueName: \"kubernetes.io/projected/41c5ed13-c3df-42e2-846d-3a1cd7df0d00-kube-api-access-ngd48\") pod \"istiod-openshift-gateway-7b7995d5cd-t6dws\" (UID: \"41c5ed13-c3df-42e2-846d-3a1cd7df0d00\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t6dws"
Sep 17 01:47:11.630781 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:11.630706    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/41c5ed13-c3df-42e2-846d-3a1cd7df0d00-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-t6dws\" (UID: \"41c5ed13-c3df-42e2-846d-3a1cd7df0d00\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t6dws"
Sep 17 01:47:11.631755 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:11.631707    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/41c5ed13-c3df-42e2-846d-3a1cd7df0d00-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-t6dws\" (UID: \"41c5ed13-c3df-42e2-846d-3a1cd7df0d00\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t6dws"
Sep 17 01:47:11.634420 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:11.634383    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/41c5ed13-c3df-42e2-846d-3a1cd7df0d00-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-t6dws\" (UID: \"41c5ed13-c3df-42e2-846d-3a1cd7df0d00\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t6dws"
Sep 17 01:47:11.634586 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:11.634565    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/41c5ed13-c3df-42e2-846d-3a1cd7df0d00-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-t6dws\" (UID: \"41c5ed13-c3df-42e2-846d-3a1cd7df0d00\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t6dws"
Sep 17 01:47:11.634690 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:11.634663    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/41c5ed13-c3df-42e2-846d-3a1cd7df0d00-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-t6dws\" (UID: \"41c5ed13-c3df-42e2-846d-3a1cd7df0d00\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t6dws"
Sep 17 01:47:11.634910 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:11.634883    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/41c5ed13-c3df-42e2-846d-3a1cd7df0d00-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-t6dws\" (UID: \"41c5ed13-c3df-42e2-846d-3a1cd7df0d00\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t6dws"
Sep 17 01:47:11.638824 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:11.638772    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41c5ed13-c3df-42e2-846d-3a1cd7df0d00-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-t6dws\" (UID: \"41c5ed13-c3df-42e2-846d-3a1cd7df0d00\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t6dws"
Sep 17 01:47:11.639267 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:11.639230    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngd48\" (UniqueName: \"kubernetes.io/projected/41c5ed13-c3df-42e2-846d-3a1cd7df0d00-kube-api-access-ngd48\") pod \"istiod-openshift-gateway-7b7995d5cd-t6dws\" (UID: \"41c5ed13-c3df-42e2-846d-3a1cd7df0d00\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t6dws"
Sep 17 01:47:11.675300 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:11.675261    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t6dws"
Sep 17 01:47:11.966115 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:11.966027    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t6dws"]
Sep 17 01:47:11.969856 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:47:11.969825    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41c5ed13_c3df_42e2_846d_3a1cd7df0d00.slice/crio-989f08c0bb13c4969e30745267c4ac7140a72b33ce6322ffdd44d1f5f7c67c4f WatchSource:0}: Error finding container 989f08c0bb13c4969e30745267c4ac7140a72b33ce6322ffdd44d1f5f7c67c4f: Status 404 returned error can't find the container with id 989f08c0bb13c4969e30745267c4ac7140a72b33ce6322ffdd44d1f5f7c67c4f
Sep 17 01:47:12.446884 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:12.446847    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t6dws" event={"ID":"41c5ed13-c3df-42e2-846d-3a1cd7df0d00","Type":"ContainerStarted","Data":"989f08c0bb13c4969e30745267c4ac7140a72b33ce6322ffdd44d1f5f7c67c4f"}
Sep 17 01:47:14.457019 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:14.456980    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6b79c4dfc8-cs6db" event={"ID":"bd462ce5-798b-46ab-ab9a-542df781ab42","Type":"ContainerStarted","Data":"c667594457f17976f4a58a0ef74eddf5b5eccc7bfbb4b2caeb33b242a2da977c"}
Sep 17 01:47:14.471809 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:14.471762    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6b79c4dfc8-cs6db" podStartSLOduration=1.733470628 podStartE2EDuration="4.471747197s" totalImagesPullingTime="2.738276569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:47:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:47:14.469868637 +0000 UTC m=+592.719845951" watchObservedRunningTime="2026-09-17 01:47:14.471747197 +0000 UTC m=+592.721724509"
Sep 17 01:47:15.396496 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:15.396457    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 01:47:15.396601 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:15.396523    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 01:47:15.463234 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:15.463194    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t6dws" event={"ID":"41c5ed13-c3df-42e2-846d-3a1cd7df0d00","Type":"ContainerStarted","Data":"d675ffb9aabbdc0a64fe4110cb905dc8457c6ce9e528271c5d335040d4b5efb9"}
Sep 17 01:47:15.507058 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:15.507003    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t6dws" podStartSLOduration=1.083300458 podStartE2EDuration="4.506979515s" totalImagesPullingTime="3.423679057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:47:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:47:15.505573421 +0000 UTC m=+593.755550728" watchObservedRunningTime="2026-09-17 01:47:15.506979515 +0000 UTC m=+593.756956829"
Sep 17 01:47:16.467400 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:16.467368    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t6dws"
Sep 17 01:47:16.469185 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:16.469156    2560 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-t6dws container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 17 01:47:16.469290 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:16.469213    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t6dws" podUID="41c5ed13-c3df-42e2-846d-3a1cd7df0d00" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 01:47:17.472069 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:17.472040    2560 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-t6dws container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 17 01:47:17.472462 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:17.472094    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t6dws" podUID="41c5ed13-c3df-42e2-846d-3a1cd7df0d00" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 01:47:20.473190 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:20.473157    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t6dws"
Sep 17 01:47:27.194936 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:27.194900    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-pgkbc"]
Sep 17 01:47:27.198362 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:27.198336    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pgkbc"
Sep 17 01:47:27.209712 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:27.209687    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-pgkbc"]
Sep 17 01:47:27.254839 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:27.254800    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/994d1047-b360-47df-bfa9-b2a728c5ab75-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-pgkbc\" (UID: \"994d1047-b360-47df-bfa9-b2a728c5ab75\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pgkbc"
Sep 17 01:47:27.254839 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:27.254841    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/994d1047-b360-47df-bfa9-b2a728c5ab75-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-pgkbc\" (UID: \"994d1047-b360-47df-bfa9-b2a728c5ab75\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pgkbc"
Sep 17 01:47:27.255061 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:27.254907    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6msl5\" (UniqueName: \"kubernetes.io/projected/994d1047-b360-47df-bfa9-b2a728c5ab75-kube-api-access-6msl5\") pod \"istiod-openshift-gateway-5677ccb49b-pgkbc\" (UID: \"994d1047-b360-47df-bfa9-b2a728c5ab75\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pgkbc"
Sep 17 01:47:27.255061 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:27.254963    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/994d1047-b360-47df-bfa9-b2a728c5ab75-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-pgkbc\" (UID: \"994d1047-b360-47df-bfa9-b2a728c5ab75\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pgkbc"
Sep 17 01:47:27.255061 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:27.254996    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/994d1047-b360-47df-bfa9-b2a728c5ab75-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-pgkbc\" (UID: \"994d1047-b360-47df-bfa9-b2a728c5ab75\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pgkbc"
Sep 17 01:47:27.255061 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:27.255017    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/994d1047-b360-47df-bfa9-b2a728c5ab75-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-pgkbc\" (UID: \"994d1047-b360-47df-bfa9-b2a728c5ab75\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pgkbc"
Sep 17 01:47:27.255061 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:27.255038    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/994d1047-b360-47df-bfa9-b2a728c5ab75-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-pgkbc\" (UID: \"994d1047-b360-47df-bfa9-b2a728c5ab75\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pgkbc"
Sep 17 01:47:27.356015 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:27.355983    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6msl5\" (UniqueName: \"kubernetes.io/projected/994d1047-b360-47df-bfa9-b2a728c5ab75-kube-api-access-6msl5\") pod \"istiod-openshift-gateway-5677ccb49b-pgkbc\" (UID: \"994d1047-b360-47df-bfa9-b2a728c5ab75\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pgkbc"
Sep 17 01:47:27.356015 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:27.356013    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/994d1047-b360-47df-bfa9-b2a728c5ab75-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-pgkbc\" (UID: \"994d1047-b360-47df-bfa9-b2a728c5ab75\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pgkbc"
Sep 17 01:47:27.356281 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:27.356036    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/994d1047-b360-47df-bfa9-b2a728c5ab75-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-pgkbc\" (UID: \"994d1047-b360-47df-bfa9-b2a728c5ab75\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pgkbc"
Sep 17 01:47:27.356281 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:27.356062    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/994d1047-b360-47df-bfa9-b2a728c5ab75-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-pgkbc\" (UID: \"994d1047-b360-47df-bfa9-b2a728c5ab75\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pgkbc"
Sep 17 01:47:27.356281 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:27.356088    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/994d1047-b360-47df-bfa9-b2a728c5ab75-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-pgkbc\" (UID: \"994d1047-b360-47df-bfa9-b2a728c5ab75\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pgkbc"
Sep 17 01:47:27.356281 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:27.356140    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/994d1047-b360-47df-bfa9-b2a728c5ab75-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-pgkbc\" (UID: \"994d1047-b360-47df-bfa9-b2a728c5ab75\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pgkbc"
Sep 17 01:47:27.356281 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:27.356269    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/994d1047-b360-47df-bfa9-b2a728c5ab75-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-pgkbc\" (UID: \"994d1047-b360-47df-bfa9-b2a728c5ab75\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pgkbc"
Sep 17 01:47:27.356929 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:27.356900    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/994d1047-b360-47df-bfa9-b2a728c5ab75-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-pgkbc\" (UID: \"994d1047-b360-47df-bfa9-b2a728c5ab75\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pgkbc"
Sep 17 01:47:27.358484 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:27.358459    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/994d1047-b360-47df-bfa9-b2a728c5ab75-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-pgkbc\" (UID: \"994d1047-b360-47df-bfa9-b2a728c5ab75\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pgkbc"
Sep 17 01:47:27.358566 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:27.358548    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/994d1047-b360-47df-bfa9-b2a728c5ab75-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-pgkbc\" (UID: \"994d1047-b360-47df-bfa9-b2a728c5ab75\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pgkbc"
Sep 17 01:47:27.358661 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:27.358639    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/994d1047-b360-47df-bfa9-b2a728c5ab75-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-pgkbc\" (UID: \"994d1047-b360-47df-bfa9-b2a728c5ab75\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pgkbc"
Sep 17 01:47:27.358701 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:27.358645    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/994d1047-b360-47df-bfa9-b2a728c5ab75-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-pgkbc\" (UID: \"994d1047-b360-47df-bfa9-b2a728c5ab75\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pgkbc"
Sep 17 01:47:27.362799 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:27.362770    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/994d1047-b360-47df-bfa9-b2a728c5ab75-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-pgkbc\" (UID: \"994d1047-b360-47df-bfa9-b2a728c5ab75\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pgkbc"
Sep 17 01:47:27.363032 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:27.363015    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6msl5\" (UniqueName: \"kubernetes.io/projected/994d1047-b360-47df-bfa9-b2a728c5ab75-kube-api-access-6msl5\") pod \"istiod-openshift-gateway-5677ccb49b-pgkbc\" (UID: \"994d1047-b360-47df-bfa9-b2a728c5ab75\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pgkbc"
Sep 17 01:47:27.507584 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:27.507483    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pgkbc"
Sep 17 01:47:27.785739 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:27.785710    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-pgkbc"]
Sep 17 01:47:27.788361 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:47:27.788337    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod994d1047_b360_47df_bfa9_b2a728c5ab75.slice/crio-94926c6f3e9bfbeb2f1621f352c0570f42bf42071916e22451f7d5a20f2e0425 WatchSource:0}: Error finding container 94926c6f3e9bfbeb2f1621f352c0570f42bf42071916e22451f7d5a20f2e0425: Status 404 returned error can't find the container with id 94926c6f3e9bfbeb2f1621f352c0570f42bf42071916e22451f7d5a20f2e0425
Sep 17 01:47:27.790834 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:27.790797    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 01:47:27.790930 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:27.790860    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 01:47:28.516818 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:28.516774    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pgkbc" event={"ID":"994d1047-b360-47df-bfa9-b2a728c5ab75","Type":"ContainerStarted","Data":"0a1fda3301c930d936b0affd058ada474cd406c1fc9a7fc503049b4c5b1400b5"}
Sep 17 01:47:28.517279 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:28.516837    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pgkbc" event={"ID":"994d1047-b360-47df-bfa9-b2a728c5ab75","Type":"ContainerStarted","Data":"94926c6f3e9bfbeb2f1621f352c0570f42bf42071916e22451f7d5a20f2e0425"}
Sep 17 01:47:28.517279 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:28.516984    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pgkbc"
Sep 17 01:47:28.518754 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:28.518724    2560 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-pgkbc container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 17 01:47:28.518879 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:28.518783    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pgkbc" podUID="994d1047-b360-47df-bfa9-b2a728c5ab75" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 01:47:28.535818 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:28.535765    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pgkbc" podStartSLOduration=1.535743627 podStartE2EDuration="1.535743627s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:47:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:47:28.534379193 +0000 UTC m=+606.784356509" watchObservedRunningTime="2026-09-17 01:47:28.535743627 +0000 UTC m=+606.785720939"
Sep 17 01:47:29.521748 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:29.521718    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-pgkbc"
Sep 17 01:47:29.685747 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:29.685717    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t6dws"]
Sep 17 01:47:29.685917 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:29.685896    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t6dws" podUID="41c5ed13-c3df-42e2-846d-3a1cd7df0d00" containerName="discovery" containerID="cri-o://d675ffb9aabbdc0a64fe4110cb905dc8457c6ce9e528271c5d335040d4b5efb9" gracePeriod=30
Sep 17 01:47:29.818329 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:29.818300    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d65888898-7phm7"]
Sep 17 01:47:29.821533 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:29.821513    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d65888898-7phm7"
Sep 17 01:47:29.841717 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:29.841685    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d65888898-7phm7"]
Sep 17 01:47:29.876638 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:29.876601    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/70ef6ef2-4104-4696-be49-f812c79d573a-service-ca\") pod \"console-d65888898-7phm7\" (UID: \"70ef6ef2-4104-4696-be49-f812c79d573a\") " pod="openshift-console/console-d65888898-7phm7"
Sep 17 01:47:29.876759 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:29.876643    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cvpw\" (UniqueName: \"kubernetes.io/projected/70ef6ef2-4104-4696-be49-f812c79d573a-kube-api-access-9cvpw\") pod \"console-d65888898-7phm7\" (UID: \"70ef6ef2-4104-4696-be49-f812c79d573a\") " pod="openshift-console/console-d65888898-7phm7"
Sep 17 01:47:29.876759 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:29.876687    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/70ef6ef2-4104-4696-be49-f812c79d573a-console-oauth-config\") pod \"console-d65888898-7phm7\" (UID: \"70ef6ef2-4104-4696-be49-f812c79d573a\") " pod="openshift-console/console-d65888898-7phm7"
Sep 17 01:47:29.876759 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:29.876728    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/70ef6ef2-4104-4696-be49-f812c79d573a-oauth-serving-cert\") pod \"console-d65888898-7phm7\" (UID: \"70ef6ef2-4104-4696-be49-f812c79d573a\") " pod="openshift-console/console-d65888898-7phm7"
Sep 17 01:47:29.876896 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:29.876806    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70ef6ef2-4104-4696-be49-f812c79d573a-trusted-ca-bundle\") pod \"console-d65888898-7phm7\" (UID: \"70ef6ef2-4104-4696-be49-f812c79d573a\") " pod="openshift-console/console-d65888898-7phm7"
Sep 17 01:47:29.876896 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:29.876858    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/70ef6ef2-4104-4696-be49-f812c79d573a-console-serving-cert\") pod \"console-d65888898-7phm7\" (UID: \"70ef6ef2-4104-4696-be49-f812c79d573a\") " pod="openshift-console/console-d65888898-7phm7"
Sep 17 01:47:29.876972 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:29.876898    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/70ef6ef2-4104-4696-be49-f812c79d573a-console-config\") pod \"console-d65888898-7phm7\" (UID: \"70ef6ef2-4104-4696-be49-f812c79d573a\") " pod="openshift-console/console-d65888898-7phm7"
Sep 17 01:47:29.943155 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:29.943128    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t6dws"
Sep 17 01:47:29.977407 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:29.977370    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/41c5ed13-c3df-42e2-846d-3a1cd7df0d00-istio-csr-ca-configmap\") pod \"41c5ed13-c3df-42e2-846d-3a1cd7df0d00\" (UID: \"41c5ed13-c3df-42e2-846d-3a1cd7df0d00\") "
Sep 17 01:47:29.977578 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:29.977464    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/41c5ed13-c3df-42e2-846d-3a1cd7df0d00-istio-csr-dns-cert\") pod \"41c5ed13-c3df-42e2-846d-3a1cd7df0d00\" (UID: \"41c5ed13-c3df-42e2-846d-3a1cd7df0d00\") "
Sep 17 01:47:29.977578 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:29.977495    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/41c5ed13-c3df-42e2-846d-3a1cd7df0d00-local-certs\") pod \"41c5ed13-c3df-42e2-846d-3a1cd7df0d00\" (UID: \"41c5ed13-c3df-42e2-846d-3a1cd7df0d00\") "
Sep 17 01:47:29.977578 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:29.977518    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/41c5ed13-c3df-42e2-846d-3a1cd7df0d00-cacerts\") pod \"41c5ed13-c3df-42e2-846d-3a1cd7df0d00\" (UID: \"41c5ed13-c3df-42e2-846d-3a1cd7df0d00\") "
Sep 17 01:47:29.977578 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:29.977543    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41c5ed13-c3df-42e2-846d-3a1cd7df0d00-istio-token\") pod \"41c5ed13-c3df-42e2-846d-3a1cd7df0d00\" (UID: \"41c5ed13-c3df-42e2-846d-3a1cd7df0d00\") "
Sep 17 01:47:29.977790 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:29.977577    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ngd48\" (UniqueName: \"kubernetes.io/projected/41c5ed13-c3df-42e2-846d-3a1cd7df0d00-kube-api-access-ngd48\") pod \"41c5ed13-c3df-42e2-846d-3a1cd7df0d00\" (UID: \"41c5ed13-c3df-42e2-846d-3a1cd7df0d00\") "
Sep 17 01:47:29.977790 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:29.977604    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/41c5ed13-c3df-42e2-846d-3a1cd7df0d00-istio-kubeconfig\") pod \"41c5ed13-c3df-42e2-846d-3a1cd7df0d00\" (UID: \"41c5ed13-c3df-42e2-846d-3a1cd7df0d00\") "
Sep 17 01:47:29.977790 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:29.977743    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/70ef6ef2-4104-4696-be49-f812c79d573a-console-oauth-config\") pod \"console-d65888898-7phm7\" (UID: \"70ef6ef2-4104-4696-be49-f812c79d573a\") " pod="openshift-console/console-d65888898-7phm7"
Sep 17 01:47:29.977790 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:29.977781    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/70ef6ef2-4104-4696-be49-f812c79d573a-oauth-serving-cert\") pod \"console-d65888898-7phm7\" (UID: \"70ef6ef2-4104-4696-be49-f812c79d573a\") " pod="openshift-console/console-d65888898-7phm7"
Sep 17 01:47:29.977977 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:29.977832    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70ef6ef2-4104-4696-be49-f812c79d573a-trusted-ca-bundle\") pod \"console-d65888898-7phm7\" (UID: \"70ef6ef2-4104-4696-be49-f812c79d573a\") " pod="openshift-console/console-d65888898-7phm7"
Sep 17 01:47:29.977977 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:29.977832    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41c5ed13-c3df-42e2-846d-3a1cd7df0d00-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "41c5ed13-c3df-42e2-846d-3a1cd7df0d00" (UID: "41c5ed13-c3df-42e2-846d-3a1cd7df0d00"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:47:29.978689 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:29.978664    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/70ef6ef2-4104-4696-be49-f812c79d573a-oauth-serving-cert\") pod \"console-d65888898-7phm7\" (UID: \"70ef6ef2-4104-4696-be49-f812c79d573a\") " pod="openshift-console/console-d65888898-7phm7"
Sep 17 01:47:29.978889 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:29.978869    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/70ef6ef2-4104-4696-be49-f812c79d573a-console-serving-cert\") pod \"console-d65888898-7phm7\" (UID: \"70ef6ef2-4104-4696-be49-f812c79d573a\") " pod="openshift-console/console-d65888898-7phm7"
Sep 17 01:47:29.979024 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:29.979005    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/70ef6ef2-4104-4696-be49-f812c79d573a-console-config\") pod \"console-d65888898-7phm7\" (UID: \"70ef6ef2-4104-4696-be49-f812c79d573a\") " pod="openshift-console/console-d65888898-7phm7"
Sep 17 01:47:29.979187 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:29.979169    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/70ef6ef2-4104-4696-be49-f812c79d573a-service-ca\") pod \"console-d65888898-7phm7\" (UID: \"70ef6ef2-4104-4696-be49-f812c79d573a\") " pod="openshift-console/console-d65888898-7phm7"
Sep 17 01:47:29.979321 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:29.979303    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cvpw\" (UniqueName: \"kubernetes.io/projected/70ef6ef2-4104-4696-be49-f812c79d573a-kube-api-access-9cvpw\") pod \"console-d65888898-7phm7\" (UID: \"70ef6ef2-4104-4696-be49-f812c79d573a\") " pod="openshift-console/console-d65888898-7phm7"
Sep 17 01:47:29.979474 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:29.979459    2560 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/41c5ed13-c3df-42e2-846d-3a1cd7df0d00-istio-csr-ca-configmap\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:47:29.979558 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:29.979035    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70ef6ef2-4104-4696-be49-f812c79d573a-trusted-ca-bundle\") pod \"console-d65888898-7phm7\" (UID: \"70ef6ef2-4104-4696-be49-f812c79d573a\") " pod="openshift-console/console-d65888898-7phm7"
Sep 17 01:47:29.980283 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:29.980215    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/70ef6ef2-4104-4696-be49-f812c79d573a-console-config\") pod \"console-d65888898-7phm7\" (UID: \"70ef6ef2-4104-4696-be49-f812c79d573a\") " pod="openshift-console/console-d65888898-7phm7"
Sep 17 01:47:29.980501 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:29.980476    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41c5ed13-c3df-42e2-846d-3a1cd7df0d00-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "41c5ed13-c3df-42e2-846d-3a1cd7df0d00" (UID: "41c5ed13-c3df-42e2-846d-3a1cd7df0d00"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 01:47:29.980583 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:29.980491    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/70ef6ef2-4104-4696-be49-f812c79d573a-service-ca\") pod \"console-d65888898-7phm7\" (UID: \"70ef6ef2-4104-4696-be49-f812c79d573a\") " pod="openshift-console/console-d65888898-7phm7"
Sep 17 01:47:29.980665 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:29.980641    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41c5ed13-c3df-42e2-846d-3a1cd7df0d00-cacerts" (OuterVolumeSpecName: "cacerts") pod "41c5ed13-c3df-42e2-846d-3a1cd7df0d00" (UID: "41c5ed13-c3df-42e2-846d-3a1cd7df0d00"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 01:47:29.981289 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:29.981234    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/70ef6ef2-4104-4696-be49-f812c79d573a-console-oauth-config\") pod \"console-d65888898-7phm7\" (UID: \"70ef6ef2-4104-4696-be49-f812c79d573a\") " pod="openshift-console/console-d65888898-7phm7"
Sep 17 01:47:29.981431 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:29.981403    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41c5ed13-c3df-42e2-846d-3a1cd7df0d00-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "41c5ed13-c3df-42e2-846d-3a1cd7df0d00" (UID: "41c5ed13-c3df-42e2-846d-3a1cd7df0d00"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 01:47:29.982117 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:29.982083    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41c5ed13-c3df-42e2-846d-3a1cd7df0d00-kube-api-access-ngd48" (OuterVolumeSpecName: "kube-api-access-ngd48") pod "41c5ed13-c3df-42e2-846d-3a1cd7df0d00" (UID: "41c5ed13-c3df-42e2-846d-3a1cd7df0d00"). InnerVolumeSpecName "kube-api-access-ngd48". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:47:29.982183 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:29.982149    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41c5ed13-c3df-42e2-846d-3a1cd7df0d00-local-certs" (OuterVolumeSpecName: "local-certs") pod "41c5ed13-c3df-42e2-846d-3a1cd7df0d00" (UID: "41c5ed13-c3df-42e2-846d-3a1cd7df0d00"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:47:29.982183 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:29.982152    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41c5ed13-c3df-42e2-846d-3a1cd7df0d00-istio-token" (OuterVolumeSpecName: "istio-token") pod "41c5ed13-c3df-42e2-846d-3a1cd7df0d00" (UID: "41c5ed13-c3df-42e2-846d-3a1cd7df0d00"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:47:29.982361 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:29.982346    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/70ef6ef2-4104-4696-be49-f812c79d573a-console-serving-cert\") pod \"console-d65888898-7phm7\" (UID: \"70ef6ef2-4104-4696-be49-f812c79d573a\") " pod="openshift-console/console-d65888898-7phm7"
Sep 17 01:47:29.990683 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:29.990660    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cvpw\" (UniqueName: \"kubernetes.io/projected/70ef6ef2-4104-4696-be49-f812c79d573a-kube-api-access-9cvpw\") pod \"console-d65888898-7phm7\" (UID: \"70ef6ef2-4104-4696-be49-f812c79d573a\") " pod="openshift-console/console-d65888898-7phm7"
Sep 17 01:47:30.080642 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:30.080607    2560 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/41c5ed13-c3df-42e2-846d-3a1cd7df0d00-istio-csr-dns-cert\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:47:30.080642 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:30.080636    2560 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/41c5ed13-c3df-42e2-846d-3a1cd7df0d00-local-certs\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:47:30.080642 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:30.080645    2560 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/41c5ed13-c3df-42e2-846d-3a1cd7df0d00-cacerts\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:47:30.080870 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:30.080652    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41c5ed13-c3df-42e2-846d-3a1cd7df0d00-istio-token\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:47:30.080870 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:30.080661    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ngd48\" (UniqueName: \"kubernetes.io/projected/41c5ed13-c3df-42e2-846d-3a1cd7df0d00-kube-api-access-ngd48\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:47:30.080870 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:30.080669    2560 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/41c5ed13-c3df-42e2-846d-3a1cd7df0d00-istio-kubeconfig\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:47:30.133411 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:30.133378    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d65888898-7phm7"
Sep 17 01:47:30.413448 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:30.413417    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d65888898-7phm7"]
Sep 17 01:47:30.417395 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:47:30.417367    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70ef6ef2_4104_4696_be49_f812c79d573a.slice/crio-94a483153efcd9de222354647670fcdfb5a238cd43541c97596d69e4f7b9e043 WatchSource:0}: Error finding container 94a483153efcd9de222354647670fcdfb5a238cd43541c97596d69e4f7b9e043: Status 404 returned error can't find the container with id 94a483153efcd9de222354647670fcdfb5a238cd43541c97596d69e4f7b9e043
Sep 17 01:47:30.526990 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:30.526949    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d65888898-7phm7" event={"ID":"70ef6ef2-4104-4696-be49-f812c79d573a","Type":"ContainerStarted","Data":"8c8e11d851c4e523fd0da08d77431464c2cce65e7aeea747030eaffc865dca95"}
Sep 17 01:47:30.527502 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:30.527015    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d65888898-7phm7" event={"ID":"70ef6ef2-4104-4696-be49-f812c79d573a","Type":"ContainerStarted","Data":"94a483153efcd9de222354647670fcdfb5a238cd43541c97596d69e4f7b9e043"}
Sep 17 01:47:30.528555 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:30.528521    2560 generic.go:356] "Generic (PLEG): container finished" podID="41c5ed13-c3df-42e2-846d-3a1cd7df0d00" containerID="d675ffb9aabbdc0a64fe4110cb905dc8457c6ce9e528271c5d335040d4b5efb9" exitCode=0
Sep 17 01:47:30.528674 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:30.528565    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t6dws"
Sep 17 01:47:30.528674 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:30.528612    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t6dws" event={"ID":"41c5ed13-c3df-42e2-846d-3a1cd7df0d00","Type":"ContainerDied","Data":"d675ffb9aabbdc0a64fe4110cb905dc8457c6ce9e528271c5d335040d4b5efb9"}
Sep 17 01:47:30.528674 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:30.528662    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t6dws" event={"ID":"41c5ed13-c3df-42e2-846d-3a1cd7df0d00","Type":"ContainerDied","Data":"989f08c0bb13c4969e30745267c4ac7140a72b33ce6322ffdd44d1f5f7c67c4f"}
Sep 17 01:47:30.528813 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:30.528684    2560 scope.go:117] "RemoveContainer" containerID="d675ffb9aabbdc0a64fe4110cb905dc8457c6ce9e528271c5d335040d4b5efb9"
Sep 17 01:47:30.537141 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:30.537115    2560 scope.go:117] "RemoveContainer" containerID="d675ffb9aabbdc0a64fe4110cb905dc8457c6ce9e528271c5d335040d4b5efb9"
Sep 17 01:47:30.537446 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:47:30.537420    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d675ffb9aabbdc0a64fe4110cb905dc8457c6ce9e528271c5d335040d4b5efb9\": container with ID starting with d675ffb9aabbdc0a64fe4110cb905dc8457c6ce9e528271c5d335040d4b5efb9 not found: ID does not exist" containerID="d675ffb9aabbdc0a64fe4110cb905dc8457c6ce9e528271c5d335040d4b5efb9"
Sep 17 01:47:30.537504 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:30.537445    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d675ffb9aabbdc0a64fe4110cb905dc8457c6ce9e528271c5d335040d4b5efb9"} err="failed to get container status \"d675ffb9aabbdc0a64fe4110cb905dc8457c6ce9e528271c5d335040d4b5efb9\": rpc error: code = NotFound desc = could not find container \"d675ffb9aabbdc0a64fe4110cb905dc8457c6ce9e528271c5d335040d4b5efb9\": container with ID starting with d675ffb9aabbdc0a64fe4110cb905dc8457c6ce9e528271c5d335040d4b5efb9 not found: ID does not exist"
Sep 17 01:47:30.550338 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:30.550297    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d65888898-7phm7" podStartSLOduration=1.550282715 podStartE2EDuration="1.550282715s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:47:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:47:30.548218242 +0000 UTC m=+608.798195548" watchObservedRunningTime="2026-09-17 01:47:30.550282715 +0000 UTC m=+608.800260029"
Sep 17 01:47:30.562720 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:30.562695    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t6dws"]
Sep 17 01:47:30.566734 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:30.566709    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t6dws"]
Sep 17 01:47:32.356601 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:32.356568    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41c5ed13-c3df-42e2-846d-3a1cd7df0d00" path="/var/lib/kubelet/pods/41c5ed13-c3df-42e2-846d-3a1cd7df0d00/volumes"
Sep 17 01:47:40.134109 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:40.134067    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d65888898-7phm7"
Sep 17 01:47:40.134752 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:40.134141    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d65888898-7phm7"
Sep 17 01:47:40.138576 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:40.138553    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d65888898-7phm7"
Sep 17 01:47:40.574540 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:40.574508    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d65888898-7phm7"
Sep 17 01:47:40.619178 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:47:40.619134    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6879f7bb68-q8c9m"]
Sep 17 01:48:05.643979 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:05.643892    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6879f7bb68-q8c9m" podUID="ca49a1de-828e-46ad-8a3e-e0e944be0bca" containerName="console" containerID="cri-o://b9c16dba9debdd78c089edde7e9819dbc37f7eb7743201ebb820cce59f57d811" gracePeriod=15
Sep 17 01:48:05.892174 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:05.892148    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6879f7bb68-q8c9m"
Sep 17 01:48:05.976768 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:05.976681    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ca49a1de-828e-46ad-8a3e-e0e944be0bca-oauth-serving-cert\") pod \"ca49a1de-828e-46ad-8a3e-e0e944be0bca\" (UID: \"ca49a1de-828e-46ad-8a3e-e0e944be0bca\") "
Sep 17 01:48:05.976768 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:05.976718    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ca49a1de-828e-46ad-8a3e-e0e944be0bca-console-config\") pod \"ca49a1de-828e-46ad-8a3e-e0e944be0bca\" (UID: \"ca49a1de-828e-46ad-8a3e-e0e944be0bca\") "
Sep 17 01:48:05.976768 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:05.976744    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca49a1de-828e-46ad-8a3e-e0e944be0bca-trusted-ca-bundle\") pod \"ca49a1de-828e-46ad-8a3e-e0e944be0bca\" (UID: \"ca49a1de-828e-46ad-8a3e-e0e944be0bca\") "
Sep 17 01:48:05.977038 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:05.976782    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pftjz\" (UniqueName: \"kubernetes.io/projected/ca49a1de-828e-46ad-8a3e-e0e944be0bca-kube-api-access-pftjz\") pod \"ca49a1de-828e-46ad-8a3e-e0e944be0bca\" (UID: \"ca49a1de-828e-46ad-8a3e-e0e944be0bca\") "
Sep 17 01:48:05.977038 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:05.976813    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ca49a1de-828e-46ad-8a3e-e0e944be0bca-console-serving-cert\") pod \"ca49a1de-828e-46ad-8a3e-e0e944be0bca\" (UID: \"ca49a1de-828e-46ad-8a3e-e0e944be0bca\") "
Sep 17 01:48:05.977038 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:05.976861    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ca49a1de-828e-46ad-8a3e-e0e944be0bca-console-oauth-config\") pod \"ca49a1de-828e-46ad-8a3e-e0e944be0bca\" (UID: \"ca49a1de-828e-46ad-8a3e-e0e944be0bca\") "
Sep 17 01:48:05.977038 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:05.976936    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ca49a1de-828e-46ad-8a3e-e0e944be0bca-service-ca\") pod \"ca49a1de-828e-46ad-8a3e-e0e944be0bca\" (UID: \"ca49a1de-828e-46ad-8a3e-e0e944be0bca\") "
Sep 17 01:48:05.977230 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:05.977165    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca49a1de-828e-46ad-8a3e-e0e944be0bca-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ca49a1de-828e-46ad-8a3e-e0e944be0bca" (UID: "ca49a1de-828e-46ad-8a3e-e0e944be0bca"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:48:05.977230 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:05.977194    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca49a1de-828e-46ad-8a3e-e0e944be0bca-console-config" (OuterVolumeSpecName: "console-config") pod "ca49a1de-828e-46ad-8a3e-e0e944be0bca" (UID: "ca49a1de-828e-46ad-8a3e-e0e944be0bca"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:48:05.977408 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:05.977386    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca49a1de-828e-46ad-8a3e-e0e944be0bca-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ca49a1de-828e-46ad-8a3e-e0e944be0bca" (UID: "ca49a1de-828e-46ad-8a3e-e0e944be0bca"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:48:05.977464 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:05.977429    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca49a1de-828e-46ad-8a3e-e0e944be0bca-service-ca" (OuterVolumeSpecName: "service-ca") pod "ca49a1de-828e-46ad-8a3e-e0e944be0bca" (UID: "ca49a1de-828e-46ad-8a3e-e0e944be0bca"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:48:05.979155 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:05.979121    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca49a1de-828e-46ad-8a3e-e0e944be0bca-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ca49a1de-828e-46ad-8a3e-e0e944be0bca" (UID: "ca49a1de-828e-46ad-8a3e-e0e944be0bca"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 01:48:05.979155 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:05.979135    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca49a1de-828e-46ad-8a3e-e0e944be0bca-kube-api-access-pftjz" (OuterVolumeSpecName: "kube-api-access-pftjz") pod "ca49a1de-828e-46ad-8a3e-e0e944be0bca" (UID: "ca49a1de-828e-46ad-8a3e-e0e944be0bca"). InnerVolumeSpecName "kube-api-access-pftjz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:48:05.979322 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:05.979204    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca49a1de-828e-46ad-8a3e-e0e944be0bca-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ca49a1de-828e-46ad-8a3e-e0e944be0bca" (UID: "ca49a1de-828e-46ad-8a3e-e0e944be0bca"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 01:48:06.078428 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:06.078395    2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ca49a1de-828e-46ad-8a3e-e0e944be0bca-oauth-serving-cert\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:48:06.078428 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:06.078422    2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ca49a1de-828e-46ad-8a3e-e0e944be0bca-console-config\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:48:06.078428 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:06.078432    2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca49a1de-828e-46ad-8a3e-e0e944be0bca-trusted-ca-bundle\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:48:06.078640 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:06.078440    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pftjz\" (UniqueName: \"kubernetes.io/projected/ca49a1de-828e-46ad-8a3e-e0e944be0bca-kube-api-access-pftjz\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:48:06.078640 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:06.078449    2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ca49a1de-828e-46ad-8a3e-e0e944be0bca-console-serving-cert\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:48:06.078640 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:06.078457    2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ca49a1de-828e-46ad-8a3e-e0e944be0bca-console-oauth-config\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:48:06.078640 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:06.078466    2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ca49a1de-828e-46ad-8a3e-e0e944be0bca-service-ca\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:48:06.678796 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:06.678703    2560 generic.go:356] "Generic (PLEG): container finished" podID="ca49a1de-828e-46ad-8a3e-e0e944be0bca" containerID="b9c16dba9debdd78c089edde7e9819dbc37f7eb7743201ebb820cce59f57d811" exitCode=0
Sep 17 01:48:06.678796 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:06.678767    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6879f7bb68-q8c9m"
Sep 17 01:48:06.678796 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:06.678786    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6879f7bb68-q8c9m" event={"ID":"ca49a1de-828e-46ad-8a3e-e0e944be0bca","Type":"ContainerDied","Data":"b9c16dba9debdd78c089edde7e9819dbc37f7eb7743201ebb820cce59f57d811"}
Sep 17 01:48:06.679330 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:06.678844    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6879f7bb68-q8c9m" event={"ID":"ca49a1de-828e-46ad-8a3e-e0e944be0bca","Type":"ContainerDied","Data":"a5d93f2cc5e8cdc277d9fdadac4c6cb678fb24cd6a9c9bafc623c1c1262367b0"}
Sep 17 01:48:06.679330 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:06.678871    2560 scope.go:117] "RemoveContainer" containerID="b9c16dba9debdd78c089edde7e9819dbc37f7eb7743201ebb820cce59f57d811"
Sep 17 01:48:06.688526 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:06.688500    2560 scope.go:117] "RemoveContainer" containerID="b9c16dba9debdd78c089edde7e9819dbc37f7eb7743201ebb820cce59f57d811"
Sep 17 01:48:06.688878 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:48:06.688849    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9c16dba9debdd78c089edde7e9819dbc37f7eb7743201ebb820cce59f57d811\": container with ID starting with b9c16dba9debdd78c089edde7e9819dbc37f7eb7743201ebb820cce59f57d811 not found: ID does not exist" containerID="b9c16dba9debdd78c089edde7e9819dbc37f7eb7743201ebb820cce59f57d811"
Sep 17 01:48:06.688951 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:06.688886    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9c16dba9debdd78c089edde7e9819dbc37f7eb7743201ebb820cce59f57d811"} err="failed to get container status \"b9c16dba9debdd78c089edde7e9819dbc37f7eb7743201ebb820cce59f57d811\": rpc error: code = NotFound desc = could not find container \"b9c16dba9debdd78c089edde7e9819dbc37f7eb7743201ebb820cce59f57d811\": container with ID starting with b9c16dba9debdd78c089edde7e9819dbc37f7eb7743201ebb820cce59f57d811 not found: ID does not exist"
Sep 17 01:48:06.692323 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:06.692297    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6879f7bb68-q8c9m"]
Sep 17 01:48:06.693378 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:06.693359    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6879f7bb68-q8c9m"]
Sep 17 01:48:08.356238 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:08.356203    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca49a1de-828e-46ad-8a3e-e0e944be0bca" path="/var/lib/kubelet/pods/ca49a1de-828e-46ad-8a3e-e0e944be0bca/volumes"
Sep 17 01:48:41.771136 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:41.771097    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-djpdm"]
Sep 17 01:48:41.771730 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:41.771500    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca49a1de-828e-46ad-8a3e-e0e944be0bca" containerName="console"
Sep 17 01:48:41.771730 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:41.771518    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca49a1de-828e-46ad-8a3e-e0e944be0bca" containerName="console"
Sep 17 01:48:41.771730 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:41.771550    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41c5ed13-c3df-42e2-846d-3a1cd7df0d00" containerName="discovery"
Sep 17 01:48:41.771730 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:41.771558    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="41c5ed13-c3df-42e2-846d-3a1cd7df0d00" containerName="discovery"
Sep 17 01:48:41.771730 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:41.771626    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="41c5ed13-c3df-42e2-846d-3a1cd7df0d00" containerName="discovery"
Sep 17 01:48:41.771730 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:41.771637    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca49a1de-828e-46ad-8a3e-e0e944be0bca" containerName="console"
Sep 17 01:48:41.775961 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:41.775940    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-djpdm"
Sep 17 01:48:41.777599 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:41.777580    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 17 01:48:41.777742 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:41.777722    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-jf26l\""
Sep 17 01:48:41.777823 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:41.777806    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 17 01:48:41.784023 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:41.784000    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-djpdm"]
Sep 17 01:48:41.856168 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:41.856131    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtwv5\" (UniqueName: \"kubernetes.io/projected/5bfe3778-76bf-44c5-8404-1a70b45dcedf-kube-api-access-rtwv5\") pod \"authorino-operator-76b478bd78-djpdm\" (UID: \"5bfe3778-76bf-44c5-8404-1a70b45dcedf\") " pod="kuadrant-system/authorino-operator-76b478bd78-djpdm"
Sep 17 01:48:41.957594 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:41.957548    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtwv5\" (UniqueName: \"kubernetes.io/projected/5bfe3778-76bf-44c5-8404-1a70b45dcedf-kube-api-access-rtwv5\") pod \"authorino-operator-76b478bd78-djpdm\" (UID: \"5bfe3778-76bf-44c5-8404-1a70b45dcedf\") " pod="kuadrant-system/authorino-operator-76b478bd78-djpdm"
Sep 17 01:48:41.965365 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:41.965328    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtwv5\" (UniqueName: \"kubernetes.io/projected/5bfe3778-76bf-44c5-8404-1a70b45dcedf-kube-api-access-rtwv5\") pod \"authorino-operator-76b478bd78-djpdm\" (UID: \"5bfe3778-76bf-44c5-8404-1a70b45dcedf\") " pod="kuadrant-system/authorino-operator-76b478bd78-djpdm"
Sep 17 01:48:42.086681 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:42.086652    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-djpdm"
Sep 17 01:48:42.356717 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:42.356688    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-djpdm"]
Sep 17 01:48:42.357486 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:48:42.357462    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bfe3778_76bf_44c5_8404_1a70b45dcedf.slice/crio-d1f5934a0735a21a2283c515b41211cd85efc705904c38a47fb0871bf765e912 WatchSource:0}: Error finding container d1f5934a0735a21a2283c515b41211cd85efc705904c38a47fb0871bf765e912: Status 404 returned error can't find the container with id d1f5934a0735a21a2283c515b41211cd85efc705904c38a47fb0871bf765e912
Sep 17 01:48:42.359540 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:42.359518    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 01:48:42.828611 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:42.828575    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-djpdm" event={"ID":"5bfe3778-76bf-44c5-8404-1a70b45dcedf","Type":"ContainerStarted","Data":"d1f5934a0735a21a2283c515b41211cd85efc705904c38a47fb0871bf765e912"}
Sep 17 01:48:44.797090 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:44.797066    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-xvtnm"]
Sep 17 01:48:44.801464 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:44.801445    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-xvtnm"
Sep 17 01:48:44.803164 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:44.803145    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-z9tkx\""
Sep 17 01:48:44.803238 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:44.803145    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 17 01:48:44.811028 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:44.811004    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-xvtnm"]
Sep 17 01:48:44.882391 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:44.882358    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnwgz\" (UniqueName: \"kubernetes.io/projected/19e326d8-2308-4845-8737-4781a3737762-kube-api-access-xnwgz\") pod \"dns-operator-controller-manager-7b84cd7c9c-xvtnm\" (UID: \"19e326d8-2308-4845-8737-4781a3737762\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-xvtnm"
Sep 17 01:48:44.983703 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:44.983664    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnwgz\" (UniqueName: \"kubernetes.io/projected/19e326d8-2308-4845-8737-4781a3737762-kube-api-access-xnwgz\") pod \"dns-operator-controller-manager-7b84cd7c9c-xvtnm\" (UID: \"19e326d8-2308-4845-8737-4781a3737762\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-xvtnm"
Sep 17 01:48:44.992602 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:44.992572    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnwgz\" (UniqueName: \"kubernetes.io/projected/19e326d8-2308-4845-8737-4781a3737762-kube-api-access-xnwgz\") pod \"dns-operator-controller-manager-7b84cd7c9c-xvtnm\" (UID: \"19e326d8-2308-4845-8737-4781a3737762\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-xvtnm"
Sep 17 01:48:45.127609 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:45.127561    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-xvtnm"
Sep 17 01:48:45.426792 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:45.426717    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-xvtnm"]
Sep 17 01:48:45.429919 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:48:45.429894    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19e326d8_2308_4845_8737_4781a3737762.slice/crio-94bdb421334e483dadc977b001173849f1d10c46c484385da83560b9d7aa63f2 WatchSource:0}: Error finding container 94bdb421334e483dadc977b001173849f1d10c46c484385da83560b9d7aa63f2: Status 404 returned error can't find the container with id 94bdb421334e483dadc977b001173849f1d10c46c484385da83560b9d7aa63f2
Sep 17 01:48:45.844713 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:45.844675    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-xvtnm" event={"ID":"19e326d8-2308-4845-8737-4781a3737762","Type":"ContainerStarted","Data":"94bdb421334e483dadc977b001173849f1d10c46c484385da83560b9d7aa63f2"}
Sep 17 01:48:45.846343 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:45.846304    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-djpdm" event={"ID":"5bfe3778-76bf-44c5-8404-1a70b45dcedf","Type":"ContainerStarted","Data":"d12554c7e7294483a2213607bdb9bffc1c54c1aa9ef1579b271a52069344956a"}
Sep 17 01:48:45.846479 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:45.846432    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-djpdm"
Sep 17 01:48:45.868340 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:45.868280    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-djpdm" podStartSLOduration=2.452055776 podStartE2EDuration="4.868221704s" totalImagesPullingTime="2.416165928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:48:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:48:45.868119186 +0000 UTC m=+684.118096499" watchObservedRunningTime="2026-09-17 01:48:45.868221704 +0000 UTC m=+684.118199016"
Sep 17 01:48:47.856938 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:47.856906    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-xvtnm" event={"ID":"19e326d8-2308-4845-8737-4781a3737762","Type":"ContainerStarted","Data":"1723d4a30e839d1369df8e76611dbadeed9c38ffb4ac3aa99addabae37546740"}
Sep 17 01:48:47.857339 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:47.857032    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-xvtnm"
Sep 17 01:48:48.069580 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:48.069526    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-xvtnm" podStartSLOduration=2.108808305 podStartE2EDuration="4.069508102s" totalImagesPullingTime="1.960699797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:48:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:48:47.894045593 +0000 UTC m=+686.144022909" watchObservedRunningTime="2026-09-17 01:48:48.069508102 +0000 UTC m=+686.319485415"
Sep 17 01:48:48.069822 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:48.069808    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-gmrwv"]
Sep 17 01:48:48.072827 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:48.072812    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gmrwv"
Sep 17 01:48:48.075387 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:48.075365    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-js8g4\""
Sep 17 01:48:48.087230 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:48.087210    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-gmrwv"]
Sep 17 01:48:48.111460 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:48.111376    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnt26\" (UniqueName: \"kubernetes.io/projected/4d43577d-a703-459c-bcbf-eed39dbc3cf8-kube-api-access-bnt26\") pod \"limitador-operator-controller-manager-74495c69f8-gmrwv\" (UID: \"4d43577d-a703-459c-bcbf-eed39dbc3cf8\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gmrwv"
Sep 17 01:48:48.212180 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:48.212141    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnt26\" (UniqueName: \"kubernetes.io/projected/4d43577d-a703-459c-bcbf-eed39dbc3cf8-kube-api-access-bnt26\") pod \"limitador-operator-controller-manager-74495c69f8-gmrwv\" (UID: \"4d43577d-a703-459c-bcbf-eed39dbc3cf8\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gmrwv"
Sep 17 01:48:48.221468 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:48.221445    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnt26\" (UniqueName: \"kubernetes.io/projected/4d43577d-a703-459c-bcbf-eed39dbc3cf8-kube-api-access-bnt26\") pod \"limitador-operator-controller-manager-74495c69f8-gmrwv\" (UID: \"4d43577d-a703-459c-bcbf-eed39dbc3cf8\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gmrwv"
Sep 17 01:48:48.382970 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:48.382885    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gmrwv"
Sep 17 01:48:48.670599 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:48.670350    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-gmrwv"]
Sep 17 01:48:48.678420 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:48:48.678386    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d43577d_a703_459c_bcbf_eed39dbc3cf8.slice/crio-66ec6a59195bf07f5fdacd0e28356d95fcccf43e07f0a7266009ab5522f62190 WatchSource:0}: Error finding container 66ec6a59195bf07f5fdacd0e28356d95fcccf43e07f0a7266009ab5522f62190: Status 404 returned error can't find the container with id 66ec6a59195bf07f5fdacd0e28356d95fcccf43e07f0a7266009ab5522f62190
Sep 17 01:48:48.862790 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:48.862755    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gmrwv" event={"ID":"4d43577d-a703-459c-bcbf-eed39dbc3cf8","Type":"ContainerStarted","Data":"66ec6a59195bf07f5fdacd0e28356d95fcccf43e07f0a7266009ab5522f62190"}
Sep 17 01:48:51.877097 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:51.877060    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gmrwv" event={"ID":"4d43577d-a703-459c-bcbf-eed39dbc3cf8","Type":"ContainerStarted","Data":"36b73eadc1a5d6d0819eb4d7e8a4135e67997efdca52acd15bb66c9030ad1e66"}
Sep 17 01:48:51.877504 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:51.877230    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gmrwv"
Sep 17 01:48:51.905446 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:51.905398    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gmrwv" podStartSLOduration=1.70911063 podStartE2EDuration="3.905382869s" totalImagesPullingTime="2.196272239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:48:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:48:51.903323902 +0000 UTC m=+690.153301214" watchObservedRunningTime="2026-09-17 01:48:51.905382869 +0000 UTC m=+690.155360182"
Sep 17 01:48:56.853398 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:56.853362    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-djpdm"
Sep 17 01:48:58.865808 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:48:58.865779    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-xvtnm"
Sep 17 01:49:02.884642 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:49:02.884612    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gmrwv"
Sep 17 01:49:18.730570 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:49:18.730537    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-gmrwv"]
Sep 17 01:49:18.731297 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:49:18.730757    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gmrwv" podUID="4d43577d-a703-459c-bcbf-eed39dbc3cf8" containerName="manager" containerID="cri-o://36b73eadc1a5d6d0819eb4d7e8a4135e67997efdca52acd15bb66c9030ad1e66" gracePeriod=2
Sep 17 01:49:18.744062 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:49:18.744031    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-gmrwv"]
Sep 17 01:49:18.753423 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:49:18.753392    2560 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"4d43577d-a703-459c-bcbf-eed39dbc3cf8\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-74495c69f8-gmrwv\": pods \"limitador-operator-controller-manager-74495c69f8-gmrwv\" not found" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gmrwv"
Sep 17 01:49:18.758538 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:49:18.758517    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-f66rn"]
Sep 17 01:49:18.758818 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:49:18.758807    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d43577d-a703-459c-bcbf-eed39dbc3cf8" containerName="manager"
Sep 17 01:49:18.758858 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:49:18.758820    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d43577d-a703-459c-bcbf-eed39dbc3cf8" containerName="manager"
Sep 17 01:49:18.758891 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:49:18.758874    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d43577d-a703-459c-bcbf-eed39dbc3cf8" containerName="manager"
Sep 17 01:49:18.761351 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:49:18.761329    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f66rn"
Sep 17 01:49:18.774081 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:49:18.774058    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-f66rn"]
Sep 17 01:49:18.797035 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:49:18.797000    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-gmrwv\" is forbidden: User \"system:node:ip-10-0-143-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-95.ec2.internal' and this object" podUID="4d43577d-a703-459c-bcbf-eed39dbc3cf8" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gmrwv"
Sep 17 01:49:18.869418 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:49:18.869344    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvk7t\" (UniqueName: \"kubernetes.io/projected/9bed9aca-ba37-4d87-9c44-af1c80b5da08-kube-api-access-wvk7t\") pod \"limitador-operator-controller-manager-74495c69f8-f66rn\" (UID: \"9bed9aca-ba37-4d87-9c44-af1c80b5da08\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f66rn"
Sep 17 01:49:18.967450 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:49:18.967426    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gmrwv"
Sep 17 01:49:18.969063 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:49:18.969036    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-gmrwv\" is forbidden: User \"system:node:ip-10-0-143-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-95.ec2.internal' and this object" podUID="4d43577d-a703-459c-bcbf-eed39dbc3cf8" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gmrwv"
Sep 17 01:49:18.970391 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:49:18.970371    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvk7t\" (UniqueName: \"kubernetes.io/projected/9bed9aca-ba37-4d87-9c44-af1c80b5da08-kube-api-access-wvk7t\") pod \"limitador-operator-controller-manager-74495c69f8-f66rn\" (UID: \"9bed9aca-ba37-4d87-9c44-af1c80b5da08\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f66rn"
Sep 17 01:49:18.980505 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:49:18.980481    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvk7t\" (UniqueName: \"kubernetes.io/projected/9bed9aca-ba37-4d87-9c44-af1c80b5da08-kube-api-access-wvk7t\") pod \"limitador-operator-controller-manager-74495c69f8-f66rn\" (UID: \"9bed9aca-ba37-4d87-9c44-af1c80b5da08\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f66rn"
Sep 17 01:49:18.992674 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:49:18.992616    2560 generic.go:356] "Generic (PLEG): container finished" podID="4d43577d-a703-459c-bcbf-eed39dbc3cf8" containerID="36b73eadc1a5d6d0819eb4d7e8a4135e67997efdca52acd15bb66c9030ad1e66" exitCode=0
Sep 17 01:49:18.992674 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:49:18.992658    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gmrwv"
Sep 17 01:49:18.992789 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:49:18.992702    2560 scope.go:117] "RemoveContainer" containerID="36b73eadc1a5d6d0819eb4d7e8a4135e67997efdca52acd15bb66c9030ad1e66"
Sep 17 01:49:18.994427 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:49:18.994401    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-gmrwv\" is forbidden: User \"system:node:ip-10-0-143-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-95.ec2.internal' and this object" podUID="4d43577d-a703-459c-bcbf-eed39dbc3cf8" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gmrwv"
Sep 17 01:49:19.000191 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:49:19.000166    2560 scope.go:117] "RemoveContainer" containerID="36b73eadc1a5d6d0819eb4d7e8a4135e67997efdca52acd15bb66c9030ad1e66"
Sep 17 01:49:19.000477 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:49:19.000461    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36b73eadc1a5d6d0819eb4d7e8a4135e67997efdca52acd15bb66c9030ad1e66\": container with ID starting with 36b73eadc1a5d6d0819eb4d7e8a4135e67997efdca52acd15bb66c9030ad1e66 not found: ID does not exist" containerID="36b73eadc1a5d6d0819eb4d7e8a4135e67997efdca52acd15bb66c9030ad1e66"
Sep 17 01:49:19.000543 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:49:19.000485    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36b73eadc1a5d6d0819eb4d7e8a4135e67997efdca52acd15bb66c9030ad1e66"} err="failed to get container status \"36b73eadc1a5d6d0819eb4d7e8a4135e67997efdca52acd15bb66c9030ad1e66\": rpc error: code = NotFound desc = could not find container \"36b73eadc1a5d6d0819eb4d7e8a4135e67997efdca52acd15bb66c9030ad1e66\": container with ID starting with 36b73eadc1a5d6d0819eb4d7e8a4135e67997efdca52acd15bb66c9030ad1e66 not found: ID does not exist"
Sep 17 01:49:19.071270 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:49:19.071210    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bnt26\" (UniqueName: \"kubernetes.io/projected/4d43577d-a703-459c-bcbf-eed39dbc3cf8-kube-api-access-bnt26\") pod \"4d43577d-a703-459c-bcbf-eed39dbc3cf8\" (UID: \"4d43577d-a703-459c-bcbf-eed39dbc3cf8\") "
Sep 17 01:49:19.073384 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:49:19.073360    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d43577d-a703-459c-bcbf-eed39dbc3cf8-kube-api-access-bnt26" (OuterVolumeSpecName: "kube-api-access-bnt26") pod "4d43577d-a703-459c-bcbf-eed39dbc3cf8" (UID: "4d43577d-a703-459c-bcbf-eed39dbc3cf8"). InnerVolumeSpecName "kube-api-access-bnt26". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:49:19.114828 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:49:19.114792    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f66rn"
Sep 17 01:49:19.172801 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:49:19.172775    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bnt26\" (UniqueName: \"kubernetes.io/projected/4d43577d-a703-459c-bcbf-eed39dbc3cf8-kube-api-access-bnt26\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:49:19.302840 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:49:19.302809    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-gmrwv\" is forbidden: User \"system:node:ip-10-0-143-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-95.ec2.internal' and this object" podUID="4d43577d-a703-459c-bcbf-eed39dbc3cf8" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gmrwv"
Sep 17 01:49:19.388548 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:49:19.388521    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-f66rn"]
Sep 17 01:49:19.391267 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:49:19.391226    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bed9aca_ba37_4d87_9c44_af1c80b5da08.slice/crio-14432b532cb918a9ae0752be769f7cda7de883f4fa946af5c6820c2a5ef0ba98 WatchSource:0}: Error finding container 14432b532cb918a9ae0752be769f7cda7de883f4fa946af5c6820c2a5ef0ba98: Status 404 returned error can't find the container with id 14432b532cb918a9ae0752be769f7cda7de883f4fa946af5c6820c2a5ef0ba98
Sep 17 01:49:19.998960 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:49:19.998924    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f66rn" event={"ID":"9bed9aca-ba37-4d87-9c44-af1c80b5da08","Type":"ContainerStarted","Data":"2d644dd9555374487d832d59cf03073c0b40c86b681f7460a46a845be62fe09c"}
Sep 17 01:49:19.999415 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:49:19.999006    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f66rn" event={"ID":"9bed9aca-ba37-4d87-9c44-af1c80b5da08","Type":"ContainerStarted","Data":"14432b532cb918a9ae0752be769f7cda7de883f4fa946af5c6820c2a5ef0ba98"}
Sep 17 01:49:19.999415 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:49:19.999054    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f66rn"
Sep 17 01:49:20.020022 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:49:20.019969    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f66rn" podStartSLOduration=2.019952668 podStartE2EDuration="2.019952668s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:49:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:49:20.018586543 +0000 UTC m=+718.268563856" watchObservedRunningTime="2026-09-17 01:49:20.019952668 +0000 UTC m=+718.269929981"
Sep 17 01:49:20.020171 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:49:20.020071    2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-gmrwv\" is forbidden: User \"system:node:ip-10-0-143-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-95.ec2.internal' and this object" podUID="4d43577d-a703-459c-bcbf-eed39dbc3cf8" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-gmrwv"
Sep 17 01:49:20.356332 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:49:20.356301    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d43577d-a703-459c-bcbf-eed39dbc3cf8" path="/var/lib/kubelet/pods/4d43577d-a703-459c-bcbf-eed39dbc3cf8/volumes"
Sep 17 01:49:31.006368 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:49:31.006338    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-f66rn"
Sep 17 01:49:59.666644 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:49:59.666612    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-vjg4g"]
Sep 17 01:49:59.669995 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:49:59.669970    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-vjg4g"
Sep 17 01:49:59.671748 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:49:59.671722    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 17 01:49:59.671867 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:49:59.671727    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6khtx\""
Sep 17 01:49:59.679922 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:49:59.679902    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-vjg4g"]
Sep 17 01:49:59.766922 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:49:59.766884    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-vjg4g"]
Sep 17 01:49:59.809904 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:49:59.809872    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gg4b4\" (UniqueName: \"kubernetes.io/projected/8e8e9165-7f17-4467-b443-92c797855dc1-kube-api-access-gg4b4\") pod \"limitador-limitador-8588749977-vjg4g\" (UID: \"8e8e9165-7f17-4467-b443-92c797855dc1\") " pod="kuadrant-system/limitador-limitador-8588749977-vjg4g"
Sep 17 01:49:59.810074 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:49:59.809939    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8e8e9165-7f17-4467-b443-92c797855dc1-config-file\") pod \"limitador-limitador-8588749977-vjg4g\" (UID: \"8e8e9165-7f17-4467-b443-92c797855dc1\") " pod="kuadrant-system/limitador-limitador-8588749977-vjg4g"
Sep 17 01:49:59.910969 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:49:59.910929    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8e8e9165-7f17-4467-b443-92c797855dc1-config-file\") pod \"limitador-limitador-8588749977-vjg4g\" (UID: \"8e8e9165-7f17-4467-b443-92c797855dc1\") " pod="kuadrant-system/limitador-limitador-8588749977-vjg4g"
Sep 17 01:49:59.911148 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:49:59.911000    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gg4b4\" (UniqueName: \"kubernetes.io/projected/8e8e9165-7f17-4467-b443-92c797855dc1-kube-api-access-gg4b4\") pod \"limitador-limitador-8588749977-vjg4g\" (UID: \"8e8e9165-7f17-4467-b443-92c797855dc1\") " pod="kuadrant-system/limitador-limitador-8588749977-vjg4g"
Sep 17 01:49:59.911570 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:49:59.911549    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8e8e9165-7f17-4467-b443-92c797855dc1-config-file\") pod \"limitador-limitador-8588749977-vjg4g\" (UID: \"8e8e9165-7f17-4467-b443-92c797855dc1\") " pod="kuadrant-system/limitador-limitador-8588749977-vjg4g"
Sep 17 01:49:59.918426 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:49:59.918375    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gg4b4\" (UniqueName: \"kubernetes.io/projected/8e8e9165-7f17-4467-b443-92c797855dc1-kube-api-access-gg4b4\") pod \"limitador-limitador-8588749977-vjg4g\" (UID: \"8e8e9165-7f17-4467-b443-92c797855dc1\") " pod="kuadrant-system/limitador-limitador-8588749977-vjg4g"
Sep 17 01:49:59.980376 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:49:59.980341    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-vjg4g"
Sep 17 01:50:00.249088 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:00.249034    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-vjg4g"]
Sep 17 01:50:00.251660 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:50:00.251632    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e8e9165_7f17_4467_b443_92c797855dc1.slice/crio-442a96e8fef1c841b5e29b814481789ccefa6b9445504f195757445b50ac9034 WatchSource:0}: Error finding container 442a96e8fef1c841b5e29b814481789ccefa6b9445504f195757445b50ac9034: Status 404 returned error can't find the container with id 442a96e8fef1c841b5e29b814481789ccefa6b9445504f195757445b50ac9034
Sep 17 01:50:01.169966 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:01.169930    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-vjg4g" event={"ID":"8e8e9165-7f17-4467-b443-92c797855dc1","Type":"ContainerStarted","Data":"442a96e8fef1c841b5e29b814481789ccefa6b9445504f195757445b50ac9034"}
Sep 17 01:50:02.175270 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:02.175217    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-vjg4g" event={"ID":"8e8e9165-7f17-4467-b443-92c797855dc1","Type":"ContainerStarted","Data":"4c490e6d263b9fce99057e07d1ecbf7134d5598ed0b2f89f6a02e9c5cc05ed93"}
Sep 17 01:50:02.175673 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:02.175368    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-vjg4g"
Sep 17 01:50:02.189649 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:02.189598    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-vjg4g" podStartSLOduration=1.9232614209999999 podStartE2EDuration="3.18958406s" totalImagesPullingTime="1.266322639s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:49:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:50:02.188574165 +0000 UTC m=+760.438551480" watchObservedRunningTime="2026-09-17 01:50:02.18958406 +0000 UTC m=+760.439561372"
Sep 17 01:50:12.729968 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:12.729928    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-vjg4g"]
Sep 17 01:50:12.730473 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:12.730120    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-vjg4g" podUID="8e8e9165-7f17-4467-b443-92c797855dc1" containerName="limitador" containerID="cri-o://4c490e6d263b9fce99057e07d1ecbf7134d5598ed0b2f89f6a02e9c5cc05ed93" gracePeriod=30
Sep 17 01:50:12.730864 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:12.730756    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-vjg4g"
Sep 17 01:50:13.221571 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:13.221531    2560 generic.go:356] "Generic (PLEG): container finished" podID="8e8e9165-7f17-4467-b443-92c797855dc1" containerID="4c490e6d263b9fce99057e07d1ecbf7134d5598ed0b2f89f6a02e9c5cc05ed93" exitCode=0
Sep 17 01:50:13.221740 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:13.221601    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-vjg4g" event={"ID":"8e8e9165-7f17-4467-b443-92c797855dc1","Type":"ContainerDied","Data":"4c490e6d263b9fce99057e07d1ecbf7134d5598ed0b2f89f6a02e9c5cc05ed93"}
Sep 17 01:50:13.662837 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:13.662808    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-vjg4g"
Sep 17 01:50:13.828746 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:13.828707    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gg4b4\" (UniqueName: \"kubernetes.io/projected/8e8e9165-7f17-4467-b443-92c797855dc1-kube-api-access-gg4b4\") pod \"8e8e9165-7f17-4467-b443-92c797855dc1\" (UID: \"8e8e9165-7f17-4467-b443-92c797855dc1\") "
Sep 17 01:50:13.829176 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:13.828795    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8e8e9165-7f17-4467-b443-92c797855dc1-config-file\") pod \"8e8e9165-7f17-4467-b443-92c797855dc1\" (UID: \"8e8e9165-7f17-4467-b443-92c797855dc1\") "
Sep 17 01:50:13.829176 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:13.829134    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e8e9165-7f17-4467-b443-92c797855dc1-config-file" (OuterVolumeSpecName: "config-file") pod "8e8e9165-7f17-4467-b443-92c797855dc1" (UID: "8e8e9165-7f17-4467-b443-92c797855dc1"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:50:13.830808 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:13.830783    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e8e9165-7f17-4467-b443-92c797855dc1-kube-api-access-gg4b4" (OuterVolumeSpecName: "kube-api-access-gg4b4") pod "8e8e9165-7f17-4467-b443-92c797855dc1" (UID: "8e8e9165-7f17-4467-b443-92c797855dc1"). InnerVolumeSpecName "kube-api-access-gg4b4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:50:13.930326 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:13.930291    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gg4b4\" (UniqueName: \"kubernetes.io/projected/8e8e9165-7f17-4467-b443-92c797855dc1-kube-api-access-gg4b4\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:50:13.930326 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:13.930322    2560 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8e8e9165-7f17-4467-b443-92c797855dc1-config-file\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:50:14.226869 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:14.226784    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-vjg4g"
Sep 17 01:50:14.227055 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:14.226789    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-vjg4g" event={"ID":"8e8e9165-7f17-4467-b443-92c797855dc1","Type":"ContainerDied","Data":"442a96e8fef1c841b5e29b814481789ccefa6b9445504f195757445b50ac9034"}
Sep 17 01:50:14.227055 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:14.226934    2560 scope.go:117] "RemoveContainer" containerID="4c490e6d263b9fce99057e07d1ecbf7134d5598ed0b2f89f6a02e9c5cc05ed93"
Sep 17 01:50:14.245788 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:14.245763    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-vjg4g"]
Sep 17 01:50:14.251825 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:14.251804    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-vjg4g"]
Sep 17 01:50:14.355873 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:14.355841    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e8e9165-7f17-4467-b443-92c797855dc1" path="/var/lib/kubelet/pods/8e8e9165-7f17-4467-b443-92c797855dc1/volumes"
Sep 17 01:50:16.959371 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:16.959336    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-bx4j7"]
Sep 17 01:50:16.959739 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:16.959626    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e8e9165-7f17-4467-b443-92c797855dc1" containerName="limitador"
Sep 17 01:50:16.959739 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:16.959642    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e8e9165-7f17-4467-b443-92c797855dc1" containerName="limitador"
Sep 17 01:50:16.959739 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:16.959710    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e8e9165-7f17-4467-b443-92c797855dc1" containerName="limitador"
Sep 17 01:50:16.963898 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:16.963878    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-bx4j7"
Sep 17 01:50:16.965711 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:16.965680    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 17 01:50:16.965836 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:16.965753    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 17 01:50:16.966051 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:16.966034    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-4tzl9\""
Sep 17 01:50:16.966103 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:16.966042    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 17 01:50:16.971079 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:16.970873    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-bx4j7"]
Sep 17 01:50:17.155955 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:17.155915    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mddh4\" (UniqueName: \"kubernetes.io/projected/c715deb0-ecaa-4e96-8321-27f2ff52c7a9-kube-api-access-mddh4\") pod \"postgres-69fb4594cf-bx4j7\" (UID: \"c715deb0-ecaa-4e96-8321-27f2ff52c7a9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-bx4j7"
Sep 17 01:50:17.156133 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:17.155986    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c715deb0-ecaa-4e96-8321-27f2ff52c7a9-data\") pod \"postgres-69fb4594cf-bx4j7\" (UID: \"c715deb0-ecaa-4e96-8321-27f2ff52c7a9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-bx4j7"
Sep 17 01:50:17.257112 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:17.257023    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mddh4\" (UniqueName: \"kubernetes.io/projected/c715deb0-ecaa-4e96-8321-27f2ff52c7a9-kube-api-access-mddh4\") pod \"postgres-69fb4594cf-bx4j7\" (UID: \"c715deb0-ecaa-4e96-8321-27f2ff52c7a9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-bx4j7"
Sep 17 01:50:17.257112 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:17.257088    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c715deb0-ecaa-4e96-8321-27f2ff52c7a9-data\") pod \"postgres-69fb4594cf-bx4j7\" (UID: \"c715deb0-ecaa-4e96-8321-27f2ff52c7a9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-bx4j7"
Sep 17 01:50:17.257470 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:17.257453    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c715deb0-ecaa-4e96-8321-27f2ff52c7a9-data\") pod \"postgres-69fb4594cf-bx4j7\" (UID: \"c715deb0-ecaa-4e96-8321-27f2ff52c7a9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-bx4j7"
Sep 17 01:50:17.264227 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:17.264203    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mddh4\" (UniqueName: \"kubernetes.io/projected/c715deb0-ecaa-4e96-8321-27f2ff52c7a9-kube-api-access-mddh4\") pod \"postgres-69fb4594cf-bx4j7\" (UID: \"c715deb0-ecaa-4e96-8321-27f2ff52c7a9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-bx4j7"
Sep 17 01:50:17.275045 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:17.275025    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-bx4j7"
Sep 17 01:50:17.543923 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:17.543845    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-bx4j7"]
Sep 17 01:50:17.547014 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:50:17.546977    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc715deb0_ecaa_4e96_8321_27f2ff52c7a9.slice/crio-14d15632fbb308faaf1eaeef389815784d0ffa1ad4d5fb63eb561edc4238b38b WatchSource:0}: Error finding container 14d15632fbb308faaf1eaeef389815784d0ffa1ad4d5fb63eb561edc4238b38b: Status 404 returned error can't find the container with id 14d15632fbb308faaf1eaeef389815784d0ffa1ad4d5fb63eb561edc4238b38b
Sep 17 01:50:18.245405 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:18.245371    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-bx4j7" event={"ID":"c715deb0-ecaa-4e96-8321-27f2ff52c7a9","Type":"ContainerStarted","Data":"14d15632fbb308faaf1eaeef389815784d0ffa1ad4d5fb63eb561edc4238b38b"}
Sep 17 01:50:22.379650 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:22.379627    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 17 01:50:23.271614 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:23.271578    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-bx4j7" event={"ID":"c715deb0-ecaa-4e96-8321-27f2ff52c7a9","Type":"ContainerStarted","Data":"a2e5f1c150a47a4f86662d67f0e68bedaa6178ba15ff7912a057f738cc325a35"}
Sep 17 01:50:23.271770 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:23.271704    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-bx4j7"
Sep 17 01:50:23.285628 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:23.285570    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-bx4j7" podStartSLOduration=2.456717797 podStartE2EDuration="7.285559458s" totalImagesPullingTime="4.828841661s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:50:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:50:23.285088999 +0000 UTC m=+781.535066312" watchObservedRunningTime="2026-09-17 01:50:23.285559458 +0000 UTC m=+781.535536770"
Sep 17 01:50:29.304088 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:29.304057    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-bx4j7"
Sep 17 01:50:36.236607 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:36.236577    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-8vwxd"]
Sep 17 01:50:36.261149 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:36.261114    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-8vwxd"]
Sep 17 01:50:36.261311 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:36.261166    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75dc6cbdf-8vwxd"
Sep 17 01:50:36.264012 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:36.263987    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 17 01:50:36.264012 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:36.264007    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-28j7d\""
Sep 17 01:50:36.264199 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:36.263990    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 17 01:50:36.264199 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:36.264031    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 17 01:50:36.301986 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:36.301938    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4r2p\" (UniqueName: \"kubernetes.io/projected/4cbde737-083f-4d62-9e1a-19c67b94fa03-kube-api-access-r4r2p\") pod \"maas-controller-75dc6cbdf-8vwxd\" (UID: \"4cbde737-083f-4d62-9e1a-19c67b94fa03\") " pod="opendatahub/maas-controller-75dc6cbdf-8vwxd"
Sep 17 01:50:36.301986 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:36.301979    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4cbde737-083f-4d62-9e1a-19c67b94fa03-metrics-certs\") pod \"maas-controller-75dc6cbdf-8vwxd\" (UID: \"4cbde737-083f-4d62-9e1a-19c67b94fa03\") " pod="opendatahub/maas-controller-75dc6cbdf-8vwxd"
Sep 17 01:50:36.302210 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:36.302046    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4cbde737-083f-4d62-9e1a-19c67b94fa03-webhook-cert\") pod \"maas-controller-75dc6cbdf-8vwxd\" (UID: \"4cbde737-083f-4d62-9e1a-19c67b94fa03\") " pod="opendatahub/maas-controller-75dc6cbdf-8vwxd"
Sep 17 01:50:36.403101 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:36.403060    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4r2p\" (UniqueName: \"kubernetes.io/projected/4cbde737-083f-4d62-9e1a-19c67b94fa03-kube-api-access-r4r2p\") pod \"maas-controller-75dc6cbdf-8vwxd\" (UID: \"4cbde737-083f-4d62-9e1a-19c67b94fa03\") " pod="opendatahub/maas-controller-75dc6cbdf-8vwxd"
Sep 17 01:50:36.403101 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:36.403098    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4cbde737-083f-4d62-9e1a-19c67b94fa03-metrics-certs\") pod \"maas-controller-75dc6cbdf-8vwxd\" (UID: \"4cbde737-083f-4d62-9e1a-19c67b94fa03\") " pod="opendatahub/maas-controller-75dc6cbdf-8vwxd"
Sep 17 01:50:36.403333 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:36.403136    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4cbde737-083f-4d62-9e1a-19c67b94fa03-webhook-cert\") pod \"maas-controller-75dc6cbdf-8vwxd\" (UID: \"4cbde737-083f-4d62-9e1a-19c67b94fa03\") " pod="opendatahub/maas-controller-75dc6cbdf-8vwxd"
Sep 17 01:50:36.403333 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:50:36.403282    2560 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found
Sep 17 01:50:36.403399 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:50:36.403357    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cbde737-083f-4d62-9e1a-19c67b94fa03-metrics-certs podName:4cbde737-083f-4d62-9e1a-19c67b94fa03 nodeName:}" failed. No retries permitted until 2026-09-17 01:50:36.903334308 +0000 UTC m=+795.153311603 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4cbde737-083f-4d62-9e1a-19c67b94fa03-metrics-certs") pod "maas-controller-75dc6cbdf-8vwxd" (UID: "4cbde737-083f-4d62-9e1a-19c67b94fa03") : secret "maas-controller-metrics-tls" not found
Sep 17 01:50:36.405760 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:36.405735    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7cdffb474b-dcscd"]
Sep 17 01:50:36.406158 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:36.406136    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4cbde737-083f-4d62-9e1a-19c67b94fa03-webhook-cert\") pod \"maas-controller-75dc6cbdf-8vwxd\" (UID: \"4cbde737-083f-4d62-9e1a-19c67b94fa03\") " pod="opendatahub/maas-controller-75dc6cbdf-8vwxd"
Sep 17 01:50:36.413368 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:36.413344    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7cdffb474b-dcscd"
Sep 17 01:50:36.413865 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:36.413846    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4r2p\" (UniqueName: \"kubernetes.io/projected/4cbde737-083f-4d62-9e1a-19c67b94fa03-kube-api-access-r4r2p\") pod \"maas-controller-75dc6cbdf-8vwxd\" (UID: \"4cbde737-083f-4d62-9e1a-19c67b94fa03\") " pod="opendatahub/maas-controller-75dc6cbdf-8vwxd"
Sep 17 01:50:36.417908 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:36.417878    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7cdffb474b-dcscd"]
Sep 17 01:50:36.504530 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:36.504438    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6e2a1314-3f05-452e-a01a-8c11855daa86-webhook-cert\") pod \"maas-controller-7cdffb474b-dcscd\" (UID: \"6e2a1314-3f05-452e-a01a-8c11855daa86\") " pod="opendatahub/maas-controller-7cdffb474b-dcscd"
Sep 17 01:50:36.504530 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:36.504492    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e2a1314-3f05-452e-a01a-8c11855daa86-metrics-certs\") pod \"maas-controller-7cdffb474b-dcscd\" (UID: \"6e2a1314-3f05-452e-a01a-8c11855daa86\") " pod="opendatahub/maas-controller-7cdffb474b-dcscd"
Sep 17 01:50:36.504715 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:36.504541    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4xsx\" (UniqueName: \"kubernetes.io/projected/6e2a1314-3f05-452e-a01a-8c11855daa86-kube-api-access-d4xsx\") pod \"maas-controller-7cdffb474b-dcscd\" (UID: \"6e2a1314-3f05-452e-a01a-8c11855daa86\") " pod="opendatahub/maas-controller-7cdffb474b-dcscd"
Sep 17 01:50:36.605841 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:36.605804    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e2a1314-3f05-452e-a01a-8c11855daa86-metrics-certs\") pod \"maas-controller-7cdffb474b-dcscd\" (UID: \"6e2a1314-3f05-452e-a01a-8c11855daa86\") " pod="opendatahub/maas-controller-7cdffb474b-dcscd"
Sep 17 01:50:36.605841 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:36.605848    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4xsx\" (UniqueName: \"kubernetes.io/projected/6e2a1314-3f05-452e-a01a-8c11855daa86-kube-api-access-d4xsx\") pod \"maas-controller-7cdffb474b-dcscd\" (UID: \"6e2a1314-3f05-452e-a01a-8c11855daa86\") " pod="opendatahub/maas-controller-7cdffb474b-dcscd"
Sep 17 01:50:36.606055 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:36.605904    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6e2a1314-3f05-452e-a01a-8c11855daa86-webhook-cert\") pod \"maas-controller-7cdffb474b-dcscd\" (UID: \"6e2a1314-3f05-452e-a01a-8c11855daa86\") " pod="opendatahub/maas-controller-7cdffb474b-dcscd"
Sep 17 01:50:36.608196 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:36.608175    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6e2a1314-3f05-452e-a01a-8c11855daa86-webhook-cert\") pod \"maas-controller-7cdffb474b-dcscd\" (UID: \"6e2a1314-3f05-452e-a01a-8c11855daa86\") " pod="opendatahub/maas-controller-7cdffb474b-dcscd"
Sep 17 01:50:36.608311 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:36.608294    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e2a1314-3f05-452e-a01a-8c11855daa86-metrics-certs\") pod \"maas-controller-7cdffb474b-dcscd\" (UID: \"6e2a1314-3f05-452e-a01a-8c11855daa86\") " pod="opendatahub/maas-controller-7cdffb474b-dcscd"
Sep 17 01:50:36.612456 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:36.612430    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4xsx\" (UniqueName: \"kubernetes.io/projected/6e2a1314-3f05-452e-a01a-8c11855daa86-kube-api-access-d4xsx\") pod \"maas-controller-7cdffb474b-dcscd\" (UID: \"6e2a1314-3f05-452e-a01a-8c11855daa86\") " pod="opendatahub/maas-controller-7cdffb474b-dcscd"
Sep 17 01:50:36.730059 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:36.730012    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7cdffb474b-dcscd"
Sep 17 01:50:36.908928 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:36.908887    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4cbde737-083f-4d62-9e1a-19c67b94fa03-metrics-certs\") pod \"maas-controller-75dc6cbdf-8vwxd\" (UID: \"4cbde737-083f-4d62-9e1a-19c67b94fa03\") " pod="opendatahub/maas-controller-75dc6cbdf-8vwxd"
Sep 17 01:50:36.911292 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:36.911260    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4cbde737-083f-4d62-9e1a-19c67b94fa03-metrics-certs\") pod \"maas-controller-75dc6cbdf-8vwxd\" (UID: \"4cbde737-083f-4d62-9e1a-19c67b94fa03\") " pod="opendatahub/maas-controller-75dc6cbdf-8vwxd"
Sep 17 01:50:36.997015 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:36.996980    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7cdffb474b-dcscd"]
Sep 17 01:50:37.000596 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:50:37.000564    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e2a1314_3f05_452e_a01a_8c11855daa86.slice/crio-b20c14bfa5a90b9c6d12d55c4f0bbcd85e45a54e977fa5394ca0be11df9b3246 WatchSource:0}: Error finding container b20c14bfa5a90b9c6d12d55c4f0bbcd85e45a54e977fa5394ca0be11df9b3246: Status 404 returned error can't find the container with id b20c14bfa5a90b9c6d12d55c4f0bbcd85e45a54e977fa5394ca0be11df9b3246
Sep 17 01:50:37.171625 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:37.171595    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75dc6cbdf-8vwxd"
Sep 17 01:50:37.334485 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:37.334451    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7cdffb474b-dcscd" event={"ID":"6e2a1314-3f05-452e-a01a-8c11855daa86","Type":"ContainerStarted","Data":"b20c14bfa5a90b9c6d12d55c4f0bbcd85e45a54e977fa5394ca0be11df9b3246"}
Sep 17 01:50:37.440762 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:37.440732    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-8vwxd"]
Sep 17 01:50:37.443211 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:50:37.443180    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cbde737_083f_4d62_9e1a_19c67b94fa03.slice/crio-6505820747a58f435433a9c64de1ff926632e124bea9d3a60891a496ea0a10f1 WatchSource:0}: Error finding container 6505820747a58f435433a9c64de1ff926632e124bea9d3a60891a496ea0a10f1: Status 404 returned error can't find the container with id 6505820747a58f435433a9c64de1ff926632e124bea9d3a60891a496ea0a10f1
Sep 17 01:50:38.343467 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:38.343389    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75dc6cbdf-8vwxd" event={"ID":"4cbde737-083f-4d62-9e1a-19c67b94fa03","Type":"ContainerStarted","Data":"6505820747a58f435433a9c64de1ff926632e124bea9d3a60891a496ea0a10f1"}
Sep 17 01:50:40.356282 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:40.356237    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-75dc6cbdf-8vwxd"
Sep 17 01:50:40.356727 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:40.356301    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75dc6cbdf-8vwxd" event={"ID":"4cbde737-083f-4d62-9e1a-19c67b94fa03","Type":"ContainerStarted","Data":"435b8b270e479cf62123b3cb2766730d4e4a50be19b0bc8a5cf4ac477e1b2f29"}
Sep 17 01:50:40.356941 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:40.356919    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7cdffb474b-dcscd" event={"ID":"6e2a1314-3f05-452e-a01a-8c11855daa86","Type":"ContainerStarted","Data":"21c6f43f8292e255aadce9d2fec1c50b7d50a93c37f1cd27308502646f603969"}
Sep 17 01:50:40.357063 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:40.357050    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7cdffb474b-dcscd"
Sep 17 01:50:40.370842 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:40.370767    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-75dc6cbdf-8vwxd" podStartSLOduration=2.2622551140000002 podStartE2EDuration="4.370746484s" totalImagesPullingTime="2.10849137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:50:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:50:40.370066207 +0000 UTC m=+798.620043519" watchObservedRunningTime="2026-09-17 01:50:40.370746484 +0000 UTC m=+798.620723799"
Sep 17 01:50:40.390905 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:40.390849    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7cdffb474b-dcscd" podStartSLOduration=1.849568565 podStartE2EDuration="4.390830163s" totalImagesPullingTime="2.541261598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:50:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:50:40.389194317 +0000 UTC m=+798.639171629" watchObservedRunningTime="2026-09-17 01:50:40.390830163 +0000 UTC m=+798.640807475"
Sep 17 01:50:51.363732 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:51.363653    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-75dc6cbdf-8vwxd"
Sep 17 01:50:51.364175 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:51.363740    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7cdffb474b-dcscd"
Sep 17 01:50:51.424502 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:51.424457    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-8vwxd"]
Sep 17 01:50:51.424681 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:51.424656    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-75dc6cbdf-8vwxd" podUID="4cbde737-083f-4d62-9e1a-19c67b94fa03" containerName="manager" containerID="cri-o://435b8b270e479cf62123b3cb2766730d4e4a50be19b0bc8a5cf4ac477e1b2f29" gracePeriod=30
Sep 17 01:50:51.664453 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:51.664429    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75dc6cbdf-8vwxd"
Sep 17 01:50:51.735706 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:51.735669    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4cbde737-083f-4d62-9e1a-19c67b94fa03-webhook-cert\") pod \"4cbde737-083f-4d62-9e1a-19c67b94fa03\" (UID: \"4cbde737-083f-4d62-9e1a-19c67b94fa03\") "
Sep 17 01:50:51.735880 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:51.735717    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4r2p\" (UniqueName: \"kubernetes.io/projected/4cbde737-083f-4d62-9e1a-19c67b94fa03-kube-api-access-r4r2p\") pod \"4cbde737-083f-4d62-9e1a-19c67b94fa03\" (UID: \"4cbde737-083f-4d62-9e1a-19c67b94fa03\") "
Sep 17 01:50:51.735880 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:51.735733    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4cbde737-083f-4d62-9e1a-19c67b94fa03-metrics-certs\") pod \"4cbde737-083f-4d62-9e1a-19c67b94fa03\" (UID: \"4cbde737-083f-4d62-9e1a-19c67b94fa03\") "
Sep 17 01:50:51.737953 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:51.737921    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4cbde737-083f-4d62-9e1a-19c67b94fa03-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "4cbde737-083f-4d62-9e1a-19c67b94fa03" (UID: "4cbde737-083f-4d62-9e1a-19c67b94fa03"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 01:50:51.738073 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:51.737989    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cbde737-083f-4d62-9e1a-19c67b94fa03-kube-api-access-r4r2p" (OuterVolumeSpecName: "kube-api-access-r4r2p") pod "4cbde737-083f-4d62-9e1a-19c67b94fa03" (UID: "4cbde737-083f-4d62-9e1a-19c67b94fa03"). InnerVolumeSpecName "kube-api-access-r4r2p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:50:51.738073 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:51.738017    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4cbde737-083f-4d62-9e1a-19c67b94fa03-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "4cbde737-083f-4d62-9e1a-19c67b94fa03" (UID: "4cbde737-083f-4d62-9e1a-19c67b94fa03"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 01:50:51.836933 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:51.836898    2560 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4cbde737-083f-4d62-9e1a-19c67b94fa03-webhook-cert\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:50:51.836933 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:51.836925    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4r2p\" (UniqueName: \"kubernetes.io/projected/4cbde737-083f-4d62-9e1a-19c67b94fa03-kube-api-access-r4r2p\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:50:51.836933 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:51.836934    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4cbde737-083f-4d62-9e1a-19c67b94fa03-metrics-certs\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:50:52.412029 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:52.411992    2560 generic.go:356] "Generic (PLEG): container finished" podID="4cbde737-083f-4d62-9e1a-19c67b94fa03" containerID="435b8b270e479cf62123b3cb2766730d4e4a50be19b0bc8a5cf4ac477e1b2f29" exitCode=0
Sep 17 01:50:52.412029 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:52.412040    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75dc6cbdf-8vwxd"
Sep 17 01:50:52.412550 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:52.412060    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75dc6cbdf-8vwxd" event={"ID":"4cbde737-083f-4d62-9e1a-19c67b94fa03","Type":"ContainerDied","Data":"435b8b270e479cf62123b3cb2766730d4e4a50be19b0bc8a5cf4ac477e1b2f29"}
Sep 17 01:50:52.412550 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:52.412104    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75dc6cbdf-8vwxd" event={"ID":"4cbde737-083f-4d62-9e1a-19c67b94fa03","Type":"ContainerDied","Data":"6505820747a58f435433a9c64de1ff926632e124bea9d3a60891a496ea0a10f1"}
Sep 17 01:50:52.412550 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:52.412134    2560 scope.go:117] "RemoveContainer" containerID="435b8b270e479cf62123b3cb2766730d4e4a50be19b0bc8a5cf4ac477e1b2f29"
Sep 17 01:50:52.421475 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:52.421422    2560 scope.go:117] "RemoveContainer" containerID="435b8b270e479cf62123b3cb2766730d4e4a50be19b0bc8a5cf4ac477e1b2f29"
Sep 17 01:50:52.421699 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:50:52.421676    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"435b8b270e479cf62123b3cb2766730d4e4a50be19b0bc8a5cf4ac477e1b2f29\": container with ID starting with 435b8b270e479cf62123b3cb2766730d4e4a50be19b0bc8a5cf4ac477e1b2f29 not found: ID does not exist" containerID="435b8b270e479cf62123b3cb2766730d4e4a50be19b0bc8a5cf4ac477e1b2f29"
Sep 17 01:50:52.421769 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:52.421708    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"435b8b270e479cf62123b3cb2766730d4e4a50be19b0bc8a5cf4ac477e1b2f29"} err="failed to get container status \"435b8b270e479cf62123b3cb2766730d4e4a50be19b0bc8a5cf4ac477e1b2f29\": rpc error: code = NotFound desc = could not find container \"435b8b270e479cf62123b3cb2766730d4e4a50be19b0bc8a5cf4ac477e1b2f29\": container with ID starting with 435b8b270e479cf62123b3cb2766730d4e4a50be19b0bc8a5cf4ac477e1b2f29 not found: ID does not exist"
Sep 17 01:50:52.428061 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:52.428038    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-8vwxd"]
Sep 17 01:50:52.431880 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:52.431860    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-8vwxd"]
Sep 17 01:50:54.356348 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:50:54.356309    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4cbde737-083f-4d62-9e1a-19c67b94fa03" path="/var/lib/kubelet/pods/4cbde737-083f-4d62-9e1a-19c67b94fa03/volumes"
Sep 17 01:51:12.966208 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:12.966171    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-59f6566bbc-ps7ln"]
Sep 17 01:51:12.966744 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:12.966548    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cbde737-083f-4d62-9e1a-19c67b94fa03" containerName="manager"
Sep 17 01:51:12.966744 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:12.966565    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cbde737-083f-4d62-9e1a-19c67b94fa03" containerName="manager"
Sep 17 01:51:12.966744 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:12.966632    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cbde737-083f-4d62-9e1a-19c67b94fa03" containerName="manager"
Sep 17 01:51:12.973431 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:12.973412    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-ps7ln"
Sep 17 01:51:12.975194 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:12.975164    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 17 01:51:12.975321 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:12.975202    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-kpnw8\""
Sep 17 01:51:12.975321 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:12.975207    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 17 01:51:12.980122 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:12.980040    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-59f6566bbc-ps7ln"]
Sep 17 01:51:13.123823 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:13.123788    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3642e8e6-7b7d-43f3-ae87-486ebab18de0-openshift-service-ca\") pod \"maas-api-59f6566bbc-ps7ln\" (UID: \"3642e8e6-7b7d-43f3-ae87-486ebab18de0\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-ps7ln"
Sep 17 01:51:13.124029 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:13.123860    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cxrd\" (UniqueName: \"kubernetes.io/projected/3642e8e6-7b7d-43f3-ae87-486ebab18de0-kube-api-access-8cxrd\") pod \"maas-api-59f6566bbc-ps7ln\" (UID: \"3642e8e6-7b7d-43f3-ae87-486ebab18de0\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-ps7ln"
Sep 17 01:51:13.124029 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:13.123957    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3642e8e6-7b7d-43f3-ae87-486ebab18de0-metrics-certs\") pod \"maas-api-59f6566bbc-ps7ln\" (UID: \"3642e8e6-7b7d-43f3-ae87-486ebab18de0\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-ps7ln"
Sep 17 01:51:13.124029 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:13.124016    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3642e8e6-7b7d-43f3-ae87-486ebab18de0-maas-api-tls\") pod \"maas-api-59f6566bbc-ps7ln\" (UID: \"3642e8e6-7b7d-43f3-ae87-486ebab18de0\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-ps7ln"
Sep 17 01:51:13.225367 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:13.225266    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3642e8e6-7b7d-43f3-ae87-486ebab18de0-maas-api-tls\") pod \"maas-api-59f6566bbc-ps7ln\" (UID: \"3642e8e6-7b7d-43f3-ae87-486ebab18de0\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-ps7ln"
Sep 17 01:51:13.225367 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:13.225352    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3642e8e6-7b7d-43f3-ae87-486ebab18de0-openshift-service-ca\") pod \"maas-api-59f6566bbc-ps7ln\" (UID: \"3642e8e6-7b7d-43f3-ae87-486ebab18de0\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-ps7ln"
Sep 17 01:51:13.225620 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:13.225398    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cxrd\" (UniqueName: \"kubernetes.io/projected/3642e8e6-7b7d-43f3-ae87-486ebab18de0-kube-api-access-8cxrd\") pod \"maas-api-59f6566bbc-ps7ln\" (UID: \"3642e8e6-7b7d-43f3-ae87-486ebab18de0\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-ps7ln"
Sep 17 01:51:13.225620 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:51:13.225419    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Sep 17 01:51:13.225620 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:13.225438    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3642e8e6-7b7d-43f3-ae87-486ebab18de0-metrics-certs\") pod \"maas-api-59f6566bbc-ps7ln\" (UID: \"3642e8e6-7b7d-43f3-ae87-486ebab18de0\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-ps7ln"
Sep 17 01:51:13.225620 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:51:13.225494    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3642e8e6-7b7d-43f3-ae87-486ebab18de0-maas-api-tls podName:3642e8e6-7b7d-43f3-ae87-486ebab18de0 nodeName:}" failed. No retries permitted until 2026-09-17 01:51:13.725477281 +0000 UTC m=+831.975454572 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3642e8e6-7b7d-43f3-ae87-486ebab18de0-maas-api-tls") pod "maas-api-59f6566bbc-ps7ln" (UID: "3642e8e6-7b7d-43f3-ae87-486ebab18de0") : secret "maas-api-serving-cert" not found
Sep 17 01:51:13.225982 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:13.225963    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3642e8e6-7b7d-43f3-ae87-486ebab18de0-openshift-service-ca\") pod \"maas-api-59f6566bbc-ps7ln\" (UID: \"3642e8e6-7b7d-43f3-ae87-486ebab18de0\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-ps7ln"
Sep 17 01:51:13.227839 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:13.227815    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3642e8e6-7b7d-43f3-ae87-486ebab18de0-metrics-certs\") pod \"maas-api-59f6566bbc-ps7ln\" (UID: \"3642e8e6-7b7d-43f3-ae87-486ebab18de0\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-ps7ln"
Sep 17 01:51:13.234787 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:13.234758    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cxrd\" (UniqueName: \"kubernetes.io/projected/3642e8e6-7b7d-43f3-ae87-486ebab18de0-kube-api-access-8cxrd\") pod \"maas-api-59f6566bbc-ps7ln\" (UID: \"3642e8e6-7b7d-43f3-ae87-486ebab18de0\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-ps7ln"
Sep 17 01:51:13.420342 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:13.420308    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-7hm7j"]
Sep 17 01:51:13.424728 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:13.424688    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-7hm7j"
Sep 17 01:51:13.426664 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:13.426638    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 17 01:51:13.426765 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:13.426713    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-8fgrd\""
Sep 17 01:51:13.439227 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:13.439201    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-7hm7j"]
Sep 17 01:51:13.527813 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:13.527731    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44c7d\" (UniqueName: \"kubernetes.io/projected/5b7ab618-2a1f-47b4-b36c-96a47af612b1-kube-api-access-44c7d\") pod \"payload-processing-5b54b7fbb7-7hm7j\" (UID: \"5b7ab618-2a1f-47b4-b36c-96a47af612b1\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-7hm7j"
Sep 17 01:51:13.527813 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:13.527774    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b7ab618-2a1f-47b4-b36c-96a47af612b1-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-7hm7j\" (UID: \"5b7ab618-2a1f-47b4-b36c-96a47af612b1\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-7hm7j"
Sep 17 01:51:13.629046 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:13.629008    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b7ab618-2a1f-47b4-b36c-96a47af612b1-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-7hm7j\" (UID: \"5b7ab618-2a1f-47b4-b36c-96a47af612b1\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-7hm7j"
Sep 17 01:51:13.629223 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:13.629111    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44c7d\" (UniqueName: \"kubernetes.io/projected/5b7ab618-2a1f-47b4-b36c-96a47af612b1-kube-api-access-44c7d\") pod \"payload-processing-5b54b7fbb7-7hm7j\" (UID: \"5b7ab618-2a1f-47b4-b36c-96a47af612b1\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-7hm7j"
Sep 17 01:51:13.629699 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:13.629680    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b7ab618-2a1f-47b4-b36c-96a47af612b1-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-7hm7j\" (UID: \"5b7ab618-2a1f-47b4-b36c-96a47af612b1\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-7hm7j"
Sep 17 01:51:13.653783 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:13.653745    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44c7d\" (UniqueName: \"kubernetes.io/projected/5b7ab618-2a1f-47b4-b36c-96a47af612b1-kube-api-access-44c7d\") pod \"payload-processing-5b54b7fbb7-7hm7j\" (UID: \"5b7ab618-2a1f-47b4-b36c-96a47af612b1\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-7hm7j"
Sep 17 01:51:13.729928 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:13.729893    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3642e8e6-7b7d-43f3-ae87-486ebab18de0-maas-api-tls\") pod \"maas-api-59f6566bbc-ps7ln\" (UID: \"3642e8e6-7b7d-43f3-ae87-486ebab18de0\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-ps7ln"
Sep 17 01:51:13.732319 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:13.732286    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3642e8e6-7b7d-43f3-ae87-486ebab18de0-maas-api-tls\") pod \"maas-api-59f6566bbc-ps7ln\" (UID: \"3642e8e6-7b7d-43f3-ae87-486ebab18de0\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-ps7ln"
Sep 17 01:51:13.735108 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:13.735089    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-7hm7j"
Sep 17 01:51:13.885439 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:13.885404    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-ps7ln"
Sep 17 01:51:14.010085 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:14.010058    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-7hm7j"]
Sep 17 01:51:14.012526 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:51:14.012500    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b7ab618_2a1f_47b4_b36c_96a47af612b1.slice/crio-0b6f74ff58c02a02e2888a9d02ab2d1e9f745e13170fe716cdd83b78914b636e WatchSource:0}: Error finding container 0b6f74ff58c02a02e2888a9d02ab2d1e9f745e13170fe716cdd83b78914b636e: Status 404 returned error can't find the container with id 0b6f74ff58c02a02e2888a9d02ab2d1e9f745e13170fe716cdd83b78914b636e
Sep 17 01:51:14.157200 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:14.157162    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-59f6566bbc-ps7ln"]
Sep 17 01:51:14.159989 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:51:14.159958    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3642e8e6_7b7d_43f3_ae87_486ebab18de0.slice/crio-0d9329e14814a8d3067aa26be5144537756e95174c9a6844728b3b6c1ff261df WatchSource:0}: Error finding container 0d9329e14814a8d3067aa26be5144537756e95174c9a6844728b3b6c1ff261df: Status 404 returned error can't find the container with id 0d9329e14814a8d3067aa26be5144537756e95174c9a6844728b3b6c1ff261df
Sep 17 01:51:14.507207 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:14.507102    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-7hm7j" event={"ID":"5b7ab618-2a1f-47b4-b36c-96a47af612b1","Type":"ContainerStarted","Data":"0b6f74ff58c02a02e2888a9d02ab2d1e9f745e13170fe716cdd83b78914b636e"}
Sep 17 01:51:14.508315 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:14.508293    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-ps7ln" event={"ID":"3642e8e6-7b7d-43f3-ae87-486ebab18de0","Type":"ContainerStarted","Data":"0d9329e14814a8d3067aa26be5144537756e95174c9a6844728b3b6c1ff261df"}
Sep 17 01:51:17.525275 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:17.525214    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-7hm7j" event={"ID":"5b7ab618-2a1f-47b4-b36c-96a47af612b1","Type":"ContainerStarted","Data":"3032d3c6b12a3bdf2db5bb226692fbb38a4297ef2327dbf5217ff8a871a126b0"}
Sep 17 01:51:17.525766 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:17.525382    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-7hm7j"
Sep 17 01:51:17.526788 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:17.526764    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-ps7ln" event={"ID":"3642e8e6-7b7d-43f3-ae87-486ebab18de0","Type":"ContainerStarted","Data":"31bcb92e632fe915873fcc1f19f7238b952c3d01e7efdb76b5cbe605d6f883fb"}
Sep 17 01:51:17.526894 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:17.526804    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-ps7ln"
Sep 17 01:51:17.539997 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:17.539950    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-7hm7j" podStartSLOduration=1.561095922 podStartE2EDuration="4.539936369s" totalImagesPullingTime="2.978840447s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:51:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:51:17.538447899 +0000 UTC m=+835.788425212" watchObservedRunningTime="2026-09-17 01:51:17.539936369 +0000 UTC m=+835.789913682"
Sep 17 01:51:17.552296 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:17.552219    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-ps7ln" podStartSLOduration=2.7202412750000002 podStartE2EDuration="5.552208746s" totalImagesPullingTime="2.831967471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:51:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:51:17.551596594 +0000 UTC m=+835.801573907" watchObservedRunningTime="2026-09-17 01:51:17.552208746 +0000 UTC m=+835.802186058"
Sep 17 01:51:23.535838 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:23.535802    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-ps7ln"
Sep 17 01:51:28.533266 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:28.533213    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-7hm7j"
Sep 17 01:51:54.068935 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:54.068897    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hmhh9"]
Sep 17 01:51:54.082822 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:54.082788    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hmhh9"
Sep 17 01:51:54.084499 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:54.084436    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hmhh9"]
Sep 17 01:51:54.085155 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:54.085121    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 17 01:51:54.085290 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:54.085126    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 17 01:51:54.085290 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:54.085134    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-k5l9j\""
Sep 17 01:51:54.085290 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:54.085134    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 17 01:51:54.179596 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:54.179561    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c198ed41-cf3a-4063-ac68-2ece02980786-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hmhh9\" (UID: \"c198ed41-cf3a-4063-ac68-2ece02980786\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hmhh9"
Sep 17 01:51:54.179759 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:54.179616    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jn4m7\" (UniqueName: \"kubernetes.io/projected/c198ed41-cf3a-4063-ac68-2ece02980786-kube-api-access-jn4m7\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hmhh9\" (UID: \"c198ed41-cf3a-4063-ac68-2ece02980786\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hmhh9"
Sep 17 01:51:54.179759 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:54.179684    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c198ed41-cf3a-4063-ac68-2ece02980786-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hmhh9\" (UID: \"c198ed41-cf3a-4063-ac68-2ece02980786\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hmhh9"
Sep 17 01:51:54.179759 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:54.179714    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c198ed41-cf3a-4063-ac68-2ece02980786-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hmhh9\" (UID: \"c198ed41-cf3a-4063-ac68-2ece02980786\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hmhh9"
Sep 17 01:51:54.179759 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:54.179741    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c198ed41-cf3a-4063-ac68-2ece02980786-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hmhh9\" (UID: \"c198ed41-cf3a-4063-ac68-2ece02980786\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hmhh9"
Sep 17 01:51:54.179932 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:54.179808    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c198ed41-cf3a-4063-ac68-2ece02980786-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hmhh9\" (UID: \"c198ed41-cf3a-4063-ac68-2ece02980786\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hmhh9"
Sep 17 01:51:54.281075 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:54.281039    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c198ed41-cf3a-4063-ac68-2ece02980786-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hmhh9\" (UID: \"c198ed41-cf3a-4063-ac68-2ece02980786\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hmhh9"
Sep 17 01:51:54.281276 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:54.281090    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jn4m7\" (UniqueName: \"kubernetes.io/projected/c198ed41-cf3a-4063-ac68-2ece02980786-kube-api-access-jn4m7\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hmhh9\" (UID: \"c198ed41-cf3a-4063-ac68-2ece02980786\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hmhh9"
Sep 17 01:51:54.281276 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:54.281131    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c198ed41-cf3a-4063-ac68-2ece02980786-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hmhh9\" (UID: \"c198ed41-cf3a-4063-ac68-2ece02980786\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hmhh9"
Sep 17 01:51:54.281276 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:54.281159    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c198ed41-cf3a-4063-ac68-2ece02980786-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hmhh9\" (UID: \"c198ed41-cf3a-4063-ac68-2ece02980786\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hmhh9"
Sep 17 01:51:54.281276 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:54.281189    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c198ed41-cf3a-4063-ac68-2ece02980786-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hmhh9\" (UID: \"c198ed41-cf3a-4063-ac68-2ece02980786\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hmhh9"
Sep 17 01:51:54.281276 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:54.281222    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c198ed41-cf3a-4063-ac68-2ece02980786-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hmhh9\" (UID: \"c198ed41-cf3a-4063-ac68-2ece02980786\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hmhh9"
Sep 17 01:51:54.281596 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:54.281570    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c198ed41-cf3a-4063-ac68-2ece02980786-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hmhh9\" (UID: \"c198ed41-cf3a-4063-ac68-2ece02980786\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hmhh9"
Sep 17 01:51:54.281653 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:54.281607    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c198ed41-cf3a-4063-ac68-2ece02980786-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hmhh9\" (UID: \"c198ed41-cf3a-4063-ac68-2ece02980786\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hmhh9"
Sep 17 01:51:54.281709 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:54.281658    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c198ed41-cf3a-4063-ac68-2ece02980786-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hmhh9\" (UID: \"c198ed41-cf3a-4063-ac68-2ece02980786\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hmhh9"
Sep 17 01:51:54.283308 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:54.283283    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c198ed41-cf3a-4063-ac68-2ece02980786-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hmhh9\" (UID: \"c198ed41-cf3a-4063-ac68-2ece02980786\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hmhh9"
Sep 17 01:51:54.283550 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:54.283529    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c198ed41-cf3a-4063-ac68-2ece02980786-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hmhh9\" (UID: \"c198ed41-cf3a-4063-ac68-2ece02980786\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hmhh9"
Sep 17 01:51:54.288493 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:54.288474    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jn4m7\" (UniqueName: \"kubernetes.io/projected/c198ed41-cf3a-4063-ac68-2ece02980786-kube-api-access-jn4m7\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hmhh9\" (UID: \"c198ed41-cf3a-4063-ac68-2ece02980786\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hmhh9"
Sep 17 01:51:54.403185 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:54.403094    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hmhh9"
Sep 17 01:51:54.673636 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:54.673557    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hmhh9"]
Sep 17 01:51:54.676660 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:51:54.676634    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc198ed41_cf3a_4063_ac68_2ece02980786.slice/crio-a7466e991103cf8f9c5cd27703b11c75209eb7e4b4cf28f5ca7e65d513218cf5 WatchSource:0}: Error finding container a7466e991103cf8f9c5cd27703b11c75209eb7e4b4cf28f5ca7e65d513218cf5: Status 404 returned error can't find the container with id a7466e991103cf8f9c5cd27703b11c75209eb7e4b4cf28f5ca7e65d513218cf5
Sep 17 01:51:54.693946 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:54.693916    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hmhh9" event={"ID":"c198ed41-cf3a-4063-ac68-2ece02980786","Type":"ContainerStarted","Data":"a7466e991103cf8f9c5cd27703b11c75209eb7e4b4cf28f5ca7e65d513218cf5"}
Sep 17 01:51:55.700823 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:55.700785    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hmhh9" event={"ID":"c198ed41-cf3a-4063-ac68-2ece02980786","Type":"ContainerStarted","Data":"cfbe0415fe851a689147c24cb0884261bdd3808001a6547aba0f1c04a4dce5f9"}
Sep 17 01:51:55.715796 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:51:55.715750    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hmhh9" podStartSLOduration=0.782038185 podStartE2EDuration="1.715733449s" totalImagesPullingTime="933.695264ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:51:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:51:55.714572959 +0000 UTC m=+873.964550273" watchObservedRunningTime="2026-09-17 01:51:55.715733449 +0000 UTC m=+873.965710761"
Sep 17 01:52:04.403666 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:52:04.403610    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hmhh9"
Sep 17 01:52:04.404050 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:52:04.403685    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hmhh9"
Sep 17 01:52:04.416031 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:52:04.416004    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hmhh9"
Sep 17 01:52:04.749015 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:52:04.748943    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hmhh9"
Sep 17 01:52:12.475391 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:52:12.475355    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-qxgr4"]
Sep 17 01:52:12.478974 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:52:12.478953    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qxgr4"
Sep 17 01:52:12.480854 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:52:12.480836    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 17 01:52:12.489164 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:52:12.489140    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-qxgr4"]
Sep 17 01:52:12.526606 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:52:12.526571    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb7faa25-8d2e-4f81-813a-af87fbd4d353-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qxgr4\" (UID: \"fb7faa25-8d2e-4f81-813a-af87fbd4d353\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qxgr4"
Sep 17 01:52:12.526776 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:52:12.526615    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zdhk\" (UniqueName: \"kubernetes.io/projected/fb7faa25-8d2e-4f81-813a-af87fbd4d353-kube-api-access-8zdhk\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qxgr4\" (UID: \"fb7faa25-8d2e-4f81-813a-af87fbd4d353\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qxgr4"
Sep 17 01:52:12.526776 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:52:12.526698    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb7faa25-8d2e-4f81-813a-af87fbd4d353-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qxgr4\" (UID: \"fb7faa25-8d2e-4f81-813a-af87fbd4d353\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qxgr4"
Sep 17 01:52:12.526776 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:52:12.526725    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb7faa25-8d2e-4f81-813a-af87fbd4d353-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qxgr4\" (UID: \"fb7faa25-8d2e-4f81-813a-af87fbd4d353\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qxgr4"
Sep 17 01:52:12.526776 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:52:12.526765    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb7faa25-8d2e-4f81-813a-af87fbd4d353-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qxgr4\" (UID: \"fb7faa25-8d2e-4f81-813a-af87fbd4d353\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qxgr4"
Sep 17 01:52:12.526991 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:52:12.526804    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb7faa25-8d2e-4f81-813a-af87fbd4d353-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qxgr4\" (UID: \"fb7faa25-8d2e-4f81-813a-af87fbd4d353\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qxgr4"
Sep 17 01:52:12.627995 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:52:12.627954    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb7faa25-8d2e-4f81-813a-af87fbd4d353-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qxgr4\" (UID: \"fb7faa25-8d2e-4f81-813a-af87fbd4d353\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qxgr4"
Sep 17 01:52:12.627995 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:52:12.627990    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb7faa25-8d2e-4f81-813a-af87fbd4d353-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qxgr4\" (UID: \"fb7faa25-8d2e-4f81-813a-af87fbd4d353\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qxgr4"
Sep 17 01:52:12.628235 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:52:12.628021    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb7faa25-8d2e-4f81-813a-af87fbd4d353-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qxgr4\" (UID: \"fb7faa25-8d2e-4f81-813a-af87fbd4d353\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qxgr4"
Sep 17 01:52:12.628235 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:52:12.628050    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb7faa25-8d2e-4f81-813a-af87fbd4d353-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qxgr4\" (UID: \"fb7faa25-8d2e-4f81-813a-af87fbd4d353\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qxgr4"
Sep 17 01:52:12.628235 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:52:12.628082    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb7faa25-8d2e-4f81-813a-af87fbd4d353-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qxgr4\" (UID: \"fb7faa25-8d2e-4f81-813a-af87fbd4d353\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qxgr4"
Sep 17 01:52:12.628235 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:52:12.628105    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zdhk\" (UniqueName: \"kubernetes.io/projected/fb7faa25-8d2e-4f81-813a-af87fbd4d353-kube-api-access-8zdhk\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qxgr4\" (UID: \"fb7faa25-8d2e-4f81-813a-af87fbd4d353\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qxgr4"
Sep 17 01:52:12.628541 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:52:12.628515    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb7faa25-8d2e-4f81-813a-af87fbd4d353-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qxgr4\" (UID: \"fb7faa25-8d2e-4f81-813a-af87fbd4d353\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qxgr4"
Sep 17 01:52:12.628616 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:52:12.628570    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb7faa25-8d2e-4f81-813a-af87fbd4d353-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qxgr4\" (UID: \"fb7faa25-8d2e-4f81-813a-af87fbd4d353\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qxgr4"
Sep 17 01:52:12.628616 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:52:12.628604    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb7faa25-8d2e-4f81-813a-af87fbd4d353-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qxgr4\" (UID: \"fb7faa25-8d2e-4f81-813a-af87fbd4d353\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qxgr4"
Sep 17 01:52:12.630385 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:52:12.630364    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb7faa25-8d2e-4f81-813a-af87fbd4d353-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qxgr4\" (UID: \"fb7faa25-8d2e-4f81-813a-af87fbd4d353\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qxgr4"
Sep 17 01:52:12.630760 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:52:12.630739    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb7faa25-8d2e-4f81-813a-af87fbd4d353-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qxgr4\" (UID: \"fb7faa25-8d2e-4f81-813a-af87fbd4d353\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qxgr4"
Sep 17 01:52:12.634605 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:52:12.634583    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zdhk\" (UniqueName: \"kubernetes.io/projected/fb7faa25-8d2e-4f81-813a-af87fbd4d353-kube-api-access-8zdhk\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qxgr4\" (UID: \"fb7faa25-8d2e-4f81-813a-af87fbd4d353\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qxgr4"
Sep 17 01:52:12.808114 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:52:12.808031    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qxgr4"
Sep 17 01:52:13.075303 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:52:13.075274    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-qxgr4"]
Sep 17 01:52:13.077596 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:52:13.077569    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb7faa25_8d2e_4f81_813a_af87fbd4d353.slice/crio-8dc3e09e1796f0cb031f1a676b5e794ecf6fcdf3b43658691c467dd31d9cf92f WatchSource:0}: Error finding container 8dc3e09e1796f0cb031f1a676b5e794ecf6fcdf3b43658691c467dd31d9cf92f: Status 404 returned error can't find the container with id 8dc3e09e1796f0cb031f1a676b5e794ecf6fcdf3b43658691c467dd31d9cf92f
Sep 17 01:52:13.777288 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:52:13.777237    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qxgr4" event={"ID":"fb7faa25-8d2e-4f81-813a-af87fbd4d353","Type":"ContainerStarted","Data":"365d99efb66f8a2dedb3205a478ae60624bbe37e1f8321f28fa16dbe82d2de35"}
Sep 17 01:52:13.777637 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:52:13.777302    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qxgr4" event={"ID":"fb7faa25-8d2e-4f81-813a-af87fbd4d353","Type":"ContainerStarted","Data":"8dc3e09e1796f0cb031f1a676b5e794ecf6fcdf3b43658691c467dd31d9cf92f"}
Sep 17 01:52:13.795227 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:52:13.795176    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qxgr4" podStartSLOduration=1.611620526 podStartE2EDuration="1.79515621s" totalImagesPullingTime="183.535684ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:52:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:52:13.793399979 +0000 UTC m=+892.043377303" watchObservedRunningTime="2026-09-17 01:52:13.79515621 +0000 UTC m=+892.045133522"
Sep 17 01:52:22.809089 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:52:22.809027    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qxgr4"
Sep 17 01:52:22.809621 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:52:22.809118    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qxgr4"
Sep 17 01:52:22.822055 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:52:22.822029    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qxgr4"
Sep 17 01:52:22.833217 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:52:22.833197    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qxgr4"
Sep 17 01:53:54.023525 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:54.023444    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-7hm7j"]
Sep 17 01:53:54.024008 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:54.023656    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-5b54b7fbb7-7hm7j" podUID="5b7ab618-2a1f-47b4-b36c-96a47af612b1" containerName="payload-processing" containerID="cri-o://3032d3c6b12a3bdf2db5bb226692fbb38a4297ef2327dbf5217ff8a871a126b0" gracePeriod=30
Sep 17 01:53:54.165717 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:54.165673    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7cdffb474b-dcscd"]
Sep 17 01:53:54.165961 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:54.165882    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7cdffb474b-dcscd" podUID="6e2a1314-3f05-452e-a01a-8c11855daa86" containerName="manager" containerID="cri-o://21c6f43f8292e255aadce9d2fec1c50b7d50a93c37f1cd27308502646f603969" gracePeriod=30
Sep 17 01:53:54.218402 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:54.218370    2560 generic.go:356] "Generic (PLEG): container finished" podID="5b7ab618-2a1f-47b4-b36c-96a47af612b1" containerID="3032d3c6b12a3bdf2db5bb226692fbb38a4297ef2327dbf5217ff8a871a126b0" exitCode=0
Sep 17 01:53:54.218566 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:54.218444    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-7hm7j" event={"ID":"5b7ab618-2a1f-47b4-b36c-96a47af612b1","Type":"ContainerDied","Data":"3032d3c6b12a3bdf2db5bb226692fbb38a4297ef2327dbf5217ff8a871a126b0"}
Sep 17 01:53:54.266153 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:54.266127    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-7hm7j"
Sep 17 01:53:54.378075 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:54.378044    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-44c7d\" (UniqueName: \"kubernetes.io/projected/5b7ab618-2a1f-47b4-b36c-96a47af612b1-kube-api-access-44c7d\") pod \"5b7ab618-2a1f-47b4-b36c-96a47af612b1\" (UID: \"5b7ab618-2a1f-47b4-b36c-96a47af612b1\") "
Sep 17 01:53:54.378265 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:54.378081    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b7ab618-2a1f-47b4-b36c-96a47af612b1-plugins-config-volume\") pod \"5b7ab618-2a1f-47b4-b36c-96a47af612b1\" (UID: \"5b7ab618-2a1f-47b4-b36c-96a47af612b1\") "
Sep 17 01:53:54.378551 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:54.378522    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b7ab618-2a1f-47b4-b36c-96a47af612b1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5b7ab618-2a1f-47b4-b36c-96a47af612b1" (UID: "5b7ab618-2a1f-47b4-b36c-96a47af612b1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:53:54.380238 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:54.380214    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b7ab618-2a1f-47b4-b36c-96a47af612b1-kube-api-access-44c7d" (OuterVolumeSpecName: "kube-api-access-44c7d") pod "5b7ab618-2a1f-47b4-b36c-96a47af612b1" (UID: "5b7ab618-2a1f-47b4-b36c-96a47af612b1"). InnerVolumeSpecName "kube-api-access-44c7d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:53:54.478801 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:54.478774    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-44c7d\" (UniqueName: \"kubernetes.io/projected/5b7ab618-2a1f-47b4-b36c-96a47af612b1-kube-api-access-44c7d\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:53:54.478898 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:54.478807    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b7ab618-2a1f-47b4-b36c-96a47af612b1-plugins-config-volume\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:53:55.106507 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:55.106484    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7cdffb474b-dcscd"
Sep 17 01:53:55.211669 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:55.211633    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7cdffb474b-8cpk6"]
Sep 17 01:53:55.212029 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:55.212011    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e2a1314-3f05-452e-a01a-8c11855daa86" containerName="manager"
Sep 17 01:53:55.212104 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:55.212033    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e2a1314-3f05-452e-a01a-8c11855daa86" containerName="manager"
Sep 17 01:53:55.212104 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:55.212045    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b7ab618-2a1f-47b4-b36c-96a47af612b1" containerName="payload-processing"
Sep 17 01:53:55.212104 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:55.212053    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b7ab618-2a1f-47b4-b36c-96a47af612b1" containerName="payload-processing"
Sep 17 01:53:55.212282 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:55.212139    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e2a1314-3f05-452e-a01a-8c11855daa86" containerName="manager"
Sep 17 01:53:55.212282 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:55.212152    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b7ab618-2a1f-47b4-b36c-96a47af612b1" containerName="payload-processing"
Sep 17 01:53:55.214989 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:55.214968    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7cdffb474b-8cpk6"
Sep 17 01:53:55.227422 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:55.227388    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7cdffb474b-8cpk6"]
Sep 17 01:53:55.231285 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:55.231208    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-7hm7j"
Sep 17 01:53:55.231383 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:55.231209    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-7hm7j" event={"ID":"5b7ab618-2a1f-47b4-b36c-96a47af612b1","Type":"ContainerDied","Data":"0b6f74ff58c02a02e2888a9d02ab2d1e9f745e13170fe716cdd83b78914b636e"}
Sep 17 01:53:55.231465 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:55.231418    2560 scope.go:117] "RemoveContainer" containerID="3032d3c6b12a3bdf2db5bb226692fbb38a4297ef2327dbf5217ff8a871a126b0"
Sep 17 01:53:55.232944 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:55.232919    2560 generic.go:356] "Generic (PLEG): container finished" podID="6e2a1314-3f05-452e-a01a-8c11855daa86" containerID="21c6f43f8292e255aadce9d2fec1c50b7d50a93c37f1cd27308502646f603969" exitCode=0
Sep 17 01:53:55.233019 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:55.232971    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7cdffb474b-dcscd"
Sep 17 01:53:55.233077 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:55.232972    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7cdffb474b-dcscd" event={"ID":"6e2a1314-3f05-452e-a01a-8c11855daa86","Type":"ContainerDied","Data":"21c6f43f8292e255aadce9d2fec1c50b7d50a93c37f1cd27308502646f603969"}
Sep 17 01:53:55.233128 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:55.233073    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7cdffb474b-dcscd" event={"ID":"6e2a1314-3f05-452e-a01a-8c11855daa86","Type":"ContainerDied","Data":"b20c14bfa5a90b9c6d12d55c4f0bbcd85e45a54e977fa5394ca0be11df9b3246"}
Sep 17 01:53:55.244309 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:55.244290    2560 scope.go:117] "RemoveContainer" containerID="21c6f43f8292e255aadce9d2fec1c50b7d50a93c37f1cd27308502646f603969"
Sep 17 01:53:55.251885 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:55.251868    2560 scope.go:117] "RemoveContainer" containerID="21c6f43f8292e255aadce9d2fec1c50b7d50a93c37f1cd27308502646f603969"
Sep 17 01:53:55.252127 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:53:55.252110    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21c6f43f8292e255aadce9d2fec1c50b7d50a93c37f1cd27308502646f603969\": container with ID starting with 21c6f43f8292e255aadce9d2fec1c50b7d50a93c37f1cd27308502646f603969 not found: ID does not exist" containerID="21c6f43f8292e255aadce9d2fec1c50b7d50a93c37f1cd27308502646f603969"
Sep 17 01:53:55.252169 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:55.252133    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21c6f43f8292e255aadce9d2fec1c50b7d50a93c37f1cd27308502646f603969"} err="failed to get container status \"21c6f43f8292e255aadce9d2fec1c50b7d50a93c37f1cd27308502646f603969\": rpc error: code = NotFound desc = could not find container \"21c6f43f8292e255aadce9d2fec1c50b7d50a93c37f1cd27308502646f603969\": container with ID starting with 21c6f43f8292e255aadce9d2fec1c50b7d50a93c37f1cd27308502646f603969 not found: ID does not exist"
Sep 17 01:53:55.254828 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:55.254808    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-7hm7j"]
Sep 17 01:53:55.258158 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:55.258139    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-7hm7j"]
Sep 17 01:53:55.285751 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:55.285726    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e2a1314-3f05-452e-a01a-8c11855daa86-metrics-certs\") pod \"6e2a1314-3f05-452e-a01a-8c11855daa86\" (UID: \"6e2a1314-3f05-452e-a01a-8c11855daa86\") "
Sep 17 01:53:55.285860 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:55.285791    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4xsx\" (UniqueName: \"kubernetes.io/projected/6e2a1314-3f05-452e-a01a-8c11855daa86-kube-api-access-d4xsx\") pod \"6e2a1314-3f05-452e-a01a-8c11855daa86\" (UID: \"6e2a1314-3f05-452e-a01a-8c11855daa86\") "
Sep 17 01:53:55.285860 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:55.285826    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6e2a1314-3f05-452e-a01a-8c11855daa86-webhook-cert\") pod \"6e2a1314-3f05-452e-a01a-8c11855daa86\" (UID: \"6e2a1314-3f05-452e-a01a-8c11855daa86\") "
Sep 17 01:53:55.287795 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:55.287771    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e2a1314-3f05-452e-a01a-8c11855daa86-kube-api-access-d4xsx" (OuterVolumeSpecName: "kube-api-access-d4xsx") pod "6e2a1314-3f05-452e-a01a-8c11855daa86" (UID: "6e2a1314-3f05-452e-a01a-8c11855daa86"). InnerVolumeSpecName "kube-api-access-d4xsx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:53:55.287896 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:55.287806    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e2a1314-3f05-452e-a01a-8c11855daa86-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "6e2a1314-3f05-452e-a01a-8c11855daa86" (UID: "6e2a1314-3f05-452e-a01a-8c11855daa86"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 01:53:55.287896 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:55.287825    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e2a1314-3f05-452e-a01a-8c11855daa86-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6e2a1314-3f05-452e-a01a-8c11855daa86" (UID: "6e2a1314-3f05-452e-a01a-8c11855daa86"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 01:53:55.386666 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:55.386630    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwjmf\" (UniqueName: \"kubernetes.io/projected/415d68e5-19d5-44f0-b238-aa852a12cecd-kube-api-access-jwjmf\") pod \"maas-controller-7cdffb474b-8cpk6\" (UID: \"415d68e5-19d5-44f0-b238-aa852a12cecd\") " pod="opendatahub/maas-controller-7cdffb474b-8cpk6"
Sep 17 01:53:55.386828 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:55.386720    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/415d68e5-19d5-44f0-b238-aa852a12cecd-webhook-cert\") pod \"maas-controller-7cdffb474b-8cpk6\" (UID: \"415d68e5-19d5-44f0-b238-aa852a12cecd\") " pod="opendatahub/maas-controller-7cdffb474b-8cpk6"
Sep 17 01:53:55.386828 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:55.386766    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/415d68e5-19d5-44f0-b238-aa852a12cecd-metrics-certs\") pod \"maas-controller-7cdffb474b-8cpk6\" (UID: \"415d68e5-19d5-44f0-b238-aa852a12cecd\") " pod="opendatahub/maas-controller-7cdffb474b-8cpk6"
Sep 17 01:53:55.386900 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:55.386827    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e2a1314-3f05-452e-a01a-8c11855daa86-metrics-certs\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:53:55.386900 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:55.386845    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4xsx\" (UniqueName: \"kubernetes.io/projected/6e2a1314-3f05-452e-a01a-8c11855daa86-kube-api-access-d4xsx\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:53:55.386900 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:55.386861    2560 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6e2a1314-3f05-452e-a01a-8c11855daa86-webhook-cert\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:53:55.487741 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:55.487654    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwjmf\" (UniqueName: \"kubernetes.io/projected/415d68e5-19d5-44f0-b238-aa852a12cecd-kube-api-access-jwjmf\") pod \"maas-controller-7cdffb474b-8cpk6\" (UID: \"415d68e5-19d5-44f0-b238-aa852a12cecd\") " pod="opendatahub/maas-controller-7cdffb474b-8cpk6"
Sep 17 01:53:55.487741 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:55.487709    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/415d68e5-19d5-44f0-b238-aa852a12cecd-webhook-cert\") pod \"maas-controller-7cdffb474b-8cpk6\" (UID: \"415d68e5-19d5-44f0-b238-aa852a12cecd\") " pod="opendatahub/maas-controller-7cdffb474b-8cpk6"
Sep 17 01:53:55.487741 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:55.487736    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/415d68e5-19d5-44f0-b238-aa852a12cecd-metrics-certs\") pod \"maas-controller-7cdffb474b-8cpk6\" (UID: \"415d68e5-19d5-44f0-b238-aa852a12cecd\") " pod="opendatahub/maas-controller-7cdffb474b-8cpk6"
Sep 17 01:53:55.490158 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:55.490129    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/415d68e5-19d5-44f0-b238-aa852a12cecd-webhook-cert\") pod \"maas-controller-7cdffb474b-8cpk6\" (UID: \"415d68e5-19d5-44f0-b238-aa852a12cecd\") " pod="opendatahub/maas-controller-7cdffb474b-8cpk6"
Sep 17 01:53:55.490301 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:55.490169    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/415d68e5-19d5-44f0-b238-aa852a12cecd-metrics-certs\") pod \"maas-controller-7cdffb474b-8cpk6\" (UID: \"415d68e5-19d5-44f0-b238-aa852a12cecd\") " pod="opendatahub/maas-controller-7cdffb474b-8cpk6"
Sep 17 01:53:55.495790 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:55.495767    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwjmf\" (UniqueName: \"kubernetes.io/projected/415d68e5-19d5-44f0-b238-aa852a12cecd-kube-api-access-jwjmf\") pod \"maas-controller-7cdffb474b-8cpk6\" (UID: \"415d68e5-19d5-44f0-b238-aa852a12cecd\") " pod="opendatahub/maas-controller-7cdffb474b-8cpk6"
Sep 17 01:53:55.533325 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:55.533291    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7cdffb474b-8cpk6"
Sep 17 01:53:55.557025 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:55.556997    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7cdffb474b-dcscd"]
Sep 17 01:53:55.558789 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:55.558765    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7cdffb474b-dcscd"]
Sep 17 01:53:55.823560 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:55.823527    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7cdffb474b-8cpk6"]
Sep 17 01:53:55.826520 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:53:55.826497    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod415d68e5_19d5_44f0_b238_aa852a12cecd.slice/crio-0aef0244e0222add14ed14a7b1a958209087f17b467bfc92ffb842f48ec4c845 WatchSource:0}: Error finding container 0aef0244e0222add14ed14a7b1a958209087f17b467bfc92ffb842f48ec4c845: Status 404 returned error can't find the container with id 0aef0244e0222add14ed14a7b1a958209087f17b467bfc92ffb842f48ec4c845
Sep 17 01:53:55.827737 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:55.827720    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 01:53:56.240038 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:56.240001    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7cdffb474b-8cpk6" event={"ID":"415d68e5-19d5-44f0-b238-aa852a12cecd","Type":"ContainerStarted","Data":"0aef0244e0222add14ed14a7b1a958209087f17b467bfc92ffb842f48ec4c845"}
Sep 17 01:53:56.356937 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:56.356906    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b7ab618-2a1f-47b4-b36c-96a47af612b1" path="/var/lib/kubelet/pods/5b7ab618-2a1f-47b4-b36c-96a47af612b1/volumes"
Sep 17 01:53:56.357300 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:56.357287    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e2a1314-3f05-452e-a01a-8c11855daa86" path="/var/lib/kubelet/pods/6e2a1314-3f05-452e-a01a-8c11855daa86/volumes"
Sep 17 01:53:57.246110 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:57.246076    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7cdffb474b-8cpk6" event={"ID":"415d68e5-19d5-44f0-b238-aa852a12cecd","Type":"ContainerStarted","Data":"08dc7d90138e994299aceac34db23e6a36728a682b1d4ca28a489185f05e1190"}
Sep 17 01:53:57.246511 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:57.246210    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7cdffb474b-8cpk6"
Sep 17 01:53:57.265257 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:53:57.265209    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7cdffb474b-8cpk6" podStartSLOduration=1.8897321329999999 podStartE2EDuration="2.265192212s" totalImagesPullingTime="375.460079ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:53:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:53:57.263045545 +0000 UTC m=+995.513022858" watchObservedRunningTime="2026-09-17 01:53:57.265192212 +0000 UTC m=+995.515169525"
Sep 17 01:54:08.253404 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:08.253371    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7cdffb474b-8cpk6"
Sep 17 01:54:22.827671 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:22.827633    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-76ff884776-799m8"]
Sep 17 01:54:22.832328 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:22.832305    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-76ff884776-799m8"
Sep 17 01:54:22.834647 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:22.834618    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-dockercfg-k4hf7\""
Sep 17 01:54:22.834750 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:22.834678    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"ai-gateway-controller-parameters\""
Sep 17 01:54:22.840698 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:22.840672    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-76ff884776-799m8"]
Sep 17 01:54:22.928519 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:22.928481    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ws8x5\" (UniqueName: \"kubernetes.io/projected/5dba7335-1653-4401-ac06-13c11c9e93fa-kube-api-access-ws8x5\") pod \"ai-gateway-controller-76ff884776-799m8\" (UID: \"5dba7335-1653-4401-ac06-13c11c9e93fa\") " pod="opendatahub/ai-gateway-controller-76ff884776-799m8"
Sep 17 01:54:23.029340 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:23.029308    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ws8x5\" (UniqueName: \"kubernetes.io/projected/5dba7335-1653-4401-ac06-13c11c9e93fa-kube-api-access-ws8x5\") pod \"ai-gateway-controller-76ff884776-799m8\" (UID: \"5dba7335-1653-4401-ac06-13c11c9e93fa\") " pod="opendatahub/ai-gateway-controller-76ff884776-799m8"
Sep 17 01:54:23.037001 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:23.036972    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ws8x5\" (UniqueName: \"kubernetes.io/projected/5dba7335-1653-4401-ac06-13c11c9e93fa-kube-api-access-ws8x5\") pod \"ai-gateway-controller-76ff884776-799m8\" (UID: \"5dba7335-1653-4401-ac06-13c11c9e93fa\") " pod="opendatahub/ai-gateway-controller-76ff884776-799m8"
Sep 17 01:54:23.143290 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:23.143187    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-76ff884776-799m8"
Sep 17 01:54:23.409633 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:23.409223    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-76ff884776-799m8"]
Sep 17 01:54:23.412005 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:54:23.411975    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dba7335_1653_4401_ac06_13c11c9e93fa.slice/crio-999be1cbaa9466b57effd8e18a468746177f99d2f82bc15416d0ae35e91dc35b WatchSource:0}: Error finding container 999be1cbaa9466b57effd8e18a468746177f99d2f82bc15416d0ae35e91dc35b: Status 404 returned error can't find the container with id 999be1cbaa9466b57effd8e18a468746177f99d2f82bc15416d0ae35e91dc35b
Sep 17 01:54:24.365763 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:24.365718    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-76ff884776-799m8" event={"ID":"5dba7335-1653-4401-ac06-13c11c9e93fa","Type":"ContainerStarted","Data":"999be1cbaa9466b57effd8e18a468746177f99d2f82bc15416d0ae35e91dc35b"}
Sep 17 01:54:25.372467 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:25.372423    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-76ff884776-799m8" event={"ID":"5dba7335-1653-4401-ac06-13c11c9e93fa","Type":"ContainerStarted","Data":"888aa81771a605577ea7ee5e18ca70ffbe8f653ca848fcc37e6429c2ff42419d"}
Sep 17 01:54:25.372835 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:25.372508    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-76ff884776-799m8"
Sep 17 01:54:25.387158 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:25.387110    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-76ff884776-799m8" podStartSLOduration=2.173289177 podStartE2EDuration="3.387095286s" totalImagesPullingTime="1.213806109s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:54:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:54:25.385297612 +0000 UTC m=+1023.635274924" watchObservedRunningTime="2026-09-17 01:54:25.387095286 +0000 UTC m=+1023.637072599"
Sep 17 01:54:36.377690 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:36.377655    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-76ff884776-799m8"
Sep 17 01:54:36.850240 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:36.850205    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7cdffb474b-8cpk6"]
Sep 17 01:54:36.850453 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:36.850428    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7cdffb474b-8cpk6" podUID="415d68e5-19d5-44f0-b238-aa852a12cecd" containerName="manager" containerID="cri-o://08dc7d90138e994299aceac34db23e6a36728a682b1d4ca28a489185f05e1190" gracePeriod=30
Sep 17 01:54:37.088965 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:37.088938    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7cdffb474b-8cpk6"
Sep 17 01:54:37.256836 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:37.256743    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/415d68e5-19d5-44f0-b238-aa852a12cecd-metrics-certs\") pod \"415d68e5-19d5-44f0-b238-aa852a12cecd\" (UID: \"415d68e5-19d5-44f0-b238-aa852a12cecd\") "
Sep 17 01:54:37.256995 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:37.256861    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/415d68e5-19d5-44f0-b238-aa852a12cecd-webhook-cert\") pod \"415d68e5-19d5-44f0-b238-aa852a12cecd\" (UID: \"415d68e5-19d5-44f0-b238-aa852a12cecd\") "
Sep 17 01:54:37.256995 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:37.256967    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jwjmf\" (UniqueName: \"kubernetes.io/projected/415d68e5-19d5-44f0-b238-aa852a12cecd-kube-api-access-jwjmf\") pod \"415d68e5-19d5-44f0-b238-aa852a12cecd\" (UID: \"415d68e5-19d5-44f0-b238-aa852a12cecd\") "
Sep 17 01:54:37.258996 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:37.258965    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/415d68e5-19d5-44f0-b238-aa852a12cecd-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "415d68e5-19d5-44f0-b238-aa852a12cecd" (UID: "415d68e5-19d5-44f0-b238-aa852a12cecd"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 01:54:37.259114 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:37.259005    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/415d68e5-19d5-44f0-b238-aa852a12cecd-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "415d68e5-19d5-44f0-b238-aa852a12cecd" (UID: "415d68e5-19d5-44f0-b238-aa852a12cecd"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 01:54:37.259114 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:37.259010    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/415d68e5-19d5-44f0-b238-aa852a12cecd-kube-api-access-jwjmf" (OuterVolumeSpecName: "kube-api-access-jwjmf") pod "415d68e5-19d5-44f0-b238-aa852a12cecd" (UID: "415d68e5-19d5-44f0-b238-aa852a12cecd"). InnerVolumeSpecName "kube-api-access-jwjmf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:54:37.358575 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:37.358540    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/415d68e5-19d5-44f0-b238-aa852a12cecd-metrics-certs\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:54:37.358575 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:37.358567    2560 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/415d68e5-19d5-44f0-b238-aa852a12cecd-webhook-cert\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:54:37.358575 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:37.358576    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jwjmf\" (UniqueName: \"kubernetes.io/projected/415d68e5-19d5-44f0-b238-aa852a12cecd-kube-api-access-jwjmf\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:54:37.427823 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:37.427786    2560 generic.go:356] "Generic (PLEG): container finished" podID="415d68e5-19d5-44f0-b238-aa852a12cecd" containerID="08dc7d90138e994299aceac34db23e6a36728a682b1d4ca28a489185f05e1190" exitCode=0
Sep 17 01:54:37.428312 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:37.427841    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7cdffb474b-8cpk6"
Sep 17 01:54:37.428312 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:37.427869    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7cdffb474b-8cpk6" event={"ID":"415d68e5-19d5-44f0-b238-aa852a12cecd","Type":"ContainerDied","Data":"08dc7d90138e994299aceac34db23e6a36728a682b1d4ca28a489185f05e1190"}
Sep 17 01:54:37.428312 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:37.427919    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7cdffb474b-8cpk6" event={"ID":"415d68e5-19d5-44f0-b238-aa852a12cecd","Type":"ContainerDied","Data":"0aef0244e0222add14ed14a7b1a958209087f17b467bfc92ffb842f48ec4c845"}
Sep 17 01:54:37.428312 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:37.427943    2560 scope.go:117] "RemoveContainer" containerID="08dc7d90138e994299aceac34db23e6a36728a682b1d4ca28a489185f05e1190"
Sep 17 01:54:37.436929 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:37.436911    2560 scope.go:117] "RemoveContainer" containerID="08dc7d90138e994299aceac34db23e6a36728a682b1d4ca28a489185f05e1190"
Sep 17 01:54:37.437200 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:54:37.437180    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08dc7d90138e994299aceac34db23e6a36728a682b1d4ca28a489185f05e1190\": container with ID starting with 08dc7d90138e994299aceac34db23e6a36728a682b1d4ca28a489185f05e1190 not found: ID does not exist" containerID="08dc7d90138e994299aceac34db23e6a36728a682b1d4ca28a489185f05e1190"
Sep 17 01:54:37.437307 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:37.437205    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08dc7d90138e994299aceac34db23e6a36728a682b1d4ca28a489185f05e1190"} err="failed to get container status \"08dc7d90138e994299aceac34db23e6a36728a682b1d4ca28a489185f05e1190\": rpc error: code = NotFound desc = could not find container \"08dc7d90138e994299aceac34db23e6a36728a682b1d4ca28a489185f05e1190\": container with ID starting with 08dc7d90138e994299aceac34db23e6a36728a682b1d4ca28a489185f05e1190 not found: ID does not exist"
Sep 17 01:54:37.447259 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:37.447226    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7cdffb474b-8cpk6"]
Sep 17 01:54:37.450934 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:37.450916    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7cdffb474b-8cpk6"]
Sep 17 01:54:38.356967 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:38.356925    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="415d68e5-19d5-44f0-b238-aa852a12cecd" path="/var/lib/kubelet/pods/415d68e5-19d5-44f0-b238-aa852a12cecd/volumes"
Sep 17 01:54:43.172328 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:43.172299    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7cdffb474b-kkqz8"]
Sep 17 01:54:43.172771 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:43.172606    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="415d68e5-19d5-44f0-b238-aa852a12cecd" containerName="manager"
Sep 17 01:54:43.172771 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:43.172617    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="415d68e5-19d5-44f0-b238-aa852a12cecd" containerName="manager"
Sep 17 01:54:43.172771 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:43.172678    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="415d68e5-19d5-44f0-b238-aa852a12cecd" containerName="manager"
Sep 17 01:54:43.176788 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:43.176768    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7cdffb474b-kkqz8"
Sep 17 01:54:43.178693 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:43.178671    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 17 01:54:43.179023 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:43.179009    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 17 01:54:43.179397 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:43.179370    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 17 01:54:43.179506 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:43.179416    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-28j7d\""
Sep 17 01:54:43.191598 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:43.187877    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7cdffb474b-kkqz8"]
Sep 17 01:54:43.313289 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:43.313235    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59a2e6fe-f1d1-4774-90b4-98085ed0f1d9-metrics-certs\") pod \"maas-controller-7cdffb474b-kkqz8\" (UID: \"59a2e6fe-f1d1-4774-90b4-98085ed0f1d9\") " pod="opendatahub/maas-controller-7cdffb474b-kkqz8"
Sep 17 01:54:43.313449 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:43.313318    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/59a2e6fe-f1d1-4774-90b4-98085ed0f1d9-webhook-cert\") pod \"maas-controller-7cdffb474b-kkqz8\" (UID: \"59a2e6fe-f1d1-4774-90b4-98085ed0f1d9\") " pod="opendatahub/maas-controller-7cdffb474b-kkqz8"
Sep 17 01:54:43.313449 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:43.313354    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lk7bb\" (UniqueName: \"kubernetes.io/projected/59a2e6fe-f1d1-4774-90b4-98085ed0f1d9-kube-api-access-lk7bb\") pod \"maas-controller-7cdffb474b-kkqz8\" (UID: \"59a2e6fe-f1d1-4774-90b4-98085ed0f1d9\") " pod="opendatahub/maas-controller-7cdffb474b-kkqz8"
Sep 17 01:54:43.413951 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:43.413913    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59a2e6fe-f1d1-4774-90b4-98085ed0f1d9-metrics-certs\") pod \"maas-controller-7cdffb474b-kkqz8\" (UID: \"59a2e6fe-f1d1-4774-90b4-98085ed0f1d9\") " pod="opendatahub/maas-controller-7cdffb474b-kkqz8"
Sep 17 01:54:43.414105 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:43.413960    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/59a2e6fe-f1d1-4774-90b4-98085ed0f1d9-webhook-cert\") pod \"maas-controller-7cdffb474b-kkqz8\" (UID: \"59a2e6fe-f1d1-4774-90b4-98085ed0f1d9\") " pod="opendatahub/maas-controller-7cdffb474b-kkqz8"
Sep 17 01:54:43.414105 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:43.413990    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lk7bb\" (UniqueName: \"kubernetes.io/projected/59a2e6fe-f1d1-4774-90b4-98085ed0f1d9-kube-api-access-lk7bb\") pod \"maas-controller-7cdffb474b-kkqz8\" (UID: \"59a2e6fe-f1d1-4774-90b4-98085ed0f1d9\") " pod="opendatahub/maas-controller-7cdffb474b-kkqz8"
Sep 17 01:54:43.416540 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:43.416505    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/59a2e6fe-f1d1-4774-90b4-98085ed0f1d9-webhook-cert\") pod \"maas-controller-7cdffb474b-kkqz8\" (UID: \"59a2e6fe-f1d1-4774-90b4-98085ed0f1d9\") " pod="opendatahub/maas-controller-7cdffb474b-kkqz8"
Sep 17 01:54:43.416653 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:43.416505    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59a2e6fe-f1d1-4774-90b4-98085ed0f1d9-metrics-certs\") pod \"maas-controller-7cdffb474b-kkqz8\" (UID: \"59a2e6fe-f1d1-4774-90b4-98085ed0f1d9\") " pod="opendatahub/maas-controller-7cdffb474b-kkqz8"
Sep 17 01:54:43.421460 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:43.421437    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lk7bb\" (UniqueName: \"kubernetes.io/projected/59a2e6fe-f1d1-4774-90b4-98085ed0f1d9-kube-api-access-lk7bb\") pod \"maas-controller-7cdffb474b-kkqz8\" (UID: \"59a2e6fe-f1d1-4774-90b4-98085ed0f1d9\") " pod="opendatahub/maas-controller-7cdffb474b-kkqz8"
Sep 17 01:54:43.488343 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:43.488259    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7cdffb474b-kkqz8"
Sep 17 01:54:43.756416 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:43.756386    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7cdffb474b-kkqz8"]
Sep 17 01:54:43.758942 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:54:43.758912    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59a2e6fe_f1d1_4774_90b4_98085ed0f1d9.slice/crio-a812c7bfcd54d42329ed17a843bbafc3acb4ade07644cd5a053022f9884b9225 WatchSource:0}: Error finding container a812c7bfcd54d42329ed17a843bbafc3acb4ade07644cd5a053022f9884b9225: Status 404 returned error can't find the container with id a812c7bfcd54d42329ed17a843bbafc3acb4ade07644cd5a053022f9884b9225
Sep 17 01:54:44.459740 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:44.459648    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7cdffb474b-kkqz8" event={"ID":"59a2e6fe-f1d1-4774-90b4-98085ed0f1d9","Type":"ContainerStarted","Data":"50faf520a41168528b1dccea21a5810a04f55bda7b453dbbd682704a0e577901"}
Sep 17 01:54:44.459740 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:44.459709    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7cdffb474b-kkqz8" event={"ID":"59a2e6fe-f1d1-4774-90b4-98085ed0f1d9","Type":"ContainerStarted","Data":"a812c7bfcd54d42329ed17a843bbafc3acb4ade07644cd5a053022f9884b9225"}
Sep 17 01:54:44.460228 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:44.459788    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7cdffb474b-kkqz8"
Sep 17 01:54:44.474503 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:44.474423    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7cdffb474b-kkqz8" podStartSLOduration=1.137776849 podStartE2EDuration="1.474404928s" totalImagesPullingTime="336.628079ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:54:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:54:44.47372973 +0000 UTC m=+1042.723707045" watchObservedRunningTime="2026-09-17 01:54:44.474404928 +0000 UTC m=+1042.724382242"
Sep 17 01:54:55.466263 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:55.466208    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7cdffb474b-kkqz8"
Sep 17 01:54:55.927565 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:55.927530    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-587ff8bd8c-78n76"]
Sep 17 01:54:55.930801 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:55.930775    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-587ff8bd8c-78n76"
Sep 17 01:54:55.940706 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:55.940681    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-587ff8bd8c-78n76"]
Sep 17 01:54:56.021915 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:56.021869    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c4a6d44-a033-4d76-bf7c-a27ae32cb23a-metrics-certs\") pod \"maas-controller-587ff8bd8c-78n76\" (UID: \"3c4a6d44-a033-4d76-bf7c-a27ae32cb23a\") " pod="opendatahub/maas-controller-587ff8bd8c-78n76"
Sep 17 01:54:56.022087 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:56.021970    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxps7\" (UniqueName: \"kubernetes.io/projected/3c4a6d44-a033-4d76-bf7c-a27ae32cb23a-kube-api-access-dxps7\") pod \"maas-controller-587ff8bd8c-78n76\" (UID: \"3c4a6d44-a033-4d76-bf7c-a27ae32cb23a\") " pod="opendatahub/maas-controller-587ff8bd8c-78n76"
Sep 17 01:54:56.022087 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:56.021997    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3c4a6d44-a033-4d76-bf7c-a27ae32cb23a-webhook-cert\") pod \"maas-controller-587ff8bd8c-78n76\" (UID: \"3c4a6d44-a033-4d76-bf7c-a27ae32cb23a\") " pod="opendatahub/maas-controller-587ff8bd8c-78n76"
Sep 17 01:54:56.123416 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:56.123377    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxps7\" (UniqueName: \"kubernetes.io/projected/3c4a6d44-a033-4d76-bf7c-a27ae32cb23a-kube-api-access-dxps7\") pod \"maas-controller-587ff8bd8c-78n76\" (UID: \"3c4a6d44-a033-4d76-bf7c-a27ae32cb23a\") " pod="opendatahub/maas-controller-587ff8bd8c-78n76"
Sep 17 01:54:56.123416 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:56.123423    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3c4a6d44-a033-4d76-bf7c-a27ae32cb23a-webhook-cert\") pod \"maas-controller-587ff8bd8c-78n76\" (UID: \"3c4a6d44-a033-4d76-bf7c-a27ae32cb23a\") " pod="opendatahub/maas-controller-587ff8bd8c-78n76"
Sep 17 01:54:56.123613 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:56.123548    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c4a6d44-a033-4d76-bf7c-a27ae32cb23a-metrics-certs\") pod \"maas-controller-587ff8bd8c-78n76\" (UID: \"3c4a6d44-a033-4d76-bf7c-a27ae32cb23a\") " pod="opendatahub/maas-controller-587ff8bd8c-78n76"
Sep 17 01:54:56.125897 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:56.125871    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c4a6d44-a033-4d76-bf7c-a27ae32cb23a-metrics-certs\") pod \"maas-controller-587ff8bd8c-78n76\" (UID: \"3c4a6d44-a033-4d76-bf7c-a27ae32cb23a\") " pod="opendatahub/maas-controller-587ff8bd8c-78n76"
Sep 17 01:54:56.126005 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:56.125929    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3c4a6d44-a033-4d76-bf7c-a27ae32cb23a-webhook-cert\") pod \"maas-controller-587ff8bd8c-78n76\" (UID: \"3c4a6d44-a033-4d76-bf7c-a27ae32cb23a\") " pod="opendatahub/maas-controller-587ff8bd8c-78n76"
Sep 17 01:54:56.130240 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:56.130213    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxps7\" (UniqueName: \"kubernetes.io/projected/3c4a6d44-a033-4d76-bf7c-a27ae32cb23a-kube-api-access-dxps7\") pod \"maas-controller-587ff8bd8c-78n76\" (UID: \"3c4a6d44-a033-4d76-bf7c-a27ae32cb23a\") " pod="opendatahub/maas-controller-587ff8bd8c-78n76"
Sep 17 01:54:56.241751 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:56.241657    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-587ff8bd8c-78n76"
Sep 17 01:54:56.512492 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:56.512470    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-587ff8bd8c-78n76"]
Sep 17 01:54:56.515144 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:54:56.515117    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c4a6d44_a033_4d76_bf7c_a27ae32cb23a.slice/crio-7139a1c8edcbc5cdff64e5b2680365aca55bc2925ca0ad0ebd5f40fd8557ba16 WatchSource:0}: Error finding container 7139a1c8edcbc5cdff64e5b2680365aca55bc2925ca0ad0ebd5f40fd8557ba16: Status 404 returned error can't find the container with id 7139a1c8edcbc5cdff64e5b2680365aca55bc2925ca0ad0ebd5f40fd8557ba16
Sep 17 01:54:57.517823 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:57.517785    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-587ff8bd8c-78n76" event={"ID":"3c4a6d44-a033-4d76-bf7c-a27ae32cb23a","Type":"ContainerStarted","Data":"5c180546e55d41e30a014f53b59960ef65e9ace4d8d26e7f82d83e6b3c176c01"}
Sep 17 01:54:57.518211 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:57.517838    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-587ff8bd8c-78n76" event={"ID":"3c4a6d44-a033-4d76-bf7c-a27ae32cb23a","Type":"ContainerStarted","Data":"7139a1c8edcbc5cdff64e5b2680365aca55bc2925ca0ad0ebd5f40fd8557ba16"}
Sep 17 01:54:57.518211 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:57.517897    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-587ff8bd8c-78n76"
Sep 17 01:54:57.533012 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:54:57.532962    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-587ff8bd8c-78n76" podStartSLOduration=2.209737416 podStartE2EDuration="2.532946521s" totalImagesPullingTime="323.209105ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:54:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:54:57.531846118 +0000 UTC m=+1055.781823431" watchObservedRunningTime="2026-09-17 01:54:57.532946521 +0000 UTC m=+1055.782923833"
Sep 17 01:55:08.524397 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:08.524362    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-587ff8bd8c-78n76"
Sep 17 01:55:08.564552 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:08.564516    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7cdffb474b-kkqz8"]
Sep 17 01:55:08.564803 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:08.564779    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7cdffb474b-kkqz8" podUID="59a2e6fe-f1d1-4774-90b4-98085ed0f1d9" containerName="manager" containerID="cri-o://50faf520a41168528b1dccea21a5810a04f55bda7b453dbbd682704a0e577901" gracePeriod=30
Sep 17 01:55:08.808632 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:08.808607    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7cdffb474b-kkqz8"
Sep 17 01:55:08.941867 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:08.941831    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lk7bb\" (UniqueName: \"kubernetes.io/projected/59a2e6fe-f1d1-4774-90b4-98085ed0f1d9-kube-api-access-lk7bb\") pod \"59a2e6fe-f1d1-4774-90b4-98085ed0f1d9\" (UID: \"59a2e6fe-f1d1-4774-90b4-98085ed0f1d9\") "
Sep 17 01:55:08.941867 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:08.941872    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59a2e6fe-f1d1-4774-90b4-98085ed0f1d9-metrics-certs\") pod \"59a2e6fe-f1d1-4774-90b4-98085ed0f1d9\" (UID: \"59a2e6fe-f1d1-4774-90b4-98085ed0f1d9\") "
Sep 17 01:55:08.942110 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:08.941925    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/59a2e6fe-f1d1-4774-90b4-98085ed0f1d9-webhook-cert\") pod \"59a2e6fe-f1d1-4774-90b4-98085ed0f1d9\" (UID: \"59a2e6fe-f1d1-4774-90b4-98085ed0f1d9\") "
Sep 17 01:55:08.943962 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:08.943931    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59a2e6fe-f1d1-4774-90b4-98085ed0f1d9-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "59a2e6fe-f1d1-4774-90b4-98085ed0f1d9" (UID: "59a2e6fe-f1d1-4774-90b4-98085ed0f1d9"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 01:55:08.944082 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:08.943974    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59a2e6fe-f1d1-4774-90b4-98085ed0f1d9-kube-api-access-lk7bb" (OuterVolumeSpecName: "kube-api-access-lk7bb") pod "59a2e6fe-f1d1-4774-90b4-98085ed0f1d9" (UID: "59a2e6fe-f1d1-4774-90b4-98085ed0f1d9"). InnerVolumeSpecName "kube-api-access-lk7bb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:55:08.944082 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:08.944021    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59a2e6fe-f1d1-4774-90b4-98085ed0f1d9-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "59a2e6fe-f1d1-4774-90b4-98085ed0f1d9" (UID: "59a2e6fe-f1d1-4774-90b4-98085ed0f1d9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 01:55:09.043030 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:09.042945    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lk7bb\" (UniqueName: \"kubernetes.io/projected/59a2e6fe-f1d1-4774-90b4-98085ed0f1d9-kube-api-access-lk7bb\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:55:09.043030 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:09.042973    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59a2e6fe-f1d1-4774-90b4-98085ed0f1d9-metrics-certs\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:55:09.043030 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:09.042982    2560 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/59a2e6fe-f1d1-4774-90b4-98085ed0f1d9-webhook-cert\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:55:09.577059 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:09.577020    2560 generic.go:356] "Generic (PLEG): container finished" podID="59a2e6fe-f1d1-4774-90b4-98085ed0f1d9" containerID="50faf520a41168528b1dccea21a5810a04f55bda7b453dbbd682704a0e577901" exitCode=0
Sep 17 01:55:09.577466 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:09.577069    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7cdffb474b-kkqz8"
Sep 17 01:55:09.577466 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:09.577108    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7cdffb474b-kkqz8" event={"ID":"59a2e6fe-f1d1-4774-90b4-98085ed0f1d9","Type":"ContainerDied","Data":"50faf520a41168528b1dccea21a5810a04f55bda7b453dbbd682704a0e577901"}
Sep 17 01:55:09.577466 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:09.577164    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7cdffb474b-kkqz8" event={"ID":"59a2e6fe-f1d1-4774-90b4-98085ed0f1d9","Type":"ContainerDied","Data":"a812c7bfcd54d42329ed17a843bbafc3acb4ade07644cd5a053022f9884b9225"}
Sep 17 01:55:09.577466 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:09.577193    2560 scope.go:117] "RemoveContainer" containerID="50faf520a41168528b1dccea21a5810a04f55bda7b453dbbd682704a0e577901"
Sep 17 01:55:09.585798 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:09.585783    2560 scope.go:117] "RemoveContainer" containerID="50faf520a41168528b1dccea21a5810a04f55bda7b453dbbd682704a0e577901"
Sep 17 01:55:09.586075 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:55:09.586056    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50faf520a41168528b1dccea21a5810a04f55bda7b453dbbd682704a0e577901\": container with ID starting with 50faf520a41168528b1dccea21a5810a04f55bda7b453dbbd682704a0e577901 not found: ID does not exist" containerID="50faf520a41168528b1dccea21a5810a04f55bda7b453dbbd682704a0e577901"
Sep 17 01:55:09.586145 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:09.586084    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50faf520a41168528b1dccea21a5810a04f55bda7b453dbbd682704a0e577901"} err="failed to get container status \"50faf520a41168528b1dccea21a5810a04f55bda7b453dbbd682704a0e577901\": rpc error: code = NotFound desc = could not find container \"50faf520a41168528b1dccea21a5810a04f55bda7b453dbbd682704a0e577901\": container with ID starting with 50faf520a41168528b1dccea21a5810a04f55bda7b453dbbd682704a0e577901 not found: ID does not exist"
Sep 17 01:55:09.597541 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:09.597515    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7cdffb474b-kkqz8"]
Sep 17 01:55:09.599769 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:09.599746    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7cdffb474b-kkqz8"]
Sep 17 01:55:10.356798 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:10.356768    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59a2e6fe-f1d1-4774-90b4-98085ed0f1d9" path="/var/lib/kubelet/pods/59a2e6fe-f1d1-4774-90b4-98085ed0f1d9/volumes"
Sep 17 01:55:27.380754 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.380720    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb"]
Sep 17 01:55:27.381165 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.381113    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59a2e6fe-f1d1-4774-90b4-98085ed0f1d9" containerName="manager"
Sep 17 01:55:27.381165 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.381126    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="59a2e6fe-f1d1-4774-90b4-98085ed0f1d9" containerName="manager"
Sep 17 01:55:27.381268 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.381184    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="59a2e6fe-f1d1-4774-90b4-98085ed0f1d9" containerName="manager"
Sep 17 01:55:27.384276 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.384226    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb"
Sep 17 01:55:27.386908 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.386838    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-3f027f-openshift-default-dockercfg-9lkj4\""
Sep 17 01:55:27.396362 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.396326    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb"]
Sep 17 01:55:27.503360 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.503321    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkql4\" (UniqueName: \"kubernetes.io/projected/d04475df-65f2-423a-9a29-d015ea63b35f-kube-api-access-qkql4\") pod \"e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb\" (UID: \"d04475df-65f2-423a-9a29-d015ea63b35f\") " pod="openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb"
Sep 17 01:55:27.503360 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.503362    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d04475df-65f2-423a-9a29-d015ea63b35f-istio-data\") pod \"e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb\" (UID: \"d04475df-65f2-423a-9a29-d015ea63b35f\") " pod="openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb"
Sep 17 01:55:27.503610 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.503393    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d04475df-65f2-423a-9a29-d015ea63b35f-istiod-ca-cert\") pod \"e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb\" (UID: \"d04475df-65f2-423a-9a29-d015ea63b35f\") " pod="openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb"
Sep 17 01:55:27.503610 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.503463    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d04475df-65f2-423a-9a29-d015ea63b35f-workload-certs\") pod \"e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb\" (UID: \"d04475df-65f2-423a-9a29-d015ea63b35f\") " pod="openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb"
Sep 17 01:55:27.503610 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.503517    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d04475df-65f2-423a-9a29-d015ea63b35f-credential-socket\") pod \"e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb\" (UID: \"d04475df-65f2-423a-9a29-d015ea63b35f\") " pod="openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb"
Sep 17 01:55:27.503790 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.503618    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d04475df-65f2-423a-9a29-d015ea63b35f-istio-podinfo\") pod \"e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb\" (UID: \"d04475df-65f2-423a-9a29-d015ea63b35f\") " pod="openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb"
Sep 17 01:55:27.503790 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.503700    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d04475df-65f2-423a-9a29-d015ea63b35f-istio-token\") pod \"e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb\" (UID: \"d04475df-65f2-423a-9a29-d015ea63b35f\") " pod="openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb"
Sep 17 01:55:27.503790 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.503731    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d04475df-65f2-423a-9a29-d015ea63b35f-istio-envoy\") pod \"e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb\" (UID: \"d04475df-65f2-423a-9a29-d015ea63b35f\") " pod="openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb"
Sep 17 01:55:27.503790 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.503781    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d04475df-65f2-423a-9a29-d015ea63b35f-workload-socket\") pod \"e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb\" (UID: \"d04475df-65f2-423a-9a29-d015ea63b35f\") " pod="openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb"
Sep 17 01:55:27.523202 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.523166    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5"]
Sep 17 01:55:27.526672 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.526645    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5"
Sep 17 01:55:27.528593 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.528564    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-e564e1-openshift-default-dockercfg-7w4zg\""
Sep 17 01:55:27.539313 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.539284    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5"]
Sep 17 01:55:27.604971 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.604929    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkql4\" (UniqueName: \"kubernetes.io/projected/d04475df-65f2-423a-9a29-d015ea63b35f-kube-api-access-qkql4\") pod \"e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb\" (UID: \"d04475df-65f2-423a-9a29-d015ea63b35f\") " pod="openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb"
Sep 17 01:55:27.604971 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.604975    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d04475df-65f2-423a-9a29-d015ea63b35f-istio-data\") pod \"e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb\" (UID: \"d04475df-65f2-423a-9a29-d015ea63b35f\") " pod="openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb"
Sep 17 01:55:27.605226 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.605015    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d04475df-65f2-423a-9a29-d015ea63b35f-istiod-ca-cert\") pod \"e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb\" (UID: \"d04475df-65f2-423a-9a29-d015ea63b35f\") " pod="openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb"
Sep 17 01:55:27.605226 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.605044    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d04475df-65f2-423a-9a29-d015ea63b35f-workload-certs\") pod \"e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb\" (UID: \"d04475df-65f2-423a-9a29-d015ea63b35f\") " pod="openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb"
Sep 17 01:55:27.605226 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.605077    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d04475df-65f2-423a-9a29-d015ea63b35f-credential-socket\") pod \"e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb\" (UID: \"d04475df-65f2-423a-9a29-d015ea63b35f\") " pod="openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb"
Sep 17 01:55:27.605405 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.605237    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d04475df-65f2-423a-9a29-d015ea63b35f-istio-podinfo\") pod \"e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb\" (UID: \"d04475df-65f2-423a-9a29-d015ea63b35f\") " pod="openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb"
Sep 17 01:55:27.605405 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.605339    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d04475df-65f2-423a-9a29-d015ea63b35f-istio-token\") pod \"e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb\" (UID: \"d04475df-65f2-423a-9a29-d015ea63b35f\") " pod="openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb"
Sep 17 01:55:27.605405 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.605371    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d04475df-65f2-423a-9a29-d015ea63b35f-istio-envoy\") pod \"e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb\" (UID: \"d04475df-65f2-423a-9a29-d015ea63b35f\") " pod="openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb"
Sep 17 01:55:27.605570 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.605404    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d04475df-65f2-423a-9a29-d015ea63b35f-workload-socket\") pod \"e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb\" (UID: \"d04475df-65f2-423a-9a29-d015ea63b35f\") " pod="openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb"
Sep 17 01:55:27.605570 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.605496    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d04475df-65f2-423a-9a29-d015ea63b35f-istio-data\") pod \"e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb\" (UID: \"d04475df-65f2-423a-9a29-d015ea63b35f\") " pod="openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb"
Sep 17 01:55:27.605680 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.605576    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d04475df-65f2-423a-9a29-d015ea63b35f-workload-certs\") pod \"e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb\" (UID: \"d04475df-65f2-423a-9a29-d015ea63b35f\") " pod="openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb"
Sep 17 01:55:27.605680 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.605616    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d04475df-65f2-423a-9a29-d015ea63b35f-credential-socket\") pod \"e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb\" (UID: \"d04475df-65f2-423a-9a29-d015ea63b35f\") " pod="openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb"
Sep 17 01:55:27.605797 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.605775    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d04475df-65f2-423a-9a29-d015ea63b35f-workload-socket\") pod \"e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb\" (UID: \"d04475df-65f2-423a-9a29-d015ea63b35f\") " pod="openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb"
Sep 17 01:55:27.605842 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.605816    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d04475df-65f2-423a-9a29-d015ea63b35f-istiod-ca-cert\") pod \"e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb\" (UID: \"d04475df-65f2-423a-9a29-d015ea63b35f\") " pod="openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb"
Sep 17 01:55:27.607675 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.607656    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d04475df-65f2-423a-9a29-d015ea63b35f-istio-envoy\") pod \"e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb\" (UID: \"d04475df-65f2-423a-9a29-d015ea63b35f\") " pod="openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb"
Sep 17 01:55:27.607797 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.607777    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d04475df-65f2-423a-9a29-d015ea63b35f-istio-podinfo\") pod \"e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb\" (UID: \"d04475df-65f2-423a-9a29-d015ea63b35f\") " pod="openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb"
Sep 17 01:55:27.612031 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.612001    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d04475df-65f2-423a-9a29-d015ea63b35f-istio-token\") pod \"e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb\" (UID: \"d04475df-65f2-423a-9a29-d015ea63b35f\") " pod="openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb"
Sep 17 01:55:27.612552 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.612532    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkql4\" (UniqueName: \"kubernetes.io/projected/d04475df-65f2-423a-9a29-d015ea63b35f-kube-api-access-qkql4\") pod \"e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb\" (UID: \"d04475df-65f2-423a-9a29-d015ea63b35f\") " pod="openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb"
Sep 17 01:55:27.697176 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.697087    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb"
Sep 17 01:55:27.705897 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.705867    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04476ca5-bc8f-4e8e-b711-835ce6e40037-istio-envoy\") pod \"e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5\" (UID: \"04476ca5-bc8f-4e8e-b711-835ce6e40037\") " pod="openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5"
Sep 17 01:55:27.706025 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.705907    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04476ca5-bc8f-4e8e-b711-835ce6e40037-workload-certs\") pod \"e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5\" (UID: \"04476ca5-bc8f-4e8e-b711-835ce6e40037\") " pod="openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5"
Sep 17 01:55:27.706025 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.705925    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04476ca5-bc8f-4e8e-b711-835ce6e40037-istiod-ca-cert\") pod \"e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5\" (UID: \"04476ca5-bc8f-4e8e-b711-835ce6e40037\") " pod="openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5"
Sep 17 01:55:27.706025 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.705987    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04476ca5-bc8f-4e8e-b711-835ce6e40037-istio-data\") pod \"e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5\" (UID: \"04476ca5-bc8f-4e8e-b711-835ce6e40037\") " pod="openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5"
Sep 17 01:55:27.706130 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.706081    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrlws\" (UniqueName: \"kubernetes.io/projected/04476ca5-bc8f-4e8e-b711-835ce6e40037-kube-api-access-xrlws\") pod \"e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5\" (UID: \"04476ca5-bc8f-4e8e-b711-835ce6e40037\") " pod="openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5"
Sep 17 01:55:27.706130 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.706122    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04476ca5-bc8f-4e8e-b711-835ce6e40037-credential-socket\") pod \"e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5\" (UID: \"04476ca5-bc8f-4e8e-b711-835ce6e40037\") " pod="openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5"
Sep 17 01:55:27.706194 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.706138    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04476ca5-bc8f-4e8e-b711-835ce6e40037-istio-podinfo\") pod \"e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5\" (UID: \"04476ca5-bc8f-4e8e-b711-835ce6e40037\") " pod="openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5"
Sep 17 01:55:27.706298 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.706266    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04476ca5-bc8f-4e8e-b711-835ce6e40037-workload-socket\") pod \"e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5\" (UID: \"04476ca5-bc8f-4e8e-b711-835ce6e40037\") " pod="openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5"
Sep 17 01:55:27.706359 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.706339    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04476ca5-bc8f-4e8e-b711-835ce6e40037-istio-token\") pod \"e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5\" (UID: \"04476ca5-bc8f-4e8e-b711-835ce6e40037\") " pod="openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5"
Sep 17 01:55:27.807737 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.807698    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04476ca5-bc8f-4e8e-b711-835ce6e40037-istio-token\") pod \"e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5\" (UID: \"04476ca5-bc8f-4e8e-b711-835ce6e40037\") " pod="openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5"
Sep 17 01:55:27.807737 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.807747    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04476ca5-bc8f-4e8e-b711-835ce6e40037-istio-envoy\") pod \"e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5\" (UID: \"04476ca5-bc8f-4e8e-b711-835ce6e40037\") " pod="openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5"
Sep 17 01:55:27.807933 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.807844    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04476ca5-bc8f-4e8e-b711-835ce6e40037-workload-certs\") pod \"e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5\" (UID: \"04476ca5-bc8f-4e8e-b711-835ce6e40037\") " pod="openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5"
Sep 17 01:55:27.807933 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.807874    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04476ca5-bc8f-4e8e-b711-835ce6e40037-istiod-ca-cert\") pod \"e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5\" (UID: \"04476ca5-bc8f-4e8e-b711-835ce6e40037\") " pod="openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5"
Sep 17 01:55:27.807933 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.807903    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04476ca5-bc8f-4e8e-b711-835ce6e40037-istio-data\") pod \"e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5\" (UID: \"04476ca5-bc8f-4e8e-b711-835ce6e40037\") " pod="openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5"
Sep 17 01:55:27.807933 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.807923    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrlws\" (UniqueName: \"kubernetes.io/projected/04476ca5-bc8f-4e8e-b711-835ce6e40037-kube-api-access-xrlws\") pod \"e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5\" (UID: \"04476ca5-bc8f-4e8e-b711-835ce6e40037\") " pod="openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5"
Sep 17 01:55:27.808120 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.807954    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04476ca5-bc8f-4e8e-b711-835ce6e40037-credential-socket\") pod \"e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5\" (UID: \"04476ca5-bc8f-4e8e-b711-835ce6e40037\") " pod="openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5"
Sep 17 01:55:27.808120 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.808064    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04476ca5-bc8f-4e8e-b711-835ce6e40037-istio-podinfo\") pod \"e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5\" (UID: \"04476ca5-bc8f-4e8e-b711-835ce6e40037\") " pod="openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5"
Sep 17 01:55:27.808224 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.808162    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04476ca5-bc8f-4e8e-b711-835ce6e40037-workload-socket\") pod \"e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5\" (UID: \"04476ca5-bc8f-4e8e-b711-835ce6e40037\") " pod="openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5"
Sep 17 01:55:27.808378 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.808347    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04476ca5-bc8f-4e8e-b711-835ce6e40037-workload-certs\") pod \"e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5\" (UID: \"04476ca5-bc8f-4e8e-b711-835ce6e40037\") " pod="openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5"
Sep 17 01:55:27.808445 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.808386    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04476ca5-bc8f-4e8e-b711-835ce6e40037-credential-socket\") pod \"e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5\" (UID: \"04476ca5-bc8f-4e8e-b711-835ce6e40037\") " pod="openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5"
Sep 17 01:55:27.808506 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.808437    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04476ca5-bc8f-4e8e-b711-835ce6e40037-istio-data\") pod \"e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5\" (UID: \"04476ca5-bc8f-4e8e-b711-835ce6e40037\") " pod="openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5"
Sep 17 01:55:27.808586 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.808565    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04476ca5-bc8f-4e8e-b711-835ce6e40037-workload-socket\") pod \"e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5\" (UID: \"04476ca5-bc8f-4e8e-b711-835ce6e40037\") " pod="openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5"
Sep 17 01:55:27.808656 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.808637    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04476ca5-bc8f-4e8e-b711-835ce6e40037-istiod-ca-cert\") pod \"e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5\" (UID: \"04476ca5-bc8f-4e8e-b711-835ce6e40037\") " pod="openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5"
Sep 17 01:55:27.810192 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.810163    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04476ca5-bc8f-4e8e-b711-835ce6e40037-istio-envoy\") pod \"e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5\" (UID: \"04476ca5-bc8f-4e8e-b711-835ce6e40037\") " pod="openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5"
Sep 17 01:55:27.810628 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.810612    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04476ca5-bc8f-4e8e-b711-835ce6e40037-istio-podinfo\") pod \"e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5\" (UID: \"04476ca5-bc8f-4e8e-b711-835ce6e40037\") " pod="openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5"
Sep 17 01:55:27.815735 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.815716    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04476ca5-bc8f-4e8e-b711-835ce6e40037-istio-token\") pod \"e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5\" (UID: \"04476ca5-bc8f-4e8e-b711-835ce6e40037\") " pod="openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5"
Sep 17 01:55:27.815943 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.815921    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrlws\" (UniqueName: \"kubernetes.io/projected/04476ca5-bc8f-4e8e-b711-835ce6e40037-kube-api-access-xrlws\") pod \"e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5\" (UID: \"04476ca5-bc8f-4e8e-b711-835ce6e40037\") " pod="openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5"
Sep 17 01:55:27.837960 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.837932    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5"
Sep 17 01:55:27.973832 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:27.973804    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb"]
Sep 17 01:55:27.975969 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:55:27.975935    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd04475df_65f2_423a_9a29_d015ea63b35f.slice/crio-5d0d05491694bc6d7772e18fc1da8be2a915b3fa8444ed9e1e973d90b5ea24de WatchSource:0}: Error finding container 5d0d05491694bc6d7772e18fc1da8be2a915b3fa8444ed9e1e973d90b5ea24de: Status 404 returned error can't find the container with id 5d0d05491694bc6d7772e18fc1da8be2a915b3fa8444ed9e1e973d90b5ea24de
Sep 17 01:55:28.116744 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:28.116717    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5"]
Sep 17 01:55:28.118320 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:55:28.118293    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04476ca5_bc8f_4e8e_b711_835ce6e40037.slice/crio-74dcbe2b47504cd18464deff3c63083fdd0ac083b5ed29095d8b3ae4ebc82aa5 WatchSource:0}: Error finding container 74dcbe2b47504cd18464deff3c63083fdd0ac083b5ed29095d8b3ae4ebc82aa5: Status 404 returned error can't find the container with id 74dcbe2b47504cd18464deff3c63083fdd0ac083b5ed29095d8b3ae4ebc82aa5
Sep 17 01:55:28.666876 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:28.666837    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb" event={"ID":"d04475df-65f2-423a-9a29-d015ea63b35f","Type":"ContainerStarted","Data":"5d0d05491694bc6d7772e18fc1da8be2a915b3fa8444ed9e1e973d90b5ea24de"}
Sep 17 01:55:28.668305 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:28.668277    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5" event={"ID":"04476ca5-bc8f-4e8e-b711-835ce6e40037","Type":"ContainerStarted","Data":"74dcbe2b47504cd18464deff3c63083fdd0ac083b5ed29095d8b3ae4ebc82aa5"}
Sep 17 01:55:31.126132 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:31.126092    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 01:55:31.126456 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:31.126199    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 01:55:31.126456 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:31.126231    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 01:55:31.132135 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:31.132102    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 01:55:31.132241 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:31.132224    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 01:55:31.132318 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:31.132289    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 01:55:31.685602 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:31.685560    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb" event={"ID":"d04475df-65f2-423a-9a29-d015ea63b35f","Type":"ContainerStarted","Data":"5e37821884b329800b7db87e6dc51a147549eda9bb2715ca08a1fd4c88639506"}
Sep 17 01:55:31.687323 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:31.687294    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5" event={"ID":"04476ca5-bc8f-4e8e-b711-835ce6e40037","Type":"ContainerStarted","Data":"c4fc3472e2ae7bdee2ebae532d53fca16e802062b1babc86e143aba89c5463ab"}
Sep 17 01:55:31.697909 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:31.697886    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb"
Sep 17 01:55:31.709910 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:31.709861    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb" podStartSLOduration=1.562432116 podStartE2EDuration="4.7098451s" totalImagesPullingTime="3.147412984s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:55:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:55:31.707658016 +0000 UTC m=+1089.957635331" watchObservedRunningTime="2026-09-17 01:55:31.7098451 +0000 UTC m=+1089.959822413"
Sep 17 01:55:31.732680 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:31.732623    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5" podStartSLOduration=1.721237658 podStartE2EDuration="4.7326084s" totalImagesPullingTime="3.011370742s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:55:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:55:31.731035065 +0000 UTC m=+1089.981012379" watchObservedRunningTime="2026-09-17 01:55:31.7326084 +0000 UTC m=+1089.982585713"
Sep 17 01:55:31.838089 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:31.838052    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5"
Sep 17 01:55:32.300609 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:32.300574    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-38758b-5f864bfd54-sbrht"]
Sep 17 01:55:32.303955 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:32.303933    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-38758b-5f864bfd54-sbrht"
Sep 17 01:55:32.305823 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:32.305797    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-38758b-serving-cert\""
Sep 17 01:55:32.315488 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:32.315462    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-38758b-5f864bfd54-sbrht"]
Sep 17 01:55:32.450580 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:32.450540    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99ac56e3-41a0-4975-aa73-13b391b438dd-maas-api-tls\") pod \"maas-api-e2e-inf-a-38758b-5f864bfd54-sbrht\" (UID: \"99ac56e3-41a0-4975-aa73-13b391b438dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-38758b-5f864bfd54-sbrht"
Sep 17 01:55:32.450580 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:32.450587    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/99ac56e3-41a0-4975-aa73-13b391b438dd-openshift-service-ca\") pod \"maas-api-e2e-inf-a-38758b-5f864bfd54-sbrht\" (UID: \"99ac56e3-41a0-4975-aa73-13b391b438dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-38758b-5f864bfd54-sbrht"
Sep 17 01:55:32.450806 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:32.450629    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfb6g\" (UniqueName: \"kubernetes.io/projected/99ac56e3-41a0-4975-aa73-13b391b438dd-kube-api-access-zfb6g\") pod \"maas-api-e2e-inf-a-38758b-5f864bfd54-sbrht\" (UID: \"99ac56e3-41a0-4975-aa73-13b391b438dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-38758b-5f864bfd54-sbrht"
Sep 17 01:55:32.450806 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:32.450660    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99ac56e3-41a0-4975-aa73-13b391b438dd-metrics-certs\") pod \"maas-api-e2e-inf-a-38758b-5f864bfd54-sbrht\" (UID: \"99ac56e3-41a0-4975-aa73-13b391b438dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-38758b-5f864bfd54-sbrht"
Sep 17 01:55:32.551562 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:32.551486    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/99ac56e3-41a0-4975-aa73-13b391b438dd-openshift-service-ca\") pod \"maas-api-e2e-inf-a-38758b-5f864bfd54-sbrht\" (UID: \"99ac56e3-41a0-4975-aa73-13b391b438dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-38758b-5f864bfd54-sbrht"
Sep 17 01:55:32.551562 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:32.551536    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfb6g\" (UniqueName: \"kubernetes.io/projected/99ac56e3-41a0-4975-aa73-13b391b438dd-kube-api-access-zfb6g\") pod \"maas-api-e2e-inf-a-38758b-5f864bfd54-sbrht\" (UID: \"99ac56e3-41a0-4975-aa73-13b391b438dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-38758b-5f864bfd54-sbrht"
Sep 17 01:55:32.551746 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:32.551573    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99ac56e3-41a0-4975-aa73-13b391b438dd-metrics-certs\") pod \"maas-api-e2e-inf-a-38758b-5f864bfd54-sbrht\" (UID: \"99ac56e3-41a0-4975-aa73-13b391b438dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-38758b-5f864bfd54-sbrht"
Sep 17 01:55:32.551746 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:32.551615    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99ac56e3-41a0-4975-aa73-13b391b438dd-maas-api-tls\") pod \"maas-api-e2e-inf-a-38758b-5f864bfd54-sbrht\" (UID: \"99ac56e3-41a0-4975-aa73-13b391b438dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-38758b-5f864bfd54-sbrht"
Sep 17 01:55:32.552296 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:32.552276    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/99ac56e3-41a0-4975-aa73-13b391b438dd-openshift-service-ca\") pod \"maas-api-e2e-inf-a-38758b-5f864bfd54-sbrht\" (UID: \"99ac56e3-41a0-4975-aa73-13b391b438dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-38758b-5f864bfd54-sbrht"
Sep 17 01:55:32.554126 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:32.554103    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99ac56e3-41a0-4975-aa73-13b391b438dd-metrics-certs\") pod \"maas-api-e2e-inf-a-38758b-5f864bfd54-sbrht\" (UID: \"99ac56e3-41a0-4975-aa73-13b391b438dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-38758b-5f864bfd54-sbrht"
Sep 17 01:55:32.554227 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:32.554137    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99ac56e3-41a0-4975-aa73-13b391b438dd-maas-api-tls\") pod \"maas-api-e2e-inf-a-38758b-5f864bfd54-sbrht\" (UID: \"99ac56e3-41a0-4975-aa73-13b391b438dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-38758b-5f864bfd54-sbrht"
Sep 17 01:55:32.562439 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:32.562415    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfb6g\" (UniqueName: \"kubernetes.io/projected/99ac56e3-41a0-4975-aa73-13b391b438dd-kube-api-access-zfb6g\") pod \"maas-api-e2e-inf-a-38758b-5f864bfd54-sbrht\" (UID: \"99ac56e3-41a0-4975-aa73-13b391b438dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-38758b-5f864bfd54-sbrht"
Sep 17 01:55:32.615519 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:32.615486    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-38758b-5f864bfd54-sbrht"
Sep 17 01:55:32.702392 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:32.702363    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb"
Sep 17 01:55:32.843690 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:32.843661    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5"
Sep 17 01:55:32.893119 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:32.893094    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-38758b-5f864bfd54-sbrht"]
Sep 17 01:55:32.895228 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:55:32.895198    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99ac56e3_41a0_4975_aa73_13b391b438dd.slice/crio-217444fa924480666604e732d255697166e17f89d4759a2db4aabeb82adf92ce WatchSource:0}: Error finding container 217444fa924480666604e732d255697166e17f89d4759a2db4aabeb82adf92ce: Status 404 returned error can't find the container with id 217444fa924480666604e732d255697166e17f89d4759a2db4aabeb82adf92ce
Sep 17 01:55:33.112181 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:33.112107    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-38758b-8564ff96c-7f24n"]
Sep 17 01:55:33.116901 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:33.116881    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-38758b-8564ff96c-7f24n"
Sep 17 01:55:33.119305 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:33.119268    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-38758b\""
Sep 17 01:55:33.119420 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:33.119354    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-38758b-dockercfg-j8bkm\""
Sep 17 01:55:33.138049 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:33.138016    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-38758b-8564ff96c-7f24n"]
Sep 17 01:55:33.161960 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:33.161925    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de6b1ba5-af5d-4cfa-b0d3-ace0f82c6da3-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-38758b-8564ff96c-7f24n\" (UID: \"de6b1ba5-af5d-4cfa-b0d3-ace0f82c6da3\") " pod="openshift-ingress/payload-processing-e2e-inf-a-38758b-8564ff96c-7f24n"
Sep 17 01:55:33.162096 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:33.161976    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjnjq\" (UniqueName: \"kubernetes.io/projected/de6b1ba5-af5d-4cfa-b0d3-ace0f82c6da3-kube-api-access-fjnjq\") pod \"payload-processing-e2e-inf-a-38758b-8564ff96c-7f24n\" (UID: \"de6b1ba5-af5d-4cfa-b0d3-ace0f82c6da3\") " pod="openshift-ingress/payload-processing-e2e-inf-a-38758b-8564ff96c-7f24n"
Sep 17 01:55:33.262646 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:33.262622    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de6b1ba5-af5d-4cfa-b0d3-ace0f82c6da3-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-38758b-8564ff96c-7f24n\" (UID: \"de6b1ba5-af5d-4cfa-b0d3-ace0f82c6da3\") " pod="openshift-ingress/payload-processing-e2e-inf-a-38758b-8564ff96c-7f24n"
Sep 17 01:55:33.262739 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:33.262652    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjnjq\" (UniqueName: \"kubernetes.io/projected/de6b1ba5-af5d-4cfa-b0d3-ace0f82c6da3-kube-api-access-fjnjq\") pod \"payload-processing-e2e-inf-a-38758b-8564ff96c-7f24n\" (UID: \"de6b1ba5-af5d-4cfa-b0d3-ace0f82c6da3\") " pod="openshift-ingress/payload-processing-e2e-inf-a-38758b-8564ff96c-7f24n"
Sep 17 01:55:33.263274 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:33.263231    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de6b1ba5-af5d-4cfa-b0d3-ace0f82c6da3-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-38758b-8564ff96c-7f24n\" (UID: \"de6b1ba5-af5d-4cfa-b0d3-ace0f82c6da3\") " pod="openshift-ingress/payload-processing-e2e-inf-a-38758b-8564ff96c-7f24n"
Sep 17 01:55:33.271151 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:33.271125    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjnjq\" (UniqueName: \"kubernetes.io/projected/de6b1ba5-af5d-4cfa-b0d3-ace0f82c6da3-kube-api-access-fjnjq\") pod \"payload-processing-e2e-inf-a-38758b-8564ff96c-7f24n\" (UID: \"de6b1ba5-af5d-4cfa-b0d3-ace0f82c6da3\") " pod="openshift-ingress/payload-processing-e2e-inf-a-38758b-8564ff96c-7f24n"
Sep 17 01:55:33.427489 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:33.427397    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-38758b-8564ff96c-7f24n"
Sep 17 01:55:33.708779 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:33.708740    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-38758b-5f864bfd54-sbrht" event={"ID":"99ac56e3-41a0-4975-aa73-13b391b438dd","Type":"ContainerStarted","Data":"992f8da548c942406c3ef729372dbbd62636a1fb37bbd03828607844b4f51411"}
Sep 17 01:55:33.708975 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:33.708842    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-38758b-5f864bfd54-sbrht" event={"ID":"99ac56e3-41a0-4975-aa73-13b391b438dd","Type":"ContainerStarted","Data":"217444fa924480666604e732d255697166e17f89d4759a2db4aabeb82adf92ce"}
Sep 17 01:55:33.709092 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:33.709072    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-38758b-5f864bfd54-sbrht"
Sep 17 01:55:33.709311 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:33.709294    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb"
Sep 17 01:55:33.709415 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:33.709398    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5"
Sep 17 01:55:33.709543 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:33.709520    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-38758b-8564ff96c-7f24n"]
Sep 17 01:55:33.710276 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:33.710226    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb"
Sep 17 01:55:33.710373 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:33.710338    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5"
Sep 17 01:55:33.711379 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:55:33.711329    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde6b1ba5_af5d_4cfa_b0d3_ace0f82c6da3.slice/crio-39d4de1c829c761bcd9c9dbb453bf7d652c9b553da9ecbc119035f8b3fb782ff WatchSource:0}: Error finding container 39d4de1c829c761bcd9c9dbb453bf7d652c9b553da9ecbc119035f8b3fb782ff: Status 404 returned error can't find the container with id 39d4de1c829c761bcd9c9dbb453bf7d652c9b553da9ecbc119035f8b3fb782ff
Sep 17 01:55:33.731577 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:33.731524    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-38758b-5f864bfd54-sbrht" podStartSLOduration=1.387773389 podStartE2EDuration="1.731501614s" totalImagesPullingTime="343.728225ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:55:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:55:33.730180682 +0000 UTC m=+1091.980157994" watchObservedRunningTime="2026-09-17 01:55:33.731501614 +0000 UTC m=+1091.981478927"
Sep 17 01:55:34.715710 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:34.715656    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-38758b-8564ff96c-7f24n" event={"ID":"de6b1ba5-af5d-4cfa-b0d3-ace0f82c6da3","Type":"ContainerStarted","Data":"541cb3d9fc9748a681e9fcb8a1ef560305ae47ccf756c81b377d21b89128df38"}
Sep 17 01:55:34.716143 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:34.715866    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-38758b-8564ff96c-7f24n"
Sep 17 01:55:34.716143 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:34.715906    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-38758b-8564ff96c-7f24n" event={"ID":"de6b1ba5-af5d-4cfa-b0d3-ace0f82c6da3","Type":"ContainerStarted","Data":"39d4de1c829c761bcd9c9dbb453bf7d652c9b553da9ecbc119035f8b3fb782ff"}
Sep 17 01:55:34.733122 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:34.733068    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-38758b-8564ff96c-7f24n" podStartSLOduration=1.733046866 podStartE2EDuration="1.733046866s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:55:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:55:34.731677787 +0000 UTC m=+1092.981655100" watchObservedRunningTime="2026-09-17 01:55:34.733046866 +0000 UTC m=+1092.983024183"
Sep 17 01:55:35.558915 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:35.558870    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-e564e1-964b5585b-mmc26"]
Sep 17 01:55:35.562457 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:35.562434    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e564e1-964b5585b-mmc26"
Sep 17 01:55:35.567685 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:35.567658    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-e564e1-serving-cert\""
Sep 17 01:55:35.581729 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:35.581700    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-e564e1-964b5585b-mmc26"]
Sep 17 01:55:35.582116 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:35.582088    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-e564e1-964b5585b-mmc26\" (UID: \"a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e564e1-964b5585b-mmc26"
Sep 17 01:55:35.582229 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:35.582176    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2c8mt\" (UniqueName: \"kubernetes.io/projected/a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7-kube-api-access-2c8mt\") pod \"maas-api-e2e-worker-w0-e564e1-964b5585b-mmc26\" (UID: \"a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e564e1-964b5585b-mmc26"
Sep 17 01:55:35.582339 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:35.582234    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7-maas-api-tls\") pod \"maas-api-e2e-worker-w0-e564e1-964b5585b-mmc26\" (UID: \"a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e564e1-964b5585b-mmc26"
Sep 17 01:55:35.582339 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:35.582278    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7-metrics-certs\") pod \"maas-api-e2e-worker-w0-e564e1-964b5585b-mmc26\" (UID: \"a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e564e1-964b5585b-mmc26"
Sep 17 01:55:35.682942 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:35.682910    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-e564e1-964b5585b-mmc26\" (UID: \"a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e564e1-964b5585b-mmc26"
Sep 17 01:55:35.683127 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:35.682961    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2c8mt\" (UniqueName: \"kubernetes.io/projected/a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7-kube-api-access-2c8mt\") pod \"maas-api-e2e-worker-w0-e564e1-964b5585b-mmc26\" (UID: \"a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e564e1-964b5585b-mmc26"
Sep 17 01:55:35.683127 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:35.682987    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7-maas-api-tls\") pod \"maas-api-e2e-worker-w0-e564e1-964b5585b-mmc26\" (UID: \"a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e564e1-964b5585b-mmc26"
Sep 17 01:55:35.683127 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:35.683013    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7-metrics-certs\") pod \"maas-api-e2e-worker-w0-e564e1-964b5585b-mmc26\" (UID: \"a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e564e1-964b5585b-mmc26"
Sep 17 01:55:35.683884 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:35.683858    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-e564e1-964b5585b-mmc26\" (UID: \"a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e564e1-964b5585b-mmc26"
Sep 17 01:55:35.686136 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:35.686111    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7-maas-api-tls\") pod \"maas-api-e2e-worker-w0-e564e1-964b5585b-mmc26\" (UID: \"a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e564e1-964b5585b-mmc26"
Sep 17 01:55:35.686136 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:35.686124    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7-metrics-certs\") pod \"maas-api-e2e-worker-w0-e564e1-964b5585b-mmc26\" (UID: \"a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e564e1-964b5585b-mmc26"
Sep 17 01:55:35.690139 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:35.690111    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2c8mt\" (UniqueName: \"kubernetes.io/projected/a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7-kube-api-access-2c8mt\") pod \"maas-api-e2e-worker-w0-e564e1-964b5585b-mmc26\" (UID: \"a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e564e1-964b5585b-mmc26"
Sep 17 01:55:35.873099 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:35.873066    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e564e1-964b5585b-mmc26"
Sep 17 01:55:36.151019 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:36.150991    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-e564e1-964b5585b-mmc26"]
Sep 17 01:55:36.153958 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:55:36.153924    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda504b71c_49b4_4d97_ae7c_2a6eb1aa8fa7.slice/crio-ee5d350c6e79d1831b0ee5ddb5d94dd2861c8452c71c83a2e6650660742b6ab0 WatchSource:0}: Error finding container ee5d350c6e79d1831b0ee5ddb5d94dd2861c8452c71c83a2e6650660742b6ab0: Status 404 returned error can't find the container with id ee5d350c6e79d1831b0ee5ddb5d94dd2861c8452c71c83a2e6650660742b6ab0
Sep 17 01:55:36.726163 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:36.726123    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e564e1-964b5585b-mmc26" event={"ID":"a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7","Type":"ContainerStarted","Data":"c6ff19998e2ef8a6e46a98fc637e5a751f0bdf9e94325b7b05610f4902b94ee3"}
Sep 17 01:55:36.726370 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:36.726192    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e564e1-964b5585b-mmc26" event={"ID":"a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7","Type":"ContainerStarted","Data":"ee5d350c6e79d1831b0ee5ddb5d94dd2861c8452c71c83a2e6650660742b6ab0"}
Sep 17 01:55:36.726370 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:36.726239    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e564e1-964b5585b-mmc26"
Sep 17 01:55:36.744042 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:36.743934    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e564e1-964b5585b-mmc26" podStartSLOduration=1.414146063 podStartE2EDuration="1.743916511s" totalImagesPullingTime="329.770448ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:55:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:55:36.742701727 +0000 UTC m=+1094.992679057" watchObservedRunningTime="2026-09-17 01:55:36.743916511 +0000 UTC m=+1094.993893824"
Sep 17 01:55:37.286509 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:37.286469    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-3f027f-5ff757bcf7-7ddfx"]
Sep 17 01:55:37.296239 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:37.296208    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-3f027f-5ff757bcf7-7ddfx"
Sep 17 01:55:37.298815 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:37.298785    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w3-3f027f\""
Sep 17 01:55:37.301556 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:37.301528    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-3f027f-5ff757bcf7-7ddfx"]
Sep 17 01:55:37.404784 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:37.404733    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7f48h\" (UniqueName: \"kubernetes.io/projected/081de0cf-f552-4147-9e5f-3cb59465d9bd-kube-api-access-7f48h\") pod \"payload-processing-e2e-worker-w3-3f027f-5ff757bcf7-7ddfx\" (UID: \"081de0cf-f552-4147-9e5f-3cb59465d9bd\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-3f027f-5ff757bcf7-7ddfx"
Sep 17 01:55:37.404784 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:37.404787    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/081de0cf-f552-4147-9e5f-3cb59465d9bd-plugins-config-volume\") pod \"payload-processing-e2e-worker-w3-3f027f-5ff757bcf7-7ddfx\" (UID: \"081de0cf-f552-4147-9e5f-3cb59465d9bd\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-3f027f-5ff757bcf7-7ddfx"
Sep 17 01:55:37.505719 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:37.505680    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7f48h\" (UniqueName: \"kubernetes.io/projected/081de0cf-f552-4147-9e5f-3cb59465d9bd-kube-api-access-7f48h\") pod \"payload-processing-e2e-worker-w3-3f027f-5ff757bcf7-7ddfx\" (UID: \"081de0cf-f552-4147-9e5f-3cb59465d9bd\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-3f027f-5ff757bcf7-7ddfx"
Sep 17 01:55:37.505719 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:37.505720    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/081de0cf-f552-4147-9e5f-3cb59465d9bd-plugins-config-volume\") pod \"payload-processing-e2e-worker-w3-3f027f-5ff757bcf7-7ddfx\" (UID: \"081de0cf-f552-4147-9e5f-3cb59465d9bd\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-3f027f-5ff757bcf7-7ddfx"
Sep 17 01:55:37.506511 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:37.506467    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/081de0cf-f552-4147-9e5f-3cb59465d9bd-plugins-config-volume\") pod \"payload-processing-e2e-worker-w3-3f027f-5ff757bcf7-7ddfx\" (UID: \"081de0cf-f552-4147-9e5f-3cb59465d9bd\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-3f027f-5ff757bcf7-7ddfx"
Sep 17 01:55:37.513431 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:37.513398    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7f48h\" (UniqueName: \"kubernetes.io/projected/081de0cf-f552-4147-9e5f-3cb59465d9bd-kube-api-access-7f48h\") pod \"payload-processing-e2e-worker-w3-3f027f-5ff757bcf7-7ddfx\" (UID: \"081de0cf-f552-4147-9e5f-3cb59465d9bd\") " pod="openshift-ingress/payload-processing-e2e-worker-w3-3f027f-5ff757bcf7-7ddfx"
Sep 17 01:55:37.608919 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:37.608881    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-3f027f-5ff757bcf7-7ddfx"
Sep 17 01:55:37.882833 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:37.882809    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-3f027f-5ff757bcf7-7ddfx"]
Sep 17 01:55:37.885767 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:55:37.885739    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod081de0cf_f552_4147_9e5f_3cb59465d9bd.slice/crio-b4ce6aa3d8b05f73e16cf3480cdc948196875cf575fc9a37a133774f4cec9257 WatchSource:0}: Error finding container b4ce6aa3d8b05f73e16cf3480cdc948196875cf575fc9a37a133774f4cec9257: Status 404 returned error can't find the container with id b4ce6aa3d8b05f73e16cf3480cdc948196875cf575fc9a37a133774f4cec9257
Sep 17 01:55:38.737593 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:38.737556    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-3f027f-5ff757bcf7-7ddfx" event={"ID":"081de0cf-f552-4147-9e5f-3cb59465d9bd","Type":"ContainerStarted","Data":"605e69bb125c624e1fc7c1b90883cf50f9c8598a15deda1a161f9d2b71853076"}
Sep 17 01:55:38.738057 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:38.737614    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-3f027f-5ff757bcf7-7ddfx" event={"ID":"081de0cf-f552-4147-9e5f-3cb59465d9bd","Type":"ContainerStarted","Data":"b4ce6aa3d8b05f73e16cf3480cdc948196875cf575fc9a37a133774f4cec9257"}
Sep 17 01:55:38.738057 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:38.737695    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w3-3f027f-5ff757bcf7-7ddfx"
Sep 17 01:55:38.765633 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:38.765580    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w3-3f027f-5ff757bcf7-7ddfx" podStartSLOduration=1.765561777 podStartE2EDuration="1.765561777s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:55:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:55:38.76398076 +0000 UTC m=+1097.013958073" watchObservedRunningTime="2026-09-17 01:55:38.765561777 +0000 UTC m=+1097.015539089"
Sep 17 01:55:40.725125 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:40.725099    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-38758b-5f864bfd54-sbrht"
Sep 17 01:55:42.737800 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:42.737764    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e564e1-964b5585b-mmc26"
Sep 17 01:55:45.722317 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:45.722289    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-38758b-8564ff96c-7f24n"
Sep 17 01:55:48.925744 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:48.925650    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-266b61f5-9957574fd-wg68c"]
Sep 17 01:55:48.931013 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:48.930983    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-266b61f5-9957574fd-wg68c"
Sep 17 01:55:48.933355 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:48.933316    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-266b61f5-serving-cert\""
Sep 17 01:55:48.956435 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:48.956354    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-266b61f5-9957574fd-wg68c"]
Sep 17 01:55:49.039143 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:49.039104    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7-maas-api-tls\") pod \"maas-api-e2e-ait-266b61f5-9957574fd-wg68c\" (UID: \"1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-266b61f5-9957574fd-wg68c"
Sep 17 01:55:49.039356 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:49.039154    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7-metrics-certs\") pod \"maas-api-e2e-ait-266b61f5-9957574fd-wg68c\" (UID: \"1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-266b61f5-9957574fd-wg68c"
Sep 17 01:55:49.039356 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:49.039336    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7-openshift-service-ca\") pod \"maas-api-e2e-ait-266b61f5-9957574fd-wg68c\" (UID: \"1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-266b61f5-9957574fd-wg68c"
Sep 17 01:55:49.039487 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:49.039377    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4pdg\" (UniqueName: \"kubernetes.io/projected/1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7-kube-api-access-n4pdg\") pod \"maas-api-e2e-ait-266b61f5-9957574fd-wg68c\" (UID: \"1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-266b61f5-9957574fd-wg68c"
Sep 17 01:55:49.141224 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:49.141180    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7-openshift-service-ca\") pod \"maas-api-e2e-ait-266b61f5-9957574fd-wg68c\" (UID: \"1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-266b61f5-9957574fd-wg68c"
Sep 17 01:55:49.141224 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:49.141231    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4pdg\" (UniqueName: \"kubernetes.io/projected/1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7-kube-api-access-n4pdg\") pod \"maas-api-e2e-ait-266b61f5-9957574fd-wg68c\" (UID: \"1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-266b61f5-9957574fd-wg68c"
Sep 17 01:55:49.141509 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:49.141357    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7-maas-api-tls\") pod \"maas-api-e2e-ait-266b61f5-9957574fd-wg68c\" (UID: \"1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-266b61f5-9957574fd-wg68c"
Sep 17 01:55:49.141509 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:49.141399    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7-metrics-certs\") pod \"maas-api-e2e-ait-266b61f5-9957574fd-wg68c\" (UID: \"1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-266b61f5-9957574fd-wg68c"
Sep 17 01:55:49.141986 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:55:49.141780    2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-266b61f5-serving-cert: secret "maas-api-e2e-ait-266b61f5-serving-cert" not found
Sep 17 01:55:49.141986 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:55:49.141868    2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7-maas-api-tls podName:1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7 nodeName:}" failed. No retries permitted until 2026-09-17 01:55:49.641843404 +0000 UTC m=+1107.891820714 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7-maas-api-tls") pod "maas-api-e2e-ait-266b61f5-9957574fd-wg68c" (UID: "1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7") : secret "maas-api-e2e-ait-266b61f5-serving-cert" not found
Sep 17 01:55:49.142897 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:49.142868    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7-openshift-service-ca\") pod \"maas-api-e2e-ait-266b61f5-9957574fd-wg68c\" (UID: \"1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-266b61f5-9957574fd-wg68c"
Sep 17 01:55:49.144547 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:49.144514    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7-metrics-certs\") pod \"maas-api-e2e-ait-266b61f5-9957574fd-wg68c\" (UID: \"1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-266b61f5-9957574fd-wg68c"
Sep 17 01:55:49.177283 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:49.177157    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4pdg\" (UniqueName: \"kubernetes.io/projected/1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7-kube-api-access-n4pdg\") pod \"maas-api-e2e-ait-266b61f5-9957574fd-wg68c\" (UID: \"1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-266b61f5-9957574fd-wg68c"
Sep 17 01:55:49.645716 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:49.645673    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7-maas-api-tls\") pod \"maas-api-e2e-ait-266b61f5-9957574fd-wg68c\" (UID: \"1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-266b61f5-9957574fd-wg68c"
Sep 17 01:55:49.648488 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:49.648459    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7-maas-api-tls\") pod \"maas-api-e2e-ait-266b61f5-9957574fd-wg68c\" (UID: \"1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-266b61f5-9957574fd-wg68c"
Sep 17 01:55:49.745434 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:49.745400    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w3-3f027f-5ff757bcf7-7ddfx"
Sep 17 01:55:49.751401 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:49.751366    2560 patch_prober.go:28] interesting pod/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 17 01:55:49.751546 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:49.751438    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb" podUID="d04475df-65f2-423a-9a29-d015ea63b35f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 17 01:55:49.752385 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:49.752356    2560 patch_prober.go:28] interesting pod/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 17 01:55:49.752470 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:49.752409    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5" podUID="04476ca5-bc8f-4e8e-b711-835ce6e40037" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 17 01:55:49.847060 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:49.847026    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-266b61f5-9957574fd-wg68c"
Sep 17 01:55:50.146987 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:50.146946    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-266b61f5-9957574fd-wg68c"]
Sep 17 01:55:50.150509 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:55:50.150469    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c0cbc9d_5ecc_47f9_945e_4d3137b71dc7.slice/crio-3427462fcbae0a250ee20859668a165eb1709eda9c0414ed12aaa12c5ce99751 WatchSource:0}: Error finding container 3427462fcbae0a250ee20859668a165eb1709eda9c0414ed12aaa12c5ce99751: Status 404 returned error can't find the container with id 3427462fcbae0a250ee20859668a165eb1709eda9c0414ed12aaa12c5ce99751
Sep 17 01:55:50.818052 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:50.818010    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-266b61f5-9957574fd-wg68c" event={"ID":"1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7","Type":"ContainerStarted","Data":"7e65899bfb88d21b73b1596630b6453db37c470018d5f613e3b3041b23e25bab"}
Sep 17 01:55:50.818273 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:50.818067    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-266b61f5-9957574fd-wg68c" event={"ID":"1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7","Type":"ContainerStarted","Data":"3427462fcbae0a250ee20859668a165eb1709eda9c0414ed12aaa12c5ce99751"}
Sep 17 01:55:50.818273 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:50.818088    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-266b61f5-9957574fd-wg68c"
Sep 17 01:55:50.841338 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:50.841242    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-266b61f5-9957574fd-wg68c" podStartSLOduration=2.52981693 podStartE2EDuration="2.841219247s" totalImagesPullingTime="311.402317ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:55:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:55:50.840588513 +0000 UTC m=+1109.090565837" watchObservedRunningTime="2026-09-17 01:55:50.841219247 +0000 UTC m=+1109.091196560"
Sep 17 01:55:51.824406 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:51.824372    2560 generic.go:356] "Generic (PLEG): container finished" podID="d04475df-65f2-423a-9a29-d015ea63b35f" containerID="5e37821884b329800b7db87e6dc51a147549eda9bb2715ca08a1fd4c88639506" exitCode=0
Sep 17 01:55:51.824934 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:51.824447    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb" event={"ID":"d04475df-65f2-423a-9a29-d015ea63b35f","Type":"ContainerDied","Data":"5e37821884b329800b7db87e6dc51a147549eda9bb2715ca08a1fd4c88639506"}
Sep 17 01:55:51.824934 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:51.824881    2560 scope.go:117] "RemoveContainer" containerID="5e37821884b329800b7db87e6dc51a147549eda9bb2715ca08a1fd4c88639506"
Sep 17 01:55:51.826126 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:51.826106    2560 generic.go:356] "Generic (PLEG): container finished" podID="04476ca5-bc8f-4e8e-b711-835ce6e40037" containerID="c4fc3472e2ae7bdee2ebae532d53fca16e802062b1babc86e143aba89c5463ab" exitCode=0
Sep 17 01:55:51.826222 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:51.826178    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5" event={"ID":"04476ca5-bc8f-4e8e-b711-835ce6e40037","Type":"ContainerDied","Data":"c4fc3472e2ae7bdee2ebae532d53fca16e802062b1babc86e143aba89c5463ab"}
Sep 17 01:55:51.826666 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:51.826650    2560 scope.go:117] "RemoveContainer" containerID="c4fc3472e2ae7bdee2ebae532d53fca16e802062b1babc86e143aba89c5463ab"
Sep 17 01:55:51.827033 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:51.827005    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 01:55:51.827116 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:51.827085    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 01:55:51.827271 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:51.827158    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 01:55:51.828682 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:51.828655    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 01:55:51.828749 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:51.828734    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 01:55:51.828794 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:51.828779    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 01:55:52.834729 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:52.834692    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb" event={"ID":"d04475df-65f2-423a-9a29-d015ea63b35f","Type":"ContainerStarted","Data":"cd4d48f8247173f960b80f824bc39172983148b3d1b52f98b1eed6b2f751f9a9"}
Sep 17 01:55:52.837047 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:52.837019    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5" event={"ID":"04476ca5-bc8f-4e8e-b711-835ce6e40037","Type":"ContainerStarted","Data":"fdd77db23f19a55d8f28798ada2d7aa781e93eb8d0be0cb2f8bb3affd28f1017"}
Sep 17 01:55:52.838156 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:52.838140    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5"
Sep 17 01:55:52.838371 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:52.838353    2560 patch_prober.go:28] interesting pod/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Sep 17 01:55:52.838450 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:52.838433    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5" podUID="04476ca5-bc8f-4e8e-b711-835ce6e40037" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Sep 17 01:55:53.697838 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:53.697804    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb"
Sep 17 01:55:53.698324 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:53.698294    2560 patch_prober.go:28] interesting pod/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Sep 17 01:55:53.698515 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:53.698486    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb" podUID="d04475df-65f2-423a-9a29-d015ea63b35f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Sep 17 01:55:53.838394 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:53.838358    2560 patch_prober.go:28] interesting pod/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Sep 17 01:55:53.838777 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:53.838413    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5" podUID="04476ca5-bc8f-4e8e-b711-835ce6e40037" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Sep 17 01:55:54.697947 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:54.697501    2560 patch_prober.go:28] interesting pod/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Sep 17 01:55:54.697947 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:54.697565    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb" podUID="d04475df-65f2-423a-9a29-d015ea63b35f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Sep 17 01:55:54.838621 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:54.838579    2560 patch_prober.go:28] interesting pod/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Sep 17 01:55:54.838990 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:54.838642    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5" podUID="04476ca5-bc8f-4e8e-b711-835ce6e40037" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Sep 17 01:55:55.697766 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:55.697719    2560 patch_prober.go:28] interesting pod/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Sep 17 01:55:55.697986 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:55.697788    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb" podUID="d04475df-65f2-423a-9a29-d015ea63b35f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Sep 17 01:55:55.839205 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:55.839169    2560 patch_prober.go:28] interesting pod/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Sep 17 01:55:55.839616 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:55.839230    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5" podUID="04476ca5-bc8f-4e8e-b711-835ce6e40037" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Sep 17 01:55:56.697922 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:56.697871    2560 patch_prober.go:28] interesting pod/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Sep 17 01:55:56.698137 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:56.697947    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb" podUID="d04475df-65f2-423a-9a29-d015ea63b35f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Sep 17 01:55:56.831829 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:56.831801    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-266b61f5-9957574fd-wg68c"
Sep 17 01:55:56.838471 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:56.838434    2560 patch_prober.go:28] interesting pod/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Sep 17 01:55:56.838626 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:56.838497    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5" podUID="04476ca5-bc8f-4e8e-b711-835ce6e40037" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Sep 17 01:55:57.699395 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:57.699351    2560 patch_prober.go:28] interesting pod/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Sep 17 01:55:57.699989 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:57.699953    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb" podUID="d04475df-65f2-423a-9a29-d015ea63b35f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Sep 17 01:55:57.838433 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:57.838397    2560 patch_prober.go:28] interesting pod/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Sep 17 01:55:57.838639 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:57.838452    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5" podUID="04476ca5-bc8f-4e8e-b711-835ce6e40037" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Sep 17 01:55:58.701596 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:58.701565    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb"
Sep 17 01:55:58.702040 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:58.701874    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb"
Sep 17 01:55:58.702524 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:58.702506    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb"
Sep 17 01:55:58.842634 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:58.842602    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5"
Sep 17 01:55:58.842926 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:58.842899    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5"
Sep 17 01:55:58.843691 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:55:58.843672    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5"
Sep 17 01:56:00.646310 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:00.646271    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-55c648-79bf9f859d-5x9qk"]
Sep 17 01:56:00.654998 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:00.654971    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-55c648-79bf9f859d-5x9qk"
Sep 17 01:56:00.659931 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:00.659906    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-55c648\""
Sep 17 01:56:00.669831 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:00.669800    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-55c648-79bf9f859d-5x9qk"]
Sep 17 01:56:00.772931 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:00.772892    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl67g\" (UniqueName: \"kubernetes.io/projected/2d3f7c2e-6173-489c-b5f2-6fab37689819-kube-api-access-jl67g\") pod \"payload-pre-processing-e2e-inf-b-55c648-79bf9f859d-5x9qk\" (UID: \"2d3f7c2e-6173-489c-b5f2-6fab37689819\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-55c648-79bf9f859d-5x9qk"
Sep 17 01:56:00.773087 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:00.773060    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d3f7c2e-6173-489c-b5f2-6fab37689819-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-55c648-79bf9f859d-5x9qk\" (UID: \"2d3f7c2e-6173-489c-b5f2-6fab37689819\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-55c648-79bf9f859d-5x9qk"
Sep 17 01:56:00.874481 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:00.874443    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d3f7c2e-6173-489c-b5f2-6fab37689819-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-55c648-79bf9f859d-5x9qk\" (UID: \"2d3f7c2e-6173-489c-b5f2-6fab37689819\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-55c648-79bf9f859d-5x9qk"
Sep 17 01:56:00.874657 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:00.874505    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl67g\" (UniqueName: \"kubernetes.io/projected/2d3f7c2e-6173-489c-b5f2-6fab37689819-kube-api-access-jl67g\") pod \"payload-pre-processing-e2e-inf-b-55c648-79bf9f859d-5x9qk\" (UID: \"2d3f7c2e-6173-489c-b5f2-6fab37689819\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-55c648-79bf9f859d-5x9qk"
Sep 17 01:56:00.875219 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:00.875197    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d3f7c2e-6173-489c-b5f2-6fab37689819-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-55c648-79bf9f859d-5x9qk\" (UID: \"2d3f7c2e-6173-489c-b5f2-6fab37689819\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-55c648-79bf9f859d-5x9qk"
Sep 17 01:56:00.882872 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:00.882836    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl67g\" (UniqueName: \"kubernetes.io/projected/2d3f7c2e-6173-489c-b5f2-6fab37689819-kube-api-access-jl67g\") pod \"payload-pre-processing-e2e-inf-b-55c648-79bf9f859d-5x9qk\" (UID: \"2d3f7c2e-6173-489c-b5f2-6fab37689819\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-55c648-79bf9f859d-5x9qk"
Sep 17 01:56:00.965088 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:00.965001    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-55c648-79bf9f859d-5x9qk"
Sep 17 01:56:01.247000 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:01.246976    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-55c648-79bf9f859d-5x9qk"]
Sep 17 01:56:01.248540 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:56:01.248512    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d3f7c2e_6173_489c_b5f2_6fab37689819.slice/crio-5f229bdbaca7ea0a488259824936e9d23b3a4da6d02082cf83962dc9335de88a WatchSource:0}: Error finding container 5f229bdbaca7ea0a488259824936e9d23b3a4da6d02082cf83962dc9335de88a: Status 404 returned error can't find the container with id 5f229bdbaca7ea0a488259824936e9d23b3a4da6d02082cf83962dc9335de88a
Sep 17 01:56:01.886932 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:01.886894    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-55c648-79bf9f859d-5x9qk" event={"ID":"2d3f7c2e-6173-489c-b5f2-6fab37689819","Type":"ContainerStarted","Data":"0e944d0f13f5cef26c605583d745e0e9b024607f599e5fbcb2b118d72ec2833c"}
Sep 17 01:56:01.887452 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:01.886955    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-55c648-79bf9f859d-5x9qk" event={"ID":"2d3f7c2e-6173-489c-b5f2-6fab37689819","Type":"ContainerStarted","Data":"5f229bdbaca7ea0a488259824936e9d23b3a4da6d02082cf83962dc9335de88a"}
Sep 17 01:56:01.887452 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:01.886985    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-55c648-79bf9f859d-5x9qk"
Sep 17 01:56:01.914047 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:01.913985    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-55c648-79bf9f859d-5x9qk" podStartSLOduration=1.913968208 podStartE2EDuration="1.913968208s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:56:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:56:01.912801874 +0000 UTC m=+1120.162779186" watchObservedRunningTime="2026-09-17 01:56:01.913968208 +0000 UTC m=+1120.163945526"
Sep 17 01:56:10.192259 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:10.192203    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-266b61f5-9957574fd-wg68c"]
Sep 17 01:56:10.192760 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:10.192537    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-266b61f5-9957574fd-wg68c" podUID="1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7" containerName="maas-api" containerID="cri-o://7e65899bfb88d21b73b1596630b6453db37c470018d5f613e3b3041b23e25bab" gracePeriod=30
Sep 17 01:56:10.441699 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:10.441673    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-266b61f5-9957574fd-wg68c"
Sep 17 01:56:10.468902 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:10.468821    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7-metrics-certs\") pod \"1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7\" (UID: \"1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7\") "
Sep 17 01:56:10.468902 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:10.468885    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7-openshift-service-ca\") pod \"1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7\" (UID: \"1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7\") "
Sep 17 01:56:10.469079 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:10.468966    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4pdg\" (UniqueName: \"kubernetes.io/projected/1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7-kube-api-access-n4pdg\") pod \"1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7\" (UID: \"1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7\") "
Sep 17 01:56:10.469120 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:10.469086    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7-maas-api-tls\") pod \"1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7\" (UID: \"1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7\") "
Sep 17 01:56:10.469326 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:10.469300    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7" (UID: "1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:56:10.469461 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:10.469437    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7-openshift-service-ca\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:56:10.471237 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:10.471205    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7" (UID: "1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 01:56:10.471237 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:10.471218    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7-kube-api-access-n4pdg" (OuterVolumeSpecName: "kube-api-access-n4pdg") pod "1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7" (UID: "1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7"). InnerVolumeSpecName "kube-api-access-n4pdg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:56:10.471411 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:10.471307    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7" (UID: "1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 01:56:10.570331 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:10.570217    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4pdg\" (UniqueName: \"kubernetes.io/projected/1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7-kube-api-access-n4pdg\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:56:10.570331 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:10.570267    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7-maas-api-tls\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:56:10.570331 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:10.570282    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7-metrics-certs\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:56:10.934305 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:10.934273    2560 generic.go:356] "Generic (PLEG): container finished" podID="1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7" containerID="7e65899bfb88d21b73b1596630b6453db37c470018d5f613e3b3041b23e25bab" exitCode=0
Sep 17 01:56:10.934505 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:10.934403    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-266b61f5-9957574fd-wg68c"
Sep 17 01:56:10.934505 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:10.934423    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-266b61f5-9957574fd-wg68c" event={"ID":"1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7","Type":"ContainerDied","Data":"7e65899bfb88d21b73b1596630b6453db37c470018d5f613e3b3041b23e25bab"}
Sep 17 01:56:10.934505 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:10.934478    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-266b61f5-9957574fd-wg68c" event={"ID":"1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7","Type":"ContainerDied","Data":"3427462fcbae0a250ee20859668a165eb1709eda9c0414ed12aaa12c5ce99751"}
Sep 17 01:56:10.934681 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:10.934508    2560 scope.go:117] "RemoveContainer" containerID="7e65899bfb88d21b73b1596630b6453db37c470018d5f613e3b3041b23e25bab"
Sep 17 01:56:10.945679 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:10.945657    2560 scope.go:117] "RemoveContainer" containerID="7e65899bfb88d21b73b1596630b6453db37c470018d5f613e3b3041b23e25bab"
Sep 17 01:56:10.945966 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:56:10.945947    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e65899bfb88d21b73b1596630b6453db37c470018d5f613e3b3041b23e25bab\": container with ID starting with 7e65899bfb88d21b73b1596630b6453db37c470018d5f613e3b3041b23e25bab not found: ID does not exist" containerID="7e65899bfb88d21b73b1596630b6453db37c470018d5f613e3b3041b23e25bab"
Sep 17 01:56:10.946014 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:10.945976    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e65899bfb88d21b73b1596630b6453db37c470018d5f613e3b3041b23e25bab"} err="failed to get container status \"7e65899bfb88d21b73b1596630b6453db37c470018d5f613e3b3041b23e25bab\": rpc error: code = NotFound desc = could not find container \"7e65899bfb88d21b73b1596630b6453db37c470018d5f613e3b3041b23e25bab\": container with ID starting with 7e65899bfb88d21b73b1596630b6453db37c470018d5f613e3b3041b23e25bab not found: ID does not exist"
Sep 17 01:56:10.983813 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:10.983781    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-266b61f5-9957574fd-wg68c"]
Sep 17 01:56:10.992808 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:10.992780    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-266b61f5-9957574fd-wg68c"]
Sep 17 01:56:11.725315 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:11.725284    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb"]
Sep 17 01:56:11.725726 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:11.725711    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7" containerName="maas-api"
Sep 17 01:56:11.725794 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:11.725729    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7" containerName="maas-api"
Sep 17 01:56:11.725794 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:11.725779    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7" containerName="maas-api"
Sep 17 01:56:11.730506 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:11.730484    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb"
Sep 17 01:56:11.732409 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:11.732383    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-404126c3-gw-openshift-default-dockercfg-8nfld\""
Sep 17 01:56:11.743452 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:11.743426    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb"]
Sep 17 01:56:11.782004 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:11.781948    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/311dfce8-14ff-418b-b00d-7678b43270d9-istio-envoy\") pod \"e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb\" (UID: \"311dfce8-14ff-418b-b00d-7678b43270d9\") " pod="openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb"
Sep 17 01:56:11.782180 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:11.782018    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/311dfce8-14ff-418b-b00d-7678b43270d9-istiod-ca-cert\") pod \"e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb\" (UID: \"311dfce8-14ff-418b-b00d-7678b43270d9\") " pod="openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb"
Sep 17 01:56:11.782180 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:11.782050    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrfxd\" (UniqueName: \"kubernetes.io/projected/311dfce8-14ff-418b-b00d-7678b43270d9-kube-api-access-nrfxd\") pod \"e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb\" (UID: \"311dfce8-14ff-418b-b00d-7678b43270d9\") " pod="openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb"
Sep 17 01:56:11.782180 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:11.782130    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/311dfce8-14ff-418b-b00d-7678b43270d9-workload-socket\") pod \"e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb\" (UID: \"311dfce8-14ff-418b-b00d-7678b43270d9\") " pod="openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb"
Sep 17 01:56:11.782180 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:11.782150    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/311dfce8-14ff-418b-b00d-7678b43270d9-workload-certs\") pod \"e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb\" (UID: \"311dfce8-14ff-418b-b00d-7678b43270d9\") " pod="openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb"
Sep 17 01:56:11.782458 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:11.782235    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/311dfce8-14ff-418b-b00d-7678b43270d9-istio-token\") pod \"e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb\" (UID: \"311dfce8-14ff-418b-b00d-7678b43270d9\") " pod="openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb"
Sep 17 01:56:11.782458 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:11.782340    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/311dfce8-14ff-418b-b00d-7678b43270d9-credential-socket\") pod \"e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb\" (UID: \"311dfce8-14ff-418b-b00d-7678b43270d9\") " pod="openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb"
Sep 17 01:56:11.782458 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:11.782367    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/311dfce8-14ff-418b-b00d-7678b43270d9-istio-podinfo\") pod \"e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb\" (UID: \"311dfce8-14ff-418b-b00d-7678b43270d9\") " pod="openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb"
Sep 17 01:56:11.782458 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:11.782414    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/311dfce8-14ff-418b-b00d-7678b43270d9-istio-data\") pod \"e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb\" (UID: \"311dfce8-14ff-418b-b00d-7678b43270d9\") " pod="openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb"
Sep 17 01:56:11.883408 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:11.883372    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/311dfce8-14ff-418b-b00d-7678b43270d9-workload-socket\") pod \"e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb\" (UID: \"311dfce8-14ff-418b-b00d-7678b43270d9\") " pod="openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb"
Sep 17 01:56:11.883408 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:11.883411    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/311dfce8-14ff-418b-b00d-7678b43270d9-workload-certs\") pod \"e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb\" (UID: \"311dfce8-14ff-418b-b00d-7678b43270d9\") " pod="openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb"
Sep 17 01:56:11.883671 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:11.883436    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/311dfce8-14ff-418b-b00d-7678b43270d9-istio-token\") pod \"e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb\" (UID: \"311dfce8-14ff-418b-b00d-7678b43270d9\") " pod="openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb"
Sep 17 01:56:11.883671 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:11.883485    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/311dfce8-14ff-418b-b00d-7678b43270d9-credential-socket\") pod \"e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb\" (UID: \"311dfce8-14ff-418b-b00d-7678b43270d9\") " pod="openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb"
Sep 17 01:56:11.883671 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:11.883502    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/311dfce8-14ff-418b-b00d-7678b43270d9-istio-podinfo\") pod \"e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb\" (UID: \"311dfce8-14ff-418b-b00d-7678b43270d9\") " pod="openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb"
Sep 17 01:56:11.883671 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:11.883536    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/311dfce8-14ff-418b-b00d-7678b43270d9-istio-data\") pod \"e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb\" (UID: \"311dfce8-14ff-418b-b00d-7678b43270d9\") " pod="openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb"
Sep 17 01:56:11.883671 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:11.883573    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/311dfce8-14ff-418b-b00d-7678b43270d9-istio-envoy\") pod \"e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb\" (UID: \"311dfce8-14ff-418b-b00d-7678b43270d9\") " pod="openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb"
Sep 17 01:56:11.883671 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:11.883605    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/311dfce8-14ff-418b-b00d-7678b43270d9-istiod-ca-cert\") pod \"e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb\" (UID: \"311dfce8-14ff-418b-b00d-7678b43270d9\") " pod="openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb"
Sep 17 01:56:11.883671 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:11.883632    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrfxd\" (UniqueName: \"kubernetes.io/projected/311dfce8-14ff-418b-b00d-7678b43270d9-kube-api-access-nrfxd\") pod \"e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb\" (UID: \"311dfce8-14ff-418b-b00d-7678b43270d9\") " pod="openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb"
Sep 17 01:56:11.884035 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:11.883836    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/311dfce8-14ff-418b-b00d-7678b43270d9-workload-socket\") pod \"e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb\" (UID: \"311dfce8-14ff-418b-b00d-7678b43270d9\") " pod="openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb"
Sep 17 01:56:11.884035 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:11.883881    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/311dfce8-14ff-418b-b00d-7678b43270d9-workload-certs\") pod \"e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb\" (UID: \"311dfce8-14ff-418b-b00d-7678b43270d9\") " pod="openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb"
Sep 17 01:56:11.884035 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:11.883922    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/311dfce8-14ff-418b-b00d-7678b43270d9-istio-data\") pod \"e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb\" (UID: \"311dfce8-14ff-418b-b00d-7678b43270d9\") " pod="openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb"
Sep 17 01:56:11.884295 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:11.884269    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/311dfce8-14ff-418b-b00d-7678b43270d9-credential-socket\") pod \"e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb\" (UID: \"311dfce8-14ff-418b-b00d-7678b43270d9\") " pod="openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb"
Sep 17 01:56:11.884654 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:11.884624    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/311dfce8-14ff-418b-b00d-7678b43270d9-istiod-ca-cert\") pod \"e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb\" (UID: \"311dfce8-14ff-418b-b00d-7678b43270d9\") " pod="openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb"
Sep 17 01:56:11.886725 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:11.886477    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/311dfce8-14ff-418b-b00d-7678b43270d9-istio-envoy\") pod \"e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb\" (UID: \"311dfce8-14ff-418b-b00d-7678b43270d9\") " pod="openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb"
Sep 17 01:56:11.886867 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:11.886764    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/311dfce8-14ff-418b-b00d-7678b43270d9-istio-podinfo\") pod \"e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb\" (UID: \"311dfce8-14ff-418b-b00d-7678b43270d9\") " pod="openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb"
Sep 17 01:56:11.893780 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:11.893749    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/311dfce8-14ff-418b-b00d-7678b43270d9-istio-token\") pod \"e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb\" (UID: \"311dfce8-14ff-418b-b00d-7678b43270d9\") " pod="openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb"
Sep 17 01:56:11.893992 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:11.893969    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrfxd\" (UniqueName: \"kubernetes.io/projected/311dfce8-14ff-418b-b00d-7678b43270d9-kube-api-access-nrfxd\") pod \"e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb\" (UID: \"311dfce8-14ff-418b-b00d-7678b43270d9\") " pod="openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb"
Sep 17 01:56:12.041285 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:12.041171    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb"
Sep 17 01:56:12.320114 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:12.320086    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb"]
Sep 17 01:56:12.322663 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:56:12.322634    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod311dfce8_14ff_418b_b00d_7678b43270d9.slice/crio-15d3f367fcc8a406137c55552a8d48db74a3bef85d4b9be22b3fb91aea853f6f WatchSource:0}: Error finding container 15d3f367fcc8a406137c55552a8d48db74a3bef85d4b9be22b3fb91aea853f6f: Status 404 returned error can't find the container with id 15d3f367fcc8a406137c55552a8d48db74a3bef85d4b9be22b3fb91aea853f6f
Sep 17 01:56:12.325410 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:12.325381    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 01:56:12.325487 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:12.325443    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 01:56:12.325487 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:12.325482    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 01:56:12.357169 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:12.357143    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7" path="/var/lib/kubelet/pods/1c0cbc9d-5ecc-47f9-945e-4d3137b71dc7/volumes"
Sep 17 01:56:12.894436 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:12.894403    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-55c648-79bf9f859d-5x9qk"
Sep 17 01:56:12.947177 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:12.947140    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb" event={"ID":"311dfce8-14ff-418b-b00d-7678b43270d9","Type":"ContainerStarted","Data":"e85e1e694c4c63c185183b2df50025f41a952ce043b8f3428a080cf0108b9c74"}
Sep 17 01:56:12.947335 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:12.947202    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb" event={"ID":"311dfce8-14ff-418b-b00d-7678b43270d9","Type":"ContainerStarted","Data":"15d3f367fcc8a406137c55552a8d48db74a3bef85d4b9be22b3fb91aea853f6f"}
Sep 17 01:56:12.975039 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:12.974975    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb" podStartSLOduration=1.974954289 podStartE2EDuration="1.974954289s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:56:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:56:12.972950098 +0000 UTC m=+1131.222927412" watchObservedRunningTime="2026-09-17 01:56:12.974954289 +0000 UTC m=+1131.224931605"
Sep 17 01:56:13.042400 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:13.042366    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb"
Sep 17 01:56:13.048065 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:13.048040    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb"
Sep 17 01:56:13.951777 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:13.951743    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb"
Sep 17 01:56:13.952627 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:13.952606    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb"
Sep 17 01:56:18.571497 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:18.571462    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-404126c3-69cb476bfd-nc4h4"]
Sep 17 01:56:18.575330 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:18.575307    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-404126c3-69cb476bfd-nc4h4"
Sep 17 01:56:18.578913 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:18.577345    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-404126c3\""
Sep 17 01:56:18.578913 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:18.577650    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-404126c3-dockercfg-h7cfp\""
Sep 17 01:56:18.587383 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:18.587348    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-404126c3-69cb476bfd-nc4h4"]
Sep 17 01:56:18.648128 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:18.648096    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bac8e79f-d66f-4d30-b927-ee65ec4afe43-plugins-config-volume\") pod \"payload-processing-e2e-migrate-404126c3-69cb476bfd-nc4h4\" (UID: \"bac8e79f-d66f-4d30-b927-ee65ec4afe43\") " pod="openshift-ingress/payload-processing-e2e-migrate-404126c3-69cb476bfd-nc4h4"
Sep 17 01:56:18.648337 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:18.648153    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvfkc\" (UniqueName: \"kubernetes.io/projected/bac8e79f-d66f-4d30-b927-ee65ec4afe43-kube-api-access-xvfkc\") pod \"payload-processing-e2e-migrate-404126c3-69cb476bfd-nc4h4\" (UID: \"bac8e79f-d66f-4d30-b927-ee65ec4afe43\") " pod="openshift-ingress/payload-processing-e2e-migrate-404126c3-69cb476bfd-nc4h4"
Sep 17 01:56:18.749643 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:18.749603    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvfkc\" (UniqueName: \"kubernetes.io/projected/bac8e79f-d66f-4d30-b927-ee65ec4afe43-kube-api-access-xvfkc\") pod \"payload-processing-e2e-migrate-404126c3-69cb476bfd-nc4h4\" (UID: \"bac8e79f-d66f-4d30-b927-ee65ec4afe43\") " pod="openshift-ingress/payload-processing-e2e-migrate-404126c3-69cb476bfd-nc4h4"
Sep 17 01:56:18.749836 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:18.749714    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bac8e79f-d66f-4d30-b927-ee65ec4afe43-plugins-config-volume\") pod \"payload-processing-e2e-migrate-404126c3-69cb476bfd-nc4h4\" (UID: \"bac8e79f-d66f-4d30-b927-ee65ec4afe43\") " pod="openshift-ingress/payload-processing-e2e-migrate-404126c3-69cb476bfd-nc4h4"
Sep 17 01:56:18.750393 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:18.750373    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bac8e79f-d66f-4d30-b927-ee65ec4afe43-plugins-config-volume\") pod \"payload-processing-e2e-migrate-404126c3-69cb476bfd-nc4h4\" (UID: \"bac8e79f-d66f-4d30-b927-ee65ec4afe43\") " pod="openshift-ingress/payload-processing-e2e-migrate-404126c3-69cb476bfd-nc4h4"
Sep 17 01:56:18.758566 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:18.758537    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvfkc\" (UniqueName: \"kubernetes.io/projected/bac8e79f-d66f-4d30-b927-ee65ec4afe43-kube-api-access-xvfkc\") pod \"payload-processing-e2e-migrate-404126c3-69cb476bfd-nc4h4\" (UID: \"bac8e79f-d66f-4d30-b927-ee65ec4afe43\") " pod="openshift-ingress/payload-processing-e2e-migrate-404126c3-69cb476bfd-nc4h4"
Sep 17 01:56:18.892630 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:18.892540    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-404126c3-69cb476bfd-nc4h4"
Sep 17 01:56:19.170703 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:19.170678    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-404126c3-69cb476bfd-nc4h4"]
Sep 17 01:56:19.173538 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:56:19.173509    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbac8e79f_d66f_4d30_b927_ee65ec4afe43.slice/crio-1bda6b6476004864c514e008a9cb10ffb2d803f7c093b01161a38815e53c798b WatchSource:0}: Error finding container 1bda6b6476004864c514e008a9cb10ffb2d803f7c093b01161a38815e53c798b: Status 404 returned error can't find the container with id 1bda6b6476004864c514e008a9cb10ffb2d803f7c093b01161a38815e53c798b
Sep 17 01:56:19.986565 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:19.986529    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-404126c3-69cb476bfd-nc4h4" event={"ID":"bac8e79f-d66f-4d30-b927-ee65ec4afe43","Type":"ContainerStarted","Data":"f827e53cb5078ed57fe802fd8e7de09820f4b12592065ba09005be9f234c8070"}
Sep 17 01:56:19.987024 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:19.986614    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-404126c3-69cb476bfd-nc4h4" event={"ID":"bac8e79f-d66f-4d30-b927-ee65ec4afe43","Type":"ContainerStarted","Data":"1bda6b6476004864c514e008a9cb10ffb2d803f7c093b01161a38815e53c798b"}
Sep 17 01:56:19.987024 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:19.986642    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-404126c3-69cb476bfd-nc4h4"
Sep 17 01:56:20.003987 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:20.003931    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-404126c3-69cb476bfd-nc4h4" podStartSLOduration=2.003915194 podStartE2EDuration="2.003915194s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:56:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:56:20.001770868 +0000 UTC m=+1138.251748183" watchObservedRunningTime="2026-09-17 01:56:20.003915194 +0000 UTC m=+1138.253892507"
Sep 17 01:56:30.993914 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:30.993884    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-404126c3-69cb476bfd-nc4h4"
Sep 17 01:56:37.084867 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:37.084824    2560 generic.go:356] "Generic (PLEG): container finished" podID="311dfce8-14ff-418b-b00d-7678b43270d9" containerID="e85e1e694c4c63c185183b2df50025f41a952ce043b8f3428a080cf0108b9c74" exitCode=0
Sep 17 01:56:37.085410 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:37.084904    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb" event={"ID":"311dfce8-14ff-418b-b00d-7678b43270d9","Type":"ContainerDied","Data":"e85e1e694c4c63c185183b2df50025f41a952ce043b8f3428a080cf0108b9c74"}
Sep 17 01:56:37.085480 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:37.085452    2560 scope.go:117] "RemoveContainer" containerID="e85e1e694c4c63c185183b2df50025f41a952ce043b8f3428a080cf0108b9c74"
Sep 17 01:56:37.086573 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:37.086536    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 01:56:37.086676 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:37.086628    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 01:56:37.086750 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:37.086675    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 01:56:38.092174 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:38.092137    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb" event={"ID":"311dfce8-14ff-418b-b00d-7678b43270d9","Type":"ContainerStarted","Data":"40b713c224dbc9e1bbe7f4564c0b4ff6625165a60e4339c16d6284a003ba61c8"}
Sep 17 01:56:39.041907 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:39.041870    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb"
Sep 17 01:56:39.042090 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:39.042028    2560 patch_prober.go:28] interesting pod/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 17 01:56:39.042140 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:39.042097    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb" podUID="311dfce8-14ff-418b-b00d-7678b43270d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 17 01:56:40.041621 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:40.041586    2560 patch_prober.go:28] interesting pod/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 17 01:56:40.042026 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:40.041650    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb" podUID="311dfce8-14ff-418b-b00d-7678b43270d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 17 01:56:41.042173 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:41.042136    2560 patch_prober.go:28] interesting pod/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 17 01:56:41.042613 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:41.042199    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb" podUID="311dfce8-14ff-418b-b00d-7678b43270d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 17 01:56:42.042024 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:42.041986    2560 patch_prober.go:28] interesting pod/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 17 01:56:42.042197 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:42.042056    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb" podUID="311dfce8-14ff-418b-b00d-7678b43270d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 17 01:56:43.042047 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:43.042007    2560 patch_prober.go:28] interesting pod/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 17 01:56:43.042314 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:43.042062    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb" podUID="311dfce8-14ff-418b-b00d-7678b43270d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 17 01:56:43.952521 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:43.952476    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb"
Sep 17 01:56:44.045710 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:44.045678    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb"
Sep 17 01:56:44.124135 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:44.124107    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb"
Sep 17 01:56:56.169637 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:56.169553    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-404126c3-69cb476bfd-nc4h4"]
Sep 17 01:56:56.170015 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:56.169852    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-404126c3-69cb476bfd-nc4h4" podUID="bac8e79f-d66f-4d30-b927-ee65ec4afe43" containerName="payload-processing" containerID="cri-o://f827e53cb5078ed57fe802fd8e7de09820f4b12592065ba09005be9f234c8070" gracePeriod=30
Sep 17 01:56:56.456660 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:56.456629    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-404126c3-69cb476bfd-nc4h4"
Sep 17 01:56:56.480684 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:56.480639    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb"]
Sep 17 01:56:56.480963 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:56.480909    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb" podUID="311dfce8-14ff-418b-b00d-7678b43270d9" containerName="istio-proxy" containerID="cri-o://40b713c224dbc9e1bbe7f4564c0b4ff6625165a60e4339c16d6284a003ba61c8" gracePeriod=30
Sep 17 01:56:56.519774 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:56.519742    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bac8e79f-d66f-4d30-b927-ee65ec4afe43-plugins-config-volume\") pod \"bac8e79f-d66f-4d30-b927-ee65ec4afe43\" (UID: \"bac8e79f-d66f-4d30-b927-ee65ec4afe43\") "
Sep 17 01:56:56.519945 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:56.519825    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvfkc\" (UniqueName: \"kubernetes.io/projected/bac8e79f-d66f-4d30-b927-ee65ec4afe43-kube-api-access-xvfkc\") pod \"bac8e79f-d66f-4d30-b927-ee65ec4afe43\" (UID: \"bac8e79f-d66f-4d30-b927-ee65ec4afe43\") "
Sep 17 01:56:56.520096 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:56.520070    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bac8e79f-d66f-4d30-b927-ee65ec4afe43-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bac8e79f-d66f-4d30-b927-ee65ec4afe43" (UID: "bac8e79f-d66f-4d30-b927-ee65ec4afe43"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:56:56.522003 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:56.521971    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bac8e79f-d66f-4d30-b927-ee65ec4afe43-kube-api-access-xvfkc" (OuterVolumeSpecName: "kube-api-access-xvfkc") pod "bac8e79f-d66f-4d30-b927-ee65ec4afe43" (UID: "bac8e79f-d66f-4d30-b927-ee65ec4afe43"). InnerVolumeSpecName "kube-api-access-xvfkc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:56:56.621068 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:56.621023    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bac8e79f-d66f-4d30-b927-ee65ec4afe43-plugins-config-volume\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:56:56.621068 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:56.621059    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvfkc\" (UniqueName: \"kubernetes.io/projected/bac8e79f-d66f-4d30-b927-ee65ec4afe43-kube-api-access-xvfkc\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:56:57.199750 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:57.199711    2560 generic.go:356] "Generic (PLEG): container finished" podID="bac8e79f-d66f-4d30-b927-ee65ec4afe43" containerID="f827e53cb5078ed57fe802fd8e7de09820f4b12592065ba09005be9f234c8070" exitCode=0
Sep 17 01:56:57.200178 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:57.199774    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-404126c3-69cb476bfd-nc4h4"
Sep 17 01:56:57.200178 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:57.199801    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-404126c3-69cb476bfd-nc4h4" event={"ID":"bac8e79f-d66f-4d30-b927-ee65ec4afe43","Type":"ContainerDied","Data":"f827e53cb5078ed57fe802fd8e7de09820f4b12592065ba09005be9f234c8070"}
Sep 17 01:56:57.200178 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:57.199851    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-404126c3-69cb476bfd-nc4h4" event={"ID":"bac8e79f-d66f-4d30-b927-ee65ec4afe43","Type":"ContainerDied","Data":"1bda6b6476004864c514e008a9cb10ffb2d803f7c093b01161a38815e53c798b"}
Sep 17 01:56:57.200178 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:57.199873    2560 scope.go:117] "RemoveContainer" containerID="f827e53cb5078ed57fe802fd8e7de09820f4b12592065ba09005be9f234c8070"
Sep 17 01:56:57.209374 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:57.209355    2560 scope.go:117] "RemoveContainer" containerID="f827e53cb5078ed57fe802fd8e7de09820f4b12592065ba09005be9f234c8070"
Sep 17 01:56:57.209671 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:56:57.209650    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f827e53cb5078ed57fe802fd8e7de09820f4b12592065ba09005be9f234c8070\": container with ID starting with f827e53cb5078ed57fe802fd8e7de09820f4b12592065ba09005be9f234c8070 not found: ID does not exist" containerID="f827e53cb5078ed57fe802fd8e7de09820f4b12592065ba09005be9f234c8070"
Sep 17 01:56:57.209741 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:57.209679    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f827e53cb5078ed57fe802fd8e7de09820f4b12592065ba09005be9f234c8070"} err="failed to get container status \"f827e53cb5078ed57fe802fd8e7de09820f4b12592065ba09005be9f234c8070\": rpc error: code = NotFound desc = could not find container \"f827e53cb5078ed57fe802fd8e7de09820f4b12592065ba09005be9f234c8070\": container with ID starting with f827e53cb5078ed57fe802fd8e7de09820f4b12592065ba09005be9f234c8070 not found: ID does not exist"
Sep 17 01:56:57.223688 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:57.223660    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-404126c3-69cb476bfd-nc4h4"]
Sep 17 01:56:57.229641 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:57.229618    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-404126c3-69cb476bfd-nc4h4"]
Sep 17 01:56:58.357508 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:58.357476    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bac8e79f-d66f-4d30-b927-ee65ec4afe43" path="/var/lib/kubelet/pods/bac8e79f-d66f-4d30-b927-ee65ec4afe43/volumes"
Sep 17 01:56:59.125851 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:59.125806    2560 patch_prober.go:28] interesting pod/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 17 01:56:59.126038 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:56:59.125893    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb" podUID="311dfce8-14ff-418b-b00d-7678b43270d9" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 01:57:01.738545 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:01.738519    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb"
Sep 17 01:57:01.771177 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:01.771098    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/311dfce8-14ff-418b-b00d-7678b43270d9-workload-socket\") pod \"311dfce8-14ff-418b-b00d-7678b43270d9\" (UID: \"311dfce8-14ff-418b-b00d-7678b43270d9\") "
Sep 17 01:57:01.771177 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:01.771162    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/311dfce8-14ff-418b-b00d-7678b43270d9-istio-podinfo\") pod \"311dfce8-14ff-418b-b00d-7678b43270d9\" (UID: \"311dfce8-14ff-418b-b00d-7678b43270d9\") "
Sep 17 01:57:01.771406 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:01.771200    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/311dfce8-14ff-418b-b00d-7678b43270d9-workload-certs\") pod \"311dfce8-14ff-418b-b00d-7678b43270d9\" (UID: \"311dfce8-14ff-418b-b00d-7678b43270d9\") "
Sep 17 01:57:01.771406 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:01.771233    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/311dfce8-14ff-418b-b00d-7678b43270d9-credential-socket\") pod \"311dfce8-14ff-418b-b00d-7678b43270d9\" (UID: \"311dfce8-14ff-418b-b00d-7678b43270d9\") "
Sep 17 01:57:01.771406 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:01.771297    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/311dfce8-14ff-418b-b00d-7678b43270d9-istiod-ca-cert\") pod \"311dfce8-14ff-418b-b00d-7678b43270d9\" (UID: \"311dfce8-14ff-418b-b00d-7678b43270d9\") "
Sep 17 01:57:01.771406 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:01.771322    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/311dfce8-14ff-418b-b00d-7678b43270d9-istio-token\") pod \"311dfce8-14ff-418b-b00d-7678b43270d9\" (UID: \"311dfce8-14ff-418b-b00d-7678b43270d9\") "
Sep 17 01:57:01.771406 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:01.771378    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nrfxd\" (UniqueName: \"kubernetes.io/projected/311dfce8-14ff-418b-b00d-7678b43270d9-kube-api-access-nrfxd\") pod \"311dfce8-14ff-418b-b00d-7678b43270d9\" (UID: \"311dfce8-14ff-418b-b00d-7678b43270d9\") "
Sep 17 01:57:01.771673 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:01.771403    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/311dfce8-14ff-418b-b00d-7678b43270d9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "311dfce8-14ff-418b-b00d-7678b43270d9" (UID: "311dfce8-14ff-418b-b00d-7678b43270d9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:57:01.771673 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:01.771447    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/311dfce8-14ff-418b-b00d-7678b43270d9-istio-envoy\") pod \"311dfce8-14ff-418b-b00d-7678b43270d9\" (UID: \"311dfce8-14ff-418b-b00d-7678b43270d9\") "
Sep 17 01:57:01.771673 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:01.771471    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/311dfce8-14ff-418b-b00d-7678b43270d9-istio-data\") pod \"311dfce8-14ff-418b-b00d-7678b43270d9\" (UID: \"311dfce8-14ff-418b-b00d-7678b43270d9\") "
Sep 17 01:57:01.771673 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:01.771505    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/311dfce8-14ff-418b-b00d-7678b43270d9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "311dfce8-14ff-418b-b00d-7678b43270d9" (UID: "311dfce8-14ff-418b-b00d-7678b43270d9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:57:01.771900 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:01.771739    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/311dfce8-14ff-418b-b00d-7678b43270d9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "311dfce8-14ff-418b-b00d-7678b43270d9" (UID: "311dfce8-14ff-418b-b00d-7678b43270d9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:57:01.771900 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:01.771845    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/311dfce8-14ff-418b-b00d-7678b43270d9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "311dfce8-14ff-418b-b00d-7678b43270d9" (UID: "311dfce8-14ff-418b-b00d-7678b43270d9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:57:01.772149 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:01.771958    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/311dfce8-14ff-418b-b00d-7678b43270d9-workload-socket\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:57:01.772149 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:01.771981    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/311dfce8-14ff-418b-b00d-7678b43270d9-workload-certs\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:57:01.772149 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:01.772082    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/311dfce8-14ff-418b-b00d-7678b43270d9-istio-data" (OuterVolumeSpecName: "istio-data") pod "311dfce8-14ff-418b-b00d-7678b43270d9" (UID: "311dfce8-14ff-418b-b00d-7678b43270d9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:57:01.773668 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:01.773641    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/311dfce8-14ff-418b-b00d-7678b43270d9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "311dfce8-14ff-418b-b00d-7678b43270d9" (UID: "311dfce8-14ff-418b-b00d-7678b43270d9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 01:57:01.773894 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:01.773870    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/311dfce8-14ff-418b-b00d-7678b43270d9-istio-token" (OuterVolumeSpecName: "istio-token") pod "311dfce8-14ff-418b-b00d-7678b43270d9" (UID: "311dfce8-14ff-418b-b00d-7678b43270d9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:57:01.773997 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:01.773907    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/311dfce8-14ff-418b-b00d-7678b43270d9-kube-api-access-nrfxd" (OuterVolumeSpecName: "kube-api-access-nrfxd") pod "311dfce8-14ff-418b-b00d-7678b43270d9" (UID: "311dfce8-14ff-418b-b00d-7678b43270d9"). InnerVolumeSpecName "kube-api-access-nrfxd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:57:01.774135 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:01.774110    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/311dfce8-14ff-418b-b00d-7678b43270d9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "311dfce8-14ff-418b-b00d-7678b43270d9" (UID: "311dfce8-14ff-418b-b00d-7678b43270d9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:57:01.873291 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:01.873240    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/311dfce8-14ff-418b-b00d-7678b43270d9-istiod-ca-cert\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:57:01.873291 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:01.873285    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/311dfce8-14ff-418b-b00d-7678b43270d9-istio-token\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:57:01.873291 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:01.873296    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nrfxd\" (UniqueName: \"kubernetes.io/projected/311dfce8-14ff-418b-b00d-7678b43270d9-kube-api-access-nrfxd\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:57:01.873507 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:01.873306    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/311dfce8-14ff-418b-b00d-7678b43270d9-istio-envoy\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:57:01.873507 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:01.873315    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/311dfce8-14ff-418b-b00d-7678b43270d9-istio-data\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:57:01.873507 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:01.873323    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/311dfce8-14ff-418b-b00d-7678b43270d9-istio-podinfo\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:57:01.873507 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:01.873331    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/311dfce8-14ff-418b-b00d-7678b43270d9-credential-socket\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:57:02.227355 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:02.227314    2560 generic.go:356] "Generic (PLEG): container finished" podID="311dfce8-14ff-418b-b00d-7678b43270d9" containerID="40b713c224dbc9e1bbe7f4564c0b4ff6625165a60e4339c16d6284a003ba61c8" exitCode=0
Sep 17 01:57:02.227608 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:02.227371    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb"
Sep 17 01:57:02.227608 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:02.227400    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb" event={"ID":"311dfce8-14ff-418b-b00d-7678b43270d9","Type":"ContainerDied","Data":"40b713c224dbc9e1bbe7f4564c0b4ff6625165a60e4339c16d6284a003ba61c8"}
Sep 17 01:57:02.227608 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:02.227459    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb" event={"ID":"311dfce8-14ff-418b-b00d-7678b43270d9","Type":"ContainerDied","Data":"15d3f367fcc8a406137c55552a8d48db74a3bef85d4b9be22b3fb91aea853f6f"}
Sep 17 01:57:02.227608 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:02.227484    2560 scope.go:117] "RemoveContainer" containerID="40b713c224dbc9e1bbe7f4564c0b4ff6625165a60e4339c16d6284a003ba61c8"
Sep 17 01:57:02.237204 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:02.237187    2560 scope.go:117] "RemoveContainer" containerID="e85e1e694c4c63c185183b2df50025f41a952ce043b8f3428a080cf0108b9c74"
Sep 17 01:57:02.244866 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:02.244839    2560 scope.go:117] "RemoveContainer" containerID="40b713c224dbc9e1bbe7f4564c0b4ff6625165a60e4339c16d6284a003ba61c8"
Sep 17 01:57:02.245114 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:57:02.245086    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40b713c224dbc9e1bbe7f4564c0b4ff6625165a60e4339c16d6284a003ba61c8\": container with ID starting with 40b713c224dbc9e1bbe7f4564c0b4ff6625165a60e4339c16d6284a003ba61c8 not found: ID does not exist" containerID="40b713c224dbc9e1bbe7f4564c0b4ff6625165a60e4339c16d6284a003ba61c8"
Sep 17 01:57:02.245279 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:02.245116    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40b713c224dbc9e1bbe7f4564c0b4ff6625165a60e4339c16d6284a003ba61c8"} err="failed to get container status \"40b713c224dbc9e1bbe7f4564c0b4ff6625165a60e4339c16d6284a003ba61c8\": rpc error: code = NotFound desc = could not find container \"40b713c224dbc9e1bbe7f4564c0b4ff6625165a60e4339c16d6284a003ba61c8\": container with ID starting with 40b713c224dbc9e1bbe7f4564c0b4ff6625165a60e4339c16d6284a003ba61c8 not found: ID does not exist"
Sep 17 01:57:02.245279 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:02.245135    2560 scope.go:117] "RemoveContainer" containerID="e85e1e694c4c63c185183b2df50025f41a952ce043b8f3428a080cf0108b9c74"
Sep 17 01:57:02.245415 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:57:02.245399    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e85e1e694c4c63c185183b2df50025f41a952ce043b8f3428a080cf0108b9c74\": container with ID starting with e85e1e694c4c63c185183b2df50025f41a952ce043b8f3428a080cf0108b9c74 not found: ID does not exist" containerID="e85e1e694c4c63c185183b2df50025f41a952ce043b8f3428a080cf0108b9c74"
Sep 17 01:57:02.245453 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:02.245419    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e85e1e694c4c63c185183b2df50025f41a952ce043b8f3428a080cf0108b9c74"} err="failed to get container status \"e85e1e694c4c63c185183b2df50025f41a952ce043b8f3428a080cf0108b9c74\": rpc error: code = NotFound desc = could not find container \"e85e1e694c4c63c185183b2df50025f41a952ce043b8f3428a080cf0108b9c74\": container with ID starting with e85e1e694c4c63c185183b2df50025f41a952ce043b8f3428a080cf0108b9c74 not found: ID does not exist"
Sep 17 01:57:02.249388 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:02.249364    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb"]
Sep 17 01:57:02.255000 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:02.254979    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-404126c3-gw-openshift-default-b7cc76f8d-f7zqb"]
Sep 17 01:57:02.357023 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:02.356990    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="311dfce8-14ff-418b-b00d-7678b43270d9" path="/var/lib/kubelet/pods/311dfce8-14ff-418b-b00d-7678b43270d9/volumes"
Sep 17 01:57:04.303536 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:04.303505    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-3607043f-5499fc64f8-g6zmv"]
Sep 17 01:57:04.304108 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:04.304085    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bac8e79f-d66f-4d30-b927-ee65ec4afe43" containerName="payload-processing"
Sep 17 01:57:04.304199 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:04.304112    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="bac8e79f-d66f-4d30-b927-ee65ec4afe43" containerName="payload-processing"
Sep 17 01:57:04.304199 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:04.304126    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="311dfce8-14ff-418b-b00d-7678b43270d9" containerName="istio-proxy"
Sep 17 01:57:04.304199 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:04.304134    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="311dfce8-14ff-418b-b00d-7678b43270d9" containerName="istio-proxy"
Sep 17 01:57:04.304379 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:04.304280    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="311dfce8-14ff-418b-b00d-7678b43270d9" containerName="istio-proxy"
Sep 17 01:57:04.304379 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:04.304298    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="311dfce8-14ff-418b-b00d-7678b43270d9" containerName="istio-proxy"
Sep 17 01:57:04.304379 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:04.304312    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="bac8e79f-d66f-4d30-b927-ee65ec4afe43" containerName="payload-processing"
Sep 17 01:57:04.308914 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:04.308892    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-3607043f-5499fc64f8-g6zmv"
Sep 17 01:57:04.310847 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:04.310825    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-3607043f\""
Sep 17 01:57:04.310974 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:04.310908    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-3607043f-dockercfg-s2lbg\""
Sep 17 01:57:04.315761 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:04.315740    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-3607043f-5499fc64f8-g6zmv"]
Sep 17 01:57:04.338093 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:04.338059    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-3607043f-fd4f8b56f-rh79b"]
Sep 17 01:57:04.338482 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:04.338468    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="311dfce8-14ff-418b-b00d-7678b43270d9" containerName="istio-proxy"
Sep 17 01:57:04.338539 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:04.338483    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="311dfce8-14ff-418b-b00d-7678b43270d9" containerName="istio-proxy"
Sep 17 01:57:04.341499 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:04.341480    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-3607043f-fd4f8b56f-rh79b"
Sep 17 01:57:04.358618 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:04.358590    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-3607043f-fd4f8b56f-rh79b"]
Sep 17 01:57:04.399240 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:04.399199    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2hlz\" (UniqueName: \"kubernetes.io/projected/e2f20c8e-9421-4b59-a466-38036dc5dac0-kube-api-access-q2hlz\") pod \"payload-processing-e2e-ait-3607043f-fd4f8b56f-rh79b\" (UID: \"e2f20c8e-9421-4b59-a466-38036dc5dac0\") " pod="openshift-ingress/payload-processing-e2e-ait-3607043f-fd4f8b56f-rh79b"
Sep 17 01:57:04.399457 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:04.399298    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjv8h\" (UniqueName: \"kubernetes.io/projected/d1a02efb-06ba-427f-8b23-9888ef6b1e76-kube-api-access-pjv8h\") pod \"payload-pre-processing-e2e-ait-3607043f-5499fc64f8-g6zmv\" (UID: \"d1a02efb-06ba-427f-8b23-9888ef6b1e76\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-3607043f-5499fc64f8-g6zmv"
Sep 17 01:57:04.399457 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:04.399338    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1a02efb-06ba-427f-8b23-9888ef6b1e76-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-3607043f-5499fc64f8-g6zmv\" (UID: \"d1a02efb-06ba-427f-8b23-9888ef6b1e76\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-3607043f-5499fc64f8-g6zmv"
Sep 17 01:57:04.399457 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:04.399389    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2f20c8e-9421-4b59-a466-38036dc5dac0-plugins-config-volume\") pod \"payload-processing-e2e-ait-3607043f-fd4f8b56f-rh79b\" (UID: \"e2f20c8e-9421-4b59-a466-38036dc5dac0\") " pod="openshift-ingress/payload-processing-e2e-ait-3607043f-fd4f8b56f-rh79b"
Sep 17 01:57:04.500258 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:04.500199    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2hlz\" (UniqueName: \"kubernetes.io/projected/e2f20c8e-9421-4b59-a466-38036dc5dac0-kube-api-access-q2hlz\") pod \"payload-processing-e2e-ait-3607043f-fd4f8b56f-rh79b\" (UID: \"e2f20c8e-9421-4b59-a466-38036dc5dac0\") " pod="openshift-ingress/payload-processing-e2e-ait-3607043f-fd4f8b56f-rh79b"
Sep 17 01:57:04.500456 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:04.500296    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjv8h\" (UniqueName: \"kubernetes.io/projected/d1a02efb-06ba-427f-8b23-9888ef6b1e76-kube-api-access-pjv8h\") pod \"payload-pre-processing-e2e-ait-3607043f-5499fc64f8-g6zmv\" (UID: \"d1a02efb-06ba-427f-8b23-9888ef6b1e76\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-3607043f-5499fc64f8-g6zmv"
Sep 17 01:57:04.500456 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:04.500341    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1a02efb-06ba-427f-8b23-9888ef6b1e76-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-3607043f-5499fc64f8-g6zmv\" (UID: \"d1a02efb-06ba-427f-8b23-9888ef6b1e76\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-3607043f-5499fc64f8-g6zmv"
Sep 17 01:57:04.500591 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:04.500529    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2f20c8e-9421-4b59-a466-38036dc5dac0-plugins-config-volume\") pod \"payload-processing-e2e-ait-3607043f-fd4f8b56f-rh79b\" (UID: \"e2f20c8e-9421-4b59-a466-38036dc5dac0\") " pod="openshift-ingress/payload-processing-e2e-ait-3607043f-fd4f8b56f-rh79b"
Sep 17 01:57:04.501174 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:04.501153    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2f20c8e-9421-4b59-a466-38036dc5dac0-plugins-config-volume\") pod \"payload-processing-e2e-ait-3607043f-fd4f8b56f-rh79b\" (UID: \"e2f20c8e-9421-4b59-a466-38036dc5dac0\") " pod="openshift-ingress/payload-processing-e2e-ait-3607043f-fd4f8b56f-rh79b"
Sep 17 01:57:04.501319 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:04.501299    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1a02efb-06ba-427f-8b23-9888ef6b1e76-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-3607043f-5499fc64f8-g6zmv\" (UID: \"d1a02efb-06ba-427f-8b23-9888ef6b1e76\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-3607043f-5499fc64f8-g6zmv"
Sep 17 01:57:04.509994 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:04.509970    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2hlz\" (UniqueName: \"kubernetes.io/projected/e2f20c8e-9421-4b59-a466-38036dc5dac0-kube-api-access-q2hlz\") pod \"payload-processing-e2e-ait-3607043f-fd4f8b56f-rh79b\" (UID: \"e2f20c8e-9421-4b59-a466-38036dc5dac0\") " pod="openshift-ingress/payload-processing-e2e-ait-3607043f-fd4f8b56f-rh79b"
Sep 17 01:57:04.510096 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:04.510020    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjv8h\" (UniqueName: \"kubernetes.io/projected/d1a02efb-06ba-427f-8b23-9888ef6b1e76-kube-api-access-pjv8h\") pod \"payload-pre-processing-e2e-ait-3607043f-5499fc64f8-g6zmv\" (UID: \"d1a02efb-06ba-427f-8b23-9888ef6b1e76\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-3607043f-5499fc64f8-g6zmv"
Sep 17 01:57:04.620678 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:04.620646    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-3607043f-5499fc64f8-g6zmv"
Sep 17 01:57:04.652165 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:04.652129    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-3607043f-fd4f8b56f-rh79b"
Sep 17 01:57:04.892117 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:04.891926    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-3607043f-5499fc64f8-g6zmv"]
Sep 17 01:57:04.894841 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:57:04.894814    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1a02efb_06ba_427f_8b23_9888ef6b1e76.slice/crio-58a22af7c3c75e3be6341906d508765bcc15b89a93c2579a8d4fbeef2030e851 WatchSource:0}: Error finding container 58a22af7c3c75e3be6341906d508765bcc15b89a93c2579a8d4fbeef2030e851: Status 404 returned error can't find the container with id 58a22af7c3c75e3be6341906d508765bcc15b89a93c2579a8d4fbeef2030e851
Sep 17 01:57:04.942026 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:04.941998    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-3607043f-fd4f8b56f-rh79b"]
Sep 17 01:57:04.942618 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:57:04.942596    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2f20c8e_9421_4b59_a466_38036dc5dac0.slice/crio-488217d2d89071dff59b1b19f829fe63f76df3047a7ad45213f8c7da231b17d3 WatchSource:0}: Error finding container 488217d2d89071dff59b1b19f829fe63f76df3047a7ad45213f8c7da231b17d3: Status 404 returned error can't find the container with id 488217d2d89071dff59b1b19f829fe63f76df3047a7ad45213f8c7da231b17d3
Sep 17 01:57:05.252018 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:05.251910    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-3607043f-fd4f8b56f-rh79b" event={"ID":"e2f20c8e-9421-4b59-a466-38036dc5dac0","Type":"ContainerStarted","Data":"17d6a6f56c0430f396c87adc9136d864e733becadf7b85b40eeef248f4d39789"}
Sep 17 01:57:05.252018 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:05.251978    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-3607043f-fd4f8b56f-rh79b" event={"ID":"e2f20c8e-9421-4b59-a466-38036dc5dac0","Type":"ContainerStarted","Data":"488217d2d89071dff59b1b19f829fe63f76df3047a7ad45213f8c7da231b17d3"}
Sep 17 01:57:05.252234 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:05.252101    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-3607043f-fd4f8b56f-rh79b"
Sep 17 01:57:05.253621 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:05.253591    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-3607043f-5499fc64f8-g6zmv" event={"ID":"d1a02efb-06ba-427f-8b23-9888ef6b1e76","Type":"ContainerStarted","Data":"adbe0d3f5b9f3c92d4fa4fa6af7498364e752a961e4bcc7be7dae3062375fd9a"}
Sep 17 01:57:05.253726 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:05.253636    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-3607043f-5499fc64f8-g6zmv" event={"ID":"d1a02efb-06ba-427f-8b23-9888ef6b1e76","Type":"ContainerStarted","Data":"58a22af7c3c75e3be6341906d508765bcc15b89a93c2579a8d4fbeef2030e851"}
Sep 17 01:57:05.253777 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:05.253739    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-3607043f-5499fc64f8-g6zmv"
Sep 17 01:57:05.268341 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:05.268292    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-3607043f-fd4f8b56f-rh79b" podStartSLOduration=1.268278006 podStartE2EDuration="1.268278006s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:57:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:57:05.265545278 +0000 UTC m=+1183.515522588" watchObservedRunningTime="2026-09-17 01:57:05.268278006 +0000 UTC m=+1183.518255310"
Sep 17 01:57:05.281838 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:05.281781    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-3607043f-5499fc64f8-g6zmv" podStartSLOduration=1.2817669760000001 podStartE2EDuration="1.281766976s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:57:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:57:05.281194044 +0000 UTC m=+1183.531171358" watchObservedRunningTime="2026-09-17 01:57:05.281766976 +0000 UTC m=+1183.531744294"
Sep 17 01:57:16.261037 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:16.261005    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-3607043f-fd4f8b56f-rh79b"
Sep 17 01:57:16.261520 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:16.261080    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-3607043f-5499fc64f8-g6zmv"
Sep 17 01:57:41.940372 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:41.940341    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-3607043f-fd4f8b56f-rh79b"]
Sep 17 01:57:41.940921 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:41.940586    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-3607043f-fd4f8b56f-rh79b" podUID="e2f20c8e-9421-4b59-a466-38036dc5dac0" containerName="payload-processing" containerID="cri-o://17d6a6f56c0430f396c87adc9136d864e733becadf7b85b40eeef248f4d39789" gracePeriod=30
Sep 17 01:57:41.950313 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:41.950286    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-3607043f-5499fc64f8-g6zmv"]
Sep 17 01:57:41.950514 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:41.950487    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-3607043f-5499fc64f8-g6zmv" podUID="d1a02efb-06ba-427f-8b23-9888ef6b1e76" containerName="payload-pre-processing" containerID="cri-o://adbe0d3f5b9f3c92d4fa4fa6af7498364e752a961e4bcc7be7dae3062375fd9a" gracePeriod=30
Sep 17 01:57:42.219854 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:42.219820    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-3607043f-fd4f8b56f-rh79b"
Sep 17 01:57:42.247186 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:42.247096    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q2hlz\" (UniqueName: \"kubernetes.io/projected/e2f20c8e-9421-4b59-a466-38036dc5dac0-kube-api-access-q2hlz\") pod \"e2f20c8e-9421-4b59-a466-38036dc5dac0\" (UID: \"e2f20c8e-9421-4b59-a466-38036dc5dac0\") "
Sep 17 01:57:42.247365 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:42.247201    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2f20c8e-9421-4b59-a466-38036dc5dac0-plugins-config-volume\") pod \"e2f20c8e-9421-4b59-a466-38036dc5dac0\" (UID: \"e2f20c8e-9421-4b59-a466-38036dc5dac0\") "
Sep 17 01:57:42.247787 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:42.247759    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2f20c8e-9421-4b59-a466-38036dc5dac0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e2f20c8e-9421-4b59-a466-38036dc5dac0" (UID: "e2f20c8e-9421-4b59-a466-38036dc5dac0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:57:42.249538 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:42.249511    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2f20c8e-9421-4b59-a466-38036dc5dac0-kube-api-access-q2hlz" (OuterVolumeSpecName: "kube-api-access-q2hlz") pod "e2f20c8e-9421-4b59-a466-38036dc5dac0" (UID: "e2f20c8e-9421-4b59-a466-38036dc5dac0"). InnerVolumeSpecName "kube-api-access-q2hlz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:57:42.250758 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:42.250737    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-3607043f-5499fc64f8-g6zmv"
Sep 17 01:57:42.347993 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:42.347958    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pjv8h\" (UniqueName: \"kubernetes.io/projected/d1a02efb-06ba-427f-8b23-9888ef6b1e76-kube-api-access-pjv8h\") pod \"d1a02efb-06ba-427f-8b23-9888ef6b1e76\" (UID: \"d1a02efb-06ba-427f-8b23-9888ef6b1e76\") "
Sep 17 01:57:42.348167 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:42.348011    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1a02efb-06ba-427f-8b23-9888ef6b1e76-plugins-config-volume\") pod \"d1a02efb-06ba-427f-8b23-9888ef6b1e76\" (UID: \"d1a02efb-06ba-427f-8b23-9888ef6b1e76\") "
Sep 17 01:57:42.348212 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:42.348198    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2hlz\" (UniqueName: \"kubernetes.io/projected/e2f20c8e-9421-4b59-a466-38036dc5dac0-kube-api-access-q2hlz\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:57:42.348212 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:42.348209    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2f20c8e-9421-4b59-a466-38036dc5dac0-plugins-config-volume\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:57:42.348455 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:42.348419    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1a02efb-06ba-427f-8b23-9888ef6b1e76-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d1a02efb-06ba-427f-8b23-9888ef6b1e76" (UID: "d1a02efb-06ba-427f-8b23-9888ef6b1e76"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:57:42.350005 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:42.349980    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1a02efb-06ba-427f-8b23-9888ef6b1e76-kube-api-access-pjv8h" (OuterVolumeSpecName: "kube-api-access-pjv8h") pod "d1a02efb-06ba-427f-8b23-9888ef6b1e76" (UID: "d1a02efb-06ba-427f-8b23-9888ef6b1e76"). InnerVolumeSpecName "kube-api-access-pjv8h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:57:42.436969 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:42.436930    2560 generic.go:356] "Generic (PLEG): container finished" podID="e2f20c8e-9421-4b59-a466-38036dc5dac0" containerID="17d6a6f56c0430f396c87adc9136d864e733becadf7b85b40eeef248f4d39789" exitCode=0
Sep 17 01:57:42.437159 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:42.436980    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-3607043f-fd4f8b56f-rh79b"
Sep 17 01:57:42.437159 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:42.437014    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-3607043f-fd4f8b56f-rh79b" event={"ID":"e2f20c8e-9421-4b59-a466-38036dc5dac0","Type":"ContainerDied","Data":"17d6a6f56c0430f396c87adc9136d864e733becadf7b85b40eeef248f4d39789"}
Sep 17 01:57:42.437159 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:42.437076    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-3607043f-fd4f8b56f-rh79b" event={"ID":"e2f20c8e-9421-4b59-a466-38036dc5dac0","Type":"ContainerDied","Data":"488217d2d89071dff59b1b19f829fe63f76df3047a7ad45213f8c7da231b17d3"}
Sep 17 01:57:42.437159 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:42.437112    2560 scope.go:117] "RemoveContainer" containerID="17d6a6f56c0430f396c87adc9136d864e733becadf7b85b40eeef248f4d39789"
Sep 17 01:57:42.438415 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:42.438393    2560 generic.go:356] "Generic (PLEG): container finished" podID="d1a02efb-06ba-427f-8b23-9888ef6b1e76" containerID="adbe0d3f5b9f3c92d4fa4fa6af7498364e752a961e4bcc7be7dae3062375fd9a" exitCode=0
Sep 17 01:57:42.438499 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:42.438446    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-3607043f-5499fc64f8-g6zmv"
Sep 17 01:57:42.438565 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:42.438450    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-3607043f-5499fc64f8-g6zmv" event={"ID":"d1a02efb-06ba-427f-8b23-9888ef6b1e76","Type":"ContainerDied","Data":"adbe0d3f5b9f3c92d4fa4fa6af7498364e752a961e4bcc7be7dae3062375fd9a"}
Sep 17 01:57:42.438565 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:42.438557    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-3607043f-5499fc64f8-g6zmv" event={"ID":"d1a02efb-06ba-427f-8b23-9888ef6b1e76","Type":"ContainerDied","Data":"58a22af7c3c75e3be6341906d508765bcc15b89a93c2579a8d4fbeef2030e851"}
Sep 17 01:57:42.445921 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:42.445904    2560 scope.go:117] "RemoveContainer" containerID="17d6a6f56c0430f396c87adc9136d864e733becadf7b85b40eeef248f4d39789"
Sep 17 01:57:42.446203 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:57:42.446185    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17d6a6f56c0430f396c87adc9136d864e733becadf7b85b40eeef248f4d39789\": container with ID starting with 17d6a6f56c0430f396c87adc9136d864e733becadf7b85b40eeef248f4d39789 not found: ID does not exist" containerID="17d6a6f56c0430f396c87adc9136d864e733becadf7b85b40eeef248f4d39789"
Sep 17 01:57:42.446283 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:42.446209    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17d6a6f56c0430f396c87adc9136d864e733becadf7b85b40eeef248f4d39789"} err="failed to get container status \"17d6a6f56c0430f396c87adc9136d864e733becadf7b85b40eeef248f4d39789\": rpc error: code = NotFound desc = could not find container \"17d6a6f56c0430f396c87adc9136d864e733becadf7b85b40eeef248f4d39789\": container with ID starting with 17d6a6f56c0430f396c87adc9136d864e733becadf7b85b40eeef248f4d39789 not found: ID does not exist"
Sep 17 01:57:42.446283 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:42.446224    2560 scope.go:117] "RemoveContainer" containerID="adbe0d3f5b9f3c92d4fa4fa6af7498364e752a961e4bcc7be7dae3062375fd9a"
Sep 17 01:57:42.449815 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:42.449754    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pjv8h\" (UniqueName: \"kubernetes.io/projected/d1a02efb-06ba-427f-8b23-9888ef6b1e76-kube-api-access-pjv8h\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:57:42.449815 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:42.449785    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1a02efb-06ba-427f-8b23-9888ef6b1e76-plugins-config-volume\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:57:42.454438 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:42.454415    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-3607043f-5499fc64f8-g6zmv"]
Sep 17 01:57:42.454798 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:42.454784    2560 scope.go:117] "RemoveContainer" containerID="adbe0d3f5b9f3c92d4fa4fa6af7498364e752a961e4bcc7be7dae3062375fd9a"
Sep 17 01:57:42.455114 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:57:42.455093    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"adbe0d3f5b9f3c92d4fa4fa6af7498364e752a961e4bcc7be7dae3062375fd9a\": container with ID starting with adbe0d3f5b9f3c92d4fa4fa6af7498364e752a961e4bcc7be7dae3062375fd9a not found: ID does not exist" containerID="adbe0d3f5b9f3c92d4fa4fa6af7498364e752a961e4bcc7be7dae3062375fd9a"
Sep 17 01:57:42.455199 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:42.455126    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adbe0d3f5b9f3c92d4fa4fa6af7498364e752a961e4bcc7be7dae3062375fd9a"} err="failed to get container status \"adbe0d3f5b9f3c92d4fa4fa6af7498364e752a961e4bcc7be7dae3062375fd9a\": rpc error: code = NotFound desc = could not find container \"adbe0d3f5b9f3c92d4fa4fa6af7498364e752a961e4bcc7be7dae3062375fd9a\": container with ID starting with adbe0d3f5b9f3c92d4fa4fa6af7498364e752a961e4bcc7be7dae3062375fd9a not found: ID does not exist"
Sep 17 01:57:42.457667 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:42.457646    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-3607043f-5499fc64f8-g6zmv"]
Sep 17 01:57:42.466047 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:42.466012    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-3607043f-fd4f8b56f-rh79b"]
Sep 17 01:57:42.471864 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:42.471845    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-3607043f-fd4f8b56f-rh79b"]
Sep 17 01:57:44.153602 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:44.153570    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn"]
Sep 17 01:57:44.154099 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:44.153944    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1a02efb-06ba-427f-8b23-9888ef6b1e76" containerName="payload-pre-processing"
Sep 17 01:57:44.154099 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:44.153955    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1a02efb-06ba-427f-8b23-9888ef6b1e76" containerName="payload-pre-processing"
Sep 17 01:57:44.154099 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:44.153964    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2f20c8e-9421-4b59-a466-38036dc5dac0" containerName="payload-processing"
Sep 17 01:57:44.154099 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:44.153970    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2f20c8e-9421-4b59-a466-38036dc5dac0" containerName="payload-processing"
Sep 17 01:57:44.154099 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:44.154039    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1a02efb-06ba-427f-8b23-9888ef6b1e76" containerName="payload-pre-processing"
Sep 17 01:57:44.154099 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:44.154048    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2f20c8e-9421-4b59-a466-38036dc5dac0" containerName="payload-processing"
Sep 17 01:57:44.158205 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:44.158178    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn"
Sep 17 01:57:44.160489 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:44.160468    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-56574e4f-openshift-default-dockercfg-x62p5\""
Sep 17 01:57:44.167874 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:44.167851    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn"]
Sep 17 01:57:44.268073 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:44.268031    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9074146c-7a41-487f-8c42-c483dc233734-credential-socket\") pod \"e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn\" (UID: \"9074146c-7a41-487f-8c42-c483dc233734\") " pod="openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn"
Sep 17 01:57:44.268285 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:44.268088    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9074146c-7a41-487f-8c42-c483dc233734-workload-socket\") pod \"e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn\" (UID: \"9074146c-7a41-487f-8c42-c483dc233734\") " pod="openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn"
Sep 17 01:57:44.268285 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:44.268113    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9074146c-7a41-487f-8c42-c483dc233734-istio-data\") pod \"e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn\" (UID: \"9074146c-7a41-487f-8c42-c483dc233734\") " pod="openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn"
Sep 17 01:57:44.268285 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:44.268142    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9074146c-7a41-487f-8c42-c483dc233734-istio-token\") pod \"e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn\" (UID: \"9074146c-7a41-487f-8c42-c483dc233734\") " pod="openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn"
Sep 17 01:57:44.268285 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:44.268160    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9074146c-7a41-487f-8c42-c483dc233734-istiod-ca-cert\") pod \"e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn\" (UID: \"9074146c-7a41-487f-8c42-c483dc233734\") " pod="openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn"
Sep 17 01:57:44.268285 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:44.268189    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9074146c-7a41-487f-8c42-c483dc233734-workload-certs\") pod \"e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn\" (UID: \"9074146c-7a41-487f-8c42-c483dc233734\") " pod="openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn"
Sep 17 01:57:44.268285 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:44.268222    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wr27\" (UniqueName: \"kubernetes.io/projected/9074146c-7a41-487f-8c42-c483dc233734-kube-api-access-2wr27\") pod \"e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn\" (UID: \"9074146c-7a41-487f-8c42-c483dc233734\") " pod="openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn"
Sep 17 01:57:44.268642 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:44.268306    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9074146c-7a41-487f-8c42-c483dc233734-istio-envoy\") pod \"e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn\" (UID: \"9074146c-7a41-487f-8c42-c483dc233734\") " pod="openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn"
Sep 17 01:57:44.268642 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:44.268327    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9074146c-7a41-487f-8c42-c483dc233734-istio-podinfo\") pod \"e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn\" (UID: \"9074146c-7a41-487f-8c42-c483dc233734\") " pod="openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn"
Sep 17 01:57:44.358741 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:44.358709    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1a02efb-06ba-427f-8b23-9888ef6b1e76" path="/var/lib/kubelet/pods/d1a02efb-06ba-427f-8b23-9888ef6b1e76/volumes"
Sep 17 01:57:44.359110 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:44.359095    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2f20c8e-9421-4b59-a466-38036dc5dac0" path="/var/lib/kubelet/pods/e2f20c8e-9421-4b59-a466-38036dc5dac0/volumes"
Sep 17 01:57:44.369041 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:44.369011    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9074146c-7a41-487f-8c42-c483dc233734-credential-socket\") pod \"e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn\" (UID: \"9074146c-7a41-487f-8c42-c483dc233734\") " pod="openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn"
Sep 17 01:57:44.369184 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:44.369046    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9074146c-7a41-487f-8c42-c483dc233734-workload-socket\") pod \"e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn\" (UID: \"9074146c-7a41-487f-8c42-c483dc233734\") " pod="openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn"
Sep 17 01:57:44.369184 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:44.369064    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9074146c-7a41-487f-8c42-c483dc233734-istio-data\") pod \"e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn\" (UID: \"9074146c-7a41-487f-8c42-c483dc233734\") " pod="openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn"
Sep 17 01:57:44.369352 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:44.369184    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9074146c-7a41-487f-8c42-c483dc233734-istio-token\") pod \"e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn\" (UID: \"9074146c-7a41-487f-8c42-c483dc233734\") " pod="openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn"
Sep 17 01:57:44.369352 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:44.369232    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9074146c-7a41-487f-8c42-c483dc233734-istiod-ca-cert\") pod \"e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn\" (UID: \"9074146c-7a41-487f-8c42-c483dc233734\") " pod="openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn"
Sep 17 01:57:44.369352 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:44.369299    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9074146c-7a41-487f-8c42-c483dc233734-workload-certs\") pod \"e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn\" (UID: \"9074146c-7a41-487f-8c42-c483dc233734\") " pod="openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn"
Sep 17 01:57:44.369352 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:44.369335    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wr27\" (UniqueName: \"kubernetes.io/projected/9074146c-7a41-487f-8c42-c483dc233734-kube-api-access-2wr27\") pod \"e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn\" (UID: \"9074146c-7a41-487f-8c42-c483dc233734\") " pod="openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn"
Sep 17 01:57:44.369566 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:44.369368    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9074146c-7a41-487f-8c42-c483dc233734-workload-socket\") pod \"e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn\" (UID: \"9074146c-7a41-487f-8c42-c483dc233734\") " pod="openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn"
Sep 17 01:57:44.369566 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:44.369425    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9074146c-7a41-487f-8c42-c483dc233734-credential-socket\") pod \"e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn\" (UID: \"9074146c-7a41-487f-8c42-c483dc233734\") " pod="openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn"
Sep 17 01:57:44.369566 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:44.369472    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9074146c-7a41-487f-8c42-c483dc233734-istio-envoy\") pod \"e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn\" (UID: \"9074146c-7a41-487f-8c42-c483dc233734\") " pod="openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn"
Sep 17 01:57:44.369566 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:44.369504    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9074146c-7a41-487f-8c42-c483dc233734-istio-podinfo\") pod \"e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn\" (UID: \"9074146c-7a41-487f-8c42-c483dc233734\") " pod="openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn"
Sep 17 01:57:44.369566 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:44.369554    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9074146c-7a41-487f-8c42-c483dc233734-istio-data\") pod \"e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn\" (UID: \"9074146c-7a41-487f-8c42-c483dc233734\") " pod="openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn"
Sep 17 01:57:44.369780 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:44.369647    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9074146c-7a41-487f-8c42-c483dc233734-workload-certs\") pod \"e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn\" (UID: \"9074146c-7a41-487f-8c42-c483dc233734\") " pod="openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn"
Sep 17 01:57:44.369943 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:44.369918    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9074146c-7a41-487f-8c42-c483dc233734-istiod-ca-cert\") pod \"e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn\" (UID: \"9074146c-7a41-487f-8c42-c483dc233734\") " pod="openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn"
Sep 17 01:57:44.371710 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:44.371683    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9074146c-7a41-487f-8c42-c483dc233734-istio-envoy\") pod \"e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn\" (UID: \"9074146c-7a41-487f-8c42-c483dc233734\") " pod="openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn"
Sep 17 01:57:44.371923 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:44.371901    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9074146c-7a41-487f-8c42-c483dc233734-istio-podinfo\") pod \"e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn\" (UID: \"9074146c-7a41-487f-8c42-c483dc233734\") " pod="openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn"
Sep 17 01:57:44.376430 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:44.376407    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wr27\" (UniqueName: \"kubernetes.io/projected/9074146c-7a41-487f-8c42-c483dc233734-kube-api-access-2wr27\") pod \"e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn\" (UID: \"9074146c-7a41-487f-8c42-c483dc233734\") " pod="openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn"
Sep 17 01:57:44.376536 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:44.376516    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9074146c-7a41-487f-8c42-c483dc233734-istio-token\") pod \"e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn\" (UID: \"9074146c-7a41-487f-8c42-c483dc233734\") " pod="openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn"
Sep 17 01:57:44.470317 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:44.470214    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn"
Sep 17 01:57:44.750222 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:44.750194    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn"]
Sep 17 01:57:44.753075 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:57:44.753048    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9074146c_7a41_487f_8c42_c483dc233734.slice/crio-7224c0bf11857de51441c42a5ee68be3dd00eda34829349bd8df68fb8bbb0b1e WatchSource:0}: Error finding container 7224c0bf11857de51441c42a5ee68be3dd00eda34829349bd8df68fb8bbb0b1e: Status 404 returned error can't find the container with id 7224c0bf11857de51441c42a5ee68be3dd00eda34829349bd8df68fb8bbb0b1e
Sep 17 01:57:44.755541 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:44.755499    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 01:57:44.755635 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:44.755588    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 01:57:44.755635 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:44.755628    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 01:57:45.458022 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:45.457985    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn" event={"ID":"9074146c-7a41-487f-8c42-c483dc233734","Type":"ContainerStarted","Data":"64725c0450a14a0db3feb034059bda81ce2f476dacd4c65d6321eca7dca1a501"}
Sep 17 01:57:45.458410 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:45.458046    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn" event={"ID":"9074146c-7a41-487f-8c42-c483dc233734","Type":"ContainerStarted","Data":"7224c0bf11857de51441c42a5ee68be3dd00eda34829349bd8df68fb8bbb0b1e"}
Sep 17 01:57:45.471311 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:45.471287    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn"
Sep 17 01:57:45.476733 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:45.476684    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn" podStartSLOduration=1.476664639 podStartE2EDuration="1.476664639s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:57:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:57:45.473979306 +0000 UTC m=+1223.723956619" watchObservedRunningTime="2026-09-17 01:57:45.476664639 +0000 UTC m=+1223.726641953"
Sep 17 01:57:45.477138 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:45.477122    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn"
Sep 17 01:57:46.463511 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:46.463473    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn"
Sep 17 01:57:46.464548 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:46.464529    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn"
Sep 17 01:57:50.922851 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:50.922815    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-56574e4f-dcc6d94fd-gndmt"]
Sep 17 01:57:50.926519 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:50.926495    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-56574e4f-dcc6d94fd-gndmt"
Sep 17 01:57:50.928391 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:50.928366    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-56574e4f-dockercfg-8k2kg\""
Sep 17 01:57:50.928491 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:50.928377    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-56574e4f\""
Sep 17 01:57:50.936426 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:50.936400    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-56574e4f-dcc6d94fd-gndmt"]
Sep 17 01:57:50.956231 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:50.956200    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-56574e4f-75f847557-7b8jx"]
Sep 17 01:57:50.960440 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:50.960420    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-56574e4f-75f847557-7b8jx"
Sep 17 01:57:50.970611 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:50.970585    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-56574e4f-75f847557-7b8jx"]
Sep 17 01:57:51.038207 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:51.038175    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7ljm\" (UniqueName: \"kubernetes.io/projected/1baf059e-af53-43ac-bffe-fdbfecd58cd3-kube-api-access-m7ljm\") pod \"payload-pre-processing-e2e-derive-56574e4f-dcc6d94fd-gndmt\" (UID: \"1baf059e-af53-43ac-bffe-fdbfecd58cd3\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-56574e4f-dcc6d94fd-gndmt"
Sep 17 01:57:51.038425 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:51.038222    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hwgq\" (UniqueName: \"kubernetes.io/projected/5be6ca4e-319d-4403-9ef1-1909afea1f02-kube-api-access-6hwgq\") pod \"payload-processing-e2e-derive-56574e4f-75f847557-7b8jx\" (UID: \"5be6ca4e-319d-4403-9ef1-1909afea1f02\") " pod="openshift-ingress/payload-processing-e2e-derive-56574e4f-75f847557-7b8jx"
Sep 17 01:57:51.038425 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:51.038277    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5be6ca4e-319d-4403-9ef1-1909afea1f02-plugins-config-volume\") pod \"payload-processing-e2e-derive-56574e4f-75f847557-7b8jx\" (UID: \"5be6ca4e-319d-4403-9ef1-1909afea1f02\") " pod="openshift-ingress/payload-processing-e2e-derive-56574e4f-75f847557-7b8jx"
Sep 17 01:57:51.038425 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:51.038326    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1baf059e-af53-43ac-bffe-fdbfecd58cd3-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-56574e4f-dcc6d94fd-gndmt\" (UID: \"1baf059e-af53-43ac-bffe-fdbfecd58cd3\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-56574e4f-dcc6d94fd-gndmt"
Sep 17 01:57:51.139735 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:51.139687    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7ljm\" (UniqueName: \"kubernetes.io/projected/1baf059e-af53-43ac-bffe-fdbfecd58cd3-kube-api-access-m7ljm\") pod \"payload-pre-processing-e2e-derive-56574e4f-dcc6d94fd-gndmt\" (UID: \"1baf059e-af53-43ac-bffe-fdbfecd58cd3\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-56574e4f-dcc6d94fd-gndmt"
Sep 17 01:57:51.139937 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:51.139759    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hwgq\" (UniqueName: \"kubernetes.io/projected/5be6ca4e-319d-4403-9ef1-1909afea1f02-kube-api-access-6hwgq\") pod \"payload-processing-e2e-derive-56574e4f-75f847557-7b8jx\" (UID: \"5be6ca4e-319d-4403-9ef1-1909afea1f02\") " pod="openshift-ingress/payload-processing-e2e-derive-56574e4f-75f847557-7b8jx"
Sep 17 01:57:51.139937 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:51.139790    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5be6ca4e-319d-4403-9ef1-1909afea1f02-plugins-config-volume\") pod \"payload-processing-e2e-derive-56574e4f-75f847557-7b8jx\" (UID: \"5be6ca4e-319d-4403-9ef1-1909afea1f02\") " pod="openshift-ingress/payload-processing-e2e-derive-56574e4f-75f847557-7b8jx"
Sep 17 01:57:51.139937 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:51.139815    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1baf059e-af53-43ac-bffe-fdbfecd58cd3-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-56574e4f-dcc6d94fd-gndmt\" (UID: \"1baf059e-af53-43ac-bffe-fdbfecd58cd3\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-56574e4f-dcc6d94fd-gndmt"
Sep 17 01:57:51.140634 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:51.140608    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1baf059e-af53-43ac-bffe-fdbfecd58cd3-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-56574e4f-dcc6d94fd-gndmt\" (UID: \"1baf059e-af53-43ac-bffe-fdbfecd58cd3\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-56574e4f-dcc6d94fd-gndmt"
Sep 17 01:57:51.140754 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:51.140610    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5be6ca4e-319d-4403-9ef1-1909afea1f02-plugins-config-volume\") pod \"payload-processing-e2e-derive-56574e4f-75f847557-7b8jx\" (UID: \"5be6ca4e-319d-4403-9ef1-1909afea1f02\") " pod="openshift-ingress/payload-processing-e2e-derive-56574e4f-75f847557-7b8jx"
Sep 17 01:57:51.146886 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:51.146860    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7ljm\" (UniqueName: \"kubernetes.io/projected/1baf059e-af53-43ac-bffe-fdbfecd58cd3-kube-api-access-m7ljm\") pod \"payload-pre-processing-e2e-derive-56574e4f-dcc6d94fd-gndmt\" (UID: \"1baf059e-af53-43ac-bffe-fdbfecd58cd3\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-56574e4f-dcc6d94fd-gndmt"
Sep 17 01:57:51.147064 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:51.147039    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hwgq\" (UniqueName: \"kubernetes.io/projected/5be6ca4e-319d-4403-9ef1-1909afea1f02-kube-api-access-6hwgq\") pod \"payload-processing-e2e-derive-56574e4f-75f847557-7b8jx\" (UID: \"5be6ca4e-319d-4403-9ef1-1909afea1f02\") " pod="openshift-ingress/payload-processing-e2e-derive-56574e4f-75f847557-7b8jx"
Sep 17 01:57:51.239373 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:51.239290    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-56574e4f-dcc6d94fd-gndmt"
Sep 17 01:57:51.273156 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:51.273115    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-56574e4f-75f847557-7b8jx"
Sep 17 01:57:51.510527 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:51.510492    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-56574e4f-dcc6d94fd-gndmt"]
Sep 17 01:57:51.512797 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:57:51.512769    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1baf059e_af53_43ac_bffe_fdbfecd58cd3.slice/crio-4ad58b1cd0f08fe3a4e15b9bf351f3f8f894cfac7d138998a36340f91d9db75c WatchSource:0}: Error finding container 4ad58b1cd0f08fe3a4e15b9bf351f3f8f894cfac7d138998a36340f91d9db75c: Status 404 returned error can't find the container with id 4ad58b1cd0f08fe3a4e15b9bf351f3f8f894cfac7d138998a36340f91d9db75c
Sep 17 01:57:51.561569 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:51.561544    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-56574e4f-75f847557-7b8jx"]
Sep 17 01:57:51.564263 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:57:51.564225    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5be6ca4e_319d_4403_9ef1_1909afea1f02.slice/crio-b3bca0a9d6bd5fad81514c2c2ba2ebdf36f0153a6ed7f8b94a4a204edbf80e1d WatchSource:0}: Error finding container b3bca0a9d6bd5fad81514c2c2ba2ebdf36f0153a6ed7f8b94a4a204edbf80e1d: Status 404 returned error can't find the container with id b3bca0a9d6bd5fad81514c2c2ba2ebdf36f0153a6ed7f8b94a4a204edbf80e1d
Sep 17 01:57:52.496118 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:52.496078    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-56574e4f-75f847557-7b8jx" event={"ID":"5be6ca4e-319d-4403-9ef1-1909afea1f02","Type":"ContainerStarted","Data":"f54d98ae6ee55a1e96b0b230d0d1704421f3c568e31b211fc4c4466dbfdf29cf"}
Sep 17 01:57:52.496638 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:52.496136    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-56574e4f-75f847557-7b8jx" event={"ID":"5be6ca4e-319d-4403-9ef1-1909afea1f02","Type":"ContainerStarted","Data":"b3bca0a9d6bd5fad81514c2c2ba2ebdf36f0153a6ed7f8b94a4a204edbf80e1d"}
Sep 17 01:57:52.496638 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:52.496166    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-56574e4f-75f847557-7b8jx"
Sep 17 01:57:52.497833 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:52.497806    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-56574e4f-dcc6d94fd-gndmt" event={"ID":"1baf059e-af53-43ac-bffe-fdbfecd58cd3","Type":"ContainerStarted","Data":"b2c895e28d51446102735ad5af99372bd9bb4db65b21a9888866084baf11b833"}
Sep 17 01:57:52.497943 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:52.497855    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-56574e4f-dcc6d94fd-gndmt" event={"ID":"1baf059e-af53-43ac-bffe-fdbfecd58cd3","Type":"ContainerStarted","Data":"4ad58b1cd0f08fe3a4e15b9bf351f3f8f894cfac7d138998a36340f91d9db75c"}
Sep 17 01:57:52.497943 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:52.497877    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-56574e4f-dcc6d94fd-gndmt"
Sep 17 01:57:52.512438 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:52.512390    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-56574e4f-75f847557-7b8jx" podStartSLOduration=2.512375321 podStartE2EDuration="2.512375321s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:57:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:57:52.511061874 +0000 UTC m=+1230.761039186" watchObservedRunningTime="2026-09-17 01:57:52.512375321 +0000 UTC m=+1230.762352675"
Sep 17 01:57:52.527406 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:57:52.527355    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-56574e4f-dcc6d94fd-gndmt" podStartSLOduration=2.527340785 podStartE2EDuration="2.527340785s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:57:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:57:52.525684166 +0000 UTC m=+1230.775661481" watchObservedRunningTime="2026-09-17 01:57:52.527340785 +0000 UTC m=+1230.777318098"
Sep 17 01:58:03.505032 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:03.504999    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-56574e4f-75f847557-7b8jx"
Sep 17 01:58:03.505506 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:03.505195    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-56574e4f-dcc6d94fd-gndmt"
Sep 17 01:58:10.602375 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:10.602341    2560 generic.go:356] "Generic (PLEG): container finished" podID="9074146c-7a41-487f-8c42-c483dc233734" containerID="64725c0450a14a0db3feb034059bda81ce2f476dacd4c65d6321eca7dca1a501" exitCode=0
Sep 17 01:58:10.602732 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:10.602408    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn" event={"ID":"9074146c-7a41-487f-8c42-c483dc233734","Type":"ContainerDied","Data":"64725c0450a14a0db3feb034059bda81ce2f476dacd4c65d6321eca7dca1a501"}
Sep 17 01:58:10.602825 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:10.602811    2560 scope.go:117] "RemoveContainer" containerID="64725c0450a14a0db3feb034059bda81ce2f476dacd4c65d6321eca7dca1a501"
Sep 17 01:58:10.603916 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:10.603888    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 01:58:10.603974 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:10.603957    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 01:58:10.604019 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:10.604006    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 01:58:11.610332 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:11.610299    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn" event={"ID":"9074146c-7a41-487f-8c42-c483dc233734","Type":"ContainerStarted","Data":"862cab05df59ce52fdd4a2d7654fba3e1b12c490159658ac5f862f475756264a"}
Sep 17 01:58:12.471086 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:12.471046    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn"
Sep 17 01:58:12.472712 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:12.472375    2560 patch_prober.go:28] interesting pod/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 17 01:58:12.472712 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:12.472445    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn" podUID="9074146c-7a41-487f-8c42-c483dc233734" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 17 01:58:13.470942 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:13.470892    2560 patch_prober.go:28] interesting pod/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 17 01:58:13.471492 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:13.470977    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn" podUID="9074146c-7a41-487f-8c42-c483dc233734" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 17 01:58:14.471358 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:14.471313    2560 patch_prober.go:28] interesting pod/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 17 01:58:14.471847 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:14.471395    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn" podUID="9074146c-7a41-487f-8c42-c483dc233734" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 17 01:58:15.471139 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:15.471095    2560 patch_prober.go:28] interesting pod/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 17 01:58:15.471378 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:15.471171    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn" podUID="9074146c-7a41-487f-8c42-c483dc233734" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 17 01:58:16.463987 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:16.463946    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn"
Sep 17 01:58:16.471160 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:16.471126    2560 patch_prober.go:28] interesting pod/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Sep 17 01:58:16.471499 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:16.471412    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn" podUID="9074146c-7a41-487f-8c42-c483dc233734" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Sep 17 01:58:17.475299 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:17.475263    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn"
Sep 17 01:58:17.476400 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:17.476377    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn"
Sep 17 01:58:28.746004 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:28.745971    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-56574e4f-75f847557-7b8jx"]
Sep 17 01:58:28.746512 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:28.746202    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-56574e4f-75f847557-7b8jx" podUID="5be6ca4e-319d-4403-9ef1-1909afea1f02" containerName="payload-processing" containerID="cri-o://f54d98ae6ee55a1e96b0b230d0d1704421f3c568e31b211fc4c4466dbfdf29cf" gracePeriod=30
Sep 17 01:58:28.750932 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:28.750904    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-56574e4f-dcc6d94fd-gndmt"]
Sep 17 01:58:28.751316 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:28.751290    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-56574e4f-dcc6d94fd-gndmt" podUID="1baf059e-af53-43ac-bffe-fdbfecd58cd3" containerName="payload-pre-processing" containerID="cri-o://b2c895e28d51446102735ad5af99372bd9bb4db65b21a9888866084baf11b833" gracePeriod=30
Sep 17 01:58:29.060021 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:29.059767    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-56574e4f-75f847557-7b8jx"
Sep 17 01:58:29.060266 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:29.060221    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn"]
Sep 17 01:58:29.060482 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:29.060449    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn" podUID="9074146c-7a41-487f-8c42-c483dc233734" containerName="istio-proxy" containerID="cri-o://862cab05df59ce52fdd4a2d7654fba3e1b12c490159658ac5f862f475756264a" gracePeriod=30
Sep 17 01:58:29.064979 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:29.064957    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-56574e4f-dcc6d94fd-gndmt"
Sep 17 01:58:29.114888 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:29.114854    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m7ljm\" (UniqueName: \"kubernetes.io/projected/1baf059e-af53-43ac-bffe-fdbfecd58cd3-kube-api-access-m7ljm\") pod \"1baf059e-af53-43ac-bffe-fdbfecd58cd3\" (UID: \"1baf059e-af53-43ac-bffe-fdbfecd58cd3\") "
Sep 17 01:58:29.115066 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:29.114900    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1baf059e-af53-43ac-bffe-fdbfecd58cd3-plugins-config-volume\") pod \"1baf059e-af53-43ac-bffe-fdbfecd58cd3\" (UID: \"1baf059e-af53-43ac-bffe-fdbfecd58cd3\") "
Sep 17 01:58:29.115066 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:29.115001    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6hwgq\" (UniqueName: \"kubernetes.io/projected/5be6ca4e-319d-4403-9ef1-1909afea1f02-kube-api-access-6hwgq\") pod \"5be6ca4e-319d-4403-9ef1-1909afea1f02\" (UID: \"5be6ca4e-319d-4403-9ef1-1909afea1f02\") "
Sep 17 01:58:29.115164 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:29.115110    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5be6ca4e-319d-4403-9ef1-1909afea1f02-plugins-config-volume\") pod \"5be6ca4e-319d-4403-9ef1-1909afea1f02\" (UID: \"5be6ca4e-319d-4403-9ef1-1909afea1f02\") "
Sep 17 01:58:29.115377 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:29.115344    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1baf059e-af53-43ac-bffe-fdbfecd58cd3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1baf059e-af53-43ac-bffe-fdbfecd58cd3" (UID: "1baf059e-af53-43ac-bffe-fdbfecd58cd3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:58:29.115590 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:29.115563    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5be6ca4e-319d-4403-9ef1-1909afea1f02-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5be6ca4e-319d-4403-9ef1-1909afea1f02" (UID: "5be6ca4e-319d-4403-9ef1-1909afea1f02"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:58:29.117139 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:29.117117    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1baf059e-af53-43ac-bffe-fdbfecd58cd3-kube-api-access-m7ljm" (OuterVolumeSpecName: "kube-api-access-m7ljm") pod "1baf059e-af53-43ac-bffe-fdbfecd58cd3" (UID: "1baf059e-af53-43ac-bffe-fdbfecd58cd3"). InnerVolumeSpecName "kube-api-access-m7ljm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:58:29.117289 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:29.117149    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5be6ca4e-319d-4403-9ef1-1909afea1f02-kube-api-access-6hwgq" (OuterVolumeSpecName: "kube-api-access-6hwgq") pod "5be6ca4e-319d-4403-9ef1-1909afea1f02" (UID: "5be6ca4e-319d-4403-9ef1-1909afea1f02"). InnerVolumeSpecName "kube-api-access-6hwgq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:58:29.216091 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:29.216054    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7ljm\" (UniqueName: \"kubernetes.io/projected/1baf059e-af53-43ac-bffe-fdbfecd58cd3-kube-api-access-m7ljm\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:58:29.216091 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:29.216084    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1baf059e-af53-43ac-bffe-fdbfecd58cd3-plugins-config-volume\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:58:29.216091 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:29.216094    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6hwgq\" (UniqueName: \"kubernetes.io/projected/5be6ca4e-319d-4403-9ef1-1909afea1f02-kube-api-access-6hwgq\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:58:29.216091 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:29.216103    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5be6ca4e-319d-4403-9ef1-1909afea1f02-plugins-config-volume\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:58:29.704577 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:29.704537    2560 generic.go:356] "Generic (PLEG): container finished" podID="5be6ca4e-319d-4403-9ef1-1909afea1f02" containerID="f54d98ae6ee55a1e96b0b230d0d1704421f3c568e31b211fc4c4466dbfdf29cf" exitCode=0
Sep 17 01:58:29.704784 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:29.704585    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-56574e4f-75f847557-7b8jx"
Sep 17 01:58:29.704784 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:29.704628    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-56574e4f-75f847557-7b8jx" event={"ID":"5be6ca4e-319d-4403-9ef1-1909afea1f02","Type":"ContainerDied","Data":"f54d98ae6ee55a1e96b0b230d0d1704421f3c568e31b211fc4c4466dbfdf29cf"}
Sep 17 01:58:29.704784 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:29.704700    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-56574e4f-75f847557-7b8jx" event={"ID":"5be6ca4e-319d-4403-9ef1-1909afea1f02","Type":"ContainerDied","Data":"b3bca0a9d6bd5fad81514c2c2ba2ebdf36f0153a6ed7f8b94a4a204edbf80e1d"}
Sep 17 01:58:29.704784 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:29.704738    2560 scope.go:117] "RemoveContainer" containerID="f54d98ae6ee55a1e96b0b230d0d1704421f3c568e31b211fc4c4466dbfdf29cf"
Sep 17 01:58:29.706047 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:29.706021    2560 generic.go:356] "Generic (PLEG): container finished" podID="1baf059e-af53-43ac-bffe-fdbfecd58cd3" containerID="b2c895e28d51446102735ad5af99372bd9bb4db65b21a9888866084baf11b833" exitCode=0
Sep 17 01:58:29.706162 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:29.706067    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-56574e4f-dcc6d94fd-gndmt"
Sep 17 01:58:29.706227 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:29.706169    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-56574e4f-dcc6d94fd-gndmt" event={"ID":"1baf059e-af53-43ac-bffe-fdbfecd58cd3","Type":"ContainerDied","Data":"b2c895e28d51446102735ad5af99372bd9bb4db65b21a9888866084baf11b833"}
Sep 17 01:58:29.706227 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:29.706212    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-56574e4f-dcc6d94fd-gndmt" event={"ID":"1baf059e-af53-43ac-bffe-fdbfecd58cd3","Type":"ContainerDied","Data":"4ad58b1cd0f08fe3a4e15b9bf351f3f8f894cfac7d138998a36340f91d9db75c"}
Sep 17 01:58:29.714797 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:29.714772    2560 scope.go:117] "RemoveContainer" containerID="f54d98ae6ee55a1e96b0b230d0d1704421f3c568e31b211fc4c4466dbfdf29cf"
Sep 17 01:58:29.715321 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:58:29.715188    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f54d98ae6ee55a1e96b0b230d0d1704421f3c568e31b211fc4c4466dbfdf29cf\": container with ID starting with f54d98ae6ee55a1e96b0b230d0d1704421f3c568e31b211fc4c4466dbfdf29cf not found: ID does not exist" containerID="f54d98ae6ee55a1e96b0b230d0d1704421f3c568e31b211fc4c4466dbfdf29cf"
Sep 17 01:58:29.715321 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:29.715229    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f54d98ae6ee55a1e96b0b230d0d1704421f3c568e31b211fc4c4466dbfdf29cf"} err="failed to get container status \"f54d98ae6ee55a1e96b0b230d0d1704421f3c568e31b211fc4c4466dbfdf29cf\": rpc error: code = NotFound desc = could not find container \"f54d98ae6ee55a1e96b0b230d0d1704421f3c568e31b211fc4c4466dbfdf29cf\": container with ID starting with f54d98ae6ee55a1e96b0b230d0d1704421f3c568e31b211fc4c4466dbfdf29cf not found: ID does not exist"
Sep 17 01:58:29.715321 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:29.715283    2560 scope.go:117] "RemoveContainer" containerID="b2c895e28d51446102735ad5af99372bd9bb4db65b21a9888866084baf11b833"
Sep 17 01:58:29.723926 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:29.723904    2560 scope.go:117] "RemoveContainer" containerID="b2c895e28d51446102735ad5af99372bd9bb4db65b21a9888866084baf11b833"
Sep 17 01:58:29.724196 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:58:29.724177    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2c895e28d51446102735ad5af99372bd9bb4db65b21a9888866084baf11b833\": container with ID starting with b2c895e28d51446102735ad5af99372bd9bb4db65b21a9888866084baf11b833 not found: ID does not exist" containerID="b2c895e28d51446102735ad5af99372bd9bb4db65b21a9888866084baf11b833"
Sep 17 01:58:29.724278 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:29.724206    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2c895e28d51446102735ad5af99372bd9bb4db65b21a9888866084baf11b833"} err="failed to get container status \"b2c895e28d51446102735ad5af99372bd9bb4db65b21a9888866084baf11b833\": rpc error: code = NotFound desc = could not find container \"b2c895e28d51446102735ad5af99372bd9bb4db65b21a9888866084baf11b833\": container with ID starting with b2c895e28d51446102735ad5af99372bd9bb4db65b21a9888866084baf11b833 not found: ID does not exist"
Sep 17 01:58:29.729688 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:29.729665    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-56574e4f-dcc6d94fd-gndmt"]
Sep 17 01:58:29.740144 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:29.736646    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-56574e4f-dcc6d94fd-gndmt"]
Sep 17 01:58:29.748551 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:29.748524    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-56574e4f-75f847557-7b8jx"]
Sep 17 01:58:29.752807 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:29.752787    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-56574e4f-75f847557-7b8jx"]
Sep 17 01:58:30.357692 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:30.357656    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1baf059e-af53-43ac-bffe-fdbfecd58cd3" path="/var/lib/kubelet/pods/1baf059e-af53-43ac-bffe-fdbfecd58cd3/volumes"
Sep 17 01:58:30.358021 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:30.358006    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5be6ca4e-319d-4403-9ef1-1909afea1f02" path="/var/lib/kubelet/pods/5be6ca4e-319d-4403-9ef1-1909afea1f02/volumes"
Sep 17 01:58:32.478124 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:32.478080    2560 patch_prober.go:28] interesting pod/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 17 01:58:32.478522 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:32.478149    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn" podUID="9074146c-7a41-487f-8c42-c483dc233734" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 01:58:34.314186 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:34.314161    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn"
Sep 17 01:58:34.468431 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:34.468349    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9074146c-7a41-487f-8c42-c483dc233734-istio-envoy\") pod \"9074146c-7a41-487f-8c42-c483dc233734\" (UID: \"9074146c-7a41-487f-8c42-c483dc233734\") "
Sep 17 01:58:34.468431 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:34.468388    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9074146c-7a41-487f-8c42-c483dc233734-workload-socket\") pod \"9074146c-7a41-487f-8c42-c483dc233734\" (UID: \"9074146c-7a41-487f-8c42-c483dc233734\") "
Sep 17 01:58:34.468431 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:34.468413    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2wr27\" (UniqueName: \"kubernetes.io/projected/9074146c-7a41-487f-8c42-c483dc233734-kube-api-access-2wr27\") pod \"9074146c-7a41-487f-8c42-c483dc233734\" (UID: \"9074146c-7a41-487f-8c42-c483dc233734\") "
Sep 17 01:58:34.468701 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:34.468441    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9074146c-7a41-487f-8c42-c483dc233734-istiod-ca-cert\") pod \"9074146c-7a41-487f-8c42-c483dc233734\" (UID: \"9074146c-7a41-487f-8c42-c483dc233734\") "
Sep 17 01:58:34.468701 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:34.468508    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9074146c-7a41-487f-8c42-c483dc233734-istio-data\") pod \"9074146c-7a41-487f-8c42-c483dc233734\" (UID: \"9074146c-7a41-487f-8c42-c483dc233734\") "
Sep 17 01:58:34.468701 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:34.468530    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9074146c-7a41-487f-8c42-c483dc233734-workload-certs\") pod \"9074146c-7a41-487f-8c42-c483dc233734\" (UID: \"9074146c-7a41-487f-8c42-c483dc233734\") "
Sep 17 01:58:34.468701 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:34.468554    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9074146c-7a41-487f-8c42-c483dc233734-istio-podinfo\") pod \"9074146c-7a41-487f-8c42-c483dc233734\" (UID: \"9074146c-7a41-487f-8c42-c483dc233734\") "
Sep 17 01:58:34.468701 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:34.468626    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9074146c-7a41-487f-8c42-c483dc233734-credential-socket\") pod \"9074146c-7a41-487f-8c42-c483dc233734\" (UID: \"9074146c-7a41-487f-8c42-c483dc233734\") "
Sep 17 01:58:34.468701 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:34.468669    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9074146c-7a41-487f-8c42-c483dc233734-istio-token\") pod \"9074146c-7a41-487f-8c42-c483dc233734\" (UID: \"9074146c-7a41-487f-8c42-c483dc233734\") "
Sep 17 01:58:34.468701 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:34.468681    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9074146c-7a41-487f-8c42-c483dc233734-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9074146c-7a41-487f-8c42-c483dc233734" (UID: "9074146c-7a41-487f-8c42-c483dc233734"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:58:34.469076 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:34.468794    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9074146c-7a41-487f-8c42-c483dc233734-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9074146c-7a41-487f-8c42-c483dc233734" (UID: "9074146c-7a41-487f-8c42-c483dc233734"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:58:34.469076 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:34.468807    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9074146c-7a41-487f-8c42-c483dc233734-istio-data" (OuterVolumeSpecName: "istio-data") pod "9074146c-7a41-487f-8c42-c483dc233734" (UID: "9074146c-7a41-487f-8c42-c483dc233734"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:58:34.469076 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:34.468896    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9074146c-7a41-487f-8c42-c483dc233734-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9074146c-7a41-487f-8c42-c483dc233734" (UID: "9074146c-7a41-487f-8c42-c483dc233734"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 01:58:34.469076 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:34.468999    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9074146c-7a41-487f-8c42-c483dc233734-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9074146c-7a41-487f-8c42-c483dc233734" (UID: "9074146c-7a41-487f-8c42-c483dc233734"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:58:34.469281 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:34.469189    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9074146c-7a41-487f-8c42-c483dc233734-workload-socket\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:58:34.469281 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:34.469208    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9074146c-7a41-487f-8c42-c483dc233734-istiod-ca-cert\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:58:34.469281 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:34.469222    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9074146c-7a41-487f-8c42-c483dc233734-istio-data\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:58:34.469281 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:34.469236    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9074146c-7a41-487f-8c42-c483dc233734-workload-certs\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:58:34.469281 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:34.469272    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9074146c-7a41-487f-8c42-c483dc233734-credential-socket\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:58:34.470666 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:34.470644    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9074146c-7a41-487f-8c42-c483dc233734-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9074146c-7a41-487f-8c42-c483dc233734" (UID: "9074146c-7a41-487f-8c42-c483dc233734"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 01:58:34.470856 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:34.470837    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9074146c-7a41-487f-8c42-c483dc233734-istio-token" (OuterVolumeSpecName: "istio-token") pod "9074146c-7a41-487f-8c42-c483dc233734" (UID: "9074146c-7a41-487f-8c42-c483dc233734"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:58:34.471039 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:34.471024    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9074146c-7a41-487f-8c42-c483dc233734-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9074146c-7a41-487f-8c42-c483dc233734" (UID: "9074146c-7a41-487f-8c42-c483dc233734"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 01:58:34.471101 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:34.471060    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9074146c-7a41-487f-8c42-c483dc233734-kube-api-access-2wr27" (OuterVolumeSpecName: "kube-api-access-2wr27") pod "9074146c-7a41-487f-8c42-c483dc233734" (UID: "9074146c-7a41-487f-8c42-c483dc233734"). InnerVolumeSpecName "kube-api-access-2wr27". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 01:58:34.570484 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:34.570452    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9074146c-7a41-487f-8c42-c483dc233734-istio-token\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:58:34.570484 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:34.570478    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9074146c-7a41-487f-8c42-c483dc233734-istio-envoy\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:58:34.570484 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:34.570487    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2wr27\" (UniqueName: \"kubernetes.io/projected/9074146c-7a41-487f-8c42-c483dc233734-kube-api-access-2wr27\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:58:34.570713 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:34.570497    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9074146c-7a41-487f-8c42-c483dc233734-istio-podinfo\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 01:58:34.733957 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:34.733872    2560 generic.go:356] "Generic (PLEG): container finished" podID="9074146c-7a41-487f-8c42-c483dc233734" containerID="862cab05df59ce52fdd4a2d7654fba3e1b12c490159658ac5f862f475756264a" exitCode=0
Sep 17 01:58:34.733957 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:34.733924    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn"
Sep 17 01:58:34.734134 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:34.733964    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn" event={"ID":"9074146c-7a41-487f-8c42-c483dc233734","Type":"ContainerDied","Data":"862cab05df59ce52fdd4a2d7654fba3e1b12c490159658ac5f862f475756264a"}
Sep 17 01:58:34.734134 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:34.734026    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn" event={"ID":"9074146c-7a41-487f-8c42-c483dc233734","Type":"ContainerDied","Data":"7224c0bf11857de51441c42a5ee68be3dd00eda34829349bd8df68fb8bbb0b1e"}
Sep 17 01:58:34.734134 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:34.734056    2560 scope.go:117] "RemoveContainer" containerID="862cab05df59ce52fdd4a2d7654fba3e1b12c490159658ac5f862f475756264a"
Sep 17 01:58:34.743345 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:34.743325    2560 scope.go:117] "RemoveContainer" containerID="64725c0450a14a0db3feb034059bda81ce2f476dacd4c65d6321eca7dca1a501"
Sep 17 01:58:34.751749 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:34.751694    2560 scope.go:117] "RemoveContainer" containerID="862cab05df59ce52fdd4a2d7654fba3e1b12c490159658ac5f862f475756264a"
Sep 17 01:58:34.752159 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:58:34.752125    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"862cab05df59ce52fdd4a2d7654fba3e1b12c490159658ac5f862f475756264a\": container with ID starting with 862cab05df59ce52fdd4a2d7654fba3e1b12c490159658ac5f862f475756264a not found: ID does not exist" containerID="862cab05df59ce52fdd4a2d7654fba3e1b12c490159658ac5f862f475756264a"
Sep 17 01:58:34.752299 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:34.752170    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"862cab05df59ce52fdd4a2d7654fba3e1b12c490159658ac5f862f475756264a"} err="failed to get container status \"862cab05df59ce52fdd4a2d7654fba3e1b12c490159658ac5f862f475756264a\": rpc error: code = NotFound desc = could not find container \"862cab05df59ce52fdd4a2d7654fba3e1b12c490159658ac5f862f475756264a\": container with ID starting with 862cab05df59ce52fdd4a2d7654fba3e1b12c490159658ac5f862f475756264a not found: ID does not exist"
Sep 17 01:58:34.752299 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:34.752194    2560 scope.go:117] "RemoveContainer" containerID="64725c0450a14a0db3feb034059bda81ce2f476dacd4c65d6321eca7dca1a501"
Sep 17 01:58:34.752533 ip-10-0-143-95 kubenswrapper[2560]: E0917 01:58:34.752514    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64725c0450a14a0db3feb034059bda81ce2f476dacd4c65d6321eca7dca1a501\": container with ID starting with 64725c0450a14a0db3feb034059bda81ce2f476dacd4c65d6321eca7dca1a501 not found: ID does not exist" containerID="64725c0450a14a0db3feb034059bda81ce2f476dacd4c65d6321eca7dca1a501"
Sep 17 01:58:34.752586 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:34.752539    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64725c0450a14a0db3feb034059bda81ce2f476dacd4c65d6321eca7dca1a501"} err="failed to get container status \"64725c0450a14a0db3feb034059bda81ce2f476dacd4c65d6321eca7dca1a501\": rpc error: code = NotFound desc = could not find container \"64725c0450a14a0db3feb034059bda81ce2f476dacd4c65d6321eca7dca1a501\": container with ID starting with 64725c0450a14a0db3feb034059bda81ce2f476dacd4c65d6321eca7dca1a501 not found: ID does not exist"
Sep 17 01:58:34.754148 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:34.754127    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn"]
Sep 17 01:58:34.757730 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:34.757707    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-56574e4f-openshift-default-58b95bb4fb-gmbrn"]
Sep 17 01:58:36.357346 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:58:36.357315    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9074146c-7a41-487f-8c42-c483dc233734" path="/var/lib/kubelet/pods/9074146c-7a41-487f-8c42-c483dc233734/volumes"
Sep 17 01:59:03.064211 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:03.064179    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-3f027f/distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw"]
Sep 17 01:59:03.064716 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:03.064594    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9074146c-7a41-487f-8c42-c483dc233734" containerName="istio-proxy"
Sep 17 01:59:03.064716 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:03.064607    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9074146c-7a41-487f-8c42-c483dc233734" containerName="istio-proxy"
Sep 17 01:59:03.064716 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:03.064616    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1baf059e-af53-43ac-bffe-fdbfecd58cd3" containerName="payload-pre-processing"
Sep 17 01:59:03.064716 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:03.064621    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1baf059e-af53-43ac-bffe-fdbfecd58cd3" containerName="payload-pre-processing"
Sep 17 01:59:03.064716 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:03.064630    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5be6ca4e-319d-4403-9ef1-1909afea1f02" containerName="payload-processing"
Sep 17 01:59:03.064716 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:03.064636    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5be6ca4e-319d-4403-9ef1-1909afea1f02" containerName="payload-processing"
Sep 17 01:59:03.064716 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:03.064704    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9074146c-7a41-487f-8c42-c483dc233734" containerName="istio-proxy"
Sep 17 01:59:03.064716 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:03.064712    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1baf059e-af53-43ac-bffe-fdbfecd58cd3" containerName="payload-pre-processing"
Sep 17 01:59:03.064716 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:03.064721    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="5be6ca4e-319d-4403-9ef1-1909afea1f02" containerName="payload-processing"
Sep 17 01:59:03.067867 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:03.067842    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-3f027f/distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw"
Sep 17 01:59:03.070556 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:03.070526    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-3f027f\"/\"default-dockercfg-ztf9z\""
Sep 17 01:59:03.070556 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:03.070526    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-3f027f\"/\"distinct-w3-3f027f-kserve-self-signed-certs\""
Sep 17 01:59:03.070768 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:03.070620    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-3f027f\"/\"kube-root-ca.crt\""
Sep 17 01:59:03.070768 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:03.070526    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-3f027f\"/\"openshift-service-ca.crt\""
Sep 17 01:59:03.078632 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:03.078604    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-3f027f/distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw"]
Sep 17 01:59:03.132420 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:03.132383    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f46ba291-6d51-48b8-94b7-0f3613171893-dshm\") pod \"distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw\" (UID: \"f46ba291-6d51-48b8-94b7-0f3613171893\") " pod="e2e-models-e2e-worker-w3-3f027f/distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw"
Sep 17 01:59:03.132420 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:03.132429    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwztb\" (UniqueName: \"kubernetes.io/projected/f46ba291-6d51-48b8-94b7-0f3613171893-kube-api-access-wwztb\") pod \"distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw\" (UID: \"f46ba291-6d51-48b8-94b7-0f3613171893\") " pod="e2e-models-e2e-worker-w3-3f027f/distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw"
Sep 17 01:59:03.132690 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:03.132462    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f46ba291-6d51-48b8-94b7-0f3613171893-tmp-dir\") pod \"distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw\" (UID: \"f46ba291-6d51-48b8-94b7-0f3613171893\") " pod="e2e-models-e2e-worker-w3-3f027f/distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw"
Sep 17 01:59:03.132690 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:03.132520    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f46ba291-6d51-48b8-94b7-0f3613171893-tls-certs\") pod \"distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw\" (UID: \"f46ba291-6d51-48b8-94b7-0f3613171893\") " pod="e2e-models-e2e-worker-w3-3f027f/distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw"
Sep 17 01:59:03.132690 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:03.132583    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f46ba291-6d51-48b8-94b7-0f3613171893-model-cache\") pod \"distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw\" (UID: \"f46ba291-6d51-48b8-94b7-0f3613171893\") " pod="e2e-models-e2e-worker-w3-3f027f/distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw"
Sep 17 01:59:03.132690 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:03.132613    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f46ba291-6d51-48b8-94b7-0f3613171893-home\") pod \"distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw\" (UID: \"f46ba291-6d51-48b8-94b7-0f3613171893\") " pod="e2e-models-e2e-worker-w3-3f027f/distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw"
Sep 17 01:59:03.233345 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:03.233309    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f46ba291-6d51-48b8-94b7-0f3613171893-dshm\") pod \"distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw\" (UID: \"f46ba291-6d51-48b8-94b7-0f3613171893\") " pod="e2e-models-e2e-worker-w3-3f027f/distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw"
Sep 17 01:59:03.233345 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:03.233350    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwztb\" (UniqueName: \"kubernetes.io/projected/f46ba291-6d51-48b8-94b7-0f3613171893-kube-api-access-wwztb\") pod \"distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw\" (UID: \"f46ba291-6d51-48b8-94b7-0f3613171893\") " pod="e2e-models-e2e-worker-w3-3f027f/distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw"
Sep 17 01:59:03.233603 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:03.233371    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f46ba291-6d51-48b8-94b7-0f3613171893-tmp-dir\") pod \"distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw\" (UID: \"f46ba291-6d51-48b8-94b7-0f3613171893\") " pod="e2e-models-e2e-worker-w3-3f027f/distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw"
Sep 17 01:59:03.233603 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:03.233384    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f46ba291-6d51-48b8-94b7-0f3613171893-tls-certs\") pod \"distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw\" (UID: \"f46ba291-6d51-48b8-94b7-0f3613171893\") " pod="e2e-models-e2e-worker-w3-3f027f/distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw"
Sep 17 01:59:03.233603 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:03.233496    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f46ba291-6d51-48b8-94b7-0f3613171893-model-cache\") pod \"distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw\" (UID: \"f46ba291-6d51-48b8-94b7-0f3613171893\") " pod="e2e-models-e2e-worker-w3-3f027f/distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw"
Sep 17 01:59:03.233603 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:03.233551    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f46ba291-6d51-48b8-94b7-0f3613171893-home\") pod \"distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw\" (UID: \"f46ba291-6d51-48b8-94b7-0f3613171893\") " pod="e2e-models-e2e-worker-w3-3f027f/distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw"
Sep 17 01:59:03.233822 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:03.233755    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f46ba291-6d51-48b8-94b7-0f3613171893-tmp-dir\") pod \"distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw\" (UID: \"f46ba291-6d51-48b8-94b7-0f3613171893\") " pod="e2e-models-e2e-worker-w3-3f027f/distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw"
Sep 17 01:59:03.233869 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:03.233850    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f46ba291-6d51-48b8-94b7-0f3613171893-model-cache\") pod \"distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw\" (UID: \"f46ba291-6d51-48b8-94b7-0f3613171893\") " pod="e2e-models-e2e-worker-w3-3f027f/distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw"
Sep 17 01:59:03.233928 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:03.233906    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f46ba291-6d51-48b8-94b7-0f3613171893-home\") pod \"distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw\" (UID: \"f46ba291-6d51-48b8-94b7-0f3613171893\") " pod="e2e-models-e2e-worker-w3-3f027f/distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw"
Sep 17 01:59:03.235692 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:03.235669    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f46ba291-6d51-48b8-94b7-0f3613171893-dshm\") pod \"distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw\" (UID: \"f46ba291-6d51-48b8-94b7-0f3613171893\") " pod="e2e-models-e2e-worker-w3-3f027f/distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw"
Sep 17 01:59:03.235851 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:03.235833    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f46ba291-6d51-48b8-94b7-0f3613171893-tls-certs\") pod \"distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw\" (UID: \"f46ba291-6d51-48b8-94b7-0f3613171893\") " pod="e2e-models-e2e-worker-w3-3f027f/distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw"
Sep 17 01:59:03.240463 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:03.240445    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwztb\" (UniqueName: \"kubernetes.io/projected/f46ba291-6d51-48b8-94b7-0f3613171893-kube-api-access-wwztb\") pod \"distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw\" (UID: \"f46ba291-6d51-48b8-94b7-0f3613171893\") " pod="e2e-models-e2e-worker-w3-3f027f/distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw"
Sep 17 01:59:03.380523 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:03.380425    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-3f027f/distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw"
Sep 17 01:59:03.649930 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:03.649902    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-3f027f/distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw"]
Sep 17 01:59:03.651731 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:59:03.651705    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf46ba291_6d51_48b8_94b7_0f3613171893.slice/crio-b661a7d94b2b15f93d696a83e375cf61a647344de98904a25b7294e9edbf3331 WatchSource:0}: Error finding container b661a7d94b2b15f93d696a83e375cf61a647344de98904a25b7294e9edbf3331: Status 404 returned error can't find the container with id b661a7d94b2b15f93d696a83e375cf61a647344de98904a25b7294e9edbf3331
Sep 17 01:59:03.885380 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:03.885341    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-3f027f/distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw" event={"ID":"f46ba291-6d51-48b8-94b7-0f3613171893","Type":"ContainerStarted","Data":"baa59a92fe362c8abfb8e002311aca1497f324df4c623ee5e04eceae65a6375c"}
Sep 17 01:59:03.885586 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:03.885397    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-3f027f/distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw" event={"ID":"f46ba291-6d51-48b8-94b7-0f3613171893","Type":"ContainerStarted","Data":"b661a7d94b2b15f93d696a83e375cf61a647344de98904a25b7294e9edbf3331"}
Sep 17 01:59:03.899813 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:03.899710    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-3f027f/distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw" podStartSLOduration=0.89969468 podStartE2EDuration="899.69468ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:59:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:59:03.89912811 +0000 UTC m=+1302.149105422" watchObservedRunningTime="2026-09-17 01:59:03.89969468 +0000 UTC m=+1302.149671993"
Sep 17 01:59:13.381038 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:13.381003    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-3f027f/distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw"
Sep 17 01:59:13.381485 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:13.381059    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-3f027f/distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw"
Sep 17 01:59:13.393310 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:13.393285    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-3f027f/distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw"
Sep 17 01:59:13.949031 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:13.948999    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-3f027f/distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw"
Sep 17 01:59:30.575713 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:30.575679    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-e564e1/distinct-w0-e564e1-kserve-6597f876cc-pxj9j"]
Sep 17 01:59:30.576320 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:30.576293    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9074146c-7a41-487f-8c42-c483dc233734" containerName="istio-proxy"
Sep 17 01:59:30.576320 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:30.576318    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9074146c-7a41-487f-8c42-c483dc233734" containerName="istio-proxy"
Sep 17 01:59:30.576552 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:30.576419    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9074146c-7a41-487f-8c42-c483dc233734" containerName="istio-proxy"
Sep 17 01:59:30.580701 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:30.580676    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e564e1/distinct-w0-e564e1-kserve-6597f876cc-pxj9j"
Sep 17 01:59:30.582466 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:30.582441    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-e564e1\"/\"openshift-service-ca.crt\""
Sep 17 01:59:30.582943 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:30.582921    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-e564e1\"/\"distinct-w0-e564e1-kserve-self-signed-certs\""
Sep 17 01:59:30.583041 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:30.582958    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-e564e1\"/\"kube-root-ca.crt\""
Sep 17 01:59:30.583099 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:30.583059    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-e564e1\"/\"default-dockercfg-2ftzh\""
Sep 17 01:59:30.592910 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:30.592878    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-e564e1/distinct-w0-e564e1-kserve-6597f876cc-pxj9j"]
Sep 17 01:59:30.697709 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:30.697665    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6r69m\" (UniqueName: \"kubernetes.io/projected/3a191213-21ad-4a45-9ad6-35107bd52a88-kube-api-access-6r69m\") pod \"distinct-w0-e564e1-kserve-6597f876cc-pxj9j\" (UID: \"3a191213-21ad-4a45-9ad6-35107bd52a88\") " pod="e2e-models-e2e-worker-w0-e564e1/distinct-w0-e564e1-kserve-6597f876cc-pxj9j"
Sep 17 01:59:30.698023 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:30.698004    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a191213-21ad-4a45-9ad6-35107bd52a88-tls-certs\") pod \"distinct-w0-e564e1-kserve-6597f876cc-pxj9j\" (UID: \"3a191213-21ad-4a45-9ad6-35107bd52a88\") " pod="e2e-models-e2e-worker-w0-e564e1/distinct-w0-e564e1-kserve-6597f876cc-pxj9j"
Sep 17 01:59:30.698369 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:30.698334    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a191213-21ad-4a45-9ad6-35107bd52a88-home\") pod \"distinct-w0-e564e1-kserve-6597f876cc-pxj9j\" (UID: \"3a191213-21ad-4a45-9ad6-35107bd52a88\") " pod="e2e-models-e2e-worker-w0-e564e1/distinct-w0-e564e1-kserve-6597f876cc-pxj9j"
Sep 17 01:59:30.698490 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:30.698435    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a191213-21ad-4a45-9ad6-35107bd52a88-dshm\") pod \"distinct-w0-e564e1-kserve-6597f876cc-pxj9j\" (UID: \"3a191213-21ad-4a45-9ad6-35107bd52a88\") " pod="e2e-models-e2e-worker-w0-e564e1/distinct-w0-e564e1-kserve-6597f876cc-pxj9j"
Sep 17 01:59:30.698552 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:30.698488    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a191213-21ad-4a45-9ad6-35107bd52a88-tmp-dir\") pod \"distinct-w0-e564e1-kserve-6597f876cc-pxj9j\" (UID: \"3a191213-21ad-4a45-9ad6-35107bd52a88\") " pod="e2e-models-e2e-worker-w0-e564e1/distinct-w0-e564e1-kserve-6597f876cc-pxj9j"
Sep 17 01:59:30.698614 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:30.698524    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a191213-21ad-4a45-9ad6-35107bd52a88-model-cache\") pod \"distinct-w0-e564e1-kserve-6597f876cc-pxj9j\" (UID: \"3a191213-21ad-4a45-9ad6-35107bd52a88\") " pod="e2e-models-e2e-worker-w0-e564e1/distinct-w0-e564e1-kserve-6597f876cc-pxj9j"
Sep 17 01:59:30.799106 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:30.799072    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r69m\" (UniqueName: \"kubernetes.io/projected/3a191213-21ad-4a45-9ad6-35107bd52a88-kube-api-access-6r69m\") pod \"distinct-w0-e564e1-kserve-6597f876cc-pxj9j\" (UID: \"3a191213-21ad-4a45-9ad6-35107bd52a88\") " pod="e2e-models-e2e-worker-w0-e564e1/distinct-w0-e564e1-kserve-6597f876cc-pxj9j"
Sep 17 01:59:30.799106 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:30.799112    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a191213-21ad-4a45-9ad6-35107bd52a88-tls-certs\") pod \"distinct-w0-e564e1-kserve-6597f876cc-pxj9j\" (UID: \"3a191213-21ad-4a45-9ad6-35107bd52a88\") " pod="e2e-models-e2e-worker-w0-e564e1/distinct-w0-e564e1-kserve-6597f876cc-pxj9j"
Sep 17 01:59:30.799370 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:30.799136    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a191213-21ad-4a45-9ad6-35107bd52a88-home\") pod \"distinct-w0-e564e1-kserve-6597f876cc-pxj9j\" (UID: \"3a191213-21ad-4a45-9ad6-35107bd52a88\") " pod="e2e-models-e2e-worker-w0-e564e1/distinct-w0-e564e1-kserve-6597f876cc-pxj9j"
Sep 17 01:59:30.799370 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:30.799185    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a191213-21ad-4a45-9ad6-35107bd52a88-dshm\") pod \"distinct-w0-e564e1-kserve-6597f876cc-pxj9j\" (UID: \"3a191213-21ad-4a45-9ad6-35107bd52a88\") " pod="e2e-models-e2e-worker-w0-e564e1/distinct-w0-e564e1-kserve-6597f876cc-pxj9j"
Sep 17 01:59:30.799370 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:30.799216    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a191213-21ad-4a45-9ad6-35107bd52a88-tmp-dir\") pod \"distinct-w0-e564e1-kserve-6597f876cc-pxj9j\" (UID: \"3a191213-21ad-4a45-9ad6-35107bd52a88\") " pod="e2e-models-e2e-worker-w0-e564e1/distinct-w0-e564e1-kserve-6597f876cc-pxj9j"
Sep 17 01:59:30.799370 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:30.799268    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a191213-21ad-4a45-9ad6-35107bd52a88-model-cache\") pod \"distinct-w0-e564e1-kserve-6597f876cc-pxj9j\" (UID: \"3a191213-21ad-4a45-9ad6-35107bd52a88\") " pod="e2e-models-e2e-worker-w0-e564e1/distinct-w0-e564e1-kserve-6597f876cc-pxj9j"
Sep 17 01:59:30.799698 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:30.799665    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a191213-21ad-4a45-9ad6-35107bd52a88-model-cache\") pod \"distinct-w0-e564e1-kserve-6597f876cc-pxj9j\" (UID: \"3a191213-21ad-4a45-9ad6-35107bd52a88\") " pod="e2e-models-e2e-worker-w0-e564e1/distinct-w0-e564e1-kserve-6597f876cc-pxj9j"
Sep 17 01:59:30.799698 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:30.799686    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a191213-21ad-4a45-9ad6-35107bd52a88-tmp-dir\") pod \"distinct-w0-e564e1-kserve-6597f876cc-pxj9j\" (UID: \"3a191213-21ad-4a45-9ad6-35107bd52a88\") " pod="e2e-models-e2e-worker-w0-e564e1/distinct-w0-e564e1-kserve-6597f876cc-pxj9j"
Sep 17 01:59:30.799862 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:30.799725    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a191213-21ad-4a45-9ad6-35107bd52a88-home\") pod \"distinct-w0-e564e1-kserve-6597f876cc-pxj9j\" (UID: \"3a191213-21ad-4a45-9ad6-35107bd52a88\") " pod="e2e-models-e2e-worker-w0-e564e1/distinct-w0-e564e1-kserve-6597f876cc-pxj9j"
Sep 17 01:59:30.801456 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:30.801436    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a191213-21ad-4a45-9ad6-35107bd52a88-dshm\") pod \"distinct-w0-e564e1-kserve-6597f876cc-pxj9j\" (UID: \"3a191213-21ad-4a45-9ad6-35107bd52a88\") " pod="e2e-models-e2e-worker-w0-e564e1/distinct-w0-e564e1-kserve-6597f876cc-pxj9j"
Sep 17 01:59:30.801779 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:30.801760    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a191213-21ad-4a45-9ad6-35107bd52a88-tls-certs\") pod \"distinct-w0-e564e1-kserve-6597f876cc-pxj9j\" (UID: \"3a191213-21ad-4a45-9ad6-35107bd52a88\") " pod="e2e-models-e2e-worker-w0-e564e1/distinct-w0-e564e1-kserve-6597f876cc-pxj9j"
Sep 17 01:59:30.805723 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:30.805697    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6r69m\" (UniqueName: \"kubernetes.io/projected/3a191213-21ad-4a45-9ad6-35107bd52a88-kube-api-access-6r69m\") pod \"distinct-w0-e564e1-kserve-6597f876cc-pxj9j\" (UID: \"3a191213-21ad-4a45-9ad6-35107bd52a88\") " pod="e2e-models-e2e-worker-w0-e564e1/distinct-w0-e564e1-kserve-6597f876cc-pxj9j"
Sep 17 01:59:30.890711 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:30.890623    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e564e1/distinct-w0-e564e1-kserve-6597f876cc-pxj9j"
Sep 17 01:59:31.159748 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:31.159713    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-e564e1/distinct-w0-e564e1-kserve-6597f876cc-pxj9j"]
Sep 17 01:59:31.161998 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:59:31.161970    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3a191213_21ad_4a45_9ad6_35107bd52a88.slice/crio-1c4da066b975df1753dfbdd2550b036b0ac70a506b8ecc51ba438ab86e279ebf WatchSource:0}: Error finding container 1c4da066b975df1753dfbdd2550b036b0ac70a506b8ecc51ba438ab86e279ebf: Status 404 returned error can't find the container with id 1c4da066b975df1753dfbdd2550b036b0ac70a506b8ecc51ba438ab86e279ebf
Sep 17 01:59:32.027017 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:32.026976    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e564e1/distinct-w0-e564e1-kserve-6597f876cc-pxj9j" event={"ID":"3a191213-21ad-4a45-9ad6-35107bd52a88","Type":"ContainerStarted","Data":"e1b7ef20837418ec83c2e8d2c4fde916ff0b0634fd03b32b38bcc7cc6bce79a0"}
Sep 17 01:59:32.027017 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:32.027023    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e564e1/distinct-w0-e564e1-kserve-6597f876cc-pxj9j" event={"ID":"3a191213-21ad-4a45-9ad6-35107bd52a88","Type":"ContainerStarted","Data":"1c4da066b975df1753dfbdd2550b036b0ac70a506b8ecc51ba438ab86e279ebf"}
Sep 17 01:59:32.045463 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:32.045400    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-e564e1/distinct-w0-e564e1-kserve-6597f876cc-pxj9j" podStartSLOduration=2.045382778 podStartE2EDuration="2.045382778s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:59:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 01:59:32.045309462 +0000 UTC m=+1330.295286776" watchObservedRunningTime="2026-09-17 01:59:32.045382778 +0000 UTC m=+1330.295360094"
Sep 17 01:59:40.891452 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:40.891395    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-e564e1/distinct-w0-e564e1-kserve-6597f876cc-pxj9j"
Sep 17 01:59:40.892024 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:40.891471    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-e564e1/distinct-w0-e564e1-kserve-6597f876cc-pxj9j"
Sep 17 01:59:40.904080 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:40.904051    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-e564e1/distinct-w0-e564e1-kserve-6597f876cc-pxj9j"
Sep 17 01:59:41.082079 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:41.082047    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-e564e1/distinct-w0-e564e1-kserve-6597f876cc-pxj9j"
Sep 17 01:59:59.258995 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:59.258911    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-3f027f/distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5"]
Sep 17 01:59:59.262543 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:59.262522    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-3f027f/distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5"
Sep 17 01:59:59.264257 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:59.264228    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-3f027f\"/\"distinct-2-w3-3f027f-kserve-self-signed-certs\""
Sep 17 01:59:59.270436 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:59.270209    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-3f027f/distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5"]
Sep 17 01:59:59.376757 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:59.376719    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec025b7e-5e6a-4aa7-a1f2-309dafacf267-home\") pod \"distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5\" (UID: \"ec025b7e-5e6a-4aa7-a1f2-309dafacf267\") " pod="e2e-models-e2e-worker-w3-3f027f/distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5"
Sep 17 01:59:59.376757 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:59.376761    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec025b7e-5e6a-4aa7-a1f2-309dafacf267-dshm\") pod \"distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5\" (UID: \"ec025b7e-5e6a-4aa7-a1f2-309dafacf267\") " pod="e2e-models-e2e-worker-w3-3f027f/distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5"
Sep 17 01:59:59.376976 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:59.376780    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmvpn\" (UniqueName: \"kubernetes.io/projected/ec025b7e-5e6a-4aa7-a1f2-309dafacf267-kube-api-access-xmvpn\") pod \"distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5\" (UID: \"ec025b7e-5e6a-4aa7-a1f2-309dafacf267\") " pod="e2e-models-e2e-worker-w3-3f027f/distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5"
Sep 17 01:59:59.376976 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:59.376881    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec025b7e-5e6a-4aa7-a1f2-309dafacf267-model-cache\") pod \"distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5\" (UID: \"ec025b7e-5e6a-4aa7-a1f2-309dafacf267\") " pod="e2e-models-e2e-worker-w3-3f027f/distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5"
Sep 17 01:59:59.376976 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:59.376909    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec025b7e-5e6a-4aa7-a1f2-309dafacf267-tls-certs\") pod \"distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5\" (UID: \"ec025b7e-5e6a-4aa7-a1f2-309dafacf267\") " pod="e2e-models-e2e-worker-w3-3f027f/distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5"
Sep 17 01:59:59.377096 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:59.376994    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec025b7e-5e6a-4aa7-a1f2-309dafacf267-tmp-dir\") pod \"distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5\" (UID: \"ec025b7e-5e6a-4aa7-a1f2-309dafacf267\") " pod="e2e-models-e2e-worker-w3-3f027f/distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5"
Sep 17 01:59:59.477919 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:59.477875    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec025b7e-5e6a-4aa7-a1f2-309dafacf267-home\") pod \"distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5\" (UID: \"ec025b7e-5e6a-4aa7-a1f2-309dafacf267\") " pod="e2e-models-e2e-worker-w3-3f027f/distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5"
Sep 17 01:59:59.477919 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:59.477921    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec025b7e-5e6a-4aa7-a1f2-309dafacf267-dshm\") pod \"distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5\" (UID: \"ec025b7e-5e6a-4aa7-a1f2-309dafacf267\") " pod="e2e-models-e2e-worker-w3-3f027f/distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5"
Sep 17 01:59:59.478191 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:59.477937    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmvpn\" (UniqueName: \"kubernetes.io/projected/ec025b7e-5e6a-4aa7-a1f2-309dafacf267-kube-api-access-xmvpn\") pod \"distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5\" (UID: \"ec025b7e-5e6a-4aa7-a1f2-309dafacf267\") " pod="e2e-models-e2e-worker-w3-3f027f/distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5"
Sep 17 01:59:59.478191 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:59.477970    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec025b7e-5e6a-4aa7-a1f2-309dafacf267-model-cache\") pod \"distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5\" (UID: \"ec025b7e-5e6a-4aa7-a1f2-309dafacf267\") " pod="e2e-models-e2e-worker-w3-3f027f/distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5"
Sep 17 01:59:59.478191 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:59.477988    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec025b7e-5e6a-4aa7-a1f2-309dafacf267-tls-certs\") pod \"distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5\" (UID: \"ec025b7e-5e6a-4aa7-a1f2-309dafacf267\") " pod="e2e-models-e2e-worker-w3-3f027f/distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5"
Sep 17 01:59:59.478191 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:59.478034    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec025b7e-5e6a-4aa7-a1f2-309dafacf267-tmp-dir\") pod \"distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5\" (UID: \"ec025b7e-5e6a-4aa7-a1f2-309dafacf267\") " pod="e2e-models-e2e-worker-w3-3f027f/distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5"
Sep 17 01:59:59.478449 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:59.478406    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec025b7e-5e6a-4aa7-a1f2-309dafacf267-home\") pod \"distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5\" (UID: \"ec025b7e-5e6a-4aa7-a1f2-309dafacf267\") " pod="e2e-models-e2e-worker-w3-3f027f/distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5"
Sep 17 01:59:59.478449 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:59.478430    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec025b7e-5e6a-4aa7-a1f2-309dafacf267-model-cache\") pod \"distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5\" (UID: \"ec025b7e-5e6a-4aa7-a1f2-309dafacf267\") " pod="e2e-models-e2e-worker-w3-3f027f/distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5"
Sep 17 01:59:59.478523 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:59.478465    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec025b7e-5e6a-4aa7-a1f2-309dafacf267-tmp-dir\") pod \"distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5\" (UID: \"ec025b7e-5e6a-4aa7-a1f2-309dafacf267\") " pod="e2e-models-e2e-worker-w3-3f027f/distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5"
Sep 17 01:59:59.480352 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:59.480327    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec025b7e-5e6a-4aa7-a1f2-309dafacf267-dshm\") pod \"distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5\" (UID: \"ec025b7e-5e6a-4aa7-a1f2-309dafacf267\") " pod="e2e-models-e2e-worker-w3-3f027f/distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5"
Sep 17 01:59:59.480574 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:59.480554    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec025b7e-5e6a-4aa7-a1f2-309dafacf267-tls-certs\") pod \"distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5\" (UID: \"ec025b7e-5e6a-4aa7-a1f2-309dafacf267\") " pod="e2e-models-e2e-worker-w3-3f027f/distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5"
Sep 17 01:59:59.484785 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:59.484763    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmvpn\" (UniqueName: \"kubernetes.io/projected/ec025b7e-5e6a-4aa7-a1f2-309dafacf267-kube-api-access-xmvpn\") pod \"distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5\" (UID: \"ec025b7e-5e6a-4aa7-a1f2-309dafacf267\") " pod="e2e-models-e2e-worker-w3-3f027f/distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5"
Sep 17 01:59:59.572844 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:59.572803    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-3f027f/distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5"
Sep 17 01:59:59.846757 ip-10-0-143-95 kubenswrapper[2560]: I0917 01:59:59.846727    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-3f027f/distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5"]
Sep 17 01:59:59.848440 ip-10-0-143-95 kubenswrapper[2560]: W0917 01:59:59.848409    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podec025b7e_5e6a_4aa7_a1f2_309dafacf267.slice/crio-dbc024df14e7bcc61e5263ca5f5009c3cfc9ab8ca3ceeb6e2e2dfc14b300103c WatchSource:0}: Error finding container dbc024df14e7bcc61e5263ca5f5009c3cfc9ab8ca3ceeb6e2e2dfc14b300103c: Status 404 returned error can't find the container with id dbc024df14e7bcc61e5263ca5f5009c3cfc9ab8ca3ceeb6e2e2dfc14b300103c
Sep 17 02:00:00.180306 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:00.180186    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-3f027f/distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5" event={"ID":"ec025b7e-5e6a-4aa7-a1f2-309dafacf267","Type":"ContainerStarted","Data":"9620c5f0ba6f8037a831a28e142c2843f584aab82f9f2c1293aee4eb36fc34ba"}
Sep 17 02:00:00.180306 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:00.180255    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-3f027f/distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5" event={"ID":"ec025b7e-5e6a-4aa7-a1f2-309dafacf267","Type":"ContainerStarted","Data":"dbc024df14e7bcc61e5263ca5f5009c3cfc9ab8ca3ceeb6e2e2dfc14b300103c"}
Sep 17 02:00:00.196476 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:00.196413    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-3f027f/distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5" podStartSLOduration=1.196390998 podStartE2EDuration="1.196390998s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 01:59:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:00:00.19579163 +0000 UTC m=+1358.445768955" watchObservedRunningTime="2026-09-17 02:00:00.196390998 +0000 UTC m=+1358.446368312"
Sep 17 02:00:09.573490 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:09.573447    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-3f027f/distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5"
Sep 17 02:00:09.574013 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:09.573514    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-3f027f/distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5"
Sep 17 02:00:09.586011 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:09.585987    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-3f027f/distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5"
Sep 17 02:00:10.245787 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:10.245759    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-3f027f/distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5"
Sep 17 02:00:12.649040 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:12.649005    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-4a1f5690-6cdd4768b-6prs7"]
Sep 17 02:00:12.653202 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:12.653178    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-4a1f5690-6cdd4768b-6prs7"
Sep 17 02:00:12.655822 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:12.655801    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-4a1f5690\""
Sep 17 02:00:12.655930 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:12.655896    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-4a1f5690-dockercfg-kcw9x\""
Sep 17 02:00:12.664923 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:12.664842    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-4a1f5690-6cdd4768b-6prs7"]
Sep 17 02:00:12.673846 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:12.673823    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-4a1f5690-6fc8b7f569-lrpdm"]
Sep 17 02:00:12.677337 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:12.677321    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-4a1f5690-6fc8b7f569-lrpdm"
Sep 17 02:00:12.692518 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:12.692488    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-4a1f5690-6fc8b7f569-lrpdm"]
Sep 17 02:00:12.805854 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:12.805811    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x84vq\" (UniqueName: \"kubernetes.io/projected/7d46e2f0-1866-4393-891a-9967cc336e1b-kube-api-access-x84vq\") pod \"payload-processing-e2e-mt-4a1f5690-6fc8b7f569-lrpdm\" (UID: \"7d46e2f0-1866-4393-891a-9967cc336e1b\") " pod="openshift-ingress/payload-processing-e2e-mt-4a1f5690-6fc8b7f569-lrpdm"
Sep 17 02:00:12.806031 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:12.805865    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d46e2f0-1866-4393-891a-9967cc336e1b-plugins-config-volume\") pod \"payload-processing-e2e-mt-4a1f5690-6fc8b7f569-lrpdm\" (UID: \"7d46e2f0-1866-4393-891a-9967cc336e1b\") " pod="openshift-ingress/payload-processing-e2e-mt-4a1f5690-6fc8b7f569-lrpdm"
Sep 17 02:00:12.806031 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:12.805901    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c7hx\" (UniqueName: \"kubernetes.io/projected/ffba00fa-3bac-4e8b-98fc-aff284f2b010-kube-api-access-7c7hx\") pod \"payload-pre-processing-e2e-mt-4a1f5690-6cdd4768b-6prs7\" (UID: \"ffba00fa-3bac-4e8b-98fc-aff284f2b010\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-4a1f5690-6cdd4768b-6prs7"
Sep 17 02:00:12.806031 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:12.805980    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ffba00fa-3bac-4e8b-98fc-aff284f2b010-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-4a1f5690-6cdd4768b-6prs7\" (UID: \"ffba00fa-3bac-4e8b-98fc-aff284f2b010\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-4a1f5690-6cdd4768b-6prs7"
Sep 17 02:00:12.907048 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:12.906951    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x84vq\" (UniqueName: \"kubernetes.io/projected/7d46e2f0-1866-4393-891a-9967cc336e1b-kube-api-access-x84vq\") pod \"payload-processing-e2e-mt-4a1f5690-6fc8b7f569-lrpdm\" (UID: \"7d46e2f0-1866-4393-891a-9967cc336e1b\") " pod="openshift-ingress/payload-processing-e2e-mt-4a1f5690-6fc8b7f569-lrpdm"
Sep 17 02:00:12.907048 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:12.907014    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d46e2f0-1866-4393-891a-9967cc336e1b-plugins-config-volume\") pod \"payload-processing-e2e-mt-4a1f5690-6fc8b7f569-lrpdm\" (UID: \"7d46e2f0-1866-4393-891a-9967cc336e1b\") " pod="openshift-ingress/payload-processing-e2e-mt-4a1f5690-6fc8b7f569-lrpdm"
Sep 17 02:00:12.907048 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:12.907043    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7c7hx\" (UniqueName: \"kubernetes.io/projected/ffba00fa-3bac-4e8b-98fc-aff284f2b010-kube-api-access-7c7hx\") pod \"payload-pre-processing-e2e-mt-4a1f5690-6cdd4768b-6prs7\" (UID: \"ffba00fa-3bac-4e8b-98fc-aff284f2b010\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-4a1f5690-6cdd4768b-6prs7"
Sep 17 02:00:12.907333 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:12.907107    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ffba00fa-3bac-4e8b-98fc-aff284f2b010-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-4a1f5690-6cdd4768b-6prs7\" (UID: \"ffba00fa-3bac-4e8b-98fc-aff284f2b010\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-4a1f5690-6cdd4768b-6prs7"
Sep 17 02:00:12.908016 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:12.907991    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d46e2f0-1866-4393-891a-9967cc336e1b-plugins-config-volume\") pod \"payload-processing-e2e-mt-4a1f5690-6fc8b7f569-lrpdm\" (UID: \"7d46e2f0-1866-4393-891a-9967cc336e1b\") " pod="openshift-ingress/payload-processing-e2e-mt-4a1f5690-6fc8b7f569-lrpdm"
Sep 17 02:00:12.908075 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:12.907991    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ffba00fa-3bac-4e8b-98fc-aff284f2b010-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-4a1f5690-6cdd4768b-6prs7\" (UID: \"ffba00fa-3bac-4e8b-98fc-aff284f2b010\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-4a1f5690-6cdd4768b-6prs7"
Sep 17 02:00:12.915594 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:12.915570    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c7hx\" (UniqueName: \"kubernetes.io/projected/ffba00fa-3bac-4e8b-98fc-aff284f2b010-kube-api-access-7c7hx\") pod \"payload-pre-processing-e2e-mt-4a1f5690-6cdd4768b-6prs7\" (UID: \"ffba00fa-3bac-4e8b-98fc-aff284f2b010\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-4a1f5690-6cdd4768b-6prs7"
Sep 17 02:00:12.915791 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:12.915761    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x84vq\" (UniqueName: \"kubernetes.io/projected/7d46e2f0-1866-4393-891a-9967cc336e1b-kube-api-access-x84vq\") pod \"payload-processing-e2e-mt-4a1f5690-6fc8b7f569-lrpdm\" (UID: \"7d46e2f0-1866-4393-891a-9967cc336e1b\") " pod="openshift-ingress/payload-processing-e2e-mt-4a1f5690-6fc8b7f569-lrpdm"
Sep 17 02:00:12.964703 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:12.964668    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-4a1f5690-6cdd4768b-6prs7"
Sep 17 02:00:12.987034 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:12.987006    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-4a1f5690-6fc8b7f569-lrpdm"
Sep 17 02:00:13.240422 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:13.240395    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-4a1f5690-6cdd4768b-6prs7"]
Sep 17 02:00:13.242678 ip-10-0-143-95 kubenswrapper[2560]: W0917 02:00:13.242650    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffba00fa_3bac_4e8b_98fc_aff284f2b010.slice/crio-a6df08ad81a71f628ba2a998a5d3e26ef0cc2f7aed687cc5571aa408ef308df9 WatchSource:0}: Error finding container a6df08ad81a71f628ba2a998a5d3e26ef0cc2f7aed687cc5571aa408ef308df9: Status 404 returned error can't find the container with id a6df08ad81a71f628ba2a998a5d3e26ef0cc2f7aed687cc5571aa408ef308df9
Sep 17 02:00:13.251241 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:13.251214    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-4a1f5690-6cdd4768b-6prs7" event={"ID":"ffba00fa-3bac-4e8b-98fc-aff284f2b010","Type":"ContainerStarted","Data":"a6df08ad81a71f628ba2a998a5d3e26ef0cc2f7aed687cc5571aa408ef308df9"}
Sep 17 02:00:13.271646 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:13.271620    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-4a1f5690-6fc8b7f569-lrpdm"]
Sep 17 02:00:13.277549 ip-10-0-143-95 kubenswrapper[2560]: W0917 02:00:13.277518    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d46e2f0_1866_4393_891a_9967cc336e1b.slice/crio-72dd92a73f9d7ff025d7987be47bc87a56b0bdc6608d2dc2ce7bf445f4061c1f WatchSource:0}: Error finding container 72dd92a73f9d7ff025d7987be47bc87a56b0bdc6608d2dc2ce7bf445f4061c1f: Status 404 returned error can't find the container with id 72dd92a73f9d7ff025d7987be47bc87a56b0bdc6608d2dc2ce7bf445f4061c1f
Sep 17 02:00:13.370404 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:13.368975    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-38758b-5f864bfd54-sbrht"]
Sep 17 02:00:13.370404 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:13.369272    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-38758b-5f864bfd54-sbrht" podUID="99ac56e3-41a0-4975-aa73-13b391b438dd" containerName="maas-api" containerID="cri-o://992f8da548c942406c3ef729372dbbd62636a1fb37bbd03828607844b4f51411" gracePeriod=30
Sep 17 02:00:13.439203 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:13.439170    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-38758b-8564ff96c-7f24n"]
Sep 17 02:00:13.439430 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:13.439402    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-38758b-8564ff96c-7f24n" podUID="de6b1ba5-af5d-4cfa-b0d3-ace0f82c6da3" containerName="payload-processing" containerID="cri-o://541cb3d9fc9748a681e9fcb8a1ef560305ae47ccf756c81b377d21b89128df38" gracePeriod=30
Sep 17 02:00:13.726934 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:13.726902    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-38758b-8564ff96c-7f24n"
Sep 17 02:00:13.823655 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:13.823620    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de6b1ba5-af5d-4cfa-b0d3-ace0f82c6da3-plugins-config-volume\") pod \"de6b1ba5-af5d-4cfa-b0d3-ace0f82c6da3\" (UID: \"de6b1ba5-af5d-4cfa-b0d3-ace0f82c6da3\") "
Sep 17 02:00:13.823853 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:13.823748    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjnjq\" (UniqueName: \"kubernetes.io/projected/de6b1ba5-af5d-4cfa-b0d3-ace0f82c6da3-kube-api-access-fjnjq\") pod \"de6b1ba5-af5d-4cfa-b0d3-ace0f82c6da3\" (UID: \"de6b1ba5-af5d-4cfa-b0d3-ace0f82c6da3\") "
Sep 17 02:00:13.824034 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:13.824009    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de6b1ba5-af5d-4cfa-b0d3-ace0f82c6da3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "de6b1ba5-af5d-4cfa-b0d3-ace0f82c6da3" (UID: "de6b1ba5-af5d-4cfa-b0d3-ace0f82c6da3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 02:00:13.825923 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:13.825885    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de6b1ba5-af5d-4cfa-b0d3-ace0f82c6da3-kube-api-access-fjnjq" (OuterVolumeSpecName: "kube-api-access-fjnjq") pod "de6b1ba5-af5d-4cfa-b0d3-ace0f82c6da3" (UID: "de6b1ba5-af5d-4cfa-b0d3-ace0f82c6da3"). InnerVolumeSpecName "kube-api-access-fjnjq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 02:00:13.837297 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:13.837223    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-38758b-5f864bfd54-sbrht"
Sep 17 02:00:13.925062 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:13.925034    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjnjq\" (UniqueName: \"kubernetes.io/projected/de6b1ba5-af5d-4cfa-b0d3-ace0f82c6da3-kube-api-access-fjnjq\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:00:13.925149 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:13.925065    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de6b1ba5-af5d-4cfa-b0d3-ace0f82c6da3-plugins-config-volume\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:00:14.025707 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:14.025663    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99ac56e3-41a0-4975-aa73-13b391b438dd-maas-api-tls\") pod \"99ac56e3-41a0-4975-aa73-13b391b438dd\" (UID: \"99ac56e3-41a0-4975-aa73-13b391b438dd\") "
Sep 17 02:00:14.025707 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:14.025708    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zfb6g\" (UniqueName: \"kubernetes.io/projected/99ac56e3-41a0-4975-aa73-13b391b438dd-kube-api-access-zfb6g\") pod \"99ac56e3-41a0-4975-aa73-13b391b438dd\" (UID: \"99ac56e3-41a0-4975-aa73-13b391b438dd\") "
Sep 17 02:00:14.025964 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:14.025740    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/99ac56e3-41a0-4975-aa73-13b391b438dd-openshift-service-ca\") pod \"99ac56e3-41a0-4975-aa73-13b391b438dd\" (UID: \"99ac56e3-41a0-4975-aa73-13b391b438dd\") "
Sep 17 02:00:14.025964 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:14.025771    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99ac56e3-41a0-4975-aa73-13b391b438dd-metrics-certs\") pod \"99ac56e3-41a0-4975-aa73-13b391b438dd\" (UID: \"99ac56e3-41a0-4975-aa73-13b391b438dd\") "
Sep 17 02:00:14.026342 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:14.026125    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99ac56e3-41a0-4975-aa73-13b391b438dd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "99ac56e3-41a0-4975-aa73-13b391b438dd" (UID: "99ac56e3-41a0-4975-aa73-13b391b438dd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 02:00:14.027955 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:14.027916    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99ac56e3-41a0-4975-aa73-13b391b438dd-kube-api-access-zfb6g" (OuterVolumeSpecName: "kube-api-access-zfb6g") pod "99ac56e3-41a0-4975-aa73-13b391b438dd" (UID: "99ac56e3-41a0-4975-aa73-13b391b438dd"). InnerVolumeSpecName "kube-api-access-zfb6g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 02:00:14.027955 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:14.027946    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99ac56e3-41a0-4975-aa73-13b391b438dd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "99ac56e3-41a0-4975-aa73-13b391b438dd" (UID: "99ac56e3-41a0-4975-aa73-13b391b438dd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 02:00:14.028103 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:14.027968    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99ac56e3-41a0-4975-aa73-13b391b438dd-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "99ac56e3-41a0-4975-aa73-13b391b438dd" (UID: "99ac56e3-41a0-4975-aa73-13b391b438dd"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 02:00:14.127055 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:14.126958    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zfb6g\" (UniqueName: \"kubernetes.io/projected/99ac56e3-41a0-4975-aa73-13b391b438dd-kube-api-access-zfb6g\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:00:14.127055 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:14.126991    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/99ac56e3-41a0-4975-aa73-13b391b438dd-openshift-service-ca\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:00:14.127055 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:14.127005    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99ac56e3-41a0-4975-aa73-13b391b438dd-metrics-certs\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:00:14.127055 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:14.127017    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99ac56e3-41a0-4975-aa73-13b391b438dd-maas-api-tls\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:00:14.259826 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:14.259790    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-4a1f5690-6fc8b7f569-lrpdm" event={"ID":"7d46e2f0-1866-4393-891a-9967cc336e1b","Type":"ContainerStarted","Data":"94a9d3ff090375f26aaaec9ed63bfd02d2f2465912eb30c5e7ef142e4a6401c8"}
Sep 17 02:00:14.260022 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:14.259862    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-4a1f5690-6fc8b7f569-lrpdm"
Sep 17 02:00:14.260022 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:14.259885    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-4a1f5690-6fc8b7f569-lrpdm" event={"ID":"7d46e2f0-1866-4393-891a-9967cc336e1b","Type":"ContainerStarted","Data":"72dd92a73f9d7ff025d7987be47bc87a56b0bdc6608d2dc2ce7bf445f4061c1f"}
Sep 17 02:00:14.261591 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:14.261557    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-4a1f5690-6cdd4768b-6prs7" event={"ID":"ffba00fa-3bac-4e8b-98fc-aff284f2b010","Type":"ContainerStarted","Data":"4eae57ca1c871e8a4c96fffd34717ea968ea0f264899f74f7555ef266b307b93"}
Sep 17 02:00:14.261731 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:14.261667    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-4a1f5690-6cdd4768b-6prs7"
Sep 17 02:00:14.262911 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:14.262888    2560 generic.go:356] "Generic (PLEG): container finished" podID="de6b1ba5-af5d-4cfa-b0d3-ace0f82c6da3" containerID="541cb3d9fc9748a681e9fcb8a1ef560305ae47ccf756c81b377d21b89128df38" exitCode=0
Sep 17 02:00:14.263014 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:14.262928    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-38758b-8564ff96c-7f24n"
Sep 17 02:00:14.263014 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:14.262968    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-38758b-8564ff96c-7f24n" event={"ID":"de6b1ba5-af5d-4cfa-b0d3-ace0f82c6da3","Type":"ContainerDied","Data":"541cb3d9fc9748a681e9fcb8a1ef560305ae47ccf756c81b377d21b89128df38"}
Sep 17 02:00:14.263111 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:14.263015    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-38758b-8564ff96c-7f24n" event={"ID":"de6b1ba5-af5d-4cfa-b0d3-ace0f82c6da3","Type":"ContainerDied","Data":"39d4de1c829c761bcd9c9dbb453bf7d652c9b553da9ecbc119035f8b3fb782ff"}
Sep 17 02:00:14.263111 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:14.263047    2560 scope.go:117] "RemoveContainer" containerID="541cb3d9fc9748a681e9fcb8a1ef560305ae47ccf756c81b377d21b89128df38"
Sep 17 02:00:14.264680 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:14.264645    2560 generic.go:356] "Generic (PLEG): container finished" podID="99ac56e3-41a0-4975-aa73-13b391b438dd" containerID="992f8da548c942406c3ef729372dbbd62636a1fb37bbd03828607844b4f51411" exitCode=0
Sep 17 02:00:14.264762 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:14.264691    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-38758b-5f864bfd54-sbrht"
Sep 17 02:00:14.264816 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:14.264697    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-38758b-5f864bfd54-sbrht" event={"ID":"99ac56e3-41a0-4975-aa73-13b391b438dd","Type":"ContainerDied","Data":"992f8da548c942406c3ef729372dbbd62636a1fb37bbd03828607844b4f51411"}
Sep 17 02:00:14.264879 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:14.264837    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-38758b-5f864bfd54-sbrht" event={"ID":"99ac56e3-41a0-4975-aa73-13b391b438dd","Type":"ContainerDied","Data":"217444fa924480666604e732d255697166e17f89d4759a2db4aabeb82adf92ce"}
Sep 17 02:00:14.272415 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:14.272397    2560 scope.go:117] "RemoveContainer" containerID="541cb3d9fc9748a681e9fcb8a1ef560305ae47ccf756c81b377d21b89128df38"
Sep 17 02:00:14.272716 ip-10-0-143-95 kubenswrapper[2560]: E0917 02:00:14.272696    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"541cb3d9fc9748a681e9fcb8a1ef560305ae47ccf756c81b377d21b89128df38\": container with ID starting with 541cb3d9fc9748a681e9fcb8a1ef560305ae47ccf756c81b377d21b89128df38 not found: ID does not exist" containerID="541cb3d9fc9748a681e9fcb8a1ef560305ae47ccf756c81b377d21b89128df38"
Sep 17 02:00:14.272787 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:14.272728    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"541cb3d9fc9748a681e9fcb8a1ef560305ae47ccf756c81b377d21b89128df38"} err="failed to get container status \"541cb3d9fc9748a681e9fcb8a1ef560305ae47ccf756c81b377d21b89128df38\": rpc error: code = NotFound desc = could not find container \"541cb3d9fc9748a681e9fcb8a1ef560305ae47ccf756c81b377d21b89128df38\": container with ID starting with 541cb3d9fc9748a681e9fcb8a1ef560305ae47ccf756c81b377d21b89128df38 not found: ID does not exist"
Sep 17 02:00:14.272787 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:14.272746    2560 scope.go:117] "RemoveContainer" containerID="992f8da548c942406c3ef729372dbbd62636a1fb37bbd03828607844b4f51411"
Sep 17 02:00:14.282012 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:14.281995    2560 scope.go:117] "RemoveContainer" containerID="992f8da548c942406c3ef729372dbbd62636a1fb37bbd03828607844b4f51411"
Sep 17 02:00:14.282322 ip-10-0-143-95 kubenswrapper[2560]: E0917 02:00:14.282301    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"992f8da548c942406c3ef729372dbbd62636a1fb37bbd03828607844b4f51411\": container with ID starting with 992f8da548c942406c3ef729372dbbd62636a1fb37bbd03828607844b4f51411 not found: ID does not exist" containerID="992f8da548c942406c3ef729372dbbd62636a1fb37bbd03828607844b4f51411"
Sep 17 02:00:14.282410 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:14.282330    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"992f8da548c942406c3ef729372dbbd62636a1fb37bbd03828607844b4f51411"} err="failed to get container status \"992f8da548c942406c3ef729372dbbd62636a1fb37bbd03828607844b4f51411\": rpc error: code = NotFound desc = could not find container \"992f8da548c942406c3ef729372dbbd62636a1fb37bbd03828607844b4f51411\": container with ID starting with 992f8da548c942406c3ef729372dbbd62636a1fb37bbd03828607844b4f51411 not found: ID does not exist"
Sep 17 02:00:14.303735 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:14.303686    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-4a1f5690-6fc8b7f569-lrpdm" podStartSLOduration=2.30366799 podStartE2EDuration="2.30366799s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 02:00:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:00:14.299504157 +0000 UTC m=+1372.549481470" watchObservedRunningTime="2026-09-17 02:00:14.30366799 +0000 UTC m=+1372.553645296"
Sep 17 02:00:14.354912 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:14.354861    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-4a1f5690-6cdd4768b-6prs7" podStartSLOduration=2.354841254 podStartE2EDuration="2.354841254s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 02:00:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:00:14.352077962 +0000 UTC m=+1372.602055276" watchObservedRunningTime="2026-09-17 02:00:14.354841254 +0000 UTC m=+1372.604818567"
Sep 17 02:00:14.381364 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:14.381292    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-38758b-5f864bfd54-sbrht"]
Sep 17 02:00:14.384808 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:14.384785    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-38758b-5f864bfd54-sbrht"]
Sep 17 02:00:14.399460 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:14.399431    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-38758b-8564ff96c-7f24n"]
Sep 17 02:00:14.404965 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:14.404942    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-38758b-8564ff96c-7f24n"]
Sep 17 02:00:16.360198 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:16.360164    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99ac56e3-41a0-4975-aa73-13b391b438dd" path="/var/lib/kubelet/pods/99ac56e3-41a0-4975-aa73-13b391b438dd/volumes"
Sep 17 02:00:16.360649 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:16.360631    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de6b1ba5-af5d-4cfa-b0d3-ace0f82c6da3" path="/var/lib/kubelet/pods/de6b1ba5-af5d-4cfa-b0d3-ace0f82c6da3/volumes"
Sep 17 02:00:25.274431 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:25.274396    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-4a1f5690-6cdd4768b-6prs7"
Sep 17 02:00:25.274860 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:25.274474    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-4a1f5690-6fc8b7f569-lrpdm"
Sep 17 02:00:31.136274 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:31.136221    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-55c648-79bf9f859d-5x9qk"]
Sep 17 02:00:31.136783 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:31.136498    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-55c648-79bf9f859d-5x9qk" podUID="2d3f7c2e-6173-489c-b5f2-6fab37689819" containerName="payload-pre-processing" containerID="cri-o://0e944d0f13f5cef26c605583d745e0e9b024607f599e5fbcb2b118d72ec2833c" gracePeriod=30
Sep 17 02:00:31.365813 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:31.365741    2560 generic.go:356] "Generic (PLEG): container finished" podID="2d3f7c2e-6173-489c-b5f2-6fab37689819" containerID="0e944d0f13f5cef26c605583d745e0e9b024607f599e5fbcb2b118d72ec2833c" exitCode=0
Sep 17 02:00:31.366089 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:31.365851    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-55c648-79bf9f859d-5x9qk" event={"ID":"2d3f7c2e-6173-489c-b5f2-6fab37689819","Type":"ContainerDied","Data":"0e944d0f13f5cef26c605583d745e0e9b024607f599e5fbcb2b118d72ec2833c"}
Sep 17 02:00:31.406417 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:31.406346    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-55c648-79bf9f859d-5x9qk"
Sep 17 02:00:31.502089 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:31.502048    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d3f7c2e-6173-489c-b5f2-6fab37689819-plugins-config-volume\") pod \"2d3f7c2e-6173-489c-b5f2-6fab37689819\" (UID: \"2d3f7c2e-6173-489c-b5f2-6fab37689819\") "
Sep 17 02:00:31.502325 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:31.502113    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jl67g\" (UniqueName: \"kubernetes.io/projected/2d3f7c2e-6173-489c-b5f2-6fab37689819-kube-api-access-jl67g\") pod \"2d3f7c2e-6173-489c-b5f2-6fab37689819\" (UID: \"2d3f7c2e-6173-489c-b5f2-6fab37689819\") "
Sep 17 02:00:31.502524 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:31.502496    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d3f7c2e-6173-489c-b5f2-6fab37689819-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2d3f7c2e-6173-489c-b5f2-6fab37689819" (UID: "2d3f7c2e-6173-489c-b5f2-6fab37689819"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 02:00:31.504217 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:31.504195    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d3f7c2e-6173-489c-b5f2-6fab37689819-kube-api-access-jl67g" (OuterVolumeSpecName: "kube-api-access-jl67g") pod "2d3f7c2e-6173-489c-b5f2-6fab37689819" (UID: "2d3f7c2e-6173-489c-b5f2-6fab37689819"). InnerVolumeSpecName "kube-api-access-jl67g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 02:00:31.602792 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:31.602757    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d3f7c2e-6173-489c-b5f2-6fab37689819-plugins-config-volume\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:00:31.602792 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:31.602786    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jl67g\" (UniqueName: \"kubernetes.io/projected/2d3f7c2e-6173-489c-b5f2-6fab37689819-kube-api-access-jl67g\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:00:32.372102 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:32.372068    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-55c648-79bf9f859d-5x9qk" event={"ID":"2d3f7c2e-6173-489c-b5f2-6fab37689819","Type":"ContainerDied","Data":"5f229bdbaca7ea0a488259824936e9d23b3a4da6d02082cf83962dc9335de88a"}
Sep 17 02:00:32.372457 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:32.372129    2560 scope.go:117] "RemoveContainer" containerID="0e944d0f13f5cef26c605583d745e0e9b024607f599e5fbcb2b118d72ec2833c"
Sep 17 02:00:32.372457 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:32.372082    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-55c648-79bf9f859d-5x9qk"
Sep 17 02:00:32.386572 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:32.386547    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-55c648-79bf9f859d-5x9qk"]
Sep 17 02:00:32.391549 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:32.391524    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-55c648-79bf9f859d-5x9qk"]
Sep 17 02:00:34.359508 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:34.359465    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d3f7c2e-6173-489c-b5f2-6fab37689819" path="/var/lib/kubelet/pods/2d3f7c2e-6173-489c-b5f2-6fab37689819/volumes"
Sep 17 02:00:39.057784 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:39.055582    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr"]
Sep 17 02:00:39.057784 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:39.056464    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d3f7c2e-6173-489c-b5f2-6fab37689819" containerName="payload-pre-processing"
Sep 17 02:00:39.057784 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:39.056486    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d3f7c2e-6173-489c-b5f2-6fab37689819" containerName="payload-pre-processing"
Sep 17 02:00:39.057784 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:39.056554    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99ac56e3-41a0-4975-aa73-13b391b438dd" containerName="maas-api"
Sep 17 02:00:39.057784 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:39.056566    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="99ac56e3-41a0-4975-aa73-13b391b438dd" containerName="maas-api"
Sep 17 02:00:39.057784 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:39.056576    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de6b1ba5-af5d-4cfa-b0d3-ace0f82c6da3" containerName="payload-processing"
Sep 17 02:00:39.057784 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:39.056585    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="de6b1ba5-af5d-4cfa-b0d3-ace0f82c6da3" containerName="payload-processing"
Sep 17 02:00:39.057784 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:39.056754    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d3f7c2e-6173-489c-b5f2-6fab37689819" containerName="payload-pre-processing"
Sep 17 02:00:39.057784 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:39.056778    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="de6b1ba5-af5d-4cfa-b0d3-ace0f82c6da3" containerName="payload-processing"
Sep 17 02:00:39.057784 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:39.056790    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="99ac56e3-41a0-4975-aa73-13b391b438dd" containerName="maas-api"
Sep 17 02:00:39.063953 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:39.063918    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr"
Sep 17 02:00:39.066174 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:39.066148    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-67a23a-openshift-default-dockercfg-m5wsx\""
Sep 17 02:00:39.068352 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:39.068327    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr"]
Sep 17 02:00:39.177003 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:39.176964    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6673a56-cae4-406a-b3d8-18f42a987f3d-workload-socket\") pod \"e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr\" (UID: \"f6673a56-cae4-406a-b3d8-18f42a987f3d\") " pod="openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr"
Sep 17 02:00:39.177003 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:39.177007    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6673a56-cae4-406a-b3d8-18f42a987f3d-istiod-ca-cert\") pod \"e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr\" (UID: \"f6673a56-cae4-406a-b3d8-18f42a987f3d\") " pod="openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr"
Sep 17 02:00:39.177207 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:39.177061    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vmbt\" (UniqueName: \"kubernetes.io/projected/f6673a56-cae4-406a-b3d8-18f42a987f3d-kube-api-access-8vmbt\") pod \"e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr\" (UID: \"f6673a56-cae4-406a-b3d8-18f42a987f3d\") " pod="openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr"
Sep 17 02:00:39.177207 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:39.177135    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6673a56-cae4-406a-b3d8-18f42a987f3d-istio-envoy\") pod \"e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr\" (UID: \"f6673a56-cae4-406a-b3d8-18f42a987f3d\") " pod="openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr"
Sep 17 02:00:39.177315 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:39.177209    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6673a56-cae4-406a-b3d8-18f42a987f3d-workload-certs\") pod \"e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr\" (UID: \"f6673a56-cae4-406a-b3d8-18f42a987f3d\") " pod="openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr"
Sep 17 02:00:39.177315 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:39.177229    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6673a56-cae4-406a-b3d8-18f42a987f3d-istio-data\") pod \"e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr\" (UID: \"f6673a56-cae4-406a-b3d8-18f42a987f3d\") " pod="openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr"
Sep 17 02:00:39.177315 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:39.177280    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6673a56-cae4-406a-b3d8-18f42a987f3d-istio-podinfo\") pod \"e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr\" (UID: \"f6673a56-cae4-406a-b3d8-18f42a987f3d\") " pod="openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr"
Sep 17 02:00:39.177415 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:39.177326    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6673a56-cae4-406a-b3d8-18f42a987f3d-istio-token\") pod \"e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr\" (UID: \"f6673a56-cae4-406a-b3d8-18f42a987f3d\") " pod="openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr"
Sep 17 02:00:39.177415 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:39.177355    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6673a56-cae4-406a-b3d8-18f42a987f3d-credential-socket\") pod \"e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr\" (UID: \"f6673a56-cae4-406a-b3d8-18f42a987f3d\") " pod="openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr"
Sep 17 02:00:39.278573 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:39.278538    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6673a56-cae4-406a-b3d8-18f42a987f3d-credential-socket\") pod \"e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr\" (UID: \"f6673a56-cae4-406a-b3d8-18f42a987f3d\") " pod="openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr"
Sep 17 02:00:39.278749 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:39.278580    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6673a56-cae4-406a-b3d8-18f42a987f3d-workload-socket\") pod \"e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr\" (UID: \"f6673a56-cae4-406a-b3d8-18f42a987f3d\") " pod="openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr"
Sep 17 02:00:39.278749 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:39.278601    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6673a56-cae4-406a-b3d8-18f42a987f3d-istiod-ca-cert\") pod \"e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr\" (UID: \"f6673a56-cae4-406a-b3d8-18f42a987f3d\") " pod="openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr"
Sep 17 02:00:39.278749 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:39.278629    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vmbt\" (UniqueName: \"kubernetes.io/projected/f6673a56-cae4-406a-b3d8-18f42a987f3d-kube-api-access-8vmbt\") pod \"e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr\" (UID: \"f6673a56-cae4-406a-b3d8-18f42a987f3d\") " pod="openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr"
Sep 17 02:00:39.278749 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:39.278653    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6673a56-cae4-406a-b3d8-18f42a987f3d-istio-envoy\") pod \"e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr\" (UID: \"f6673a56-cae4-406a-b3d8-18f42a987f3d\") " pod="openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr"
Sep 17 02:00:39.278749 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:39.278694    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6673a56-cae4-406a-b3d8-18f42a987f3d-workload-certs\") pod \"e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr\" (UID: \"f6673a56-cae4-406a-b3d8-18f42a987f3d\") " pod="openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr"
Sep 17 02:00:39.278749 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:39.278717    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6673a56-cae4-406a-b3d8-18f42a987f3d-istio-data\") pod \"e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr\" (UID: \"f6673a56-cae4-406a-b3d8-18f42a987f3d\") " pod="openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr"
Sep 17 02:00:39.279146 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:39.278753    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6673a56-cae4-406a-b3d8-18f42a987f3d-istio-podinfo\") pod \"e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr\" (UID: \"f6673a56-cae4-406a-b3d8-18f42a987f3d\") " pod="openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr"
Sep 17 02:00:39.279146 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:39.278812    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6673a56-cae4-406a-b3d8-18f42a987f3d-istio-token\") pod \"e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr\" (UID: \"f6673a56-cae4-406a-b3d8-18f42a987f3d\") " pod="openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr"
Sep 17 02:00:39.279146 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:39.279004    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6673a56-cae4-406a-b3d8-18f42a987f3d-workload-socket\") pod \"e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr\" (UID: \"f6673a56-cae4-406a-b3d8-18f42a987f3d\") " pod="openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr"
Sep 17 02:00:39.279146 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:39.279023    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6673a56-cae4-406a-b3d8-18f42a987f3d-credential-socket\") pod \"e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr\" (UID: \"f6673a56-cae4-406a-b3d8-18f42a987f3d\") " pod="openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr"
Sep 17 02:00:39.279378 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:39.279193    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6673a56-cae4-406a-b3d8-18f42a987f3d-istio-data\") pod \"e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr\" (UID: \"f6673a56-cae4-406a-b3d8-18f42a987f3d\") " pod="openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr"
Sep 17 02:00:39.279644 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:39.279616    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6673a56-cae4-406a-b3d8-18f42a987f3d-workload-certs\") pod \"e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr\" (UID: \"f6673a56-cae4-406a-b3d8-18f42a987f3d\") " pod="openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr"
Sep 17 02:00:39.279734 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:39.279694    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6673a56-cae4-406a-b3d8-18f42a987f3d-istiod-ca-cert\") pod \"e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr\" (UID: \"f6673a56-cae4-406a-b3d8-18f42a987f3d\") " pod="openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr"
Sep 17 02:00:39.280843 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:39.280817    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6673a56-cae4-406a-b3d8-18f42a987f3d-istio-envoy\") pod \"e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr\" (UID: \"f6673a56-cae4-406a-b3d8-18f42a987f3d\") " pod="openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr"
Sep 17 02:00:39.281155 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:39.281138    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6673a56-cae4-406a-b3d8-18f42a987f3d-istio-podinfo\") pod \"e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr\" (UID: \"f6673a56-cae4-406a-b3d8-18f42a987f3d\") " pod="openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr"
Sep 17 02:00:39.285452 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:39.285426    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6673a56-cae4-406a-b3d8-18f42a987f3d-istio-token\") pod \"e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr\" (UID: \"f6673a56-cae4-406a-b3d8-18f42a987f3d\") " pod="openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr"
Sep 17 02:00:39.285652 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:39.285633    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vmbt\" (UniqueName: \"kubernetes.io/projected/f6673a56-cae4-406a-b3d8-18f42a987f3d-kube-api-access-8vmbt\") pod \"e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr\" (UID: \"f6673a56-cae4-406a-b3d8-18f42a987f3d\") " pod="openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr"
Sep 17 02:00:39.376241 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:39.376205    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr"
Sep 17 02:00:39.651695 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:39.651672    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr"]
Sep 17 02:00:39.653844 ip-10-0-143-95 kubenswrapper[2560]: W0917 02:00:39.653815    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6673a56_cae4_406a_b3d8_18f42a987f3d.slice/crio-e682be8dd89dd8c512c27d359cddca502a2c0099e71a736f96ee33506919cabf WatchSource:0}: Error finding container e682be8dd89dd8c512c27d359cddca502a2c0099e71a736f96ee33506919cabf: Status 404 returned error can't find the container with id e682be8dd89dd8c512c27d359cddca502a2c0099e71a736f96ee33506919cabf
Sep 17 02:00:39.656099 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:39.656067    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 02:00:39.656153 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:39.656137    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 02:00:39.656192 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:39.656167    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 02:00:40.418119 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:40.418077    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr" event={"ID":"f6673a56-cae4-406a-b3d8-18f42a987f3d","Type":"ContainerStarted","Data":"af3c42f44d5a855eaee14ac31e4a4b500b4f0acd7f9a544f1b6b99f892c3bd2a"}
Sep 17 02:00:40.418635 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:40.418151    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr" event={"ID":"f6673a56-cae4-406a-b3d8-18f42a987f3d","Type":"ContainerStarted","Data":"e682be8dd89dd8c512c27d359cddca502a2c0099e71a736f96ee33506919cabf"}
Sep 17 02:00:40.437691 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:40.437640    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr" podStartSLOduration=1.437623813 podStartE2EDuration="1.437623813s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 02:00:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:00:40.435536223 +0000 UTC m=+1398.685513536" watchObservedRunningTime="2026-09-17 02:00:40.437623813 +0000 UTC m=+1398.687601125"
Sep 17 02:00:41.376449 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:41.376402    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr"
Sep 17 02:00:41.381638 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:41.381611    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr"
Sep 17 02:00:41.424548 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:41.424521    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr"
Sep 17 02:00:41.425638 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:41.425619    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr"
Sep 17 02:00:45.701097 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:45.701060    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-67a23a-5747bc7574-tbrz2"]
Sep 17 02:00:45.705709 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:45.705692    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-67a23a-5747bc7574-tbrz2"
Sep 17 02:00:45.707453 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:45.707434    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-67a23a-dockercfg-d4lpw\""
Sep 17 02:00:45.707712 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:45.707697    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-67a23a\""
Sep 17 02:00:45.714764 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:45.714744    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-67a23a-5747bc7574-tbrz2"]
Sep 17 02:00:45.844965 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:45.844923    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/07cecd25-a940-4ad3-aad0-dc7d3cef3e85-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-67a23a-5747bc7574-tbrz2\" (UID: \"07cecd25-a940-4ad3-aad0-dc7d3cef3e85\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-67a23a-5747bc7574-tbrz2"
Sep 17 02:00:45.845143 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:45.845066    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p272v\" (UniqueName: \"kubernetes.io/projected/07cecd25-a940-4ad3-aad0-dc7d3cef3e85-kube-api-access-p272v\") pod \"payload-pre-processing-e2e-shared-a-w2-67a23a-5747bc7574-tbrz2\" (UID: \"07cecd25-a940-4ad3-aad0-dc7d3cef3e85\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-67a23a-5747bc7574-tbrz2"
Sep 17 02:00:45.946126 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:45.946092    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/07cecd25-a940-4ad3-aad0-dc7d3cef3e85-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-67a23a-5747bc7574-tbrz2\" (UID: \"07cecd25-a940-4ad3-aad0-dc7d3cef3e85\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-67a23a-5747bc7574-tbrz2"
Sep 17 02:00:45.946340 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:45.946189    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p272v\" (UniqueName: \"kubernetes.io/projected/07cecd25-a940-4ad3-aad0-dc7d3cef3e85-kube-api-access-p272v\") pod \"payload-pre-processing-e2e-shared-a-w2-67a23a-5747bc7574-tbrz2\" (UID: \"07cecd25-a940-4ad3-aad0-dc7d3cef3e85\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-67a23a-5747bc7574-tbrz2"
Sep 17 02:00:45.946828 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:45.946807    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/07cecd25-a940-4ad3-aad0-dc7d3cef3e85-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-67a23a-5747bc7574-tbrz2\" (UID: \"07cecd25-a940-4ad3-aad0-dc7d3cef3e85\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-67a23a-5747bc7574-tbrz2"
Sep 17 02:00:45.953270 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:45.953193    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p272v\" (UniqueName: \"kubernetes.io/projected/07cecd25-a940-4ad3-aad0-dc7d3cef3e85-kube-api-access-p272v\") pod \"payload-pre-processing-e2e-shared-a-w2-67a23a-5747bc7574-tbrz2\" (UID: \"07cecd25-a940-4ad3-aad0-dc7d3cef3e85\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-67a23a-5747bc7574-tbrz2"
Sep 17 02:00:46.019199 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:46.019164    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-67a23a-5747bc7574-tbrz2"
Sep 17 02:00:46.288304 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:46.288263    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-67a23a-5747bc7574-tbrz2"]
Sep 17 02:00:46.459775 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:46.459738    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-67a23a-5747bc7574-tbrz2" event={"ID":"07cecd25-a940-4ad3-aad0-dc7d3cef3e85","Type":"ContainerStarted","Data":"2efda3a3752da46e3f3d3cc57292da239606fffc6fc81749778b653efb864931"}
Sep 17 02:00:46.459974 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:46.459799    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-67a23a-5747bc7574-tbrz2" event={"ID":"07cecd25-a940-4ad3-aad0-dc7d3cef3e85","Type":"ContainerStarted","Data":"15916acc2641ad3a5ea213fa79c2764842ed1d5f5a6d85bd748e333d66f740be"}
Sep 17 02:00:46.459974 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:46.459950    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-67a23a-5747bc7574-tbrz2"
Sep 17 02:00:46.474481 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:46.474426    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-67a23a-5747bc7574-tbrz2" podStartSLOduration=1.4744071939999999 podStartE2EDuration="1.474407194s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 02:00:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:00:46.472704082 +0000 UTC m=+1404.722681406" watchObservedRunningTime="2026-09-17 02:00:46.474407194 +0000 UTC m=+1404.724384512"
Sep 17 02:00:49.650037 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:49.650004    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-4a1f5690-6fc8b7f569-lrpdm"]
Sep 17 02:00:49.650539 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:49.650203    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-4a1f5690-6fc8b7f569-lrpdm" podUID="7d46e2f0-1866-4393-891a-9967cc336e1b" containerName="payload-processing" containerID="cri-o://94a9d3ff090375f26aaaec9ed63bfd02d2f2465912eb30c5e7ef142e4a6401c8" gracePeriod=30
Sep 17 02:00:49.658035 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:49.657793    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-4a1f5690-6cdd4768b-6prs7"]
Sep 17 02:00:49.658152 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:49.658006    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-4a1f5690-6cdd4768b-6prs7" podUID="ffba00fa-3bac-4e8b-98fc-aff284f2b010" containerName="payload-pre-processing" containerID="cri-o://4eae57ca1c871e8a4c96fffd34717ea968ea0f264899f74f7555ef266b307b93" gracePeriod=30
Sep 17 02:00:49.933098 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:49.933071    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-4a1f5690-6fc8b7f569-lrpdm"
Sep 17 02:00:49.935937 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:49.935914    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-4a1f5690-6cdd4768b-6prs7"
Sep 17 02:00:50.091442 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:50.091400    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7c7hx\" (UniqueName: \"kubernetes.io/projected/ffba00fa-3bac-4e8b-98fc-aff284f2b010-kube-api-access-7c7hx\") pod \"ffba00fa-3bac-4e8b-98fc-aff284f2b010\" (UID: \"ffba00fa-3bac-4e8b-98fc-aff284f2b010\") "
Sep 17 02:00:50.091644 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:50.091462    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ffba00fa-3bac-4e8b-98fc-aff284f2b010-plugins-config-volume\") pod \"ffba00fa-3bac-4e8b-98fc-aff284f2b010\" (UID: \"ffba00fa-3bac-4e8b-98fc-aff284f2b010\") "
Sep 17 02:00:50.091644 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:50.091531    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d46e2f0-1866-4393-891a-9967cc336e1b-plugins-config-volume\") pod \"7d46e2f0-1866-4393-891a-9967cc336e1b\" (UID: \"7d46e2f0-1866-4393-891a-9967cc336e1b\") "
Sep 17 02:00:50.091644 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:50.091573    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x84vq\" (UniqueName: \"kubernetes.io/projected/7d46e2f0-1866-4393-891a-9967cc336e1b-kube-api-access-x84vq\") pod \"7d46e2f0-1866-4393-891a-9967cc336e1b\" (UID: \"7d46e2f0-1866-4393-891a-9967cc336e1b\") "
Sep 17 02:00:50.091843 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:50.091813    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffba00fa-3bac-4e8b-98fc-aff284f2b010-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ffba00fa-3bac-4e8b-98fc-aff284f2b010" (UID: "ffba00fa-3bac-4e8b-98fc-aff284f2b010"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 02:00:50.091930 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:50.091905    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d46e2f0-1866-4393-891a-9967cc336e1b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7d46e2f0-1866-4393-891a-9967cc336e1b" (UID: "7d46e2f0-1866-4393-891a-9967cc336e1b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 02:00:50.091991 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:50.091912    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ffba00fa-3bac-4e8b-98fc-aff284f2b010-plugins-config-volume\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:00:50.093613 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:50.093585    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffba00fa-3bac-4e8b-98fc-aff284f2b010-kube-api-access-7c7hx" (OuterVolumeSpecName: "kube-api-access-7c7hx") pod "ffba00fa-3bac-4e8b-98fc-aff284f2b010" (UID: "ffba00fa-3bac-4e8b-98fc-aff284f2b010"). InnerVolumeSpecName "kube-api-access-7c7hx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 02:00:50.093737 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:50.093650    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d46e2f0-1866-4393-891a-9967cc336e1b-kube-api-access-x84vq" (OuterVolumeSpecName: "kube-api-access-x84vq") pod "7d46e2f0-1866-4393-891a-9967cc336e1b" (UID: "7d46e2f0-1866-4393-891a-9967cc336e1b"). InnerVolumeSpecName "kube-api-access-x84vq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 02:00:50.192785 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:50.192699    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d46e2f0-1866-4393-891a-9967cc336e1b-plugins-config-volume\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:00:50.192785 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:50.192727    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x84vq\" (UniqueName: \"kubernetes.io/projected/7d46e2f0-1866-4393-891a-9967cc336e1b-kube-api-access-x84vq\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:00:50.192785 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:50.192738    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7c7hx\" (UniqueName: \"kubernetes.io/projected/ffba00fa-3bac-4e8b-98fc-aff284f2b010-kube-api-access-7c7hx\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:00:50.482964 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:50.482868    2560 generic.go:356] "Generic (PLEG): container finished" podID="ffba00fa-3bac-4e8b-98fc-aff284f2b010" containerID="4eae57ca1c871e8a4c96fffd34717ea968ea0f264899f74f7555ef266b307b93" exitCode=0
Sep 17 02:00:50.482964 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:50.482920    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-4a1f5690-6cdd4768b-6prs7"
Sep 17 02:00:50.482964 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:50.482953    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-4a1f5690-6cdd4768b-6prs7" event={"ID":"ffba00fa-3bac-4e8b-98fc-aff284f2b010","Type":"ContainerDied","Data":"4eae57ca1c871e8a4c96fffd34717ea968ea0f264899f74f7555ef266b307b93"}
Sep 17 02:00:50.483231 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:50.483006    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-4a1f5690-6cdd4768b-6prs7" event={"ID":"ffba00fa-3bac-4e8b-98fc-aff284f2b010","Type":"ContainerDied","Data":"a6df08ad81a71f628ba2a998a5d3e26ef0cc2f7aed687cc5571aa408ef308df9"}
Sep 17 02:00:50.483231 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:50.483028    2560 scope.go:117] "RemoveContainer" containerID="4eae57ca1c871e8a4c96fffd34717ea968ea0f264899f74f7555ef266b307b93"
Sep 17 02:00:50.484586 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:50.484557    2560 generic.go:356] "Generic (PLEG): container finished" podID="7d46e2f0-1866-4393-891a-9967cc336e1b" containerID="94a9d3ff090375f26aaaec9ed63bfd02d2f2465912eb30c5e7ef142e4a6401c8" exitCode=0
Sep 17 02:00:50.484688 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:50.484589    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-4a1f5690-6fc8b7f569-lrpdm"
Sep 17 02:00:50.484688 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:50.484632    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-4a1f5690-6fc8b7f569-lrpdm" event={"ID":"7d46e2f0-1866-4393-891a-9967cc336e1b","Type":"ContainerDied","Data":"94a9d3ff090375f26aaaec9ed63bfd02d2f2465912eb30c5e7ef142e4a6401c8"}
Sep 17 02:00:50.484688 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:50.484673    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-4a1f5690-6fc8b7f569-lrpdm" event={"ID":"7d46e2f0-1866-4393-891a-9967cc336e1b","Type":"ContainerDied","Data":"72dd92a73f9d7ff025d7987be47bc87a56b0bdc6608d2dc2ce7bf445f4061c1f"}
Sep 17 02:00:50.492285 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:50.492240    2560 scope.go:117] "RemoveContainer" containerID="4eae57ca1c871e8a4c96fffd34717ea968ea0f264899f74f7555ef266b307b93"
Sep 17 02:00:50.492566 ip-10-0-143-95 kubenswrapper[2560]: E0917 02:00:50.492544    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4eae57ca1c871e8a4c96fffd34717ea968ea0f264899f74f7555ef266b307b93\": container with ID starting with 4eae57ca1c871e8a4c96fffd34717ea968ea0f264899f74f7555ef266b307b93 not found: ID does not exist" containerID="4eae57ca1c871e8a4c96fffd34717ea968ea0f264899f74f7555ef266b307b93"
Sep 17 02:00:50.492622 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:50.492576    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4eae57ca1c871e8a4c96fffd34717ea968ea0f264899f74f7555ef266b307b93"} err="failed to get container status \"4eae57ca1c871e8a4c96fffd34717ea968ea0f264899f74f7555ef266b307b93\": rpc error: code = NotFound desc = could not find container \"4eae57ca1c871e8a4c96fffd34717ea968ea0f264899f74f7555ef266b307b93\": container with ID starting with 4eae57ca1c871e8a4c96fffd34717ea968ea0f264899f74f7555ef266b307b93 not found: ID does not exist"
Sep 17 02:00:50.492622 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:50.492591    2560 scope.go:117] "RemoveContainer" containerID="94a9d3ff090375f26aaaec9ed63bfd02d2f2465912eb30c5e7ef142e4a6401c8"
Sep 17 02:00:50.500786 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:50.500770    2560 scope.go:117] "RemoveContainer" containerID="94a9d3ff090375f26aaaec9ed63bfd02d2f2465912eb30c5e7ef142e4a6401c8"
Sep 17 02:00:50.501087 ip-10-0-143-95 kubenswrapper[2560]: E0917 02:00:50.501068    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94a9d3ff090375f26aaaec9ed63bfd02d2f2465912eb30c5e7ef142e4a6401c8\": container with ID starting with 94a9d3ff090375f26aaaec9ed63bfd02d2f2465912eb30c5e7ef142e4a6401c8 not found: ID does not exist" containerID="94a9d3ff090375f26aaaec9ed63bfd02d2f2465912eb30c5e7ef142e4a6401c8"
Sep 17 02:00:50.501136 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:50.501095    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94a9d3ff090375f26aaaec9ed63bfd02d2f2465912eb30c5e7ef142e4a6401c8"} err="failed to get container status \"94a9d3ff090375f26aaaec9ed63bfd02d2f2465912eb30c5e7ef142e4a6401c8\": rpc error: code = NotFound desc = could not find container \"94a9d3ff090375f26aaaec9ed63bfd02d2f2465912eb30c5e7ef142e4a6401c8\": container with ID starting with 94a9d3ff090375f26aaaec9ed63bfd02d2f2465912eb30c5e7ef142e4a6401c8 not found: ID does not exist"
Sep 17 02:00:50.501809 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:50.501792    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-4a1f5690-6fc8b7f569-lrpdm"]
Sep 17 02:00:50.508052 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:50.508029    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-4a1f5690-6fc8b7f569-lrpdm"]
Sep 17 02:00:50.519333 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:50.519311    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-4a1f5690-6cdd4768b-6prs7"]
Sep 17 02:00:50.524567 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:50.524549    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-4a1f5690-6cdd4768b-6prs7"]
Sep 17 02:00:52.358851 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:52.358820    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d46e2f0-1866-4393-891a-9967cc336e1b" path="/var/lib/kubelet/pods/7d46e2f0-1866-4393-891a-9967cc336e1b/volumes"
Sep 17 02:00:52.359275 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:52.359209    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffba00fa-3bac-4e8b-98fc-aff284f2b010" path="/var/lib/kubelet/pods/ffba00fa-3bac-4e8b-98fc-aff284f2b010/volumes"
Sep 17 02:00:57.469199 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:00:57.469168    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-67a23a-5747bc7574-tbrz2"
Sep 17 02:01:08.011580 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:08.011549    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq"]
Sep 17 02:01:08.012529 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:08.012506    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d46e2f0-1866-4393-891a-9967cc336e1b" containerName="payload-processing"
Sep 17 02:01:08.012685 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:08.012670    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d46e2f0-1866-4393-891a-9967cc336e1b" containerName="payload-processing"
Sep 17 02:01:08.012768 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:08.012743    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffba00fa-3bac-4e8b-98fc-aff284f2b010" containerName="payload-pre-processing"
Sep 17 02:01:08.012831 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:08.012769    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffba00fa-3bac-4e8b-98fc-aff284f2b010" containerName="payload-pre-processing"
Sep 17 02:01:08.012922 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:08.012905    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffba00fa-3bac-4e8b-98fc-aff284f2b010" containerName="payload-pre-processing"
Sep 17 02:01:08.012980 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:08.012923    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d46e2f0-1866-4393-891a-9967cc336e1b" containerName="payload-processing"
Sep 17 02:01:08.016322 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:08.016302    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq"
Sep 17 02:01:08.018189 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:08.018171    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-f03337-openshift-default-dockercfg-tj5gl\""
Sep 17 02:01:08.026350 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:08.026324    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq"]
Sep 17 02:01:08.075852 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:08.075810    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88eb986b-b765-4423-a2b2-2882024b91be-istio-token\") pod \"e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq\" (UID: \"88eb986b-b765-4423-a2b2-2882024b91be\") " pod="openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq"
Sep 17 02:01:08.076197 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:08.076170    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8ks8\" (UniqueName: \"kubernetes.io/projected/88eb986b-b765-4423-a2b2-2882024b91be-kube-api-access-z8ks8\") pod \"e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq\" (UID: \"88eb986b-b765-4423-a2b2-2882024b91be\") " pod="openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq"
Sep 17 02:01:08.076397 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:08.076379    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88eb986b-b765-4423-a2b2-2882024b91be-istio-podinfo\") pod \"e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq\" (UID: \"88eb986b-b765-4423-a2b2-2882024b91be\") " pod="openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq"
Sep 17 02:01:08.076533 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:08.076518    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88eb986b-b765-4423-a2b2-2882024b91be-workload-socket\") pod \"e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq\" (UID: \"88eb986b-b765-4423-a2b2-2882024b91be\") " pod="openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq"
Sep 17 02:01:08.076653 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:08.076637    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88eb986b-b765-4423-a2b2-2882024b91be-istio-data\") pod \"e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq\" (UID: \"88eb986b-b765-4423-a2b2-2882024b91be\") " pod="openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq"
Sep 17 02:01:08.076757 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:08.076744    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88eb986b-b765-4423-a2b2-2882024b91be-workload-certs\") pod \"e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq\" (UID: \"88eb986b-b765-4423-a2b2-2882024b91be\") " pod="openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq"
Sep 17 02:01:08.076853 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:08.076840    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88eb986b-b765-4423-a2b2-2882024b91be-istiod-ca-cert\") pod \"e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq\" (UID: \"88eb986b-b765-4423-a2b2-2882024b91be\") " pod="openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq"
Sep 17 02:01:08.076990 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:08.076959    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88eb986b-b765-4423-a2b2-2882024b91be-credential-socket\") pod \"e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq\" (UID: \"88eb986b-b765-4423-a2b2-2882024b91be\") " pod="openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq"
Sep 17 02:01:08.077106 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:08.077090    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88eb986b-b765-4423-a2b2-2882024b91be-istio-envoy\") pod \"e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq\" (UID: \"88eb986b-b765-4423-a2b2-2882024b91be\") " pod="openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq"
Sep 17 02:01:08.178306 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:08.178257    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8ks8\" (UniqueName: \"kubernetes.io/projected/88eb986b-b765-4423-a2b2-2882024b91be-kube-api-access-z8ks8\") pod \"e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq\" (UID: \"88eb986b-b765-4423-a2b2-2882024b91be\") " pod="openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq"
Sep 17 02:01:08.178506 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:08.178338    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88eb986b-b765-4423-a2b2-2882024b91be-istio-podinfo\") pod \"e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq\" (UID: \"88eb986b-b765-4423-a2b2-2882024b91be\") " pod="openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq"
Sep 17 02:01:08.178506 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:08.178380    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88eb986b-b765-4423-a2b2-2882024b91be-workload-socket\") pod \"e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq\" (UID: \"88eb986b-b765-4423-a2b2-2882024b91be\") " pod="openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq"
Sep 17 02:01:08.178506 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:08.178409    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88eb986b-b765-4423-a2b2-2882024b91be-istio-data\") pod \"e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq\" (UID: \"88eb986b-b765-4423-a2b2-2882024b91be\") " pod="openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq"
Sep 17 02:01:08.179602 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:08.178439    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88eb986b-b765-4423-a2b2-2882024b91be-workload-certs\") pod \"e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq\" (UID: \"88eb986b-b765-4423-a2b2-2882024b91be\") " pod="openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq"
Sep 17 02:01:08.179602 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:08.179003    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88eb986b-b765-4423-a2b2-2882024b91be-istiod-ca-cert\") pod \"e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq\" (UID: \"88eb986b-b765-4423-a2b2-2882024b91be\") " pod="openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq"
Sep 17 02:01:08.179602 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:08.179038    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88eb986b-b765-4423-a2b2-2882024b91be-istio-data\") pod \"e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq\" (UID: \"88eb986b-b765-4423-a2b2-2882024b91be\") " pod="openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq"
Sep 17 02:01:08.179602 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:08.178938    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88eb986b-b765-4423-a2b2-2882024b91be-workload-socket\") pod \"e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq\" (UID: \"88eb986b-b765-4423-a2b2-2882024b91be\") " pod="openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq"
Sep 17 02:01:08.179602 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:08.179108    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88eb986b-b765-4423-a2b2-2882024b91be-workload-certs\") pod \"e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq\" (UID: \"88eb986b-b765-4423-a2b2-2882024b91be\") " pod="openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq"
Sep 17 02:01:08.179602 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:08.179047    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88eb986b-b765-4423-a2b2-2882024b91be-credential-socket\") pod \"e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq\" (UID: \"88eb986b-b765-4423-a2b2-2882024b91be\") " pod="openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq"
Sep 17 02:01:08.179602 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:08.179158    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88eb986b-b765-4423-a2b2-2882024b91be-istio-envoy\") pod \"e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq\" (UID: \"88eb986b-b765-4423-a2b2-2882024b91be\") " pod="openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq"
Sep 17 02:01:08.179602 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:08.179214    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88eb986b-b765-4423-a2b2-2882024b91be-istio-token\") pod \"e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq\" (UID: \"88eb986b-b765-4423-a2b2-2882024b91be\") " pod="openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq"
Sep 17 02:01:08.179602 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:08.179311    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88eb986b-b765-4423-a2b2-2882024b91be-credential-socket\") pod \"e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq\" (UID: \"88eb986b-b765-4423-a2b2-2882024b91be\") " pod="openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq"
Sep 17 02:01:08.180145 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:08.179758    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88eb986b-b765-4423-a2b2-2882024b91be-istiod-ca-cert\") pod \"e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq\" (UID: \"88eb986b-b765-4423-a2b2-2882024b91be\") " pod="openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq"
Sep 17 02:01:08.185765 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:08.185735    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88eb986b-b765-4423-a2b2-2882024b91be-istio-podinfo\") pod \"e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq\" (UID: \"88eb986b-b765-4423-a2b2-2882024b91be\") " pod="openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq"
Sep 17 02:01:08.185896 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:08.185739    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88eb986b-b765-4423-a2b2-2882024b91be-istio-envoy\") pod \"e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq\" (UID: \"88eb986b-b765-4423-a2b2-2882024b91be\") " pod="openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq"
Sep 17 02:01:08.187282 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:08.187225    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8ks8\" (UniqueName: \"kubernetes.io/projected/88eb986b-b765-4423-a2b2-2882024b91be-kube-api-access-z8ks8\") pod \"e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq\" (UID: \"88eb986b-b765-4423-a2b2-2882024b91be\") " pod="openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq"
Sep 17 02:01:08.187578 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:08.187554    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88eb986b-b765-4423-a2b2-2882024b91be-istio-token\") pod \"e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq\" (UID: \"88eb986b-b765-4423-a2b2-2882024b91be\") " pod="openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq"
Sep 17 02:01:08.328395 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:08.328362    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq"
Sep 17 02:01:08.626602 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:08.626505    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq"]
Sep 17 02:01:08.629847 ip-10-0-143-95 kubenswrapper[2560]: W0917 02:01:08.629815    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88eb986b_b765_4423_a2b2_2882024b91be.slice/crio-94ebbda8c2f0bd1d3c0992cc71f0ae0d4f2cde0fff92a82a227a5bae7f085c5a WatchSource:0}: Error finding container 94ebbda8c2f0bd1d3c0992cc71f0ae0d4f2cde0fff92a82a227a5bae7f085c5a: Status 404 returned error can't find the container with id 94ebbda8c2f0bd1d3c0992cc71f0ae0d4f2cde0fff92a82a227a5bae7f085c5a
Sep 17 02:01:08.632145 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:08.632113    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 02:01:08.632274 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:08.632184    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 02:01:08.632274 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:08.632214    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 02:01:09.595521 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:09.595484    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq" event={"ID":"88eb986b-b765-4423-a2b2-2882024b91be","Type":"ContainerStarted","Data":"eea635cf2edf53c4100539a5ba533b7eb83470f3b993118fe2f129b3c42af9be"}
Sep 17 02:01:09.595894 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:09.595550    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq" event={"ID":"88eb986b-b765-4423-a2b2-2882024b91be","Type":"ContainerStarted","Data":"94ebbda8c2f0bd1d3c0992cc71f0ae0d4f2cde0fff92a82a227a5bae7f085c5a"}
Sep 17 02:01:09.623309 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:09.623165    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq" podStartSLOduration=2.623139595 podStartE2EDuration="2.623139595s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 02:01:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:01:09.620972347 +0000 UTC m=+1427.870949661" watchObservedRunningTime="2026-09-17 02:01:09.623139595 +0000 UTC m=+1427.873116909"
Sep 17 02:01:10.329300 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:10.329241    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq"
Sep 17 02:01:10.335148 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:10.335117    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq"
Sep 17 02:01:10.601486 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:10.601393    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq"
Sep 17 02:01:10.602690 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:10.602659    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq"
Sep 17 02:01:12.465416 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:12.465378    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 17 02:01:12.469818 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:12.465462    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr" podUID="f6673a56-cae4-406a-b3d8-18f42a987f3d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 17 02:01:12.613467 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:12.613438    2560 generic.go:356] "Generic (PLEG): container finished" podID="f6673a56-cae4-406a-b3d8-18f42a987f3d" containerID="af3c42f44d5a855eaee14ac31e4a4b500b4f0acd7f9a544f1b6b99f892c3bd2a" exitCode=0
Sep 17 02:01:12.613641 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:12.613509    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr" event={"ID":"f6673a56-cae4-406a-b3d8-18f42a987f3d","Type":"ContainerDied","Data":"af3c42f44d5a855eaee14ac31e4a4b500b4f0acd7f9a544f1b6b99f892c3bd2a"}
Sep 17 02:01:12.613932 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:12.613916    2560 scope.go:117] "RemoveContainer" containerID="af3c42f44d5a855eaee14ac31e4a4b500b4f0acd7f9a544f1b6b99f892c3bd2a"
Sep 17 02:01:12.615032 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:12.614994    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 02:01:12.615109 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:12.615095    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 02:01:12.615148 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:12.615131    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 02:01:13.621374 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:13.621339    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr" event={"ID":"f6673a56-cae4-406a-b3d8-18f42a987f3d","Type":"ContainerStarted","Data":"fe8ab8cd8b484d037ddacac483d34cd1a4d0821cd7b268396bc3df82a2332899"}
Sep 17 02:01:14.376842 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:14.376799    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr"
Sep 17 02:01:14.377050 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:14.376940    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 17 02:01:14.377050 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:14.376988    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr" podUID="f6673a56-cae4-406a-b3d8-18f42a987f3d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 17 02:01:15.197089 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:15.197048    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-f03337-54f5994d47-dshlh"]
Sep 17 02:01:15.200758 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:15.200740    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f03337-54f5994d47-dshlh"
Sep 17 02:01:15.202526 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:15.202497    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-f03337\""
Sep 17 02:01:15.202663 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:15.202555    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-f03337-dockercfg-zgnd5\""
Sep 17 02:01:15.210617 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:15.210591    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-f03337-54f5994d47-dshlh"]
Sep 17 02:01:15.354133 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:15.354098    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0db7ef60-8b80-4284-b3d9-150ae557ca03-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-f03337-54f5994d47-dshlh\" (UID: \"0db7ef60-8b80-4284-b3d9-150ae557ca03\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f03337-54f5994d47-dshlh"
Sep 17 02:01:15.354392 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:15.354173    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkpjr\" (UniqueName: \"kubernetes.io/projected/0db7ef60-8b80-4284-b3d9-150ae557ca03-kube-api-access-hkpjr\") pod \"payload-processing-e2e-shared-b-w2-f03337-54f5994d47-dshlh\" (UID: \"0db7ef60-8b80-4284-b3d9-150ae557ca03\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f03337-54f5994d47-dshlh"
Sep 17 02:01:15.380313 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:15.377611    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 17 02:01:15.380313 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:15.377674    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr" podUID="f6673a56-cae4-406a-b3d8-18f42a987f3d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 17 02:01:15.455312 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:15.455183    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkpjr\" (UniqueName: \"kubernetes.io/projected/0db7ef60-8b80-4284-b3d9-150ae557ca03-kube-api-access-hkpjr\") pod \"payload-processing-e2e-shared-b-w2-f03337-54f5994d47-dshlh\" (UID: \"0db7ef60-8b80-4284-b3d9-150ae557ca03\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f03337-54f5994d47-dshlh"
Sep 17 02:01:15.455781 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:15.455751    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0db7ef60-8b80-4284-b3d9-150ae557ca03-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-f03337-54f5994d47-dshlh\" (UID: \"0db7ef60-8b80-4284-b3d9-150ae557ca03\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f03337-54f5994d47-dshlh"
Sep 17 02:01:15.456770 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:15.456737    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0db7ef60-8b80-4284-b3d9-150ae557ca03-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-f03337-54f5994d47-dshlh\" (UID: \"0db7ef60-8b80-4284-b3d9-150ae557ca03\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f03337-54f5994d47-dshlh"
Sep 17 02:01:15.464767 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:15.464737    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkpjr\" (UniqueName: \"kubernetes.io/projected/0db7ef60-8b80-4284-b3d9-150ae557ca03-kube-api-access-hkpjr\") pod \"payload-processing-e2e-shared-b-w2-f03337-54f5994d47-dshlh\" (UID: \"0db7ef60-8b80-4284-b3d9-150ae557ca03\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f03337-54f5994d47-dshlh"
Sep 17 02:01:15.512383 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:15.512344    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f03337-54f5994d47-dshlh"
Sep 17 02:01:15.814466 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:15.814440    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-f03337-54f5994d47-dshlh"]
Sep 17 02:01:15.816552 ip-10-0-143-95 kubenswrapper[2560]: W0917 02:01:15.816523    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0db7ef60_8b80_4284_b3d9_150ae557ca03.slice/crio-04bbc40747f585f1bae68b528a0acca1bf0586b46092343aa70342e1701b87a5 WatchSource:0}: Error finding container 04bbc40747f585f1bae68b528a0acca1bf0586b46092343aa70342e1701b87a5: Status 404 returned error can't find the container with id 04bbc40747f585f1bae68b528a0acca1bf0586b46092343aa70342e1701b87a5
Sep 17 02:01:16.377023 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:16.376984    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 17 02:01:16.377630 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:16.377593    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr" podUID="f6673a56-cae4-406a-b3d8-18f42a987f3d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 17 02:01:16.639617 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:16.639527    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f03337-54f5994d47-dshlh" event={"ID":"0db7ef60-8b80-4284-b3d9-150ae557ca03","Type":"ContainerStarted","Data":"1bb356707ec8a7ba65af9e7e69d4c59153750484be6927dee62f236ca0b93f99"}
Sep 17 02:01:16.639617 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:16.639578    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f03337-54f5994d47-dshlh" event={"ID":"0db7ef60-8b80-4284-b3d9-150ae557ca03","Type":"ContainerStarted","Data":"04bbc40747f585f1bae68b528a0acca1bf0586b46092343aa70342e1701b87a5"}
Sep 17 02:01:16.639851 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:16.639617    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f03337-54f5994d47-dshlh"
Sep 17 02:01:16.656581 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:16.656518    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f03337-54f5994d47-dshlh" podStartSLOduration=1.656497065 podStartE2EDuration="1.656497065s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 02:01:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:01:16.654006768 +0000 UTC m=+1434.903984082" watchObservedRunningTime="2026-09-17 02:01:16.656497065 +0000 UTC m=+1434.906474379"
Sep 17 02:01:17.377002 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:17.376961    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 17 02:01:17.377318 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:17.377283    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr" podUID="f6673a56-cae4-406a-b3d8-18f42a987f3d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 17 02:01:18.377765 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:18.377723    2560 patch_prober.go:28] interesting pod/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 17 02:01:18.378294 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:18.377795    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr" podUID="f6673a56-cae4-406a-b3d8-18f42a987f3d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 17 02:01:19.380133 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:19.380102    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr"
Sep 17 02:01:19.380545 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:19.380484    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr"
Sep 17 02:01:19.381167 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:19.381152    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr"
Sep 17 02:01:20.043453 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:20.043414    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w1-c5da3b-54989b8b6c-lkhqx"]
Sep 17 02:01:20.047118 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:20.047101    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-c5da3b-54989b8b6c-lkhqx"
Sep 17 02:01:20.048936 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:20.048911    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w1-c5da3b-dockercfg-shj92\""
Sep 17 02:01:20.048936 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:20.048921    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w1-c5da3b\""
Sep 17 02:01:20.060177 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:20.060147    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w1-c5da3b-54989b8b6c-lkhqx"]
Sep 17 02:01:20.219492 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:20.219446    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp5lb\" (UniqueName: \"kubernetes.io/projected/0fda824e-ac2f-4972-9790-e66b8c04412a-kube-api-access-tp5lb\") pod \"payload-processing-e2e-shared-a-w1-c5da3b-54989b8b6c-lkhqx\" (UID: \"0fda824e-ac2f-4972-9790-e66b8c04412a\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w1-c5da3b-54989b8b6c-lkhqx"
Sep 17 02:01:20.219663 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:20.219567    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0fda824e-ac2f-4972-9790-e66b8c04412a-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w1-c5da3b-54989b8b6c-lkhqx\" (UID: \"0fda824e-ac2f-4972-9790-e66b8c04412a\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w1-c5da3b-54989b8b6c-lkhqx"
Sep 17 02:01:20.321165 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:20.321132    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tp5lb\" (UniqueName: \"kubernetes.io/projected/0fda824e-ac2f-4972-9790-e66b8c04412a-kube-api-access-tp5lb\") pod \"payload-processing-e2e-shared-a-w1-c5da3b-54989b8b6c-lkhqx\" (UID: \"0fda824e-ac2f-4972-9790-e66b8c04412a\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w1-c5da3b-54989b8b6c-lkhqx"
Sep 17 02:01:20.321368 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:20.321200    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0fda824e-ac2f-4972-9790-e66b8c04412a-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w1-c5da3b-54989b8b6c-lkhqx\" (UID: \"0fda824e-ac2f-4972-9790-e66b8c04412a\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w1-c5da3b-54989b8b6c-lkhqx"
Sep 17 02:01:20.321914 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:20.321894    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0fda824e-ac2f-4972-9790-e66b8c04412a-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w1-c5da3b-54989b8b6c-lkhqx\" (UID: \"0fda824e-ac2f-4972-9790-e66b8c04412a\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w1-c5da3b-54989b8b6c-lkhqx"
Sep 17 02:01:20.329834 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:20.329804    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp5lb\" (UniqueName: \"kubernetes.io/projected/0fda824e-ac2f-4972-9790-e66b8c04412a-kube-api-access-tp5lb\") pod \"payload-processing-e2e-shared-a-w1-c5da3b-54989b8b6c-lkhqx\" (UID: \"0fda824e-ac2f-4972-9790-e66b8c04412a\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w1-c5da3b-54989b8b6c-lkhqx"
Sep 17 02:01:20.357986 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:20.357938    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-c5da3b-54989b8b6c-lkhqx"
Sep 17 02:01:20.631197 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:20.631147    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w1-c5da3b-54989b8b6c-lkhqx"]
Sep 17 02:01:20.633590 ip-10-0-143-95 kubenswrapper[2560]: W0917 02:01:20.633559    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fda824e_ac2f_4972_9790_e66b8c04412a.slice/crio-3db65f9391c69fd6be0f77e259d6cec8e9885f23c8d250cca31ca5ca67b5e0ea WatchSource:0}: Error finding container 3db65f9391c69fd6be0f77e259d6cec8e9885f23c8d250cca31ca5ca67b5e0ea: Status 404 returned error can't find the container with id 3db65f9391c69fd6be0f77e259d6cec8e9885f23c8d250cca31ca5ca67b5e0ea
Sep 17 02:01:20.661590 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:20.661564    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-c5da3b-54989b8b6c-lkhqx" event={"ID":"0fda824e-ac2f-4972-9790-e66b8c04412a","Type":"ContainerStarted","Data":"3db65f9391c69fd6be0f77e259d6cec8e9885f23c8d250cca31ca5ca67b5e0ea"}
Sep 17 02:01:21.672172 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:21.672127    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-c5da3b-54989b8b6c-lkhqx" event={"ID":"0fda824e-ac2f-4972-9790-e66b8c04412a","Type":"ContainerStarted","Data":"4143a3d8820e0acf08a9c8797a8d42feb6393ecb0e1c5c828aa13efe299999f7"}
Sep 17 02:01:21.672829 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:21.672781    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-c5da3b-54989b8b6c-lkhqx"
Sep 17 02:01:21.690297 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:21.690226    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-c5da3b-54989b8b6c-lkhqx" podStartSLOduration=1.690208477 podStartE2EDuration="1.690208477s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 02:01:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:01:21.688101813 +0000 UTC m=+1439.938079127" watchObservedRunningTime="2026-09-17 02:01:21.690208477 +0000 UTC m=+1439.940185790"
Sep 17 02:01:27.647960 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:27.647925    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f03337-54f5994d47-dshlh"
Sep 17 02:01:30.726604 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:30.726568    2560 generic.go:356] "Generic (PLEG): container finished" podID="88eb986b-b765-4423-a2b2-2882024b91be" containerID="eea635cf2edf53c4100539a5ba533b7eb83470f3b993118fe2f129b3c42af9be" exitCode=0
Sep 17 02:01:30.727138 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:30.726645    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq" event={"ID":"88eb986b-b765-4423-a2b2-2882024b91be","Type":"ContainerDied","Data":"eea635cf2edf53c4100539a5ba533b7eb83470f3b993118fe2f129b3c42af9be"}
Sep 17 02:01:30.727205 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:30.727185    2560 scope.go:117] "RemoveContainer" containerID="eea635cf2edf53c4100539a5ba533b7eb83470f3b993118fe2f129b3c42af9be"
Sep 17 02:01:30.728399 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:30.728369    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 02:01:30.728502 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:30.728451    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 02:01:30.728564 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:30.728497    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 02:01:31.734622 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:31.734574    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq" event={"ID":"88eb986b-b765-4423-a2b2-2882024b91be","Type":"ContainerStarted","Data":"dbb3ea814ceeac42c38e006515a6ee52ee493747c42ab81b685217ffa474c291"}
Sep 17 02:01:32.328763 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:32.328730    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq"
Sep 17 02:01:32.328959 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:32.328923    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 17 02:01:32.329008 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:32.328987    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq" podUID="88eb986b-b765-4423-a2b2-2882024b91be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 17 02:01:33.329615 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:33.329579    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 17 02:01:33.330015 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:33.329633    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq" podUID="88eb986b-b765-4423-a2b2-2882024b91be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 17 02:01:33.689270 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:33.689177    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-c5da3b-54989b8b6c-lkhqx"
Sep 17 02:01:34.329080 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:34.329049    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 17 02:01:34.329271 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:34.329102    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq" podUID="88eb986b-b765-4423-a2b2-2882024b91be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 17 02:01:35.329053 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:35.329018    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 17 02:01:35.329474 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:35.329071    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq" podUID="88eb986b-b765-4423-a2b2-2882024b91be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 17 02:01:36.329219 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:36.329182    2560 patch_prober.go:28] interesting pod/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 17 02:01:36.329653 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:36.329319    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq" podUID="88eb986b-b765-4423-a2b2-2882024b91be" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 17 02:01:37.333467 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:37.333431    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq"
Sep 17 02:01:37.333851 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:37.333747    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq"
Sep 17 02:01:37.334415 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:01:37.334394    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq"
Sep 17 02:02:33.508909 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:33.508874    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l"]
Sep 17 02:02:33.513171 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:33.513142    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l"
Sep 17 02:02:33.516628 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:33.516605    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-4e1c2c18-openshift-default-dockercfg-8qbzm\""
Sep 17 02:02:33.524634 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:33.524611    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l"]
Sep 17 02:02:33.588912 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:33.588870    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5f6z5\" (UniqueName: \"kubernetes.io/projected/a7954079-df26-4024-a536-c695b4a358f1-kube-api-access-5f6z5\") pod \"e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l\" (UID: \"a7954079-df26-4024-a536-c695b4a358f1\") " pod="openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l"
Sep 17 02:02:33.588912 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:33.588915    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7954079-df26-4024-a536-c695b4a358f1-credential-socket\") pod \"e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l\" (UID: \"a7954079-df26-4024-a536-c695b4a358f1\") " pod="openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l"
Sep 17 02:02:33.589138 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:33.588945    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7954079-df26-4024-a536-c695b4a358f1-istio-token\") pod \"e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l\" (UID: \"a7954079-df26-4024-a536-c695b4a358f1\") " pod="openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l"
Sep 17 02:02:33.589138 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:33.588962    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7954079-df26-4024-a536-c695b4a358f1-istio-podinfo\") pod \"e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l\" (UID: \"a7954079-df26-4024-a536-c695b4a358f1\") " pod="openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l"
Sep 17 02:02:33.589138 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:33.589040    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7954079-df26-4024-a536-c695b4a358f1-istio-envoy\") pod \"e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l\" (UID: \"a7954079-df26-4024-a536-c695b4a358f1\") " pod="openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l"
Sep 17 02:02:33.589356 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:33.589296    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7954079-df26-4024-a536-c695b4a358f1-workload-certs\") pod \"e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l\" (UID: \"a7954079-df26-4024-a536-c695b4a358f1\") " pod="openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l"
Sep 17 02:02:33.589413 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:33.589378    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7954079-df26-4024-a536-c695b4a358f1-istio-data\") pod \"e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l\" (UID: \"a7954079-df26-4024-a536-c695b4a358f1\") " pod="openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l"
Sep 17 02:02:33.589472 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:33.589440    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7954079-df26-4024-a536-c695b4a358f1-workload-socket\") pod \"e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l\" (UID: \"a7954079-df26-4024-a536-c695b4a358f1\") " pod="openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l"
Sep 17 02:02:33.589525 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:33.589495    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7954079-df26-4024-a536-c695b4a358f1-istiod-ca-cert\") pod \"e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l\" (UID: \"a7954079-df26-4024-a536-c695b4a358f1\") " pod="openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l"
Sep 17 02:02:33.690858 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:33.690826    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7954079-df26-4024-a536-c695b4a358f1-workload-certs\") pod \"e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l\" (UID: \"a7954079-df26-4024-a536-c695b4a358f1\") " pod="openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l"
Sep 17 02:02:33.691058 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:33.690877    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7954079-df26-4024-a536-c695b4a358f1-istio-data\") pod \"e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l\" (UID: \"a7954079-df26-4024-a536-c695b4a358f1\") " pod="openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l"
Sep 17 02:02:33.691058 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:33.690901    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7954079-df26-4024-a536-c695b4a358f1-workload-socket\") pod \"e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l\" (UID: \"a7954079-df26-4024-a536-c695b4a358f1\") " pod="openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l"
Sep 17 02:02:33.691058 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:33.690933    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7954079-df26-4024-a536-c695b4a358f1-istiod-ca-cert\") pod \"e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l\" (UID: \"a7954079-df26-4024-a536-c695b4a358f1\") " pod="openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l"
Sep 17 02:02:33.691058 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:33.690977    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5f6z5\" (UniqueName: \"kubernetes.io/projected/a7954079-df26-4024-a536-c695b4a358f1-kube-api-access-5f6z5\") pod \"e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l\" (UID: \"a7954079-df26-4024-a536-c695b4a358f1\") " pod="openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l"
Sep 17 02:02:33.691058 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:33.690999    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7954079-df26-4024-a536-c695b4a358f1-credential-socket\") pod \"e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l\" (UID: \"a7954079-df26-4024-a536-c695b4a358f1\") " pod="openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l"
Sep 17 02:02:33.691385 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:33.691086    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7954079-df26-4024-a536-c695b4a358f1-istio-token\") pod \"e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l\" (UID: \"a7954079-df26-4024-a536-c695b4a358f1\") " pod="openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l"
Sep 17 02:02:33.691385 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:33.691132    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7954079-df26-4024-a536-c695b4a358f1-istio-podinfo\") pod \"e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l\" (UID: \"a7954079-df26-4024-a536-c695b4a358f1\") " pod="openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l"
Sep 17 02:02:33.691385 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:33.691171    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7954079-df26-4024-a536-c695b4a358f1-istio-envoy\") pod \"e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l\" (UID: \"a7954079-df26-4024-a536-c695b4a358f1\") " pod="openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l"
Sep 17 02:02:33.691385 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:33.691303    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7954079-df26-4024-a536-c695b4a358f1-workload-certs\") pod \"e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l\" (UID: \"a7954079-df26-4024-a536-c695b4a358f1\") " pod="openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l"
Sep 17 02:02:33.691385 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:33.691358    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7954079-df26-4024-a536-c695b4a358f1-istio-data\") pod \"e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l\" (UID: \"a7954079-df26-4024-a536-c695b4a358f1\") " pod="openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l"
Sep 17 02:02:33.691385 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:33.691370    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7954079-df26-4024-a536-c695b4a358f1-workload-socket\") pod \"e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l\" (UID: \"a7954079-df26-4024-a536-c695b4a358f1\") " pod="openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l"
Sep 17 02:02:33.691817 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:33.691799    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7954079-df26-4024-a536-c695b4a358f1-credential-socket\") pod \"e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l\" (UID: \"a7954079-df26-4024-a536-c695b4a358f1\") " pod="openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l"
Sep 17 02:02:33.691970 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:33.691950    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7954079-df26-4024-a536-c695b4a358f1-istiod-ca-cert\") pod \"e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l\" (UID: \"a7954079-df26-4024-a536-c695b4a358f1\") " pod="openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l"
Sep 17 02:02:33.693627 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:33.693601    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7954079-df26-4024-a536-c695b4a358f1-istio-envoy\") pod \"e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l\" (UID: \"a7954079-df26-4024-a536-c695b4a358f1\") " pod="openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l"
Sep 17 02:02:33.693831 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:33.693806    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7954079-df26-4024-a536-c695b4a358f1-istio-podinfo\") pod \"e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l\" (UID: \"a7954079-df26-4024-a536-c695b4a358f1\") " pod="openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l"
Sep 17 02:02:33.699680 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:33.699656    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7954079-df26-4024-a536-c695b4a358f1-istio-token\") pod \"e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l\" (UID: \"a7954079-df26-4024-a536-c695b4a358f1\") " pod="openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l"
Sep 17 02:02:33.700079 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:33.700057    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5f6z5\" (UniqueName: \"kubernetes.io/projected/a7954079-df26-4024-a536-c695b4a358f1-kube-api-access-5f6z5\") pod \"e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l\" (UID: \"a7954079-df26-4024-a536-c695b4a358f1\") " pod="openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l"
Sep 17 02:02:33.824718 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:33.824682    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l"
Sep 17 02:02:34.100797 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:34.100763    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l"]
Sep 17 02:02:34.102006 ip-10-0-143-95 kubenswrapper[2560]: W0917 02:02:34.101980    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7954079_df26_4024_a536_c695b4a358f1.slice/crio-914632fbc096fc72799487d8762c3331b4dab6929e54befd8c1256c32ee35969 WatchSource:0}: Error finding container 914632fbc096fc72799487d8762c3331b4dab6929e54befd8c1256c32ee35969: Status 404 returned error can't find the container with id 914632fbc096fc72799487d8762c3331b4dab6929e54befd8c1256c32ee35969
Sep 17 02:02:34.104340 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:34.104307    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 02:02:34.104443 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:34.104368    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 02:02:34.104443 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:34.104394    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 02:02:35.069094 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:35.069057    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l" event={"ID":"a7954079-df26-4024-a536-c695b4a358f1","Type":"ContainerStarted","Data":"997b2ba2ee703d90d3beeaa91d03241671a8e158d21073c727ecf72e2aa1a74a"}
Sep 17 02:02:35.069523 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:35.069114    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l" event={"ID":"a7954079-df26-4024-a536-c695b4a358f1","Type":"ContainerStarted","Data":"914632fbc096fc72799487d8762c3331b4dab6929e54befd8c1256c32ee35969"}
Sep 17 02:02:35.087019 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:35.086972    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l" podStartSLOduration=2.086955674 podStartE2EDuration="2.086955674s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 02:02:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:02:35.085025795 +0000 UTC m=+1513.335003108" watchObservedRunningTime="2026-09-17 02:02:35.086955674 +0000 UTC m=+1513.336932986"
Sep 17 02:02:35.825302 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:35.825239    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l"
Sep 17 02:02:35.830513 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:35.830489    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l"
Sep 17 02:02:36.075549 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:36.075455    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l"
Sep 17 02:02:36.076492 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:36.076472    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l"
Sep 17 02:02:41.912454 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:41.912414    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-4e1c2c18-8b4fc54f8-hhzsh"]
Sep 17 02:02:41.916171 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:41.916148    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-4e1c2c18-8b4fc54f8-hhzsh"
Sep 17 02:02:41.918032 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:41.918002    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-4e1c2c18\""
Sep 17 02:02:41.918146 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:41.918110    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-4e1c2c18-dockercfg-2mkx2\""
Sep 17 02:02:41.925971 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:41.925947    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-4e1c2c18-8b4fc54f8-hhzsh"]
Sep 17 02:02:41.941300 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:41.941240    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-4e1c2c18-b99897db9-mxz5w"]
Sep 17 02:02:41.944738 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:41.944714    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-4e1c2c18-b99897db9-mxz5w"
Sep 17 02:02:41.954441 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:41.954412    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-4e1c2c18-b99897db9-mxz5w"]
Sep 17 02:02:41.977114 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:41.977079    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvqx7\" (UniqueName: \"kubernetes.io/projected/9dbf457d-7c89-4489-9235-0c1be3089b47-kube-api-access-jvqx7\") pod \"payload-pre-processing-e2e-mt-4e1c2c18-8b4fc54f8-hhzsh\" (UID: \"9dbf457d-7c89-4489-9235-0c1be3089b47\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-4e1c2c18-8b4fc54f8-hhzsh"
Sep 17 02:02:41.977300 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:41.977149    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9dbf457d-7c89-4489-9235-0c1be3089b47-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-4e1c2c18-8b4fc54f8-hhzsh\" (UID: \"9dbf457d-7c89-4489-9235-0c1be3089b47\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-4e1c2c18-8b4fc54f8-hhzsh"
Sep 17 02:02:42.077802 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:42.077766    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93aad484-0aab-460c-b970-28989efbb240-plugins-config-volume\") pod \"payload-processing-e2e-mt-4e1c2c18-b99897db9-mxz5w\" (UID: \"93aad484-0aab-460c-b970-28989efbb240\") " pod="openshift-ingress/payload-processing-e2e-mt-4e1c2c18-b99897db9-mxz5w"
Sep 17 02:02:42.077976 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:42.077841    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvqx7\" (UniqueName: \"kubernetes.io/projected/9dbf457d-7c89-4489-9235-0c1be3089b47-kube-api-access-jvqx7\") pod \"payload-pre-processing-e2e-mt-4e1c2c18-8b4fc54f8-hhzsh\" (UID: \"9dbf457d-7c89-4489-9235-0c1be3089b47\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-4e1c2c18-8b4fc54f8-hhzsh"
Sep 17 02:02:42.078049 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:42.077959    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9dbf457d-7c89-4489-9235-0c1be3089b47-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-4e1c2c18-8b4fc54f8-hhzsh\" (UID: \"9dbf457d-7c89-4489-9235-0c1be3089b47\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-4e1c2c18-8b4fc54f8-hhzsh"
Sep 17 02:02:42.078105 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:42.078068    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zd24\" (UniqueName: \"kubernetes.io/projected/93aad484-0aab-460c-b970-28989efbb240-kube-api-access-5zd24\") pod \"payload-processing-e2e-mt-4e1c2c18-b99897db9-mxz5w\" (UID: \"93aad484-0aab-460c-b970-28989efbb240\") " pod="openshift-ingress/payload-processing-e2e-mt-4e1c2c18-b99897db9-mxz5w"
Sep 17 02:02:42.078709 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:42.078687    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9dbf457d-7c89-4489-9235-0c1be3089b47-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-4e1c2c18-8b4fc54f8-hhzsh\" (UID: \"9dbf457d-7c89-4489-9235-0c1be3089b47\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-4e1c2c18-8b4fc54f8-hhzsh"
Sep 17 02:02:42.084946 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:42.084917    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvqx7\" (UniqueName: \"kubernetes.io/projected/9dbf457d-7c89-4489-9235-0c1be3089b47-kube-api-access-jvqx7\") pod \"payload-pre-processing-e2e-mt-4e1c2c18-8b4fc54f8-hhzsh\" (UID: \"9dbf457d-7c89-4489-9235-0c1be3089b47\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-4e1c2c18-8b4fc54f8-hhzsh"
Sep 17 02:02:42.178887 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:42.178783    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zd24\" (UniqueName: \"kubernetes.io/projected/93aad484-0aab-460c-b970-28989efbb240-kube-api-access-5zd24\") pod \"payload-processing-e2e-mt-4e1c2c18-b99897db9-mxz5w\" (UID: \"93aad484-0aab-460c-b970-28989efbb240\") " pod="openshift-ingress/payload-processing-e2e-mt-4e1c2c18-b99897db9-mxz5w"
Sep 17 02:02:42.178887 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:42.178852    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93aad484-0aab-460c-b970-28989efbb240-plugins-config-volume\") pod \"payload-processing-e2e-mt-4e1c2c18-b99897db9-mxz5w\" (UID: \"93aad484-0aab-460c-b970-28989efbb240\") " pod="openshift-ingress/payload-processing-e2e-mt-4e1c2c18-b99897db9-mxz5w"
Sep 17 02:02:42.179676 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:42.179655    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93aad484-0aab-460c-b970-28989efbb240-plugins-config-volume\") pod \"payload-processing-e2e-mt-4e1c2c18-b99897db9-mxz5w\" (UID: \"93aad484-0aab-460c-b970-28989efbb240\") " pod="openshift-ingress/payload-processing-e2e-mt-4e1c2c18-b99897db9-mxz5w"
Sep 17 02:02:42.186446 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:42.186424    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zd24\" (UniqueName: \"kubernetes.io/projected/93aad484-0aab-460c-b970-28989efbb240-kube-api-access-5zd24\") pod \"payload-processing-e2e-mt-4e1c2c18-b99897db9-mxz5w\" (UID: \"93aad484-0aab-460c-b970-28989efbb240\") " pod="openshift-ingress/payload-processing-e2e-mt-4e1c2c18-b99897db9-mxz5w"
Sep 17 02:02:42.229232 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:42.229192    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-4e1c2c18-8b4fc54f8-hhzsh"
Sep 17 02:02:42.256723 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:42.256687    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-4e1c2c18-b99897db9-mxz5w"
Sep 17 02:02:42.504692 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:42.504610    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-4e1c2c18-8b4fc54f8-hhzsh"]
Sep 17 02:02:42.507078 ip-10-0-143-95 kubenswrapper[2560]: W0917 02:02:42.507052    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dbf457d_7c89_4489_9235_0c1be3089b47.slice/crio-03e11ea7a1953b88821cab560c2fde031ea13a5e57ff64d8291f05a73fd6270f WatchSource:0}: Error finding container 03e11ea7a1953b88821cab560c2fde031ea13a5e57ff64d8291f05a73fd6270f: Status 404 returned error can't find the container with id 03e11ea7a1953b88821cab560c2fde031ea13a5e57ff64d8291f05a73fd6270f
Sep 17 02:02:42.538928 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:42.538900    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-4e1c2c18-b99897db9-mxz5w"]
Sep 17 02:02:42.540910 ip-10-0-143-95 kubenswrapper[2560]: W0917 02:02:42.540888    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93aad484_0aab_460c_b970_28989efbb240.slice/crio-b886b32761890e67e7fb93c609baa40a43113d05aa8f2fa5544a106ca021c323 WatchSource:0}: Error finding container b886b32761890e67e7fb93c609baa40a43113d05aa8f2fa5544a106ca021c323: Status 404 returned error can't find the container with id b886b32761890e67e7fb93c609baa40a43113d05aa8f2fa5544a106ca021c323
Sep 17 02:02:43.115983 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:43.115925    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-4e1c2c18-8b4fc54f8-hhzsh" event={"ID":"9dbf457d-7c89-4489-9235-0c1be3089b47","Type":"ContainerStarted","Data":"55e8f66cb1260b53de1db250feb7c7c265b4257044741f7fcccddeac821e2cf4"}
Sep 17 02:02:43.116478 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:43.116124    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-4e1c2c18-8b4fc54f8-hhzsh"
Sep 17 02:02:43.116478 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:43.116158    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-4e1c2c18-8b4fc54f8-hhzsh" event={"ID":"9dbf457d-7c89-4489-9235-0c1be3089b47","Type":"ContainerStarted","Data":"03e11ea7a1953b88821cab560c2fde031ea13a5e57ff64d8291f05a73fd6270f"}
Sep 17 02:02:43.117866 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:43.117828    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-4e1c2c18-b99897db9-mxz5w" event={"ID":"93aad484-0aab-460c-b970-28989efbb240","Type":"ContainerStarted","Data":"efb6fa439f912cd169092f19802ab0e10d7ac9ad5773144f5b32cbb69430cd18"}
Sep 17 02:02:43.118005 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:43.117894    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-4e1c2c18-b99897db9-mxz5w" event={"ID":"93aad484-0aab-460c-b970-28989efbb240","Type":"ContainerStarted","Data":"b886b32761890e67e7fb93c609baa40a43113d05aa8f2fa5544a106ca021c323"}
Sep 17 02:02:43.118005 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:43.117926    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-4e1c2c18-b99897db9-mxz5w"
Sep 17 02:02:43.135004 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:43.134944    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-4e1c2c18-8b4fc54f8-hhzsh" podStartSLOduration=2.13492405 podStartE2EDuration="2.13492405s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 02:02:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:02:43.1310748 +0000 UTC m=+1521.381052112" watchObservedRunningTime="2026-09-17 02:02:43.13492405 +0000 UTC m=+1521.384901366"
Sep 17 02:02:43.145742 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:43.145682    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-4e1c2c18-b99897db9-mxz5w" podStartSLOduration=2.145664043 podStartE2EDuration="2.145664043s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 02:02:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:02:43.145028379 +0000 UTC m=+1521.395005692" watchObservedRunningTime="2026-09-17 02:02:43.145664043 +0000 UTC m=+1521.395641357"
Sep 17 02:02:54.126159 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:54.126076    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-4e1c2c18-b99897db9-mxz5w"
Sep 17 02:02:54.126624 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:02:54.126165    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-4e1c2c18-8b4fc54f8-hhzsh"
Sep 17 02:03:01.230299 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:03:01.230265    2560 generic.go:356] "Generic (PLEG): container finished" podID="a7954079-df26-4024-a536-c695b4a358f1" containerID="997b2ba2ee703d90d3beeaa91d03241671a8e158d21073c727ecf72e2aa1a74a" exitCode=0
Sep 17 02:03:01.230676 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:03:01.230320    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l" event={"ID":"a7954079-df26-4024-a536-c695b4a358f1","Type":"ContainerDied","Data":"997b2ba2ee703d90d3beeaa91d03241671a8e158d21073c727ecf72e2aa1a74a"}
Sep 17 02:03:01.230829 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:03:01.230815    2560 scope.go:117] "RemoveContainer" containerID="997b2ba2ee703d90d3beeaa91d03241671a8e158d21073c727ecf72e2aa1a74a"
Sep 17 02:03:01.231978 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:03:01.231953    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 02:03:01.232045 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:03:01.232019    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 02:03:01.232081 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:03:01.232047    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 02:03:02.238081 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:03:02.238049    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l" event={"ID":"a7954079-df26-4024-a536-c695b4a358f1","Type":"ContainerStarted","Data":"4c4d0bf46f29b5d467156940ffddec84044d6c9d6805d45f684b292061a73070"}
Sep 17 02:03:02.824966 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:03:02.824930    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l"
Sep 17 02:03:02.826268 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:03:02.826218    2560 patch_prober.go:28] interesting pod/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 17 02:03:02.826395 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:03:02.826285    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l" podUID="a7954079-df26-4024-a536-c695b4a358f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 17 02:03:03.825600 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:03:03.825561    2560 patch_prober.go:28] interesting pod/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 17 02:03:03.826041 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:03:03.825630    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l" podUID="a7954079-df26-4024-a536-c695b4a358f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 17 02:03:04.826051 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:03:04.826007    2560 patch_prober.go:28] interesting pod/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 17 02:03:04.826579 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:03:04.826070    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l" podUID="a7954079-df26-4024-a536-c695b4a358f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 17 02:03:05.825108 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:03:05.825071    2560 patch_prober.go:28] interesting pod/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 17 02:03:05.825322 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:03:05.825130    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l" podUID="a7954079-df26-4024-a536-c695b4a358f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 17 02:03:06.075475 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:03:06.075366    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l"
Sep 17 02:03:06.825911 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:03:06.825871    2560 patch_prober.go:28] interesting pod/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 17 02:03:06.826088 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:03:06.825928    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l" podUID="a7954079-df26-4024-a536-c695b4a358f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 17 02:03:07.829259 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:03:07.829223    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l"
Sep 17 02:03:07.830467 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:03:07.830447    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l"
Sep 17 02:04:00.526641 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:00.526605    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-3f027f/distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5"]
Sep 17 02:04:00.532192 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:00.532164    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-3f027f/distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw"]
Sep 17 02:04:11.494217 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:11.494183    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-3f027f-5ff757bcf7-7ddfx"]
Sep 17 02:04:11.494842 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:11.494410    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w3-3f027f-5ff757bcf7-7ddfx" podUID="081de0cf-f552-4147-9e5f-3cb59465d9bd" containerName="payload-processing" containerID="cri-o://605e69bb125c624e1fc7c1b90883cf50f9c8598a15deda1a161f9d2b71853076" gracePeriod=30
Sep 17 02:04:11.619241 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:11.619211    2560 generic.go:356] "Generic (PLEG): container finished" podID="081de0cf-f552-4147-9e5f-3cb59465d9bd" containerID="605e69bb125c624e1fc7c1b90883cf50f9c8598a15deda1a161f9d2b71853076" exitCode=0
Sep 17 02:04:11.619377 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:11.619289    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-3f027f-5ff757bcf7-7ddfx" event={"ID":"081de0cf-f552-4147-9e5f-3cb59465d9bd","Type":"ContainerDied","Data":"605e69bb125c624e1fc7c1b90883cf50f9c8598a15deda1a161f9d2b71853076"}
Sep 17 02:04:11.754908 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:11.754791    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-3f027f-5ff757bcf7-7ddfx"
Sep 17 02:04:11.790711 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:11.789570    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7f48h\" (UniqueName: \"kubernetes.io/projected/081de0cf-f552-4147-9e5f-3cb59465d9bd-kube-api-access-7f48h\") pod \"081de0cf-f552-4147-9e5f-3cb59465d9bd\" (UID: \"081de0cf-f552-4147-9e5f-3cb59465d9bd\") "
Sep 17 02:04:11.790711 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:11.789676    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/081de0cf-f552-4147-9e5f-3cb59465d9bd-plugins-config-volume\") pod \"081de0cf-f552-4147-9e5f-3cb59465d9bd\" (UID: \"081de0cf-f552-4147-9e5f-3cb59465d9bd\") "
Sep 17 02:04:11.790711 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:11.790285    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/081de0cf-f552-4147-9e5f-3cb59465d9bd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "081de0cf-f552-4147-9e5f-3cb59465d9bd" (UID: "081de0cf-f552-4147-9e5f-3cb59465d9bd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 02:04:11.797787 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:11.797744    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/081de0cf-f552-4147-9e5f-3cb59465d9bd-kube-api-access-7f48h" (OuterVolumeSpecName: "kube-api-access-7f48h") pod "081de0cf-f552-4147-9e5f-3cb59465d9bd" (UID: "081de0cf-f552-4147-9e5f-3cb59465d9bd"). InnerVolumeSpecName "kube-api-access-7f48h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 02:04:11.890781 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:11.890740    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/081de0cf-f552-4147-9e5f-3cb59465d9bd-plugins-config-volume\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:04:11.890781 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:11.890777    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7f48h\" (UniqueName: \"kubernetes.io/projected/081de0cf-f552-4147-9e5f-3cb59465d9bd-kube-api-access-7f48h\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:04:12.626470 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:12.626373    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w3-3f027f-5ff757bcf7-7ddfx" event={"ID":"081de0cf-f552-4147-9e5f-3cb59465d9bd","Type":"ContainerDied","Data":"b4ce6aa3d8b05f73e16cf3480cdc948196875cf575fc9a37a133774f4cec9257"}
Sep 17 02:04:12.626470 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:12.626413    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w3-3f027f-5ff757bcf7-7ddfx"
Sep 17 02:04:12.626470 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:12.626452    2560 scope.go:117] "RemoveContainer" containerID="605e69bb125c624e1fc7c1b90883cf50f9c8598a15deda1a161f9d2b71853076"
Sep 17 02:04:12.646167 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:12.646142    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-3f027f-5ff757bcf7-7ddfx"]
Sep 17 02:04:12.648709 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:12.648684    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w3-3f027f-5ff757bcf7-7ddfx"]
Sep 17 02:04:13.441925 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:13.441891    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-4e1c2c18-b99897db9-mxz5w"]
Sep 17 02:04:13.442132 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:13.442104    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-4e1c2c18-b99897db9-mxz5w" podUID="93aad484-0aab-460c-b970-28989efbb240" containerName="payload-processing" containerID="cri-o://efb6fa439f912cd169092f19802ab0e10d7ac9ad5773144f5b32cbb69430cd18" gracePeriod=30
Sep 17 02:04:13.449665 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:13.449639    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-4e1c2c18-8b4fc54f8-hhzsh"]
Sep 17 02:04:13.634021 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:13.633984    2560 generic.go:356] "Generic (PLEG): container finished" podID="93aad484-0aab-460c-b970-28989efbb240" containerID="efb6fa439f912cd169092f19802ab0e10d7ac9ad5773144f5b32cbb69430cd18" exitCode=0
Sep 17 02:04:13.634453 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:13.634062    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-4e1c2c18-b99897db9-mxz5w" event={"ID":"93aad484-0aab-460c-b970-28989efbb240","Type":"ContainerDied","Data":"efb6fa439f912cd169092f19802ab0e10d7ac9ad5773144f5b32cbb69430cd18"}
Sep 17 02:04:13.635540 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:13.635507    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-4e1c2c18-8b4fc54f8-hhzsh" podUID="9dbf457d-7c89-4489-9235-0c1be3089b47" containerName="payload-pre-processing" containerID="cri-o://55e8f66cb1260b53de1db250feb7c7c265b4257044741f7fcccddeac821e2cf4" gracePeriod=30
Sep 17 02:04:13.761487 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:13.761463    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-4e1c2c18-b99897db9-mxz5w"
Sep 17 02:04:13.806790 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:13.806760    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93aad484-0aab-460c-b970-28989efbb240-plugins-config-volume\") pod \"93aad484-0aab-460c-b970-28989efbb240\" (UID: \"93aad484-0aab-460c-b970-28989efbb240\") "
Sep 17 02:04:13.806971 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:13.806856    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5zd24\" (UniqueName: \"kubernetes.io/projected/93aad484-0aab-460c-b970-28989efbb240-kube-api-access-5zd24\") pod \"93aad484-0aab-460c-b970-28989efbb240\" (UID: \"93aad484-0aab-460c-b970-28989efbb240\") "
Sep 17 02:04:13.807227 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:13.807197    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93aad484-0aab-460c-b970-28989efbb240-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "93aad484-0aab-460c-b970-28989efbb240" (UID: "93aad484-0aab-460c-b970-28989efbb240"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 02:04:13.810300 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:13.810268    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93aad484-0aab-460c-b970-28989efbb240-kube-api-access-5zd24" (OuterVolumeSpecName: "kube-api-access-5zd24") pod "93aad484-0aab-460c-b970-28989efbb240" (UID: "93aad484-0aab-460c-b970-28989efbb240"). InnerVolumeSpecName "kube-api-access-5zd24". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 02:04:13.903434 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:13.903399    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-4e1c2c18-8b4fc54f8-hhzsh"
Sep 17 02:04:13.907651 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:13.907616    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9dbf457d-7c89-4489-9235-0c1be3089b47-plugins-config-volume\") pod \"9dbf457d-7c89-4489-9235-0c1be3089b47\" (UID: \"9dbf457d-7c89-4489-9235-0c1be3089b47\") "
Sep 17 02:04:13.907802 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:13.907677    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvqx7\" (UniqueName: \"kubernetes.io/projected/9dbf457d-7c89-4489-9235-0c1be3089b47-kube-api-access-jvqx7\") pod \"9dbf457d-7c89-4489-9235-0c1be3089b47\" (UID: \"9dbf457d-7c89-4489-9235-0c1be3089b47\") "
Sep 17 02:04:13.907937 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:13.907911    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9dbf457d-7c89-4489-9235-0c1be3089b47-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9dbf457d-7c89-4489-9235-0c1be3089b47" (UID: "9dbf457d-7c89-4489-9235-0c1be3089b47"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 02:04:13.907997 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:13.907985    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93aad484-0aab-460c-b970-28989efbb240-plugins-config-volume\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:04:13.908045 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:13.908005    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5zd24\" (UniqueName: \"kubernetes.io/projected/93aad484-0aab-460c-b970-28989efbb240-kube-api-access-5zd24\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:04:13.909783 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:13.909760    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9dbf457d-7c89-4489-9235-0c1be3089b47-kube-api-access-jvqx7" (OuterVolumeSpecName: "kube-api-access-jvqx7") pod "9dbf457d-7c89-4489-9235-0c1be3089b47" (UID: "9dbf457d-7c89-4489-9235-0c1be3089b47"). InnerVolumeSpecName "kube-api-access-jvqx7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 02:04:14.009350 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:14.009238    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9dbf457d-7c89-4489-9235-0c1be3089b47-plugins-config-volume\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:04:14.009350 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:14.009292    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvqx7\" (UniqueName: \"kubernetes.io/projected/9dbf457d-7c89-4489-9235-0c1be3089b47-kube-api-access-jvqx7\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:04:14.357659 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:14.357628    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="081de0cf-f552-4147-9e5f-3cb59465d9bd" path="/var/lib/kubelet/pods/081de0cf-f552-4147-9e5f-3cb59465d9bd/volumes"
Sep 17 02:04:14.643305 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:14.643200    2560 generic.go:356] "Generic (PLEG): container finished" podID="9dbf457d-7c89-4489-9235-0c1be3089b47" containerID="55e8f66cb1260b53de1db250feb7c7c265b4257044741f7fcccddeac821e2cf4" exitCode=0
Sep 17 02:04:14.643305 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:14.643265    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-4e1c2c18-8b4fc54f8-hhzsh"
Sep 17 02:04:14.643305 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:14.643285    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-4e1c2c18-8b4fc54f8-hhzsh" event={"ID":"9dbf457d-7c89-4489-9235-0c1be3089b47","Type":"ContainerDied","Data":"55e8f66cb1260b53de1db250feb7c7c265b4257044741f7fcccddeac821e2cf4"}
Sep 17 02:04:14.643836 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:14.643341    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-4e1c2c18-8b4fc54f8-hhzsh" event={"ID":"9dbf457d-7c89-4489-9235-0c1be3089b47","Type":"ContainerDied","Data":"03e11ea7a1953b88821cab560c2fde031ea13a5e57ff64d8291f05a73fd6270f"}
Sep 17 02:04:14.643836 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:14.643372    2560 scope.go:117] "RemoveContainer" containerID="55e8f66cb1260b53de1db250feb7c7c265b4257044741f7fcccddeac821e2cf4"
Sep 17 02:04:14.644801 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:14.644773    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-4e1c2c18-b99897db9-mxz5w"
Sep 17 02:04:14.644882 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:14.644787    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-4e1c2c18-b99897db9-mxz5w" event={"ID":"93aad484-0aab-460c-b970-28989efbb240","Type":"ContainerDied","Data":"b886b32761890e67e7fb93c609baa40a43113d05aa8f2fa5544a106ca021c323"}
Sep 17 02:04:14.652393 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:14.652375    2560 scope.go:117] "RemoveContainer" containerID="55e8f66cb1260b53de1db250feb7c7c265b4257044741f7fcccddeac821e2cf4"
Sep 17 02:04:14.652682 ip-10-0-143-95 kubenswrapper[2560]: E0917 02:04:14.652662    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55e8f66cb1260b53de1db250feb7c7c265b4257044741f7fcccddeac821e2cf4\": container with ID starting with 55e8f66cb1260b53de1db250feb7c7c265b4257044741f7fcccddeac821e2cf4 not found: ID does not exist" containerID="55e8f66cb1260b53de1db250feb7c7c265b4257044741f7fcccddeac821e2cf4"
Sep 17 02:04:14.652771 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:14.652694    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55e8f66cb1260b53de1db250feb7c7c265b4257044741f7fcccddeac821e2cf4"} err="failed to get container status \"55e8f66cb1260b53de1db250feb7c7c265b4257044741f7fcccddeac821e2cf4\": rpc error: code = NotFound desc = could not find container \"55e8f66cb1260b53de1db250feb7c7c265b4257044741f7fcccddeac821e2cf4\": container with ID starting with 55e8f66cb1260b53de1db250feb7c7c265b4257044741f7fcccddeac821e2cf4 not found: ID does not exist"
Sep 17 02:04:14.652771 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:14.652716    2560 scope.go:117] "RemoveContainer" containerID="efb6fa439f912cd169092f19802ab0e10d7ac9ad5773144f5b32cbb69430cd18"
Sep 17 02:04:14.659743 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:14.659713    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-4e1c2c18-8b4fc54f8-hhzsh"]
Sep 17 02:04:14.663067 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:14.663032    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-4e1c2c18-8b4fc54f8-hhzsh"]
Sep 17 02:04:14.680233 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:14.680196    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-4e1c2c18-b99897db9-mxz5w"]
Sep 17 02:04:14.694363 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:14.694329    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-4e1c2c18-b99897db9-mxz5w"]
Sep 17 02:04:15.546302 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:15.546239    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-3f027f/distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5" podUID="ec025b7e-5e6a-4aa7-a1f2-309dafacf267" containerName="main" containerID="cri-o://9620c5f0ba6f8037a831a28e142c2843f584aab82f9f2c1293aee4eb36fc34ba" gracePeriod=45
Sep 17 02:04:15.550221 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:15.550186    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-3f027f/distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw" podUID="f46ba291-6d51-48b8-94b7-0f3613171893" containerName="main" containerID="cri-o://baa59a92fe362c8abfb8e002311aca1497f324df4c623ee5e04eceae65a6375c" gracePeriod=45
Sep 17 02:04:15.856315 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:15.856285    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-3f027f/distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5"
Sep 17 02:04:15.859373 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:15.859352    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-3f027f/distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw"
Sep 17 02:04:15.928013 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:15.927920    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wwztb\" (UniqueName: \"kubernetes.io/projected/f46ba291-6d51-48b8-94b7-0f3613171893-kube-api-access-wwztb\") pod \"f46ba291-6d51-48b8-94b7-0f3613171893\" (UID: \"f46ba291-6d51-48b8-94b7-0f3613171893\") "
Sep 17 02:04:15.928013 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:15.927986    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec025b7e-5e6a-4aa7-a1f2-309dafacf267-home\") pod \"ec025b7e-5e6a-4aa7-a1f2-309dafacf267\" (UID: \"ec025b7e-5e6a-4aa7-a1f2-309dafacf267\") "
Sep 17 02:04:15.928013 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:15.928015    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f46ba291-6d51-48b8-94b7-0f3613171893-home\") pod \"f46ba291-6d51-48b8-94b7-0f3613171893\" (UID: \"f46ba291-6d51-48b8-94b7-0f3613171893\") "
Sep 17 02:04:15.928482 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:15.928210    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f46ba291-6d51-48b8-94b7-0f3613171893-tmp-dir\") pod \"f46ba291-6d51-48b8-94b7-0f3613171893\" (UID: \"f46ba291-6d51-48b8-94b7-0f3613171893\") "
Sep 17 02:04:15.928482 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:15.928283    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xmvpn\" (UniqueName: \"kubernetes.io/projected/ec025b7e-5e6a-4aa7-a1f2-309dafacf267-kube-api-access-xmvpn\") pod \"ec025b7e-5e6a-4aa7-a1f2-309dafacf267\" (UID: \"ec025b7e-5e6a-4aa7-a1f2-309dafacf267\") "
Sep 17 02:04:15.928482 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:15.928307    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec025b7e-5e6a-4aa7-a1f2-309dafacf267-home" (OuterVolumeSpecName: "home") pod "ec025b7e-5e6a-4aa7-a1f2-309dafacf267" (UID: "ec025b7e-5e6a-4aa7-a1f2-309dafacf267"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:04:15.928482 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:15.928336    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f46ba291-6d51-48b8-94b7-0f3613171893-model-cache\") pod \"f46ba291-6d51-48b8-94b7-0f3613171893\" (UID: \"f46ba291-6d51-48b8-94b7-0f3613171893\") "
Sep 17 02:04:15.928482 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:15.928379    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f46ba291-6d51-48b8-94b7-0f3613171893-tls-certs\") pod \"f46ba291-6d51-48b8-94b7-0f3613171893\" (UID: \"f46ba291-6d51-48b8-94b7-0f3613171893\") "
Sep 17 02:04:15.928482 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:15.928429    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f46ba291-6d51-48b8-94b7-0f3613171893-dshm\") pod \"f46ba291-6d51-48b8-94b7-0f3613171893\" (UID: \"f46ba291-6d51-48b8-94b7-0f3613171893\") "
Sep 17 02:04:15.928482 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:15.928316    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f46ba291-6d51-48b8-94b7-0f3613171893-home" (OuterVolumeSpecName: "home") pod "f46ba291-6d51-48b8-94b7-0f3613171893" (UID: "f46ba291-6d51-48b8-94b7-0f3613171893"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:04:15.928482 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:15.928463    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec025b7e-5e6a-4aa7-a1f2-309dafacf267-dshm\") pod \"ec025b7e-5e6a-4aa7-a1f2-309dafacf267\" (UID: \"ec025b7e-5e6a-4aa7-a1f2-309dafacf267\") "
Sep 17 02:04:15.928482 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:15.928490    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f46ba291-6d51-48b8-94b7-0f3613171893-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f46ba291-6d51-48b8-94b7-0f3613171893" (UID: "f46ba291-6d51-48b8-94b7-0f3613171893"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:04:15.929042 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:15.928515    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec025b7e-5e6a-4aa7-a1f2-309dafacf267-tls-certs\") pod \"ec025b7e-5e6a-4aa7-a1f2-309dafacf267\" (UID: \"ec025b7e-5e6a-4aa7-a1f2-309dafacf267\") "
Sep 17 02:04:15.929042 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:15.928582    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec025b7e-5e6a-4aa7-a1f2-309dafacf267-tmp-dir\") pod \"ec025b7e-5e6a-4aa7-a1f2-309dafacf267\" (UID: \"ec025b7e-5e6a-4aa7-a1f2-309dafacf267\") "
Sep 17 02:04:15.929042 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:15.928637    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec025b7e-5e6a-4aa7-a1f2-309dafacf267-model-cache\") pod \"ec025b7e-5e6a-4aa7-a1f2-309dafacf267\" (UID: \"ec025b7e-5e6a-4aa7-a1f2-309dafacf267\") "
Sep 17 02:04:15.929042 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:15.928666    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f46ba291-6d51-48b8-94b7-0f3613171893-model-cache" (OuterVolumeSpecName: "model-cache") pod "f46ba291-6d51-48b8-94b7-0f3613171893" (UID: "f46ba291-6d51-48b8-94b7-0f3613171893"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:04:15.929042 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:15.929004    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec025b7e-5e6a-4aa7-a1f2-309dafacf267-home\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:04:15.929042 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:15.929023    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f46ba291-6d51-48b8-94b7-0f3613171893-home\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:04:15.929042 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:15.929036    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f46ba291-6d51-48b8-94b7-0f3613171893-tmp-dir\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:04:15.929427 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:15.929048    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f46ba291-6d51-48b8-94b7-0f3613171893-model-cache\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:04:15.929427 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:15.929304    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec025b7e-5e6a-4aa7-a1f2-309dafacf267-model-cache" (OuterVolumeSpecName: "model-cache") pod "ec025b7e-5e6a-4aa7-a1f2-309dafacf267" (UID: "ec025b7e-5e6a-4aa7-a1f2-309dafacf267"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:04:15.929872 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:15.929846    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec025b7e-5e6a-4aa7-a1f2-309dafacf267-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ec025b7e-5e6a-4aa7-a1f2-309dafacf267" (UID: "ec025b7e-5e6a-4aa7-a1f2-309dafacf267"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:04:15.931022 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:15.930986    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec025b7e-5e6a-4aa7-a1f2-309dafacf267-kube-api-access-xmvpn" (OuterVolumeSpecName: "kube-api-access-xmvpn") pod "ec025b7e-5e6a-4aa7-a1f2-309dafacf267" (UID: "ec025b7e-5e6a-4aa7-a1f2-309dafacf267"). InnerVolumeSpecName "kube-api-access-xmvpn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 02:04:15.931117 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:15.931019    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f46ba291-6d51-48b8-94b7-0f3613171893-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f46ba291-6d51-48b8-94b7-0f3613171893" (UID: "f46ba291-6d51-48b8-94b7-0f3613171893"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 02:04:15.931117 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:15.931030    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f46ba291-6d51-48b8-94b7-0f3613171893-kube-api-access-wwztb" (OuterVolumeSpecName: "kube-api-access-wwztb") pod "f46ba291-6d51-48b8-94b7-0f3613171893" (UID: "f46ba291-6d51-48b8-94b7-0f3613171893"). InnerVolumeSpecName "kube-api-access-wwztb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 02:04:15.931275 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:15.931135    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f46ba291-6d51-48b8-94b7-0f3613171893-dshm" (OuterVolumeSpecName: "dshm") pod "f46ba291-6d51-48b8-94b7-0f3613171893" (UID: "f46ba291-6d51-48b8-94b7-0f3613171893"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:04:15.931932 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:15.931912    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec025b7e-5e6a-4aa7-a1f2-309dafacf267-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ec025b7e-5e6a-4aa7-a1f2-309dafacf267" (UID: "ec025b7e-5e6a-4aa7-a1f2-309dafacf267"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 02:04:15.932212 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:15.932180    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec025b7e-5e6a-4aa7-a1f2-309dafacf267-dshm" (OuterVolumeSpecName: "dshm") pod "ec025b7e-5e6a-4aa7-a1f2-309dafacf267" (UID: "ec025b7e-5e6a-4aa7-a1f2-309dafacf267"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:04:16.030183 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:16.030140    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec025b7e-5e6a-4aa7-a1f2-309dafacf267-tmp-dir\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:04:16.030183 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:16.030175    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec025b7e-5e6a-4aa7-a1f2-309dafacf267-model-cache\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:04:16.030183 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:16.030185    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wwztb\" (UniqueName: \"kubernetes.io/projected/f46ba291-6d51-48b8-94b7-0f3613171893-kube-api-access-wwztb\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:04:16.030183 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:16.030194    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xmvpn\" (UniqueName: \"kubernetes.io/projected/ec025b7e-5e6a-4aa7-a1f2-309dafacf267-kube-api-access-xmvpn\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:04:16.030570 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:16.030204    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f46ba291-6d51-48b8-94b7-0f3613171893-tls-certs\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:04:16.030570 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:16.030212    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f46ba291-6d51-48b8-94b7-0f3613171893-dshm\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:04:16.030570 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:16.030219    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec025b7e-5e6a-4aa7-a1f2-309dafacf267-dshm\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:04:16.030570 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:16.030226    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec025b7e-5e6a-4aa7-a1f2-309dafacf267-tls-certs\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:04:16.358143 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:16.358107    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93aad484-0aab-460c-b970-28989efbb240" path="/var/lib/kubelet/pods/93aad484-0aab-460c-b970-28989efbb240/volumes"
Sep 17 02:04:16.358536 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:16.358523    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9dbf457d-7c89-4489-9235-0c1be3089b47" path="/var/lib/kubelet/pods/9dbf457d-7c89-4489-9235-0c1be3089b47/volumes"
Sep 17 02:04:16.665562 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:16.665482    2560 generic.go:356] "Generic (PLEG): container finished" podID="f46ba291-6d51-48b8-94b7-0f3613171893" containerID="baa59a92fe362c8abfb8e002311aca1497f324df4c623ee5e04eceae65a6375c" exitCode=0
Sep 17 02:04:16.665562 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:16.665535    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-3f027f/distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw"
Sep 17 02:04:16.665760 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:16.665567    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-3f027f/distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw" event={"ID":"f46ba291-6d51-48b8-94b7-0f3613171893","Type":"ContainerDied","Data":"baa59a92fe362c8abfb8e002311aca1497f324df4c623ee5e04eceae65a6375c"}
Sep 17 02:04:16.665760 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:16.665613    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-3f027f/distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw" event={"ID":"f46ba291-6d51-48b8-94b7-0f3613171893","Type":"ContainerDied","Data":"b661a7d94b2b15f93d696a83e375cf61a647344de98904a25b7294e9edbf3331"}
Sep 17 02:04:16.665760 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:16.665639    2560 scope.go:117] "RemoveContainer" containerID="baa59a92fe362c8abfb8e002311aca1497f324df4c623ee5e04eceae65a6375c"
Sep 17 02:04:16.667219 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:16.667187    2560 generic.go:356] "Generic (PLEG): container finished" podID="ec025b7e-5e6a-4aa7-a1f2-309dafacf267" containerID="9620c5f0ba6f8037a831a28e142c2843f584aab82f9f2c1293aee4eb36fc34ba" exitCode=0
Sep 17 02:04:16.667357 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:16.667272    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-3f027f/distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5"
Sep 17 02:04:16.667357 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:16.667299    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-3f027f/distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5" event={"ID":"ec025b7e-5e6a-4aa7-a1f2-309dafacf267","Type":"ContainerDied","Data":"9620c5f0ba6f8037a831a28e142c2843f584aab82f9f2c1293aee4eb36fc34ba"}
Sep 17 02:04:16.667357 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:16.667343    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-3f027f/distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5" event={"ID":"ec025b7e-5e6a-4aa7-a1f2-309dafacf267","Type":"ContainerDied","Data":"dbc024df14e7bcc61e5263ca5f5009c3cfc9ab8ca3ceeb6e2e2dfc14b300103c"}
Sep 17 02:04:16.674807 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:16.674621    2560 scope.go:117] "RemoveContainer" containerID="baa59a92fe362c8abfb8e002311aca1497f324df4c623ee5e04eceae65a6375c"
Sep 17 02:04:16.674900 ip-10-0-143-95 kubenswrapper[2560]: E0917 02:04:16.674882    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"baa59a92fe362c8abfb8e002311aca1497f324df4c623ee5e04eceae65a6375c\": container with ID starting with baa59a92fe362c8abfb8e002311aca1497f324df4c623ee5e04eceae65a6375c not found: ID does not exist" containerID="baa59a92fe362c8abfb8e002311aca1497f324df4c623ee5e04eceae65a6375c"
Sep 17 02:04:16.674941 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:16.674908    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"baa59a92fe362c8abfb8e002311aca1497f324df4c623ee5e04eceae65a6375c"} err="failed to get container status \"baa59a92fe362c8abfb8e002311aca1497f324df4c623ee5e04eceae65a6375c\": rpc error: code = NotFound desc = could not find container \"baa59a92fe362c8abfb8e002311aca1497f324df4c623ee5e04eceae65a6375c\": container with ID starting with baa59a92fe362c8abfb8e002311aca1497f324df4c623ee5e04eceae65a6375c not found: ID does not exist"
Sep 17 02:04:16.674941 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:16.674923    2560 scope.go:117] "RemoveContainer" containerID="9620c5f0ba6f8037a831a28e142c2843f584aab82f9f2c1293aee4eb36fc34ba"
Sep 17 02:04:16.680559 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:16.680536    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-3f027f/distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5"]
Sep 17 02:04:16.683214 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:16.683197    2560 scope.go:117] "RemoveContainer" containerID="9620c5f0ba6f8037a831a28e142c2843f584aab82f9f2c1293aee4eb36fc34ba"
Sep 17 02:04:16.683540 ip-10-0-143-95 kubenswrapper[2560]: E0917 02:04:16.683513    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9620c5f0ba6f8037a831a28e142c2843f584aab82f9f2c1293aee4eb36fc34ba\": container with ID starting with 9620c5f0ba6f8037a831a28e142c2843f584aab82f9f2c1293aee4eb36fc34ba not found: ID does not exist" containerID="9620c5f0ba6f8037a831a28e142c2843f584aab82f9f2c1293aee4eb36fc34ba"
Sep 17 02:04:16.683639 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:16.683547    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9620c5f0ba6f8037a831a28e142c2843f584aab82f9f2c1293aee4eb36fc34ba"} err="failed to get container status \"9620c5f0ba6f8037a831a28e142c2843f584aab82f9f2c1293aee4eb36fc34ba\": rpc error: code = NotFound desc = could not find container \"9620c5f0ba6f8037a831a28e142c2843f584aab82f9f2c1293aee4eb36fc34ba\": container with ID starting with 9620c5f0ba6f8037a831a28e142c2843f584aab82f9f2c1293aee4eb36fc34ba not found: ID does not exist"
Sep 17 02:04:16.684395 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:16.684375    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-3f027f/distinct-2-w3-3f027f-kserve-54fddcd7df-rznx5"]
Sep 17 02:04:16.691960 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:16.691939    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-3f027f/distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw"]
Sep 17 02:04:16.695317 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:16.695296    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-3f027f/distinct-w3-3f027f-kserve-6c8b8487f4-2h5gw"]
Sep 17 02:04:18.358194 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:18.358152    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec025b7e-5e6a-4aa7-a1f2-309dafacf267" path="/var/lib/kubelet/pods/ec025b7e-5e6a-4aa7-a1f2-309dafacf267/volumes"
Sep 17 02:04:18.358779 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:18.358751    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f46ba291-6d51-48b8-94b7-0f3613171893" path="/var/lib/kubelet/pods/f46ba291-6d51-48b8-94b7-0f3613171893/volumes"
Sep 17 02:04:18.981616 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:18.981580    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb"]
Sep 17 02:04:18.981897 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:18.981863    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb" podUID="d04475df-65f2-423a-9a29-d015ea63b35f" containerName="istio-proxy" containerID="cri-o://cd4d48f8247173f960b80f824bc39172983148b3d1b52f98b1eed6b2f751f9a9" gracePeriod=30
Sep 17 02:04:24.230836 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:24.230809    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb"
Sep 17 02:04:24.314632 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:24.314608    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d04475df-65f2-423a-9a29-d015ea63b35f-istiod-ca-cert\") pod \"d04475df-65f2-423a-9a29-d015ea63b35f\" (UID: \"d04475df-65f2-423a-9a29-d015ea63b35f\") "
Sep 17 02:04:24.314773 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:24.314676    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qkql4\" (UniqueName: \"kubernetes.io/projected/d04475df-65f2-423a-9a29-d015ea63b35f-kube-api-access-qkql4\") pod \"d04475df-65f2-423a-9a29-d015ea63b35f\" (UID: \"d04475df-65f2-423a-9a29-d015ea63b35f\") "
Sep 17 02:04:24.314773 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:24.314701    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d04475df-65f2-423a-9a29-d015ea63b35f-istio-token\") pod \"d04475df-65f2-423a-9a29-d015ea63b35f\" (UID: \"d04475df-65f2-423a-9a29-d015ea63b35f\") "
Sep 17 02:04:24.314773 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:24.314740    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d04475df-65f2-423a-9a29-d015ea63b35f-istio-envoy\") pod \"d04475df-65f2-423a-9a29-d015ea63b35f\" (UID: \"d04475df-65f2-423a-9a29-d015ea63b35f\") "
Sep 17 02:04:24.314932 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:24.314777    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d04475df-65f2-423a-9a29-d015ea63b35f-istio-data\") pod \"d04475df-65f2-423a-9a29-d015ea63b35f\" (UID: \"d04475df-65f2-423a-9a29-d015ea63b35f\") "
Sep 17 02:04:24.314932 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:24.314801    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d04475df-65f2-423a-9a29-d015ea63b35f-workload-socket\") pod \"d04475df-65f2-423a-9a29-d015ea63b35f\" (UID: \"d04475df-65f2-423a-9a29-d015ea63b35f\") "
Sep 17 02:04:24.314932 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:24.314829    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d04475df-65f2-423a-9a29-d015ea63b35f-workload-certs\") pod \"d04475df-65f2-423a-9a29-d015ea63b35f\" (UID: \"d04475df-65f2-423a-9a29-d015ea63b35f\") "
Sep 17 02:04:24.314932 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:24.314872    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d04475df-65f2-423a-9a29-d015ea63b35f-credential-socket\") pod \"d04475df-65f2-423a-9a29-d015ea63b35f\" (UID: \"d04475df-65f2-423a-9a29-d015ea63b35f\") "
Sep 17 02:04:24.314932 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:24.314894    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d04475df-65f2-423a-9a29-d015ea63b35f-istio-podinfo\") pod \"d04475df-65f2-423a-9a29-d015ea63b35f\" (UID: \"d04475df-65f2-423a-9a29-d015ea63b35f\") "
Sep 17 02:04:24.315183 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:24.315020    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d04475df-65f2-423a-9a29-d015ea63b35f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d04475df-65f2-423a-9a29-d015ea63b35f" (UID: "d04475df-65f2-423a-9a29-d015ea63b35f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 02:04:24.315183 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:24.315161    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d04475df-65f2-423a-9a29-d015ea63b35f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d04475df-65f2-423a-9a29-d015ea63b35f" (UID: "d04475df-65f2-423a-9a29-d015ea63b35f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:04:24.315373 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:24.315329    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d04475df-65f2-423a-9a29-d015ea63b35f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d04475df-65f2-423a-9a29-d015ea63b35f" (UID: "d04475df-65f2-423a-9a29-d015ea63b35f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:04:24.315459 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:24.315333    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d04475df-65f2-423a-9a29-d015ea63b35f-workload-socket\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:04:24.315459 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:24.315399    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d04475df-65f2-423a-9a29-d015ea63b35f-istiod-ca-cert\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:04:24.315459 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:24.315404    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d04475df-65f2-423a-9a29-d015ea63b35f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d04475df-65f2-423a-9a29-d015ea63b35f" (UID: "d04475df-65f2-423a-9a29-d015ea63b35f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:04:24.315604 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:24.315504    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d04475df-65f2-423a-9a29-d015ea63b35f-istio-data" (OuterVolumeSpecName: "istio-data") pod "d04475df-65f2-423a-9a29-d015ea63b35f" (UID: "d04475df-65f2-423a-9a29-d015ea63b35f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:04:24.316966 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:24.316943    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d04475df-65f2-423a-9a29-d015ea63b35f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d04475df-65f2-423a-9a29-d015ea63b35f" (UID: "d04475df-65f2-423a-9a29-d015ea63b35f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:04:24.317072 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:24.316971    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d04475df-65f2-423a-9a29-d015ea63b35f-kube-api-access-qkql4" (OuterVolumeSpecName: "kube-api-access-qkql4") pod "d04475df-65f2-423a-9a29-d015ea63b35f" (UID: "d04475df-65f2-423a-9a29-d015ea63b35f"). InnerVolumeSpecName "kube-api-access-qkql4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 02:04:24.317447 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:24.317423    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d04475df-65f2-423a-9a29-d015ea63b35f-istio-token" (OuterVolumeSpecName: "istio-token") pod "d04475df-65f2-423a-9a29-d015ea63b35f" (UID: "d04475df-65f2-423a-9a29-d015ea63b35f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 02:04:24.317537 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:24.317438    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d04475df-65f2-423a-9a29-d015ea63b35f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d04475df-65f2-423a-9a29-d015ea63b35f" (UID: "d04475df-65f2-423a-9a29-d015ea63b35f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 02:04:24.416732 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:24.416700    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d04475df-65f2-423a-9a29-d015ea63b35f-istio-envoy\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:04:24.416732 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:24.416726    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d04475df-65f2-423a-9a29-d015ea63b35f-istio-data\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:04:24.416732 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:24.416738    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d04475df-65f2-423a-9a29-d015ea63b35f-workload-certs\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:04:24.416978 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:24.416752    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d04475df-65f2-423a-9a29-d015ea63b35f-credential-socket\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:04:24.416978 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:24.416763    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d04475df-65f2-423a-9a29-d015ea63b35f-istio-podinfo\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:04:24.416978 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:24.416771    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qkql4\" (UniqueName: \"kubernetes.io/projected/d04475df-65f2-423a-9a29-d015ea63b35f-kube-api-access-qkql4\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:04:24.416978 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:24.416779    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d04475df-65f2-423a-9a29-d015ea63b35f-istio-token\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:04:24.713129 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:24.713034    2560 generic.go:356] "Generic (PLEG): container finished" podID="d04475df-65f2-423a-9a29-d015ea63b35f" containerID="cd4d48f8247173f960b80f824bc39172983148b3d1b52f98b1eed6b2f751f9a9" exitCode=0
Sep 17 02:04:24.713129 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:24.713089    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb"
Sep 17 02:04:24.713364 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:24.713119    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb" event={"ID":"d04475df-65f2-423a-9a29-d015ea63b35f","Type":"ContainerDied","Data":"cd4d48f8247173f960b80f824bc39172983148b3d1b52f98b1eed6b2f751f9a9"}
Sep 17 02:04:24.713364 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:24.713177    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb" event={"ID":"d04475df-65f2-423a-9a29-d015ea63b35f","Type":"ContainerDied","Data":"5d0d05491694bc6d7772e18fc1da8be2a915b3fa8444ed9e1e973d90b5ea24de"}
Sep 17 02:04:24.713364 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:24.713202    2560 scope.go:117] "RemoveContainer" containerID="cd4d48f8247173f960b80f824bc39172983148b3d1b52f98b1eed6b2f751f9a9"
Sep 17 02:04:24.722260 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:24.722226    2560 scope.go:117] "RemoveContainer" containerID="5e37821884b329800b7db87e6dc51a147549eda9bb2715ca08a1fd4c88639506"
Sep 17 02:04:24.728907 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:24.728883    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb"]
Sep 17 02:04:24.730443 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:24.730427    2560 scope.go:117] "RemoveContainer" containerID="cd4d48f8247173f960b80f824bc39172983148b3d1b52f98b1eed6b2f751f9a9"
Sep 17 02:04:24.730707 ip-10-0-143-95 kubenswrapper[2560]: E0917 02:04:24.730689    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd4d48f8247173f960b80f824bc39172983148b3d1b52f98b1eed6b2f751f9a9\": container with ID starting with cd4d48f8247173f960b80f824bc39172983148b3d1b52f98b1eed6b2f751f9a9 not found: ID does not exist" containerID="cd4d48f8247173f960b80f824bc39172983148b3d1b52f98b1eed6b2f751f9a9"
Sep 17 02:04:24.730747 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:24.730714    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd4d48f8247173f960b80f824bc39172983148b3d1b52f98b1eed6b2f751f9a9"} err="failed to get container status \"cd4d48f8247173f960b80f824bc39172983148b3d1b52f98b1eed6b2f751f9a9\": rpc error: code = NotFound desc = could not find container \"cd4d48f8247173f960b80f824bc39172983148b3d1b52f98b1eed6b2f751f9a9\": container with ID starting with cd4d48f8247173f960b80f824bc39172983148b3d1b52f98b1eed6b2f751f9a9 not found: ID does not exist"
Sep 17 02:04:24.730747 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:24.730730    2560 scope.go:117] "RemoveContainer" containerID="5e37821884b329800b7db87e6dc51a147549eda9bb2715ca08a1fd4c88639506"
Sep 17 02:04:24.730997 ip-10-0-143-95 kubenswrapper[2560]: E0917 02:04:24.730976    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e37821884b329800b7db87e6dc51a147549eda9bb2715ca08a1fd4c88639506\": container with ID starting with 5e37821884b329800b7db87e6dc51a147549eda9bb2715ca08a1fd4c88639506 not found: ID does not exist" containerID="5e37821884b329800b7db87e6dc51a147549eda9bb2715ca08a1fd4c88639506"
Sep 17 02:04:24.731043 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:24.731005    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e37821884b329800b7db87e6dc51a147549eda9bb2715ca08a1fd4c88639506"} err="failed to get container status \"5e37821884b329800b7db87e6dc51a147549eda9bb2715ca08a1fd4c88639506\": rpc error: code = NotFound desc = could not find container \"5e37821884b329800b7db87e6dc51a147549eda9bb2715ca08a1fd4c88639506\": container with ID starting with 5e37821884b329800b7db87e6dc51a147549eda9bb2715ca08a1fd4c88639506 not found: ID does not exist"
Sep 17 02:04:24.734520 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:24.734499    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-3f027f-openshift-default-69646d798b-wdktb"]
Sep 17 02:04:26.358141 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:04:26.358104    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d04475df-65f2-423a-9a29-d015ea63b35f" path="/var/lib/kubelet/pods/d04475df-65f2-423a-9a29-d015ea63b35f/volumes"
Sep 17 02:05:04.732069 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:04.732035    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l"]
Sep 17 02:05:04.732648 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:04.732285    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l" podUID="a7954079-df26-4024-a536-c695b4a358f1" containerName="istio-proxy" containerID="cri-o://4c4d0bf46f29b5d467156940ffddec84044d6c9d6805d45f684b292061a73070" gracePeriod=30
Sep 17 02:05:07.832702 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:07.832657    2560 patch_prober.go:28] interesting pod/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 17 02:05:07.833087 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:07.832731    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l" podUID="a7954079-df26-4024-a536-c695b4a358f1" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 02:05:09.942988 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:09.942956    2560 generic.go:356] "Generic (PLEG): container finished" podID="a7954079-df26-4024-a536-c695b4a358f1" containerID="4c4d0bf46f29b5d467156940ffddec84044d6c9d6805d45f684b292061a73070" exitCode=0
Sep 17 02:05:09.943366 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:09.943026    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l" event={"ID":"a7954079-df26-4024-a536-c695b4a358f1","Type":"ContainerDied","Data":"4c4d0bf46f29b5d467156940ffddec84044d6c9d6805d45f684b292061a73070"}
Sep 17 02:05:09.943366 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:09.943092    2560 scope.go:117] "RemoveContainer" containerID="997b2ba2ee703d90d3beeaa91d03241671a8e158d21073c727ecf72e2aa1a74a"
Sep 17 02:05:09.985083 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:09.985062    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l"
Sep 17 02:05:10.040056 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:10.039975    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7954079-df26-4024-a536-c695b4a358f1-workload-socket\") pod \"a7954079-df26-4024-a536-c695b4a358f1\" (UID: \"a7954079-df26-4024-a536-c695b4a358f1\") "
Sep 17 02:05:10.040056 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:10.040047    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7954079-df26-4024-a536-c695b4a358f1-istio-envoy\") pod \"a7954079-df26-4024-a536-c695b4a358f1\" (UID: \"a7954079-df26-4024-a536-c695b4a358f1\") "
Sep 17 02:05:10.040335 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:10.040066    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7954079-df26-4024-a536-c695b4a358f1-workload-certs\") pod \"a7954079-df26-4024-a536-c695b4a358f1\" (UID: \"a7954079-df26-4024-a536-c695b4a358f1\") "
Sep 17 02:05:10.040335 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:10.040107    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5f6z5\" (UniqueName: \"kubernetes.io/projected/a7954079-df26-4024-a536-c695b4a358f1-kube-api-access-5f6z5\") pod \"a7954079-df26-4024-a536-c695b4a358f1\" (UID: \"a7954079-df26-4024-a536-c695b4a358f1\") "
Sep 17 02:05:10.040335 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:10.040123    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7954079-df26-4024-a536-c695b4a358f1-credential-socket\") pod \"a7954079-df26-4024-a536-c695b4a358f1\" (UID: \"a7954079-df26-4024-a536-c695b4a358f1\") "
Sep 17 02:05:10.040335 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:10.040147    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7954079-df26-4024-a536-c695b4a358f1-istio-podinfo\") pod \"a7954079-df26-4024-a536-c695b4a358f1\" (UID: \"a7954079-df26-4024-a536-c695b4a358f1\") "
Sep 17 02:05:10.040335 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:10.040307    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7954079-df26-4024-a536-c695b4a358f1-istio-token\") pod \"a7954079-df26-4024-a536-c695b4a358f1\" (UID: \"a7954079-df26-4024-a536-c695b4a358f1\") "
Sep 17 02:05:10.040602 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:10.040348    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7954079-df26-4024-a536-c695b4a358f1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a7954079-df26-4024-a536-c695b4a358f1" (UID: "a7954079-df26-4024-a536-c695b4a358f1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:05:10.040602 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:10.040391    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7954079-df26-4024-a536-c695b4a358f1-istiod-ca-cert\") pod \"a7954079-df26-4024-a536-c695b4a358f1\" (UID: \"a7954079-df26-4024-a536-c695b4a358f1\") "
Sep 17 02:05:10.040602 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:10.040421    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7954079-df26-4024-a536-c695b4a358f1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a7954079-df26-4024-a536-c695b4a358f1" (UID: "a7954079-df26-4024-a536-c695b4a358f1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:05:10.040602 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:10.040432    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7954079-df26-4024-a536-c695b4a358f1-istio-data\") pod \"a7954079-df26-4024-a536-c695b4a358f1\" (UID: \"a7954079-df26-4024-a536-c695b4a358f1\") "
Sep 17 02:05:10.040602 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:10.040441    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7954079-df26-4024-a536-c695b4a358f1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a7954079-df26-4024-a536-c695b4a358f1" (UID: "a7954079-df26-4024-a536-c695b4a358f1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:05:10.040885 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:10.040742    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7954079-df26-4024-a536-c695b4a358f1-istio-data" (OuterVolumeSpecName: "istio-data") pod "a7954079-df26-4024-a536-c695b4a358f1" (UID: "a7954079-df26-4024-a536-c695b4a358f1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:05:10.040885 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:10.040769    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7954079-df26-4024-a536-c695b4a358f1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a7954079-df26-4024-a536-c695b4a358f1" (UID: "a7954079-df26-4024-a536-c695b4a358f1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 02:05:10.040885 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:10.040798    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7954079-df26-4024-a536-c695b4a358f1-workload-socket\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:05:10.040885 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:10.040816    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7954079-df26-4024-a536-c695b4a358f1-workload-certs\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:05:10.040885 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:10.040828    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7954079-df26-4024-a536-c695b4a358f1-credential-socket\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:05:10.042412 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:10.042381    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a7954079-df26-4024-a536-c695b4a358f1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a7954079-df26-4024-a536-c695b4a358f1" (UID: "a7954079-df26-4024-a536-c695b4a358f1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 02:05:10.042529 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:10.042436    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7954079-df26-4024-a536-c695b4a358f1-istio-token" (OuterVolumeSpecName: "istio-token") pod "a7954079-df26-4024-a536-c695b4a358f1" (UID: "a7954079-df26-4024-a536-c695b4a358f1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 02:05:10.042646 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:10.042628    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7954079-df26-4024-a536-c695b4a358f1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a7954079-df26-4024-a536-c695b4a358f1" (UID: "a7954079-df26-4024-a536-c695b4a358f1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:05:10.042692 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:10.042649    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7954079-df26-4024-a536-c695b4a358f1-kube-api-access-5f6z5" (OuterVolumeSpecName: "kube-api-access-5f6z5") pod "a7954079-df26-4024-a536-c695b4a358f1" (UID: "a7954079-df26-4024-a536-c695b4a358f1"). InnerVolumeSpecName "kube-api-access-5f6z5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 02:05:10.142038 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:10.142004    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7954079-df26-4024-a536-c695b4a358f1-istio-token\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:05:10.142038 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:10.142029    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7954079-df26-4024-a536-c695b4a358f1-istiod-ca-cert\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:05:10.142038 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:10.142038    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7954079-df26-4024-a536-c695b4a358f1-istio-data\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:05:10.142038 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:10.142047    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7954079-df26-4024-a536-c695b4a358f1-istio-envoy\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:05:10.142326 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:10.142055    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5f6z5\" (UniqueName: \"kubernetes.io/projected/a7954079-df26-4024-a536-c695b4a358f1-kube-api-access-5f6z5\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:05:10.142326 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:10.142065    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7954079-df26-4024-a536-c695b4a358f1-istio-podinfo\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:05:10.949133 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:10.949107    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l"
Sep 17 02:05:10.949133 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:10.949121    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l" event={"ID":"a7954079-df26-4024-a536-c695b4a358f1","Type":"ContainerDied","Data":"914632fbc096fc72799487d8762c3331b4dab6929e54befd8c1256c32ee35969"}
Sep 17 02:05:10.949670 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:10.949176    2560 scope.go:117] "RemoveContainer" containerID="4c4d0bf46f29b5d467156940ffddec84044d6c9d6805d45f684b292061a73070"
Sep 17 02:05:10.964565 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:10.964537    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l"]
Sep 17 02:05:10.967879 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:10.967853    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-4e1c2c18-openshift-default-76875787c6-lxg6l"]
Sep 17 02:05:12.357617 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:12.357582    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7954079-df26-4024-a536-c695b4a358f1" path="/var/lib/kubelet/pods/a7954079-df26-4024-a536-c695b4a358f1/volumes"
Sep 17 02:05:13.017578 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:13.017543    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-e564e1/distinct-w0-e564e1-kserve-6597f876cc-pxj9j"]
Sep 17 02:05:23.800346 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:23.800282    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-e564e1-964b5585b-mmc26"]
Sep 17 02:05:23.801424 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:23.801323    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e564e1-964b5585b-mmc26" podUID="a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7" containerName="maas-api" containerID="cri-o://c6ff19998e2ef8a6e46a98fc637e5a751f0bdf9e94325b7b05610f4902b94ee3" gracePeriod=30
Sep 17 02:05:24.018214 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:24.018178    2560 generic.go:356] "Generic (PLEG): container finished" podID="a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7" containerID="c6ff19998e2ef8a6e46a98fc637e5a751f0bdf9e94325b7b05610f4902b94ee3" exitCode=0
Sep 17 02:05:24.018428 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:24.018267    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e564e1-964b5585b-mmc26" event={"ID":"a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7","Type":"ContainerDied","Data":"c6ff19998e2ef8a6e46a98fc637e5a751f0bdf9e94325b7b05610f4902b94ee3"}
Sep 17 02:05:24.057237 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:24.057177    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e564e1-964b5585b-mmc26"
Sep 17 02:05:24.170793 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:24.170756    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7-openshift-service-ca\") pod \"a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7\" (UID: \"a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7\") "
Sep 17 02:05:24.170968 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:24.170807    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2c8mt\" (UniqueName: \"kubernetes.io/projected/a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7-kube-api-access-2c8mt\") pod \"a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7\" (UID: \"a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7\") "
Sep 17 02:05:24.170968 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:24.170844    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7-maas-api-tls\") pod \"a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7\" (UID: \"a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7\") "
Sep 17 02:05:24.170968 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:24.170873    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7-metrics-certs\") pod \"a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7\" (UID: \"a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7\") "
Sep 17 02:05:24.171294 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:24.171260    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7" (UID: "a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 02:05:24.173175 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:24.173139    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7" (UID: "a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 02:05:24.173305 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:24.173178    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7-kube-api-access-2c8mt" (OuterVolumeSpecName: "kube-api-access-2c8mt") pod "a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7" (UID: "a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7"). InnerVolumeSpecName "kube-api-access-2c8mt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 02:05:24.173305 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:24.173287    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7" (UID: "a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 02:05:24.271955 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:24.271914    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7-openshift-service-ca\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:05:24.271955 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:24.271947    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2c8mt\" (UniqueName: \"kubernetes.io/projected/a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7-kube-api-access-2c8mt\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:05:24.271955 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:24.271957    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7-maas-api-tls\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:05:24.271955 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:24.271966    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7-metrics-certs\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:05:25.024731 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:25.024697    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e564e1-964b5585b-mmc26" event={"ID":"a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7","Type":"ContainerDied","Data":"ee5d350c6e79d1831b0ee5ddb5d94dd2861c8452c71c83a2e6650660742b6ab0"}
Sep 17 02:05:25.024731 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:25.024714    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-e564e1-964b5585b-mmc26"
Sep 17 02:05:25.025292 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:25.024766    2560 scope.go:117] "RemoveContainer" containerID="c6ff19998e2ef8a6e46a98fc637e5a751f0bdf9e94325b7b05610f4902b94ee3"
Sep 17 02:05:25.040449 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:25.040421    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-e564e1-964b5585b-mmc26"]
Sep 17 02:05:25.044199 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:25.044176    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-e564e1-964b5585b-mmc26"]
Sep 17 02:05:26.357985 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:26.357956    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7" path="/var/lib/kubelet/pods/a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7/volumes"
Sep 17 02:05:28.037132 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:28.037089    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-e564e1/distinct-w0-e564e1-kserve-6597f876cc-pxj9j" podUID="3a191213-21ad-4a45-9ad6-35107bd52a88" containerName="main" containerID="cri-o://e1b7ef20837418ec83c2e8d2c4fde916ff0b0634fd03b32b38bcc7cc6bce79a0" gracePeriod=45
Sep 17 02:05:28.323982 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:28.323956    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e564e1/distinct-w0-e564e1-kserve-6597f876cc-pxj9j"
Sep 17 02:05:28.411822 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:28.411774    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a191213-21ad-4a45-9ad6-35107bd52a88-tmp-dir\") pod \"3a191213-21ad-4a45-9ad6-35107bd52a88\" (UID: \"3a191213-21ad-4a45-9ad6-35107bd52a88\") "
Sep 17 02:05:28.412018 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:28.411836    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a191213-21ad-4a45-9ad6-35107bd52a88-dshm\") pod \"3a191213-21ad-4a45-9ad6-35107bd52a88\" (UID: \"3a191213-21ad-4a45-9ad6-35107bd52a88\") "
Sep 17 02:05:28.412018 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:28.411870    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a191213-21ad-4a45-9ad6-35107bd52a88-tls-certs\") pod \"3a191213-21ad-4a45-9ad6-35107bd52a88\" (UID: \"3a191213-21ad-4a45-9ad6-35107bd52a88\") "
Sep 17 02:05:28.412018 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:28.411940    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a191213-21ad-4a45-9ad6-35107bd52a88-home\") pod \"3a191213-21ad-4a45-9ad6-35107bd52a88\" (UID: \"3a191213-21ad-4a45-9ad6-35107bd52a88\") "
Sep 17 02:05:28.412018 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:28.411998    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a191213-21ad-4a45-9ad6-35107bd52a88-model-cache\") pod \"3a191213-21ad-4a45-9ad6-35107bd52a88\" (UID: \"3a191213-21ad-4a45-9ad6-35107bd52a88\") "
Sep 17 02:05:28.412263 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:28.412045    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6r69m\" (UniqueName: \"kubernetes.io/projected/3a191213-21ad-4a45-9ad6-35107bd52a88-kube-api-access-6r69m\") pod \"3a191213-21ad-4a45-9ad6-35107bd52a88\" (UID: \"3a191213-21ad-4a45-9ad6-35107bd52a88\") "
Sep 17 02:05:28.412263 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:28.412080    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a191213-21ad-4a45-9ad6-35107bd52a88-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3a191213-21ad-4a45-9ad6-35107bd52a88" (UID: "3a191213-21ad-4a45-9ad6-35107bd52a88"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:05:28.412380 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:28.412366    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a191213-21ad-4a45-9ad6-35107bd52a88-tmp-dir\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:05:28.412714 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:28.412680    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a191213-21ad-4a45-9ad6-35107bd52a88-home" (OuterVolumeSpecName: "home") pod "3a191213-21ad-4a45-9ad6-35107bd52a88" (UID: "3a191213-21ad-4a45-9ad6-35107bd52a88"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:05:28.412948 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:28.412904    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a191213-21ad-4a45-9ad6-35107bd52a88-model-cache" (OuterVolumeSpecName: "model-cache") pod "3a191213-21ad-4a45-9ad6-35107bd52a88" (UID: "3a191213-21ad-4a45-9ad6-35107bd52a88"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:05:28.415213 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:28.415159    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a191213-21ad-4a45-9ad6-35107bd52a88-kube-api-access-6r69m" (OuterVolumeSpecName: "kube-api-access-6r69m") pod "3a191213-21ad-4a45-9ad6-35107bd52a88" (UID: "3a191213-21ad-4a45-9ad6-35107bd52a88"). InnerVolumeSpecName "kube-api-access-6r69m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 02:05:28.415440 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:28.415348    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a191213-21ad-4a45-9ad6-35107bd52a88-dshm" (OuterVolumeSpecName: "dshm") pod "3a191213-21ad-4a45-9ad6-35107bd52a88" (UID: "3a191213-21ad-4a45-9ad6-35107bd52a88"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:05:28.415440 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:28.415392    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a191213-21ad-4a45-9ad6-35107bd52a88-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3a191213-21ad-4a45-9ad6-35107bd52a88" (UID: "3a191213-21ad-4a45-9ad6-35107bd52a88"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 02:05:28.513772 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:28.513732    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a191213-21ad-4a45-9ad6-35107bd52a88-home\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:05:28.513772 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:28.513766    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a191213-21ad-4a45-9ad6-35107bd52a88-model-cache\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:05:28.513772 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:28.513777    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6r69m\" (UniqueName: \"kubernetes.io/projected/3a191213-21ad-4a45-9ad6-35107bd52a88-kube-api-access-6r69m\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:05:28.514017 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:28.513786    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a191213-21ad-4a45-9ad6-35107bd52a88-dshm\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:05:28.514017 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:28.513794    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a191213-21ad-4a45-9ad6-35107bd52a88-tls-certs\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:05:29.047846 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:29.047808    2560 generic.go:356] "Generic (PLEG): container finished" podID="3a191213-21ad-4a45-9ad6-35107bd52a88" containerID="e1b7ef20837418ec83c2e8d2c4fde916ff0b0634fd03b32b38bcc7cc6bce79a0" exitCode=0
Sep 17 02:05:29.048282 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:29.047872    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-e564e1/distinct-w0-e564e1-kserve-6597f876cc-pxj9j"
Sep 17 02:05:29.048282 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:29.047900    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e564e1/distinct-w0-e564e1-kserve-6597f876cc-pxj9j" event={"ID":"3a191213-21ad-4a45-9ad6-35107bd52a88","Type":"ContainerDied","Data":"e1b7ef20837418ec83c2e8d2c4fde916ff0b0634fd03b32b38bcc7cc6bce79a0"}
Sep 17 02:05:29.048282 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:29.047949    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-e564e1/distinct-w0-e564e1-kserve-6597f876cc-pxj9j" event={"ID":"3a191213-21ad-4a45-9ad6-35107bd52a88","Type":"ContainerDied","Data":"1c4da066b975df1753dfbdd2550b036b0ac70a506b8ecc51ba438ab86e279ebf"}
Sep 17 02:05:29.048282 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:29.047966    2560 scope.go:117] "RemoveContainer" containerID="e1b7ef20837418ec83c2e8d2c4fde916ff0b0634fd03b32b38bcc7cc6bce79a0"
Sep 17 02:05:29.057522 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:29.057503    2560 scope.go:117] "RemoveContainer" containerID="e1b7ef20837418ec83c2e8d2c4fde916ff0b0634fd03b32b38bcc7cc6bce79a0"
Sep 17 02:05:29.057798 ip-10-0-143-95 kubenswrapper[2560]: E0917 02:05:29.057777    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1b7ef20837418ec83c2e8d2c4fde916ff0b0634fd03b32b38bcc7cc6bce79a0\": container with ID starting with e1b7ef20837418ec83c2e8d2c4fde916ff0b0634fd03b32b38bcc7cc6bce79a0 not found: ID does not exist" containerID="e1b7ef20837418ec83c2e8d2c4fde916ff0b0634fd03b32b38bcc7cc6bce79a0"
Sep 17 02:05:29.057849 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:29.057806    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1b7ef20837418ec83c2e8d2c4fde916ff0b0634fd03b32b38bcc7cc6bce79a0"} err="failed to get container status \"e1b7ef20837418ec83c2e8d2c4fde916ff0b0634fd03b32b38bcc7cc6bce79a0\": rpc error: code = NotFound desc = could not find container \"e1b7ef20837418ec83c2e8d2c4fde916ff0b0634fd03b32b38bcc7cc6bce79a0\": container with ID starting with e1b7ef20837418ec83c2e8d2c4fde916ff0b0634fd03b32b38bcc7cc6bce79a0 not found: ID does not exist"
Sep 17 02:05:29.069340 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:29.069313    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-e564e1/distinct-w0-e564e1-kserve-6597f876cc-pxj9j"]
Sep 17 02:05:29.073107 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:29.073080    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-e564e1/distinct-w0-e564e1-kserve-6597f876cc-pxj9j"]
Sep 17 02:05:30.356824 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:30.356782    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a191213-21ad-4a45-9ad6-35107bd52a88" path="/var/lib/kubelet/pods/3a191213-21ad-4a45-9ad6-35107bd52a88/volumes"
Sep 17 02:05:30.665193 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:30.665112    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5"]
Sep 17 02:05:30.665381 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:30.665352    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5" podUID="04476ca5-bc8f-4e8e-b711-835ce6e40037" containerName="istio-proxy" containerID="cri-o://fdd77db23f19a55d8f28798ada2d7aa781e93eb8d0be0cb2f8bb3affd28f1017" gracePeriod=30
Sep 17 02:05:35.922431 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:35.922407    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5"
Sep 17 02:05:35.985932 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:35.985898    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04476ca5-bc8f-4e8e-b711-835ce6e40037-istiod-ca-cert\") pod \"04476ca5-bc8f-4e8e-b711-835ce6e40037\" (UID: \"04476ca5-bc8f-4e8e-b711-835ce6e40037\") "
Sep 17 02:05:35.985932 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:35.985937    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04476ca5-bc8f-4e8e-b711-835ce6e40037-istio-data\") pod \"04476ca5-bc8f-4e8e-b711-835ce6e40037\" (UID: \"04476ca5-bc8f-4e8e-b711-835ce6e40037\") "
Sep 17 02:05:35.986157 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:35.985958    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrlws\" (UniqueName: \"kubernetes.io/projected/04476ca5-bc8f-4e8e-b711-835ce6e40037-kube-api-access-xrlws\") pod \"04476ca5-bc8f-4e8e-b711-835ce6e40037\" (UID: \"04476ca5-bc8f-4e8e-b711-835ce6e40037\") "
Sep 17 02:05:35.986157 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:35.986027    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04476ca5-bc8f-4e8e-b711-835ce6e40037-istio-envoy\") pod \"04476ca5-bc8f-4e8e-b711-835ce6e40037\" (UID: \"04476ca5-bc8f-4e8e-b711-835ce6e40037\") "
Sep 17 02:05:35.986157 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:35.986052    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04476ca5-bc8f-4e8e-b711-835ce6e40037-istio-token\") pod \"04476ca5-bc8f-4e8e-b711-835ce6e40037\" (UID: \"04476ca5-bc8f-4e8e-b711-835ce6e40037\") "
Sep 17 02:05:35.986157 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:35.986086    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04476ca5-bc8f-4e8e-b711-835ce6e40037-workload-socket\") pod \"04476ca5-bc8f-4e8e-b711-835ce6e40037\" (UID: \"04476ca5-bc8f-4e8e-b711-835ce6e40037\") "
Sep 17 02:05:35.986157 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:35.986121    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04476ca5-bc8f-4e8e-b711-835ce6e40037-istio-podinfo\") pod \"04476ca5-bc8f-4e8e-b711-835ce6e40037\" (UID: \"04476ca5-bc8f-4e8e-b711-835ce6e40037\") "
Sep 17 02:05:35.986157 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:35.986156    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04476ca5-bc8f-4e8e-b711-835ce6e40037-credential-socket\") pod \"04476ca5-bc8f-4e8e-b711-835ce6e40037\" (UID: \"04476ca5-bc8f-4e8e-b711-835ce6e40037\") "
Sep 17 02:05:35.986517 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:35.986227    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04476ca5-bc8f-4e8e-b711-835ce6e40037-workload-certs\") pod \"04476ca5-bc8f-4e8e-b711-835ce6e40037\" (UID: \"04476ca5-bc8f-4e8e-b711-835ce6e40037\") "
Sep 17 02:05:35.986517 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:35.986227    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04476ca5-bc8f-4e8e-b711-835ce6e40037-istio-data" (OuterVolumeSpecName: "istio-data") pod "04476ca5-bc8f-4e8e-b711-835ce6e40037" (UID: "04476ca5-bc8f-4e8e-b711-835ce6e40037"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:05:35.986517 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:35.986402    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04476ca5-bc8f-4e8e-b711-835ce6e40037-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "04476ca5-bc8f-4e8e-b711-835ce6e40037" (UID: "04476ca5-bc8f-4e8e-b711-835ce6e40037"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 02:05:35.986688 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:35.986587    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04476ca5-bc8f-4e8e-b711-835ce6e40037-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "04476ca5-bc8f-4e8e-b711-835ce6e40037" (UID: "04476ca5-bc8f-4e8e-b711-835ce6e40037"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:05:35.986791 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:35.986767    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04476ca5-bc8f-4e8e-b711-835ce6e40037-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "04476ca5-bc8f-4e8e-b711-835ce6e40037" (UID: "04476ca5-bc8f-4e8e-b711-835ce6e40037"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:05:35.986851 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:35.986824    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04476ca5-bc8f-4e8e-b711-835ce6e40037-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "04476ca5-bc8f-4e8e-b711-835ce6e40037" (UID: "04476ca5-bc8f-4e8e-b711-835ce6e40037"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:05:35.986908 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:35.986863    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04476ca5-bc8f-4e8e-b711-835ce6e40037-istiod-ca-cert\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:05:35.986908 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:35.986886    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04476ca5-bc8f-4e8e-b711-835ce6e40037-istio-data\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:05:35.986908 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:35.986900    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04476ca5-bc8f-4e8e-b711-835ce6e40037-credential-socket\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:05:35.988284 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:35.988256    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04476ca5-bc8f-4e8e-b711-835ce6e40037-istio-token" (OuterVolumeSpecName: "istio-token") pod "04476ca5-bc8f-4e8e-b711-835ce6e40037" (UID: "04476ca5-bc8f-4e8e-b711-835ce6e40037"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 02:05:35.988412 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:35.988288    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04476ca5-bc8f-4e8e-b711-835ce6e40037-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "04476ca5-bc8f-4e8e-b711-835ce6e40037" (UID: "04476ca5-bc8f-4e8e-b711-835ce6e40037"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:05:35.988412 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:35.988331    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/04476ca5-bc8f-4e8e-b711-835ce6e40037-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "04476ca5-bc8f-4e8e-b711-835ce6e40037" (UID: "04476ca5-bc8f-4e8e-b711-835ce6e40037"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 02:05:35.988412 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:35.988351    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04476ca5-bc8f-4e8e-b711-835ce6e40037-kube-api-access-xrlws" (OuterVolumeSpecName: "kube-api-access-xrlws") pod "04476ca5-bc8f-4e8e-b711-835ce6e40037" (UID: "04476ca5-bc8f-4e8e-b711-835ce6e40037"). InnerVolumeSpecName "kube-api-access-xrlws". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 02:05:36.085834 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:36.085803    2560 generic.go:356] "Generic (PLEG): container finished" podID="04476ca5-bc8f-4e8e-b711-835ce6e40037" containerID="fdd77db23f19a55d8f28798ada2d7aa781e93eb8d0be0cb2f8bb3affd28f1017" exitCode=0
Sep 17 02:05:36.086000 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:36.085841    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5" event={"ID":"04476ca5-bc8f-4e8e-b711-835ce6e40037","Type":"ContainerDied","Data":"fdd77db23f19a55d8f28798ada2d7aa781e93eb8d0be0cb2f8bb3affd28f1017"}
Sep 17 02:05:36.086000 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:36.085859    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5"
Sep 17 02:05:36.086000 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:36.085881    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5" event={"ID":"04476ca5-bc8f-4e8e-b711-835ce6e40037","Type":"ContainerDied","Data":"74dcbe2b47504cd18464deff3c63083fdd0ac083b5ed29095d8b3ae4ebc82aa5"}
Sep 17 02:05:36.086000 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:36.085910    2560 scope.go:117] "RemoveContainer" containerID="fdd77db23f19a55d8f28798ada2d7aa781e93eb8d0be0cb2f8bb3affd28f1017"
Sep 17 02:05:36.087410 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:36.087390    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrlws\" (UniqueName: \"kubernetes.io/projected/04476ca5-bc8f-4e8e-b711-835ce6e40037-kube-api-access-xrlws\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:05:36.087508 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:36.087414    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04476ca5-bc8f-4e8e-b711-835ce6e40037-istio-envoy\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:05:36.087508 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:36.087428    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04476ca5-bc8f-4e8e-b711-835ce6e40037-istio-token\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:05:36.087508 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:36.087439    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04476ca5-bc8f-4e8e-b711-835ce6e40037-workload-socket\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:05:36.087508 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:36.087451    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04476ca5-bc8f-4e8e-b711-835ce6e40037-istio-podinfo\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:05:36.087508 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:36.087463    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04476ca5-bc8f-4e8e-b711-835ce6e40037-workload-certs\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:05:36.101338 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:36.101318    2560 scope.go:117] "RemoveContainer" containerID="c4fc3472e2ae7bdee2ebae532d53fca16e802062b1babc86e143aba89c5463ab"
Sep 17 02:05:36.109567 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:36.109547    2560 scope.go:117] "RemoveContainer" containerID="fdd77db23f19a55d8f28798ada2d7aa781e93eb8d0be0cb2f8bb3affd28f1017"
Sep 17 02:05:36.109739 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:36.109716    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5"]
Sep 17 02:05:36.109865 ip-10-0-143-95 kubenswrapper[2560]: E0917 02:05:36.109848    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fdd77db23f19a55d8f28798ada2d7aa781e93eb8d0be0cb2f8bb3affd28f1017\": container with ID starting with fdd77db23f19a55d8f28798ada2d7aa781e93eb8d0be0cb2f8bb3affd28f1017 not found: ID does not exist" containerID="fdd77db23f19a55d8f28798ada2d7aa781e93eb8d0be0cb2f8bb3affd28f1017"
Sep 17 02:05:36.109905 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:36.109873    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdd77db23f19a55d8f28798ada2d7aa781e93eb8d0be0cb2f8bb3affd28f1017"} err="failed to get container status \"fdd77db23f19a55d8f28798ada2d7aa781e93eb8d0be0cb2f8bb3affd28f1017\": rpc error: code = NotFound desc = could not find container \"fdd77db23f19a55d8f28798ada2d7aa781e93eb8d0be0cb2f8bb3affd28f1017\": container with ID starting with fdd77db23f19a55d8f28798ada2d7aa781e93eb8d0be0cb2f8bb3affd28f1017 not found: ID does not exist"
Sep 17 02:05:36.109905 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:36.109892    2560 scope.go:117] "RemoveContainer" containerID="c4fc3472e2ae7bdee2ebae532d53fca16e802062b1babc86e143aba89c5463ab"
Sep 17 02:05:36.110149 ip-10-0-143-95 kubenswrapper[2560]: E0917 02:05:36.110129    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4fc3472e2ae7bdee2ebae532d53fca16e802062b1babc86e143aba89c5463ab\": container with ID starting with c4fc3472e2ae7bdee2ebae532d53fca16e802062b1babc86e143aba89c5463ab not found: ID does not exist" containerID="c4fc3472e2ae7bdee2ebae532d53fca16e802062b1babc86e143aba89c5463ab"
Sep 17 02:05:36.110189 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:36.110158    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4fc3472e2ae7bdee2ebae532d53fca16e802062b1babc86e143aba89c5463ab"} err="failed to get container status \"c4fc3472e2ae7bdee2ebae532d53fca16e802062b1babc86e143aba89c5463ab\": rpc error: code = NotFound desc = could not find container \"c4fc3472e2ae7bdee2ebae532d53fca16e802062b1babc86e143aba89c5463ab\": container with ID starting with c4fc3472e2ae7bdee2ebae532d53fca16e802062b1babc86e143aba89c5463ab not found: ID does not exist"
Sep 17 02:05:36.113058 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:36.113039    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-e564e1-openshift-default-55c866f464-d9kf5"]
Sep 17 02:05:36.357364 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:36.357287    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04476ca5-bc8f-4e8e-b711-835ce6e40037" path="/var/lib/kubelet/pods/04476ca5-bc8f-4e8e-b711-835ce6e40037/volumes"
Sep 17 02:05:59.020301 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.020201    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf"]
Sep 17 02:05:59.020636 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.020584    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d04475df-65f2-423a-9a29-d015ea63b35f" containerName="istio-proxy"
Sep 17 02:05:59.020636 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.020596    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d04475df-65f2-423a-9a29-d015ea63b35f" containerName="istio-proxy"
Sep 17 02:05:59.020636 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.020606    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7954079-df26-4024-a536-c695b4a358f1" containerName="istio-proxy"
Sep 17 02:05:59.020636 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.020611    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7954079-df26-4024-a536-c695b4a358f1" containerName="istio-proxy"
Sep 17 02:05:59.020636 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.020618    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04476ca5-bc8f-4e8e-b711-835ce6e40037" containerName="istio-proxy"
Sep 17 02:05:59.020636 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.020623    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="04476ca5-bc8f-4e8e-b711-835ce6e40037" containerName="istio-proxy"
Sep 17 02:05:59.020636 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.020630    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f46ba291-6d51-48b8-94b7-0f3613171893" containerName="main"
Sep 17 02:05:59.020636 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.020634    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f46ba291-6d51-48b8-94b7-0f3613171893" containerName="main"
Sep 17 02:05:59.020636 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.020640    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a191213-21ad-4a45-9ad6-35107bd52a88" containerName="main"
Sep 17 02:05:59.020951 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.020645    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a191213-21ad-4a45-9ad6-35107bd52a88" containerName="main"
Sep 17 02:05:59.020951 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.020658    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d04475df-65f2-423a-9a29-d015ea63b35f" containerName="istio-proxy"
Sep 17 02:05:59.020951 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.020663    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d04475df-65f2-423a-9a29-d015ea63b35f" containerName="istio-proxy"
Sep 17 02:05:59.020951 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.020677    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="081de0cf-f552-4147-9e5f-3cb59465d9bd" containerName="payload-processing"
Sep 17 02:05:59.020951 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.020683    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="081de0cf-f552-4147-9e5f-3cb59465d9bd" containerName="payload-processing"
Sep 17 02:05:59.020951 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.020688    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9dbf457d-7c89-4489-9235-0c1be3089b47" containerName="payload-pre-processing"
Sep 17 02:05:59.020951 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.020694    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dbf457d-7c89-4489-9235-0c1be3089b47" containerName="payload-pre-processing"
Sep 17 02:05:59.020951 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.020703    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec025b7e-5e6a-4aa7-a1f2-309dafacf267" containerName="main"
Sep 17 02:05:59.020951 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.020707    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec025b7e-5e6a-4aa7-a1f2-309dafacf267" containerName="main"
Sep 17 02:05:59.020951 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.020712    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7" containerName="maas-api"
Sep 17 02:05:59.020951 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.020717    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7" containerName="maas-api"
Sep 17 02:05:59.020951 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.020722    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7954079-df26-4024-a536-c695b4a358f1" containerName="istio-proxy"
Sep 17 02:05:59.020951 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.020727    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7954079-df26-4024-a536-c695b4a358f1" containerName="istio-proxy"
Sep 17 02:05:59.020951 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.020732    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93aad484-0aab-460c-b970-28989efbb240" containerName="payload-processing"
Sep 17 02:05:59.020951 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.020737    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="93aad484-0aab-460c-b970-28989efbb240" containerName="payload-processing"
Sep 17 02:05:59.020951 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.020783    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="04476ca5-bc8f-4e8e-b711-835ce6e40037" containerName="istio-proxy"
Sep 17 02:05:59.020951 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.020790    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="04476ca5-bc8f-4e8e-b711-835ce6e40037" containerName="istio-proxy"
Sep 17 02:05:59.020951 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.020798    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="081de0cf-f552-4147-9e5f-3cb59465d9bd" containerName="payload-processing"
Sep 17 02:05:59.020951 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.020803    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec025b7e-5e6a-4aa7-a1f2-309dafacf267" containerName="main"
Sep 17 02:05:59.020951 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.020810    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7954079-df26-4024-a536-c695b4a358f1" containerName="istio-proxy"
Sep 17 02:05:59.020951 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.020817    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="93aad484-0aab-460c-b970-28989efbb240" containerName="payload-processing"
Sep 17 02:05:59.020951 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.020822    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d04475df-65f2-423a-9a29-d015ea63b35f" containerName="istio-proxy"
Sep 17 02:05:59.020951 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.020827    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f46ba291-6d51-48b8-94b7-0f3613171893" containerName="main"
Sep 17 02:05:59.020951 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.020832    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a191213-21ad-4a45-9ad6-35107bd52a88" containerName="main"
Sep 17 02:05:59.020951 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.020837    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9dbf457d-7c89-4489-9235-0c1be3089b47" containerName="payload-pre-processing"
Sep 17 02:05:59.020951 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.020842    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d04475df-65f2-423a-9a29-d015ea63b35f" containerName="istio-proxy"
Sep 17 02:05:59.020951 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.020848    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a504b71c-49b4-4d97-ae7c-2a6eb1aa8fa7" containerName="maas-api"
Sep 17 02:05:59.020951 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.020853    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7954079-df26-4024-a536-c695b4a358f1" containerName="istio-proxy"
Sep 17 02:05:59.024309 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.024284    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf"
Sep 17 02:05:59.026031 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.026010    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-11a2e3-openshift-default-dockercfg-ljkbs\""
Sep 17 02:05:59.036125 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.036100    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf"]
Sep 17 02:05:59.085000 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.084970    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0abf225-37e6-40a7-989c-50bcb88390a7-istio-data\") pod \"e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf\" (UID: \"b0abf225-37e6-40a7-989c-50bcb88390a7\") " pod="openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf"
Sep 17 02:05:59.085148 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.085011    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0abf225-37e6-40a7-989c-50bcb88390a7-istio-envoy\") pod \"e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf\" (UID: \"b0abf225-37e6-40a7-989c-50bcb88390a7\") " pod="openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf"
Sep 17 02:05:59.085148 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.085029    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0abf225-37e6-40a7-989c-50bcb88390a7-istio-token\") pod \"e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf\" (UID: \"b0abf225-37e6-40a7-989c-50bcb88390a7\") " pod="openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf"
Sep 17 02:05:59.085148 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.085044    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0abf225-37e6-40a7-989c-50bcb88390a7-workload-socket\") pod \"e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf\" (UID: \"b0abf225-37e6-40a7-989c-50bcb88390a7\") " pod="openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf"
Sep 17 02:05:59.085148 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.085066    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0abf225-37e6-40a7-989c-50bcb88390a7-istiod-ca-cert\") pod \"e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf\" (UID: \"b0abf225-37e6-40a7-989c-50bcb88390a7\") " pod="openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf"
Sep 17 02:05:59.085148 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.085129    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0abf225-37e6-40a7-989c-50bcb88390a7-credential-socket\") pod \"e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf\" (UID: \"b0abf225-37e6-40a7-989c-50bcb88390a7\") " pod="openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf"
Sep 17 02:05:59.085409 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.085179    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stbbg\" (UniqueName: \"kubernetes.io/projected/b0abf225-37e6-40a7-989c-50bcb88390a7-kube-api-access-stbbg\") pod \"e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf\" (UID: \"b0abf225-37e6-40a7-989c-50bcb88390a7\") " pod="openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf"
Sep 17 02:05:59.085409 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.085219    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0abf225-37e6-40a7-989c-50bcb88390a7-workload-certs\") pod \"e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf\" (UID: \"b0abf225-37e6-40a7-989c-50bcb88390a7\") " pod="openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf"
Sep 17 02:05:59.085409 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.085241    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0abf225-37e6-40a7-989c-50bcb88390a7-istio-podinfo\") pod \"e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf\" (UID: \"b0abf225-37e6-40a7-989c-50bcb88390a7\") " pod="openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf"
Sep 17 02:05:59.186323 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.186289    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0abf225-37e6-40a7-989c-50bcb88390a7-workload-certs\") pod \"e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf\" (UID: \"b0abf225-37e6-40a7-989c-50bcb88390a7\") " pod="openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf"
Sep 17 02:05:59.186507 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.186328    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0abf225-37e6-40a7-989c-50bcb88390a7-istio-podinfo\") pod \"e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf\" (UID: \"b0abf225-37e6-40a7-989c-50bcb88390a7\") " pod="openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf"
Sep 17 02:05:59.186507 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.186367    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0abf225-37e6-40a7-989c-50bcb88390a7-istio-data\") pod \"e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf\" (UID: \"b0abf225-37e6-40a7-989c-50bcb88390a7\") " pod="openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf"
Sep 17 02:05:59.186507 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.186417    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0abf225-37e6-40a7-989c-50bcb88390a7-istio-envoy\") pod \"e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf\" (UID: \"b0abf225-37e6-40a7-989c-50bcb88390a7\") " pod="openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf"
Sep 17 02:05:59.186507 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.186443    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0abf225-37e6-40a7-989c-50bcb88390a7-istio-token\") pod \"e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf\" (UID: \"b0abf225-37e6-40a7-989c-50bcb88390a7\") " pod="openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf"
Sep 17 02:05:59.186507 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.186468    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0abf225-37e6-40a7-989c-50bcb88390a7-workload-socket\") pod \"e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf\" (UID: \"b0abf225-37e6-40a7-989c-50bcb88390a7\") " pod="openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf"
Sep 17 02:05:59.186789 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.186610    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0abf225-37e6-40a7-989c-50bcb88390a7-istiod-ca-cert\") pod \"e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf\" (UID: \"b0abf225-37e6-40a7-989c-50bcb88390a7\") " pod="openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf"
Sep 17 02:05:59.186789 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.186680    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0abf225-37e6-40a7-989c-50bcb88390a7-credential-socket\") pod \"e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf\" (UID: \"b0abf225-37e6-40a7-989c-50bcb88390a7\") " pod="openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf"
Sep 17 02:05:59.186789 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.186723    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stbbg\" (UniqueName: \"kubernetes.io/projected/b0abf225-37e6-40a7-989c-50bcb88390a7-kube-api-access-stbbg\") pod \"e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf\" (UID: \"b0abf225-37e6-40a7-989c-50bcb88390a7\") " pod="openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf"
Sep 17 02:05:59.186789 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.186754    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0abf225-37e6-40a7-989c-50bcb88390a7-workload-certs\") pod \"e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf\" (UID: \"b0abf225-37e6-40a7-989c-50bcb88390a7\") " pod="openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf"
Sep 17 02:05:59.186996 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.186801    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0abf225-37e6-40a7-989c-50bcb88390a7-istio-data\") pod \"e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf\" (UID: \"b0abf225-37e6-40a7-989c-50bcb88390a7\") " pod="openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf"
Sep 17 02:05:59.186996 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.186824    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0abf225-37e6-40a7-989c-50bcb88390a7-workload-socket\") pod \"e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf\" (UID: \"b0abf225-37e6-40a7-989c-50bcb88390a7\") " pod="openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf"
Sep 17 02:05:59.187140 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.187115    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0abf225-37e6-40a7-989c-50bcb88390a7-credential-socket\") pod \"e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf\" (UID: \"b0abf225-37e6-40a7-989c-50bcb88390a7\") " pod="openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf"
Sep 17 02:05:59.187471 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.187451    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0abf225-37e6-40a7-989c-50bcb88390a7-istiod-ca-cert\") pod \"e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf\" (UID: \"b0abf225-37e6-40a7-989c-50bcb88390a7\") " pod="openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf"
Sep 17 02:05:59.188668 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.188643    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0abf225-37e6-40a7-989c-50bcb88390a7-istio-envoy\") pod \"e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf\" (UID: \"b0abf225-37e6-40a7-989c-50bcb88390a7\") " pod="openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf"
Sep 17 02:05:59.188797 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.188779    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0abf225-37e6-40a7-989c-50bcb88390a7-istio-podinfo\") pod \"e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf\" (UID: \"b0abf225-37e6-40a7-989c-50bcb88390a7\") " pod="openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf"
Sep 17 02:05:59.195292 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.195271    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0abf225-37e6-40a7-989c-50bcb88390a7-istio-token\") pod \"e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf\" (UID: \"b0abf225-37e6-40a7-989c-50bcb88390a7\") " pod="openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf"
Sep 17 02:05:59.195681 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.195657    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stbbg\" (UniqueName: \"kubernetes.io/projected/b0abf225-37e6-40a7-989c-50bcb88390a7-kube-api-access-stbbg\") pod \"e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf\" (UID: \"b0abf225-37e6-40a7-989c-50bcb88390a7\") " pod="openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf"
Sep 17 02:05:59.334980 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.334936    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf"
Sep 17 02:05:59.618354 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.618325    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf"]
Sep 17 02:05:59.621147 ip-10-0-143-95 kubenswrapper[2560]: W0917 02:05:59.621117    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0abf225_37e6_40a7_989c_50bcb88390a7.slice/crio-6762d75c8c08ce8d89aef286456290382c1ea9cea1a2666247a89041ebaf8766 WatchSource:0}: Error finding container 6762d75c8c08ce8d89aef286456290382c1ea9cea1a2666247a89041ebaf8766: Status 404 returned error can't find the container with id 6762d75c8c08ce8d89aef286456290382c1ea9cea1a2666247a89041ebaf8766
Sep 17 02:05:59.623662 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.623607    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 02:05:59.623855 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.623691    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 02:05:59.623855 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:05:59.623729    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 02:06:00.209491 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:00.209453    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf" event={"ID":"b0abf225-37e6-40a7-989c-50bcb88390a7","Type":"ContainerStarted","Data":"059ba489e05effdf731f3412c021ed39211aa68dc018ff960e063f8496592b15"}
Sep 17 02:06:00.209858 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:00.209517    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf" event={"ID":"b0abf225-37e6-40a7-989c-50bcb88390a7","Type":"ContainerStarted","Data":"6762d75c8c08ce8d89aef286456290382c1ea9cea1a2666247a89041ebaf8766"}
Sep 17 02:06:00.233579 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:00.233531    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf" podStartSLOduration=1.233516738 podStartE2EDuration="1.233516738s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 02:05:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:06:00.231170681 +0000 UTC m=+1718.481147993" watchObservedRunningTime="2026-09-17 02:06:00.233516738 +0000 UTC m=+1718.483494050"
Sep 17 02:06:00.335479 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:00.335445    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf"
Sep 17 02:06:00.346224 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:00.346194    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf"
Sep 17 02:06:01.214545 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:01.214515    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf"
Sep 17 02:06:01.215392 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:01.215372    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf"
Sep 17 02:06:05.964086 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:05.964051    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-11a2e3-f68b6559d-8sdqx"]
Sep 17 02:06:05.964517 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:05.964449    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04476ca5-bc8f-4e8e-b711-835ce6e40037" containerName="istio-proxy"
Sep 17 02:06:05.964517 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:05.964461    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="04476ca5-bc8f-4e8e-b711-835ce6e40037" containerName="istio-proxy"
Sep 17 02:06:05.967769 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:05.967747    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-11a2e3-f68b6559d-8sdqx"
Sep 17 02:06:05.969623 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:05.969599    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-11a2e3-dockercfg-2m6mb\""
Sep 17 02:06:05.969710 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:05.969599    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-11a2e3\""
Sep 17 02:06:05.976582 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:05.976561    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-11a2e3-f68b6559d-8sdqx"]
Sep 17 02:06:05.994743 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:05.994715    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-11a2e3-76fd49757c-zn2nz"]
Sep 17 02:06:05.998150 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:05.998133    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-11a2e3-76fd49757c-zn2nz"
Sep 17 02:06:06.007354 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:06.007331    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-11a2e3-76fd49757c-zn2nz"]
Sep 17 02:06:06.059183 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:06.059125    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62tqq\" (UniqueName: \"kubernetes.io/projected/8e096fa4-669e-444d-a7a5-a10d52c5d32a-kube-api-access-62tqq\") pod \"payload-processing-e2e-api-a-11a2e3-76fd49757c-zn2nz\" (UID: \"8e096fa4-669e-444d-a7a5-a10d52c5d32a\") " pod="openshift-ingress/payload-processing-e2e-api-a-11a2e3-76fd49757c-zn2nz"
Sep 17 02:06:06.059399 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:06.059189    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/640f2048-9d11-4a04-ab4a-c7cc7b7dbf0f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-11a2e3-f68b6559d-8sdqx\" (UID: \"640f2048-9d11-4a04-ab4a-c7cc7b7dbf0f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-11a2e3-f68b6559d-8sdqx"
Sep 17 02:06:06.059479 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:06.059406    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ms82\" (UniqueName: \"kubernetes.io/projected/640f2048-9d11-4a04-ab4a-c7cc7b7dbf0f-kube-api-access-4ms82\") pod \"payload-pre-processing-e2e-api-a-11a2e3-f68b6559d-8sdqx\" (UID: \"640f2048-9d11-4a04-ab4a-c7cc7b7dbf0f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-11a2e3-f68b6559d-8sdqx"
Sep 17 02:06:06.059479 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:06.059457    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e096fa4-669e-444d-a7a5-a10d52c5d32a-plugins-config-volume\") pod \"payload-processing-e2e-api-a-11a2e3-76fd49757c-zn2nz\" (UID: \"8e096fa4-669e-444d-a7a5-a10d52c5d32a\") " pod="openshift-ingress/payload-processing-e2e-api-a-11a2e3-76fd49757c-zn2nz"
Sep 17 02:06:06.160091 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:06.160044    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62tqq\" (UniqueName: \"kubernetes.io/projected/8e096fa4-669e-444d-a7a5-a10d52c5d32a-kube-api-access-62tqq\") pod \"payload-processing-e2e-api-a-11a2e3-76fd49757c-zn2nz\" (UID: \"8e096fa4-669e-444d-a7a5-a10d52c5d32a\") " pod="openshift-ingress/payload-processing-e2e-api-a-11a2e3-76fd49757c-zn2nz"
Sep 17 02:06:06.160091 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:06.160083    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/640f2048-9d11-4a04-ab4a-c7cc7b7dbf0f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-11a2e3-f68b6559d-8sdqx\" (UID: \"640f2048-9d11-4a04-ab4a-c7cc7b7dbf0f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-11a2e3-f68b6559d-8sdqx"
Sep 17 02:06:06.160387 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:06.160141    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ms82\" (UniqueName: \"kubernetes.io/projected/640f2048-9d11-4a04-ab4a-c7cc7b7dbf0f-kube-api-access-4ms82\") pod \"payload-pre-processing-e2e-api-a-11a2e3-f68b6559d-8sdqx\" (UID: \"640f2048-9d11-4a04-ab4a-c7cc7b7dbf0f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-11a2e3-f68b6559d-8sdqx"
Sep 17 02:06:06.160387 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:06.160165    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e096fa4-669e-444d-a7a5-a10d52c5d32a-plugins-config-volume\") pod \"payload-processing-e2e-api-a-11a2e3-76fd49757c-zn2nz\" (UID: \"8e096fa4-669e-444d-a7a5-a10d52c5d32a\") " pod="openshift-ingress/payload-processing-e2e-api-a-11a2e3-76fd49757c-zn2nz"
Sep 17 02:06:06.160907 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:06.160873    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e096fa4-669e-444d-a7a5-a10d52c5d32a-plugins-config-volume\") pod \"payload-processing-e2e-api-a-11a2e3-76fd49757c-zn2nz\" (UID: \"8e096fa4-669e-444d-a7a5-a10d52c5d32a\") " pod="openshift-ingress/payload-processing-e2e-api-a-11a2e3-76fd49757c-zn2nz"
Sep 17 02:06:06.161011 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:06.160888    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/640f2048-9d11-4a04-ab4a-c7cc7b7dbf0f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-11a2e3-f68b6559d-8sdqx\" (UID: \"640f2048-9d11-4a04-ab4a-c7cc7b7dbf0f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-11a2e3-f68b6559d-8sdqx"
Sep 17 02:06:06.167503 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:06.167480    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ms82\" (UniqueName: \"kubernetes.io/projected/640f2048-9d11-4a04-ab4a-c7cc7b7dbf0f-kube-api-access-4ms82\") pod \"payload-pre-processing-e2e-api-a-11a2e3-f68b6559d-8sdqx\" (UID: \"640f2048-9d11-4a04-ab4a-c7cc7b7dbf0f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-11a2e3-f68b6559d-8sdqx"
Sep 17 02:06:06.167680 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:06.167657    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62tqq\" (UniqueName: \"kubernetes.io/projected/8e096fa4-669e-444d-a7a5-a10d52c5d32a-kube-api-access-62tqq\") pod \"payload-processing-e2e-api-a-11a2e3-76fd49757c-zn2nz\" (UID: \"8e096fa4-669e-444d-a7a5-a10d52c5d32a\") " pod="openshift-ingress/payload-processing-e2e-api-a-11a2e3-76fd49757c-zn2nz"
Sep 17 02:06:06.280161 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:06.280075    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-11a2e3-f68b6559d-8sdqx"
Sep 17 02:06:06.309132 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:06.309097    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-11a2e3-76fd49757c-zn2nz"
Sep 17 02:06:06.551409 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:06.551176    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-11a2e3-f68b6559d-8sdqx"]
Sep 17 02:06:06.554087 ip-10-0-143-95 kubenswrapper[2560]: W0917 02:06:06.554058    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod640f2048_9d11_4a04_ab4a_c7cc7b7dbf0f.slice/crio-09272c87fa6d0f61aa16003d3628178ead569ba51b4b0e021b005f2b28f47b67 WatchSource:0}: Error finding container 09272c87fa6d0f61aa16003d3628178ead569ba51b4b0e021b005f2b28f47b67: Status 404 returned error can't find the container with id 09272c87fa6d0f61aa16003d3628178ead569ba51b4b0e021b005f2b28f47b67
Sep 17 02:06:06.592085 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:06.592048    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-11a2e3-76fd49757c-zn2nz"]
Sep 17 02:06:06.602659 ip-10-0-143-95 kubenswrapper[2560]: W0917 02:06:06.602619    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e096fa4_669e_444d_a7a5_a10d52c5d32a.slice/crio-75b859210c4589057d3420fce848e1e1c837b6b6b2ce548d5b5269f1873a849d WatchSource:0}: Error finding container 75b859210c4589057d3420fce848e1e1c837b6b6b2ce548d5b5269f1873a849d: Status 404 returned error can't find the container with id 75b859210c4589057d3420fce848e1e1c837b6b6b2ce548d5b5269f1873a849d
Sep 17 02:06:07.246536 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:07.246497    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-11a2e3-f68b6559d-8sdqx" event={"ID":"640f2048-9d11-4a04-ab4a-c7cc7b7dbf0f","Type":"ContainerStarted","Data":"0df260894e3bc63de5d5e6900e97eeab6b767888fd554d0a3f0c0920f2a320b4"}
Sep 17 02:06:07.247106 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:07.246563    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-11a2e3-f68b6559d-8sdqx"
Sep 17 02:06:07.247106 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:07.246589    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-11a2e3-f68b6559d-8sdqx" event={"ID":"640f2048-9d11-4a04-ab4a-c7cc7b7dbf0f","Type":"ContainerStarted","Data":"09272c87fa6d0f61aa16003d3628178ead569ba51b4b0e021b005f2b28f47b67"}
Sep 17 02:06:07.248146 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:07.248121    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-11a2e3-76fd49757c-zn2nz" event={"ID":"8e096fa4-669e-444d-a7a5-a10d52c5d32a","Type":"ContainerStarted","Data":"0f5e30dced5cd09d722178a2b7044ed17fd2fd7481d823df5fb32a8d7a076531"}
Sep 17 02:06:07.248289 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:07.248175    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-11a2e3-76fd49757c-zn2nz" event={"ID":"8e096fa4-669e-444d-a7a5-a10d52c5d32a","Type":"ContainerStarted","Data":"75b859210c4589057d3420fce848e1e1c837b6b6b2ce548d5b5269f1873a849d"}
Sep 17 02:06:07.248289 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:07.248205    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-11a2e3-76fd49757c-zn2nz"
Sep 17 02:06:07.261864 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:07.261822    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-11a2e3-f68b6559d-8sdqx" podStartSLOduration=2.261807931 podStartE2EDuration="2.261807931s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 02:06:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:06:07.260075975 +0000 UTC m=+1725.510053287" watchObservedRunningTime="2026-09-17 02:06:07.261807931 +0000 UTC m=+1725.511785243"
Sep 17 02:06:07.275565 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:07.275489    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-11a2e3-76fd49757c-zn2nz" podStartSLOduration=2.275472058 podStartE2EDuration="2.275472058s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 02:06:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:06:07.273597809 +0000 UTC m=+1725.523575121" watchObservedRunningTime="2026-09-17 02:06:07.275472058 +0000 UTC m=+1725.525449375"
Sep 17 02:06:18.258585 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:18.258546    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-11a2e3-76fd49757c-zn2nz"
Sep 17 02:06:18.259092 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:18.258679    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-11a2e3-f68b6559d-8sdqx"
Sep 17 02:06:21.327787 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:21.327756    2560 generic.go:356] "Generic (PLEG): container finished" podID="b0abf225-37e6-40a7-989c-50bcb88390a7" containerID="059ba489e05effdf731f3412c021ed39211aa68dc018ff960e063f8496592b15" exitCode=0
Sep 17 02:06:21.328201 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:21.327829    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf" event={"ID":"b0abf225-37e6-40a7-989c-50bcb88390a7","Type":"ContainerDied","Data":"059ba489e05effdf731f3412c021ed39211aa68dc018ff960e063f8496592b15"}
Sep 17 02:06:21.328327 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:21.328309    2560 scope.go:117] "RemoveContainer" containerID="059ba489e05effdf731f3412c021ed39211aa68dc018ff960e063f8496592b15"
Sep 17 02:06:21.329460 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:21.329433    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 02:06:21.329528 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:21.329498    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 02:06:21.329565 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:21.329530    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 02:06:22.335010 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:22.334972    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf" event={"ID":"b0abf225-37e6-40a7-989c-50bcb88390a7","Type":"ContainerStarted","Data":"e09e7c5cc57d68ba95f50b33689c3de0ccfbebd0a4cefa17fe7ba38813ec7bfd"}
Sep 17 02:06:23.335870 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:23.335830    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf"
Sep 17 02:06:23.336383 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:23.336062    2560 patch_prober.go:28] interesting pod/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 17 02:06:23.336383 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:23.336135    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf" podUID="b0abf225-37e6-40a7-989c-50bcb88390a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 17 02:06:24.336218 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:24.336184    2560 patch_prober.go:28] interesting pod/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 17 02:06:24.336618 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:24.336267    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf" podUID="b0abf225-37e6-40a7-989c-50bcb88390a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 17 02:06:25.336131 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:25.336093    2560 patch_prober.go:28] interesting pod/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 17 02:06:25.336341 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:25.336151    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf" podUID="b0abf225-37e6-40a7-989c-50bcb88390a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 17 02:06:26.335424 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:26.335386    2560 patch_prober.go:28] interesting pod/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 17 02:06:26.335606 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:26.335463    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf" podUID="b0abf225-37e6-40a7-989c-50bcb88390a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 17 02:06:27.335442 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:27.335407    2560 patch_prober.go:28] interesting pod/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 17 02:06:27.335849 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:27.335462    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf" podUID="b0abf225-37e6-40a7-989c-50bcb88390a7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 17 02:06:28.339466 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:28.339432    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf"
Sep 17 02:06:28.339900 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:28.339747    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf"
Sep 17 02:06:28.340474 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:28.340457    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf"
Sep 17 02:06:33.135404 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:33.135361    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp"]
Sep 17 02:06:33.138547 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:33.138525    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp"
Sep 17 02:06:33.140387 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:33.140366    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-320e88-openshift-default-dockercfg-89d9l\""
Sep 17 02:06:33.151654 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:33.151627    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp"]
Sep 17 02:06:33.231238 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:33.231205    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eec0370a-c385-469b-8697-b0534845007b-workload-certs\") pod \"e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp\" (UID: \"eec0370a-c385-469b-8697-b0534845007b\") " pod="openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp"
Sep 17 02:06:33.231453 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:33.231265    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eec0370a-c385-469b-8697-b0534845007b-istio-data\") pod \"e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp\" (UID: \"eec0370a-c385-469b-8697-b0534845007b\") " pod="openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp"
Sep 17 02:06:33.231453 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:33.231337    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eec0370a-c385-469b-8697-b0534845007b-istio-token\") pod \"e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp\" (UID: \"eec0370a-c385-469b-8697-b0534845007b\") " pod="openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp"
Sep 17 02:06:33.231453 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:33.231378    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eec0370a-c385-469b-8697-b0534845007b-workload-socket\") pod \"e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp\" (UID: \"eec0370a-c385-469b-8697-b0534845007b\") " pod="openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp"
Sep 17 02:06:33.231453 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:33.231401    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eec0370a-c385-469b-8697-b0534845007b-istio-envoy\") pod \"e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp\" (UID: \"eec0370a-c385-469b-8697-b0534845007b\") " pod="openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp"
Sep 17 02:06:33.231694 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:33.231477    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67kj2\" (UniqueName: \"kubernetes.io/projected/eec0370a-c385-469b-8697-b0534845007b-kube-api-access-67kj2\") pod \"e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp\" (UID: \"eec0370a-c385-469b-8697-b0534845007b\") " pod="openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp"
Sep 17 02:06:33.231694 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:33.231502    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eec0370a-c385-469b-8697-b0534845007b-istiod-ca-cert\") pod \"e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp\" (UID: \"eec0370a-c385-469b-8697-b0534845007b\") " pod="openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp"
Sep 17 02:06:33.231694 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:33.231567    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eec0370a-c385-469b-8697-b0534845007b-istio-podinfo\") pod \"e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp\" (UID: \"eec0370a-c385-469b-8697-b0534845007b\") " pod="openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp"
Sep 17 02:06:33.231694 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:33.231590    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eec0370a-c385-469b-8697-b0534845007b-credential-socket\") pod \"e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp\" (UID: \"eec0370a-c385-469b-8697-b0534845007b\") " pod="openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp"
Sep 17 02:06:33.332861 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:33.332827    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eec0370a-c385-469b-8697-b0534845007b-istio-podinfo\") pod \"e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp\" (UID: \"eec0370a-c385-469b-8697-b0534845007b\") " pod="openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp"
Sep 17 02:06:33.332861 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:33.332867    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eec0370a-c385-469b-8697-b0534845007b-credential-socket\") pod \"e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp\" (UID: \"eec0370a-c385-469b-8697-b0534845007b\") " pod="openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp"
Sep 17 02:06:33.333079 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:33.332906    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eec0370a-c385-469b-8697-b0534845007b-workload-certs\") pod \"e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp\" (UID: \"eec0370a-c385-469b-8697-b0534845007b\") " pod="openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp"
Sep 17 02:06:33.333079 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:33.332937    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eec0370a-c385-469b-8697-b0534845007b-istio-data\") pod \"e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp\" (UID: \"eec0370a-c385-469b-8697-b0534845007b\") " pod="openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp"
Sep 17 02:06:33.333079 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:33.332988    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eec0370a-c385-469b-8697-b0534845007b-istio-token\") pod \"e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp\" (UID: \"eec0370a-c385-469b-8697-b0534845007b\") " pod="openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp"
Sep 17 02:06:33.333079 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:33.333017    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eec0370a-c385-469b-8697-b0534845007b-workload-socket\") pod \"e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp\" (UID: \"eec0370a-c385-469b-8697-b0534845007b\") " pod="openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp"
Sep 17 02:06:33.333079 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:33.333047    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eec0370a-c385-469b-8697-b0534845007b-istio-envoy\") pod \"e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp\" (UID: \"eec0370a-c385-469b-8697-b0534845007b\") " pod="openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp"
Sep 17 02:06:33.333365 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:33.333099    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67kj2\" (UniqueName: \"kubernetes.io/projected/eec0370a-c385-469b-8697-b0534845007b-kube-api-access-67kj2\") pod \"e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp\" (UID: \"eec0370a-c385-469b-8697-b0534845007b\") " pod="openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp"
Sep 17 02:06:33.333365 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:33.333128    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eec0370a-c385-469b-8697-b0534845007b-istiod-ca-cert\") pod \"e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp\" (UID: \"eec0370a-c385-469b-8697-b0534845007b\") " pod="openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp"
Sep 17 02:06:33.333481 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:33.333381    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eec0370a-c385-469b-8697-b0534845007b-istio-data\") pod \"e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp\" (UID: \"eec0370a-c385-469b-8697-b0534845007b\") " pod="openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp"
Sep 17 02:06:33.333481 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:33.333413    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eec0370a-c385-469b-8697-b0534845007b-credential-socket\") pod \"e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp\" (UID: \"eec0370a-c385-469b-8697-b0534845007b\") " pod="openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp"
Sep 17 02:06:33.333790 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:33.333763    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eec0370a-c385-469b-8697-b0534845007b-workload-socket\") pod \"e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp\" (UID: \"eec0370a-c385-469b-8697-b0534845007b\") " pod="openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp"
Sep 17 02:06:33.333915 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:33.333800    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eec0370a-c385-469b-8697-b0534845007b-workload-certs\") pod \"e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp\" (UID: \"eec0370a-c385-469b-8697-b0534845007b\") " pod="openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp"
Sep 17 02:06:33.334113 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:33.334096    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eec0370a-c385-469b-8697-b0534845007b-istiod-ca-cert\") pod \"e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp\" (UID: \"eec0370a-c385-469b-8697-b0534845007b\") " pod="openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp"
Sep 17 02:06:33.335489 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:33.335449    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eec0370a-c385-469b-8697-b0534845007b-istio-envoy\") pod \"e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp\" (UID: \"eec0370a-c385-469b-8697-b0534845007b\") " pod="openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp"
Sep 17 02:06:33.335580 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:33.335496    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eec0370a-c385-469b-8697-b0534845007b-istio-podinfo\") pod \"e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp\" (UID: \"eec0370a-c385-469b-8697-b0534845007b\") " pod="openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp"
Sep 17 02:06:33.340918 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:33.340873    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67kj2\" (UniqueName: \"kubernetes.io/projected/eec0370a-c385-469b-8697-b0534845007b-kube-api-access-67kj2\") pod \"e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp\" (UID: \"eec0370a-c385-469b-8697-b0534845007b\") " pod="openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp"
Sep 17 02:06:33.340918 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:33.340910    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eec0370a-c385-469b-8697-b0534845007b-istio-token\") pod \"e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp\" (UID: \"eec0370a-c385-469b-8697-b0534845007b\") " pod="openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp"
Sep 17 02:06:33.448939 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:33.448845    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp"
Sep 17 02:06:33.723435 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:33.723411    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp"]
Sep 17 02:06:33.725682 ip-10-0-143-95 kubenswrapper[2560]: W0917 02:06:33.725652    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeec0370a_c385_469b_8697_b0534845007b.slice/crio-956620d6e275ce0df0313ff04d4966395a64d26bf5403760eb2d02c2b2e0871f WatchSource:0}: Error finding container 956620d6e275ce0df0313ff04d4966395a64d26bf5403760eb2d02c2b2e0871f: Status 404 returned error can't find the container with id 956620d6e275ce0df0313ff04d4966395a64d26bf5403760eb2d02c2b2e0871f
Sep 17 02:06:33.728286 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:33.728225    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 02:06:33.728386 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:33.728321    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 02:06:33.728386 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:33.728352    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 02:06:34.399427 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:34.399392    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp" event={"ID":"eec0370a-c385-469b-8697-b0534845007b","Type":"ContainerStarted","Data":"19f362d8e6a9d57e573531385efeb88ac44ad804fdc5efe5023224dd37e10958"}
Sep 17 02:06:34.399819 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:34.399449    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp" event={"ID":"eec0370a-c385-469b-8697-b0534845007b","Type":"ContainerStarted","Data":"956620d6e275ce0df0313ff04d4966395a64d26bf5403760eb2d02c2b2e0871f"}
Sep 17 02:06:34.418160 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:34.418112    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp" podStartSLOduration=1.418097902 podStartE2EDuration="1.418097902s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 02:06:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:06:34.415955645 +0000 UTC m=+1752.665932958" watchObservedRunningTime="2026-09-17 02:06:34.418097902 +0000 UTC m=+1752.668075214"
Sep 17 02:06:34.449811 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:34.449781    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp"
Sep 17 02:06:34.455186 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:34.455160    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp"
Sep 17 02:06:35.404608 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:35.404577    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp"
Sep 17 02:06:35.405712 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:35.405691    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp"
Sep 17 02:06:41.025158 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:41.025120    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-320e88-85d77dc7bb-lmcvz"]
Sep 17 02:06:41.028094 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:41.028077    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-320e88-85d77dc7bb-lmcvz"
Sep 17 02:06:41.029809 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:41.029785    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-320e88-dockercfg-526w7\""
Sep 17 02:06:41.029940 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:41.029880    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-320e88\""
Sep 17 02:06:41.038536 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:41.038514    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-320e88-85d77dc7bb-lmcvz"]
Sep 17 02:06:41.110708 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:41.110666    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81f4be0e-c8c7-4a95-8415-ce25e167a7ab-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-320e88-85d77dc7bb-lmcvz\" (UID: \"81f4be0e-c8c7-4a95-8415-ce25e167a7ab\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-320e88-85d77dc7bb-lmcvz"
Sep 17 02:06:41.110880 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:41.110720    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5498n\" (UniqueName: \"kubernetes.io/projected/81f4be0e-c8c7-4a95-8415-ce25e167a7ab-kube-api-access-5498n\") pod \"payload-pre-processing-e2e-api-b-320e88-85d77dc7bb-lmcvz\" (UID: \"81f4be0e-c8c7-4a95-8415-ce25e167a7ab\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-320e88-85d77dc7bb-lmcvz"
Sep 17 02:06:41.211945 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:41.211902    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81f4be0e-c8c7-4a95-8415-ce25e167a7ab-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-320e88-85d77dc7bb-lmcvz\" (UID: \"81f4be0e-c8c7-4a95-8415-ce25e167a7ab\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-320e88-85d77dc7bb-lmcvz"
Sep 17 02:06:41.212130 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:41.211964    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5498n\" (UniqueName: \"kubernetes.io/projected/81f4be0e-c8c7-4a95-8415-ce25e167a7ab-kube-api-access-5498n\") pod \"payload-pre-processing-e2e-api-b-320e88-85d77dc7bb-lmcvz\" (UID: \"81f4be0e-c8c7-4a95-8415-ce25e167a7ab\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-320e88-85d77dc7bb-lmcvz"
Sep 17 02:06:41.212735 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:41.212714    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81f4be0e-c8c7-4a95-8415-ce25e167a7ab-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-320e88-85d77dc7bb-lmcvz\" (UID: \"81f4be0e-c8c7-4a95-8415-ce25e167a7ab\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-320e88-85d77dc7bb-lmcvz"
Sep 17 02:06:41.219024 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:41.218990    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5498n\" (UniqueName: \"kubernetes.io/projected/81f4be0e-c8c7-4a95-8415-ce25e167a7ab-kube-api-access-5498n\") pod \"payload-pre-processing-e2e-api-b-320e88-85d77dc7bb-lmcvz\" (UID: \"81f4be0e-c8c7-4a95-8415-ce25e167a7ab\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-320e88-85d77dc7bb-lmcvz"
Sep 17 02:06:41.340052 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:41.340021    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-320e88-85d77dc7bb-lmcvz"
Sep 17 02:06:41.611598 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:41.611569    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-320e88-85d77dc7bb-lmcvz"]
Sep 17 02:06:41.613727 ip-10-0-143-95 kubenswrapper[2560]: W0917 02:06:41.613696    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81f4be0e_c8c7_4a95_8415_ce25e167a7ab.slice/crio-b29a0b5701b7e3a90817ee17e330cc03edfc02a0d141d3f83677452b1094b79e WatchSource:0}: Error finding container b29a0b5701b7e3a90817ee17e330cc03edfc02a0d141d3f83677452b1094b79e: Status 404 returned error can't find the container with id b29a0b5701b7e3a90817ee17e330cc03edfc02a0d141d3f83677452b1094b79e
Sep 17 02:06:42.442396 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:42.442359    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-320e88-85d77dc7bb-lmcvz" event={"ID":"81f4be0e-c8c7-4a95-8415-ce25e167a7ab","Type":"ContainerStarted","Data":"de426cbdf6d5ab272c086162a5af877e991f99080d9e0920e6b9746325ddb078"}
Sep 17 02:06:42.442790 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:42.442413    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-320e88-85d77dc7bb-lmcvz" event={"ID":"81f4be0e-c8c7-4a95-8415-ce25e167a7ab","Type":"ContainerStarted","Data":"b29a0b5701b7e3a90817ee17e330cc03edfc02a0d141d3f83677452b1094b79e"}
Sep 17 02:06:42.442790 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:42.442453    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-320e88-85d77dc7bb-lmcvz"
Sep 17 02:06:42.457039 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:42.456976    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-320e88-85d77dc7bb-lmcvz" podStartSLOduration=1.456956175 podStartE2EDuration="1.456956175s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 02:06:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:06:42.455871466 +0000 UTC m=+1760.705848778" watchObservedRunningTime="2026-09-17 02:06:42.456956175 +0000 UTC m=+1760.706933490"
Sep 17 02:06:53.450718 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:53.450685    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-320e88-85d77dc7bb-lmcvz"
Sep 17 02:06:58.527196 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:58.527162    2560 generic.go:356] "Generic (PLEG): container finished" podID="eec0370a-c385-469b-8697-b0534845007b" containerID="19f362d8e6a9d57e573531385efeb88ac44ad804fdc5efe5023224dd37e10958" exitCode=0
Sep 17 02:06:58.527657 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:58.527235    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp" event={"ID":"eec0370a-c385-469b-8697-b0534845007b","Type":"ContainerDied","Data":"19f362d8e6a9d57e573531385efeb88ac44ad804fdc5efe5023224dd37e10958"}
Sep 17 02:06:58.527657 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:58.527638    2560 scope.go:117] "RemoveContainer" containerID="19f362d8e6a9d57e573531385efeb88ac44ad804fdc5efe5023224dd37e10958"
Sep 17 02:06:58.528852 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:58.528818    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 02:06:58.528973 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:58.528914    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 02:06:58.528973 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:58.528965    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 02:06:59.534331 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:06:59.534293    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp" event={"ID":"eec0370a-c385-469b-8697-b0534845007b","Type":"ContainerStarted","Data":"065d0dbaa46f05e7fe42b98c58581092ec76f2c143992fc095ee606a81dc9999"}
Sep 17 02:07:00.449986 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:00.449951    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp"
Sep 17 02:07:00.450257 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:00.450222    2560 patch_prober.go:28] interesting pod/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 17 02:07:00.450312 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:00.450295    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp" podUID="eec0370a-c385-469b-8697-b0534845007b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 17 02:07:01.450090 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:01.450053    2560 patch_prober.go:28] interesting pod/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 17 02:07:01.450541 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:01.450112    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp" podUID="eec0370a-c385-469b-8697-b0534845007b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 17 02:07:02.450035 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:02.449989    2560 patch_prober.go:28] interesting pod/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 17 02:07:02.450262 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:02.450051    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp" podUID="eec0370a-c385-469b-8697-b0534845007b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 17 02:07:03.449800 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:03.449761    2560 patch_prober.go:28] interesting pod/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 17 02:07:03.449985 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:03.449818    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp" podUID="eec0370a-c385-469b-8697-b0534845007b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 17 02:07:04.449519 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:04.449489    2560 patch_prober.go:28] interesting pod/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 17 02:07:04.449926 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:04.449541    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp" podUID="eec0370a-c385-469b-8697-b0534845007b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 17 02:07:05.405387 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:05.405346    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp"
Sep 17 02:07:05.454780 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:05.454747    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp"
Sep 17 02:07:05.572721 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:05.572693    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp"
Sep 17 02:07:25.412921 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:25.412878    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-11a2e3-76fd49757c-zn2nz"]
Sep 17 02:07:25.413496 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:25.413196    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-11a2e3-76fd49757c-zn2nz" podUID="8e096fa4-669e-444d-a7a5-a10d52c5d32a" containerName="payload-processing" containerID="cri-o://0f5e30dced5cd09d722178a2b7044ed17fd2fd7481d823df5fb32a8d7a076531" gracePeriod=30
Sep 17 02:07:25.424472 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:25.424440    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-11a2e3-f68b6559d-8sdqx"]
Sep 17 02:07:25.424747 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:25.424681    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-11a2e3-f68b6559d-8sdqx" podUID="640f2048-9d11-4a04-ab4a-c7cc7b7dbf0f" containerName="payload-pre-processing" containerID="cri-o://0df260894e3bc63de5d5e6900e97eeab6b767888fd554d0a3f0c0920f2a320b4" gracePeriod=30
Sep 17 02:07:25.674948 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:25.674870    2560 generic.go:356] "Generic (PLEG): container finished" podID="8e096fa4-669e-444d-a7a5-a10d52c5d32a" containerID="0f5e30dced5cd09d722178a2b7044ed17fd2fd7481d823df5fb32a8d7a076531" exitCode=0
Sep 17 02:07:25.675087 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:25.674947    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-11a2e3-76fd49757c-zn2nz" event={"ID":"8e096fa4-669e-444d-a7a5-a10d52c5d32a","Type":"ContainerDied","Data":"0f5e30dced5cd09d722178a2b7044ed17fd2fd7481d823df5fb32a8d7a076531"}
Sep 17 02:07:25.675087 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:25.675019    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-11a2e3-76fd49757c-zn2nz" event={"ID":"8e096fa4-669e-444d-a7a5-a10d52c5d32a","Type":"ContainerDied","Data":"75b859210c4589057d3420fce848e1e1c837b6b6b2ce548d5b5269f1873a849d"}
Sep 17 02:07:25.675087 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:25.675042    2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="75b859210c4589057d3420fce848e1e1c837b6b6b2ce548d5b5269f1873a849d"
Sep 17 02:07:25.677033 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:25.677004    2560 generic.go:356] "Generic (PLEG): container finished" podID="640f2048-9d11-4a04-ab4a-c7cc7b7dbf0f" containerID="0df260894e3bc63de5d5e6900e97eeab6b767888fd554d0a3f0c0920f2a320b4" exitCode=0
Sep 17 02:07:25.677170 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:25.677041    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-11a2e3-f68b6559d-8sdqx" event={"ID":"640f2048-9d11-4a04-ab4a-c7cc7b7dbf0f","Type":"ContainerDied","Data":"0df260894e3bc63de5d5e6900e97eeab6b767888fd554d0a3f0c0920f2a320b4"}
Sep 17 02:07:25.684605 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:25.684577    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-11a2e3-76fd49757c-zn2nz"
Sep 17 02:07:25.713342 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:25.713315    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-11a2e3-f68b6559d-8sdqx"
Sep 17 02:07:25.754832 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:25.754354    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62tqq\" (UniqueName: \"kubernetes.io/projected/8e096fa4-669e-444d-a7a5-a10d52c5d32a-kube-api-access-62tqq\") pod \"8e096fa4-669e-444d-a7a5-a10d52c5d32a\" (UID: \"8e096fa4-669e-444d-a7a5-a10d52c5d32a\") "
Sep 17 02:07:25.754832 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:25.754453    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e096fa4-669e-444d-a7a5-a10d52c5d32a-plugins-config-volume\") pod \"8e096fa4-669e-444d-a7a5-a10d52c5d32a\" (UID: \"8e096fa4-669e-444d-a7a5-a10d52c5d32a\") "
Sep 17 02:07:25.754832 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:25.754496    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/640f2048-9d11-4a04-ab4a-c7cc7b7dbf0f-plugins-config-volume\") pod \"640f2048-9d11-4a04-ab4a-c7cc7b7dbf0f\" (UID: \"640f2048-9d11-4a04-ab4a-c7cc7b7dbf0f\") "
Sep 17 02:07:25.754832 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:25.754520    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4ms82\" (UniqueName: \"kubernetes.io/projected/640f2048-9d11-4a04-ab4a-c7cc7b7dbf0f-kube-api-access-4ms82\") pod \"640f2048-9d11-4a04-ab4a-c7cc7b7dbf0f\" (UID: \"640f2048-9d11-4a04-ab4a-c7cc7b7dbf0f\") "
Sep 17 02:07:25.755842 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:25.755792    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e096fa4-669e-444d-a7a5-a10d52c5d32a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8e096fa4-669e-444d-a7a5-a10d52c5d32a" (UID: "8e096fa4-669e-444d-a7a5-a10d52c5d32a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 02:07:25.756586 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:25.756533    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/640f2048-9d11-4a04-ab4a-c7cc7b7dbf0f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "640f2048-9d11-4a04-ab4a-c7cc7b7dbf0f" (UID: "640f2048-9d11-4a04-ab4a-c7cc7b7dbf0f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 02:07:25.758775 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:25.758733    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/640f2048-9d11-4a04-ab4a-c7cc7b7dbf0f-kube-api-access-4ms82" (OuterVolumeSpecName: "kube-api-access-4ms82") pod "640f2048-9d11-4a04-ab4a-c7cc7b7dbf0f" (UID: "640f2048-9d11-4a04-ab4a-c7cc7b7dbf0f"). InnerVolumeSpecName "kube-api-access-4ms82". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 02:07:25.760000 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:25.759957    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e096fa4-669e-444d-a7a5-a10d52c5d32a-kube-api-access-62tqq" (OuterVolumeSpecName: "kube-api-access-62tqq") pod "8e096fa4-669e-444d-a7a5-a10d52c5d32a" (UID: "8e096fa4-669e-444d-a7a5-a10d52c5d32a"). InnerVolumeSpecName "kube-api-access-62tqq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 02:07:25.855773 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:25.855730    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62tqq\" (UniqueName: \"kubernetes.io/projected/8e096fa4-669e-444d-a7a5-a10d52c5d32a-kube-api-access-62tqq\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:07:25.855773 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:25.855766    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e096fa4-669e-444d-a7a5-a10d52c5d32a-plugins-config-volume\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:07:25.855773 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:25.855776    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/640f2048-9d11-4a04-ab4a-c7cc7b7dbf0f-plugins-config-volume\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:07:25.855773 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:25.855785    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4ms82\" (UniqueName: \"kubernetes.io/projected/640f2048-9d11-4a04-ab4a-c7cc7b7dbf0f-kube-api-access-4ms82\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:07:26.684501 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:26.684419    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-11a2e3-f68b6559d-8sdqx"
Sep 17 02:07:26.684501 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:26.684453    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-11a2e3-f68b6559d-8sdqx" event={"ID":"640f2048-9d11-4a04-ab4a-c7cc7b7dbf0f","Type":"ContainerDied","Data":"09272c87fa6d0f61aa16003d3628178ead569ba51b4b0e021b005f2b28f47b67"}
Sep 17 02:07:26.685015 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:26.684525    2560 scope.go:117] "RemoveContainer" containerID="0df260894e3bc63de5d5e6900e97eeab6b767888fd554d0a3f0c0920f2a320b4"
Sep 17 02:07:26.685015 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:26.684663    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-11a2e3-76fd49757c-zn2nz"
Sep 17 02:07:26.703070 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:26.703045    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-11a2e3-f68b6559d-8sdqx"]
Sep 17 02:07:26.706629 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:26.706601    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-11a2e3-f68b6559d-8sdqx"]
Sep 17 02:07:26.714827 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:26.714803    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-11a2e3-76fd49757c-zn2nz"]
Sep 17 02:07:26.716834 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:26.716813    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-11a2e3-76fd49757c-zn2nz"]
Sep 17 02:07:28.356926 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:28.356874    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="640f2048-9d11-4a04-ab4a-c7cc7b7dbf0f" path="/var/lib/kubelet/pods/640f2048-9d11-4a04-ab4a-c7cc7b7dbf0f/volumes"
Sep 17 02:07:28.357475 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:28.357454    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e096fa4-669e-444d-a7a5-a10d52c5d32a" path="/var/lib/kubelet/pods/8e096fa4-669e-444d-a7a5-a10d52c5d32a/volumes"
Sep 17 02:07:32.078624 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:32.078590    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf"]
Sep 17 02:07:32.079092 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:32.078846    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf" podUID="b0abf225-37e6-40a7-989c-50bcb88390a7" containerName="istio-proxy" containerID="cri-o://e09e7c5cc57d68ba95f50b33689c3de0ccfbebd0a4cefa17fe7ba38813ec7bfd" gracePeriod=30
Sep 17 02:07:37.333729 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:37.333702    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf"
Sep 17 02:07:37.472544 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:37.472464    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0abf225-37e6-40a7-989c-50bcb88390a7-credential-socket\") pod \"b0abf225-37e6-40a7-989c-50bcb88390a7\" (UID: \"b0abf225-37e6-40a7-989c-50bcb88390a7\") "
Sep 17 02:07:37.472544 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:37.472522    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0abf225-37e6-40a7-989c-50bcb88390a7-istio-data\") pod \"b0abf225-37e6-40a7-989c-50bcb88390a7\" (UID: \"b0abf225-37e6-40a7-989c-50bcb88390a7\") "
Sep 17 02:07:37.472544 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:37.472545    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0abf225-37e6-40a7-989c-50bcb88390a7-istiod-ca-cert\") pod \"b0abf225-37e6-40a7-989c-50bcb88390a7\" (UID: \"b0abf225-37e6-40a7-989c-50bcb88390a7\") "
Sep 17 02:07:37.472823 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:37.472571    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0abf225-37e6-40a7-989c-50bcb88390a7-istio-envoy\") pod \"b0abf225-37e6-40a7-989c-50bcb88390a7\" (UID: \"b0abf225-37e6-40a7-989c-50bcb88390a7\") "
Sep 17 02:07:37.472823 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:37.472595    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0abf225-37e6-40a7-989c-50bcb88390a7-istio-podinfo\") pod \"b0abf225-37e6-40a7-989c-50bcb88390a7\" (UID: \"b0abf225-37e6-40a7-989c-50bcb88390a7\") "
Sep 17 02:07:37.472823 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:37.472628    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0abf225-37e6-40a7-989c-50bcb88390a7-workload-socket\") pod \"b0abf225-37e6-40a7-989c-50bcb88390a7\" (UID: \"b0abf225-37e6-40a7-989c-50bcb88390a7\") "
Sep 17 02:07:37.472823 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:37.472655    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0abf225-37e6-40a7-989c-50bcb88390a7-istio-token\") pod \"b0abf225-37e6-40a7-989c-50bcb88390a7\" (UID: \"b0abf225-37e6-40a7-989c-50bcb88390a7\") "
Sep 17 02:07:37.472823 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:37.472717    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-stbbg\" (UniqueName: \"kubernetes.io/projected/b0abf225-37e6-40a7-989c-50bcb88390a7-kube-api-access-stbbg\") pod \"b0abf225-37e6-40a7-989c-50bcb88390a7\" (UID: \"b0abf225-37e6-40a7-989c-50bcb88390a7\") "
Sep 17 02:07:37.472823 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:37.472742    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0abf225-37e6-40a7-989c-50bcb88390a7-workload-certs\") pod \"b0abf225-37e6-40a7-989c-50bcb88390a7\" (UID: \"b0abf225-37e6-40a7-989c-50bcb88390a7\") "
Sep 17 02:07:37.472823 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:37.472773    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0abf225-37e6-40a7-989c-50bcb88390a7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b0abf225-37e6-40a7-989c-50bcb88390a7" (UID: "b0abf225-37e6-40a7-989c-50bcb88390a7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:07:37.473184 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:37.472896    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0abf225-37e6-40a7-989c-50bcb88390a7-istio-data" (OuterVolumeSpecName: "istio-data") pod "b0abf225-37e6-40a7-989c-50bcb88390a7" (UID: "b0abf225-37e6-40a7-989c-50bcb88390a7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:07:37.473184 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:37.473031    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0abf225-37e6-40a7-989c-50bcb88390a7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b0abf225-37e6-40a7-989c-50bcb88390a7" (UID: "b0abf225-37e6-40a7-989c-50bcb88390a7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 02:07:37.473184 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:37.473118    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0abf225-37e6-40a7-989c-50bcb88390a7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b0abf225-37e6-40a7-989c-50bcb88390a7" (UID: "b0abf225-37e6-40a7-989c-50bcb88390a7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:07:37.473379 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:37.473286    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0abf225-37e6-40a7-989c-50bcb88390a7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b0abf225-37e6-40a7-989c-50bcb88390a7" (UID: "b0abf225-37e6-40a7-989c-50bcb88390a7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:07:37.473544 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:37.473522    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0abf225-37e6-40a7-989c-50bcb88390a7-credential-socket\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:07:37.473616 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:37.473548    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0abf225-37e6-40a7-989c-50bcb88390a7-istio-data\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:07:37.473616 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:37.473562    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0abf225-37e6-40a7-989c-50bcb88390a7-istiod-ca-cert\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:07:37.475094 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:37.475064    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0abf225-37e6-40a7-989c-50bcb88390a7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b0abf225-37e6-40a7-989c-50bcb88390a7" (UID: "b0abf225-37e6-40a7-989c-50bcb88390a7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:07:37.475217 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:37.475111    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b0abf225-37e6-40a7-989c-50bcb88390a7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b0abf225-37e6-40a7-989c-50bcb88390a7" (UID: "b0abf225-37e6-40a7-989c-50bcb88390a7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 02:07:37.475217 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:37.475160    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0abf225-37e6-40a7-989c-50bcb88390a7-kube-api-access-stbbg" (OuterVolumeSpecName: "kube-api-access-stbbg") pod "b0abf225-37e6-40a7-989c-50bcb88390a7" (UID: "b0abf225-37e6-40a7-989c-50bcb88390a7"). InnerVolumeSpecName "kube-api-access-stbbg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 02:07:37.475217 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:37.475183    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0abf225-37e6-40a7-989c-50bcb88390a7-istio-token" (OuterVolumeSpecName: "istio-token") pod "b0abf225-37e6-40a7-989c-50bcb88390a7" (UID: "b0abf225-37e6-40a7-989c-50bcb88390a7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 02:07:37.574603 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:37.574568    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0abf225-37e6-40a7-989c-50bcb88390a7-istio-envoy\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:07:37.574603 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:37.574597    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0abf225-37e6-40a7-989c-50bcb88390a7-istio-podinfo\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:07:37.574603 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:37.574607    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0abf225-37e6-40a7-989c-50bcb88390a7-workload-socket\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:07:37.574830 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:37.574615    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0abf225-37e6-40a7-989c-50bcb88390a7-istio-token\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:07:37.574830 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:37.574624    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-stbbg\" (UniqueName: \"kubernetes.io/projected/b0abf225-37e6-40a7-989c-50bcb88390a7-kube-api-access-stbbg\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:07:37.574830 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:37.574634    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0abf225-37e6-40a7-989c-50bcb88390a7-workload-certs\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:07:37.746850 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:37.746766    2560 generic.go:356] "Generic (PLEG): container finished" podID="b0abf225-37e6-40a7-989c-50bcb88390a7" containerID="e09e7c5cc57d68ba95f50b33689c3de0ccfbebd0a4cefa17fe7ba38813ec7bfd" exitCode=0
Sep 17 02:07:37.746850 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:37.746812    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf"
Sep 17 02:07:37.747034 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:37.746848    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf" event={"ID":"b0abf225-37e6-40a7-989c-50bcb88390a7","Type":"ContainerDied","Data":"e09e7c5cc57d68ba95f50b33689c3de0ccfbebd0a4cefa17fe7ba38813ec7bfd"}
Sep 17 02:07:37.747034 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:37.746904    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf" event={"ID":"b0abf225-37e6-40a7-989c-50bcb88390a7","Type":"ContainerDied","Data":"6762d75c8c08ce8d89aef286456290382c1ea9cea1a2666247a89041ebaf8766"}
Sep 17 02:07:37.747034 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:37.746931    2560 scope.go:117] "RemoveContainer" containerID="e09e7c5cc57d68ba95f50b33689c3de0ccfbebd0a4cefa17fe7ba38813ec7bfd"
Sep 17 02:07:37.756442 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:37.756426    2560 scope.go:117] "RemoveContainer" containerID="059ba489e05effdf731f3412c021ed39211aa68dc018ff960e063f8496592b15"
Sep 17 02:07:37.764839 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:37.764816    2560 scope.go:117] "RemoveContainer" containerID="e09e7c5cc57d68ba95f50b33689c3de0ccfbebd0a4cefa17fe7ba38813ec7bfd"
Sep 17 02:07:37.765119 ip-10-0-143-95 kubenswrapper[2560]: E0917 02:07:37.765101    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e09e7c5cc57d68ba95f50b33689c3de0ccfbebd0a4cefa17fe7ba38813ec7bfd\": container with ID starting with e09e7c5cc57d68ba95f50b33689c3de0ccfbebd0a4cefa17fe7ba38813ec7bfd not found: ID does not exist" containerID="e09e7c5cc57d68ba95f50b33689c3de0ccfbebd0a4cefa17fe7ba38813ec7bfd"
Sep 17 02:07:37.765196 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:37.765131    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e09e7c5cc57d68ba95f50b33689c3de0ccfbebd0a4cefa17fe7ba38813ec7bfd"} err="failed to get container status \"e09e7c5cc57d68ba95f50b33689c3de0ccfbebd0a4cefa17fe7ba38813ec7bfd\": rpc error: code = NotFound desc = could not find container \"e09e7c5cc57d68ba95f50b33689c3de0ccfbebd0a4cefa17fe7ba38813ec7bfd\": container with ID starting with e09e7c5cc57d68ba95f50b33689c3de0ccfbebd0a4cefa17fe7ba38813ec7bfd not found: ID does not exist"
Sep 17 02:07:37.765196 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:37.765157    2560 scope.go:117] "RemoveContainer" containerID="059ba489e05effdf731f3412c021ed39211aa68dc018ff960e063f8496592b15"
Sep 17 02:07:37.765517 ip-10-0-143-95 kubenswrapper[2560]: E0917 02:07:37.765479    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"059ba489e05effdf731f3412c021ed39211aa68dc018ff960e063f8496592b15\": container with ID starting with 059ba489e05effdf731f3412c021ed39211aa68dc018ff960e063f8496592b15 not found: ID does not exist" containerID="059ba489e05effdf731f3412c021ed39211aa68dc018ff960e063f8496592b15"
Sep 17 02:07:37.765670 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:37.765525    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"059ba489e05effdf731f3412c021ed39211aa68dc018ff960e063f8496592b15"} err="failed to get container status \"059ba489e05effdf731f3412c021ed39211aa68dc018ff960e063f8496592b15\": rpc error: code = NotFound desc = could not find container \"059ba489e05effdf731f3412c021ed39211aa68dc018ff960e063f8496592b15\": container with ID starting with 059ba489e05effdf731f3412c021ed39211aa68dc018ff960e063f8496592b15 not found: ID does not exist"
Sep 17 02:07:37.766221 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:37.766202    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf"]
Sep 17 02:07:37.769599 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:37.769579    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-11a2e3-openshift-default-687d778bcd-9x8lf"]
Sep 17 02:07:38.356928 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:38.356893    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0abf225-37e6-40a7-989c-50bcb88390a7" path="/var/lib/kubelet/pods/b0abf225-37e6-40a7-989c-50bcb88390a7/volumes"
Sep 17 02:07:48.040422 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:48.040373    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-320e88-85d77dc7bb-lmcvz"]
Sep 17 02:07:48.040918 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:48.040638    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-320e88-85d77dc7bb-lmcvz" podUID="81f4be0e-c8c7-4a95-8415-ce25e167a7ab" containerName="payload-pre-processing" containerID="cri-o://de426cbdf6d5ab272c086162a5af877e991f99080d9e0920e6b9746325ddb078" gracePeriod=30
Sep 17 02:07:48.301574 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:48.301510    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-320e88-85d77dc7bb-lmcvz"
Sep 17 02:07:48.374491 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:48.374439    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5498n\" (UniqueName: \"kubernetes.io/projected/81f4be0e-c8c7-4a95-8415-ce25e167a7ab-kube-api-access-5498n\") pod \"81f4be0e-c8c7-4a95-8415-ce25e167a7ab\" (UID: \"81f4be0e-c8c7-4a95-8415-ce25e167a7ab\") "
Sep 17 02:07:48.374795 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:48.374540    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81f4be0e-c8c7-4a95-8415-ce25e167a7ab-plugins-config-volume\") pod \"81f4be0e-c8c7-4a95-8415-ce25e167a7ab\" (UID: \"81f4be0e-c8c7-4a95-8415-ce25e167a7ab\") "
Sep 17 02:07:48.375384 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:48.375341    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81f4be0e-c8c7-4a95-8415-ce25e167a7ab-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "81f4be0e-c8c7-4a95-8415-ce25e167a7ab" (UID: "81f4be0e-c8c7-4a95-8415-ce25e167a7ab"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 02:07:48.378070 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:48.378017    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81f4be0e-c8c7-4a95-8415-ce25e167a7ab-kube-api-access-5498n" (OuterVolumeSpecName: "kube-api-access-5498n") pod "81f4be0e-c8c7-4a95-8415-ce25e167a7ab" (UID: "81f4be0e-c8c7-4a95-8415-ce25e167a7ab"). InnerVolumeSpecName "kube-api-access-5498n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 02:07:48.475679 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:48.475642    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5498n\" (UniqueName: \"kubernetes.io/projected/81f4be0e-c8c7-4a95-8415-ce25e167a7ab-kube-api-access-5498n\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:07:48.475679 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:48.475678    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81f4be0e-c8c7-4a95-8415-ce25e167a7ab-plugins-config-volume\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:07:48.802603 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:48.802568    2560 generic.go:356] "Generic (PLEG): container finished" podID="81f4be0e-c8c7-4a95-8415-ce25e167a7ab" containerID="de426cbdf6d5ab272c086162a5af877e991f99080d9e0920e6b9746325ddb078" exitCode=0
Sep 17 02:07:48.802819 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:48.802626    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-320e88-85d77dc7bb-lmcvz"
Sep 17 02:07:48.802819 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:48.802628    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-320e88-85d77dc7bb-lmcvz" event={"ID":"81f4be0e-c8c7-4a95-8415-ce25e167a7ab","Type":"ContainerDied","Data":"de426cbdf6d5ab272c086162a5af877e991f99080d9e0920e6b9746325ddb078"}
Sep 17 02:07:48.802819 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:48.802752    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-320e88-85d77dc7bb-lmcvz" event={"ID":"81f4be0e-c8c7-4a95-8415-ce25e167a7ab","Type":"ContainerDied","Data":"b29a0b5701b7e3a90817ee17e330cc03edfc02a0d141d3f83677452b1094b79e"}
Sep 17 02:07:48.802819 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:48.802780    2560 scope.go:117] "RemoveContainer" containerID="de426cbdf6d5ab272c086162a5af877e991f99080d9e0920e6b9746325ddb078"
Sep 17 02:07:48.811651 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:48.811632    2560 scope.go:117] "RemoveContainer" containerID="de426cbdf6d5ab272c086162a5af877e991f99080d9e0920e6b9746325ddb078"
Sep 17 02:07:48.811963 ip-10-0-143-95 kubenswrapper[2560]: E0917 02:07:48.811938    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de426cbdf6d5ab272c086162a5af877e991f99080d9e0920e6b9746325ddb078\": container with ID starting with de426cbdf6d5ab272c086162a5af877e991f99080d9e0920e6b9746325ddb078 not found: ID does not exist" containerID="de426cbdf6d5ab272c086162a5af877e991f99080d9e0920e6b9746325ddb078"
Sep 17 02:07:48.812048 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:48.811968    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de426cbdf6d5ab272c086162a5af877e991f99080d9e0920e6b9746325ddb078"} err="failed to get container status \"de426cbdf6d5ab272c086162a5af877e991f99080d9e0920e6b9746325ddb078\": rpc error: code = NotFound desc = could not find container \"de426cbdf6d5ab272c086162a5af877e991f99080d9e0920e6b9746325ddb078\": container with ID starting with de426cbdf6d5ab272c086162a5af877e991f99080d9e0920e6b9746325ddb078 not found: ID does not exist"
Sep 17 02:07:48.824831 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:48.824804    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-320e88-85d77dc7bb-lmcvz"]
Sep 17 02:07:48.830423 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:48.830403    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-320e88-85d77dc7bb-lmcvz"]
Sep 17 02:07:50.356923 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:50.356891    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81f4be0e-c8c7-4a95-8415-ce25e167a7ab" path="/var/lib/kubelet/pods/81f4be0e-c8c7-4a95-8415-ce25e167a7ab/volumes"
Sep 17 02:07:51.292291 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:51.292238    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w2-67a23a/rate-test-model-67a23a-kserve-6c945cb6ff-5brpt"]
Sep 17 02:07:51.292739 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:51.292719    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0abf225-37e6-40a7-989c-50bcb88390a7" containerName="istio-proxy"
Sep 17 02:07:51.292845 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:51.292741    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0abf225-37e6-40a7-989c-50bcb88390a7" containerName="istio-proxy"
Sep 17 02:07:51.292845 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:51.292758    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81f4be0e-c8c7-4a95-8415-ce25e167a7ab" containerName="payload-pre-processing"
Sep 17 02:07:51.292845 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:51.292766    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="81f4be0e-c8c7-4a95-8415-ce25e167a7ab" containerName="payload-pre-processing"
Sep 17 02:07:51.292845 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:51.292776    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="640f2048-9d11-4a04-ab4a-c7cc7b7dbf0f" containerName="payload-pre-processing"
Sep 17 02:07:51.292845 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:51.292784    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="640f2048-9d11-4a04-ab4a-c7cc7b7dbf0f" containerName="payload-pre-processing"
Sep 17 02:07:51.292845 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:51.292815    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e096fa4-669e-444d-a7a5-a10d52c5d32a" containerName="payload-processing"
Sep 17 02:07:51.292845 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:51.292824    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e096fa4-669e-444d-a7a5-a10d52c5d32a" containerName="payload-processing"
Sep 17 02:07:51.293200 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:51.292929    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0abf225-37e6-40a7-989c-50bcb88390a7" containerName="istio-proxy"
Sep 17 02:07:51.293200 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:51.292942    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="640f2048-9d11-4a04-ab4a-c7cc7b7dbf0f" containerName="payload-pre-processing"
Sep 17 02:07:51.293200 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:51.292957    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e096fa4-669e-444d-a7a5-a10d52c5d32a" containerName="payload-processing"
Sep 17 02:07:51.293200 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:51.292967    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="81f4be0e-c8c7-4a95-8415-ce25e167a7ab" containerName="payload-pre-processing"
Sep 17 02:07:51.297500 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:51.297477    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w2-67a23a/rate-test-model-67a23a-kserve-6c945cb6ff-5brpt"
Sep 17 02:07:51.299726 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:51.299704    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w2-67a23a\"/\"openshift-service-ca.crt\""
Sep 17 02:07:51.299886 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:51.299832    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w2-67a23a\"/\"default-dockercfg-47wrb\""
Sep 17 02:07:51.300211 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:51.300189    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w2-67a23a\"/\"kube-root-ca.crt\""
Sep 17 02:07:51.300401 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:51.300381    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w2-67a23a\"/\"rate-test-model-67a23a-kserve-self-signed-certs\""
Sep 17 02:07:51.307078 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:51.307056    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w2-67a23a/rate-test-model-67a23a-kserve-6c945cb6ff-5brpt"]
Sep 17 02:07:51.406299 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:51.406255    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fcc4536-be0c-4e22-802d-37e65cb02dac-home\") pod \"rate-test-model-67a23a-kserve-6c945cb6ff-5brpt\" (UID: \"3fcc4536-be0c-4e22-802d-37e65cb02dac\") " pod="ai-tenant-e2e-shared-a-w2-67a23a/rate-test-model-67a23a-kserve-6c945cb6ff-5brpt"
Sep 17 02:07:51.406668 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:51.406309    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fcc4536-be0c-4e22-802d-37e65cb02dac-tls-certs\") pod \"rate-test-model-67a23a-kserve-6c945cb6ff-5brpt\" (UID: \"3fcc4536-be0c-4e22-802d-37e65cb02dac\") " pod="ai-tenant-e2e-shared-a-w2-67a23a/rate-test-model-67a23a-kserve-6c945cb6ff-5brpt"
Sep 17 02:07:51.406668 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:51.406378    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fcc4536-be0c-4e22-802d-37e65cb02dac-tmp-dir\") pod \"rate-test-model-67a23a-kserve-6c945cb6ff-5brpt\" (UID: \"3fcc4536-be0c-4e22-802d-37e65cb02dac\") " pod="ai-tenant-e2e-shared-a-w2-67a23a/rate-test-model-67a23a-kserve-6c945cb6ff-5brpt"
Sep 17 02:07:51.406668 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:51.406446    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pjvj\" (UniqueName: \"kubernetes.io/projected/3fcc4536-be0c-4e22-802d-37e65cb02dac-kube-api-access-9pjvj\") pod \"rate-test-model-67a23a-kserve-6c945cb6ff-5brpt\" (UID: \"3fcc4536-be0c-4e22-802d-37e65cb02dac\") " pod="ai-tenant-e2e-shared-a-w2-67a23a/rate-test-model-67a23a-kserve-6c945cb6ff-5brpt"
Sep 17 02:07:51.406668 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:51.406478    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fcc4536-be0c-4e22-802d-37e65cb02dac-dshm\") pod \"rate-test-model-67a23a-kserve-6c945cb6ff-5brpt\" (UID: \"3fcc4536-be0c-4e22-802d-37e65cb02dac\") " pod="ai-tenant-e2e-shared-a-w2-67a23a/rate-test-model-67a23a-kserve-6c945cb6ff-5brpt"
Sep 17 02:07:51.406668 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:51.406505    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fcc4536-be0c-4e22-802d-37e65cb02dac-model-cache\") pod \"rate-test-model-67a23a-kserve-6c945cb6ff-5brpt\" (UID: \"3fcc4536-be0c-4e22-802d-37e65cb02dac\") " pod="ai-tenant-e2e-shared-a-w2-67a23a/rate-test-model-67a23a-kserve-6c945cb6ff-5brpt"
Sep 17 02:07:51.507687 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:51.507647    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fcc4536-be0c-4e22-802d-37e65cb02dac-home\") pod \"rate-test-model-67a23a-kserve-6c945cb6ff-5brpt\" (UID: \"3fcc4536-be0c-4e22-802d-37e65cb02dac\") " pod="ai-tenant-e2e-shared-a-w2-67a23a/rate-test-model-67a23a-kserve-6c945cb6ff-5brpt"
Sep 17 02:07:51.507888 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:51.507716    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fcc4536-be0c-4e22-802d-37e65cb02dac-tls-certs\") pod \"rate-test-model-67a23a-kserve-6c945cb6ff-5brpt\" (UID: \"3fcc4536-be0c-4e22-802d-37e65cb02dac\") " pod="ai-tenant-e2e-shared-a-w2-67a23a/rate-test-model-67a23a-kserve-6c945cb6ff-5brpt"
Sep 17 02:07:51.507888 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:51.507748    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fcc4536-be0c-4e22-802d-37e65cb02dac-tmp-dir\") pod \"rate-test-model-67a23a-kserve-6c945cb6ff-5brpt\" (UID: \"3fcc4536-be0c-4e22-802d-37e65cb02dac\") " pod="ai-tenant-e2e-shared-a-w2-67a23a/rate-test-model-67a23a-kserve-6c945cb6ff-5brpt"
Sep 17 02:07:51.507888 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:51.507808    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pjvj\" (UniqueName: \"kubernetes.io/projected/3fcc4536-be0c-4e22-802d-37e65cb02dac-kube-api-access-9pjvj\") pod \"rate-test-model-67a23a-kserve-6c945cb6ff-5brpt\" (UID: \"3fcc4536-be0c-4e22-802d-37e65cb02dac\") " pod="ai-tenant-e2e-shared-a-w2-67a23a/rate-test-model-67a23a-kserve-6c945cb6ff-5brpt"
Sep 17 02:07:51.507888 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:51.507847    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fcc4536-be0c-4e22-802d-37e65cb02dac-dshm\") pod \"rate-test-model-67a23a-kserve-6c945cb6ff-5brpt\" (UID: \"3fcc4536-be0c-4e22-802d-37e65cb02dac\") " pod="ai-tenant-e2e-shared-a-w2-67a23a/rate-test-model-67a23a-kserve-6c945cb6ff-5brpt"
Sep 17 02:07:51.507888 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:51.507882    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fcc4536-be0c-4e22-802d-37e65cb02dac-model-cache\") pod \"rate-test-model-67a23a-kserve-6c945cb6ff-5brpt\" (UID: \"3fcc4536-be0c-4e22-802d-37e65cb02dac\") " pod="ai-tenant-e2e-shared-a-w2-67a23a/rate-test-model-67a23a-kserve-6c945cb6ff-5brpt"
Sep 17 02:07:51.508167 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:51.508068    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fcc4536-be0c-4e22-802d-37e65cb02dac-home\") pod \"rate-test-model-67a23a-kserve-6c945cb6ff-5brpt\" (UID: \"3fcc4536-be0c-4e22-802d-37e65cb02dac\") " pod="ai-tenant-e2e-shared-a-w2-67a23a/rate-test-model-67a23a-kserve-6c945cb6ff-5brpt"
Sep 17 02:07:51.508281 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:51.508175    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fcc4536-be0c-4e22-802d-37e65cb02dac-tmp-dir\") pod \"rate-test-model-67a23a-kserve-6c945cb6ff-5brpt\" (UID: \"3fcc4536-be0c-4e22-802d-37e65cb02dac\") " pod="ai-tenant-e2e-shared-a-w2-67a23a/rate-test-model-67a23a-kserve-6c945cb6ff-5brpt"
Sep 17 02:07:51.508281 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:51.508236    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fcc4536-be0c-4e22-802d-37e65cb02dac-model-cache\") pod \"rate-test-model-67a23a-kserve-6c945cb6ff-5brpt\" (UID: \"3fcc4536-be0c-4e22-802d-37e65cb02dac\") " pod="ai-tenant-e2e-shared-a-w2-67a23a/rate-test-model-67a23a-kserve-6c945cb6ff-5brpt"
Sep 17 02:07:51.510030 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:51.510009    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fcc4536-be0c-4e22-802d-37e65cb02dac-dshm\") pod \"rate-test-model-67a23a-kserve-6c945cb6ff-5brpt\" (UID: \"3fcc4536-be0c-4e22-802d-37e65cb02dac\") " pod="ai-tenant-e2e-shared-a-w2-67a23a/rate-test-model-67a23a-kserve-6c945cb6ff-5brpt"
Sep 17 02:07:51.510329 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:51.510309    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fcc4536-be0c-4e22-802d-37e65cb02dac-tls-certs\") pod \"rate-test-model-67a23a-kserve-6c945cb6ff-5brpt\" (UID: \"3fcc4536-be0c-4e22-802d-37e65cb02dac\") " pod="ai-tenant-e2e-shared-a-w2-67a23a/rate-test-model-67a23a-kserve-6c945cb6ff-5brpt"
Sep 17 02:07:51.514788 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:51.514764    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pjvj\" (UniqueName: \"kubernetes.io/projected/3fcc4536-be0c-4e22-802d-37e65cb02dac-kube-api-access-9pjvj\") pod \"rate-test-model-67a23a-kserve-6c945cb6ff-5brpt\" (UID: \"3fcc4536-be0c-4e22-802d-37e65cb02dac\") " pod="ai-tenant-e2e-shared-a-w2-67a23a/rate-test-model-67a23a-kserve-6c945cb6ff-5brpt"
Sep 17 02:07:51.606789 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:51.606750    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w2-67a23a/rate-test-model-67a23a-kserve-6c945cb6ff-5brpt"
Sep 17 02:07:51.876903 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:51.876872    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w2-67a23a/rate-test-model-67a23a-kserve-6c945cb6ff-5brpt"]
Sep 17 02:07:51.879124 ip-10-0-143-95 kubenswrapper[2560]: W0917 02:07:51.879099    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3fcc4536_be0c_4e22_802d_37e65cb02dac.slice/crio-cbc4fa181be2a48e1f12db6554725c1c108c3b049ea465e58ab248c02a6eb968 WatchSource:0}: Error finding container cbc4fa181be2a48e1f12db6554725c1c108c3b049ea465e58ab248c02a6eb968: Status 404 returned error can't find the container with id cbc4fa181be2a48e1f12db6554725c1c108c3b049ea465e58ab248c02a6eb968
Sep 17 02:07:52.826910 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:52.826875    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w2-67a23a/rate-test-model-67a23a-kserve-6c945cb6ff-5brpt" event={"ID":"3fcc4536-be0c-4e22-802d-37e65cb02dac","Type":"ContainerStarted","Data":"d08fddeb0c6c9d00036d81af7f80cfd10c1e7c0825f19676c9a7252818749e67"}
Sep 17 02:07:52.827313 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:52.826920    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w2-67a23a/rate-test-model-67a23a-kserve-6c945cb6ff-5brpt" event={"ID":"3fcc4536-be0c-4e22-802d-37e65cb02dac","Type":"ContainerStarted","Data":"cbc4fa181be2a48e1f12db6554725c1c108c3b049ea465e58ab248c02a6eb968"}
Sep 17 02:07:52.841090 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:52.841043    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w2-67a23a/rate-test-model-67a23a-kserve-6c945cb6ff-5brpt" podStartSLOduration=1.841023851 podStartE2EDuration="1.841023851s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 02:07:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:07:52.839710883 +0000 UTC m=+1831.089688196" watchObservedRunningTime="2026-09-17 02:07:52.841023851 +0000 UTC m=+1831.091001166"
Sep 17 02:07:54.581037 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:54.581002    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp"]
Sep 17 02:07:54.581450 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:54.581216    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp" podUID="eec0370a-c385-469b-8697-b0534845007b" containerName="istio-proxy" containerID="cri-o://065d0dbaa46f05e7fe42b98c58581092ec76f2c143992fc095ee606a81dc9999" gracePeriod=30
Sep 17 02:07:59.829268 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:59.829228    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp"
Sep 17 02:07:59.867960 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:59.867882    2560 generic.go:356] "Generic (PLEG): container finished" podID="eec0370a-c385-469b-8697-b0534845007b" containerID="065d0dbaa46f05e7fe42b98c58581092ec76f2c143992fc095ee606a81dc9999" exitCode=0
Sep 17 02:07:59.867960 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:59.867921    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp" event={"ID":"eec0370a-c385-469b-8697-b0534845007b","Type":"ContainerDied","Data":"065d0dbaa46f05e7fe42b98c58581092ec76f2c143992fc095ee606a81dc9999"}
Sep 17 02:07:59.868141 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:59.867994    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp" event={"ID":"eec0370a-c385-469b-8697-b0534845007b","Type":"ContainerDied","Data":"956620d6e275ce0df0313ff04d4966395a64d26bf5403760eb2d02c2b2e0871f"}
Sep 17 02:07:59.868141 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:59.868010    2560 scope.go:117] "RemoveContainer" containerID="065d0dbaa46f05e7fe42b98c58581092ec76f2c143992fc095ee606a81dc9999"
Sep 17 02:07:59.868141 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:59.867934    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp"
Sep 17 02:07:59.876639 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:59.876620    2560 scope.go:117] "RemoveContainer" containerID="19f362d8e6a9d57e573531385efeb88ac44ad804fdc5efe5023224dd37e10958"
Sep 17 02:07:59.884568 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:59.884548    2560 scope.go:117] "RemoveContainer" containerID="065d0dbaa46f05e7fe42b98c58581092ec76f2c143992fc095ee606a81dc9999"
Sep 17 02:07:59.884834 ip-10-0-143-95 kubenswrapper[2560]: E0917 02:07:59.884816    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"065d0dbaa46f05e7fe42b98c58581092ec76f2c143992fc095ee606a81dc9999\": container with ID starting with 065d0dbaa46f05e7fe42b98c58581092ec76f2c143992fc095ee606a81dc9999 not found: ID does not exist" containerID="065d0dbaa46f05e7fe42b98c58581092ec76f2c143992fc095ee606a81dc9999"
Sep 17 02:07:59.884907 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:59.884844    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"065d0dbaa46f05e7fe42b98c58581092ec76f2c143992fc095ee606a81dc9999"} err="failed to get container status \"065d0dbaa46f05e7fe42b98c58581092ec76f2c143992fc095ee606a81dc9999\": rpc error: code = NotFound desc = could not find container \"065d0dbaa46f05e7fe42b98c58581092ec76f2c143992fc095ee606a81dc9999\": container with ID starting with 065d0dbaa46f05e7fe42b98c58581092ec76f2c143992fc095ee606a81dc9999 not found: ID does not exist"
Sep 17 02:07:59.884907 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:59.884862    2560 scope.go:117] "RemoveContainer" containerID="19f362d8e6a9d57e573531385efeb88ac44ad804fdc5efe5023224dd37e10958"
Sep 17 02:07:59.885118 ip-10-0-143-95 kubenswrapper[2560]: E0917 02:07:59.885102    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19f362d8e6a9d57e573531385efeb88ac44ad804fdc5efe5023224dd37e10958\": container with ID starting with 19f362d8e6a9d57e573531385efeb88ac44ad804fdc5efe5023224dd37e10958 not found: ID does not exist" containerID="19f362d8e6a9d57e573531385efeb88ac44ad804fdc5efe5023224dd37e10958"
Sep 17 02:07:59.885195 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:59.885123    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19f362d8e6a9d57e573531385efeb88ac44ad804fdc5efe5023224dd37e10958"} err="failed to get container status \"19f362d8e6a9d57e573531385efeb88ac44ad804fdc5efe5023224dd37e10958\": rpc error: code = NotFound desc = could not find container \"19f362d8e6a9d57e573531385efeb88ac44ad804fdc5efe5023224dd37e10958\": container with ID starting with 19f362d8e6a9d57e573531385efeb88ac44ad804fdc5efe5023224dd37e10958 not found: ID does not exist"
Sep 17 02:07:59.990585 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:59.990554    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eec0370a-c385-469b-8697-b0534845007b-istio-data\") pod \"eec0370a-c385-469b-8697-b0534845007b\" (UID: \"eec0370a-c385-469b-8697-b0534845007b\") "
Sep 17 02:07:59.990585 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:59.990588    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-67kj2\" (UniqueName: \"kubernetes.io/projected/eec0370a-c385-469b-8697-b0534845007b-kube-api-access-67kj2\") pod \"eec0370a-c385-469b-8697-b0534845007b\" (UID: \"eec0370a-c385-469b-8697-b0534845007b\") "
Sep 17 02:07:59.990766 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:59.990660    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eec0370a-c385-469b-8697-b0534845007b-istio-envoy\") pod \"eec0370a-c385-469b-8697-b0534845007b\" (UID: \"eec0370a-c385-469b-8697-b0534845007b\") "
Sep 17 02:07:59.990766 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:59.990685    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eec0370a-c385-469b-8697-b0534845007b-workload-certs\") pod \"eec0370a-c385-469b-8697-b0534845007b\" (UID: \"eec0370a-c385-469b-8697-b0534845007b\") "
Sep 17 02:07:59.990766 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:59.990705    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eec0370a-c385-469b-8697-b0534845007b-istiod-ca-cert\") pod \"eec0370a-c385-469b-8697-b0534845007b\" (UID: \"eec0370a-c385-469b-8697-b0534845007b\") "
Sep 17 02:07:59.990766 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:59.990741    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eec0370a-c385-469b-8697-b0534845007b-istio-podinfo\") pod \"eec0370a-c385-469b-8697-b0534845007b\" (UID: \"eec0370a-c385-469b-8697-b0534845007b\") "
Sep 17 02:07:59.990947 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:59.990769    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eec0370a-c385-469b-8697-b0534845007b-workload-socket\") pod \"eec0370a-c385-469b-8697-b0534845007b\" (UID: \"eec0370a-c385-469b-8697-b0534845007b\") "
Sep 17 02:07:59.990947 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:59.990803    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eec0370a-c385-469b-8697-b0534845007b-credential-socket\") pod \"eec0370a-c385-469b-8697-b0534845007b\" (UID: \"eec0370a-c385-469b-8697-b0534845007b\") "
Sep 17 02:07:59.990947 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:59.990826    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eec0370a-c385-469b-8697-b0534845007b-istio-token\") pod \"eec0370a-c385-469b-8697-b0534845007b\" (UID: \"eec0370a-c385-469b-8697-b0534845007b\") "
Sep 17 02:07:59.990947 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:59.990852    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eec0370a-c385-469b-8697-b0534845007b-istio-data" (OuterVolumeSpecName: "istio-data") pod "eec0370a-c385-469b-8697-b0534845007b" (UID: "eec0370a-c385-469b-8697-b0534845007b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:07:59.991173 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:59.990972    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eec0370a-c385-469b-8697-b0534845007b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "eec0370a-c385-469b-8697-b0534845007b" (UID: "eec0370a-c385-469b-8697-b0534845007b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:07:59.991173 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:59.991081    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eec0370a-c385-469b-8697-b0534845007b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "eec0370a-c385-469b-8697-b0534845007b" (UID: "eec0370a-c385-469b-8697-b0534845007b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:07:59.991173 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:59.991169    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eec0370a-c385-469b-8697-b0534845007b-workload-certs\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:07:59.991381 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:59.991192    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eec0370a-c385-469b-8697-b0534845007b-workload-socket\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:07:59.991381 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:59.991222    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eec0370a-c385-469b-8697-b0534845007b-istio-data\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:07:59.991381 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:59.991216    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eec0370a-c385-469b-8697-b0534845007b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "eec0370a-c385-469b-8697-b0534845007b" (UID: "eec0370a-c385-469b-8697-b0534845007b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:07:59.991553 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:59.991401    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eec0370a-c385-469b-8697-b0534845007b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "eec0370a-c385-469b-8697-b0534845007b" (UID: "eec0370a-c385-469b-8697-b0534845007b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 02:07:59.992896 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:59.992860    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eec0370a-c385-469b-8697-b0534845007b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "eec0370a-c385-469b-8697-b0534845007b" (UID: "eec0370a-c385-469b-8697-b0534845007b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:07:59.993010 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:59.992877    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/eec0370a-c385-469b-8697-b0534845007b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "eec0370a-c385-469b-8697-b0534845007b" (UID: "eec0370a-c385-469b-8697-b0534845007b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 02:07:59.993010 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:59.992896    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eec0370a-c385-469b-8697-b0534845007b-istio-token" (OuterVolumeSpecName: "istio-token") pod "eec0370a-c385-469b-8697-b0534845007b" (UID: "eec0370a-c385-469b-8697-b0534845007b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 02:07:59.993010 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:07:59.992962    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eec0370a-c385-469b-8697-b0534845007b-kube-api-access-67kj2" (OuterVolumeSpecName: "kube-api-access-67kj2") pod "eec0370a-c385-469b-8697-b0534845007b" (UID: "eec0370a-c385-469b-8697-b0534845007b"). InnerVolumeSpecName "kube-api-access-67kj2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 02:08:00.092727 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:00.092688    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eec0370a-c385-469b-8697-b0534845007b-istio-envoy\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:08:00.092727 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:00.092719    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eec0370a-c385-469b-8697-b0534845007b-istiod-ca-cert\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:08:00.092727 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:00.092728    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eec0370a-c385-469b-8697-b0534845007b-istio-podinfo\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:08:00.092963 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:00.092736    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eec0370a-c385-469b-8697-b0534845007b-credential-socket\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:08:00.092963 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:00.092746    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eec0370a-c385-469b-8697-b0534845007b-istio-token\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:08:00.092963 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:00.092755    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-67kj2\" (UniqueName: \"kubernetes.io/projected/eec0370a-c385-469b-8697-b0534845007b-kube-api-access-67kj2\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:08:00.188682 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:00.188651    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp"]
Sep 17 02:08:00.194098 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:00.194073    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-320e88-openshift-default-7d6c76ccfd-twvgp"]
Sep 17 02:08:00.357581 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:00.357544    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eec0370a-c385-469b-8697-b0534845007b" path="/var/lib/kubelet/pods/eec0370a-c385-469b-8697-b0534845007b/volumes"
Sep 17 02:08:01.607366 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:01.607319    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w2-67a23a/rate-test-model-67a23a-kserve-6c945cb6ff-5brpt"
Sep 17 02:08:01.607366 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:01.607372    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w2-67a23a/rate-test-model-67a23a-kserve-6c945cb6ff-5brpt"
Sep 17 02:08:01.619971 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:01.619935    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w2-67a23a/rate-test-model-67a23a-kserve-6c945cb6ff-5brpt"
Sep 17 02:08:01.889767 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:01.889688    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w2-67a23a/rate-test-model-67a23a-kserve-6c945cb6ff-5brpt"
Sep 17 02:08:05.495173 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:05.495138    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w1-c5da3b-54989b8b6c-lkhqx"]
Sep 17 02:08:05.495677 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:05.495366    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-c5da3b-54989b8b6c-lkhqx" podUID="0fda824e-ac2f-4972-9790-e66b8c04412a" containerName="payload-processing" containerID="cri-o://4143a3d8820e0acf08a9c8797a8d42feb6393ecb0e1c5c828aa13efe299999f7" gracePeriod=30
Sep 17 02:08:05.750209 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:05.750148    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-c5da3b-54989b8b6c-lkhqx"
Sep 17 02:08:05.837512 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:05.837481    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0fda824e-ac2f-4972-9790-e66b8c04412a-plugins-config-volume\") pod \"0fda824e-ac2f-4972-9790-e66b8c04412a\" (UID: \"0fda824e-ac2f-4972-9790-e66b8c04412a\") "
Sep 17 02:08:05.837684 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:05.837540    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tp5lb\" (UniqueName: \"kubernetes.io/projected/0fda824e-ac2f-4972-9790-e66b8c04412a-kube-api-access-tp5lb\") pod \"0fda824e-ac2f-4972-9790-e66b8c04412a\" (UID: \"0fda824e-ac2f-4972-9790-e66b8c04412a\") "
Sep 17 02:08:05.837913 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:05.837881    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0fda824e-ac2f-4972-9790-e66b8c04412a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0fda824e-ac2f-4972-9790-e66b8c04412a" (UID: "0fda824e-ac2f-4972-9790-e66b8c04412a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 02:08:05.839832 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:05.839805    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fda824e-ac2f-4972-9790-e66b8c04412a-kube-api-access-tp5lb" (OuterVolumeSpecName: "kube-api-access-tp5lb") pod "0fda824e-ac2f-4972-9790-e66b8c04412a" (UID: "0fda824e-ac2f-4972-9790-e66b8c04412a"). InnerVolumeSpecName "kube-api-access-tp5lb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 02:08:05.899472 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:05.899410    2560 generic.go:356] "Generic (PLEG): container finished" podID="0fda824e-ac2f-4972-9790-e66b8c04412a" containerID="4143a3d8820e0acf08a9c8797a8d42feb6393ecb0e1c5c828aa13efe299999f7" exitCode=0
Sep 17 02:08:05.899472 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:05.899461    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-c5da3b-54989b8b6c-lkhqx" event={"ID":"0fda824e-ac2f-4972-9790-e66b8c04412a","Type":"ContainerDied","Data":"4143a3d8820e0acf08a9c8797a8d42feb6393ecb0e1c5c828aa13efe299999f7"}
Sep 17 02:08:05.899472 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:05.899463    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-c5da3b-54989b8b6c-lkhqx"
Sep 17 02:08:05.899731 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:05.899506    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w1-c5da3b-54989b8b6c-lkhqx" event={"ID":"0fda824e-ac2f-4972-9790-e66b8c04412a","Type":"ContainerDied","Data":"3db65f9391c69fd6be0f77e259d6cec8e9885f23c8d250cca31ca5ca67b5e0ea"}
Sep 17 02:08:05.899731 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:05.899541    2560 scope.go:117] "RemoveContainer" containerID="4143a3d8820e0acf08a9c8797a8d42feb6393ecb0e1c5c828aa13efe299999f7"
Sep 17 02:08:05.909291 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:05.909234    2560 scope.go:117] "RemoveContainer" containerID="4143a3d8820e0acf08a9c8797a8d42feb6393ecb0e1c5c828aa13efe299999f7"
Sep 17 02:08:05.909626 ip-10-0-143-95 kubenswrapper[2560]: E0917 02:08:05.909602    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4143a3d8820e0acf08a9c8797a8d42feb6393ecb0e1c5c828aa13efe299999f7\": container with ID starting with 4143a3d8820e0acf08a9c8797a8d42feb6393ecb0e1c5c828aa13efe299999f7 not found: ID does not exist" containerID="4143a3d8820e0acf08a9c8797a8d42feb6393ecb0e1c5c828aa13efe299999f7"
Sep 17 02:08:05.909774 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:05.909743    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4143a3d8820e0acf08a9c8797a8d42feb6393ecb0e1c5c828aa13efe299999f7"} err="failed to get container status \"4143a3d8820e0acf08a9c8797a8d42feb6393ecb0e1c5c828aa13efe299999f7\": rpc error: code = NotFound desc = could not find container \"4143a3d8820e0acf08a9c8797a8d42feb6393ecb0e1c5c828aa13efe299999f7\": container with ID starting with 4143a3d8820e0acf08a9c8797a8d42feb6393ecb0e1c5c828aa13efe299999f7 not found: ID does not exist"
Sep 17 02:08:05.922071 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:05.922041    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w1-c5da3b-54989b8b6c-lkhqx"]
Sep 17 02:08:05.925723 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:05.925701    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w1-c5da3b-54989b8b6c-lkhqx"]
Sep 17 02:08:05.938098 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:05.938078    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tp5lb\" (UniqueName: \"kubernetes.io/projected/0fda824e-ac2f-4972-9790-e66b8c04412a-kube-api-access-tp5lb\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:08:05.938170 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:05.938100    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0fda824e-ac2f-4972-9790-e66b8c04412a-plugins-config-volume\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:08:06.357087 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:06.357052    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fda824e-ac2f-4972-9790-e66b8c04412a" path="/var/lib/kubelet/pods/0fda824e-ac2f-4972-9790-e66b8c04412a/volumes"
Sep 17 02:08:54.677200 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:54.677109    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w2-67a23a/rate-test-model-67a23a-kserve-6c945cb6ff-5brpt"]
Sep 17 02:08:56.348817 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:56.348780    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p"]
Sep 17 02:08:56.349385 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:56.349356    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fda824e-ac2f-4972-9790-e66b8c04412a" containerName="payload-processing"
Sep 17 02:08:56.349385 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:56.349384    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fda824e-ac2f-4972-9790-e66b8c04412a" containerName="payload-processing"
Sep 17 02:08:56.349624 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:56.349411    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eec0370a-c385-469b-8697-b0534845007b" containerName="istio-proxy"
Sep 17 02:08:56.349624 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:56.349419    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="eec0370a-c385-469b-8697-b0534845007b" containerName="istio-proxy"
Sep 17 02:08:56.349624 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:56.349440    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0abf225-37e6-40a7-989c-50bcb88390a7" containerName="istio-proxy"
Sep 17 02:08:56.349624 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:56.349448    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0abf225-37e6-40a7-989c-50bcb88390a7" containerName="istio-proxy"
Sep 17 02:08:56.349624 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:56.349546    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="eec0370a-c385-469b-8697-b0534845007b" containerName="istio-proxy"
Sep 17 02:08:56.349624 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:56.349558    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fda824e-ac2f-4972-9790-e66b8c04412a" containerName="payload-processing"
Sep 17 02:08:56.349624 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:56.349567    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="eec0370a-c385-469b-8697-b0534845007b" containerName="istio-proxy"
Sep 17 02:08:56.349624 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:56.349579    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0abf225-37e6-40a7-989c-50bcb88390a7" containerName="istio-proxy"
Sep 17 02:08:56.352826 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:56.352805    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p"
Sep 17 02:08:56.354476 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:56.354453    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-0d7c34-openshift-default-dockercfg-cqnxj\""
Sep 17 02:08:56.362083 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:56.362059    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p"]
Sep 17 02:08:56.418474 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:56.418443    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56d8bfd0-2497-46b9-9ed6-e489470a7322-workload-socket\") pod \"e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p\" (UID: \"56d8bfd0-2497-46b9-9ed6-e489470a7322\") " pod="openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p"
Sep 17 02:08:56.418667 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:56.418484    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqhng\" (UniqueName: \"kubernetes.io/projected/56d8bfd0-2497-46b9-9ed6-e489470a7322-kube-api-access-nqhng\") pod \"e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p\" (UID: \"56d8bfd0-2497-46b9-9ed6-e489470a7322\") " pod="openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p"
Sep 17 02:08:56.418667 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:56.418517    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56d8bfd0-2497-46b9-9ed6-e489470a7322-istio-token\") pod \"e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p\" (UID: \"56d8bfd0-2497-46b9-9ed6-e489470a7322\") " pod="openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p"
Sep 17 02:08:56.418667 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:56.418591    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56d8bfd0-2497-46b9-9ed6-e489470a7322-istiod-ca-cert\") pod \"e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p\" (UID: \"56d8bfd0-2497-46b9-9ed6-e489470a7322\") " pod="openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p"
Sep 17 02:08:56.418838 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:56.418701    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56d8bfd0-2497-46b9-9ed6-e489470a7322-istio-podinfo\") pod \"e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p\" (UID: \"56d8bfd0-2497-46b9-9ed6-e489470a7322\") " pod="openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p"
Sep 17 02:08:56.418838 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:56.418738    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56d8bfd0-2497-46b9-9ed6-e489470a7322-credential-socket\") pod \"e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p\" (UID: \"56d8bfd0-2497-46b9-9ed6-e489470a7322\") " pod="openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p"
Sep 17 02:08:56.418838 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:56.418767    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56d8bfd0-2497-46b9-9ed6-e489470a7322-workload-certs\") pod \"e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p\" (UID: \"56d8bfd0-2497-46b9-9ed6-e489470a7322\") " pod="openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p"
Sep 17 02:08:56.419037 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:56.418836    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56d8bfd0-2497-46b9-9ed6-e489470a7322-istio-envoy\") pod \"e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p\" (UID: \"56d8bfd0-2497-46b9-9ed6-e489470a7322\") " pod="openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p"
Sep 17 02:08:56.419037 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:56.418881    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56d8bfd0-2497-46b9-9ed6-e489470a7322-istio-data\") pod \"e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p\" (UID: \"56d8bfd0-2497-46b9-9ed6-e489470a7322\") " pod="openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p"
Sep 17 02:08:56.519816 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:56.519774    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56d8bfd0-2497-46b9-9ed6-e489470a7322-workload-socket\") pod \"e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p\" (UID: \"56d8bfd0-2497-46b9-9ed6-e489470a7322\") " pod="openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p"
Sep 17 02:08:56.519816 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:56.519815    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqhng\" (UniqueName: \"kubernetes.io/projected/56d8bfd0-2497-46b9-9ed6-e489470a7322-kube-api-access-nqhng\") pod \"e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p\" (UID: \"56d8bfd0-2497-46b9-9ed6-e489470a7322\") " pod="openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p"
Sep 17 02:08:56.520070 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:56.519841    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56d8bfd0-2497-46b9-9ed6-e489470a7322-istio-token\") pod \"e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p\" (UID: \"56d8bfd0-2497-46b9-9ed6-e489470a7322\") " pod="openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p"
Sep 17 02:08:56.520070 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:56.519891    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56d8bfd0-2497-46b9-9ed6-e489470a7322-istiod-ca-cert\") pod \"e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p\" (UID: \"56d8bfd0-2497-46b9-9ed6-e489470a7322\") " pod="openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p"
Sep 17 02:08:56.520070 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:56.519962    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56d8bfd0-2497-46b9-9ed6-e489470a7322-istio-podinfo\") pod \"e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p\" (UID: \"56d8bfd0-2497-46b9-9ed6-e489470a7322\") " pod="openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p"
Sep 17 02:08:56.520070 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:56.519992    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56d8bfd0-2497-46b9-9ed6-e489470a7322-credential-socket\") pod \"e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p\" (UID: \"56d8bfd0-2497-46b9-9ed6-e489470a7322\") " pod="openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p"
Sep 17 02:08:56.520070 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:56.520017    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56d8bfd0-2497-46b9-9ed6-e489470a7322-workload-certs\") pod \"e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p\" (UID: \"56d8bfd0-2497-46b9-9ed6-e489470a7322\") " pod="openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p"
Sep 17 02:08:56.520070 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:56.520046    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56d8bfd0-2497-46b9-9ed6-e489470a7322-istio-envoy\") pod \"e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p\" (UID: \"56d8bfd0-2497-46b9-9ed6-e489470a7322\") " pod="openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p"
Sep 17 02:08:56.520441 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:56.520075    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56d8bfd0-2497-46b9-9ed6-e489470a7322-istio-data\") pod \"e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p\" (UID: \"56d8bfd0-2497-46b9-9ed6-e489470a7322\") " pod="openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p"
Sep 17 02:08:56.520441 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:56.520303    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56d8bfd0-2497-46b9-9ed6-e489470a7322-workload-socket\") pod \"e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p\" (UID: \"56d8bfd0-2497-46b9-9ed6-e489470a7322\") " pod="openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p"
Sep 17 02:08:56.520441 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:56.520395    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56d8bfd0-2497-46b9-9ed6-e489470a7322-credential-socket\") pod \"e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p\" (UID: \"56d8bfd0-2497-46b9-9ed6-e489470a7322\") " pod="openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p"
Sep 17 02:08:56.520601 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:56.520464    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56d8bfd0-2497-46b9-9ed6-e489470a7322-workload-certs\") pod \"e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p\" (UID: \"56d8bfd0-2497-46b9-9ed6-e489470a7322\") " pod="openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p"
Sep 17 02:08:56.520601 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:56.520510    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56d8bfd0-2497-46b9-9ed6-e489470a7322-istio-data\") pod \"e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p\" (UID: \"56d8bfd0-2497-46b9-9ed6-e489470a7322\") " pod="openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p"
Sep 17 02:08:56.520798 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:56.520774    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56d8bfd0-2497-46b9-9ed6-e489470a7322-istiod-ca-cert\") pod \"e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p\" (UID: \"56d8bfd0-2497-46b9-9ed6-e489470a7322\") " pod="openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p"
Sep 17 02:08:56.522413 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:56.522392    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56d8bfd0-2497-46b9-9ed6-e489470a7322-istio-envoy\") pod \"e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p\" (UID: \"56d8bfd0-2497-46b9-9ed6-e489470a7322\") " pod="openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p"
Sep 17 02:08:56.522635 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:56.522616    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56d8bfd0-2497-46b9-9ed6-e489470a7322-istio-podinfo\") pod \"e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p\" (UID: \"56d8bfd0-2497-46b9-9ed6-e489470a7322\") " pod="openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p"
Sep 17 02:08:56.527492 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:56.527466    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56d8bfd0-2497-46b9-9ed6-e489470a7322-istio-token\") pod \"e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p\" (UID: \"56d8bfd0-2497-46b9-9ed6-e489470a7322\") " pod="openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p"
Sep 17 02:08:56.527587 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:56.527473    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqhng\" (UniqueName: \"kubernetes.io/projected/56d8bfd0-2497-46b9-9ed6-e489470a7322-kube-api-access-nqhng\") pod \"e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p\" (UID: \"56d8bfd0-2497-46b9-9ed6-e489470a7322\") " pod="openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p"
Sep 17 02:08:56.665278 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:56.665164    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p"
Sep 17 02:08:56.941035 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:56.940947    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p"]
Sep 17 02:08:56.943892 ip-10-0-143-95 kubenswrapper[2560]: W0917 02:08:56.943862    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56d8bfd0_2497_46b9_9ed6_e489470a7322.slice/crio-8ce77cd385af29dc2a9a4de1798a7f49934039a112574e7e2cf1af36e32ff7fa WatchSource:0}: Error finding container 8ce77cd385af29dc2a9a4de1798a7f49934039a112574e7e2cf1af36e32ff7fa: Status 404 returned error can't find the container with id 8ce77cd385af29dc2a9a4de1798a7f49934039a112574e7e2cf1af36e32ff7fa
Sep 17 02:08:56.946178 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:56.946148    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 02:08:56.946275 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:56.946214    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 02:08:56.946275 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:56.946241    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 02:08:57.155437 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:57.155402    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p" event={"ID":"56d8bfd0-2497-46b9-9ed6-e489470a7322","Type":"ContainerStarted","Data":"119e81c65503ad6ce0d8ce2911bc4c9c11f743c89c997965b22053563bca16be"}
Sep 17 02:08:57.155633 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:57.155464    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p" event={"ID":"56d8bfd0-2497-46b9-9ed6-e489470a7322","Type":"ContainerStarted","Data":"8ce77cd385af29dc2a9a4de1798a7f49934039a112574e7e2cf1af36e32ff7fa"}
Sep 17 02:08:57.172344 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:57.172284    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p" podStartSLOduration=1.17224147 podStartE2EDuration="1.17224147s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 02:08:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:08:57.170789581 +0000 UTC m=+1895.420766906" watchObservedRunningTime="2026-09-17 02:08:57.17224147 +0000 UTC m=+1895.422218786"
Sep 17 02:08:57.670265 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:57.665448    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p"
Sep 17 02:08:58.672555 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:58.672525    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p"
Sep 17 02:08:59.166154 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:59.166122    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p"
Sep 17 02:08:59.167207 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:08:59.167181    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p"
Sep 17 02:09:09.696192 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:09.696141    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w2-67a23a/rate-test-model-67a23a-kserve-6c945cb6ff-5brpt" podUID="3fcc4536-be0c-4e22-802d-37e65cb02dac" containerName="main" containerID="cri-o://d08fddeb0c6c9d00036d81af7f80cfd10c1e7c0825f19676c9a7252818749e67" gracePeriod=45
Sep 17 02:09:09.989896 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:09.989869    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w2-67a23a/rate-test-model-67a23a-kserve-6c945cb6ff-5brpt"
Sep 17 02:09:10.047222 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:10.047189    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9pjvj\" (UniqueName: \"kubernetes.io/projected/3fcc4536-be0c-4e22-802d-37e65cb02dac-kube-api-access-9pjvj\") pod \"3fcc4536-be0c-4e22-802d-37e65cb02dac\" (UID: \"3fcc4536-be0c-4e22-802d-37e65cb02dac\") "
Sep 17 02:09:10.047406 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:10.047238    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fcc4536-be0c-4e22-802d-37e65cb02dac-tls-certs\") pod \"3fcc4536-be0c-4e22-802d-37e65cb02dac\" (UID: \"3fcc4536-be0c-4e22-802d-37e65cb02dac\") "
Sep 17 02:09:10.047406 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:10.047273    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fcc4536-be0c-4e22-802d-37e65cb02dac-dshm\") pod \"3fcc4536-be0c-4e22-802d-37e65cb02dac\" (UID: \"3fcc4536-be0c-4e22-802d-37e65cb02dac\") "
Sep 17 02:09:10.047406 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:10.047333    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fcc4536-be0c-4e22-802d-37e65cb02dac-home\") pod \"3fcc4536-be0c-4e22-802d-37e65cb02dac\" (UID: \"3fcc4536-be0c-4e22-802d-37e65cb02dac\") "
Sep 17 02:09:10.047406 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:10.047378    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fcc4536-be0c-4e22-802d-37e65cb02dac-tmp-dir\") pod \"3fcc4536-be0c-4e22-802d-37e65cb02dac\" (UID: \"3fcc4536-be0c-4e22-802d-37e65cb02dac\") "
Sep 17 02:09:10.047576 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:10.047407    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fcc4536-be0c-4e22-802d-37e65cb02dac-model-cache\") pod \"3fcc4536-be0c-4e22-802d-37e65cb02dac\" (UID: \"3fcc4536-be0c-4e22-802d-37e65cb02dac\") "
Sep 17 02:09:10.047717 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:10.047648    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fcc4536-be0c-4e22-802d-37e65cb02dac-home" (OuterVolumeSpecName: "home") pod "3fcc4536-be0c-4e22-802d-37e65cb02dac" (UID: "3fcc4536-be0c-4e22-802d-37e65cb02dac"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:09:10.047717 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:10.047679    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fcc4536-be0c-4e22-802d-37e65cb02dac-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3fcc4536-be0c-4e22-802d-37e65cb02dac" (UID: "3fcc4536-be0c-4e22-802d-37e65cb02dac"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:09:10.047929 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:10.047736    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fcc4536-be0c-4e22-802d-37e65cb02dac-model-cache" (OuterVolumeSpecName: "model-cache") pod "3fcc4536-be0c-4e22-802d-37e65cb02dac" (UID: "3fcc4536-be0c-4e22-802d-37e65cb02dac"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:09:10.047929 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:10.047876    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fcc4536-be0c-4e22-802d-37e65cb02dac-home\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:09:10.047929 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:10.047898    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fcc4536-be0c-4e22-802d-37e65cb02dac-tmp-dir\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:09:10.047929 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:10.047912    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fcc4536-be0c-4e22-802d-37e65cb02dac-model-cache\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:09:10.049536 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:10.049512    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fcc4536-be0c-4e22-802d-37e65cb02dac-dshm" (OuterVolumeSpecName: "dshm") pod "3fcc4536-be0c-4e22-802d-37e65cb02dac" (UID: "3fcc4536-be0c-4e22-802d-37e65cb02dac"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:09:10.049631 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:10.049600    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fcc4536-be0c-4e22-802d-37e65cb02dac-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3fcc4536-be0c-4e22-802d-37e65cb02dac" (UID: "3fcc4536-be0c-4e22-802d-37e65cb02dac"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 02:09:10.049693 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:10.049675    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fcc4536-be0c-4e22-802d-37e65cb02dac-kube-api-access-9pjvj" (OuterVolumeSpecName: "kube-api-access-9pjvj") pod "3fcc4536-be0c-4e22-802d-37e65cb02dac" (UID: "3fcc4536-be0c-4e22-802d-37e65cb02dac"). InnerVolumeSpecName "kube-api-access-9pjvj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 02:09:10.148823 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:10.148786    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9pjvj\" (UniqueName: \"kubernetes.io/projected/3fcc4536-be0c-4e22-802d-37e65cb02dac-kube-api-access-9pjvj\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:09:10.148823 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:10.148818    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fcc4536-be0c-4e22-802d-37e65cb02dac-tls-certs\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:09:10.148823 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:10.148829    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fcc4536-be0c-4e22-802d-37e65cb02dac-dshm\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:09:10.219753 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:10.219670    2560 generic.go:356] "Generic (PLEG): container finished" podID="3fcc4536-be0c-4e22-802d-37e65cb02dac" containerID="d08fddeb0c6c9d00036d81af7f80cfd10c1e7c0825f19676c9a7252818749e67" exitCode=0
Sep 17 02:09:10.219753 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:10.219720    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w2-67a23a/rate-test-model-67a23a-kserve-6c945cb6ff-5brpt"
Sep 17 02:09:10.219753 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:10.219749    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w2-67a23a/rate-test-model-67a23a-kserve-6c945cb6ff-5brpt" event={"ID":"3fcc4536-be0c-4e22-802d-37e65cb02dac","Type":"ContainerDied","Data":"d08fddeb0c6c9d00036d81af7f80cfd10c1e7c0825f19676c9a7252818749e67"}
Sep 17 02:09:10.219981 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:10.219779    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w2-67a23a/rate-test-model-67a23a-kserve-6c945cb6ff-5brpt" event={"ID":"3fcc4536-be0c-4e22-802d-37e65cb02dac","Type":"ContainerDied","Data":"cbc4fa181be2a48e1f12db6554725c1c108c3b049ea465e58ab248c02a6eb968"}
Sep 17 02:09:10.219981 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:10.219796    2560 scope.go:117] "RemoveContainer" containerID="d08fddeb0c6c9d00036d81af7f80cfd10c1e7c0825f19676c9a7252818749e67"
Sep 17 02:09:10.228850 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:10.228823    2560 scope.go:117] "RemoveContainer" containerID="d08fddeb0c6c9d00036d81af7f80cfd10c1e7c0825f19676c9a7252818749e67"
Sep 17 02:09:10.229111 ip-10-0-143-95 kubenswrapper[2560]: E0917 02:09:10.229095    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d08fddeb0c6c9d00036d81af7f80cfd10c1e7c0825f19676c9a7252818749e67\": container with ID starting with d08fddeb0c6c9d00036d81af7f80cfd10c1e7c0825f19676c9a7252818749e67 not found: ID does not exist" containerID="d08fddeb0c6c9d00036d81af7f80cfd10c1e7c0825f19676c9a7252818749e67"
Sep 17 02:09:10.229161 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:10.229121    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d08fddeb0c6c9d00036d81af7f80cfd10c1e7c0825f19676c9a7252818749e67"} err="failed to get container status \"d08fddeb0c6c9d00036d81af7f80cfd10c1e7c0825f19676c9a7252818749e67\": rpc error: code = NotFound desc = could not find container \"d08fddeb0c6c9d00036d81af7f80cfd10c1e7c0825f19676c9a7252818749e67\": container with ID starting with d08fddeb0c6c9d00036d81af7f80cfd10c1e7c0825f19676c9a7252818749e67 not found: ID does not exist"
Sep 17 02:09:10.238935 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:10.238911    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w2-67a23a/rate-test-model-67a23a-kserve-6c945cb6ff-5brpt"]
Sep 17 02:09:10.242300 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:10.242279    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w2-67a23a/rate-test-model-67a23a-kserve-6c945cb6ff-5brpt"]
Sep 17 02:09:10.358271 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:10.358212    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fcc4536-be0c-4e22-802d-37e65cb02dac" path="/var/lib/kubelet/pods/3fcc4536-be0c-4e22-802d-37e65cb02dac/volumes"
Sep 17 02:09:14.811449 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:14.811412    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": read tcp 10.133.0.2:41380->10.133.0.74:15021: read: connection reset by peer" start-of-body=
Sep 17 02:09:14.811902 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:14.811488    2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p" podUID="56d8bfd0-2497-46b9-9ed6-e489470a7322" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": read tcp 10.133.0.2:41380->10.133.0.74:15021: read: connection reset by peer"
Sep 17 02:09:15.246772 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:15.246682    2560 generic.go:356] "Generic (PLEG): container finished" podID="56d8bfd0-2497-46b9-9ed6-e489470a7322" containerID="119e81c65503ad6ce0d8ce2911bc4c9c11f743c89c997965b22053563bca16be" exitCode=0
Sep 17 02:09:15.246952 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:15.246764    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p" event={"ID":"56d8bfd0-2497-46b9-9ed6-e489470a7322","Type":"ContainerDied","Data":"119e81c65503ad6ce0d8ce2911bc4c9c11f743c89c997965b22053563bca16be"}
Sep 17 02:09:15.247234 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:15.247217    2560 scope.go:117] "RemoveContainer" containerID="119e81c65503ad6ce0d8ce2911bc4c9c11f743c89c997965b22053563bca16be"
Sep 17 02:09:15.248333 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:15.248305    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 02:09:15.248422 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:15.248392    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 02:09:15.248467 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:15.248423    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 02:09:16.253629 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:16.253598    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p" event={"ID":"56d8bfd0-2497-46b9-9ed6-e489470a7322","Type":"ContainerStarted","Data":"a11688802050a8fabf907694f3d65213b2e94b6476eb410271cc258280cec9ed"}
Sep 17 02:09:16.666522 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:16.666480    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p"
Sep 17 02:09:16.666735 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:16.666610    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 17 02:09:16.666735 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:16.666666    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p" podUID="56d8bfd0-2497-46b9-9ed6-e489470a7322" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 17 02:09:17.666110 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:17.666065    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 17 02:09:17.666722 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:17.666687    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p" podUID="56d8bfd0-2497-46b9-9ed6-e489470a7322" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 17 02:09:18.666426 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:18.666383    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 17 02:09:18.667024 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:18.666991    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p" podUID="56d8bfd0-2497-46b9-9ed6-e489470a7322" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 17 02:09:19.666570 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:19.666521    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 17 02:09:19.667080 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:19.666593    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p" podUID="56d8bfd0-2497-46b9-9ed6-e489470a7322" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 17 02:09:20.666158 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:20.666110    2560 patch_prober.go:28] interesting pod/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 17 02:09:20.666404 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:20.666181    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p" podUID="56d8bfd0-2497-46b9-9ed6-e489470a7322" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 17 02:09:21.670170 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:21.670138    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p"
Sep 17 02:09:21.670582 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:21.670368    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p"
Sep 17 02:09:21.670987 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:21.670968    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p"
Sep 17 02:09:25.236342 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:25.236298    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz"]
Sep 17 02:09:25.236862 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:25.236841    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fcc4536-be0c-4e22-802d-37e65cb02dac" containerName="main"
Sep 17 02:09:25.236959 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:25.236865    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fcc4536-be0c-4e22-802d-37e65cb02dac" containerName="main"
Sep 17 02:09:25.236959 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:25.236906    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eec0370a-c385-469b-8697-b0534845007b" containerName="istio-proxy"
Sep 17 02:09:25.236959 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:25.236915    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="eec0370a-c385-469b-8697-b0534845007b" containerName="istio-proxy"
Sep 17 02:09:25.237107 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:25.237023    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fcc4536-be0c-4e22-802d-37e65cb02dac" containerName="main"
Sep 17 02:09:25.239428 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:25.239408    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz"
Sep 17 02:09:25.241377 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:25.241347    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-4ee767-openshift-default-dockercfg-6v7jw\""
Sep 17 02:09:25.250292 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:25.250264    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz"]
Sep 17 02:09:25.323018 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:25.322977    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96e800aa-d877-4e07-b851-9052b71572e0-credential-socket\") pod \"e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz\" (UID: \"96e800aa-d877-4e07-b851-9052b71572e0\") " pod="openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz"
Sep 17 02:09:25.323018 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:25.323024    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdwjj\" (UniqueName: \"kubernetes.io/projected/96e800aa-d877-4e07-b851-9052b71572e0-kube-api-access-mdwjj\") pod \"e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz\" (UID: \"96e800aa-d877-4e07-b851-9052b71572e0\") " pod="openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz"
Sep 17 02:09:25.323289 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:25.323051    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96e800aa-d877-4e07-b851-9052b71572e0-workload-certs\") pod \"e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz\" (UID: \"96e800aa-d877-4e07-b851-9052b71572e0\") " pod="openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz"
Sep 17 02:09:25.323289 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:25.323089    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96e800aa-d877-4e07-b851-9052b71572e0-istio-envoy\") pod \"e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz\" (UID: \"96e800aa-d877-4e07-b851-9052b71572e0\") " pod="openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz"
Sep 17 02:09:25.323289 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:25.323117    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96e800aa-d877-4e07-b851-9052b71572e0-istiod-ca-cert\") pod \"e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz\" (UID: \"96e800aa-d877-4e07-b851-9052b71572e0\") " pod="openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz"
Sep 17 02:09:25.323289 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:25.323181    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96e800aa-d877-4e07-b851-9052b71572e0-istio-podinfo\") pod \"e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz\" (UID: \"96e800aa-d877-4e07-b851-9052b71572e0\") " pod="openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz"
Sep 17 02:09:25.323289 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:25.323233    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96e800aa-d877-4e07-b851-9052b71572e0-istio-data\") pod \"e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz\" (UID: \"96e800aa-d877-4e07-b851-9052b71572e0\") " pod="openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz"
Sep 17 02:09:25.323473 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:25.323324    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96e800aa-d877-4e07-b851-9052b71572e0-workload-socket\") pod \"e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz\" (UID: \"96e800aa-d877-4e07-b851-9052b71572e0\") " pod="openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz"
Sep 17 02:09:25.323473 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:25.323362    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96e800aa-d877-4e07-b851-9052b71572e0-istio-token\") pod \"e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz\" (UID: \"96e800aa-d877-4e07-b851-9052b71572e0\") " pod="openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz"
Sep 17 02:09:25.424676 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:25.424634    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96e800aa-d877-4e07-b851-9052b71572e0-istio-podinfo\") pod \"e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz\" (UID: \"96e800aa-d877-4e07-b851-9052b71572e0\") " pod="openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz"
Sep 17 02:09:25.424676 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:25.424680    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96e800aa-d877-4e07-b851-9052b71572e0-istio-data\") pod \"e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz\" (UID: \"96e800aa-d877-4e07-b851-9052b71572e0\") " pod="openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz"
Sep 17 02:09:25.425076 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:25.424753    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96e800aa-d877-4e07-b851-9052b71572e0-workload-socket\") pod \"e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz\" (UID: \"96e800aa-d877-4e07-b851-9052b71572e0\") " pod="openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz"
Sep 17 02:09:25.425076 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:25.424781    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96e800aa-d877-4e07-b851-9052b71572e0-istio-token\") pod \"e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz\" (UID: \"96e800aa-d877-4e07-b851-9052b71572e0\") " pod="openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz"
Sep 17 02:09:25.425076 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:25.424836    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96e800aa-d877-4e07-b851-9052b71572e0-credential-socket\") pod \"e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz\" (UID: \"96e800aa-d877-4e07-b851-9052b71572e0\") " pod="openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz"
Sep 17 02:09:25.425076 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:25.424981    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdwjj\" (UniqueName: \"kubernetes.io/projected/96e800aa-d877-4e07-b851-9052b71572e0-kube-api-access-mdwjj\") pod \"e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz\" (UID: \"96e800aa-d877-4e07-b851-9052b71572e0\") " pod="openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz"
Sep 17 02:09:25.425076 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:25.425030    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96e800aa-d877-4e07-b851-9052b71572e0-workload-certs\") pod \"e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz\" (UID: \"96e800aa-d877-4e07-b851-9052b71572e0\") " pod="openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz"
Sep 17 02:09:25.425076 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:25.425065    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96e800aa-d877-4e07-b851-9052b71572e0-istio-envoy\") pod \"e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz\" (UID: \"96e800aa-d877-4e07-b851-9052b71572e0\") " pod="openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz"
Sep 17 02:09:25.425547 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:25.425129    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96e800aa-d877-4e07-b851-9052b71572e0-istiod-ca-cert\") pod \"e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz\" (UID: \"96e800aa-d877-4e07-b851-9052b71572e0\") " pod="openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz"
Sep 17 02:09:25.425547 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:25.425137    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96e800aa-d877-4e07-b851-9052b71572e0-istio-data\") pod \"e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz\" (UID: \"96e800aa-d877-4e07-b851-9052b71572e0\") " pod="openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz"
Sep 17 02:09:25.425658 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:25.425546    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96e800aa-d877-4e07-b851-9052b71572e0-workload-socket\") pod \"e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz\" (UID: \"96e800aa-d877-4e07-b851-9052b71572e0\") " pod="openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz"
Sep 17 02:09:25.425658 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:25.425605    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96e800aa-d877-4e07-b851-9052b71572e0-credential-socket\") pod \"e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz\" (UID: \"96e800aa-d877-4e07-b851-9052b71572e0\") " pod="openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz"
Sep 17 02:09:25.425798 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:25.425772    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96e800aa-d877-4e07-b851-9052b71572e0-workload-certs\") pod \"e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz\" (UID: \"96e800aa-d877-4e07-b851-9052b71572e0\") " pod="openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz"
Sep 17 02:09:25.426288 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:25.426235    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96e800aa-d877-4e07-b851-9052b71572e0-istiod-ca-cert\") pod \"e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz\" (UID: \"96e800aa-d877-4e07-b851-9052b71572e0\") " pod="openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz"
Sep 17 02:09:25.427507 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:25.427484    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96e800aa-d877-4e07-b851-9052b71572e0-istio-envoy\") pod \"e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz\" (UID: \"96e800aa-d877-4e07-b851-9052b71572e0\") " pod="openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz"
Sep 17 02:09:25.427599 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:25.427525    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96e800aa-d877-4e07-b851-9052b71572e0-istio-podinfo\") pod \"e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz\" (UID: \"96e800aa-d877-4e07-b851-9052b71572e0\") " pod="openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz"
Sep 17 02:09:25.431764 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:25.431737    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96e800aa-d877-4e07-b851-9052b71572e0-istio-token\") pod \"e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz\" (UID: \"96e800aa-d877-4e07-b851-9052b71572e0\") " pod="openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz"
Sep 17 02:09:25.431917 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:25.431899    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdwjj\" (UniqueName: \"kubernetes.io/projected/96e800aa-d877-4e07-b851-9052b71572e0-kube-api-access-mdwjj\") pod \"e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz\" (UID: \"96e800aa-d877-4e07-b851-9052b71572e0\") " pod="openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz"
Sep 17 02:09:25.552741 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:25.552658    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz"
Sep 17 02:09:25.827522 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:25.827485    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz"]
Sep 17 02:09:25.828856 ip-10-0-143-95 kubenswrapper[2560]: W0917 02:09:25.828834    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96e800aa_d877_4e07_b851_9052b71572e0.slice/crio-e1ff2632c80c74ec3ecb2a5bb3a03e5722c79318d6235d862d6858153fe20c65 WatchSource:0}: Error finding container e1ff2632c80c74ec3ecb2a5bb3a03e5722c79318d6235d862d6858153fe20c65: Status 404 returned error can't find the container with id e1ff2632c80c74ec3ecb2a5bb3a03e5722c79318d6235d862d6858153fe20c65
Sep 17 02:09:25.831088 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:25.831058    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 02:09:25.831151 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:25.831125    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 02:09:25.831188 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:25.831157    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 02:09:26.314505 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:26.314467    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz" event={"ID":"96e800aa-d877-4e07-b851-9052b71572e0","Type":"ContainerStarted","Data":"9933d6d678d8cb37e5678cb01f2eb8e7289ffb5200d9968cd99670624636f87b"}
Sep 17 02:09:26.314977 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:26.314531    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz" event={"ID":"96e800aa-d877-4e07-b851-9052b71572e0","Type":"ContainerStarted","Data":"e1ff2632c80c74ec3ecb2a5bb3a03e5722c79318d6235d862d6858153fe20c65"}
Sep 17 02:09:26.333186 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:26.333135    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz" podStartSLOduration=1.3331178590000001 podStartE2EDuration="1.333117859s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 02:09:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:09:26.330679311 +0000 UTC m=+1924.580656623" watchObservedRunningTime="2026-09-17 02:09:26.333117859 +0000 UTC m=+1924.583095163"
Sep 17 02:09:26.553446 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:26.553411    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz"
Sep 17 02:09:26.558296 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:26.558268    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz"
Sep 17 02:09:27.320638 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:27.320606    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz"
Sep 17 02:09:27.321719 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:27.321689    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz"
Sep 17 02:09:31.182975 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:31.182935    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-4ee767-cf8b9b47f-zm4vb"]
Sep 17 02:09:31.185463 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:31.185437    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-4ee767-cf8b9b47f-zm4vb"
Sep 17 02:09:31.187239 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:31.187216    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-4ee767-dockercfg-8qwv9\""
Sep 17 02:09:31.187363 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:31.187217    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-4ee767\""
Sep 17 02:09:31.195605 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:31.195578    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-4ee767-cf8b9b47f-zm4vb"]
Sep 17 02:09:31.281151 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:31.281111    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d78caf1-6bc2-41bd-b91b-95ef85dad520-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-4ee767-cf8b9b47f-zm4vb\" (UID: \"9d78caf1-6bc2-41bd-b91b-95ef85dad520\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-4ee767-cf8b9b47f-zm4vb"
Sep 17 02:09:31.281354 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:31.281165    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fvhm\" (UniqueName: \"kubernetes.io/projected/9d78caf1-6bc2-41bd-b91b-95ef85dad520-kube-api-access-4fvhm\") pod \"payload-processing-e2e-ipp-b-4ee767-cf8b9b47f-zm4vb\" (UID: \"9d78caf1-6bc2-41bd-b91b-95ef85dad520\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-4ee767-cf8b9b47f-zm4vb"
Sep 17 02:09:31.382780 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:31.382742    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d78caf1-6bc2-41bd-b91b-95ef85dad520-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-4ee767-cf8b9b47f-zm4vb\" (UID: \"9d78caf1-6bc2-41bd-b91b-95ef85dad520\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-4ee767-cf8b9b47f-zm4vb"
Sep 17 02:09:31.382960 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:31.382788    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fvhm\" (UniqueName: \"kubernetes.io/projected/9d78caf1-6bc2-41bd-b91b-95ef85dad520-kube-api-access-4fvhm\") pod \"payload-processing-e2e-ipp-b-4ee767-cf8b9b47f-zm4vb\" (UID: \"9d78caf1-6bc2-41bd-b91b-95ef85dad520\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-4ee767-cf8b9b47f-zm4vb"
Sep 17 02:09:31.383597 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:31.383565    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d78caf1-6bc2-41bd-b91b-95ef85dad520-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-4ee767-cf8b9b47f-zm4vb\" (UID: \"9d78caf1-6bc2-41bd-b91b-95ef85dad520\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-4ee767-cf8b9b47f-zm4vb"
Sep 17 02:09:31.390113 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:31.390086    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fvhm\" (UniqueName: \"kubernetes.io/projected/9d78caf1-6bc2-41bd-b91b-95ef85dad520-kube-api-access-4fvhm\") pod \"payload-processing-e2e-ipp-b-4ee767-cf8b9b47f-zm4vb\" (UID: \"9d78caf1-6bc2-41bd-b91b-95ef85dad520\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-4ee767-cf8b9b47f-zm4vb"
Sep 17 02:09:31.497241 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:31.497141    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-4ee767-cf8b9b47f-zm4vb"
Sep 17 02:09:31.767544 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:31.767509    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-4ee767-cf8b9b47f-zm4vb"]
Sep 17 02:09:31.769707 ip-10-0-143-95 kubenswrapper[2560]: W0917 02:09:31.769675    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d78caf1_6bc2_41bd_b91b_95ef85dad520.slice/crio-6eadb7bf3a4ecd691bffe9ba5c31fcaf83c04e6c04ab95430a238f2a1fd60675 WatchSource:0}: Error finding container 6eadb7bf3a4ecd691bffe9ba5c31fcaf83c04e6c04ab95430a238f2a1fd60675: Status 404 returned error can't find the container with id 6eadb7bf3a4ecd691bffe9ba5c31fcaf83c04e6c04ab95430a238f2a1fd60675
Sep 17 02:09:32.357536 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:32.357502    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-4ee767-cf8b9b47f-zm4vb" event={"ID":"9d78caf1-6bc2-41bd-b91b-95ef85dad520","Type":"ContainerStarted","Data":"04862f04d60f053db7e181440c4d45f06d83e761c59ef16246b98544e323a2ab"}
Sep 17 02:09:32.357934 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:32.357555    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-4ee767-cf8b9b47f-zm4vb"
Sep 17 02:09:32.357934 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:32.357570    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-4ee767-cf8b9b47f-zm4vb" event={"ID":"9d78caf1-6bc2-41bd-b91b-95ef85dad520","Type":"ContainerStarted","Data":"6eadb7bf3a4ecd691bffe9ba5c31fcaf83c04e6c04ab95430a238f2a1fd60675"}
Sep 17 02:09:32.368848 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:32.368800    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-4ee767-cf8b9b47f-zm4vb" podStartSLOduration=1.368786031 podStartE2EDuration="1.368786031s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 02:09:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:09:32.366824492 +0000 UTC m=+1930.616801806" watchObservedRunningTime="2026-09-17 02:09:32.368786031 +0000 UTC m=+1930.618763344"
Sep 17 02:09:43.357727 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:43.357690    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-4ee767-cf8b9b47f-zm4vb"
Sep 17 02:09:46.430639 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:46.430602    2560 generic.go:356] "Generic (PLEG): container finished" podID="96e800aa-d877-4e07-b851-9052b71572e0" containerID="9933d6d678d8cb37e5678cb01f2eb8e7289ffb5200d9968cd99670624636f87b" exitCode=0
Sep 17 02:09:46.431081 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:46.430660    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz" event={"ID":"96e800aa-d877-4e07-b851-9052b71572e0","Type":"ContainerDied","Data":"9933d6d678d8cb37e5678cb01f2eb8e7289ffb5200d9968cd99670624636f87b"}
Sep 17 02:09:46.431081 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:46.431041    2560 scope.go:117] "RemoveContainer" containerID="9933d6d678d8cb37e5678cb01f2eb8e7289ffb5200d9968cd99670624636f87b"
Sep 17 02:09:46.432238 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:46.432203    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 02:09:46.432372 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:46.432322    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 02:09:46.432439 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:46.432371    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 02:09:47.436949 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:47.436913    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz" event={"ID":"96e800aa-d877-4e07-b851-9052b71572e0","Type":"ContainerStarted","Data":"41cc1f016c0780d61948dca400cdf70264f3489eb681ad17f407f01d873a29dd"}
Sep 17 02:09:47.553464 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:47.553428    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz"
Sep 17 02:09:47.553694 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:47.553670    2560 patch_prober.go:28] interesting pod/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Sep 17 02:09:47.553793 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:47.553739    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz" podUID="96e800aa-d877-4e07-b851-9052b71572e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Sep 17 02:09:48.553845 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:48.553809    2560 patch_prober.go:28] interesting pod/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Sep 17 02:09:48.554224 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:48.553876    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz" podUID="96e800aa-d877-4e07-b851-9052b71572e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Sep 17 02:09:49.553499 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:49.553463    2560 patch_prober.go:28] interesting pod/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Sep 17 02:09:49.553681 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:49.553527    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz" podUID="96e800aa-d877-4e07-b851-9052b71572e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Sep 17 02:09:50.554028 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:50.553991    2560 patch_prober.go:28] interesting pod/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Sep 17 02:09:50.554528 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:50.554049    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz" podUID="96e800aa-d877-4e07-b851-9052b71572e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Sep 17 02:09:51.553377 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:51.553341    2560 patch_prober.go:28] interesting pod/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Sep 17 02:09:51.553557 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:51.553398    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz" podUID="96e800aa-d877-4e07-b851-9052b71572e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Sep 17 02:09:52.676268 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:52.676206    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz"
Sep 17 02:09:52.676785 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:52.676500    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz"
Sep 17 02:09:52.677361 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:52.677345    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz"
Sep 17 02:09:59.143152 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:09:59.143119    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-4ee767-cf8b9b47f-zm4vb_9d78caf1-6bc2-41bd-b91b-95ef85dad520/payload-processing/0.log"
Sep 17 02:10:35.917198 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:35.917169    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-4ee767-cf8b9b47f-zm4vb_9d78caf1-6bc2-41bd-b91b-95ef85dad520/payload-processing/0.log"
Sep 17 02:10:36.045885 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:36.045857    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-4ee767-cf8b9b47f-zm4vb_9d78caf1-6bc2-41bd-b91b-95ef85dad520/payload-processing/0.log"
Sep 17 02:10:36.650059 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:36.650020    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74"]
Sep 17 02:10:36.654422 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:36.654393    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74"
Sep 17 02:10:36.656588 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:36.656565    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-557e7f-openshift-default-dockercfg-lzb7p\""
Sep 17 02:10:36.665543 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:36.665516    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74"]
Sep 17 02:10:36.720094 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:36.720058    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9ebf05f-9421-41c0-987a-3e39f051b2fe-istio-podinfo\") pod \"e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74\" (UID: \"c9ebf05f-9421-41c0-987a-3e39f051b2fe\") " pod="openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74"
Sep 17 02:10:36.720296 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:36.720109    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9ebf05f-9421-41c0-987a-3e39f051b2fe-workload-socket\") pod \"e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74\" (UID: \"c9ebf05f-9421-41c0-987a-3e39f051b2fe\") " pod="openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74"
Sep 17 02:10:36.720296 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:36.720132    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9ebf05f-9421-41c0-987a-3e39f051b2fe-credential-socket\") pod \"e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74\" (UID: \"c9ebf05f-9421-41c0-987a-3e39f051b2fe\") " pod="openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74"
Sep 17 02:10:36.720296 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:36.720191    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9ebf05f-9421-41c0-987a-3e39f051b2fe-workload-certs\") pod \"e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74\" (UID: \"c9ebf05f-9421-41c0-987a-3e39f051b2fe\") " pod="openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74"
Sep 17 02:10:36.720296 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:36.720271    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9ebf05f-9421-41c0-987a-3e39f051b2fe-istio-token\") pod \"e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74\" (UID: \"c9ebf05f-9421-41c0-987a-3e39f051b2fe\") " pod="openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74"
Sep 17 02:10:36.720440 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:36.720344    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9ebf05f-9421-41c0-987a-3e39f051b2fe-istio-data\") pod \"e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74\" (UID: \"c9ebf05f-9421-41c0-987a-3e39f051b2fe\") " pod="openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74"
Sep 17 02:10:36.720440 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:36.720383    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9ebf05f-9421-41c0-987a-3e39f051b2fe-istiod-ca-cert\") pod \"e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74\" (UID: \"c9ebf05f-9421-41c0-987a-3e39f051b2fe\") " pod="openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74"
Sep 17 02:10:36.720440 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:36.720401    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9ebf05f-9421-41c0-987a-3e39f051b2fe-istio-envoy\") pod \"e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74\" (UID: \"c9ebf05f-9421-41c0-987a-3e39f051b2fe\") " pod="openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74"
Sep 17 02:10:36.720536 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:36.720457    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vczb\" (UniqueName: \"kubernetes.io/projected/c9ebf05f-9421-41c0-987a-3e39f051b2fe-kube-api-access-8vczb\") pod \"e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74\" (UID: \"c9ebf05f-9421-41c0-987a-3e39f051b2fe\") " pod="openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74"
Sep 17 02:10:36.821440 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:36.821404    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9ebf05f-9421-41c0-987a-3e39f051b2fe-istio-podinfo\") pod \"e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74\" (UID: \"c9ebf05f-9421-41c0-987a-3e39f051b2fe\") " pod="openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74"
Sep 17 02:10:36.821618 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:36.821453    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9ebf05f-9421-41c0-987a-3e39f051b2fe-workload-socket\") pod \"e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74\" (UID: \"c9ebf05f-9421-41c0-987a-3e39f051b2fe\") " pod="openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74"
Sep 17 02:10:36.821667 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:36.821631    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9ebf05f-9421-41c0-987a-3e39f051b2fe-credential-socket\") pod \"e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74\" (UID: \"c9ebf05f-9421-41c0-987a-3e39f051b2fe\") " pod="openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74"
Sep 17 02:10:36.821705 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:36.821666    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9ebf05f-9421-41c0-987a-3e39f051b2fe-workload-certs\") pod \"e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74\" (UID: \"c9ebf05f-9421-41c0-987a-3e39f051b2fe\") " pod="openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74"
Sep 17 02:10:36.821740 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:36.821719    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9ebf05f-9421-41c0-987a-3e39f051b2fe-istio-token\") pod \"e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74\" (UID: \"c9ebf05f-9421-41c0-987a-3e39f051b2fe\") " pod="openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74"
Sep 17 02:10:36.821804 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:36.821787    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9ebf05f-9421-41c0-987a-3e39f051b2fe-istio-data\") pod \"e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74\" (UID: \"c9ebf05f-9421-41c0-987a-3e39f051b2fe\") " pod="openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74"
Sep 17 02:10:36.821847 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:36.821837    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9ebf05f-9421-41c0-987a-3e39f051b2fe-istiod-ca-cert\") pod \"e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74\" (UID: \"c9ebf05f-9421-41c0-987a-3e39f051b2fe\") " pod="openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74"
Sep 17 02:10:36.821892 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:36.821865    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9ebf05f-9421-41c0-987a-3e39f051b2fe-istio-envoy\") pod \"e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74\" (UID: \"c9ebf05f-9421-41c0-987a-3e39f051b2fe\") " pod="openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74"
Sep 17 02:10:36.821946 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:36.821912    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9ebf05f-9421-41c0-987a-3e39f051b2fe-workload-socket\") pod \"e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74\" (UID: \"c9ebf05f-9421-41c0-987a-3e39f051b2fe\") " pod="openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74"
Sep 17 02:10:36.821946 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:36.821928    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vczb\" (UniqueName: \"kubernetes.io/projected/c9ebf05f-9421-41c0-987a-3e39f051b2fe-kube-api-access-8vczb\") pod \"e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74\" (UID: \"c9ebf05f-9421-41c0-987a-3e39f051b2fe\") " pod="openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74"
Sep 17 02:10:36.822056 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:36.821952    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9ebf05f-9421-41c0-987a-3e39f051b2fe-credential-socket\") pod \"e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74\" (UID: \"c9ebf05f-9421-41c0-987a-3e39f051b2fe\") " pod="openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74"
Sep 17 02:10:36.822116 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:36.822093    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9ebf05f-9421-41c0-987a-3e39f051b2fe-workload-certs\") pod \"e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74\" (UID: \"c9ebf05f-9421-41c0-987a-3e39f051b2fe\") " pod="openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74"
Sep 17 02:10:36.822228 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:36.822203    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9ebf05f-9421-41c0-987a-3e39f051b2fe-istio-data\") pod \"e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74\" (UID: \"c9ebf05f-9421-41c0-987a-3e39f051b2fe\") " pod="openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74"
Sep 17 02:10:36.822584 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:36.822566    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9ebf05f-9421-41c0-987a-3e39f051b2fe-istiod-ca-cert\") pod \"e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74\" (UID: \"c9ebf05f-9421-41c0-987a-3e39f051b2fe\") " pod="openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74"
Sep 17 02:10:36.824032 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:36.824011    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9ebf05f-9421-41c0-987a-3e39f051b2fe-istio-envoy\") pod \"e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74\" (UID: \"c9ebf05f-9421-41c0-987a-3e39f051b2fe\") " pod="openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74"
Sep 17 02:10:36.824086 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:36.824069    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9ebf05f-9421-41c0-987a-3e39f051b2fe-istio-podinfo\") pod \"e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74\" (UID: \"c9ebf05f-9421-41c0-987a-3e39f051b2fe\") " pod="openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74"
Sep 17 02:10:36.836415 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:36.836387    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vczb\" (UniqueName: \"kubernetes.io/projected/c9ebf05f-9421-41c0-987a-3e39f051b2fe-kube-api-access-8vczb\") pod \"e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74\" (UID: \"c9ebf05f-9421-41c0-987a-3e39f051b2fe\") " pod="openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74"
Sep 17 02:10:36.836415 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:36.836413    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9ebf05f-9421-41c0-987a-3e39f051b2fe-istio-token\") pod \"e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74\" (UID: \"c9ebf05f-9421-41c0-987a-3e39f051b2fe\") " pod="openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74"
Sep 17 02:10:36.966355 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:36.966268    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74"
Sep 17 02:10:37.247668 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:37.247642    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74"]
Sep 17 02:10:37.250518 ip-10-0-143-95 kubenswrapper[2560]: W0917 02:10:37.250477    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9ebf05f_9421_41c0_987a_3e39f051b2fe.slice/crio-29cdc76a24aecfa4f00bd83cc62eeaef3cdf4771a8b0abea31dcdb8793888004 WatchSource:0}: Error finding container 29cdc76a24aecfa4f00bd83cc62eeaef3cdf4771a8b0abea31dcdb8793888004: Status 404 returned error can't find the container with id 29cdc76a24aecfa4f00bd83cc62eeaef3cdf4771a8b0abea31dcdb8793888004
Sep 17 02:10:37.252993 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:37.252953    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 02:10:37.253065 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:37.253039    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 02:10:37.253110 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:37.253077    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 02:10:37.691785 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:37.691752    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74" event={"ID":"c9ebf05f-9421-41c0-987a-3e39f051b2fe","Type":"ContainerStarted","Data":"77fb3475bf5597b172171881ed6b9b57434a20184fb3dc27cbbc093ef6879d70"}
Sep 17 02:10:37.691966 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:37.691839    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74" event={"ID":"c9ebf05f-9421-41c0-987a-3e39f051b2fe","Type":"ContainerStarted","Data":"29cdc76a24aecfa4f00bd83cc62eeaef3cdf4771a8b0abea31dcdb8793888004"}
Sep 17 02:10:37.712853 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:37.712791    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74" podStartSLOduration=1.712769476 podStartE2EDuration="1.712769476s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 02:10:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:10:37.710621146 +0000 UTC m=+1995.960598461" watchObservedRunningTime="2026-09-17 02:10:37.712769476 +0000 UTC m=+1995.962746789"
Sep 17 02:10:37.967408 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:37.967328    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74"
Sep 17 02:10:38.971870 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:38.971841    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74"
Sep 17 02:10:39.704542 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:39.704506    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74"
Sep 17 02:10:39.705563 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:39.705539    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74"
Sep 17 02:10:43.231767 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:43.231731    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-557e7f-68cd97c4d5-99chq"]
Sep 17 02:10:43.235326 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:43.235304    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-557e7f-68cd97c4d5-99chq"
Sep 17 02:10:43.237290 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:43.237236    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-557e7f-dockercfg-9kn27\""
Sep 17 02:10:43.237402 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:43.237311    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-557e7f\""
Sep 17 02:10:43.247785 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:43.247764    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-557e7f-68cd97c4d5-99chq"]
Sep 17 02:10:43.285349 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:43.285313    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc7bd765-d1f3-46ff-8685-5b495d27cae5-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-557e7f-68cd97c4d5-99chq\" (UID: \"bc7bd765-d1f3-46ff-8685-5b495d27cae5\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-557e7f-68cd97c4d5-99chq"
Sep 17 02:10:43.285512 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:43.285368    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqd59\" (UniqueName: \"kubernetes.io/projected/bc7bd765-d1f3-46ff-8685-5b495d27cae5-kube-api-access-xqd59\") pod \"payload-processing-e2e-ipp-cleanup-557e7f-68cd97c4d5-99chq\" (UID: \"bc7bd765-d1f3-46ff-8685-5b495d27cae5\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-557e7f-68cd97c4d5-99chq"
Sep 17 02:10:43.386297 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:43.386232    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc7bd765-d1f3-46ff-8685-5b495d27cae5-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-557e7f-68cd97c4d5-99chq\" (UID: \"bc7bd765-d1f3-46ff-8685-5b495d27cae5\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-557e7f-68cd97c4d5-99chq"
Sep 17 02:10:43.386494 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:43.386325    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqd59\" (UniqueName: \"kubernetes.io/projected/bc7bd765-d1f3-46ff-8685-5b495d27cae5-kube-api-access-xqd59\") pod \"payload-processing-e2e-ipp-cleanup-557e7f-68cd97c4d5-99chq\" (UID: \"bc7bd765-d1f3-46ff-8685-5b495d27cae5\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-557e7f-68cd97c4d5-99chq"
Sep 17 02:10:43.386999 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:43.386973    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc7bd765-d1f3-46ff-8685-5b495d27cae5-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-557e7f-68cd97c4d5-99chq\" (UID: \"bc7bd765-d1f3-46ff-8685-5b495d27cae5\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-557e7f-68cd97c4d5-99chq"
Sep 17 02:10:43.393470 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:43.393443    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqd59\" (UniqueName: \"kubernetes.io/projected/bc7bd765-d1f3-46ff-8685-5b495d27cae5-kube-api-access-xqd59\") pod \"payload-processing-e2e-ipp-cleanup-557e7f-68cd97c4d5-99chq\" (UID: \"bc7bd765-d1f3-46ff-8685-5b495d27cae5\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-557e7f-68cd97c4d5-99chq"
Sep 17 02:10:43.547823 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:43.547738    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-557e7f-68cd97c4d5-99chq"
Sep 17 02:10:43.816895 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:43.816858    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-557e7f-68cd97c4d5-99chq"]
Sep 17 02:10:43.819377 ip-10-0-143-95 kubenswrapper[2560]: W0917 02:10:43.819348    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc7bd765_d1f3_46ff_8685_5b495d27cae5.slice/crio-a1620e39e9cd60ea53a35dfef0a481ed097bb093052c88f208ca7ef671f604b4 WatchSource:0}: Error finding container a1620e39e9cd60ea53a35dfef0a481ed097bb093052c88f208ca7ef671f604b4: Status 404 returned error can't find the container with id a1620e39e9cd60ea53a35dfef0a481ed097bb093052c88f208ca7ef671f604b4
Sep 17 02:10:44.735828 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:44.735793    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-557e7f-68cd97c4d5-99chq" event={"ID":"bc7bd765-d1f3-46ff-8685-5b495d27cae5","Type":"ContainerStarted","Data":"c63ce7906aba03f2b0ca13084efc0142e9386d88f0c9099e0ebf34ea390f0f30"}
Sep 17 02:10:44.736232 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:44.735848    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-557e7f-68cd97c4d5-99chq" event={"ID":"bc7bd765-d1f3-46ff-8685-5b495d27cae5","Type":"ContainerStarted","Data":"a1620e39e9cd60ea53a35dfef0a481ed097bb093052c88f208ca7ef671f604b4"}
Sep 17 02:10:44.736232 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:44.736008    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-557e7f-68cd97c4d5-99chq"
Sep 17 02:10:44.751756 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:44.751704    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-557e7f-68cd97c4d5-99chq" podStartSLOduration=1.751687607 podStartE2EDuration="1.751687607s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 02:10:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:10:44.750134938 +0000 UTC m=+2003.000112254" watchObservedRunningTime="2026-09-17 02:10:44.751687607 +0000 UTC m=+2003.001664920"
Sep 17 02:10:55.742573 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:55.742543    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-557e7f-68cd97c4d5-99chq"
Sep 17 02:10:58.823988 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:58.823898    2560 generic.go:356] "Generic (PLEG): container finished" podID="c9ebf05f-9421-41c0-987a-3e39f051b2fe" containerID="77fb3475bf5597b172171881ed6b9b57434a20184fb3dc27cbbc093ef6879d70" exitCode=0
Sep 17 02:10:58.823988 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:58.823973    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74" event={"ID":"c9ebf05f-9421-41c0-987a-3e39f051b2fe","Type":"ContainerDied","Data":"77fb3475bf5597b172171881ed6b9b57434a20184fb3dc27cbbc093ef6879d70"}
Sep 17 02:10:58.824472 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:58.824459    2560 scope.go:117] "RemoveContainer" containerID="77fb3475bf5597b172171881ed6b9b57434a20184fb3dc27cbbc093ef6879d70"
Sep 17 02:10:58.825662 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:58.825630    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 02:10:58.825746 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:58.825702    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 02:10:58.825746 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:58.825732    2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 02:10:59.831586 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:59.831554    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74" event={"ID":"c9ebf05f-9421-41c0-987a-3e39f051b2fe","Type":"ContainerStarted","Data":"140fad8fcba9ce6f0b2a7be1e81262f45cdf39c04c683bb40df49d6a4e4880a7"}
Sep 17 02:10:59.966834 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:59.966789    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74"
Sep 17 02:10:59.967142 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:59.966904    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 17 02:10:59.967334 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:10:59.967298    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74" podUID="c9ebf05f-9421-41c0-987a-3e39f051b2fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 17 02:11:00.967333 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:00.967288    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 17 02:11:00.967838 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:00.967360    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74" podUID="c9ebf05f-9421-41c0-987a-3e39f051b2fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 17 02:11:01.967171 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:01.967127    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 17 02:11:01.967511 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:01.967477    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74" podUID="c9ebf05f-9421-41c0-987a-3e39f051b2fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 17 02:11:02.966677 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:02.966637    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 17 02:11:02.966893 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:02.966701    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74" podUID="c9ebf05f-9421-41c0-987a-3e39f051b2fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 17 02:11:03.966743 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:03.966702    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 17 02:11:03.967361 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:03.967324    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74" podUID="c9ebf05f-9421-41c0-987a-3e39f051b2fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 17 02:11:04.967783 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:04.967741    2560 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 17 02:11:04.968291 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:04.967849    2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74" podUID="c9ebf05f-9421-41c0-987a-3e39f051b2fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 17 02:11:05.971454 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:05.971421    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74"
Sep 17 02:11:05.971911 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:05.971721    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74"
Sep 17 02:11:05.972419 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:05.972402    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74"
Sep 17 02:11:21.957470 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:21.957433    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-557e7f-68cd97c4d5-99chq"]
Sep 17 02:11:21.958417 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:21.958356    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-557e7f-68cd97c4d5-99chq" podUID="bc7bd765-d1f3-46ff-8685-5b495d27cae5" containerName="payload-processing" containerID="cri-o://c63ce7906aba03f2b0ca13084efc0142e9386d88f0c9099e0ebf34ea390f0f30" gracePeriod=30
Sep 17 02:11:22.225223 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:22.225190    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-557e7f-68cd97c4d5-99chq"
Sep 17 02:11:22.277240 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:22.277200    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xqd59\" (UniqueName: \"kubernetes.io/projected/bc7bd765-d1f3-46ff-8685-5b495d27cae5-kube-api-access-xqd59\") pod \"bc7bd765-d1f3-46ff-8685-5b495d27cae5\" (UID: \"bc7bd765-d1f3-46ff-8685-5b495d27cae5\") "
Sep 17 02:11:22.277445 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:22.277309    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc7bd765-d1f3-46ff-8685-5b495d27cae5-plugins-config-volume\") pod \"bc7bd765-d1f3-46ff-8685-5b495d27cae5\" (UID: \"bc7bd765-d1f3-46ff-8685-5b495d27cae5\") "
Sep 17 02:11:22.277767 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:22.277732    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc7bd765-d1f3-46ff-8685-5b495d27cae5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bc7bd765-d1f3-46ff-8685-5b495d27cae5" (UID: "bc7bd765-d1f3-46ff-8685-5b495d27cae5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 02:11:22.279301 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:22.279269    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc7bd765-d1f3-46ff-8685-5b495d27cae5-kube-api-access-xqd59" (OuterVolumeSpecName: "kube-api-access-xqd59") pod "bc7bd765-d1f3-46ff-8685-5b495d27cae5" (UID: "bc7bd765-d1f3-46ff-8685-5b495d27cae5"). InnerVolumeSpecName "kube-api-access-xqd59". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 02:11:22.379013 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:22.378975    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc7bd765-d1f3-46ff-8685-5b495d27cae5-plugins-config-volume\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:11:22.379013 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:22.379009    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqd59\" (UniqueName: \"kubernetes.io/projected/bc7bd765-d1f3-46ff-8685-5b495d27cae5-kube-api-access-xqd59\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:11:22.956143 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:22.956103    2560 generic.go:356] "Generic (PLEG): container finished" podID="bc7bd765-d1f3-46ff-8685-5b495d27cae5" containerID="c63ce7906aba03f2b0ca13084efc0142e9386d88f0c9099e0ebf34ea390f0f30" exitCode=0
Sep 17 02:11:22.956349 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:22.956151    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-557e7f-68cd97c4d5-99chq"
Sep 17 02:11:22.956349 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:22.956189    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-557e7f-68cd97c4d5-99chq" event={"ID":"bc7bd765-d1f3-46ff-8685-5b495d27cae5","Type":"ContainerDied","Data":"c63ce7906aba03f2b0ca13084efc0142e9386d88f0c9099e0ebf34ea390f0f30"}
Sep 17 02:11:22.956349 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:22.956271    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-557e7f-68cd97c4d5-99chq" event={"ID":"bc7bd765-d1f3-46ff-8685-5b495d27cae5","Type":"ContainerDied","Data":"a1620e39e9cd60ea53a35dfef0a481ed097bb093052c88f208ca7ef671f604b4"}
Sep 17 02:11:22.956349 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:22.956301    2560 scope.go:117] "RemoveContainer" containerID="c63ce7906aba03f2b0ca13084efc0142e9386d88f0c9099e0ebf34ea390f0f30"
Sep 17 02:11:22.965282 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:22.965094    2560 scope.go:117] "RemoveContainer" containerID="c63ce7906aba03f2b0ca13084efc0142e9386d88f0c9099e0ebf34ea390f0f30"
Sep 17 02:11:22.965550 ip-10-0-143-95 kubenswrapper[2560]: E0917 02:11:22.965429    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c63ce7906aba03f2b0ca13084efc0142e9386d88f0c9099e0ebf34ea390f0f30\": container with ID starting with c63ce7906aba03f2b0ca13084efc0142e9386d88f0c9099e0ebf34ea390f0f30 not found: ID does not exist" containerID="c63ce7906aba03f2b0ca13084efc0142e9386d88f0c9099e0ebf34ea390f0f30"
Sep 17 02:11:22.965550 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:22.965456    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c63ce7906aba03f2b0ca13084efc0142e9386d88f0c9099e0ebf34ea390f0f30"} err="failed to get container status \"c63ce7906aba03f2b0ca13084efc0142e9386d88f0c9099e0ebf34ea390f0f30\": rpc error: code = NotFound desc = could not find container \"c63ce7906aba03f2b0ca13084efc0142e9386d88f0c9099e0ebf34ea390f0f30\": container with ID starting with c63ce7906aba03f2b0ca13084efc0142e9386d88f0c9099e0ebf34ea390f0f30 not found: ID does not exist"
Sep 17 02:11:22.970040 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:22.970019    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-557e7f-68cd97c4d5-99chq"]
Sep 17 02:11:22.973630 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:22.973611    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-557e7f-68cd97c4d5-99chq"]
Sep 17 02:11:24.357084 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:24.357050    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc7bd765-d1f3-46ff-8685-5b495d27cae5" path="/var/lib/kubelet/pods/bc7bd765-d1f3-46ff-8685-5b495d27cae5/volumes"
Sep 17 02:11:28.379358 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:28.379328    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74"]
Sep 17 02:11:28.379823 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:28.379580    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74" podUID="c9ebf05f-9421-41c0-987a-3e39f051b2fe" containerName="istio-proxy" containerID="cri-o://140fad8fcba9ce6f0b2a7be1e81262f45cdf39c04c683bb40df49d6a4e4880a7" gracePeriod=30
Sep 17 02:11:33.641929 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:33.641859    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74"
Sep 17 02:11:33.685592 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:33.685554    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9ebf05f-9421-41c0-987a-3e39f051b2fe-istio-token\") pod \"c9ebf05f-9421-41c0-987a-3e39f051b2fe\" (UID: \"c9ebf05f-9421-41c0-987a-3e39f051b2fe\") "
Sep 17 02:11:33.685788 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:33.685618    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9ebf05f-9421-41c0-987a-3e39f051b2fe-workload-certs\") pod \"c9ebf05f-9421-41c0-987a-3e39f051b2fe\" (UID: \"c9ebf05f-9421-41c0-987a-3e39f051b2fe\") "
Sep 17 02:11:33.685788 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:33.685686    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9ebf05f-9421-41c0-987a-3e39f051b2fe-credential-socket\") pod \"c9ebf05f-9421-41c0-987a-3e39f051b2fe\" (UID: \"c9ebf05f-9421-41c0-987a-3e39f051b2fe\") "
Sep 17 02:11:33.685788 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:33.685726    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8vczb\" (UniqueName: \"kubernetes.io/projected/c9ebf05f-9421-41c0-987a-3e39f051b2fe-kube-api-access-8vczb\") pod \"c9ebf05f-9421-41c0-987a-3e39f051b2fe\" (UID: \"c9ebf05f-9421-41c0-987a-3e39f051b2fe\") "
Sep 17 02:11:33.685788 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:33.685771    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9ebf05f-9421-41c0-987a-3e39f051b2fe-workload-socket\") pod \"c9ebf05f-9421-41c0-987a-3e39f051b2fe\" (UID: \"c9ebf05f-9421-41c0-987a-3e39f051b2fe\") "
Sep 17 02:11:33.686063 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:33.686028    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9ebf05f-9421-41c0-987a-3e39f051b2fe-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c9ebf05f-9421-41c0-987a-3e39f051b2fe" (UID: "c9ebf05f-9421-41c0-987a-3e39f051b2fe"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:11:33.686132 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:33.686053    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9ebf05f-9421-41c0-987a-3e39f051b2fe-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c9ebf05f-9421-41c0-987a-3e39f051b2fe" (UID: "c9ebf05f-9421-41c0-987a-3e39f051b2fe"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:11:33.686362 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:33.686333    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9ebf05f-9421-41c0-987a-3e39f051b2fe-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c9ebf05f-9421-41c0-987a-3e39f051b2fe" (UID: "c9ebf05f-9421-41c0-987a-3e39f051b2fe"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:11:33.686486 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:33.686317    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9ebf05f-9421-41c0-987a-3e39f051b2fe-istio-data" (OuterVolumeSpecName: "istio-data") pod "c9ebf05f-9421-41c0-987a-3e39f051b2fe" (UID: "c9ebf05f-9421-41c0-987a-3e39f051b2fe"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:11:33.686486 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:33.685811    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9ebf05f-9421-41c0-987a-3e39f051b2fe-istio-data\") pod \"c9ebf05f-9421-41c0-987a-3e39f051b2fe\" (UID: \"c9ebf05f-9421-41c0-987a-3e39f051b2fe\") "
Sep 17 02:11:33.686486 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:33.686454    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9ebf05f-9421-41c0-987a-3e39f051b2fe-istio-podinfo\") pod \"c9ebf05f-9421-41c0-987a-3e39f051b2fe\" (UID: \"c9ebf05f-9421-41c0-987a-3e39f051b2fe\") "
Sep 17 02:11:33.686679 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:33.686498    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9ebf05f-9421-41c0-987a-3e39f051b2fe-istiod-ca-cert\") pod \"c9ebf05f-9421-41c0-987a-3e39f051b2fe\" (UID: \"c9ebf05f-9421-41c0-987a-3e39f051b2fe\") "
Sep 17 02:11:33.686679 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:33.686540    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9ebf05f-9421-41c0-987a-3e39f051b2fe-istio-envoy\") pod \"c9ebf05f-9421-41c0-987a-3e39f051b2fe\" (UID: \"c9ebf05f-9421-41c0-987a-3e39f051b2fe\") "
Sep 17 02:11:33.686948 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:33.686927    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9ebf05f-9421-41c0-987a-3e39f051b2fe-workload-certs\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:11:33.687019 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:33.686953    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9ebf05f-9421-41c0-987a-3e39f051b2fe-credential-socket\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:11:33.687019 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:33.686968    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9ebf05f-9421-41c0-987a-3e39f051b2fe-workload-socket\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:11:33.687019 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:33.686983    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9ebf05f-9421-41c0-987a-3e39f051b2fe-istio-data\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:11:33.687603 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:33.687562    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9ebf05f-9421-41c0-987a-3e39f051b2fe-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c9ebf05f-9421-41c0-987a-3e39f051b2fe" (UID: "c9ebf05f-9421-41c0-987a-3e39f051b2fe"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 02:11:33.688213 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:33.688183    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9ebf05f-9421-41c0-987a-3e39f051b2fe-istio-token" (OuterVolumeSpecName: "istio-token") pod "c9ebf05f-9421-41c0-987a-3e39f051b2fe" (UID: "c9ebf05f-9421-41c0-987a-3e39f051b2fe"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 02:11:33.688491 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:33.688459    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9ebf05f-9421-41c0-987a-3e39f051b2fe-kube-api-access-8vczb" (OuterVolumeSpecName: "kube-api-access-8vczb") pod "c9ebf05f-9421-41c0-987a-3e39f051b2fe" (UID: "c9ebf05f-9421-41c0-987a-3e39f051b2fe"). InnerVolumeSpecName "kube-api-access-8vczb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 02:11:33.689032 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:33.689009    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9ebf05f-9421-41c0-987a-3e39f051b2fe-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c9ebf05f-9421-41c0-987a-3e39f051b2fe" (UID: "c9ebf05f-9421-41c0-987a-3e39f051b2fe"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:11:33.689523 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:33.689501    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c9ebf05f-9421-41c0-987a-3e39f051b2fe-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c9ebf05f-9421-41c0-987a-3e39f051b2fe" (UID: "c9ebf05f-9421-41c0-987a-3e39f051b2fe"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 02:11:33.787764 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:33.787730    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9ebf05f-9421-41c0-987a-3e39f051b2fe-istio-podinfo\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:11:33.787764 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:33.787759    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9ebf05f-9421-41c0-987a-3e39f051b2fe-istiod-ca-cert\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:11:33.787764 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:33.787768    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9ebf05f-9421-41c0-987a-3e39f051b2fe-istio-envoy\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:11:33.788007 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:33.787777    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9ebf05f-9421-41c0-987a-3e39f051b2fe-istio-token\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:11:33.788007 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:33.787786    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8vczb\" (UniqueName: \"kubernetes.io/projected/c9ebf05f-9421-41c0-987a-3e39f051b2fe-kube-api-access-8vczb\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:11:34.015593 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:34.015507    2560 generic.go:356] "Generic (PLEG): container finished" podID="c9ebf05f-9421-41c0-987a-3e39f051b2fe" containerID="140fad8fcba9ce6f0b2a7be1e81262f45cdf39c04c683bb40df49d6a4e4880a7" exitCode=0
Sep 17 02:11:34.015593 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:34.015544    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74" event={"ID":"c9ebf05f-9421-41c0-987a-3e39f051b2fe","Type":"ContainerDied","Data":"140fad8fcba9ce6f0b2a7be1e81262f45cdf39c04c683bb40df49d6a4e4880a7"}
Sep 17 02:11:34.015593 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:34.015560    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74"
Sep 17 02:11:34.015812 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:34.015601    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74" event={"ID":"c9ebf05f-9421-41c0-987a-3e39f051b2fe","Type":"ContainerDied","Data":"29cdc76a24aecfa4f00bd83cc62eeaef3cdf4771a8b0abea31dcdb8793888004"}
Sep 17 02:11:34.015812 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:34.015628    2560 scope.go:117] "RemoveContainer" containerID="140fad8fcba9ce6f0b2a7be1e81262f45cdf39c04c683bb40df49d6a4e4880a7"
Sep 17 02:11:34.025204 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:34.025187    2560 scope.go:117] "RemoveContainer" containerID="77fb3475bf5597b172171881ed6b9b57434a20184fb3dc27cbbc093ef6879d70"
Sep 17 02:11:34.037620 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:34.037550    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74"]
Sep 17 02:11:34.038042 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:34.038008    2560 scope.go:117] "RemoveContainer" containerID="140fad8fcba9ce6f0b2a7be1e81262f45cdf39c04c683bb40df49d6a4e4880a7"
Sep 17 02:11:34.038471 ip-10-0-143-95 kubenswrapper[2560]: E0917 02:11:34.038448    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"140fad8fcba9ce6f0b2a7be1e81262f45cdf39c04c683bb40df49d6a4e4880a7\": container with ID starting with 140fad8fcba9ce6f0b2a7be1e81262f45cdf39c04c683bb40df49d6a4e4880a7 not found: ID does not exist" containerID="140fad8fcba9ce6f0b2a7be1e81262f45cdf39c04c683bb40df49d6a4e4880a7"
Sep 17 02:11:34.038565 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:34.038486    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"140fad8fcba9ce6f0b2a7be1e81262f45cdf39c04c683bb40df49d6a4e4880a7"} err="failed to get container status \"140fad8fcba9ce6f0b2a7be1e81262f45cdf39c04c683bb40df49d6a4e4880a7\": rpc error: code = NotFound desc = could not find container \"140fad8fcba9ce6f0b2a7be1e81262f45cdf39c04c683bb40df49d6a4e4880a7\": container with ID starting with 140fad8fcba9ce6f0b2a7be1e81262f45cdf39c04c683bb40df49d6a4e4880a7 not found: ID does not exist"
Sep 17 02:11:34.038565 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:34.038506    2560 scope.go:117] "RemoveContainer" containerID="77fb3475bf5597b172171881ed6b9b57434a20184fb3dc27cbbc093ef6879d70"
Sep 17 02:11:34.038779 ip-10-0-143-95 kubenswrapper[2560]: E0917 02:11:34.038762    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77fb3475bf5597b172171881ed6b9b57434a20184fb3dc27cbbc093ef6879d70\": container with ID starting with 77fb3475bf5597b172171881ed6b9b57434a20184fb3dc27cbbc093ef6879d70 not found: ID does not exist" containerID="77fb3475bf5597b172171881ed6b9b57434a20184fb3dc27cbbc093ef6879d70"
Sep 17 02:11:34.038823 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:34.038782    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77fb3475bf5597b172171881ed6b9b57434a20184fb3dc27cbbc093ef6879d70"} err="failed to get container status \"77fb3475bf5597b172171881ed6b9b57434a20184fb3dc27cbbc093ef6879d70\": rpc error: code = NotFound desc = could not find container \"77fb3475bf5597b172171881ed6b9b57434a20184fb3dc27cbbc093ef6879d70\": container with ID starting with 77fb3475bf5597b172171881ed6b9b57434a20184fb3dc27cbbc093ef6879d70 not found: ID does not exist"
Sep 17 02:11:34.039978 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:34.039959    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-557e7f-openshift-default-87bc86454-8br74"]
Sep 17 02:11:34.358301 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:11:34.358241    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9ebf05f-9421-41c0-987a-3e39f051b2fe" path="/var/lib/kubelet/pods/c9ebf05f-9421-41c0-987a-3e39f051b2fe/volumes"
Sep 17 02:12:22.606142 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:22.606108    2560 scope.go:117] "RemoveContainer" containerID="0f5e30dced5cd09d722178a2b7044ed17fd2fd7481d823df5fb32a8d7a076531"
Sep 17 02:12:36.805394 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:36.805355    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p"]
Sep 17 02:12:36.805938 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:36.805562    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p" podUID="56d8bfd0-2497-46b9-9ed6-e489470a7322" containerName="istio-proxy" containerID="cri-o://a11688802050a8fabf907694f3d65213b2e94b6476eb410271cc258280cec9ed" gracePeriod=30
Sep 17 02:12:42.061166 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:42.061135    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p"
Sep 17 02:12:42.139580 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:42.139487    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56d8bfd0-2497-46b9-9ed6-e489470a7322-istio-token\") pod \"56d8bfd0-2497-46b9-9ed6-e489470a7322\" (UID: \"56d8bfd0-2497-46b9-9ed6-e489470a7322\") "
Sep 17 02:12:42.139580 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:42.139537    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56d8bfd0-2497-46b9-9ed6-e489470a7322-istio-data\") pod \"56d8bfd0-2497-46b9-9ed6-e489470a7322\" (UID: \"56d8bfd0-2497-46b9-9ed6-e489470a7322\") "
Sep 17 02:12:42.139580 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:42.139570    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56d8bfd0-2497-46b9-9ed6-e489470a7322-credential-socket\") pod \"56d8bfd0-2497-46b9-9ed6-e489470a7322\" (UID: \"56d8bfd0-2497-46b9-9ed6-e489470a7322\") "
Sep 17 02:12:42.139862 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:42.139611    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56d8bfd0-2497-46b9-9ed6-e489470a7322-istio-podinfo\") pod \"56d8bfd0-2497-46b9-9ed6-e489470a7322\" (UID: \"56d8bfd0-2497-46b9-9ed6-e489470a7322\") "
Sep 17 02:12:42.139862 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:42.139659    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56d8bfd0-2497-46b9-9ed6-e489470a7322-istio-envoy\") pod \"56d8bfd0-2497-46b9-9ed6-e489470a7322\" (UID: \"56d8bfd0-2497-46b9-9ed6-e489470a7322\") "
Sep 17 02:12:42.139862 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:42.139693    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56d8bfd0-2497-46b9-9ed6-e489470a7322-istiod-ca-cert\") pod \"56d8bfd0-2497-46b9-9ed6-e489470a7322\" (UID: \"56d8bfd0-2497-46b9-9ed6-e489470a7322\") "
Sep 17 02:12:42.139862 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:42.139717    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56d8bfd0-2497-46b9-9ed6-e489470a7322-workload-socket\") pod \"56d8bfd0-2497-46b9-9ed6-e489470a7322\" (UID: \"56d8bfd0-2497-46b9-9ed6-e489470a7322\") "
Sep 17 02:12:42.139862 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:42.139752    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nqhng\" (UniqueName: \"kubernetes.io/projected/56d8bfd0-2497-46b9-9ed6-e489470a7322-kube-api-access-nqhng\") pod \"56d8bfd0-2497-46b9-9ed6-e489470a7322\" (UID: \"56d8bfd0-2497-46b9-9ed6-e489470a7322\") "
Sep 17 02:12:42.139862 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:42.139816    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56d8bfd0-2497-46b9-9ed6-e489470a7322-workload-certs\") pod \"56d8bfd0-2497-46b9-9ed6-e489470a7322\" (UID: \"56d8bfd0-2497-46b9-9ed6-e489470a7322\") "
Sep 17 02:12:42.140175 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:42.139868    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56d8bfd0-2497-46b9-9ed6-e489470a7322-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "56d8bfd0-2497-46b9-9ed6-e489470a7322" (UID: "56d8bfd0-2497-46b9-9ed6-e489470a7322"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:12:42.140175 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:42.139881    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56d8bfd0-2497-46b9-9ed6-e489470a7322-istio-data" (OuterVolumeSpecName: "istio-data") pod "56d8bfd0-2497-46b9-9ed6-e489470a7322" (UID: "56d8bfd0-2497-46b9-9ed6-e489470a7322"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:12:42.140175 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:42.140128    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56d8bfd0-2497-46b9-9ed6-e489470a7322-istio-data\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:12:42.140175 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:42.140149    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56d8bfd0-2497-46b9-9ed6-e489470a7322-credential-socket\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:12:42.140175 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:42.140156    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56d8bfd0-2497-46b9-9ed6-e489470a7322-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "56d8bfd0-2497-46b9-9ed6-e489470a7322" (UID: "56d8bfd0-2497-46b9-9ed6-e489470a7322"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 02:12:42.140497 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:42.140179    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56d8bfd0-2497-46b9-9ed6-e489470a7322-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "56d8bfd0-2497-46b9-9ed6-e489470a7322" (UID: "56d8bfd0-2497-46b9-9ed6-e489470a7322"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:12:42.140497 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:42.140392    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56d8bfd0-2497-46b9-9ed6-e489470a7322-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "56d8bfd0-2497-46b9-9ed6-e489470a7322" (UID: "56d8bfd0-2497-46b9-9ed6-e489470a7322"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:12:42.141922 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:42.141893    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56d8bfd0-2497-46b9-9ed6-e489470a7322-istio-token" (OuterVolumeSpecName: "istio-token") pod "56d8bfd0-2497-46b9-9ed6-e489470a7322" (UID: "56d8bfd0-2497-46b9-9ed6-e489470a7322"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 02:12:42.142058 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:42.141945    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/56d8bfd0-2497-46b9-9ed6-e489470a7322-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "56d8bfd0-2497-46b9-9ed6-e489470a7322" (UID: "56d8bfd0-2497-46b9-9ed6-e489470a7322"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 02:12:42.142058 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:42.141962    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56d8bfd0-2497-46b9-9ed6-e489470a7322-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "56d8bfd0-2497-46b9-9ed6-e489470a7322" (UID: "56d8bfd0-2497-46b9-9ed6-e489470a7322"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:12:42.142158 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:42.142077    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56d8bfd0-2497-46b9-9ed6-e489470a7322-kube-api-access-nqhng" (OuterVolumeSpecName: "kube-api-access-nqhng") pod "56d8bfd0-2497-46b9-9ed6-e489470a7322" (UID: "56d8bfd0-2497-46b9-9ed6-e489470a7322"). InnerVolumeSpecName "kube-api-access-nqhng". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 02:12:42.241135 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:42.241096    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56d8bfd0-2497-46b9-9ed6-e489470a7322-istio-envoy\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:12:42.241135 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:42.241129    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56d8bfd0-2497-46b9-9ed6-e489470a7322-istiod-ca-cert\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:12:42.241135 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:42.241138    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56d8bfd0-2497-46b9-9ed6-e489470a7322-workload-socket\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:12:42.241135 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:42.241147    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqhng\" (UniqueName: \"kubernetes.io/projected/56d8bfd0-2497-46b9-9ed6-e489470a7322-kube-api-access-nqhng\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:12:42.241456 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:42.241155    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56d8bfd0-2497-46b9-9ed6-e489470a7322-workload-certs\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:12:42.241456 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:42.241165    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56d8bfd0-2497-46b9-9ed6-e489470a7322-istio-token\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:12:42.241456 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:42.241173    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56d8bfd0-2497-46b9-9ed6-e489470a7322-istio-podinfo\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:12:42.369295 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:42.369267    2560 generic.go:356] "Generic (PLEG): container finished" podID="56d8bfd0-2497-46b9-9ed6-e489470a7322" containerID="a11688802050a8fabf907694f3d65213b2e94b6476eb410271cc258280cec9ed" exitCode=0
Sep 17 02:12:42.369420 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:42.369318    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p" event={"ID":"56d8bfd0-2497-46b9-9ed6-e489470a7322","Type":"ContainerDied","Data":"a11688802050a8fabf907694f3d65213b2e94b6476eb410271cc258280cec9ed"}
Sep 17 02:12:42.369420 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:42.369359    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p" event={"ID":"56d8bfd0-2497-46b9-9ed6-e489470a7322","Type":"ContainerDied","Data":"8ce77cd385af29dc2a9a4de1798a7f49934039a112574e7e2cf1af36e32ff7fa"}
Sep 17 02:12:42.369420 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:42.369382    2560 scope.go:117] "RemoveContainer" containerID="a11688802050a8fabf907694f3d65213b2e94b6476eb410271cc258280cec9ed"
Sep 17 02:12:42.369567 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:42.369380    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p"
Sep 17 02:12:42.378016 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:42.377997    2560 scope.go:117] "RemoveContainer" containerID="119e81c65503ad6ce0d8ce2911bc4c9c11f743c89c997965b22053563bca16be"
Sep 17 02:12:42.383891 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:42.383869    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p"]
Sep 17 02:12:42.387080 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:42.387057    2560 scope.go:117] "RemoveContainer" containerID="a11688802050a8fabf907694f3d65213b2e94b6476eb410271cc258280cec9ed"
Sep 17 02:12:42.387399 ip-10-0-143-95 kubenswrapper[2560]: E0917 02:12:42.387374    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a11688802050a8fabf907694f3d65213b2e94b6476eb410271cc258280cec9ed\": container with ID starting with a11688802050a8fabf907694f3d65213b2e94b6476eb410271cc258280cec9ed not found: ID does not exist" containerID="a11688802050a8fabf907694f3d65213b2e94b6476eb410271cc258280cec9ed"
Sep 17 02:12:42.387491 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:42.387404    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a11688802050a8fabf907694f3d65213b2e94b6476eb410271cc258280cec9ed"} err="failed to get container status \"a11688802050a8fabf907694f3d65213b2e94b6476eb410271cc258280cec9ed\": rpc error: code = NotFound desc = could not find container \"a11688802050a8fabf907694f3d65213b2e94b6476eb410271cc258280cec9ed\": container with ID starting with a11688802050a8fabf907694f3d65213b2e94b6476eb410271cc258280cec9ed not found: ID does not exist"
Sep 17 02:12:42.387491 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:42.387422    2560 scope.go:117] "RemoveContainer" containerID="119e81c65503ad6ce0d8ce2911bc4c9c11f743c89c997965b22053563bca16be"
Sep 17 02:12:42.387718 ip-10-0-143-95 kubenswrapper[2560]: E0917 02:12:42.387699    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"119e81c65503ad6ce0d8ce2911bc4c9c11f743c89c997965b22053563bca16be\": container with ID starting with 119e81c65503ad6ce0d8ce2911bc4c9c11f743c89c997965b22053563bca16be not found: ID does not exist" containerID="119e81c65503ad6ce0d8ce2911bc4c9c11f743c89c997965b22053563bca16be"
Sep 17 02:12:42.387779 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:42.387726    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"119e81c65503ad6ce0d8ce2911bc4c9c11f743c89c997965b22053563bca16be"} err="failed to get container status \"119e81c65503ad6ce0d8ce2911bc4c9c11f743c89c997965b22053563bca16be\": rpc error: code = NotFound desc = could not find container \"119e81c65503ad6ce0d8ce2911bc4c9c11f743c89c997965b22053563bca16be\": container with ID starting with 119e81c65503ad6ce0d8ce2911bc4c9c11f743c89c997965b22053563bca16be not found: ID does not exist"
Sep 17 02:12:42.388051 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:42.388033    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-0d7c34-openshift-default-75c87dffb8-gdz2p"]
Sep 17 02:12:44.357667 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:44.357630    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56d8bfd0-2497-46b9-9ed6-e489470a7322" path="/var/lib/kubelet/pods/56d8bfd0-2497-46b9-9ed6-e489470a7322/volumes"
Sep 17 02:12:47.786098 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:47.786065    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-4ee767-cf8b9b47f-zm4vb"]
Sep 17 02:12:47.786570 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:47.786337    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-4ee767-cf8b9b47f-zm4vb" podUID="9d78caf1-6bc2-41bd-b91b-95ef85dad520" containerName="payload-processing" containerID="cri-o://04862f04d60f053db7e181440c4d45f06d83e761c59ef16246b98544e323a2ab" gracePeriod=30
Sep 17 02:12:48.057920 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:48.057893    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-4ee767-cf8b9b47f-zm4vb"
Sep 17 02:12:48.094143 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:48.094109    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d78caf1-6bc2-41bd-b91b-95ef85dad520-plugins-config-volume\") pod \"9d78caf1-6bc2-41bd-b91b-95ef85dad520\" (UID: \"9d78caf1-6bc2-41bd-b91b-95ef85dad520\") "
Sep 17 02:12:48.094381 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:48.094200    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4fvhm\" (UniqueName: \"kubernetes.io/projected/9d78caf1-6bc2-41bd-b91b-95ef85dad520-kube-api-access-4fvhm\") pod \"9d78caf1-6bc2-41bd-b91b-95ef85dad520\" (UID: \"9d78caf1-6bc2-41bd-b91b-95ef85dad520\") "
Sep 17 02:12:48.094526 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:48.094499    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d78caf1-6bc2-41bd-b91b-95ef85dad520-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9d78caf1-6bc2-41bd-b91b-95ef85dad520" (UID: "9d78caf1-6bc2-41bd-b91b-95ef85dad520"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 02:12:48.096333 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:48.096301    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d78caf1-6bc2-41bd-b91b-95ef85dad520-kube-api-access-4fvhm" (OuterVolumeSpecName: "kube-api-access-4fvhm") pod "9d78caf1-6bc2-41bd-b91b-95ef85dad520" (UID: "9d78caf1-6bc2-41bd-b91b-95ef85dad520"). InnerVolumeSpecName "kube-api-access-4fvhm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 02:12:48.195640 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:48.195599    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4fvhm\" (UniqueName: \"kubernetes.io/projected/9d78caf1-6bc2-41bd-b91b-95ef85dad520-kube-api-access-4fvhm\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:12:48.195640 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:48.195633    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d78caf1-6bc2-41bd-b91b-95ef85dad520-plugins-config-volume\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:12:48.407226 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:48.407186    2560 generic.go:356] "Generic (PLEG): container finished" podID="9d78caf1-6bc2-41bd-b91b-95ef85dad520" containerID="04862f04d60f053db7e181440c4d45f06d83e761c59ef16246b98544e323a2ab" exitCode=0
Sep 17 02:12:48.407405 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:48.407232    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-4ee767-cf8b9b47f-zm4vb" event={"ID":"9d78caf1-6bc2-41bd-b91b-95ef85dad520","Type":"ContainerDied","Data":"04862f04d60f053db7e181440c4d45f06d83e761c59ef16246b98544e323a2ab"}
Sep 17 02:12:48.407405 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:48.407323    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-4ee767-cf8b9b47f-zm4vb" event={"ID":"9d78caf1-6bc2-41bd-b91b-95ef85dad520","Type":"ContainerDied","Data":"6eadb7bf3a4ecd691bffe9ba5c31fcaf83c04e6c04ab95430a238f2a1fd60675"}
Sep 17 02:12:48.407405 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:48.407260    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-4ee767-cf8b9b47f-zm4vb"
Sep 17 02:12:48.407405 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:48.407345    2560 scope.go:117] "RemoveContainer" containerID="04862f04d60f053db7e181440c4d45f06d83e761c59ef16246b98544e323a2ab"
Sep 17 02:12:48.416114 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:48.416096    2560 scope.go:117] "RemoveContainer" containerID="04862f04d60f053db7e181440c4d45f06d83e761c59ef16246b98544e323a2ab"
Sep 17 02:12:48.416415 ip-10-0-143-95 kubenswrapper[2560]: E0917 02:12:48.416391    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04862f04d60f053db7e181440c4d45f06d83e761c59ef16246b98544e323a2ab\": container with ID starting with 04862f04d60f053db7e181440c4d45f06d83e761c59ef16246b98544e323a2ab not found: ID does not exist" containerID="04862f04d60f053db7e181440c4d45f06d83e761c59ef16246b98544e323a2ab"
Sep 17 02:12:48.416521 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:48.416421    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04862f04d60f053db7e181440c4d45f06d83e761c59ef16246b98544e323a2ab"} err="failed to get container status \"04862f04d60f053db7e181440c4d45f06d83e761c59ef16246b98544e323a2ab\": rpc error: code = NotFound desc = could not find container \"04862f04d60f053db7e181440c4d45f06d83e761c59ef16246b98544e323a2ab\": container with ID starting with 04862f04d60f053db7e181440c4d45f06d83e761c59ef16246b98544e323a2ab not found: ID does not exist"
Sep 17 02:12:48.420700 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:48.420677    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-4ee767-cf8b9b47f-zm4vb"]
Sep 17 02:12:48.426408 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:48.426388    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-4ee767-cf8b9b47f-zm4vb"]
Sep 17 02:12:50.357166 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:50.357135    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d78caf1-6bc2-41bd-b91b-95ef85dad520" path="/var/lib/kubelet/pods/9d78caf1-6bc2-41bd-b91b-95ef85dad520/volumes"
Sep 17 02:12:54.452415 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:54.452376    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz"]
Sep 17 02:12:54.452877 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:54.452672    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz" podUID="96e800aa-d877-4e07-b851-9052b71572e0" containerName="istio-proxy" containerID="cri-o://41cc1f016c0780d61948dca400cdf70264f3489eb681ad17f407f01d873a29dd" gracePeriod=30
Sep 17 02:12:59.701612 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:59.701582    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz"
Sep 17 02:12:59.809517 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:59.809489    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96e800aa-d877-4e07-b851-9052b71572e0-workload-certs\") pod \"96e800aa-d877-4e07-b851-9052b71572e0\" (UID: \"96e800aa-d877-4e07-b851-9052b71572e0\") "
Sep 17 02:12:59.809680 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:59.809529    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96e800aa-d877-4e07-b851-9052b71572e0-istio-envoy\") pod \"96e800aa-d877-4e07-b851-9052b71572e0\" (UID: \"96e800aa-d877-4e07-b851-9052b71572e0\") "
Sep 17 02:12:59.809680 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:59.809547    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96e800aa-d877-4e07-b851-9052b71572e0-credential-socket\") pod \"96e800aa-d877-4e07-b851-9052b71572e0\" (UID: \"96e800aa-d877-4e07-b851-9052b71572e0\") "
Sep 17 02:12:59.809680 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:59.809564    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96e800aa-d877-4e07-b851-9052b71572e0-istio-podinfo\") pod \"96e800aa-d877-4e07-b851-9052b71572e0\" (UID: \"96e800aa-d877-4e07-b851-9052b71572e0\") "
Sep 17 02:12:59.809680 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:59.809595    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mdwjj\" (UniqueName: \"kubernetes.io/projected/96e800aa-d877-4e07-b851-9052b71572e0-kube-api-access-mdwjj\") pod \"96e800aa-d877-4e07-b851-9052b71572e0\" (UID: \"96e800aa-d877-4e07-b851-9052b71572e0\") "
Sep 17 02:12:59.809680 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:59.809646    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96e800aa-d877-4e07-b851-9052b71572e0-workload-socket\") pod \"96e800aa-d877-4e07-b851-9052b71572e0\" (UID: \"96e800aa-d877-4e07-b851-9052b71572e0\") "
Sep 17 02:12:59.809931 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:59.809684    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96e800aa-d877-4e07-b851-9052b71572e0-istiod-ca-cert\") pod \"96e800aa-d877-4e07-b851-9052b71572e0\" (UID: \"96e800aa-d877-4e07-b851-9052b71572e0\") "
Sep 17 02:12:59.809931 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:59.809722    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96e800aa-d877-4e07-b851-9052b71572e0-istio-data\") pod \"96e800aa-d877-4e07-b851-9052b71572e0\" (UID: \"96e800aa-d877-4e07-b851-9052b71572e0\") "
Sep 17 02:12:59.809931 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:59.809746    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96e800aa-d877-4e07-b851-9052b71572e0-istio-token\") pod \"96e800aa-d877-4e07-b851-9052b71572e0\" (UID: \"96e800aa-d877-4e07-b851-9052b71572e0\") "
Sep 17 02:12:59.809931 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:59.809901    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96e800aa-d877-4e07-b851-9052b71572e0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "96e800aa-d877-4e07-b851-9052b71572e0" (UID: "96e800aa-d877-4e07-b851-9052b71572e0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:12:59.810131 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:59.810025    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96e800aa-d877-4e07-b851-9052b71572e0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "96e800aa-d877-4e07-b851-9052b71572e0" (UID: "96e800aa-d877-4e07-b851-9052b71572e0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:12:59.810183 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:59.810141    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96e800aa-d877-4e07-b851-9052b71572e0-credential-socket\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:12:59.810183 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:59.810139    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96e800aa-d877-4e07-b851-9052b71572e0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "96e800aa-d877-4e07-b851-9052b71572e0" (UID: "96e800aa-d877-4e07-b851-9052b71572e0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 02:12:59.810183 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:59.810161    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96e800aa-d877-4e07-b851-9052b71572e0-workload-socket\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:12:59.810340 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:59.810240    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96e800aa-d877-4e07-b851-9052b71572e0-istio-data" (OuterVolumeSpecName: "istio-data") pod "96e800aa-d877-4e07-b851-9052b71572e0" (UID: "96e800aa-d877-4e07-b851-9052b71572e0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:12:59.810340 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:59.810316    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96e800aa-d877-4e07-b851-9052b71572e0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "96e800aa-d877-4e07-b851-9052b71572e0" (UID: "96e800aa-d877-4e07-b851-9052b71572e0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:12:59.811811 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:59.811783    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96e800aa-d877-4e07-b851-9052b71572e0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "96e800aa-d877-4e07-b851-9052b71572e0" (UID: "96e800aa-d877-4e07-b851-9052b71572e0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:12:59.811811 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:59.811803    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/96e800aa-d877-4e07-b851-9052b71572e0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "96e800aa-d877-4e07-b851-9052b71572e0" (UID: "96e800aa-d877-4e07-b851-9052b71572e0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 02:12:59.812276 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:59.812227    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96e800aa-d877-4e07-b851-9052b71572e0-istio-token" (OuterVolumeSpecName: "istio-token") pod "96e800aa-d877-4e07-b851-9052b71572e0" (UID: "96e800aa-d877-4e07-b851-9052b71572e0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 02:12:59.812368 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:59.812266    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96e800aa-d877-4e07-b851-9052b71572e0-kube-api-access-mdwjj" (OuterVolumeSpecName: "kube-api-access-mdwjj") pod "96e800aa-d877-4e07-b851-9052b71572e0" (UID: "96e800aa-d877-4e07-b851-9052b71572e0"). InnerVolumeSpecName "kube-api-access-mdwjj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 02:12:59.910689 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:59.910654    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96e800aa-d877-4e07-b851-9052b71572e0-workload-certs\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:12:59.910689 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:59.910683    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96e800aa-d877-4e07-b851-9052b71572e0-istio-envoy\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:12:59.910689 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:59.910691    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96e800aa-d877-4e07-b851-9052b71572e0-istio-podinfo\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:12:59.910689 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:59.910699    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mdwjj\" (UniqueName: \"kubernetes.io/projected/96e800aa-d877-4e07-b851-9052b71572e0-kube-api-access-mdwjj\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:12:59.910957 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:59.910709    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96e800aa-d877-4e07-b851-9052b71572e0-istiod-ca-cert\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:12:59.910957 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:59.910717    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96e800aa-d877-4e07-b851-9052b71572e0-istio-data\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:12:59.910957 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:12:59.910725    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96e800aa-d877-4e07-b851-9052b71572e0-istio-token\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:13:00.476932 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:00.476878    2560 generic.go:356] "Generic (PLEG): container finished" podID="96e800aa-d877-4e07-b851-9052b71572e0" containerID="41cc1f016c0780d61948dca400cdf70264f3489eb681ad17f407f01d873a29dd" exitCode=0
Sep 17 02:13:00.477080 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:00.476964    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz"
Sep 17 02:13:00.477080 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:00.476963    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz" event={"ID":"96e800aa-d877-4e07-b851-9052b71572e0","Type":"ContainerDied","Data":"41cc1f016c0780d61948dca400cdf70264f3489eb681ad17f407f01d873a29dd"}
Sep 17 02:13:00.477080 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:00.477045    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz" event={"ID":"96e800aa-d877-4e07-b851-9052b71572e0","Type":"ContainerDied","Data":"e1ff2632c80c74ec3ecb2a5bb3a03e5722c79318d6235d862d6858153fe20c65"}
Sep 17 02:13:00.477080 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:00.477067    2560 scope.go:117] "RemoveContainer" containerID="41cc1f016c0780d61948dca400cdf70264f3489eb681ad17f407f01d873a29dd"
Sep 17 02:13:00.485595 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:00.485578    2560 scope.go:117] "RemoveContainer" containerID="9933d6d678d8cb37e5678cb01f2eb8e7289ffb5200d9968cd99670624636f87b"
Sep 17 02:13:00.493460 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:00.493437    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz"]
Sep 17 02:13:00.493832 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:00.493813    2560 scope.go:117] "RemoveContainer" containerID="41cc1f016c0780d61948dca400cdf70264f3489eb681ad17f407f01d873a29dd"
Sep 17 02:13:00.494139 ip-10-0-143-95 kubenswrapper[2560]: E0917 02:13:00.494118    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41cc1f016c0780d61948dca400cdf70264f3489eb681ad17f407f01d873a29dd\": container with ID starting with 41cc1f016c0780d61948dca400cdf70264f3489eb681ad17f407f01d873a29dd not found: ID does not exist" containerID="41cc1f016c0780d61948dca400cdf70264f3489eb681ad17f407f01d873a29dd"
Sep 17 02:13:00.494220 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:00.494152    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41cc1f016c0780d61948dca400cdf70264f3489eb681ad17f407f01d873a29dd"} err="failed to get container status \"41cc1f016c0780d61948dca400cdf70264f3489eb681ad17f407f01d873a29dd\": rpc error: code = NotFound desc = could not find container \"41cc1f016c0780d61948dca400cdf70264f3489eb681ad17f407f01d873a29dd\": container with ID starting with 41cc1f016c0780d61948dca400cdf70264f3489eb681ad17f407f01d873a29dd not found: ID does not exist"
Sep 17 02:13:00.494220 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:00.494176    2560 scope.go:117] "RemoveContainer" containerID="9933d6d678d8cb37e5678cb01f2eb8e7289ffb5200d9968cd99670624636f87b"
Sep 17 02:13:00.494535 ip-10-0-143-95 kubenswrapper[2560]: E0917 02:13:00.494501    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9933d6d678d8cb37e5678cb01f2eb8e7289ffb5200d9968cd99670624636f87b\": container with ID starting with 9933d6d678d8cb37e5678cb01f2eb8e7289ffb5200d9968cd99670624636f87b not found: ID does not exist" containerID="9933d6d678d8cb37e5678cb01f2eb8e7289ffb5200d9968cd99670624636f87b"
Sep 17 02:13:00.494636 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:00.494546    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9933d6d678d8cb37e5678cb01f2eb8e7289ffb5200d9968cd99670624636f87b"} err="failed to get container status \"9933d6d678d8cb37e5678cb01f2eb8e7289ffb5200d9968cd99670624636f87b\": rpc error: code = NotFound desc = could not find container \"9933d6d678d8cb37e5678cb01f2eb8e7289ffb5200d9968cd99670624636f87b\": container with ID starting with 9933d6d678d8cb37e5678cb01f2eb8e7289ffb5200d9968cd99670624636f87b not found: ID does not exist"
Sep 17 02:13:00.496621 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:00.496601    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-4ee767-openshift-default-589cb9659b-z5dvz"]
Sep 17 02:13:02.356993 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:02.356959    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96e800aa-d877-4e07-b851-9052b71572e0" path="/var/lib/kubelet/pods/96e800aa-d877-4e07-b851-9052b71572e0/volumes"
Sep 17 02:13:05.355599 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:05.355565    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-67a23a-5747bc7574-tbrz2"]
Sep 17 02:13:05.356058 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:05.355809    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-67a23a-5747bc7574-tbrz2" podUID="07cecd25-a940-4ad3-aad0-dc7d3cef3e85" containerName="payload-pre-processing" containerID="cri-o://2efda3a3752da46e3f3d3cc57292da239606fffc6fc81749778b653efb864931" gracePeriod=30
Sep 17 02:13:05.504259 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:05.504212    2560 generic.go:356] "Generic (PLEG): container finished" podID="07cecd25-a940-4ad3-aad0-dc7d3cef3e85" containerID="2efda3a3752da46e3f3d3cc57292da239606fffc6fc81749778b653efb864931" exitCode=0
Sep 17 02:13:05.504437 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:05.504293    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-67a23a-5747bc7574-tbrz2" event={"ID":"07cecd25-a940-4ad3-aad0-dc7d3cef3e85","Type":"ContainerDied","Data":"2efda3a3752da46e3f3d3cc57292da239606fffc6fc81749778b653efb864931"}
Sep 17 02:13:05.621797 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:05.621765    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-67a23a-5747bc7574-tbrz2"
Sep 17 02:13:05.763618 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:05.763581    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p272v\" (UniqueName: \"kubernetes.io/projected/07cecd25-a940-4ad3-aad0-dc7d3cef3e85-kube-api-access-p272v\") pod \"07cecd25-a940-4ad3-aad0-dc7d3cef3e85\" (UID: \"07cecd25-a940-4ad3-aad0-dc7d3cef3e85\") "
Sep 17 02:13:05.763618 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:05.763621    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/07cecd25-a940-4ad3-aad0-dc7d3cef3e85-plugins-config-volume\") pod \"07cecd25-a940-4ad3-aad0-dc7d3cef3e85\" (UID: \"07cecd25-a940-4ad3-aad0-dc7d3cef3e85\") "
Sep 17 02:13:05.764107 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:05.764067    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07cecd25-a940-4ad3-aad0-dc7d3cef3e85-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "07cecd25-a940-4ad3-aad0-dc7d3cef3e85" (UID: "07cecd25-a940-4ad3-aad0-dc7d3cef3e85"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 02:13:05.765906 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:05.765876    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07cecd25-a940-4ad3-aad0-dc7d3cef3e85-kube-api-access-p272v" (OuterVolumeSpecName: "kube-api-access-p272v") pod "07cecd25-a940-4ad3-aad0-dc7d3cef3e85" (UID: "07cecd25-a940-4ad3-aad0-dc7d3cef3e85"). InnerVolumeSpecName "kube-api-access-p272v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 02:13:05.865262 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:05.865157    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p272v\" (UniqueName: \"kubernetes.io/projected/07cecd25-a940-4ad3-aad0-dc7d3cef3e85-kube-api-access-p272v\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:13:05.865262 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:05.865189    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/07cecd25-a940-4ad3-aad0-dc7d3cef3e85-plugins-config-volume\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:13:06.510635 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:06.510600    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-67a23a-5747bc7574-tbrz2" event={"ID":"07cecd25-a940-4ad3-aad0-dc7d3cef3e85","Type":"ContainerDied","Data":"15916acc2641ad3a5ea213fa79c2764842ed1d5f5a6d85bd748e333d66f740be"}
Sep 17 02:13:06.511051 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:06.510663    2560 scope.go:117] "RemoveContainer" containerID="2efda3a3752da46e3f3d3cc57292da239606fffc6fc81749778b653efb864931"
Sep 17 02:13:06.511051 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:06.510614    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-67a23a-5747bc7574-tbrz2"
Sep 17 02:13:06.526326 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:06.526291    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-67a23a-5747bc7574-tbrz2"]
Sep 17 02:13:06.530275 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:06.530238    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-67a23a-5747bc7574-tbrz2"]
Sep 17 02:13:08.357736 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:08.357699    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07cecd25-a940-4ad3-aad0-dc7d3cef3e85" path="/var/lib/kubelet/pods/07cecd25-a940-4ad3-aad0-dc7d3cef3e85/volumes"
Sep 17 02:13:12.308961 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:12.308927    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr"]
Sep 17 02:13:12.309469 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:12.309128    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr" podUID="f6673a56-cae4-406a-b3d8-18f42a987f3d" containerName="istio-proxy" containerID="cri-o://fe8ab8cd8b484d037ddacac483d34cd1a4d0821cd7b268396bc3df82a2332899" gracePeriod=30
Sep 17 02:13:17.566746 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:17.566714    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr"
Sep 17 02:13:17.567720 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:17.567691    2560 generic.go:356] "Generic (PLEG): container finished" podID="f6673a56-cae4-406a-b3d8-18f42a987f3d" containerID="fe8ab8cd8b484d037ddacac483d34cd1a4d0821cd7b268396bc3df82a2332899" exitCode=0
Sep 17 02:13:17.567834 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:17.567729    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr" event={"ID":"f6673a56-cae4-406a-b3d8-18f42a987f3d","Type":"ContainerDied","Data":"fe8ab8cd8b484d037ddacac483d34cd1a4d0821cd7b268396bc3df82a2332899"}
Sep 17 02:13:17.567834 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:17.567784    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr" event={"ID":"f6673a56-cae4-406a-b3d8-18f42a987f3d","Type":"ContainerDied","Data":"e682be8dd89dd8c512c27d359cddca502a2c0099e71a736f96ee33506919cabf"}
Sep 17 02:13:17.567834 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:17.567806    2560 scope.go:117] "RemoveContainer" containerID="fe8ab8cd8b484d037ddacac483d34cd1a4d0821cd7b268396bc3df82a2332899"
Sep 17 02:13:17.576026 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:17.576007    2560 scope.go:117] "RemoveContainer" containerID="af3c42f44d5a855eaee14ac31e4a4b500b4f0acd7f9a544f1b6b99f892c3bd2a"
Sep 17 02:13:17.584126 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:17.584107    2560 scope.go:117] "RemoveContainer" containerID="fe8ab8cd8b484d037ddacac483d34cd1a4d0821cd7b268396bc3df82a2332899"
Sep 17 02:13:17.584509 ip-10-0-143-95 kubenswrapper[2560]: E0917 02:13:17.584486    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe8ab8cd8b484d037ddacac483d34cd1a4d0821cd7b268396bc3df82a2332899\": container with ID starting with fe8ab8cd8b484d037ddacac483d34cd1a4d0821cd7b268396bc3df82a2332899 not found: ID does not exist" containerID="fe8ab8cd8b484d037ddacac483d34cd1a4d0821cd7b268396bc3df82a2332899"
Sep 17 02:13:17.584629 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:17.584517    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe8ab8cd8b484d037ddacac483d34cd1a4d0821cd7b268396bc3df82a2332899"} err="failed to get container status \"fe8ab8cd8b484d037ddacac483d34cd1a4d0821cd7b268396bc3df82a2332899\": rpc error: code = NotFound desc = could not find container \"fe8ab8cd8b484d037ddacac483d34cd1a4d0821cd7b268396bc3df82a2332899\": container with ID starting with fe8ab8cd8b484d037ddacac483d34cd1a4d0821cd7b268396bc3df82a2332899 not found: ID does not exist"
Sep 17 02:13:17.584629 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:17.584541    2560 scope.go:117] "RemoveContainer" containerID="af3c42f44d5a855eaee14ac31e4a4b500b4f0acd7f9a544f1b6b99f892c3bd2a"
Sep 17 02:13:17.584903 ip-10-0-143-95 kubenswrapper[2560]: E0917 02:13:17.584848    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af3c42f44d5a855eaee14ac31e4a4b500b4f0acd7f9a544f1b6b99f892c3bd2a\": container with ID starting with af3c42f44d5a855eaee14ac31e4a4b500b4f0acd7f9a544f1b6b99f892c3bd2a not found: ID does not exist" containerID="af3c42f44d5a855eaee14ac31e4a4b500b4f0acd7f9a544f1b6b99f892c3bd2a"
Sep 17 02:13:17.585023 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:17.584899    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af3c42f44d5a855eaee14ac31e4a4b500b4f0acd7f9a544f1b6b99f892c3bd2a"} err="failed to get container status \"af3c42f44d5a855eaee14ac31e4a4b500b4f0acd7f9a544f1b6b99f892c3bd2a\": rpc error: code = NotFound desc = could not find container \"af3c42f44d5a855eaee14ac31e4a4b500b4f0acd7f9a544f1b6b99f892c3bd2a\": container with ID starting with af3c42f44d5a855eaee14ac31e4a4b500b4f0acd7f9a544f1b6b99f892c3bd2a not found: ID does not exist"
Sep 17 02:13:17.672711 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:17.672681    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6673a56-cae4-406a-b3d8-18f42a987f3d-istiod-ca-cert\") pod \"f6673a56-cae4-406a-b3d8-18f42a987f3d\" (UID: \"f6673a56-cae4-406a-b3d8-18f42a987f3d\") "
Sep 17 02:13:17.672905 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:17.672724    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6673a56-cae4-406a-b3d8-18f42a987f3d-workload-certs\") pod \"f6673a56-cae4-406a-b3d8-18f42a987f3d\" (UID: \"f6673a56-cae4-406a-b3d8-18f42a987f3d\") "
Sep 17 02:13:17.672905 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:17.672761    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6673a56-cae4-406a-b3d8-18f42a987f3d-credential-socket\") pod \"f6673a56-cae4-406a-b3d8-18f42a987f3d\" (UID: \"f6673a56-cae4-406a-b3d8-18f42a987f3d\") "
Sep 17 02:13:17.672905 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:17.672789    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6673a56-cae4-406a-b3d8-18f42a987f3d-istio-envoy\") pod \"f6673a56-cae4-406a-b3d8-18f42a987f3d\" (UID: \"f6673a56-cae4-406a-b3d8-18f42a987f3d\") "
Sep 17 02:13:17.672905 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:17.672853    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6673a56-cae4-406a-b3d8-18f42a987f3d-istio-data\") pod \"f6673a56-cae4-406a-b3d8-18f42a987f3d\" (UID: \"f6673a56-cae4-406a-b3d8-18f42a987f3d\") "
Sep 17 02:13:17.672905 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:17.672882    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6673a56-cae4-406a-b3d8-18f42a987f3d-istio-podinfo\") pod \"f6673a56-cae4-406a-b3d8-18f42a987f3d\" (UID: \"f6673a56-cae4-406a-b3d8-18f42a987f3d\") "
Sep 17 02:13:17.673168 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:17.672926    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6673a56-cae4-406a-b3d8-18f42a987f3d-workload-socket\") pod \"f6673a56-cae4-406a-b3d8-18f42a987f3d\" (UID: \"f6673a56-cae4-406a-b3d8-18f42a987f3d\") "
Sep 17 02:13:17.673168 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:17.672952    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8vmbt\" (UniqueName: \"kubernetes.io/projected/f6673a56-cae4-406a-b3d8-18f42a987f3d-kube-api-access-8vmbt\") pod \"f6673a56-cae4-406a-b3d8-18f42a987f3d\" (UID: \"f6673a56-cae4-406a-b3d8-18f42a987f3d\") "
Sep 17 02:13:17.673168 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:17.673032    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6673a56-cae4-406a-b3d8-18f42a987f3d-istio-token\") pod \"f6673a56-cae4-406a-b3d8-18f42a987f3d\" (UID: \"f6673a56-cae4-406a-b3d8-18f42a987f3d\") "
Sep 17 02:13:17.673168 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:17.673087    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6673a56-cae4-406a-b3d8-18f42a987f3d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f6673a56-cae4-406a-b3d8-18f42a987f3d" (UID: "f6673a56-cae4-406a-b3d8-18f42a987f3d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:13:17.673168 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:17.673100    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6673a56-cae4-406a-b3d8-18f42a987f3d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f6673a56-cae4-406a-b3d8-18f42a987f3d" (UID: "f6673a56-cae4-406a-b3d8-18f42a987f3d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:13:17.673477 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:17.673267    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6673a56-cae4-406a-b3d8-18f42a987f3d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f6673a56-cae4-406a-b3d8-18f42a987f3d" (UID: "f6673a56-cae4-406a-b3d8-18f42a987f3d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:13:17.673477 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:17.673314    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6673a56-cae4-406a-b3d8-18f42a987f3d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f6673a56-cae4-406a-b3d8-18f42a987f3d" (UID: "f6673a56-cae4-406a-b3d8-18f42a987f3d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 02:13:17.673477 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:17.673409    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6673a56-cae4-406a-b3d8-18f42a987f3d-istio-data" (OuterVolumeSpecName: "istio-data") pod "f6673a56-cae4-406a-b3d8-18f42a987f3d" (UID: "f6673a56-cae4-406a-b3d8-18f42a987f3d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:13:17.673477 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:17.673474    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6673a56-cae4-406a-b3d8-18f42a987f3d-istiod-ca-cert\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:13:17.673670 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:17.673491    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6673a56-cae4-406a-b3d8-18f42a987f3d-workload-certs\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:13:17.673670 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:17.673500    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6673a56-cae4-406a-b3d8-18f42a987f3d-credential-socket\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:13:17.673670 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:17.673509    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6673a56-cae4-406a-b3d8-18f42a987f3d-workload-socket\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:13:17.675385 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:17.675357    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6673a56-cae4-406a-b3d8-18f42a987f3d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f6673a56-cae4-406a-b3d8-18f42a987f3d" (UID: "f6673a56-cae4-406a-b3d8-18f42a987f3d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:13:17.675385 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:17.675367    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f6673a56-cae4-406a-b3d8-18f42a987f3d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f6673a56-cae4-406a-b3d8-18f42a987f3d" (UID: "f6673a56-cae4-406a-b3d8-18f42a987f3d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 02:13:17.675623 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:17.675598    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6673a56-cae4-406a-b3d8-18f42a987f3d-istio-token" (OuterVolumeSpecName: "istio-token") pod "f6673a56-cae4-406a-b3d8-18f42a987f3d" (UID: "f6673a56-cae4-406a-b3d8-18f42a987f3d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 02:13:17.675725 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:17.675658    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6673a56-cae4-406a-b3d8-18f42a987f3d-kube-api-access-8vmbt" (OuterVolumeSpecName: "kube-api-access-8vmbt") pod "f6673a56-cae4-406a-b3d8-18f42a987f3d" (UID: "f6673a56-cae4-406a-b3d8-18f42a987f3d"). InnerVolumeSpecName "kube-api-access-8vmbt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 02:13:17.774896 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:17.774856    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6673a56-cae4-406a-b3d8-18f42a987f3d-istio-token\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:13:17.774896 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:17.774890    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6673a56-cae4-406a-b3d8-18f42a987f3d-istio-envoy\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:13:17.774896 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:17.774901    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6673a56-cae4-406a-b3d8-18f42a987f3d-istio-data\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:13:17.775143 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:17.774909    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6673a56-cae4-406a-b3d8-18f42a987f3d-istio-podinfo\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:13:17.775143 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:17.774920    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8vmbt\" (UniqueName: \"kubernetes.io/projected/f6673a56-cae4-406a-b3d8-18f42a987f3d-kube-api-access-8vmbt\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:13:18.573897 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:18.573865    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr"
Sep 17 02:13:18.588968 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:18.588932    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr"]
Sep 17 02:13:18.591936 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:18.591908    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-67a23a-openshift-default-c7b5bd7bb-hbtpr"]
Sep 17 02:13:20.356452 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:20.356420    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6673a56-cae4-406a-b3d8-18f42a987f3d" path="/var/lib/kubelet/pods/f6673a56-cae4-406a-b3d8-18f42a987f3d/volumes"
Sep 17 02:13:23.315631 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:23.315598    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-f03337-54f5994d47-dshlh"]
Sep 17 02:13:23.316070 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:23.315831    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f03337-54f5994d47-dshlh" podUID="0db7ef60-8b80-4284-b3d9-150ae557ca03" containerName="payload-processing" containerID="cri-o://1bb356707ec8a7ba65af9e7e69d4c59153750484be6927dee62f236ca0b93f99" gracePeriod=30
Sep 17 02:13:23.565218 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:23.565183    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f03337-54f5994d47-dshlh"
Sep 17 02:13:23.600277 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:23.600091    2560 generic.go:356] "Generic (PLEG): container finished" podID="0db7ef60-8b80-4284-b3d9-150ae557ca03" containerID="1bb356707ec8a7ba65af9e7e69d4c59153750484be6927dee62f236ca0b93f99" exitCode=0
Sep 17 02:13:23.600277 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:23.600204    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f03337-54f5994d47-dshlh"
Sep 17 02:13:23.600513 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:23.600279    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f03337-54f5994d47-dshlh" event={"ID":"0db7ef60-8b80-4284-b3d9-150ae557ca03","Type":"ContainerDied","Data":"1bb356707ec8a7ba65af9e7e69d4c59153750484be6927dee62f236ca0b93f99"}
Sep 17 02:13:23.600513 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:23.600342    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f03337-54f5994d47-dshlh" event={"ID":"0db7ef60-8b80-4284-b3d9-150ae557ca03","Type":"ContainerDied","Data":"04bbc40747f585f1bae68b528a0acca1bf0586b46092343aa70342e1701b87a5"}
Sep 17 02:13:23.600513 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:23.600381    2560 scope.go:117] "RemoveContainer" containerID="1bb356707ec8a7ba65af9e7e69d4c59153750484be6927dee62f236ca0b93f99"
Sep 17 02:13:23.613656 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:23.613630    2560 scope.go:117] "RemoveContainer" containerID="1bb356707ec8a7ba65af9e7e69d4c59153750484be6927dee62f236ca0b93f99"
Sep 17 02:13:23.614022 ip-10-0-143-95 kubenswrapper[2560]: E0917 02:13:23.614004    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bb356707ec8a7ba65af9e7e69d4c59153750484be6927dee62f236ca0b93f99\": container with ID starting with 1bb356707ec8a7ba65af9e7e69d4c59153750484be6927dee62f236ca0b93f99 not found: ID does not exist" containerID="1bb356707ec8a7ba65af9e7e69d4c59153750484be6927dee62f236ca0b93f99"
Sep 17 02:13:23.614072 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:23.614029    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bb356707ec8a7ba65af9e7e69d4c59153750484be6927dee62f236ca0b93f99"} err="failed to get container status \"1bb356707ec8a7ba65af9e7e69d4c59153750484be6927dee62f236ca0b93f99\": rpc error: code = NotFound desc = could not find container \"1bb356707ec8a7ba65af9e7e69d4c59153750484be6927dee62f236ca0b93f99\": container with ID starting with 1bb356707ec8a7ba65af9e7e69d4c59153750484be6927dee62f236ca0b93f99 not found: ID does not exist"
Sep 17 02:13:23.624388 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:23.624364    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0db7ef60-8b80-4284-b3d9-150ae557ca03-plugins-config-volume\") pod \"0db7ef60-8b80-4284-b3d9-150ae557ca03\" (UID: \"0db7ef60-8b80-4284-b3d9-150ae557ca03\") "
Sep 17 02:13:23.624475 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:23.624450    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hkpjr\" (UniqueName: \"kubernetes.io/projected/0db7ef60-8b80-4284-b3d9-150ae557ca03-kube-api-access-hkpjr\") pod \"0db7ef60-8b80-4284-b3d9-150ae557ca03\" (UID: \"0db7ef60-8b80-4284-b3d9-150ae557ca03\") "
Sep 17 02:13:23.624713 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:23.624689    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0db7ef60-8b80-4284-b3d9-150ae557ca03-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0db7ef60-8b80-4284-b3d9-150ae557ca03" (UID: "0db7ef60-8b80-4284-b3d9-150ae557ca03"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 02:13:23.626437 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:23.626418    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0db7ef60-8b80-4284-b3d9-150ae557ca03-kube-api-access-hkpjr" (OuterVolumeSpecName: "kube-api-access-hkpjr") pod "0db7ef60-8b80-4284-b3d9-150ae557ca03" (UID: "0db7ef60-8b80-4284-b3d9-150ae557ca03"). InnerVolumeSpecName "kube-api-access-hkpjr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 02:13:23.724920 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:23.724877    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkpjr\" (UniqueName: \"kubernetes.io/projected/0db7ef60-8b80-4284-b3d9-150ae557ca03-kube-api-access-hkpjr\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:13:23.724920 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:23.724915    2560 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0db7ef60-8b80-4284-b3d9-150ae557ca03-plugins-config-volume\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:13:23.925655 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:23.925612    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-f03337-54f5994d47-dshlh"]
Sep 17 02:13:23.934264 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:23.932921    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-f03337-54f5994d47-dshlh"]
Sep 17 02:13:24.357648 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:24.357616    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0db7ef60-8b80-4284-b3d9-150ae557ca03" path="/var/lib/kubelet/pods/0db7ef60-8b80-4284-b3d9-150ae557ca03/volumes"
Sep 17 02:13:29.948924 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:29.948880    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq"]
Sep 17 02:13:29.949469 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:29.949156    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq" podUID="88eb986b-b765-4423-a2b2-2882024b91be" containerName="istio-proxy" containerID="cri-o://dbb3ea814ceeac42c38e006515a6ee52ee493747c42ab81b685217ffa474c291" gracePeriod=30
Sep 17 02:13:32.296321 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:32.296283    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-587ff8bd8c-78n76"]
Sep 17 02:13:32.296733 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:32.296520    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-587ff8bd8c-78n76" podUID="3c4a6d44-a033-4d76-bf7c-a27ae32cb23a" containerName="manager" containerID="cri-o://5c180546e55d41e30a014f53b59960ef65e9ace4d8d26e7f82d83e6b3c176c01" gracePeriod=30
Sep 17 02:13:32.541021 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:32.540992    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-587ff8bd8c-78n76"
Sep 17 02:13:32.606886 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:32.606846    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dxps7\" (UniqueName: \"kubernetes.io/projected/3c4a6d44-a033-4d76-bf7c-a27ae32cb23a-kube-api-access-dxps7\") pod \"3c4a6d44-a033-4d76-bf7c-a27ae32cb23a\" (UID: \"3c4a6d44-a033-4d76-bf7c-a27ae32cb23a\") "
Sep 17 02:13:32.607064 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:32.606903    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3c4a6d44-a033-4d76-bf7c-a27ae32cb23a-webhook-cert\") pod \"3c4a6d44-a033-4d76-bf7c-a27ae32cb23a\" (UID: \"3c4a6d44-a033-4d76-bf7c-a27ae32cb23a\") "
Sep 17 02:13:32.607064 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:32.606920    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c4a6d44-a033-4d76-bf7c-a27ae32cb23a-metrics-certs\") pod \"3c4a6d44-a033-4d76-bf7c-a27ae32cb23a\" (UID: \"3c4a6d44-a033-4d76-bf7c-a27ae32cb23a\") "
Sep 17 02:13:32.608906 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:32.608861    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c4a6d44-a033-4d76-bf7c-a27ae32cb23a-kube-api-access-dxps7" (OuterVolumeSpecName: "kube-api-access-dxps7") pod "3c4a6d44-a033-4d76-bf7c-a27ae32cb23a" (UID: "3c4a6d44-a033-4d76-bf7c-a27ae32cb23a"). InnerVolumeSpecName "kube-api-access-dxps7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 02:13:32.609079 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:32.609020    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c4a6d44-a033-4d76-bf7c-a27ae32cb23a-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "3c4a6d44-a033-4d76-bf7c-a27ae32cb23a" (UID: "3c4a6d44-a033-4d76-bf7c-a27ae32cb23a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 02:13:32.609132 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:32.609075    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c4a6d44-a033-4d76-bf7c-a27ae32cb23a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3c4a6d44-a033-4d76-bf7c-a27ae32cb23a" (UID: "3c4a6d44-a033-4d76-bf7c-a27ae32cb23a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 02:13:32.643671 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:32.643632    2560 generic.go:356] "Generic (PLEG): container finished" podID="3c4a6d44-a033-4d76-bf7c-a27ae32cb23a" containerID="5c180546e55d41e30a014f53b59960ef65e9ace4d8d26e7f82d83e6b3c176c01" exitCode=0
Sep 17 02:13:32.643671 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:32.643660    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-587ff8bd8c-78n76" event={"ID":"3c4a6d44-a033-4d76-bf7c-a27ae32cb23a","Type":"ContainerDied","Data":"5c180546e55d41e30a014f53b59960ef65e9ace4d8d26e7f82d83e6b3c176c01"}
Sep 17 02:13:32.643895 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:32.643675    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-587ff8bd8c-78n76"
Sep 17 02:13:32.643895 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:32.643718    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-587ff8bd8c-78n76" event={"ID":"3c4a6d44-a033-4d76-bf7c-a27ae32cb23a","Type":"ContainerDied","Data":"7139a1c8edcbc5cdff64e5b2680365aca55bc2925ca0ad0ebd5f40fd8557ba16"}
Sep 17 02:13:32.643895 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:32.643746    2560 scope.go:117] "RemoveContainer" containerID="5c180546e55d41e30a014f53b59960ef65e9ace4d8d26e7f82d83e6b3c176c01"
Sep 17 02:13:32.653580 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:32.653562    2560 scope.go:117] "RemoveContainer" containerID="5c180546e55d41e30a014f53b59960ef65e9ace4d8d26e7f82d83e6b3c176c01"
Sep 17 02:13:32.653851 ip-10-0-143-95 kubenswrapper[2560]: E0917 02:13:32.653836    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c180546e55d41e30a014f53b59960ef65e9ace4d8d26e7f82d83e6b3c176c01\": container with ID starting with 5c180546e55d41e30a014f53b59960ef65e9ace4d8d26e7f82d83e6b3c176c01 not found: ID does not exist" containerID="5c180546e55d41e30a014f53b59960ef65e9ace4d8d26e7f82d83e6b3c176c01"
Sep 17 02:13:32.653899 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:32.653860    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c180546e55d41e30a014f53b59960ef65e9ace4d8d26e7f82d83e6b3c176c01"} err="failed to get container status \"5c180546e55d41e30a014f53b59960ef65e9ace4d8d26e7f82d83e6b3c176c01\": rpc error: code = NotFound desc = could not find container \"5c180546e55d41e30a014f53b59960ef65e9ace4d8d26e7f82d83e6b3c176c01\": container with ID starting with 5c180546e55d41e30a014f53b59960ef65e9ace4d8d26e7f82d83e6b3c176c01 not found: ID does not exist"
Sep 17 02:13:32.663615 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:32.663591    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-587ff8bd8c-78n76"]
Sep 17 02:13:32.669450 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:32.669425    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-587ff8bd8c-78n76"]
Sep 17 02:13:32.708402 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:32.708363    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dxps7\" (UniqueName: \"kubernetes.io/projected/3c4a6d44-a033-4d76-bf7c-a27ae32cb23a-kube-api-access-dxps7\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:13:32.708402 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:32.708395    2560 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3c4a6d44-a033-4d76-bf7c-a27ae32cb23a-webhook-cert\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:13:32.708402 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:32.708404    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c4a6d44-a033-4d76-bf7c-a27ae32cb23a-metrics-certs\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:13:34.358116 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:34.358081    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c4a6d44-a033-4d76-bf7c-a27ae32cb23a" path="/var/lib/kubelet/pods/3c4a6d44-a033-4d76-bf7c-a27ae32cb23a/volumes"
Sep 17 02:13:35.195577 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:35.195553    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq"
Sep 17 02:13:35.229865 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:35.229780    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88eb986b-b765-4423-a2b2-2882024b91be-credential-socket\") pod \"88eb986b-b765-4423-a2b2-2882024b91be\" (UID: \"88eb986b-b765-4423-a2b2-2882024b91be\") "
Sep 17 02:13:35.229865 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:35.229822    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88eb986b-b765-4423-a2b2-2882024b91be-istio-token\") pod \"88eb986b-b765-4423-a2b2-2882024b91be\" (UID: \"88eb986b-b765-4423-a2b2-2882024b91be\") "
Sep 17 02:13:35.229865 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:35.229860    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88eb986b-b765-4423-a2b2-2882024b91be-istiod-ca-cert\") pod \"88eb986b-b765-4423-a2b2-2882024b91be\" (UID: \"88eb986b-b765-4423-a2b2-2882024b91be\") "
Sep 17 02:13:35.230142 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:35.229880    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88eb986b-b765-4423-a2b2-2882024b91be-istio-podinfo\") pod \"88eb986b-b765-4423-a2b2-2882024b91be\" (UID: \"88eb986b-b765-4423-a2b2-2882024b91be\") "
Sep 17 02:13:35.230142 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:35.229935    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88eb986b-b765-4423-a2b2-2882024b91be-istio-envoy\") pod \"88eb986b-b765-4423-a2b2-2882024b91be\" (UID: \"88eb986b-b765-4423-a2b2-2882024b91be\") "
Sep 17 02:13:35.230142 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:35.229985    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88eb986b-b765-4423-a2b2-2882024b91be-workload-socket\") pod \"88eb986b-b765-4423-a2b2-2882024b91be\" (UID: \"88eb986b-b765-4423-a2b2-2882024b91be\") "
Sep 17 02:13:35.230142 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:35.230012    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88eb986b-b765-4423-a2b2-2882024b91be-workload-certs\") pod \"88eb986b-b765-4423-a2b2-2882024b91be\" (UID: \"88eb986b-b765-4423-a2b2-2882024b91be\") "
Sep 17 02:13:35.230142 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:35.230058    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z8ks8\" (UniqueName: \"kubernetes.io/projected/88eb986b-b765-4423-a2b2-2882024b91be-kube-api-access-z8ks8\") pod \"88eb986b-b765-4423-a2b2-2882024b91be\" (UID: \"88eb986b-b765-4423-a2b2-2882024b91be\") "
Sep 17 02:13:35.230142 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:35.230093    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88eb986b-b765-4423-a2b2-2882024b91be-istio-data\") pod \"88eb986b-b765-4423-a2b2-2882024b91be\" (UID: \"88eb986b-b765-4423-a2b2-2882024b91be\") "
Sep 17 02:13:35.230142 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:35.230118    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88eb986b-b765-4423-a2b2-2882024b91be-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "88eb986b-b765-4423-a2b2-2882024b91be" (UID: "88eb986b-b765-4423-a2b2-2882024b91be"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:13:35.230560 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:35.230330    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88eb986b-b765-4423-a2b2-2882024b91be-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "88eb986b-b765-4423-a2b2-2882024b91be" (UID: "88eb986b-b765-4423-a2b2-2882024b91be"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 02:13:35.230560 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:35.230435    2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88eb986b-b765-4423-a2b2-2882024b91be-istiod-ca-cert\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:13:35.230560 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:35.230455    2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88eb986b-b765-4423-a2b2-2882024b91be-credential-socket\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:13:35.230560 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:35.230537    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88eb986b-b765-4423-a2b2-2882024b91be-istio-data" (OuterVolumeSpecName: "istio-data") pod "88eb986b-b765-4423-a2b2-2882024b91be" (UID: "88eb986b-b765-4423-a2b2-2882024b91be"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:13:35.230771 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:35.230688    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88eb986b-b765-4423-a2b2-2882024b91be-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "88eb986b-b765-4423-a2b2-2882024b91be" (UID: "88eb986b-b765-4423-a2b2-2882024b91be"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:13:35.230771 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:35.230753    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88eb986b-b765-4423-a2b2-2882024b91be-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "88eb986b-b765-4423-a2b2-2882024b91be" (UID: "88eb986b-b765-4423-a2b2-2882024b91be"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:13:35.232098 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:35.232069    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88eb986b-b765-4423-a2b2-2882024b91be-istio-token" (OuterVolumeSpecName: "istio-token") pod "88eb986b-b765-4423-a2b2-2882024b91be" (UID: "88eb986b-b765-4423-a2b2-2882024b91be"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 02:13:35.232278 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:35.232235    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88eb986b-b765-4423-a2b2-2882024b91be-kube-api-access-z8ks8" (OuterVolumeSpecName: "kube-api-access-z8ks8") pod "88eb986b-b765-4423-a2b2-2882024b91be" (UID: "88eb986b-b765-4423-a2b2-2882024b91be"). InnerVolumeSpecName "kube-api-access-z8ks8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 02:13:35.232481 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:35.232466    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/88eb986b-b765-4423-a2b2-2882024b91be-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "88eb986b-b765-4423-a2b2-2882024b91be" (UID: "88eb986b-b765-4423-a2b2-2882024b91be"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 02:13:35.232558 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:35.232538    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88eb986b-b765-4423-a2b2-2882024b91be-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "88eb986b-b765-4423-a2b2-2882024b91be" (UID: "88eb986b-b765-4423-a2b2-2882024b91be"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:13:35.331481 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:35.331448    2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88eb986b-b765-4423-a2b2-2882024b91be-istio-podinfo\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:13:35.331481 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:35.331477    2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88eb986b-b765-4423-a2b2-2882024b91be-istio-envoy\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:13:35.331481 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:35.331486    2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88eb986b-b765-4423-a2b2-2882024b91be-workload-socket\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:13:35.331711 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:35.331493    2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88eb986b-b765-4423-a2b2-2882024b91be-workload-certs\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:13:35.331711 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:35.331503    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8ks8\" (UniqueName: \"kubernetes.io/projected/88eb986b-b765-4423-a2b2-2882024b91be-kube-api-access-z8ks8\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:13:35.331711 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:35.331511    2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88eb986b-b765-4423-a2b2-2882024b91be-istio-data\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:13:35.331711 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:35.331519    2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88eb986b-b765-4423-a2b2-2882024b91be-istio-token\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:13:35.659061 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:35.659027    2560 generic.go:356] "Generic (PLEG): container finished" podID="88eb986b-b765-4423-a2b2-2882024b91be" containerID="dbb3ea814ceeac42c38e006515a6ee52ee493747c42ab81b685217ffa474c291" exitCode=0
Sep 17 02:13:35.659497 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:35.659072    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq"
Sep 17 02:13:35.659497 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:35.659103    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq" event={"ID":"88eb986b-b765-4423-a2b2-2882024b91be","Type":"ContainerDied","Data":"dbb3ea814ceeac42c38e006515a6ee52ee493747c42ab81b685217ffa474c291"}
Sep 17 02:13:35.659497 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:35.659156    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq" event={"ID":"88eb986b-b765-4423-a2b2-2882024b91be","Type":"ContainerDied","Data":"94ebbda8c2f0bd1d3c0992cc71f0ae0d4f2cde0fff92a82a227a5bae7f085c5a"}
Sep 17 02:13:35.659497 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:35.659177    2560 scope.go:117] "RemoveContainer" containerID="dbb3ea814ceeac42c38e006515a6ee52ee493747c42ab81b685217ffa474c291"
Sep 17 02:13:35.668317 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:35.668301    2560 scope.go:117] "RemoveContainer" containerID="eea635cf2edf53c4100539a5ba533b7eb83470f3b993118fe2f129b3c42af9be"
Sep 17 02:13:35.675716 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:35.675695    2560 scope.go:117] "RemoveContainer" containerID="dbb3ea814ceeac42c38e006515a6ee52ee493747c42ab81b685217ffa474c291"
Sep 17 02:13:35.675964 ip-10-0-143-95 kubenswrapper[2560]: E0917 02:13:35.675945    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbb3ea814ceeac42c38e006515a6ee52ee493747c42ab81b685217ffa474c291\": container with ID starting with dbb3ea814ceeac42c38e006515a6ee52ee493747c42ab81b685217ffa474c291 not found: ID does not exist" containerID="dbb3ea814ceeac42c38e006515a6ee52ee493747c42ab81b685217ffa474c291"
Sep 17 02:13:35.676013 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:35.675973    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbb3ea814ceeac42c38e006515a6ee52ee493747c42ab81b685217ffa474c291"} err="failed to get container status \"dbb3ea814ceeac42c38e006515a6ee52ee493747c42ab81b685217ffa474c291\": rpc error: code = NotFound desc = could not find container \"dbb3ea814ceeac42c38e006515a6ee52ee493747c42ab81b685217ffa474c291\": container with ID starting with dbb3ea814ceeac42c38e006515a6ee52ee493747c42ab81b685217ffa474c291 not found: ID does not exist"
Sep 17 02:13:35.676013 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:35.675990    2560 scope.go:117] "RemoveContainer" containerID="eea635cf2edf53c4100539a5ba533b7eb83470f3b993118fe2f129b3c42af9be"
Sep 17 02:13:35.676200 ip-10-0-143-95 kubenswrapper[2560]: E0917 02:13:35.676186    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eea635cf2edf53c4100539a5ba533b7eb83470f3b993118fe2f129b3c42af9be\": container with ID starting with eea635cf2edf53c4100539a5ba533b7eb83470f3b993118fe2f129b3c42af9be not found: ID does not exist" containerID="eea635cf2edf53c4100539a5ba533b7eb83470f3b993118fe2f129b3c42af9be"
Sep 17 02:13:35.676240 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:35.676203    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eea635cf2edf53c4100539a5ba533b7eb83470f3b993118fe2f129b3c42af9be"} err="failed to get container status \"eea635cf2edf53c4100539a5ba533b7eb83470f3b993118fe2f129b3c42af9be\": rpc error: code = NotFound desc = could not find container \"eea635cf2edf53c4100539a5ba533b7eb83470f3b993118fe2f129b3c42af9be\": container with ID starting with eea635cf2edf53c4100539a5ba533b7eb83470f3b993118fe2f129b3c42af9be not found: ID does not exist"
Sep 17 02:13:35.678617 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:35.678591    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq"]
Sep 17 02:13:35.683943 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:35.683922    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-f03337-openshift-default-5ff6b86b8d-ghpjq"]
Sep 17 02:13:36.358016 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:13:36.357971    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88eb986b-b765-4423-a2b2-2882024b91be" path="/var/lib/kubelet/pods/88eb986b-b765-4423-a2b2-2882024b91be/volumes"
Sep 17 02:14:33.551497 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.551460    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-587ff8bd8c-8hhkp"]
Sep 17 02:14:33.551972 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.551787    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07cecd25-a940-4ad3-aad0-dc7d3cef3e85" containerName="payload-pre-processing"
Sep 17 02:14:33.551972 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.551804    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="07cecd25-a940-4ad3-aad0-dc7d3cef3e85" containerName="payload-pre-processing"
Sep 17 02:14:33.551972 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.551815    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6673a56-cae4-406a-b3d8-18f42a987f3d" containerName="istio-proxy"
Sep 17 02:14:33.551972 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.551820    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6673a56-cae4-406a-b3d8-18f42a987f3d" containerName="istio-proxy"
Sep 17 02:14:33.551972 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.551829    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88eb986b-b765-4423-a2b2-2882024b91be" containerName="istio-proxy"
Sep 17 02:14:33.551972 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.551834    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="88eb986b-b765-4423-a2b2-2882024b91be" containerName="istio-proxy"
Sep 17 02:14:33.551972 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.551842    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c4a6d44-a033-4d76-bf7c-a27ae32cb23a" containerName="manager"
Sep 17 02:14:33.551972 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.551848    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c4a6d44-a033-4d76-bf7c-a27ae32cb23a" containerName="manager"
Sep 17 02:14:33.551972 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.551856    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0db7ef60-8b80-4284-b3d9-150ae557ca03" containerName="payload-processing"
Sep 17 02:14:33.551972 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.551861    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="0db7ef60-8b80-4284-b3d9-150ae557ca03" containerName="payload-processing"
Sep 17 02:14:33.551972 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.551867    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d78caf1-6bc2-41bd-b91b-95ef85dad520" containerName="payload-processing"
Sep 17 02:14:33.551972 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.551872    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d78caf1-6bc2-41bd-b91b-95ef85dad520" containerName="payload-processing"
Sep 17 02:14:33.551972 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.551882    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96e800aa-d877-4e07-b851-9052b71572e0" containerName="istio-proxy"
Sep 17 02:14:33.551972 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.551887    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="96e800aa-d877-4e07-b851-9052b71572e0" containerName="istio-proxy"
Sep 17 02:14:33.551972 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.551893    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88eb986b-b765-4423-a2b2-2882024b91be" containerName="istio-proxy"
Sep 17 02:14:33.551972 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.551898    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="88eb986b-b765-4423-a2b2-2882024b91be" containerName="istio-proxy"
Sep 17 02:14:33.551972 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.551904    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56d8bfd0-2497-46b9-9ed6-e489470a7322" containerName="istio-proxy"
Sep 17 02:14:33.551972 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.551909    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="56d8bfd0-2497-46b9-9ed6-e489470a7322" containerName="istio-proxy"
Sep 17 02:14:33.551972 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.551914    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9ebf05f-9421-41c0-987a-3e39f051b2fe" containerName="istio-proxy"
Sep 17 02:14:33.551972 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.551919    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9ebf05f-9421-41c0-987a-3e39f051b2fe" containerName="istio-proxy"
Sep 17 02:14:33.551972 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.551926    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9ebf05f-9421-41c0-987a-3e39f051b2fe" containerName="istio-proxy"
Sep 17 02:14:33.551972 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.551931    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9ebf05f-9421-41c0-987a-3e39f051b2fe" containerName="istio-proxy"
Sep 17 02:14:33.551972 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.551937    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96e800aa-d877-4e07-b851-9052b71572e0" containerName="istio-proxy"
Sep 17 02:14:33.551972 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.551941    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="96e800aa-d877-4e07-b851-9052b71572e0" containerName="istio-proxy"
Sep 17 02:14:33.551972 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.551947    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc7bd765-d1f3-46ff-8685-5b495d27cae5" containerName="payload-processing"
Sep 17 02:14:33.551972 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.551952    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc7bd765-d1f3-46ff-8685-5b495d27cae5" containerName="payload-processing"
Sep 17 02:14:33.553199 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.552418    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="0db7ef60-8b80-4284-b3d9-150ae557ca03" containerName="payload-processing"
Sep 17 02:14:33.553199 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.552443    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="96e800aa-d877-4e07-b851-9052b71572e0" containerName="istio-proxy"
Sep 17 02:14:33.553199 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.552533    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9ebf05f-9421-41c0-987a-3e39f051b2fe" containerName="istio-proxy"
Sep 17 02:14:33.553199 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.552569    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc7bd765-d1f3-46ff-8685-5b495d27cae5" containerName="payload-processing"
Sep 17 02:14:33.553199 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.552596    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="56d8bfd0-2497-46b9-9ed6-e489470a7322" containerName="istio-proxy"
Sep 17 02:14:33.553199 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.552607    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6673a56-cae4-406a-b3d8-18f42a987f3d" containerName="istio-proxy"
Sep 17 02:14:33.553199 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.552624    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="07cecd25-a940-4ad3-aad0-dc7d3cef3e85" containerName="payload-pre-processing"
Sep 17 02:14:33.553199 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.552633    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="88eb986b-b765-4423-a2b2-2882024b91be" containerName="istio-proxy"
Sep 17 02:14:33.553199 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.552643    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c4a6d44-a033-4d76-bf7c-a27ae32cb23a" containerName="manager"
Sep 17 02:14:33.553199 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.552650    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="88eb986b-b765-4423-a2b2-2882024b91be" containerName="istio-proxy"
Sep 17 02:14:33.553199 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.552670    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="56d8bfd0-2497-46b9-9ed6-e489470a7322" containerName="istio-proxy"
Sep 17 02:14:33.553199 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.552678    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d78caf1-6bc2-41bd-b91b-95ef85dad520" containerName="payload-processing"
Sep 17 02:14:33.553199 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.552688    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6673a56-cae4-406a-b3d8-18f42a987f3d" containerName="istio-proxy"
Sep 17 02:14:33.553199 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.552706    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9ebf05f-9421-41c0-987a-3e39f051b2fe" containerName="istio-proxy"
Sep 17 02:14:33.557894 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.556633    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-587ff8bd8c-8hhkp"
Sep 17 02:14:33.559407 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.559326    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-28j7d\""
Sep 17 02:14:33.559407 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.559401    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 17 02:14:33.559600 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.559436    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 17 02:14:33.559673 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.559437    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 17 02:14:33.565886 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.565861    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-587ff8bd8c-8hhkp"]
Sep 17 02:14:33.626461 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.626420    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-529v9\" (UniqueName: \"kubernetes.io/projected/61cab2bd-a27c-47d0-a19a-f027a67fac58-kube-api-access-529v9\") pod \"maas-controller-587ff8bd8c-8hhkp\" (UID: \"61cab2bd-a27c-47d0-a19a-f027a67fac58\") " pod="opendatahub/maas-controller-587ff8bd8c-8hhkp"
Sep 17 02:14:33.626461 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.626460    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/61cab2bd-a27c-47d0-a19a-f027a67fac58-webhook-cert\") pod \"maas-controller-587ff8bd8c-8hhkp\" (UID: \"61cab2bd-a27c-47d0-a19a-f027a67fac58\") " pod="opendatahub/maas-controller-587ff8bd8c-8hhkp"
Sep 17 02:14:33.626660 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.626498    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61cab2bd-a27c-47d0-a19a-f027a67fac58-metrics-certs\") pod \"maas-controller-587ff8bd8c-8hhkp\" (UID: \"61cab2bd-a27c-47d0-a19a-f027a67fac58\") " pod="opendatahub/maas-controller-587ff8bd8c-8hhkp"
Sep 17 02:14:33.727337 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.727297    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-529v9\" (UniqueName: \"kubernetes.io/projected/61cab2bd-a27c-47d0-a19a-f027a67fac58-kube-api-access-529v9\") pod \"maas-controller-587ff8bd8c-8hhkp\" (UID: \"61cab2bd-a27c-47d0-a19a-f027a67fac58\") " pod="opendatahub/maas-controller-587ff8bd8c-8hhkp"
Sep 17 02:14:33.727337 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.727337    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/61cab2bd-a27c-47d0-a19a-f027a67fac58-webhook-cert\") pod \"maas-controller-587ff8bd8c-8hhkp\" (UID: \"61cab2bd-a27c-47d0-a19a-f027a67fac58\") " pod="opendatahub/maas-controller-587ff8bd8c-8hhkp"
Sep 17 02:14:33.727581 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.727385    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61cab2bd-a27c-47d0-a19a-f027a67fac58-metrics-certs\") pod \"maas-controller-587ff8bd8c-8hhkp\" (UID: \"61cab2bd-a27c-47d0-a19a-f027a67fac58\") " pod="opendatahub/maas-controller-587ff8bd8c-8hhkp"
Sep 17 02:14:33.729958 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.729936    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61cab2bd-a27c-47d0-a19a-f027a67fac58-metrics-certs\") pod \"maas-controller-587ff8bd8c-8hhkp\" (UID: \"61cab2bd-a27c-47d0-a19a-f027a67fac58\") " pod="opendatahub/maas-controller-587ff8bd8c-8hhkp"
Sep 17 02:14:33.730041 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.729955    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/61cab2bd-a27c-47d0-a19a-f027a67fac58-webhook-cert\") pod \"maas-controller-587ff8bd8c-8hhkp\" (UID: \"61cab2bd-a27c-47d0-a19a-f027a67fac58\") " pod="opendatahub/maas-controller-587ff8bd8c-8hhkp"
Sep 17 02:14:33.733926 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.733898    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-529v9\" (UniqueName: \"kubernetes.io/projected/61cab2bd-a27c-47d0-a19a-f027a67fac58-kube-api-access-529v9\") pod \"maas-controller-587ff8bd8c-8hhkp\" (UID: \"61cab2bd-a27c-47d0-a19a-f027a67fac58\") " pod="opendatahub/maas-controller-587ff8bd8c-8hhkp"
Sep 17 02:14:33.869166 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:33.869134    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-587ff8bd8c-8hhkp"
Sep 17 02:14:34.137779 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:34.137751    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-587ff8bd8c-8hhkp"]
Sep 17 02:14:34.140185 ip-10-0-143-95 kubenswrapper[2560]: W0917 02:14:34.140156    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61cab2bd_a27c_47d0_a19a_f027a67fac58.slice/crio-8fc7e23e7dfcc8171103f2cba2938eb4463cc16bd157880ded2ee263b9abe801 WatchSource:0}: Error finding container 8fc7e23e7dfcc8171103f2cba2938eb4463cc16bd157880ded2ee263b9abe801: Status 404 returned error can't find the container with id 8fc7e23e7dfcc8171103f2cba2938eb4463cc16bd157880ded2ee263b9abe801
Sep 17 02:14:34.141453 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:34.141435    2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 02:14:34.919981 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:34.919889    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-587ff8bd8c-8hhkp" event={"ID":"61cab2bd-a27c-47d0-a19a-f027a67fac58","Type":"ContainerStarted","Data":"9281425e2b22e2465d75337e57d4962eccf8fce25da1727f8192e73325382252"}
Sep 17 02:14:34.919981 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:34.919943    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-587ff8bd8c-8hhkp" event={"ID":"61cab2bd-a27c-47d0-a19a-f027a67fac58","Type":"ContainerStarted","Data":"8fc7e23e7dfcc8171103f2cba2938eb4463cc16bd157880ded2ee263b9abe801"}
Sep 17 02:14:34.920424 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:34.920009    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-587ff8bd8c-8hhkp"
Sep 17 02:14:34.934957 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:34.934905    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-587ff8bd8c-8hhkp" podStartSLOduration=1.457575295 podStartE2EDuration="1.934888286s" totalImagesPullingTime="477.312991ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 02:14:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:14:34.933640121 +0000 UTC m=+2233.183617433" watchObservedRunningTime="2026-09-17 02:14:34.934888286 +0000 UTC m=+2233.184865599"
Sep 17 02:14:45.926849 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:45.926757    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-587ff8bd8c-8hhkp"
Sep 17 02:14:55.336748 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:55.336716    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-587ff8bd8c-8hhkp"]
Sep 17 02:14:55.337346 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:55.336913    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-587ff8bd8c-8hhkp" podUID="61cab2bd-a27c-47d0-a19a-f027a67fac58" containerName="manager" containerID="cri-o://9281425e2b22e2465d75337e57d4962eccf8fce25da1727f8192e73325382252" gracePeriod=30
Sep 17 02:14:55.584012 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:55.583986    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-587ff8bd8c-8hhkp"
Sep 17 02:14:55.719500 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:55.719421    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61cab2bd-a27c-47d0-a19a-f027a67fac58-metrics-certs\") pod \"61cab2bd-a27c-47d0-a19a-f027a67fac58\" (UID: \"61cab2bd-a27c-47d0-a19a-f027a67fac58\") "
Sep 17 02:14:55.719669 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:55.719503    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-529v9\" (UniqueName: \"kubernetes.io/projected/61cab2bd-a27c-47d0-a19a-f027a67fac58-kube-api-access-529v9\") pod \"61cab2bd-a27c-47d0-a19a-f027a67fac58\" (UID: \"61cab2bd-a27c-47d0-a19a-f027a67fac58\") "
Sep 17 02:14:55.719669 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:55.719535    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/61cab2bd-a27c-47d0-a19a-f027a67fac58-webhook-cert\") pod \"61cab2bd-a27c-47d0-a19a-f027a67fac58\" (UID: \"61cab2bd-a27c-47d0-a19a-f027a67fac58\") "
Sep 17 02:14:55.721595 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:55.721561    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61cab2bd-a27c-47d0-a19a-f027a67fac58-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "61cab2bd-a27c-47d0-a19a-f027a67fac58" (UID: "61cab2bd-a27c-47d0-a19a-f027a67fac58"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 02:14:55.721715 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:55.721602    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61cab2bd-a27c-47d0-a19a-f027a67fac58-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "61cab2bd-a27c-47d0-a19a-f027a67fac58" (UID: "61cab2bd-a27c-47d0-a19a-f027a67fac58"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 02:14:55.721715 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:55.721613    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61cab2bd-a27c-47d0-a19a-f027a67fac58-kube-api-access-529v9" (OuterVolumeSpecName: "kube-api-access-529v9") pod "61cab2bd-a27c-47d0-a19a-f027a67fac58" (UID: "61cab2bd-a27c-47d0-a19a-f027a67fac58"). InnerVolumeSpecName "kube-api-access-529v9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 02:14:55.820726 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:55.820693    2560 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/61cab2bd-a27c-47d0-a19a-f027a67fac58-webhook-cert\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:14:55.820726 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:55.820720    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61cab2bd-a27c-47d0-a19a-f027a67fac58-metrics-certs\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:14:55.820909 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:55.820734    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-529v9\" (UniqueName: \"kubernetes.io/projected/61cab2bd-a27c-47d0-a19a-f027a67fac58-kube-api-access-529v9\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:14:56.020288 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:56.020193    2560 generic.go:356] "Generic (PLEG): container finished" podID="61cab2bd-a27c-47d0-a19a-f027a67fac58" containerID="9281425e2b22e2465d75337e57d4962eccf8fce25da1727f8192e73325382252" exitCode=0
Sep 17 02:14:56.020288 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:56.020271    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-587ff8bd8c-8hhkp"
Sep 17 02:14:56.020483 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:56.020284    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-587ff8bd8c-8hhkp" event={"ID":"61cab2bd-a27c-47d0-a19a-f027a67fac58","Type":"ContainerDied","Data":"9281425e2b22e2465d75337e57d4962eccf8fce25da1727f8192e73325382252"}
Sep 17 02:14:56.020483 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:56.020341    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-587ff8bd8c-8hhkp" event={"ID":"61cab2bd-a27c-47d0-a19a-f027a67fac58","Type":"ContainerDied","Data":"8fc7e23e7dfcc8171103f2cba2938eb4463cc16bd157880ded2ee263b9abe801"}
Sep 17 02:14:56.020483 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:56.020364    2560 scope.go:117] "RemoveContainer" containerID="9281425e2b22e2465d75337e57d4962eccf8fce25da1727f8192e73325382252"
Sep 17 02:14:56.029208 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:56.029192    2560 scope.go:117] "RemoveContainer" containerID="9281425e2b22e2465d75337e57d4962eccf8fce25da1727f8192e73325382252"
Sep 17 02:14:56.029514 ip-10-0-143-95 kubenswrapper[2560]: E0917 02:14:56.029491    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9281425e2b22e2465d75337e57d4962eccf8fce25da1727f8192e73325382252\": container with ID starting with 9281425e2b22e2465d75337e57d4962eccf8fce25da1727f8192e73325382252 not found: ID does not exist" containerID="9281425e2b22e2465d75337e57d4962eccf8fce25da1727f8192e73325382252"
Sep 17 02:14:56.029570 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:56.029524    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9281425e2b22e2465d75337e57d4962eccf8fce25da1727f8192e73325382252"} err="failed to get container status \"9281425e2b22e2465d75337e57d4962eccf8fce25da1727f8192e73325382252\": rpc error: code = NotFound desc = could not find container \"9281425e2b22e2465d75337e57d4962eccf8fce25da1727f8192e73325382252\": container with ID starting with 9281425e2b22e2465d75337e57d4962eccf8fce25da1727f8192e73325382252 not found: ID does not exist"
Sep 17 02:14:56.039028 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:56.039002    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-587ff8bd8c-8hhkp"]
Sep 17 02:14:56.043127 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:56.043105    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-587ff8bd8c-8hhkp"]
Sep 17 02:14:56.356049 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:56.356019    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61cab2bd-a27c-47d0-a19a-f027a67fac58" path="/var/lib/kubelet/pods/61cab2bd-a27c-47d0-a19a-f027a67fac58/volumes"
Sep 17 02:14:56.935387 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:56.935347    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-587ff8bd8c-95dn7"]
Sep 17 02:14:56.935756 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:56.935736    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56d8bfd0-2497-46b9-9ed6-e489470a7322" containerName="istio-proxy"
Sep 17 02:14:56.935839 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:56.935758    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="56d8bfd0-2497-46b9-9ed6-e489470a7322" containerName="istio-proxy"
Sep 17 02:14:56.935839 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:56.935778    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6673a56-cae4-406a-b3d8-18f42a987f3d" containerName="istio-proxy"
Sep 17 02:14:56.935839 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:56.935786    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6673a56-cae4-406a-b3d8-18f42a987f3d" containerName="istio-proxy"
Sep 17 02:14:56.935839 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:56.935801    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61cab2bd-a27c-47d0-a19a-f027a67fac58" containerName="manager"
Sep 17 02:14:56.935839 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:56.935810    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="61cab2bd-a27c-47d0-a19a-f027a67fac58" containerName="manager"
Sep 17 02:14:56.936090 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:56.935894    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="96e800aa-d877-4e07-b851-9052b71572e0" containerName="istio-proxy"
Sep 17 02:14:56.936090 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:56.935910    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="61cab2bd-a27c-47d0-a19a-f027a67fac58" containerName="manager"
Sep 17 02:14:56.940197 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:56.940173    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-587ff8bd8c-95dn7"
Sep 17 02:14:56.942296 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:56.942232    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 17 02:14:56.942405 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:56.942232    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-28j7d\""
Sep 17 02:14:56.942405 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:56.942373    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 17 02:14:56.942493 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:56.942411    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 17 02:14:56.949073 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:56.949051    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-587ff8bd8c-95dn7"]
Sep 17 02:14:57.031055 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:57.031022    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2995a526-246b-4707-a7d2-30ab79413df8-webhook-cert\") pod \"maas-controller-587ff8bd8c-95dn7\" (UID: \"2995a526-246b-4707-a7d2-30ab79413df8\") " pod="opendatahub/maas-controller-587ff8bd8c-95dn7"
Sep 17 02:14:57.031055 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:57.031063    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2995a526-246b-4707-a7d2-30ab79413df8-metrics-certs\") pod \"maas-controller-587ff8bd8c-95dn7\" (UID: \"2995a526-246b-4707-a7d2-30ab79413df8\") " pod="opendatahub/maas-controller-587ff8bd8c-95dn7"
Sep 17 02:14:57.031306 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:57.031098    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwtbw\" (UniqueName: \"kubernetes.io/projected/2995a526-246b-4707-a7d2-30ab79413df8-kube-api-access-nwtbw\") pod \"maas-controller-587ff8bd8c-95dn7\" (UID: \"2995a526-246b-4707-a7d2-30ab79413df8\") " pod="opendatahub/maas-controller-587ff8bd8c-95dn7"
Sep 17 02:14:57.131628 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:57.131592    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2995a526-246b-4707-a7d2-30ab79413df8-metrics-certs\") pod \"maas-controller-587ff8bd8c-95dn7\" (UID: \"2995a526-246b-4707-a7d2-30ab79413df8\") " pod="opendatahub/maas-controller-587ff8bd8c-95dn7"
Sep 17 02:14:57.131794 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:57.131639    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwtbw\" (UniqueName: \"kubernetes.io/projected/2995a526-246b-4707-a7d2-30ab79413df8-kube-api-access-nwtbw\") pod \"maas-controller-587ff8bd8c-95dn7\" (UID: \"2995a526-246b-4707-a7d2-30ab79413df8\") " pod="opendatahub/maas-controller-587ff8bd8c-95dn7"
Sep 17 02:14:57.131794 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:57.131692    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2995a526-246b-4707-a7d2-30ab79413df8-webhook-cert\") pod \"maas-controller-587ff8bd8c-95dn7\" (UID: \"2995a526-246b-4707-a7d2-30ab79413df8\") " pod="opendatahub/maas-controller-587ff8bd8c-95dn7"
Sep 17 02:14:57.134138 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:57.134113    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2995a526-246b-4707-a7d2-30ab79413df8-webhook-cert\") pod \"maas-controller-587ff8bd8c-95dn7\" (UID: \"2995a526-246b-4707-a7d2-30ab79413df8\") " pod="opendatahub/maas-controller-587ff8bd8c-95dn7"
Sep 17 02:14:57.134239 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:57.134144    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2995a526-246b-4707-a7d2-30ab79413df8-metrics-certs\") pod \"maas-controller-587ff8bd8c-95dn7\" (UID: \"2995a526-246b-4707-a7d2-30ab79413df8\") " pod="opendatahub/maas-controller-587ff8bd8c-95dn7"
Sep 17 02:14:57.138602 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:57.138581    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwtbw\" (UniqueName: \"kubernetes.io/projected/2995a526-246b-4707-a7d2-30ab79413df8-kube-api-access-nwtbw\") pod \"maas-controller-587ff8bd8c-95dn7\" (UID: \"2995a526-246b-4707-a7d2-30ab79413df8\") " pod="opendatahub/maas-controller-587ff8bd8c-95dn7"
Sep 17 02:14:57.250357 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:57.250264    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-587ff8bd8c-95dn7"
Sep 17 02:14:57.519899 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:57.519867    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-587ff8bd8c-95dn7"]
Sep 17 02:14:57.522566 ip-10-0-143-95 kubenswrapper[2560]: W0917 02:14:57.522540    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2995a526_246b_4707_a7d2_30ab79413df8.slice/crio-e843a609a6f0171924d6dc6578ea615171ac8b039635d66a8c15db9091639739 WatchSource:0}: Error finding container e843a609a6f0171924d6dc6578ea615171ac8b039635d66a8c15db9091639739: Status 404 returned error can't find the container with id e843a609a6f0171924d6dc6578ea615171ac8b039635d66a8c15db9091639739
Sep 17 02:14:58.031978 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:58.031938    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-587ff8bd8c-95dn7" event={"ID":"2995a526-246b-4707-a7d2-30ab79413df8","Type":"ContainerStarted","Data":"78a98639e60e0e2a0c7648898079d7b9b8dcf19d35742f707cee5ced278d9344"}
Sep 17 02:14:58.032142 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:58.032022    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-587ff8bd8c-95dn7" event={"ID":"2995a526-246b-4707-a7d2-30ab79413df8","Type":"ContainerStarted","Data":"e843a609a6f0171924d6dc6578ea615171ac8b039635d66a8c15db9091639739"}
Sep 17 02:14:58.032142 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:58.032093    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-587ff8bd8c-95dn7"
Sep 17 02:14:58.047601 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:14:58.047550    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-587ff8bd8c-95dn7" podStartSLOduration=1.693431259 podStartE2EDuration="2.047535539s" totalImagesPullingTime="354.10428ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 02:14:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:14:58.046096027 +0000 UTC m=+2256.296073341" watchObservedRunningTime="2026-09-17 02:14:58.047535539 +0000 UTC m=+2256.297512885"
Sep 17 02:15:09.039506 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:15:09.039472    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-587ff8bd8c-95dn7"
Sep 17 02:17:59.371704 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:17:59.371627    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-65334296-kserve-647564bf9-bl55d"]
Sep 17 02:17:59.374981 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:17:59.374958    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-65334296-kserve-647564bf9-bl55d"
Sep 17 02:17:59.376667 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:17:59.376644    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-65334296-kserve-self-signed-certs\""
Sep 17 02:17:59.384369 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:17:59.384343    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-65334296-kserve-647564bf9-bl55d"]
Sep 17 02:17:59.511813 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:17:59.511774    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56-tls-certs\") pod \"e2e-same-id-b-65334296-kserve-647564bf9-bl55d\" (UID: \"cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56\") " pod="llm/e2e-same-id-b-65334296-kserve-647564bf9-bl55d"
Sep 17 02:17:59.511813 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:17:59.511813    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56-dshm\") pod \"e2e-same-id-b-65334296-kserve-647564bf9-bl55d\" (UID: \"cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56\") " pod="llm/e2e-same-id-b-65334296-kserve-647564bf9-bl55d"
Sep 17 02:17:59.512075 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:17:59.511842    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56-home\") pod \"e2e-same-id-b-65334296-kserve-647564bf9-bl55d\" (UID: \"cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56\") " pod="llm/e2e-same-id-b-65334296-kserve-647564bf9-bl55d"
Sep 17 02:17:59.512075 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:17:59.511877    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh6d6\" (UniqueName: \"kubernetes.io/projected/cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56-kube-api-access-sh6d6\") pod \"e2e-same-id-b-65334296-kserve-647564bf9-bl55d\" (UID: \"cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56\") " pod="llm/e2e-same-id-b-65334296-kserve-647564bf9-bl55d"
Sep 17 02:17:59.512075 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:17:59.511919    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56-model-cache\") pod \"e2e-same-id-b-65334296-kserve-647564bf9-bl55d\" (UID: \"cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56\") " pod="llm/e2e-same-id-b-65334296-kserve-647564bf9-bl55d"
Sep 17 02:17:59.512075 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:17:59.511990    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56-tmp-dir\") pod \"e2e-same-id-b-65334296-kserve-647564bf9-bl55d\" (UID: \"cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56\") " pod="llm/e2e-same-id-b-65334296-kserve-647564bf9-bl55d"
Sep 17 02:17:59.613067 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:17:59.613031    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56-tmp-dir\") pod \"e2e-same-id-b-65334296-kserve-647564bf9-bl55d\" (UID: \"cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56\") " pod="llm/e2e-same-id-b-65334296-kserve-647564bf9-bl55d"
Sep 17 02:17:59.613292 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:17:59.613084    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56-tls-certs\") pod \"e2e-same-id-b-65334296-kserve-647564bf9-bl55d\" (UID: \"cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56\") " pod="llm/e2e-same-id-b-65334296-kserve-647564bf9-bl55d"
Sep 17 02:17:59.613292 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:17:59.613111    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56-dshm\") pod \"e2e-same-id-b-65334296-kserve-647564bf9-bl55d\" (UID: \"cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56\") " pod="llm/e2e-same-id-b-65334296-kserve-647564bf9-bl55d"
Sep 17 02:17:59.613292 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:17:59.613138    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56-home\") pod \"e2e-same-id-b-65334296-kserve-647564bf9-bl55d\" (UID: \"cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56\") " pod="llm/e2e-same-id-b-65334296-kserve-647564bf9-bl55d"
Sep 17 02:17:59.613292 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:17:59.613165    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh6d6\" (UniqueName: \"kubernetes.io/projected/cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56-kube-api-access-sh6d6\") pod \"e2e-same-id-b-65334296-kserve-647564bf9-bl55d\" (UID: \"cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56\") " pod="llm/e2e-same-id-b-65334296-kserve-647564bf9-bl55d"
Sep 17 02:17:59.613292 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:17:59.613211    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56-model-cache\") pod \"e2e-same-id-b-65334296-kserve-647564bf9-bl55d\" (UID: \"cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56\") " pod="llm/e2e-same-id-b-65334296-kserve-647564bf9-bl55d"
Sep 17 02:17:59.613603 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:17:59.613513    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56-tmp-dir\") pod \"e2e-same-id-b-65334296-kserve-647564bf9-bl55d\" (UID: \"cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56\") " pod="llm/e2e-same-id-b-65334296-kserve-647564bf9-bl55d"
Sep 17 02:17:59.613603 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:17:59.613573    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56-home\") pod \"e2e-same-id-b-65334296-kserve-647564bf9-bl55d\" (UID: \"cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56\") " pod="llm/e2e-same-id-b-65334296-kserve-647564bf9-bl55d"
Sep 17 02:17:59.613699 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:17:59.613617    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56-model-cache\") pod \"e2e-same-id-b-65334296-kserve-647564bf9-bl55d\" (UID: \"cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56\") " pod="llm/e2e-same-id-b-65334296-kserve-647564bf9-bl55d"
Sep 17 02:17:59.615328 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:17:59.615299    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56-dshm\") pod \"e2e-same-id-b-65334296-kserve-647564bf9-bl55d\" (UID: \"cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56\") " pod="llm/e2e-same-id-b-65334296-kserve-647564bf9-bl55d"
Sep 17 02:17:59.615840 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:17:59.615816    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56-tls-certs\") pod \"e2e-same-id-b-65334296-kserve-647564bf9-bl55d\" (UID: \"cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56\") " pod="llm/e2e-same-id-b-65334296-kserve-647564bf9-bl55d"
Sep 17 02:17:59.620576 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:17:59.620548    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh6d6\" (UniqueName: \"kubernetes.io/projected/cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56-kube-api-access-sh6d6\") pod \"e2e-same-id-b-65334296-kserve-647564bf9-bl55d\" (UID: \"cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56\") " pod="llm/e2e-same-id-b-65334296-kserve-647564bf9-bl55d"
Sep 17 02:17:59.684153 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:17:59.684071    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-65334296-kserve-647564bf9-bl55d"
Sep 17 02:17:59.951839 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:17:59.951813    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-65334296-kserve-647564bf9-bl55d"]
Sep 17 02:17:59.954049 ip-10-0-143-95 kubenswrapper[2560]: W0917 02:17:59.954020    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcc0343ff_d918_4eb9_bea7_0b9d5b4f8c56.slice/crio-6e21060e69d8263b947128a20ed2e3ed35b63bef6c6ba34658421e2ede8ef9d0 WatchSource:0}: Error finding container 6e21060e69d8263b947128a20ed2e3ed35b63bef6c6ba34658421e2ede8ef9d0: Status 404 returned error can't find the container with id 6e21060e69d8263b947128a20ed2e3ed35b63bef6c6ba34658421e2ede8ef9d0
Sep 17 02:18:00.840428 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:00.840389    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-65334296-kserve-647564bf9-bl55d" event={"ID":"cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56","Type":"ContainerStarted","Data":"8f825f12553b8e049dd46cb57b0cf4b8e6ad6b6402694e82731ba3cf53d1bdb4"}
Sep 17 02:18:00.840428 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:00.840434    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-65334296-kserve-647564bf9-bl55d" event={"ID":"cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56","Type":"ContainerStarted","Data":"6e21060e69d8263b947128a20ed2e3ed35b63bef6c6ba34658421e2ede8ef9d0"}
Sep 17 02:18:00.855993 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:00.855943    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-65334296-kserve-647564bf9-bl55d" podStartSLOduration=1.8559286 podStartE2EDuration="1.8559286s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 02:17:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:18:00.854583112 +0000 UTC m=+2439.104560426" watchObservedRunningTime="2026-09-17 02:18:00.8559286 +0000 UTC m=+2439.105905934"
Sep 17 02:18:09.684817 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:09.684763    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-65334296-kserve-647564bf9-bl55d"
Sep 17 02:18:09.685294 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:09.684837    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-65334296-kserve-647564bf9-bl55d"
Sep 17 02:18:09.697494 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:09.697467    2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-65334296-kserve-647564bf9-bl55d"
Sep 17 02:18:09.892936 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:09.892906    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-65334296-kserve-647564bf9-bl55d"
Sep 17 02:18:21.890622 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:21.890585    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-65334296-kserve-647564bf9-bl55d"]
Sep 17 02:18:36.910154 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:36.910110    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-65334296-kserve-647564bf9-bl55d" podUID="cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56" containerName="main" containerID="cri-o://8f825f12553b8e049dd46cb57b0cf4b8e6ad6b6402694e82731ba3cf53d1bdb4" gracePeriod=45
Sep 17 02:18:37.156536 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:37.156508    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-65334296-kserve-647564bf9-bl55d"
Sep 17 02:18:37.226176 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:37.226097    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56-tls-certs\") pod \"cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56\" (UID: \"cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56\") "
Sep 17 02:18:37.226176 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:37.226139    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56-model-cache\") pod \"cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56\" (UID: \"cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56\") "
Sep 17 02:18:37.226437 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:37.226180    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56-home\") pod \"cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56\" (UID: \"cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56\") "
Sep 17 02:18:37.226437 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:37.226208    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sh6d6\" (UniqueName: \"kubernetes.io/projected/cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56-kube-api-access-sh6d6\") pod \"cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56\" (UID: \"cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56\") "
Sep 17 02:18:37.226437 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:37.226300    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56-tmp-dir\") pod \"cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56\" (UID: \"cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56\") "
Sep 17 02:18:37.226437 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:37.226335    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56-dshm\") pod \"cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56\" (UID: \"cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56\") "
Sep 17 02:18:37.226654 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:37.226468    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56-home" (OuterVolumeSpecName: "home") pod "cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56" (UID: "cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:18:37.226654 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:37.226479    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56-model-cache" (OuterVolumeSpecName: "model-cache") pod "cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56" (UID: "cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:18:37.226654 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:37.226587    2560 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56-home\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:18:37.226654 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:37.226605    2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56-model-cache\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:18:37.226654 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:37.226582    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56" (UID: "cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:18:37.228543 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:37.228515    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56-dshm" (OuterVolumeSpecName: "dshm") pod "cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56" (UID: "cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 02:18:37.228645 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:37.228556    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56-kube-api-access-sh6d6" (OuterVolumeSpecName: "kube-api-access-sh6d6") pod "cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56" (UID: "cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56"). InnerVolumeSpecName "kube-api-access-sh6d6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 02:18:37.228645 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:37.228609    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56" (UID: "cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 02:18:37.327892 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:37.327850    2560 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56-tmp-dir\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:18:37.327892 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:37.327886    2560 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56-dshm\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:18:37.327892 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:37.327895    2560 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56-tls-certs\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:18:37.328133 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:37.327906    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sh6d6\" (UniqueName: \"kubernetes.io/projected/cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56-kube-api-access-sh6d6\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:18:38.005856 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:38.005818    2560 generic.go:356] "Generic (PLEG): container finished" podID="cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56" containerID="8f825f12553b8e049dd46cb57b0cf4b8e6ad6b6402694e82731ba3cf53d1bdb4" exitCode=0
Sep 17 02:18:38.006375 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:38.005861    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-65334296-kserve-647564bf9-bl55d"
Sep 17 02:18:38.006375 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:38.005904    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-65334296-kserve-647564bf9-bl55d" event={"ID":"cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56","Type":"ContainerDied","Data":"8f825f12553b8e049dd46cb57b0cf4b8e6ad6b6402694e82731ba3cf53d1bdb4"}
Sep 17 02:18:38.006375 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:38.005948    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-65334296-kserve-647564bf9-bl55d" event={"ID":"cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56","Type":"ContainerDied","Data":"6e21060e69d8263b947128a20ed2e3ed35b63bef6c6ba34658421e2ede8ef9d0"}
Sep 17 02:18:38.006375 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:38.005965    2560 scope.go:117] "RemoveContainer" containerID="8f825f12553b8e049dd46cb57b0cf4b8e6ad6b6402694e82731ba3cf53d1bdb4"
Sep 17 02:18:38.014851 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:38.014834    2560 scope.go:117] "RemoveContainer" containerID="8f825f12553b8e049dd46cb57b0cf4b8e6ad6b6402694e82731ba3cf53d1bdb4"
Sep 17 02:18:38.015107 ip-10-0-143-95 kubenswrapper[2560]: E0917 02:18:38.015086    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f825f12553b8e049dd46cb57b0cf4b8e6ad6b6402694e82731ba3cf53d1bdb4\": container with ID starting with 8f825f12553b8e049dd46cb57b0cf4b8e6ad6b6402694e82731ba3cf53d1bdb4 not found: ID does not exist" containerID="8f825f12553b8e049dd46cb57b0cf4b8e6ad6b6402694e82731ba3cf53d1bdb4"
Sep 17 02:18:38.015155 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:38.015115    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f825f12553b8e049dd46cb57b0cf4b8e6ad6b6402694e82731ba3cf53d1bdb4"} err="failed to get container status \"8f825f12553b8e049dd46cb57b0cf4b8e6ad6b6402694e82731ba3cf53d1bdb4\": rpc error: code = NotFound desc = could not find container \"8f825f12553b8e049dd46cb57b0cf4b8e6ad6b6402694e82731ba3cf53d1bdb4\": container with ID starting with 8f825f12553b8e049dd46cb57b0cf4b8e6ad6b6402694e82731ba3cf53d1bdb4 not found: ID does not exist"
Sep 17 02:18:38.024273 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:38.024232    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-65334296-kserve-647564bf9-bl55d"]
Sep 17 02:18:38.029658 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:38.029635    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-65334296-kserve-647564bf9-bl55d"]
Sep 17 02:18:38.250726 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:38.250689    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-86d9ddc875-bx5ls"]
Sep 17 02:18:38.251292 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:38.251269    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56" containerName="main"
Sep 17 02:18:38.251292 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:38.251294    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56" containerName="main"
Sep 17 02:18:38.251430 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:38.251415    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56" containerName="main"
Sep 17 02:18:38.255937 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:38.255885    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-86d9ddc875-bx5ls"
Sep 17 02:18:38.264012 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:38.263949    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-86d9ddc875-bx5ls"]
Sep 17 02:18:38.337626 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:38.337592    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8964ee1c-34ba-4544-8a9c-15ce6cad693a-openshift-service-ca\") pod \"maas-api-86d9ddc875-bx5ls\" (UID: \"8964ee1c-34ba-4544-8a9c-15ce6cad693a\") " pod="odh-ai-gateway-infra/maas-api-86d9ddc875-bx5ls"
Sep 17 02:18:38.337626 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:38.337629    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8964ee1c-34ba-4544-8a9c-15ce6cad693a-metrics-certs\") pod \"maas-api-86d9ddc875-bx5ls\" (UID: \"8964ee1c-34ba-4544-8a9c-15ce6cad693a\") " pod="odh-ai-gateway-infra/maas-api-86d9ddc875-bx5ls"
Sep 17 02:18:38.337836 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:38.337771    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dl4f8\" (UniqueName: \"kubernetes.io/projected/8964ee1c-34ba-4544-8a9c-15ce6cad693a-kube-api-access-dl4f8\") pod \"maas-api-86d9ddc875-bx5ls\" (UID: \"8964ee1c-34ba-4544-8a9c-15ce6cad693a\") " pod="odh-ai-gateway-infra/maas-api-86d9ddc875-bx5ls"
Sep 17 02:18:38.337836 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:38.337801    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8964ee1c-34ba-4544-8a9c-15ce6cad693a-maas-api-tls\") pod \"maas-api-86d9ddc875-bx5ls\" (UID: \"8964ee1c-34ba-4544-8a9c-15ce6cad693a\") " pod="odh-ai-gateway-infra/maas-api-86d9ddc875-bx5ls"
Sep 17 02:18:38.356611 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:38.356584    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56" path="/var/lib/kubelet/pods/cc0343ff-d918-4eb9-bea7-0b9d5b4f8c56/volumes"
Sep 17 02:18:38.438200 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:38.438168    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dl4f8\" (UniqueName: \"kubernetes.io/projected/8964ee1c-34ba-4544-8a9c-15ce6cad693a-kube-api-access-dl4f8\") pod \"maas-api-86d9ddc875-bx5ls\" (UID: \"8964ee1c-34ba-4544-8a9c-15ce6cad693a\") " pod="odh-ai-gateway-infra/maas-api-86d9ddc875-bx5ls"
Sep 17 02:18:38.438200 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:38.438203    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8964ee1c-34ba-4544-8a9c-15ce6cad693a-maas-api-tls\") pod \"maas-api-86d9ddc875-bx5ls\" (UID: \"8964ee1c-34ba-4544-8a9c-15ce6cad693a\") " pod="odh-ai-gateway-infra/maas-api-86d9ddc875-bx5ls"
Sep 17 02:18:38.438429 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:38.438230    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8964ee1c-34ba-4544-8a9c-15ce6cad693a-openshift-service-ca\") pod \"maas-api-86d9ddc875-bx5ls\" (UID: \"8964ee1c-34ba-4544-8a9c-15ce6cad693a\") " pod="odh-ai-gateway-infra/maas-api-86d9ddc875-bx5ls"
Sep 17 02:18:38.438429 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:38.438265    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8964ee1c-34ba-4544-8a9c-15ce6cad693a-metrics-certs\") pod \"maas-api-86d9ddc875-bx5ls\" (UID: \"8964ee1c-34ba-4544-8a9c-15ce6cad693a\") " pod="odh-ai-gateway-infra/maas-api-86d9ddc875-bx5ls"
Sep 17 02:18:38.439063 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:38.439033    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8964ee1c-34ba-4544-8a9c-15ce6cad693a-openshift-service-ca\") pod \"maas-api-86d9ddc875-bx5ls\" (UID: \"8964ee1c-34ba-4544-8a9c-15ce6cad693a\") " pod="odh-ai-gateway-infra/maas-api-86d9ddc875-bx5ls"
Sep 17 02:18:38.440665 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:38.440638    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8964ee1c-34ba-4544-8a9c-15ce6cad693a-metrics-certs\") pod \"maas-api-86d9ddc875-bx5ls\" (UID: \"8964ee1c-34ba-4544-8a9c-15ce6cad693a\") " pod="odh-ai-gateway-infra/maas-api-86d9ddc875-bx5ls"
Sep 17 02:18:38.440744 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:38.440640    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8964ee1c-34ba-4544-8a9c-15ce6cad693a-maas-api-tls\") pod \"maas-api-86d9ddc875-bx5ls\" (UID: \"8964ee1c-34ba-4544-8a9c-15ce6cad693a\") " pod="odh-ai-gateway-infra/maas-api-86d9ddc875-bx5ls"
Sep 17 02:18:38.444703 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:38.444680    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dl4f8\" (UniqueName: \"kubernetes.io/projected/8964ee1c-34ba-4544-8a9c-15ce6cad693a-kube-api-access-dl4f8\") pod \"maas-api-86d9ddc875-bx5ls\" (UID: \"8964ee1c-34ba-4544-8a9c-15ce6cad693a\") " pod="odh-ai-gateway-infra/maas-api-86d9ddc875-bx5ls"
Sep 17 02:18:38.570423 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:38.570397    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-86d9ddc875-bx5ls"
Sep 17 02:18:38.843458 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:38.843430    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-86d9ddc875-bx5ls"]
Sep 17 02:18:38.846278 ip-10-0-143-95 kubenswrapper[2560]: W0917 02:18:38.846234    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8964ee1c_34ba_4544_8a9c_15ce6cad693a.slice/crio-c238f59c4d438dc29fce2c4aceb8efe03b99f8358330bda4eec44cc7089c1389 WatchSource:0}: Error finding container c238f59c4d438dc29fce2c4aceb8efe03b99f8358330bda4eec44cc7089c1389: Status 404 returned error can't find the container with id c238f59c4d438dc29fce2c4aceb8efe03b99f8358330bda4eec44cc7089c1389
Sep 17 02:18:39.019359 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:39.019320    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-86d9ddc875-bx5ls" event={"ID":"8964ee1c-34ba-4544-8a9c-15ce6cad693a","Type":"ContainerStarted","Data":"c238f59c4d438dc29fce2c4aceb8efe03b99f8358330bda4eec44cc7089c1389"}
Sep 17 02:18:40.025716 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:40.025676    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-86d9ddc875-bx5ls" event={"ID":"8964ee1c-34ba-4544-8a9c-15ce6cad693a","Type":"ContainerStarted","Data":"d6d87184568548cafcb6dc58f67106387d6e210621e310f3c6cb2a4e3b453cbc"}
Sep 17 02:18:40.026115 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:40.025788    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-86d9ddc875-bx5ls"
Sep 17 02:18:40.040905 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:40.040843    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-86d9ddc875-bx5ls" podStartSLOduration=1.7090162439999999 podStartE2EDuration="2.040824294s" totalImagesPullingTime="331.80805ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 02:18:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:18:40.039932733 +0000 UTC m=+2478.289910046" watchObservedRunningTime="2026-09-17 02:18:40.040824294 +0000 UTC m=+2478.290801608"
Sep 17 02:18:46.034551 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:46.034518    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-86d9ddc875-bx5ls"
Sep 17 02:18:46.076466 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:46.076435    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-59f6566bbc-ps7ln"]
Sep 17 02:18:46.076659 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:46.076634    2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-ps7ln" podUID="3642e8e6-7b7d-43f3-ae87-486ebab18de0" containerName="maas-api" containerID="cri-o://31bcb92e632fe915873fcc1f19f7238b952c3d01e7efdb76b5cbe605d6f883fb" gracePeriod=30
Sep 17 02:18:47.314274 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:47.314236    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-ps7ln"
Sep 17 02:18:47.413104 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:47.413014    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3642e8e6-7b7d-43f3-ae87-486ebab18de0-metrics-certs\") pod \"3642e8e6-7b7d-43f3-ae87-486ebab18de0\" (UID: \"3642e8e6-7b7d-43f3-ae87-486ebab18de0\") "
Sep 17 02:18:47.413104 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:47.413052    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3642e8e6-7b7d-43f3-ae87-486ebab18de0-openshift-service-ca\") pod \"3642e8e6-7b7d-43f3-ae87-486ebab18de0\" (UID: \"3642e8e6-7b7d-43f3-ae87-486ebab18de0\") "
Sep 17 02:18:47.413104 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:47.413080    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3642e8e6-7b7d-43f3-ae87-486ebab18de0-maas-api-tls\") pod \"3642e8e6-7b7d-43f3-ae87-486ebab18de0\" (UID: \"3642e8e6-7b7d-43f3-ae87-486ebab18de0\") "
Sep 17 02:18:47.413368 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:47.413153    2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8cxrd\" (UniqueName: \"kubernetes.io/projected/3642e8e6-7b7d-43f3-ae87-486ebab18de0-kube-api-access-8cxrd\") pod \"3642e8e6-7b7d-43f3-ae87-486ebab18de0\" (UID: \"3642e8e6-7b7d-43f3-ae87-486ebab18de0\") "
Sep 17 02:18:47.413470 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:47.413430    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3642e8e6-7b7d-43f3-ae87-486ebab18de0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3642e8e6-7b7d-43f3-ae87-486ebab18de0" (UID: "3642e8e6-7b7d-43f3-ae87-486ebab18de0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 02:18:47.415204 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:47.415176    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3642e8e6-7b7d-43f3-ae87-486ebab18de0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3642e8e6-7b7d-43f3-ae87-486ebab18de0" (UID: "3642e8e6-7b7d-43f3-ae87-486ebab18de0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 02:18:47.415340 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:47.415265    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3642e8e6-7b7d-43f3-ae87-486ebab18de0-kube-api-access-8cxrd" (OuterVolumeSpecName: "kube-api-access-8cxrd") pod "3642e8e6-7b7d-43f3-ae87-486ebab18de0" (UID: "3642e8e6-7b7d-43f3-ae87-486ebab18de0"). InnerVolumeSpecName "kube-api-access-8cxrd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 02:18:47.415407 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:47.415352    2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3642e8e6-7b7d-43f3-ae87-486ebab18de0-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3642e8e6-7b7d-43f3-ae87-486ebab18de0" (UID: "3642e8e6-7b7d-43f3-ae87-486ebab18de0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 02:18:47.513698 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:47.513656    2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8cxrd\" (UniqueName: \"kubernetes.io/projected/3642e8e6-7b7d-43f3-ae87-486ebab18de0-kube-api-access-8cxrd\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:18:47.513698 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:47.513691    2560 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3642e8e6-7b7d-43f3-ae87-486ebab18de0-metrics-certs\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:18:47.513698 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:47.513702    2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3642e8e6-7b7d-43f3-ae87-486ebab18de0-openshift-service-ca\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:18:47.513926 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:47.513711    2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3642e8e6-7b7d-43f3-ae87-486ebab18de0-maas-api-tls\") on node \"ip-10-0-143-95.ec2.internal\" DevicePath \"\""
Sep 17 02:18:48.064087 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:48.064046    2560 generic.go:356] "Generic (PLEG): container finished" podID="3642e8e6-7b7d-43f3-ae87-486ebab18de0" containerID="31bcb92e632fe915873fcc1f19f7238b952c3d01e7efdb76b5cbe605d6f883fb" exitCode=0
Sep 17 02:18:48.064087 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:48.064093    2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-ps7ln"
Sep 17 02:18:48.064327 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:48.064135    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-ps7ln" event={"ID":"3642e8e6-7b7d-43f3-ae87-486ebab18de0","Type":"ContainerDied","Data":"31bcb92e632fe915873fcc1f19f7238b952c3d01e7efdb76b5cbe605d6f883fb"}
Sep 17 02:18:48.064327 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:48.064195    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-ps7ln" event={"ID":"3642e8e6-7b7d-43f3-ae87-486ebab18de0","Type":"ContainerDied","Data":"0d9329e14814a8d3067aa26be5144537756e95174c9a6844728b3b6c1ff261df"}
Sep 17 02:18:48.064327 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:48.064218    2560 scope.go:117] "RemoveContainer" containerID="31bcb92e632fe915873fcc1f19f7238b952c3d01e7efdb76b5cbe605d6f883fb"
Sep 17 02:18:48.073590 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:48.073574    2560 scope.go:117] "RemoveContainer" containerID="31bcb92e632fe915873fcc1f19f7238b952c3d01e7efdb76b5cbe605d6f883fb"
Sep 17 02:18:48.073848 ip-10-0-143-95 kubenswrapper[2560]: E0917 02:18:48.073830    2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31bcb92e632fe915873fcc1f19f7238b952c3d01e7efdb76b5cbe605d6f883fb\": container with ID starting with 31bcb92e632fe915873fcc1f19f7238b952c3d01e7efdb76b5cbe605d6f883fb not found: ID does not exist" containerID="31bcb92e632fe915873fcc1f19f7238b952c3d01e7efdb76b5cbe605d6f883fb"
Sep 17 02:18:48.073922 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:48.073853    2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31bcb92e632fe915873fcc1f19f7238b952c3d01e7efdb76b5cbe605d6f883fb"} err="failed to get container status \"31bcb92e632fe915873fcc1f19f7238b952c3d01e7efdb76b5cbe605d6f883fb\": rpc error: code = NotFound desc = could not find container \"31bcb92e632fe915873fcc1f19f7238b952c3d01e7efdb76b5cbe605d6f883fb\": container with ID starting with 31bcb92e632fe915873fcc1f19f7238b952c3d01e7efdb76b5cbe605d6f883fb not found: ID does not exist"
Sep 17 02:18:48.093078 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:48.093055    2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-59f6566bbc-ps7ln"]
Sep 17 02:18:48.103838 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:48.103815    2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-59f6566bbc-ps7ln"]
Sep 17 02:18:48.357422 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:18:48.357330    2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3642e8e6-7b7d-43f3-ae87-486ebab18de0" path="/var/lib/kubelet/pods/3642e8e6-7b7d-43f3-ae87-486ebab18de0/volumes"
Sep 17 02:19:09.131198 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:09.131170    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bzxlf_d0de4f20-0902-4f4f-b1cf-48f5e4119117/global-pull-secret-syncer/0.log"
Sep 17 02:19:09.302437 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:09.302404    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9cvt8_df44a97e-9c59-4dc9-abd9-3d1bd20972b9/konnectivity-agent/0.log"
Sep 17 02:19:09.392824 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:09.392743    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-95.ec2.internal_182c03c78ab71663e42db8a5ead7b76b/haproxy/0.log"
Sep 17 02:19:14.083514 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:14.083485    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-djpdm_5bfe3778-76bf-44c5-8404-1a70b45dcedf/manager/0.log"
Sep 17 02:19:14.127691 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:14.127664    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-xvtnm_19e326d8-2308-4845-8737-4781a3737762/manager/0.log"
Sep 17 02:19:14.290143 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:14.290114    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-f66rn_9bed9aca-ba37-4d87-9c44-af1c80b5da08/manager/0.log"
Sep 17 02:19:15.901790 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:15.901707    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-d5ffb_a0f66d44-d240-4e20-ad17-e6ae05f0780d/monitoring-plugin/0.log"
Sep 17 02:19:16.010475 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:16.010448    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9lncg_b5bd5e52-63dc-468a-abdc-4d08afa3489e/node-exporter/0.log"
Sep 17 02:19:16.034921 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:16.034895    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9lncg_b5bd5e52-63dc-468a-abdc-4d08afa3489e/kube-rbac-proxy/0.log"
Sep 17 02:19:16.061946 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:16.061914    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9lncg_b5bd5e52-63dc-468a-abdc-4d08afa3489e/init-textfile/0.log"
Sep 17 02:19:19.501069 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:19.501036    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-d65888898-7phm7_70ef6ef2-4104-4696-be49-f812c79d573a/console/0.log"
Sep 17 02:19:19.529113 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:19.529085    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-nwn7d_a5a2b676-e9e1-4d35-bec9-8abc03bacced/download-server/0.log"
Sep 17 02:19:19.820722 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:19.820690    2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nlq6t/perf-node-gather-daemonset-6rjtl"]
Sep 17 02:19:19.821062 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:19.821048    2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3642e8e6-7b7d-43f3-ae87-486ebab18de0" containerName="maas-api"
Sep 17 02:19:19.821111 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:19.821064    2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3642e8e6-7b7d-43f3-ae87-486ebab18de0" containerName="maas-api"
Sep 17 02:19:19.821146 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:19.821112    2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="3642e8e6-7b7d-43f3-ae87-486ebab18de0" containerName="maas-api"
Sep 17 02:19:19.824408 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:19.824391    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nlq6t/perf-node-gather-daemonset-6rjtl"
Sep 17 02:19:19.826138 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:19.826112    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nlq6t\"/\"openshift-service-ca.crt\""
Sep 17 02:19:19.826138 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:19.826109    2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-nlq6t\"/\"default-dockercfg-cl7v2\""
Sep 17 02:19:19.826426 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:19.826412    2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nlq6t\"/\"kube-root-ca.crt\""
Sep 17 02:19:19.832301 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:19.832279    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nlq6t/perf-node-gather-daemonset-6rjtl"]
Sep 17 02:19:19.906521 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:19.906486    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5k6x\" (UniqueName: \"kubernetes.io/projected/cc6e3903-6e90-45d4-a2f0-4fa725641445-kube-api-access-m5k6x\") pod \"perf-node-gather-daemonset-6rjtl\" (UID: \"cc6e3903-6e90-45d4-a2f0-4fa725641445\") " pod="openshift-must-gather-nlq6t/perf-node-gather-daemonset-6rjtl"
Sep 17 02:19:19.906692 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:19.906540    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc6e3903-6e90-45d4-a2f0-4fa725641445-sys\") pod \"perf-node-gather-daemonset-6rjtl\" (UID: \"cc6e3903-6e90-45d4-a2f0-4fa725641445\") " pod="openshift-must-gather-nlq6t/perf-node-gather-daemonset-6rjtl"
Sep 17 02:19:19.906692 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:19.906588    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc6e3903-6e90-45d4-a2f0-4fa725641445-lib-modules\") pod \"perf-node-gather-daemonset-6rjtl\" (UID: \"cc6e3903-6e90-45d4-a2f0-4fa725641445\") " pod="openshift-must-gather-nlq6t/perf-node-gather-daemonset-6rjtl"
Sep 17 02:19:19.906692 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:19.906613    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cc6e3903-6e90-45d4-a2f0-4fa725641445-proc\") pod \"perf-node-gather-daemonset-6rjtl\" (UID: \"cc6e3903-6e90-45d4-a2f0-4fa725641445\") " pod="openshift-must-gather-nlq6t/perf-node-gather-daemonset-6rjtl"
Sep 17 02:19:19.906692 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:19.906663    2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cc6e3903-6e90-45d4-a2f0-4fa725641445-podres\") pod \"perf-node-gather-daemonset-6rjtl\" (UID: \"cc6e3903-6e90-45d4-a2f0-4fa725641445\") " pod="openshift-must-gather-nlq6t/perf-node-gather-daemonset-6rjtl"
Sep 17 02:19:20.007860 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:20.007820    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc6e3903-6e90-45d4-a2f0-4fa725641445-sys\") pod \"perf-node-gather-daemonset-6rjtl\" (UID: \"cc6e3903-6e90-45d4-a2f0-4fa725641445\") " pod="openshift-must-gather-nlq6t/perf-node-gather-daemonset-6rjtl"
Sep 17 02:19:20.008026 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:20.007870    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc6e3903-6e90-45d4-a2f0-4fa725641445-lib-modules\") pod \"perf-node-gather-daemonset-6rjtl\" (UID: \"cc6e3903-6e90-45d4-a2f0-4fa725641445\") " pod="openshift-must-gather-nlq6t/perf-node-gather-daemonset-6rjtl"
Sep 17 02:19:20.008026 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:20.007903    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cc6e3903-6e90-45d4-a2f0-4fa725641445-proc\") pod \"perf-node-gather-daemonset-6rjtl\" (UID: \"cc6e3903-6e90-45d4-a2f0-4fa725641445\") " pod="openshift-must-gather-nlq6t/perf-node-gather-daemonset-6rjtl"
Sep 17 02:19:20.008026 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:20.007930    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cc6e3903-6e90-45d4-a2f0-4fa725641445-podres\") pod \"perf-node-gather-daemonset-6rjtl\" (UID: \"cc6e3903-6e90-45d4-a2f0-4fa725641445\") " pod="openshift-must-gather-nlq6t/perf-node-gather-daemonset-6rjtl"
Sep 17 02:19:20.008026 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:20.007953    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc6e3903-6e90-45d4-a2f0-4fa725641445-sys\") pod \"perf-node-gather-daemonset-6rjtl\" (UID: \"cc6e3903-6e90-45d4-a2f0-4fa725641445\") " pod="openshift-must-gather-nlq6t/perf-node-gather-daemonset-6rjtl"
Sep 17 02:19:20.008026 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:20.007959    2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5k6x\" (UniqueName: \"kubernetes.io/projected/cc6e3903-6e90-45d4-a2f0-4fa725641445-kube-api-access-m5k6x\") pod \"perf-node-gather-daemonset-6rjtl\" (UID: \"cc6e3903-6e90-45d4-a2f0-4fa725641445\") " pod="openshift-must-gather-nlq6t/perf-node-gather-daemonset-6rjtl"
Sep 17 02:19:20.008202 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:20.008040    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cc6e3903-6e90-45d4-a2f0-4fa725641445-proc\") pod \"perf-node-gather-daemonset-6rjtl\" (UID: \"cc6e3903-6e90-45d4-a2f0-4fa725641445\") " pod="openshift-must-gather-nlq6t/perf-node-gather-daemonset-6rjtl"
Sep 17 02:19:20.008202 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:20.008094    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc6e3903-6e90-45d4-a2f0-4fa725641445-lib-modules\") pod \"perf-node-gather-daemonset-6rjtl\" (UID: \"cc6e3903-6e90-45d4-a2f0-4fa725641445\") " pod="openshift-must-gather-nlq6t/perf-node-gather-daemonset-6rjtl"
Sep 17 02:19:20.008202 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:20.008135    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cc6e3903-6e90-45d4-a2f0-4fa725641445-podres\") pod \"perf-node-gather-daemonset-6rjtl\" (UID: \"cc6e3903-6e90-45d4-a2f0-4fa725641445\") " pod="openshift-must-gather-nlq6t/perf-node-gather-daemonset-6rjtl"
Sep 17 02:19:20.016475 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:20.016456    2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5k6x\" (UniqueName: \"kubernetes.io/projected/cc6e3903-6e90-45d4-a2f0-4fa725641445-kube-api-access-m5k6x\") pod \"perf-node-gather-daemonset-6rjtl\" (UID: \"cc6e3903-6e90-45d4-a2f0-4fa725641445\") " pod="openshift-must-gather-nlq6t/perf-node-gather-daemonset-6rjtl"
Sep 17 02:19:20.134610 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:20.134521    2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nlq6t/perf-node-gather-daemonset-6rjtl"
Sep 17 02:19:20.403101 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:20.403075    2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nlq6t/perf-node-gather-daemonset-6rjtl"]
Sep 17 02:19:20.405627 ip-10-0-143-95 kubenswrapper[2560]: W0917 02:19:20.405596    2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcc6e3903_6e90_45d4_a2f0_4fa725641445.slice/crio-d4f3166d566a5e6fb1ddc83f50f6b85d4b7e23a7270e5f1cace602710d9a1a3e WatchSource:0}: Error finding container d4f3166d566a5e6fb1ddc83f50f6b85d4b7e23a7270e5f1cace602710d9a1a3e: Status 404 returned error can't find the container with id d4f3166d566a5e6fb1ddc83f50f6b85d4b7e23a7270e5f1cace602710d9a1a3e
Sep 17 02:19:21.217460 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:21.217422    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nlq6t/perf-node-gather-daemonset-6rjtl" event={"ID":"cc6e3903-6e90-45d4-a2f0-4fa725641445","Type":"ContainerStarted","Data":"6258d09e0239a0e16d16d43296ac1a1402d8531437fef0a6f772c3546f381fcb"}
Sep 17 02:19:21.217834 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:21.217484    2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nlq6t/perf-node-gather-daemonset-6rjtl" event={"ID":"cc6e3903-6e90-45d4-a2f0-4fa725641445","Type":"ContainerStarted","Data":"d4f3166d566a5e6fb1ddc83f50f6b85d4b7e23a7270e5f1cace602710d9a1a3e"}
Sep 17 02:19:21.217834 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:21.217512    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-nlq6t/perf-node-gather-daemonset-6rjtl"
Sep 17 02:19:21.231787 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:21.231739    2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-nlq6t/perf-node-gather-daemonset-6rjtl" podStartSLOduration=2.23172354 podStartE2EDuration="2.23172354s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 02:19:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 02:19:21.229803299 +0000 UTC m=+2519.479780612" watchObservedRunningTime="2026-09-17 02:19:21.23172354 +0000 UTC m=+2519.481700853"
Sep 17 02:19:21.273727 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:21.273702    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cjxjr_23eb4c89-97d5-44b9-9775-02f25ce8ed5c/dns/0.log"
Sep 17 02:19:21.291560 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:21.291533    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cjxjr_23eb4c89-97d5-44b9-9775-02f25ce8ed5c/kube-rbac-proxy/0.log"
Sep 17 02:19:21.433195 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:21.433164    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vjfz5_777686bc-ef43-4350-9276-ce9cde09811c/dns-node-resolver/0.log"
Sep 17 02:19:21.935097 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:21.935066    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-556656868b-6qdkj_4bef8068-4aab-450b-a13b-87a1c7f6b323/registry/0.log"
Sep 17 02:19:21.999435 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:21.999406    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tgvzc_02474a41-dc47-48ca-a66b-8bd035e916bc/node-ca/0.log"
Sep 17 02:19:23.266304 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:23.266241    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-pgkbc_994d1047-b360-47df-bfa9-b2a728c5ab75/discovery/0.log"
Sep 17 02:19:23.311658 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:23.311609    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b79c4dfc8-cs6db_bd462ce5-798b-46ab-ab9a-542df781ab42/kube-auth-proxy/0.log"
Sep 17 02:19:24.236611 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:24.236581    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4rxjm_1b98a580-e689-4636-8f7b-5962006de1a5/serve-healthcheck-canary/0.log"
Sep 17 02:19:24.867895 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:24.867866    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c64g7_ed45f248-7d90-4484-a2ee-aae4cb046145/kube-rbac-proxy/0.log"
Sep 17 02:19:24.888235 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:24.888211    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c64g7_ed45f248-7d90-4484-a2ee-aae4cb046145/exporter/0.log"
Sep 17 02:19:24.906937 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:24.906919    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c64g7_ed45f248-7d90-4484-a2ee-aae4cb046145/extractor/0.log"
Sep 17 02:19:27.181289 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:27.181258    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-76ff884776-799m8_5dba7335-1653-4401-ac06-13c11c9e93fa/manager/0.log"
Sep 17 02:19:27.231862 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:27.231833    2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-nlq6t/perf-node-gather-daemonset-6rjtl"
Sep 17 02:19:27.479687 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:27.479605    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-587ff8bd8c-95dn7_2995a526-246b-4707-a7d2-30ab79413df8/manager/0.log"
Sep 17 02:19:27.653616 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:27.653570    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f5f459ff6-2x8xn_14f9cb94-5a00-47a2-8500-9e6b2355c953/manager/0.log"
Sep 17 02:19:27.668405 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:27.668375    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f5f459ff6-2x8xn_14f9cb94-5a00-47a2-8500-9e6b2355c953/copy-manifests/0.log"
Sep 17 02:19:29.178741 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:29.178712    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-7z9fw_d6ff127c-158d-44d2-80bb-8e519faf9a72/openshift-lws-operator/0.log"
Sep 17 02:19:29.904087 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:29.904057    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-pgkbc_994d1047-b360-47df-bfa9-b2a728c5ab75/discovery/0.log"
Sep 17 02:19:29.935873 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:29.935851    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b79c4dfc8-cs6db_bd462ce5-798b-46ab-ab9a-542df781ab42/kube-auth-proxy/0.log"
Sep 17 02:19:31.797444 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:31.797358    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-pgkbc_994d1047-b360-47df-bfa9-b2a728c5ab75/discovery/0.log"
Sep 17 02:19:31.832435 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:31.832403    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b79c4dfc8-cs6db_bd462ce5-798b-46ab-ab9a-542df781ab42/kube-auth-proxy/0.log"
Sep 17 02:19:34.449672 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:34.449642    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-dvfht_e78acd85-6286-43cc-8079-3779ce03633f/migrator/0.log"
Sep 17 02:19:34.468275 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:34.468221    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-dvfht_e78acd85-6286-43cc-8079-3779ce03633f/graceful-termination/0.log"
Sep 17 02:19:35.771420 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:35.771389    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-8xnbz_a6ef4b82-3568-4d70-a62a-2e3eb3fdaed6/kube-multus/0.log"
Sep 17 02:19:35.791724 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:35.791701    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5jxkd_8c26e78f-6e4c-489e-98c8-fa49ca563945/kube-multus-additional-cni-plugins/0.log"
Sep 17 02:19:35.811090 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:35.811072    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5jxkd_8c26e78f-6e4c-489e-98c8-fa49ca563945/egress-router-binary-copy/0.log"
Sep 17 02:19:35.833693 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:35.833672    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5jxkd_8c26e78f-6e4c-489e-98c8-fa49ca563945/cni-plugins/0.log"
Sep 17 02:19:35.853993 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:35.853975    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5jxkd_8c26e78f-6e4c-489e-98c8-fa49ca563945/bond-cni-plugin/0.log"
Sep 17 02:19:35.873370 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:35.873345    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5jxkd_8c26e78f-6e4c-489e-98c8-fa49ca563945/routeoverride-cni/0.log"
Sep 17 02:19:35.894489 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:35.894468    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5jxkd_8c26e78f-6e4c-489e-98c8-fa49ca563945/whereabouts-cni-bincopy/0.log"
Sep 17 02:19:35.913008 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:35.912984    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5jxkd_8c26e78f-6e4c-489e-98c8-fa49ca563945/whereabouts-cni/0.log"
Sep 17 02:19:36.304594 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:36.304542    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-p8bbk_091f4d92-aca2-45ac-9c63-6b73cf983b35/network-metrics-daemon/0.log"
Sep 17 02:19:36.321632 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:36.321607    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-p8bbk_091f4d92-aca2-45ac-9c63-6b73cf983b35/kube-rbac-proxy/0.log"
Sep 17 02:19:37.203581 ip-10-0-143-95 kubenswrapper[2560]: I0917 02:19:37.203546    2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4sjxl_f6c9e227-299b-4d98-93dc-bd53cb3f37b4/ovn-controller/0.log"