Sep 20 00:47:41.898163 ip-10-0-132-108 systemd[1]: Starting Kubernetes Kubelet...
Sep 20 00:47:45.252122 ip-10-0-132-108 kubenswrapper[2570]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 20 00:47:45.252122 ip-10-0-132-108 kubenswrapper[2570]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 20 00:47:45.252122 ip-10-0-132-108 kubenswrapper[2570]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 20 00:47:45.252122 ip-10-0-132-108 kubenswrapper[2570]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 20 00:47:45.252122 ip-10-0-132-108 kubenswrapper[2570]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 20 00:47:45.252825 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.252190    2570 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 20 00:47:45.255891 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.255876    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 20 00:47:45.255891 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.255891    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 20 00:47:45.255955 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.255896    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 20 00:47:45.255955 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.255899    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 20 00:47:45.255955 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.255901    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 20 00:47:45.255955 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.255904    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 20 00:47:45.255955 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.255907    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 20 00:47:45.255955 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.255910    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 20 00:47:45.255955 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.255913    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 20 00:47:45.255955 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.255916    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 20 00:47:45.255955 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.255919    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 20 00:47:45.255955 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.255922    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 20 00:47:45.255955 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.255925    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 20 00:47:45.255955 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.255927    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 20 00:47:45.255955 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.255930    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 20 00:47:45.255955 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.255933    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 20 00:47:45.255955 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.255935    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 20 00:47:45.255955 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.255938    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 20 00:47:45.255955 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.255941    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 20 00:47:45.255955 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.255943    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 20 00:47:45.255955 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.255947    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 20 00:47:45.256440 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.255952    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 20 00:47:45.256440 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.255955    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 20 00:47:45.256440 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.255957    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 20 00:47:45.256440 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.255960    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 20 00:47:45.256440 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.255963    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 20 00:47:45.256440 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.255966    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 20 00:47:45.256440 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.255969    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 20 00:47:45.256440 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.255971    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 20 00:47:45.256440 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.255974    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 20 00:47:45.256440 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.255976    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 20 00:47:45.256440 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.255979    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 20 00:47:45.256440 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.255981    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 20 00:47:45.256440 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.255984    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 20 00:47:45.256440 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.255986    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 20 00:47:45.256440 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.255989    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 20 00:47:45.256440 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.255992    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 20 00:47:45.256440 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.255995    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 20 00:47:45.256440 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.255998    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 20 00:47:45.256440 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256000    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 20 00:47:45.256440 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256003    2570 feature_gate.go:328] unrecognized feature gate: Example2
Sep 20 00:47:45.256943 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256006    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 20 00:47:45.256943 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256008    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 20 00:47:45.256943 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256011    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 20 00:47:45.256943 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256015    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 20 00:47:45.256943 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256019    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 20 00:47:45.256943 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256022    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 20 00:47:45.256943 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256025    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 20 00:47:45.256943 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256029    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 20 00:47:45.256943 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256032    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 20 00:47:45.256943 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256034    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 20 00:47:45.256943 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256037    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 20 00:47:45.256943 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256040    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 20 00:47:45.256943 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256042    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 20 00:47:45.256943 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256046    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 20 00:47:45.256943 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256049    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 20 00:47:45.256943 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256051    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 20 00:47:45.256943 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256054    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 20 00:47:45.256943 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256057    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 20 00:47:45.256943 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256059    2570 feature_gate.go:328] unrecognized feature gate: Example
Sep 20 00:47:45.257488 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256062    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 20 00:47:45.257488 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256065    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 20 00:47:45.257488 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256068    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 20 00:47:45.257488 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256071    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 20 00:47:45.257488 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256073    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 20 00:47:45.257488 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256076    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 20 00:47:45.257488 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256078    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 20 00:47:45.257488 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256081    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 20 00:47:45.257488 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256083    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 20 00:47:45.257488 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256089    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 20 00:47:45.257488 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256092    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 20 00:47:45.257488 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256095    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 20 00:47:45.257488 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256097    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 20 00:47:45.257488 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256100    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 20 00:47:45.257488 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256104    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 20 00:47:45.257488 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256108    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 20 00:47:45.257488 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256111    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 20 00:47:45.257488 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256114    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 20 00:47:45.257488 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256116    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 20 00:47:45.257488 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256119    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 20 00:47:45.258245 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256122    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 20 00:47:45.258245 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256124    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 20 00:47:45.258245 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256127    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 20 00:47:45.258245 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256129    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 20 00:47:45.258245 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256132    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 20 00:47:45.258245 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256134    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 20 00:47:45.258245 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256139    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 20 00:47:45.258245 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256141    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 20 00:47:45.258245 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256144    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 20 00:47:45.258245 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256146    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 20 00:47:45.258245 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256149    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 20 00:47:45.258245 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256152    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 20 00:47:45.258245 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256154    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 20 00:47:45.258245 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256157    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 20 00:47:45.258245 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256159    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 20 00:47:45.258245 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256162    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 20 00:47:45.258245 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256165    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 20 00:47:45.258245 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256168    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 20 00:47:45.258245 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256170    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 20 00:47:45.258245 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256882    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 20 00:47:45.258731 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256889    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 20 00:47:45.258731 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256893    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 20 00:47:45.258731 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256901    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 20 00:47:45.258731 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256904    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 20 00:47:45.258731 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256907    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 20 00:47:45.258731 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256910    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 20 00:47:45.258731 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256913    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 20 00:47:45.258731 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256916    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 20 00:47:45.258731 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256918    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 20 00:47:45.258731 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256921    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 20 00:47:45.258731 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256923    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 20 00:47:45.258731 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256926    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 20 00:47:45.258731 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256929    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 20 00:47:45.258731 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256931    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 20 00:47:45.258731 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256934    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 20 00:47:45.258731 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256936    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 20 00:47:45.258731 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256941    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 20 00:47:45.258731 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256945    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 20 00:47:45.258731 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256948    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 20 00:47:45.258731 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256952    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 20 00:47:45.259282 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256955    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 20 00:47:45.259282 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256958    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 20 00:47:45.259282 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256961    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 20 00:47:45.259282 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256964    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 20 00:47:45.259282 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256967    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 20 00:47:45.259282 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256969    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 20 00:47:45.259282 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256972    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 20 00:47:45.259282 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256975    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 20 00:47:45.259282 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256978    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 20 00:47:45.259282 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256981    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 20 00:47:45.259282 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256985    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 20 00:47:45.259282 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256988    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 20 00:47:45.259282 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256991    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 20 00:47:45.259282 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256993    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 20 00:47:45.259282 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.256996    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 20 00:47:45.259282 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257006    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 20 00:47:45.259282 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257008    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 20 00:47:45.259282 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257011    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 20 00:47:45.259282 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257014    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 20 00:47:45.259742 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257017    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 20 00:47:45.259742 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257020    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 20 00:47:45.259742 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257023    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 20 00:47:45.259742 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257025    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 20 00:47:45.259742 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257029    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 20 00:47:45.259742 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257031    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 20 00:47:45.259742 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257034    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 20 00:47:45.259742 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257036    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 20 00:47:45.259742 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257039    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 20 00:47:45.259742 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257041    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 20 00:47:45.259742 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257044    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 20 00:47:45.259742 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257046    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 20 00:47:45.259742 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257049    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 20 00:47:45.259742 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257051    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 20 00:47:45.259742 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257054    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 20 00:47:45.259742 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257057    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 20 00:47:45.259742 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257059    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 20 00:47:45.259742 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257062    2570 feature_gate.go:328] unrecognized feature gate: Example2
Sep 20 00:47:45.259742 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257064    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 20 00:47:45.259742 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257067    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 20 00:47:45.260253 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257069    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 20 00:47:45.260253 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257072    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 20 00:47:45.260253 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257076    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 20 00:47:45.260253 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257079    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 20 00:47:45.260253 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257081    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 20 00:47:45.260253 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257085    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 20 00:47:45.260253 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257088    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 20 00:47:45.260253 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257091    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 20 00:47:45.260253 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257094    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 20 00:47:45.260253 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257102    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 20 00:47:45.260253 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257105    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 20 00:47:45.260253 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257109    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 20 00:47:45.260253 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257111    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 20 00:47:45.260253 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257114    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 20 00:47:45.260253 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257116    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 20 00:47:45.260253 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257119    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 20 00:47:45.260253 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257121    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 20 00:47:45.260253 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257124    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 20 00:47:45.260253 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257126    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 20 00:47:45.260253 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257129    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 20 00:47:45.260762 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257131    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 20 00:47:45.260762 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257134    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 20 00:47:45.260762 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257136    2570 feature_gate.go:328] unrecognized feature gate: Example
Sep 20 00:47:45.260762 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257138    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 20 00:47:45.260762 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257141    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 20 00:47:45.260762 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257143    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 20 00:47:45.260762 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257146    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 20 00:47:45.260762 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257148    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 20 00:47:45.260762 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257151    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 20 00:47:45.260762 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257153    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 20 00:47:45.260762 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257156    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 20 00:47:45.260762 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257158    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 20 00:47:45.260762 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257160    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 20 00:47:45.260762 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257163    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 20 00:47:45.260762 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257165    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 20 00:47:45.260762 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257168    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 20 00:47:45.260762 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257170    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 20 00:47:45.260762 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257173    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 20 00:47:45.260762 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.257175    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 20 00:47:45.260762 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259012    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 20 00:47:45.261257 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259023    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 20 00:47:45.261257 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259026    2570 feature_gate.go:328] unrecognized feature gate: Example2
Sep 20 00:47:45.261257 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259030    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 20 00:47:45.261257 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259033    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 20 00:47:45.261257 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259035    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 20 00:47:45.261257 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259038    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 20 00:47:45.261257 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259041    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 20 00:47:45.261257 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259043    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 20 00:47:45.261257 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259047    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 20 00:47:45.261257 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259049    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 20 00:47:45.261257 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259051    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 20 00:47:45.261257 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259054    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 20 00:47:45.261257 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259057    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 20 00:47:45.261257 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259059    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 20 00:47:45.261257 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259062    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 20 00:47:45.261257 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259065    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 20 00:47:45.261257 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259067    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 20 00:47:45.261257 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259070    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 20 00:47:45.261257 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259072    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 20 00:47:45.261257 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259075    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 20 00:47:45.261751 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259077    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 20 00:47:45.261751 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259080    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 20 00:47:45.261751 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259082    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 20 00:47:45.261751 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259085    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 20 00:47:45.261751 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259087    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 20 00:47:45.261751 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259090    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 20 00:47:45.261751 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259092    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 20 00:47:45.261751 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259095    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 20 00:47:45.261751 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259097    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 20 00:47:45.261751 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259105    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 20 00:47:45.261751 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259107    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 20 00:47:45.261751 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259110    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 20 00:47:45.261751 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259113    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 20 00:47:45.261751 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259116    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 20 00:47:45.261751 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259118    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 20 00:47:45.261751 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259121    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 20 00:47:45.261751 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259126    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 20 00:47:45.261751 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259130    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 20 00:47:45.261751 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259133    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 20 00:47:45.262228 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259136    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 20 00:47:45.262228 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259139    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 20 00:47:45.262228 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259142    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 20 00:47:45.262228 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259145    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 20 00:47:45.262228 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259148    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 20 00:47:45.262228 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259151    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 20 00:47:45.262228 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259153    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 20 00:47:45.262228 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259156    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 20 00:47:45.262228 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259158    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 20 00:47:45.262228 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259161    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 20 00:47:45.262228 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259163    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 20 00:47:45.262228 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259167    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 20 00:47:45.262228 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259171    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 20 00:47:45.262228 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259174    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 20 00:47:45.262228 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259176    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 20 00:47:45.262228 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259179    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 20 00:47:45.262228 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259182    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 20 00:47:45.262228 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259185    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 20 00:47:45.262228 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259187    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 20 00:47:45.262685 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259189    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 20 00:47:45.262685 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259192    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 20 00:47:45.262685 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259194    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 20 00:47:45.262685 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259197    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 20 00:47:45.262685 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259199    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 20 00:47:45.262685 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259202    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 20 00:47:45.262685 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259205    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 20 00:47:45.262685 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259208    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 20 00:47:45.262685 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259210    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 20 00:47:45.262685 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259213    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 20 00:47:45.262685 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259216    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 20 00:47:45.262685 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259218    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 20 00:47:45.262685 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259221    2570 feature_gate.go:328] unrecognized feature gate: Example
Sep 20 00:47:45.262685 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259224    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 20 00:47:45.262685 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259227    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 20 00:47:45.262685 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259229    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 20 00:47:45.262685 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259232    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 20 00:47:45.262685 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259235    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 20 00:47:45.262685 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259238    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 20 00:47:45.262685 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259240    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 20 00:47:45.263188 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259242    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 20 00:47:45.263188 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259245    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 20 00:47:45.263188 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259247    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 20 00:47:45.263188 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259250    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 20 00:47:45.263188 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259253    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 20 00:47:45.263188 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259255    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 20 00:47:45.263188 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259258    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 20 00:47:45.263188 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259260    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 20 00:47:45.263188 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259264    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 20 00:47:45.263188 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259267    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 20 00:47:45.263188 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259270    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 20 00:47:45.263188 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259273    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 20 00:47:45.263188 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259276    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 20 00:47:45.263188 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259279    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 20 00:47:45.263188 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259281    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 20 00:47:45.263188 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259284    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 20 00:47:45.263188 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259287    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 20 00:47:45.263188 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259291    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 20 00:47:45.263188 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259294    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 20 00:47:45.263651 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.259297    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 20 00:47:45.263651 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259401    2570 flags.go:64] FLAG: --address="0.0.0.0"
Sep 20 00:47:45.263651 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259426    2570 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 20 00:47:45.263651 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259432    2570 flags.go:64] FLAG: --anonymous-auth="true"
Sep 20 00:47:45.263651 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259437    2570 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 20 00:47:45.263651 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259441    2570 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 20 00:47:45.263651 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259444    2570 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 20 00:47:45.263651 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259448    2570 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 20 00:47:45.263651 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259452    2570 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 20 00:47:45.263651 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259455    2570 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 20 00:47:45.263651 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259458    2570 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 20 00:47:45.263651 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259462    2570 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 20 00:47:45.263651 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259465    2570 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 20 00:47:45.263651 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259468    2570 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 20 00:47:45.263651 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259471    2570 flags.go:64] FLAG: --cgroup-root=""
Sep 20 00:47:45.263651 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259473    2570 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 20 00:47:45.263651 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259476    2570 flags.go:64] FLAG: --client-ca-file=""
Sep 20 00:47:45.263651 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259480    2570 flags.go:64] FLAG: --cloud-provider="external"
Sep 20 00:47:45.263651 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259483    2570 flags.go:64] FLAG: --cluster-dns="[]"
Sep 20 00:47:45.263651 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259487    2570 flags.go:64] FLAG: --cluster-domain=""
Sep 20 00:47:45.263651 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259490    2570 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 20 00:47:45.263651 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259493    2570 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 20 00:47:45.263651 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259496    2570 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 20 00:47:45.263651 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259499    2570 flags.go:64] FLAG: --container-log-max-files="5"
Sep 20 00:47:45.264234 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259503    2570 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 20 00:47:45.264234 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259506    2570 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 20 00:47:45.264234 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259509    2570 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 20 00:47:45.264234 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259512    2570 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 20 00:47:45.264234 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259514    2570 flags.go:64] FLAG: --contention-profiling="false"
Sep 20 00:47:45.264234 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259517    2570 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 20 00:47:45.264234 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259523    2570 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 20 00:47:45.264234 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259526    2570 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 20 00:47:45.264234 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259529    2570 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 20 00:47:45.264234 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259533    2570 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 20 00:47:45.264234 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259536    2570 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 20 00:47:45.264234 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259539    2570 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 20 00:47:45.264234 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259542    2570 flags.go:64] FLAG: --enable-load-reader="false"
Sep 20 00:47:45.264234 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259545    2570 flags.go:64] FLAG: --enable-server="true"
Sep 20 00:47:45.264234 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259548    2570 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 20 00:47:45.264234 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259552    2570 flags.go:64] FLAG: --event-burst="100"
Sep 20 00:47:45.264234 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259556    2570 flags.go:64] FLAG: --event-qps="50"
Sep 20 00:47:45.264234 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259559    2570 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 20 00:47:45.264234 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259562    2570 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 20 00:47:45.264234 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259565    2570 flags.go:64] FLAG: --eviction-hard=""
Sep 20 00:47:45.264234 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259569    2570 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 20 00:47:45.264234 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259572    2570 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 20 00:47:45.264234 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259575    2570 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 20 00:47:45.264234 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259578    2570 flags.go:64] FLAG: --eviction-soft=""
Sep 20 00:47:45.264234 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259581    2570 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 20 00:47:45.264855 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259583    2570 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 20 00:47:45.264855 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259587    2570 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 20 00:47:45.264855 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259590    2570 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 20 00:47:45.264855 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259593    2570 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 20 00:47:45.264855 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259595    2570 flags.go:64] FLAG: --fail-swap-on="true"
Sep 20 00:47:45.264855 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259598    2570 flags.go:64] FLAG: --feature-gates=""
Sep 20 00:47:45.264855 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259602    2570 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 20 00:47:45.264855 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259605    2570 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 20 00:47:45.264855 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259608    2570 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 20 00:47:45.264855 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259611    2570 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 20 00:47:45.264855 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259614    2570 flags.go:64] FLAG: --healthz-port="10248"
Sep 20 00:47:45.264855 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259617    2570 flags.go:64] FLAG: --help="false"
Sep 20 00:47:45.264855 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259620    2570 flags.go:64] FLAG: --hostname-override="ip-10-0-132-108.ec2.internal"
Sep 20 00:47:45.264855 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259625    2570 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 20 00:47:45.264855 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259628    2570 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 20 00:47:45.264855 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259631    2570 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 20 00:47:45.264855 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259635    2570 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 20 00:47:45.264855 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259639    2570 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 20 00:47:45.264855 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259642    2570 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 20 00:47:45.264855 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259644    2570 flags.go:64] FLAG: --image-service-endpoint=""
Sep 20 00:47:45.264855 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259647    2570 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 20 00:47:45.264855 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259650    2570 flags.go:64] FLAG: --kube-api-burst="100"
Sep 20 00:47:45.264855 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259653    2570 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 20 00:47:45.265457 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259656    2570 flags.go:64] FLAG: --kube-api-qps="50"
Sep 20 00:47:45.265457 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259659    2570 flags.go:64] FLAG: --kube-reserved=""
Sep 20 00:47:45.265457 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259662    2570 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 20 00:47:45.265457 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259665    2570 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 20 00:47:45.265457 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259668    2570 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 20 00:47:45.265457 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259671    2570 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 20 00:47:45.265457 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259674    2570 flags.go:64] FLAG: --lock-file=""
Sep 20 00:47:45.265457 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259676    2570 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 20 00:47:45.265457 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259679    2570 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 20 00:47:45.265457 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259682    2570 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 20 00:47:45.265457 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259687    2570 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 20 00:47:45.265457 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259691    2570 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 20 00:47:45.265457 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259694    2570 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 20 00:47:45.265457 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259697    2570 flags.go:64] FLAG: --logging-format="text"
Sep 20 00:47:45.265457 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259700    2570 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 20 00:47:45.265457 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259703    2570 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 20 00:47:45.265457 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259706    2570 flags.go:64] FLAG: --manifest-url=""
Sep 20 00:47:45.265457 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259708    2570 flags.go:64] FLAG: --manifest-url-header=""
Sep 20 00:47:45.265457 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259713    2570 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 20 00:47:45.265457 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259716    2570 flags.go:64] FLAG: --max-open-files="1000000"
Sep 20 00:47:45.265457 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259720    2570 flags.go:64] FLAG: --max-pods="110"
Sep 20 00:47:45.265457 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259723    2570 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 20 00:47:45.265457 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259727    2570 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 20 00:47:45.265457 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259730    2570 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 20 00:47:45.265457 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259732    2570 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 20 00:47:45.266106 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259737    2570 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 20 00:47:45.266106 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259740    2570 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 20 00:47:45.266106 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259743    2570 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 20 00:47:45.266106 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259750    2570 flags.go:64] FLAG: --node-status-max-images="50"
Sep 20 00:47:45.266106 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259753    2570 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 20 00:47:45.266106 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259756    2570 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 20 00:47:45.266106 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259759    2570 flags.go:64] FLAG: --pod-cidr=""
Sep 20 00:47:45.266106 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259762    2570 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc"
Sep 20 00:47:45.266106 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259768    2570 flags.go:64] FLAG: --pod-manifest-path=""
Sep 20 00:47:45.266106 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259771    2570 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 20 00:47:45.266106 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259774    2570 flags.go:64] FLAG: --pods-per-core="0"
Sep 20 00:47:45.266106 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259777    2570 flags.go:64] FLAG: --port="10250"
Sep 20 00:47:45.266106 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259780    2570 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 20 00:47:45.266106 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259782    2570 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0916cf8ff79918918"
Sep 20 00:47:45.266106 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259786    2570 flags.go:64] FLAG: --qos-reserved=""
Sep 20 00:47:45.266106 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259789    2570 flags.go:64] FLAG: --read-only-port="10255"
Sep 20 00:47:45.266106 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259792    2570 flags.go:64] FLAG: --register-node="true"
Sep 20 00:47:45.266106 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259794    2570 flags.go:64] FLAG: --register-with-taints=""
Sep 20 00:47:45.266106 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259798    2570 flags.go:64] FLAG: --registry-burst="10"
Sep 20 00:47:45.266106 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259801    2570 flags.go:64] FLAG: --registry-qps="5"
Sep 20 00:47:45.266106 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259804    2570 flags.go:64] FLAG: --reserved-cpus=""
Sep 20 00:47:45.266106 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259806    2570 flags.go:64] FLAG: --reserved-memory=""
Sep 20 00:47:45.266106 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259810    2570 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 20 00:47:45.266106 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259813    2570 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 20 00:47:45.266106 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259816    2570 flags.go:64] FLAG: --rotate-certificates="false"
Sep 20 00:47:45.266745 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259819    2570 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 20 00:47:45.266745 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259822    2570 flags.go:64] FLAG: --runonce="false"
Sep 20 00:47:45.266745 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259825    2570 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 20 00:47:45.266745 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259827    2570 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 20 00:47:45.266745 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259831    2570 flags.go:64] FLAG: --seccomp-default="false"
Sep 20 00:47:45.266745 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259834    2570 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 20 00:47:45.266745 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259837    2570 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 20 00:47:45.266745 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259840    2570 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 20 00:47:45.266745 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259844    2570 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 20 00:47:45.266745 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259847    2570 flags.go:64] FLAG: --storage-driver-password="root"
Sep 20 00:47:45.266745 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259850    2570 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 20 00:47:45.266745 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259853    2570 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 20 00:47:45.266745 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259870    2570 flags.go:64] FLAG: --storage-driver-user="root"
Sep 20 00:47:45.266745 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259874    2570 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 20 00:47:45.266745 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259877    2570 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 20 00:47:45.266745 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259880    2570 flags.go:64] FLAG: --system-cgroups=""
Sep 20 00:47:45.266745 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259883    2570 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 20 00:47:45.266745 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259888    2570 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 20 00:47:45.266745 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259891    2570 flags.go:64] FLAG: --tls-cert-file=""
Sep 20 00:47:45.266745 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259894    2570 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 20 00:47:45.266745 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259898    2570 flags.go:64] FLAG: --tls-min-version=""
Sep 20 00:47:45.266745 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259900    2570 flags.go:64] FLAG: --tls-private-key-file=""
Sep 20 00:47:45.266745 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259903    2570 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 20 00:47:45.266745 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259906    2570 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 20 00:47:45.266745 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259909    2570 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 20 00:47:45.267391 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259912    2570 flags.go:64] FLAG: --v="2"
Sep 20 00:47:45.267391 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259920    2570 flags.go:64] FLAG: --version="false"
Sep 20 00:47:45.267391 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259925    2570 flags.go:64] FLAG: --vmodule=""
Sep 20 00:47:45.267391 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259929    2570 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 20 00:47:45.267391 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.259932    2570 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 20 00:47:45.267391 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260065    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 20 00:47:45.267391 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260070    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 20 00:47:45.267391 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260073    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 20 00:47:45.267391 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260077    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 20 00:47:45.267391 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260082    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 20 00:47:45.267391 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260086    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 20 00:47:45.267391 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260090    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 20 00:47:45.267391 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260093    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 20 00:47:45.267391 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260096    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 20 00:47:45.267391 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260099    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 20 00:47:45.267391 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260103    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 20 00:47:45.267391 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260106    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 20 00:47:45.267391 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260109    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 20 00:47:45.267391 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260112    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 20 00:47:45.267391 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260115    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 20 00:47:45.267899 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260118    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 20 00:47:45.267899 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260120    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 20 00:47:45.267899 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260123    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 20 00:47:45.267899 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260126    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 20 00:47:45.267899 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260128    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 20 00:47:45.267899 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260131    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 20 00:47:45.267899 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260133    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 20 00:47:45.267899 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260141    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 20 00:47:45.267899 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260144    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 20 00:47:45.267899 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260146    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 20 00:47:45.267899 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260149    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 20 00:47:45.267899 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260151    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 20 00:47:45.267899 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260154    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 20 00:47:45.267899 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260156    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 20 00:47:45.267899 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260160    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 20 00:47:45.267899 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260164    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 20 00:47:45.267899 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260167    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 20 00:47:45.267899 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260169    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 20 00:47:45.267899 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260172    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 20 00:47:45.268362 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260175    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 20 00:47:45.268362 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260178    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 20 00:47:45.268362 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260181    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 20 00:47:45.268362 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260183    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 20 00:47:45.268362 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260187    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 20 00:47:45.268362 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260189    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 20 00:47:45.268362 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260192    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 20 00:47:45.268362 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260195    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 20 00:47:45.268362 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260199    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 20 00:47:45.268362 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260201    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 20 00:47:45.268362 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260204    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 20 00:47:45.268362 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260206    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 20 00:47:45.268362 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260209    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 20 00:47:45.268362 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260212    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 20 00:47:45.268362 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260215    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 20 00:47:45.268362 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260217    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 20 00:47:45.268362 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260220    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 20 00:47:45.268362 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260222    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 20 00:47:45.268362 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260225    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 20 00:47:45.268823 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260227    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 20 00:47:45.268823 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260230    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 20 00:47:45.268823 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260232    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 20 00:47:45.268823 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260235    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 20 00:47:45.268823 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260238    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 20 00:47:45.268823 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260240    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 20 00:47:45.268823 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260243    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 20 00:47:45.268823 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260245    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 20 00:47:45.268823 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260248    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 20 00:47:45.268823 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260250    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 20 00:47:45.268823 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260254    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 20 00:47:45.268823 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260257    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 20 00:47:45.268823 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260260    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 20 00:47:45.268823 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260262    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 20 00:47:45.268823 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260265    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 20 00:47:45.268823 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260268    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 20 00:47:45.268823 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260270    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 20 00:47:45.268823 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260274    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 20 00:47:45.268823 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260276    2570 feature_gate.go:328] unrecognized feature gate: Example
Sep 20 00:47:45.268823 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260279    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 20 00:47:45.269328 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260281    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 20 00:47:45.269328 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260284    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 20 00:47:45.269328 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260288    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 20 00:47:45.269328 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260290    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 20 00:47:45.269328 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260293    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 20 00:47:45.269328 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260295    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 20 00:47:45.269328 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260298    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 20 00:47:45.269328 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260300    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 20 00:47:45.269328 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260303    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 20 00:47:45.269328 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260306    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 20 00:47:45.269328 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260309    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 20 00:47:45.269328 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260311    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 20 00:47:45.269328 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260313    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 20 00:47:45.269328 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260316    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 20 00:47:45.269328 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260318    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 20 00:47:45.269328 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260321    2570 feature_gate.go:328] unrecognized feature gate: Example2
Sep 20 00:47:45.269328 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260323    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 20 00:47:45.269328 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260326    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 20 00:47:45.269328 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260328    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 20 00:47:45.269328 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260331    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 20 00:47:45.269328 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260333    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 20 00:47:45.269851 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260335    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 20 00:47:45.269851 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260338    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 20 00:47:45.269851 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260341    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 20 00:47:45.269851 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260343    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 20 00:47:45.269851 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.260346    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 20 00:47:45.269851 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.260351    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 20 00:47:45.269851 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.267774    2570 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 20 00:47:45.269851 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.267790    2570 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 20 00:47:45.269851 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.267809    2570 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 20 00:47:45.269851 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.267815    2570 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 20 00:47:45.269851 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.267890    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 20 00:47:45.269851 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.267896    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 20 00:47:45.269851 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.267900    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 20 00:47:45.269851 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.267903    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 20 00:47:45.269851 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.267906    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 20 00:47:45.270247 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.267910    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 20 00:47:45.270247 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.267914    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 20 00:47:45.270247 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.267917    2570 feature_gate.go:328] unrecognized feature gate: Example2
Sep 20 00:47:45.270247 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.267920    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 20 00:47:45.270247 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.267923    2570 feature_gate.go:328] unrecognized feature gate: Example
Sep 20 00:47:45.270247 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.267925    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 20 00:47:45.270247 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.267928    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 20 00:47:45.270247 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.267931    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 20 00:47:45.270247 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.267933    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 20 00:47:45.270247 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.267936    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 20 00:47:45.270247 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.267939    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 20 00:47:45.270247 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.267941    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 20 00:47:45.270247 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.267944    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 20 00:47:45.270247 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.267947    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 20 00:47:45.270247 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.267949    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 20 00:47:45.270247 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.267952    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 20 00:47:45.270247 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.267955    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 20 00:47:45.270247 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.267957    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 20 00:47:45.270247 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.267961    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 20 00:47:45.270714 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.267965    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 20 00:47:45.270714 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.267968    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 20 00:47:45.270714 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.267970    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 20 00:47:45.270714 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.267973    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 20 00:47:45.270714 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.267975    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 20 00:47:45.270714 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.267980    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 20 00:47:45.270714 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.267982    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 20 00:47:45.270714 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.267985    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 20 00:47:45.270714 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.267988    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 20 00:47:45.270714 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.267990    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 20 00:47:45.270714 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.267992    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 20 00:47:45.270714 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.267995    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 20 00:47:45.270714 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.267997    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 20 00:47:45.270714 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268000    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 20 00:47:45.270714 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268002    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 20 00:47:45.270714 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268004    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 20 00:47:45.270714 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268007    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 20 00:47:45.270714 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268009    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 20 00:47:45.270714 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268011    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 20 00:47:45.270714 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268014    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 20 00:47:45.271277 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268017    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 20 00:47:45.271277 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268019    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 20 00:47:45.271277 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268022    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 20 00:47:45.271277 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268025    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 20 00:47:45.271277 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268027    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 20 00:47:45.271277 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268030    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 20 00:47:45.271277 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268032    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 20 00:47:45.271277 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268035    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 20 00:47:45.271277 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268037    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 20 00:47:45.271277 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268039    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 20 00:47:45.271277 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268042    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 20 00:47:45.271277 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268045    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 20 00:47:45.271277 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268048    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 20 00:47:45.271277 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268050    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 20 00:47:45.271277 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268053    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 20 00:47:45.271277 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268055    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 20 00:47:45.271277 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268058    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 20 00:47:45.271277 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268061    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 20 00:47:45.271277 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268064    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 20 00:47:45.271277 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268067    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 20 00:47:45.271852 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268069    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 20 00:47:45.271852 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268072    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 20 00:47:45.271852 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268075    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 20 00:47:45.271852 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268077    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 20 00:47:45.271852 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268080    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 20 00:47:45.271852 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268082    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 20 00:47:45.271852 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268085    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 20 00:47:45.271852 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268088    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 20 00:47:45.271852 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268090    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 20 00:47:45.271852 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268093    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 20 00:47:45.271852 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268095    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 20 00:47:45.271852 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268098    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 20 00:47:45.271852 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268100    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 20 00:47:45.271852 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268103    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 20 00:47:45.271852 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268106    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 20 00:47:45.271852 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268108    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 20 00:47:45.271852 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268111    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 20 00:47:45.271852 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268113    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 20 00:47:45.271852 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268116    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 20 00:47:45.272354 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268118    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 20 00:47:45.272354 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268121    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 20 00:47:45.272354 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268124    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 20 00:47:45.272354 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268126    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 20 00:47:45.272354 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268129    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 20 00:47:45.272354 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268131    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 20 00:47:45.272354 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268133    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 20 00:47:45.272354 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268137    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 20 00:47:45.272354 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268140    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 20 00:47:45.272354 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268143    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 20 00:47:45.272354 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268146    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 20 00:47:45.272354 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268149    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 20 00:47:45.272354 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268153    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 20 00:47:45.272354 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268156    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 20 00:47:45.272354 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268158    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 20 00:47:45.272354 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268161    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 20 00:47:45.272745 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.268166    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 20 00:47:45.272745 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268282    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 20 00:47:45.272745 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268287    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 20 00:47:45.272745 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268290    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 20 00:47:45.272745 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268293    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 20 00:47:45.272745 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268296    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 20 00:47:45.272745 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268298    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 20 00:47:45.272745 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268301    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 20 00:47:45.272745 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268304    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 20 00:47:45.272745 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268306    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 20 00:47:45.272745 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268309    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 20 00:47:45.272745 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268312    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 20 00:47:45.272745 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268316    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 20 00:47:45.272745 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268319    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 20 00:47:45.273154 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268321    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 20 00:47:45.273154 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268324    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 20 00:47:45.273154 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268326    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 20 00:47:45.273154 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268329    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 20 00:47:45.273154 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268331    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 20 00:47:45.273154 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268334    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 20 00:47:45.273154 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268336    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 20 00:47:45.273154 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268339    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 20 00:47:45.273154 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268342    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 20 00:47:45.273154 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268344    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 20 00:47:45.273154 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268347    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 20 00:47:45.273154 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268350    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 20 00:47:45.273154 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268353    2570 feature_gate.go:328] unrecognized feature gate: Example
Sep 20 00:47:45.273154 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268355    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 20 00:47:45.273154 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268358    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 20 00:47:45.273154 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268361    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 20 00:47:45.273154 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268364    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 20 00:47:45.273154 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268367    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 20 00:47:45.273154 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268369    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 20 00:47:45.273632 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268372    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 20 00:47:45.273632 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268375    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 20 00:47:45.273632 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268378    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 20 00:47:45.273632 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268380    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 20 00:47:45.273632 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268382    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 20 00:47:45.273632 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268385    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 20 00:47:45.273632 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268387    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 20 00:47:45.273632 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268390    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 20 00:47:45.273632 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268392    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 20 00:47:45.273632 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268395    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 20 00:47:45.273632 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268398    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 20 00:47:45.273632 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268401    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 20 00:47:45.273632 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268405    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 20 00:47:45.273632 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268408    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 20 00:47:45.273632 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268411    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 20 00:47:45.273632 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268413    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 20 00:47:45.273632 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268416    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 20 00:47:45.273632 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268418    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 20 00:47:45.273632 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268421    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 20 00:47:45.273632 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268423    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 20 00:47:45.274137 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268426    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 20 00:47:45.274137 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268429    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 20 00:47:45.274137 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268431    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 20 00:47:45.274137 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268433    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 20 00:47:45.274137 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268436    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 20 00:47:45.274137 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268439    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 20 00:47:45.274137 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268442    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 20 00:47:45.274137 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268444    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 20 00:47:45.274137 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268447    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 20 00:47:45.274137 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268450    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 20 00:47:45.274137 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268453    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 20 00:47:45.274137 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268455    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 20 00:47:45.274137 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268458    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 20 00:47:45.274137 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268460    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 20 00:47:45.274137 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268463    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 20 00:47:45.274137 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268465    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 20 00:47:45.274137 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268468    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 20 00:47:45.274137 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268470    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 20 00:47:45.274137 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268473    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 20 00:47:45.274137 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268475    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 20 00:47:45.274667 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268478    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 20 00:47:45.274667 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268480    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 20 00:47:45.274667 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268483    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 20 00:47:45.274667 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268485    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 20 00:47:45.274667 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268488    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 20 00:47:45.274667 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268490    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 20 00:47:45.274667 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268493    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 20 00:47:45.274667 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268496    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 20 00:47:45.274667 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268498    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 20 00:47:45.274667 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268501    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 20 00:47:45.274667 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268503    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 20 00:47:45.274667 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268505    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 20 00:47:45.274667 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268509    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 20 00:47:45.274667 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268513    2570 feature_gate.go:328] unrecognized feature gate: Example2
Sep 20 00:47:45.274667 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268516    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 20 00:47:45.274667 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268518    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 20 00:47:45.274667 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268521    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 20 00:47:45.274667 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268524    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 20 00:47:45.274667 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268527    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 20 00:47:45.274667 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268529    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 20 00:47:45.275292 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268532    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 20 00:47:45.275292 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268534    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 20 00:47:45.275292 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268538    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 20 00:47:45.275292 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268540    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 20 00:47:45.275292 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268543    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 20 00:47:45.275292 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268546    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 20 00:47:45.275292 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:45.268548    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 20 00:47:45.275292 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.268553    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 20 00:47:45.275292 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.268657    2570 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 20 00:47:45.275292 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.270714    2570 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 20 00:47:45.275292 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.271677    2570 server.go:1019] "Starting client certificate rotation"
Sep 20 00:47:45.275292 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.271773    2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 20 00:47:45.275292 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.271811    2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 20 00:47:45.275736 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.274278    2570 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 20 00:47:45.275736 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.275415    2570 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 20 00:47:45.282178 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.282155    2570 log.go:25] "Validated CRI v1 runtime API"
Sep 20 00:47:45.284046 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.283909    2570 log.go:25] "Validated CRI v1 image API"
Sep 20 00:47:45.284570 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.284557    2570 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 20 00:47:45.287047 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.287017    2570 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 bf6074ae-252c-4483-8f04-3c6b739136d2:/dev/nvme0n1p4 fb2f0b2a-68f5-42d5-8ae2-6e8ee79535cf:/dev/nvme0n1p3]
Sep 20 00:47:45.287128 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.287045    2570 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 20 00:47:45.291106 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.290990    2570 manager.go:216] Machine: {Timestamp:2026-09-20 00:47:45.290509724 +0000 UTC m=+1.904665632 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3110645 MemoryCapacity:32812150784 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec290f95291c38c3a7758a3f6a9a3924 SystemUUID:ec290f95-291c-38c3-a775-8a3f6a9a3924 BootID:8d3bcfe9-5164-44fb-9bf7-8f16fff0c292 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406073344 Type:vfs Inodes:4005389 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:d4:69:35:b7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:d4:69:35:b7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:76:6e:26:7a:84:85 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812150784 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 20 00:47:45.291106 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.291096    2570 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 20 00:47:45.291272 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.291200    2570 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 20 00:47:45.292784 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.292760    2570 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 20 00:47:45.292931 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.292788    2570 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-108.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 20 00:47:45.294234 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.294223    2570 topology_manager.go:138] "Creating topology manager with none policy"
Sep 20 00:47:45.294280 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.294237    2570 container_manager_linux.go:309] "Creating device plugin manager"
Sep 20 00:47:45.294280 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.294245    2570 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 20 00:47:45.294280 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.294255    2570 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 20 00:47:45.294361 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.294321    2570 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 20 00:47:45.297968 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.297955    2570 state_mem.go:36] "Initialized new in-memory state store"
Sep 20 00:47:45.298089 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.298079    2570 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 20 00:47:45.298122 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.298113    2570 kubelet.go:486] "Attempting to sync node with API server"
Sep 20 00:47:45.298154 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.298123    2570 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 20 00:47:45.298154 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.298136    2570 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 20 00:47:45.298154 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.298144    2570 kubelet.go:398] "Adding apiserver pod source"
Sep 20 00:47:45.298154 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.298154    2570 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 20 00:47:45.298512 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.298486    2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 20 00:47:45.298512 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.298511    2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 20 00:47:45.300612 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.300596    2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 20 00:47:45.300726 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.300706    2570 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1"
Sep 20 00:47:45.302753 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.302740    2570 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 20 00:47:45.302794 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.302772    2570 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 20 00:47:45.303767 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.303754    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 20 00:47:45.303807 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.303777    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 20 00:47:45.303807 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.303788    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 20 00:47:45.303807 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.303796    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 20 00:47:45.303926 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.303810    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 20 00:47:45.303926 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.303819    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 20 00:47:45.303926 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.303839    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 20 00:47:45.303926 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.303848    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 20 00:47:45.303926 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.303877    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 20 00:47:45.303926 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.303886    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 20 00:47:45.303926 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.303899    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 20 00:47:45.303926 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.303907    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 20 00:47:45.304144 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.303941    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 20 00:47:45.304144 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.303949    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 20 00:47:45.312496 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.312481    2570 server.go:1268] "Started kubelet"
Sep 20 00:47:45.312577 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.312537    2570 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 20 00:47:45.312679 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.312660    2570 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-108.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 20 00:47:45.312744 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:45.312688    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-108.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 20 00:47:45.312846 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:45.312824    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 20 00:47:45.313166 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.312595    2570 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 20 00:47:45.313266 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.313189    2570 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 20 00:47:45.313434 ip-10-0-132-108 systemd[1]: Started Kubernetes Kubelet.
Sep 20 00:47:45.346024 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.345995    2570 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 20 00:47:45.346190 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.346170    2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ct7b8"
Sep 20 00:47:45.346267 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.346202    2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ct7b8"
Sep 20 00:47:45.347140 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.347122    2570 server.go:310] "Adding debug handlers to kubelet server"
Sep 20 00:47:45.347241 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:45.347161    2570 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 20 00:47:45.351874 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:45.350821    2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-108.ec2.internal.18d6e0f9c6c24fab  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-108.ec2.internal,UID:ip-10-0-132-108.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-108.ec2.internal,},FirstTimestamp:2026-09-20 00:47:45.312452523 +0000 UTC m=+1.926608411,LastTimestamp:2026-09-20 00:47:45.312452523 +0000 UTC m=+1.926608411,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-108.ec2.internal,}"
Sep 20 00:47:45.353610 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.353594    2570 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 20 00:47:45.353709 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.353611    2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 20 00:47:45.353798 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:45.353781    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-108.ec2.internal\" not found"
Sep 20 00:47:45.354273 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.354257    2570 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 20 00:47:45.354379 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.354282    2570 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 20 00:47:45.354379 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.354257    2570 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 20 00:47:45.354379 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.354348    2570 reconstruct.go:97] "Volume reconstruction finished"
Sep 20 00:47:45.354379 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.354356    2570 reconciler.go:29] "Reconciler: start to sync state"
Sep 20 00:47:45.355297 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.355267    2570 factory.go:55] Registering systemd factory
Sep 20 00:47:45.355297 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.355286    2570 factory.go:223] Registration of the systemd container factory successfully
Sep 20 00:47:45.355540 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.355525    2570 factory.go:153] Registering CRI-O factory
Sep 20 00:47:45.355598 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.355545    2570 factory.go:223] Registration of the crio container factory successfully
Sep 20 00:47:45.355598 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.355594    2570 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 20 00:47:45.355671 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.355613    2570 factory.go:103] Registering Raw factory
Sep 20 00:47:45.355671 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.355626    2570 manager.go:1196] Started watching for new ooms in manager
Sep 20 00:47:45.356120 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.356108    2570 manager.go:349] Starting recovery of all containers
Sep 20 00:47:45.364980 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.364956    2570 manager.go:354] Recovery completed
Sep 20 00:47:45.365959 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.365941    2570 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 20 00:47:45.369111 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.369098    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 20 00:47:45.369370 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:45.369354    2570 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-132-108.ec2.internal\" not found" node="ip-10-0-132-108.ec2.internal"
Sep 20 00:47:45.370789 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.370775    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-108.ec2.internal" event="NodeHasSufficientMemory"
Sep 20 00:47:45.370874 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.370801    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-108.ec2.internal" event="NodeHasNoDiskPressure"
Sep 20 00:47:45.370874 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.370811    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-108.ec2.internal" event="NodeHasSufficientPID"
Sep 20 00:47:45.371345 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.371333    2570 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 20 00:47:45.371345 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.371343    2570 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 20 00:47:45.371442 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.371358    2570 state_mem.go:36] "Initialized new in-memory state store"
Sep 20 00:47:45.371442 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.371369    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 20 00:47:45.372008 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.371993    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-108.ec2.internal" event="NodeHasSufficientMemory"
Sep 20 00:47:45.372050 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.372016    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-108.ec2.internal" event="NodeHasNoDiskPressure"
Sep 20 00:47:45.372050 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.372025    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-108.ec2.internal" event="NodeHasSufficientPID"
Sep 20 00:47:45.373458 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.373446    2570 policy_none.go:49] "None policy: Start"
Sep 20 00:47:45.373500 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.373462    2570 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 20 00:47:45.373500 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.373473    2570 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 20 00:47:45.375394 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.375380    2570 policy_none.go:47] "Start"
Sep 20 00:47:45.425613 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.416468    2570 manager.go:337] "Starting Device Plugin manager"
Sep 20 00:47:45.425613 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:45.416605    2570 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 20 00:47:45.425613 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.416614    2570 server.go:87] "Starting device plugin registration server"
Sep 20 00:47:45.425613 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.416874    2570 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 20 00:47:45.425613 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.416900    2570 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 20 00:47:45.425613 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.416984    2570 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 20 00:47:45.425613 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.417074    2570 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 20 00:47:45.425613 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.417083    2570 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 20 00:47:45.425613 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:45.417568    2570 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 20 00:47:45.425613 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:45.417610    2570 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-108.ec2.internal\" not found"
Sep 20 00:47:45.445541 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.445518    2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 20 00:47:45.446844 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.446828    2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 20 00:47:45.446929 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.446891    2570 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 20 00:47:45.446929 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.446911    2570 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 20 00:47:45.447036 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:45.446948    2570 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 20 00:47:45.449194 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.449175    2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 20 00:47:45.517617 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.517556    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 20 00:47:45.518778 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.518763    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-108.ec2.internal" event="NodeHasSufficientMemory"
Sep 20 00:47:45.518895 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.518797    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-108.ec2.internal" event="NodeHasNoDiskPressure"
Sep 20 00:47:45.518895 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.518815    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-108.ec2.internal" event="NodeHasSufficientPID"
Sep 20 00:47:45.518895 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.518842    2570 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-108.ec2.internal"
Sep 20 00:47:45.527263 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.527249    2570 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-108.ec2.internal"
Sep 20 00:47:45.527335 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:45.527269    2570 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-108.ec2.internal\": node \"ip-10-0-132-108.ec2.internal\" not found"
Sep 20 00:47:45.548381 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.547690    2570 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-108.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-108.ec2.internal"]
Sep 20 00:47:45.548461 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.548418    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 20 00:47:45.549176 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.549162    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-108.ec2.internal" event="NodeHasSufficientMemory"
Sep 20 00:47:45.549248 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.549192    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-108.ec2.internal" event="NodeHasNoDiskPressure"
Sep 20 00:47:45.549248 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.549203    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-108.ec2.internal" event="NodeHasSufficientPID"
Sep 20 00:47:45.551388 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.551377    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 20 00:47:45.551505 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.551490    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-108.ec2.internal"
Sep 20 00:47:45.551543 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.551520    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 20 00:47:45.552026 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.552012    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-108.ec2.internal" event="NodeHasSufficientMemory"
Sep 20 00:47:45.552089 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.552033    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-108.ec2.internal" event="NodeHasNoDiskPressure"
Sep 20 00:47:45.552089 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.552041    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-108.ec2.internal" event="NodeHasSufficientPID"
Sep 20 00:47:45.552089 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.552040    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-108.ec2.internal" event="NodeHasSufficientMemory"
Sep 20 00:47:45.552089 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.552064    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-108.ec2.internal" event="NodeHasNoDiskPressure"
Sep 20 00:47:45.552089 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.552073    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-108.ec2.internal" event="NodeHasSufficientPID"
Sep 20 00:47:45.553375 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:45.553358    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-108.ec2.internal\" not found"
Sep 20 00:47:45.554235 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.554220    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-108.ec2.internal"
Sep 20 00:47:45.554321 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.554250    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 20 00:47:45.554935 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.554918    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-108.ec2.internal" event="NodeHasSufficientMemory"
Sep 20 00:47:45.555028 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.554948    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-108.ec2.internal" event="NodeHasNoDiskPressure"
Sep 20 00:47:45.555028 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.554962    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-108.ec2.internal" event="NodeHasSufficientPID"
Sep 20 00:47:45.556318 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.556297    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cf200e0815bd4d9afec83c9f28df3bc2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-108.ec2.internal\" (UID: \"cf200e0815bd4d9afec83c9f28df3bc2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-108.ec2.internal"
Sep 20 00:47:45.556405 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.556331    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf200e0815bd4d9afec83c9f28df3bc2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-108.ec2.internal\" (UID: \"cf200e0815bd4d9afec83c9f28df3bc2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-108.ec2.internal"
Sep 20 00:47:45.556405 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.556359    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1556c8746d3b9e131e1e9b890fd41c30-config\") pod \"kube-apiserver-proxy-ip-10-0-132-108.ec2.internal\" (UID: \"1556c8746d3b9e131e1e9b890fd41c30\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-108.ec2.internal"
Sep 20 00:47:45.576490 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:45.576441    2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-108.ec2.internal\" not found" node="ip-10-0-132-108.ec2.internal"
Sep 20 00:47:45.580697 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:45.580682    2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-108.ec2.internal\" not found" node="ip-10-0-132-108.ec2.internal"
Sep 20 00:47:45.654212 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:45.654190    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-108.ec2.internal\" not found"
Sep 20 00:47:45.657457 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.657437    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1556c8746d3b9e131e1e9b890fd41c30-config\") pod \"kube-apiserver-proxy-ip-10-0-132-108.ec2.internal\" (UID: \"1556c8746d3b9e131e1e9b890fd41c30\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-108.ec2.internal"
Sep 20 00:47:45.657511 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.657469    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cf200e0815bd4d9afec83c9f28df3bc2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-108.ec2.internal\" (UID: \"cf200e0815bd4d9afec83c9f28df3bc2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-108.ec2.internal"
Sep 20 00:47:45.657511 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.657494    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf200e0815bd4d9afec83c9f28df3bc2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-108.ec2.internal\" (UID: \"cf200e0815bd4d9afec83c9f28df3bc2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-108.ec2.internal"
Sep 20 00:47:45.657582 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.657533    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf200e0815bd4d9afec83c9f28df3bc2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-108.ec2.internal\" (UID: \"cf200e0815bd4d9afec83c9f28df3bc2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-108.ec2.internal"
Sep 20 00:47:45.657582 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.657552    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cf200e0815bd4d9afec83c9f28df3bc2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-108.ec2.internal\" (UID: \"cf200e0815bd4d9afec83c9f28df3bc2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-108.ec2.internal"
Sep 20 00:47:45.657582 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.657554    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1556c8746d3b9e131e1e9b890fd41c30-config\") pod \"kube-apiserver-proxy-ip-10-0-132-108.ec2.internal\" (UID: \"1556c8746d3b9e131e1e9b890fd41c30\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-108.ec2.internal"
Sep 20 00:47:45.755139 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:45.755106    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-108.ec2.internal\" not found"
Sep 20 00:47:45.855845 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:45.855783    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-108.ec2.internal\" not found"
Sep 20 00:47:45.880089 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.880064    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-108.ec2.internal"
Sep 20 00:47:45.884071 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:45.884052    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-108.ec2.internal"
Sep 20 00:47:45.956261 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:45.956229    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-108.ec2.internal\" not found"
Sep 20 00:47:46.056741 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:46.056705    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-108.ec2.internal\" not found"
Sep 20 00:47:46.157349 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:46.157270    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-108.ec2.internal\" not found"
Sep 20 00:47:46.257887 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:46.257846    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-108.ec2.internal\" not found"
Sep 20 00:47:46.271152 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:46.271130    2570 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 20 00:47:46.271293 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:46.271277    2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 20 00:47:46.271335 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:46.271294    2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 20 00:47:46.353817 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:46.353780    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-19 00:42:45 +0000 UTC" deadline="2028-05-11 15:56:15.726226997 +0000 UTC"
Sep 20 00:47:46.353817 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:46.353809    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14391h8m29.372421146s"
Sep 20 00:47:46.359008 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:46.358982    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-108.ec2.internal\" not found"
Sep 20 00:47:46.422944 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:46.422881    2570 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 20 00:47:46.459526 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:46.459503    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-108.ec2.internal\" not found"
Sep 20 00:47:46.466023 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:46.466006    2570 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 20 00:47:46.554511 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:46.554471    2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-108.ec2.internal"
Sep 20 00:47:46.564531 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:46.564514    2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 20 00:47:46.565729 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:46.565716    2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-108.ec2.internal"
Sep 20 00:47:46.573281 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:46.573268    2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 20 00:47:46.589637 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:46.589609    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf200e0815bd4d9afec83c9f28df3bc2.slice/crio-8beb14266f92bd795ba10ed3f480cbef52408504045c68f416b9c5f9ce41e0f3 WatchSource:0}: Error finding container 8beb14266f92bd795ba10ed3f480cbef52408504045c68f416b9c5f9ce41e0f3: Status 404 returned error can't find the container with id 8beb14266f92bd795ba10ed3f480cbef52408504045c68f416b9c5f9ce41e0f3
Sep 20 00:47:46.590427 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:46.590408    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1556c8746d3b9e131e1e9b890fd41c30.slice/crio-a1e0ed264d0f4ad3ec35508e97304a3b0c18c0fe9b7165e8a1a93b068a6cd4fe WatchSource:0}: Error finding container a1e0ed264d0f4ad3ec35508e97304a3b0c18c0fe9b7165e8a1a93b068a6cd4fe: Status 404 returned error can't find the container with id a1e0ed264d0f4ad3ec35508e97304a3b0c18c0fe9b7165e8a1a93b068a6cd4fe
Sep 20 00:47:46.595204 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:46.595186    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 20 00:47:47.134532 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.134490    2570 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 20 00:47:47.299004 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.298978    2570 apiserver.go:52] "Watching apiserver"
Sep 20 00:47:47.304880 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.304831    2570 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 20 00:47:47.305261 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.305236    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-9mgf7","openshift-ovn-kubernetes/ovnkube-node-65l6f","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxxk","openshift-cluster-node-tuning-operator/tuned-wdqj2","openshift-dns/node-resolver-7zwqs","openshift-image-registry/node-ca-5f7zt","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-108.ec2.internal","openshift-multus/multus-additional-cni-plugins-ghfbt","kube-system/global-pull-secret-syncer-9mws2","kube-system/konnectivity-agent-sd6xd","kube-system/kube-apiserver-proxy-ip-10-0-132-108.ec2.internal","openshift-multus/multus-hfwr4","openshift-multus/network-metrics-daemon-94nzn","openshift-network-diagnostics/network-check-target-t6qv8"]
Sep 20 00:47:47.308142 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.308120    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sd6xd"
Sep 20 00:47:47.311963 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.311938    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 20 00:47:47.312151 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.312132    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-v9vp5\""
Sep 20 00:47:47.312338 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.312318    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 20 00:47:47.314783 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.314763    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94nzn"
Sep 20 00:47:47.314894 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:47.314835    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94nzn" podUID="a0d1f872-b92c-4b72-bdee-a7ac18493d84"
Sep 20 00:47:47.316791 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.316773    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxxk"
Sep 20 00:47:47.319990 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.319971    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wdqj2"
Sep 20 00:47:47.322957 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.321851    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7zwqs"
Sep 20 00:47:47.322957 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.322343    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 20 00:47:47.323066 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.322977    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 20 00:47:47.323191 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.323163    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-pcz79\""
Sep 20 00:47:47.323274 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.323198    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 20 00:47:47.323613 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.323594    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-dcxwc\""
Sep 20 00:47:47.325541 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.324064    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 20 00:47:47.325541 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.324115    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wkstd\""
Sep 20 00:47:47.325541 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.324201    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 20 00:47:47.325541 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.324214    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 20 00:47:47.325541 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.325276    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 20 00:47:47.328090 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.328071    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5f7zt"
Sep 20 00:47:47.330025 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.330003    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 20 00:47:47.330793 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.330289    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wg88r\""
Sep 20 00:47:47.330793 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.330444    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 20 00:47:47.330793 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.330633    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 20 00:47:47.330793 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.330636    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mws2"
Sep 20 00:47:47.330793 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:47.330702    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mws2" podUID="a588c630-f4a9-49b7-9ff1-1386742f40e3"
Sep 20 00:47:47.333487 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.332408    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6qv8"
Sep 20 00:47:47.333487 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:47.332455    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6qv8" podUID="e0167375-aa59-43a4-a5ba-e0b165da8b30"
Sep 20 00:47:47.335159 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.335033    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.337711 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.337329    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9mgf7"
Sep 20 00:47:47.338176 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.338153    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 20 00:47:47.338854 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.338653    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 20 00:47:47.338854 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.338697    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 20 00:47:47.338854 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.338658    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 20 00:47:47.340103 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.340081    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 20 00:47:47.340229 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.340179    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ghfbt"
Sep 20 00:47:47.340976 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.340311    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xgpnh\""
Sep 20 00:47:47.340976 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.340337    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 20 00:47:47.340976 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.340415    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 20 00:47:47.340976 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.340565    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 20 00:47:47.340976 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.340602    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 20 00:47:47.340976 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.340938    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-r7q4k\""
Sep 20 00:47:47.342669 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.342636    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-78xwx\""
Sep 20 00:47:47.343583 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.342932    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hfwr4"
Sep 20 00:47:47.343583 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.343030    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 20 00:47:47.343583 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.343123    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 20 00:47:47.343583 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.343177    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 20 00:47:47.343583 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.343302    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 20 00:47:47.343583 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.343427    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 20 00:47:47.345339 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.344714    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 20 00:47:47.345339 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.345149    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-g87nl\""
Sep 20 00:47:47.354106 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.354087    2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 20 00:47:47.355992 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.355976    2570 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 20 00:47:47.366417 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.366333    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dk9dt\" (UniqueName: \"kubernetes.io/projected/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-kube-api-access-dk9dt\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.366417 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.366366    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-host-run-netns\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.366417 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.366393    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-run-openvswitch\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.366618 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.366437    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-node-log\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.366618 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.366470    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0922c703-f848-4c79-9355-82285e120a06-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ghfbt\" (UID: \"0922c703-f848-4c79-9355-82285e120a06\") " pod="openshift-multus/multus-additional-cni-plugins-ghfbt"
Sep 20 00:47:47.366618 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.366499    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqlf5\" (UniqueName: \"kubernetes.io/projected/a0d1f872-b92c-4b72-bdee-a7ac18493d84-kube-api-access-gqlf5\") pod \"network-metrics-daemon-94nzn\" (UID: \"a0d1f872-b92c-4b72-bdee-a7ac18493d84\") " pod="openshift-multus/network-metrics-daemon-94nzn"
Sep 20 00:47:47.366618 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.366523    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/95b69c15-6fcc-4109-bbe1-c34043671a6a-etc-sysctl-conf\") pod \"tuned-wdqj2\" (UID: \"95b69c15-6fcc-4109-bbe1-c34043671a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wdqj2"
Sep 20 00:47:47.366618 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.366544    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-host-kubelet\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.366618 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.366607    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-run-ovn\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.366893 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.366641    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-env-overrides\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.366893 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.366664    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/93db881a-91b4-44c0-8725-bc9832172d1b-cnibin\") pod \"multus-hfwr4\" (UID: \"93db881a-91b4-44c0-8725-bc9832172d1b\") " pod="openshift-multus/multus-hfwr4"
Sep 20 00:47:47.366893 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.366704    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/93db881a-91b4-44c0-8725-bc9832172d1b-multus-daemon-config\") pod \"multus-hfwr4\" (UID: \"93db881a-91b4-44c0-8725-bc9832172d1b\") " pod="openshift-multus/multus-hfwr4"
Sep 20 00:47:47.366893 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.366727    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93db881a-91b4-44c0-8725-bc9832172d1b-etc-kubernetes\") pod \"multus-hfwr4\" (UID: \"93db881a-91b4-44c0-8725-bc9832172d1b\") " pod="openshift-multus/multus-hfwr4"
Sep 20 00:47:47.366893 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.366764    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6a07188-d164-4385-8a38-35289b53a7be-tmp-dir\") pod \"node-resolver-7zwqs\" (UID: \"a6a07188-d164-4385-8a38-35289b53a7be\") " pod="openshift-dns/node-resolver-7zwqs"
Sep 20 00:47:47.366893 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.366792    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/becc2877-6923-45c5-b169-5c211abd16dd-host-slash\") pod \"iptables-alerter-9mgf7\" (UID: \"becc2877-6923-45c5-b169-5c211abd16dd\") " pod="openshift-network-operator/iptables-alerter-9mgf7"
Sep 20 00:47:47.366893 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.366825    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/becc2877-6923-45c5-b169-5c211abd16dd-iptables-alerter-script\") pod \"iptables-alerter-9mgf7\" (UID: \"becc2877-6923-45c5-b169-5c211abd16dd\") " pod="openshift-network-operator/iptables-alerter-9mgf7"
Sep 20 00:47:47.366893 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.366855    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-452gw\" (UniqueName: \"kubernetes.io/projected/becc2877-6923-45c5-b169-5c211abd16dd-kube-api-access-452gw\") pod \"iptables-alerter-9mgf7\" (UID: \"becc2877-6923-45c5-b169-5c211abd16dd\") " pod="openshift-network-operator/iptables-alerter-9mgf7"
Sep 20 00:47:47.366893 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.366897    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0922c703-f848-4c79-9355-82285e120a06-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ghfbt\" (UID: \"0922c703-f848-4c79-9355-82285e120a06\") " pod="openshift-multus/multus-additional-cni-plugins-ghfbt"
Sep 20 00:47:47.366893 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.366919    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95b69c15-6fcc-4109-bbe1-c34043671a6a-sys\") pod \"tuned-wdqj2\" (UID: \"95b69c15-6fcc-4109-bbe1-c34043671a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wdqj2"
Sep 20 00:47:47.367384 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.366940    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-run-systemd\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.367384 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.366975    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/93db881a-91b4-44c0-8725-bc9832172d1b-cni-binary-copy\") pod \"multus-hfwr4\" (UID: \"93db881a-91b4-44c0-8725-bc9832172d1b\") " pod="openshift-multus/multus-hfwr4"
Sep 20 00:47:47.367384 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.367005    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/93db881a-91b4-44c0-8725-bc9832172d1b-multus-conf-dir\") pod \"multus-hfwr4\" (UID: \"93db881a-91b4-44c0-8725-bc9832172d1b\") " pod="openshift-multus/multus-hfwr4"
Sep 20 00:47:47.367384 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.367028    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5453e2eb-f239-4ae0-a01e-f8e78bac3e5e-etc-selinux\") pod \"aws-ebs-csi-driver-node-bcxxk\" (UID: \"5453e2eb-f239-4ae0-a01e-f8e78bac3e5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxxk"
Sep 20 00:47:47.367384 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.367052    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-host-run-ovn-kubernetes\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.367384 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.367087    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-host-cni-bin\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.367384 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.367115    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-host-cni-netd\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.367384 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.367160    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5cf64fad-2d77-43e8-a13d-fb2758010192-konnectivity-ca\") pod \"konnectivity-agent-sd6xd\" (UID: \"5cf64fad-2d77-43e8-a13d-fb2758010192\") " pod="kube-system/konnectivity-agent-sd6xd"
Sep 20 00:47:47.367384 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.367219    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/95b69c15-6fcc-4109-bbe1-c34043671a6a-etc-modprobe-d\") pod \"tuned-wdqj2\" (UID: \"95b69c15-6fcc-4109-bbe1-c34043671a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wdqj2"
Sep 20 00:47:47.367384 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.367243    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/93db881a-91b4-44c0-8725-bc9832172d1b-host-run-netns\") pod \"multus-hfwr4\" (UID: \"93db881a-91b4-44c0-8725-bc9832172d1b\") " pod="openshift-multus/multus-hfwr4"
Sep 20 00:47:47.367384 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.367265    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5453e2eb-f239-4ae0-a01e-f8e78bac3e5e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bcxxk\" (UID: \"5453e2eb-f239-4ae0-a01e-f8e78bac3e5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxxk"
Sep 20 00:47:47.367384 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.367289    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0922c703-f848-4c79-9355-82285e120a06-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ghfbt\" (UID: \"0922c703-f848-4c79-9355-82285e120a06\") " pod="openshift-multus/multus-additional-cni-plugins-ghfbt"
Sep 20 00:47:47.367384 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.367314    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/95b69c15-6fcc-4109-bbe1-c34043671a6a-etc-tuned\") pod \"tuned-wdqj2\" (UID: \"95b69c15-6fcc-4109-bbe1-c34043671a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wdqj2"
Sep 20 00:47:47.367384 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.367336    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e543f7c5-f70d-49ab-877a-2ff1cf7d30c3-host\") pod \"node-ca-5f7zt\" (UID: \"e543f7c5-f70d-49ab-877a-2ff1cf7d30c3\") " pod="openshift-image-registry/node-ca-5f7zt"
Sep 20 00:47:47.367384 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.367359    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-host-slash\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.367384 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.367382    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/93db881a-91b4-44c0-8725-bc9832172d1b-host-run-multus-certs\") pod \"multus-hfwr4\" (UID: \"93db881a-91b4-44c0-8725-bc9832172d1b\") " pod="openshift-multus/multus-hfwr4"
Sep 20 00:47:47.367940 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.367408    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0922c703-f848-4c79-9355-82285e120a06-system-cni-dir\") pod \"multus-additional-cni-plugins-ghfbt\" (UID: \"0922c703-f848-4c79-9355-82285e120a06\") " pod="openshift-multus/multus-additional-cni-plugins-ghfbt"
Sep 20 00:47:47.367940 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.367432    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0922c703-f848-4c79-9355-82285e120a06-cnibin\") pod \"multus-additional-cni-plugins-ghfbt\" (UID: \"0922c703-f848-4c79-9355-82285e120a06\") " pod="openshift-multus/multus-additional-cni-plugins-ghfbt"
Sep 20 00:47:47.367940 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.367454    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/95b69c15-6fcc-4109-bbe1-c34043671a6a-lib-modules\") pod \"tuned-wdqj2\" (UID: \"95b69c15-6fcc-4109-bbe1-c34043671a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wdqj2"
Sep 20 00:47:47.367940 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.367474    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93db881a-91b4-44c0-8725-bc9832172d1b-multus-cni-dir\") pod \"multus-hfwr4\" (UID: \"93db881a-91b4-44c0-8725-bc9832172d1b\") " pod="openshift-multus/multus-hfwr4"
Sep 20 00:47:47.367940 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.367515    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-systemd-units\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.367940 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.367539    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcjc5\" (UniqueName: \"kubernetes.io/projected/93db881a-91b4-44c0-8725-bc9832172d1b-kube-api-access-zcjc5\") pod \"multus-hfwr4\" (UID: \"93db881a-91b4-44c0-8725-bc9832172d1b\") " pod="openshift-multus/multus-hfwr4"
Sep 20 00:47:47.367940 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.367553    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5453e2eb-f239-4ae0-a01e-f8e78bac3e5e-registration-dir\") pod \"aws-ebs-csi-driver-node-bcxxk\" (UID: \"5453e2eb-f239-4ae0-a01e-f8e78bac3e5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxxk"
Sep 20 00:47:47.367940 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.367575    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5453e2eb-f239-4ae0-a01e-f8e78bac3e5e-device-dir\") pod \"aws-ebs-csi-driver-node-bcxxk\" (UID: \"5453e2eb-f239-4ae0-a01e-f8e78bac3e5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxxk"
Sep 20 00:47:47.367940 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.367596    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/95b69c15-6fcc-4109-bbe1-c34043671a6a-etc-systemd\") pod \"tuned-wdqj2\" (UID: \"95b69c15-6fcc-4109-bbe1-c34043671a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wdqj2"
Sep 20 00:47:47.367940 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.367611    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93db881a-91b4-44c0-8725-bc9832172d1b-system-cni-dir\") pod \"multus-hfwr4\" (UID: \"93db881a-91b4-44c0-8725-bc9832172d1b\") " pod="openshift-multus/multus-hfwr4"
Sep 20 00:47:47.367940 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.367653    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a588c630-f4a9-49b7-9ff1-1386742f40e3-dbus\") pod \"global-pull-secret-syncer-9mws2\" (UID: \"a588c630-f4a9-49b7-9ff1-1386742f40e3\") " pod="kube-system/global-pull-secret-syncer-9mws2"
Sep 20 00:47:47.367940 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.367669    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tw8w\" (UniqueName: \"kubernetes.io/projected/0922c703-f848-4c79-9355-82285e120a06-kube-api-access-9tw8w\") pod \"multus-additional-cni-plugins-ghfbt\" (UID: \"0922c703-f848-4c79-9355-82285e120a06\") " pod="openshift-multus/multus-additional-cni-plugins-ghfbt"
Sep 20 00:47:47.367940 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.367683    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95b69c15-6fcc-4109-bbe1-c34043671a6a-tmp\") pod \"tuned-wdqj2\" (UID: \"95b69c15-6fcc-4109-bbe1-c34043671a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wdqj2"
Sep 20 00:47:47.367940 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.367707    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e543f7c5-f70d-49ab-877a-2ff1cf7d30c3-serviceca\") pod \"node-ca-5f7zt\" (UID: \"e543f7c5-f70d-49ab-877a-2ff1cf7d30c3\") " pod="openshift-image-registry/node-ca-5f7zt"
Sep 20 00:47:47.367940 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.367723    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-log-socket\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.367940 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.367739    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/93db881a-91b4-44c0-8725-bc9832172d1b-host-var-lib-cni-multus\") pod \"multus-hfwr4\" (UID: \"93db881a-91b4-44c0-8725-bc9832172d1b\") " pod="openshift-multus/multus-hfwr4"
Sep 20 00:47:47.368712 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.367754    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93db881a-91b4-44c0-8725-bc9832172d1b-host-var-lib-kubelet\") pod \"multus-hfwr4\" (UID: \"93db881a-91b4-44c0-8725-bc9832172d1b\") " pod="openshift-multus/multus-hfwr4"
Sep 20 00:47:47.368712 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.367767    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5453e2eb-f239-4ae0-a01e-f8e78bac3e5e-socket-dir\") pod \"aws-ebs-csi-driver-node-bcxxk\" (UID: \"5453e2eb-f239-4ae0-a01e-f8e78bac3e5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxxk"
Sep 20 00:47:47.368712 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.367781    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fp26r\" (UniqueName: \"kubernetes.io/projected/a6a07188-d164-4385-8a38-35289b53a7be-kube-api-access-fp26r\") pod \"node-resolver-7zwqs\" (UID: \"a6a07188-d164-4385-8a38-35289b53a7be\") " pod="openshift-dns/node-resolver-7zwqs"
Sep 20 00:47:47.368712 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.367795    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5hsb\" (UniqueName: \"kubernetes.io/projected/e0167375-aa59-43a4-a5ba-e0b165da8b30-kube-api-access-l5hsb\") pod \"network-check-target-t6qv8\" (UID: \"e0167375-aa59-43a4-a5ba-e0b165da8b30\") " pod="openshift-network-diagnostics/network-check-target-t6qv8"
Sep 20 00:47:47.368712 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.367817    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-ovnkube-config\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.368712 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.367832    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/93db881a-91b4-44c0-8725-bc9832172d1b-host-var-lib-cni-bin\") pod \"multus-hfwr4\" (UID: \"93db881a-91b4-44c0-8725-bc9832172d1b\") " pod="openshift-multus/multus-hfwr4"
Sep 20 00:47:47.368712 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.367855    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5cf64fad-2d77-43e8-a13d-fb2758010192-agent-certs\") pod \"konnectivity-agent-sd6xd\" (UID: \"5cf64fad-2d77-43e8-a13d-fb2758010192\") " pod="kube-system/konnectivity-agent-sd6xd"
Sep 20 00:47:47.368712 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.367914    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a588c630-f4a9-49b7-9ff1-1386742f40e3-kubelet-config\") pod \"global-pull-secret-syncer-9mws2\" (UID: \"a588c630-f4a9-49b7-9ff1-1386742f40e3\") " pod="kube-system/global-pull-secret-syncer-9mws2"
Sep 20 00:47:47.368712 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.367929    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0d1f872-b92c-4b72-bdee-a7ac18493d84-metrics-certs\") pod \"network-metrics-daemon-94nzn\" (UID: \"a0d1f872-b92c-4b72-bdee-a7ac18493d84\") " pod="openshift-multus/network-metrics-daemon-94nzn"
Sep 20 00:47:47.368712 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.367943    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95b69c15-6fcc-4109-bbe1-c34043671a6a-etc-kubernetes\") pod \"tuned-wdqj2\" (UID: \"95b69c15-6fcc-4109-bbe1-c34043671a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wdqj2"
Sep 20 00:47:47.368712 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.367956    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/95b69c15-6fcc-4109-bbe1-c34043671a6a-run\") pod \"tuned-wdqj2\" (UID: \"95b69c15-6fcc-4109-bbe1-c34043671a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wdqj2"
Sep 20 00:47:47.368712 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.367980    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-ovnkube-script-lib\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.368712 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.367996    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-etc-openvswitch\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.368712 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.368012    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.368712 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.368022    2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 20 00:47:47.368712 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.368028    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/93db881a-91b4-44c0-8725-bc9832172d1b-multus-socket-dir-parent\") pod \"multus-hfwr4\" (UID: \"93db881a-91b4-44c0-8725-bc9832172d1b\") " pod="openshift-multus/multus-hfwr4"
Sep 20 00:47:47.368712 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.368182    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a6a07188-d164-4385-8a38-35289b53a7be-hosts-file\") pod \"node-resolver-7zwqs\" (UID: \"a6a07188-d164-4385-8a38-35289b53a7be\") " pod="openshift-dns/node-resolver-7zwqs"
Sep 20 00:47:47.369565 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.368198    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/95b69c15-6fcc-4109-bbe1-c34043671a6a-etc-sysctl-d\") pod \"tuned-wdqj2\" (UID: \"95b69c15-6fcc-4109-bbe1-c34043671a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wdqj2"
Sep 20 00:47:47.369565 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.368211    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/95b69c15-6fcc-4109-bbe1-c34043671a6a-host\") pod \"tuned-wdqj2\" (UID: \"95b69c15-6fcc-4109-bbe1-c34043671a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wdqj2"
Sep 20 00:47:47.369565 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.368225    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdnq5\" (UniqueName: \"kubernetes.io/projected/95b69c15-6fcc-4109-bbe1-c34043671a6a-kube-api-access-fdnq5\") pod \"tuned-wdqj2\" (UID: \"95b69c15-6fcc-4109-bbe1-c34043671a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wdqj2"
Sep 20 00:47:47.369565 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.368238    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-var-lib-openvswitch\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.369565 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.368262    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/93db881a-91b4-44c0-8725-bc9832172d1b-host-run-k8s-cni-cncf-io\") pod \"multus-hfwr4\" (UID: \"93db881a-91b4-44c0-8725-bc9832172d1b\") " pod="openshift-multus/multus-hfwr4"
Sep 20 00:47:47.369565 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.368280    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/93db881a-91b4-44c0-8725-bc9832172d1b-hostroot\") pod \"multus-hfwr4\" (UID: \"93db881a-91b4-44c0-8725-bc9832172d1b\") " pod="openshift-multus/multus-hfwr4"
Sep 20 00:47:47.369565 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.368294    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5453e2eb-f239-4ae0-a01e-f8e78bac3e5e-sys-fs\") pod \"aws-ebs-csi-driver-node-bcxxk\" (UID: \"5453e2eb-f239-4ae0-a01e-f8e78bac3e5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxxk"
Sep 20 00:47:47.369565 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.368307    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0922c703-f848-4c79-9355-82285e120a06-cni-binary-copy\") pod \"multus-additional-cni-plugins-ghfbt\" (UID: \"0922c703-f848-4c79-9355-82285e120a06\") " pod="openshift-multus/multus-additional-cni-plugins-ghfbt"
Sep 20 00:47:47.369565 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.368341    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-968kc\" (UniqueName: \"kubernetes.io/projected/5453e2eb-f239-4ae0-a01e-f8e78bac3e5e-kube-api-access-968kc\") pod \"aws-ebs-csi-driver-node-bcxxk\" (UID: \"5453e2eb-f239-4ae0-a01e-f8e78bac3e5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxxk"
Sep 20 00:47:47.369565 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.368354    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/95b69c15-6fcc-4109-bbe1-c34043671a6a-var-lib-kubelet\") pod \"tuned-wdqj2\" (UID: \"95b69c15-6fcc-4109-bbe1-c34043671a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wdqj2"
Sep 20 00:47:47.369565 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.368374    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2n4k\" (UniqueName: \"kubernetes.io/projected/e543f7c5-f70d-49ab-877a-2ff1cf7d30c3-kube-api-access-q2n4k\") pod \"node-ca-5f7zt\" (UID: \"e543f7c5-f70d-49ab-877a-2ff1cf7d30c3\") " pod="openshift-image-registry/node-ca-5f7zt"
Sep 20 00:47:47.369565 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.368397    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-ovn-node-metrics-cert\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.369565 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.368419    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a588c630-f4a9-49b7-9ff1-1386742f40e3-original-pull-secret\") pod \"global-pull-secret-syncer-9mws2\" (UID: \"a588c630-f4a9-49b7-9ff1-1386742f40e3\") " pod="kube-system/global-pull-secret-syncer-9mws2"
Sep 20 00:47:47.369565 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.368442    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/95b69c15-6fcc-4109-bbe1-c34043671a6a-etc-sysconfig\") pod \"tuned-wdqj2\" (UID: \"95b69c15-6fcc-4109-bbe1-c34043671a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wdqj2"
Sep 20 00:47:47.392943 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.392920    2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-v8gth"
Sep 20 00:47:47.402603 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.402586    2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-v8gth"
Sep 20 00:47:47.453736 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.453676    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-108.ec2.internal" event={"ID":"cf200e0815bd4d9afec83c9f28df3bc2","Type":"ContainerStarted","Data":"8beb14266f92bd795ba10ed3f480cbef52408504045c68f416b9c5f9ce41e0f3"}
Sep 20 00:47:47.455692 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.455670    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-108.ec2.internal" event={"ID":"1556c8746d3b9e131e1e9b890fd41c30","Type":"ContainerStarted","Data":"a1e0ed264d0f4ad3ec35508e97304a3b0c18c0fe9b7165e8a1a93b068a6cd4fe"}
Sep 20 00:47:47.470806 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.468677    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/95b69c15-6fcc-4109-bbe1-c34043671a6a-etc-tuned\") pod \"tuned-wdqj2\" (UID: \"95b69c15-6fcc-4109-bbe1-c34043671a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wdqj2"
Sep 20 00:47:47.470806 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.468714    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e543f7c5-f70d-49ab-877a-2ff1cf7d30c3-host\") pod \"node-ca-5f7zt\" (UID: \"e543f7c5-f70d-49ab-877a-2ff1cf7d30c3\") " pod="openshift-image-registry/node-ca-5f7zt"
Sep 20 00:47:47.470806 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.468735    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-host-slash\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.470806 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.468773    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-host-slash\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.470806 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.468815    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e543f7c5-f70d-49ab-877a-2ff1cf7d30c3-host\") pod \"node-ca-5f7zt\" (UID: \"e543f7c5-f70d-49ab-877a-2ff1cf7d30c3\") " pod="openshift-image-registry/node-ca-5f7zt"
Sep 20 00:47:47.470806 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.468841    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/93db881a-91b4-44c0-8725-bc9832172d1b-host-run-multus-certs\") pod \"multus-hfwr4\" (UID: \"93db881a-91b4-44c0-8725-bc9832172d1b\") " pod="openshift-multus/multus-hfwr4"
Sep 20 00:47:47.470806 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.468876    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0922c703-f848-4c79-9355-82285e120a06-system-cni-dir\") pod \"multus-additional-cni-plugins-ghfbt\" (UID: \"0922c703-f848-4c79-9355-82285e120a06\") " pod="openshift-multus/multus-additional-cni-plugins-ghfbt"
Sep 20 00:47:47.470806 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.468901    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0922c703-f848-4c79-9355-82285e120a06-cnibin\") pod \"multus-additional-cni-plugins-ghfbt\" (UID: \"0922c703-f848-4c79-9355-82285e120a06\") " pod="openshift-multus/multus-additional-cni-plugins-ghfbt"
Sep 20 00:47:47.470806 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.468916    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/95b69c15-6fcc-4109-bbe1-c34043671a6a-lib-modules\") pod \"tuned-wdqj2\" (UID: \"95b69c15-6fcc-4109-bbe1-c34043671a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wdqj2"
Sep 20 00:47:47.470806 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.468929    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93db881a-91b4-44c0-8725-bc9832172d1b-multus-cni-dir\") pod \"multus-hfwr4\" (UID: \"93db881a-91b4-44c0-8725-bc9832172d1b\") " pod="openshift-multus/multus-hfwr4"
Sep 20 00:47:47.470806 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.468943    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-systemd-units\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.470806 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.468959    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcjc5\" (UniqueName: \"kubernetes.io/projected/93db881a-91b4-44c0-8725-bc9832172d1b-kube-api-access-zcjc5\") pod \"multus-hfwr4\" (UID: \"93db881a-91b4-44c0-8725-bc9832172d1b\") " pod="openshift-multus/multus-hfwr4"
Sep 20 00:47:47.470806 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.468983    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5453e2eb-f239-4ae0-a01e-f8e78bac3e5e-registration-dir\") pod \"aws-ebs-csi-driver-node-bcxxk\" (UID: \"5453e2eb-f239-4ae0-a01e-f8e78bac3e5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxxk"
Sep 20 00:47:47.470806 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.469006    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5453e2eb-f239-4ae0-a01e-f8e78bac3e5e-device-dir\") pod \"aws-ebs-csi-driver-node-bcxxk\" (UID: \"5453e2eb-f239-4ae0-a01e-f8e78bac3e5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxxk"
Sep 20 00:47:47.470806 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.469020    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/95b69c15-6fcc-4109-bbe1-c34043671a6a-etc-systemd\") pod \"tuned-wdqj2\" (UID: \"95b69c15-6fcc-4109-bbe1-c34043671a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wdqj2"
Sep 20 00:47:47.470806 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.469032    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93db881a-91b4-44c0-8725-bc9832172d1b-system-cni-dir\") pod \"multus-hfwr4\" (UID: \"93db881a-91b4-44c0-8725-bc9832172d1b\") " pod="openshift-multus/multus-hfwr4"
Sep 20 00:47:47.470806 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.469050    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a588c630-f4a9-49b7-9ff1-1386742f40e3-dbus\") pod \"global-pull-secret-syncer-9mws2\" (UID: \"a588c630-f4a9-49b7-9ff1-1386742f40e3\") " pod="kube-system/global-pull-secret-syncer-9mws2"
Sep 20 00:47:47.471719 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.469063    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tw8w\" (UniqueName: \"kubernetes.io/projected/0922c703-f848-4c79-9355-82285e120a06-kube-api-access-9tw8w\") pod \"multus-additional-cni-plugins-ghfbt\" (UID: \"0922c703-f848-4c79-9355-82285e120a06\") " pod="openshift-multus/multus-additional-cni-plugins-ghfbt"
Sep 20 00:47:47.471719 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.469078    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95b69c15-6fcc-4109-bbe1-c34043671a6a-tmp\") pod \"tuned-wdqj2\" (UID: \"95b69c15-6fcc-4109-bbe1-c34043671a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wdqj2"
Sep 20 00:47:47.471719 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.469091    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e543f7c5-f70d-49ab-877a-2ff1cf7d30c3-serviceca\") pod \"node-ca-5f7zt\" (UID: \"e543f7c5-f70d-49ab-877a-2ff1cf7d30c3\") " pod="openshift-image-registry/node-ca-5f7zt"
Sep 20 00:47:47.471719 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.469107    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-log-socket\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.471719 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.469119    2570 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 20 00:47:47.471719 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.469130    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/93db881a-91b4-44c0-8725-bc9832172d1b-host-var-lib-cni-multus\") pod \"multus-hfwr4\" (UID: \"93db881a-91b4-44c0-8725-bc9832172d1b\") " pod="openshift-multus/multus-hfwr4"
Sep 20 00:47:47.471719 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.469150    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93db881a-91b4-44c0-8725-bc9832172d1b-host-var-lib-kubelet\") pod \"multus-hfwr4\" (UID: \"93db881a-91b4-44c0-8725-bc9832172d1b\") " pod="openshift-multus/multus-hfwr4"
Sep 20 00:47:47.471719 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.469166    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5453e2eb-f239-4ae0-a01e-f8e78bac3e5e-socket-dir\") pod \"aws-ebs-csi-driver-node-bcxxk\" (UID: \"5453e2eb-f239-4ae0-a01e-f8e78bac3e5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxxk"
Sep 20 00:47:47.471719 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.469181    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fp26r\" (UniqueName: \"kubernetes.io/projected/a6a07188-d164-4385-8a38-35289b53a7be-kube-api-access-fp26r\") pod \"node-resolver-7zwqs\" (UID: \"a6a07188-d164-4385-8a38-35289b53a7be\") " pod="openshift-dns/node-resolver-7zwqs"
Sep 20 00:47:47.471719 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.469197    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5hsb\" (UniqueName: \"kubernetes.io/projected/e0167375-aa59-43a4-a5ba-e0b165da8b30-kube-api-access-l5hsb\") pod \"network-check-target-t6qv8\" (UID: \"e0167375-aa59-43a4-a5ba-e0b165da8b30\") " pod="openshift-network-diagnostics/network-check-target-t6qv8"
Sep 20 00:47:47.471719 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.469226    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-ovnkube-config\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.471719 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.469250    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/93db881a-91b4-44c0-8725-bc9832172d1b-host-var-lib-cni-bin\") pod \"multus-hfwr4\" (UID: \"93db881a-91b4-44c0-8725-bc9832172d1b\") " pod="openshift-multus/multus-hfwr4"
Sep 20 00:47:47.471719 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.469267    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5cf64fad-2d77-43e8-a13d-fb2758010192-agent-certs\") pod \"konnectivity-agent-sd6xd\" (UID: \"5cf64fad-2d77-43e8-a13d-fb2758010192\") " pod="kube-system/konnectivity-agent-sd6xd"
Sep 20 00:47:47.471719 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.469284    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a588c630-f4a9-49b7-9ff1-1386742f40e3-kubelet-config\") pod \"global-pull-secret-syncer-9mws2\" (UID: \"a588c630-f4a9-49b7-9ff1-1386742f40e3\") " pod="kube-system/global-pull-secret-syncer-9mws2"
Sep 20 00:47:47.471719 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.469323    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0d1f872-b92c-4b72-bdee-a7ac18493d84-metrics-certs\") pod \"network-metrics-daemon-94nzn\" (UID: \"a0d1f872-b92c-4b72-bdee-a7ac18493d84\") " pod="openshift-multus/network-metrics-daemon-94nzn"
Sep 20 00:47:47.471719 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.469346    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95b69c15-6fcc-4109-bbe1-c34043671a6a-etc-kubernetes\") pod \"tuned-wdqj2\" (UID: \"95b69c15-6fcc-4109-bbe1-c34043671a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wdqj2"
Sep 20 00:47:47.471719 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.469381    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/95b69c15-6fcc-4109-bbe1-c34043671a6a-run\") pod \"tuned-wdqj2\" (UID: \"95b69c15-6fcc-4109-bbe1-c34043671a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wdqj2"
Sep 20 00:47:47.471719 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.469405    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-ovnkube-script-lib\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.472566 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.469424    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-etc-openvswitch\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.472566 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.469447    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.472566 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.469490    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/93db881a-91b4-44c0-8725-bc9832172d1b-multus-socket-dir-parent\") pod \"multus-hfwr4\" (UID: \"93db881a-91b4-44c0-8725-bc9832172d1b\") " pod="openshift-multus/multus-hfwr4"
Sep 20 00:47:47.472566 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.469493    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5453e2eb-f239-4ae0-a01e-f8e78bac3e5e-registration-dir\") pod \"aws-ebs-csi-driver-node-bcxxk\" (UID: \"5453e2eb-f239-4ae0-a01e-f8e78bac3e5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxxk"
Sep 20 00:47:47.472566 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.469515    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a6a07188-d164-4385-8a38-35289b53a7be-hosts-file\") pod \"node-resolver-7zwqs\" (UID: \"a6a07188-d164-4385-8a38-35289b53a7be\") " pod="openshift-dns/node-resolver-7zwqs"
Sep 20 00:47:47.472566 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.469516    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0922c703-f848-4c79-9355-82285e120a06-cnibin\") pod \"multus-additional-cni-plugins-ghfbt\" (UID: \"0922c703-f848-4c79-9355-82285e120a06\") " pod="openshift-multus/multus-additional-cni-plugins-ghfbt"
Sep 20 00:47:47.472566 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.469551    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/95b69c15-6fcc-4109-bbe1-c34043671a6a-etc-sysctl-d\") pod \"tuned-wdqj2\" (UID: \"95b69c15-6fcc-4109-bbe1-c34043671a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wdqj2"
Sep 20 00:47:47.472566 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.469580    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/95b69c15-6fcc-4109-bbe1-c34043671a6a-host\") pod \"tuned-wdqj2\" (UID: \"95b69c15-6fcc-4109-bbe1-c34043671a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wdqj2"
Sep 20 00:47:47.472566 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.469608    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdnq5\" (UniqueName: \"kubernetes.io/projected/95b69c15-6fcc-4109-bbe1-c34043671a6a-kube-api-access-fdnq5\") pod \"tuned-wdqj2\" (UID: \"95b69c15-6fcc-4109-bbe1-c34043671a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wdqj2"
Sep 20 00:47:47.472566 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.469634    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-var-lib-openvswitch\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.472566 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.469579    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a6a07188-d164-4385-8a38-35289b53a7be-hosts-file\") pod \"node-resolver-7zwqs\" (UID: \"a6a07188-d164-4385-8a38-35289b53a7be\") " pod="openshift-dns/node-resolver-7zwqs"
Sep 20 00:47:47.472566 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.469671    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/93db881a-91b4-44c0-8725-bc9832172d1b-host-run-k8s-cni-cncf-io\") pod \"multus-hfwr4\" (UID: \"93db881a-91b4-44c0-8725-bc9832172d1b\") " pod="openshift-multus/multus-hfwr4"
Sep 20 00:47:47.472566 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.469692    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/93db881a-91b4-44c0-8725-bc9832172d1b-hostroot\") pod \"multus-hfwr4\" (UID: \"93db881a-91b4-44c0-8725-bc9832172d1b\") " pod="openshift-multus/multus-hfwr4"
Sep 20 00:47:47.472566 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.469702    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-systemd-units\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.472566 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.469710    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5453e2eb-f239-4ae0-a01e-f8e78bac3e5e-sys-fs\") pod \"aws-ebs-csi-driver-node-bcxxk\" (UID: \"5453e2eb-f239-4ae0-a01e-f8e78bac3e5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxxk"
Sep 20 00:47:47.472566 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.469703    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/93db881a-91b4-44c0-8725-bc9832172d1b-host-var-lib-cni-bin\") pod \"multus-hfwr4\" (UID: \"93db881a-91b4-44c0-8725-bc9832172d1b\") " pod="openshift-multus/multus-hfwr4"
Sep 20 00:47:47.472566 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.469746    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0922c703-f848-4c79-9355-82285e120a06-cni-binary-copy\") pod \"multus-additional-cni-plugins-ghfbt\" (UID: \"0922c703-f848-4c79-9355-82285e120a06\") " pod="openshift-multus/multus-additional-cni-plugins-ghfbt"
Sep 20 00:47:47.473227 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.469766    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a588c630-f4a9-49b7-9ff1-1386742f40e3-dbus\") pod \"global-pull-secret-syncer-9mws2\" (UID: \"a588c630-f4a9-49b7-9ff1-1386742f40e3\") " pod="kube-system/global-pull-secret-syncer-9mws2"
Sep 20 00:47:47.473227 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.469777    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-968kc\" (UniqueName: \"kubernetes.io/projected/5453e2eb-f239-4ae0-a01e-f8e78bac3e5e-kube-api-access-968kc\") pod \"aws-ebs-csi-driver-node-bcxxk\" (UID: \"5453e2eb-f239-4ae0-a01e-f8e78bac3e5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxxk"
Sep 20 00:47:47.473227 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:47.469786    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 00:47:47.473227 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.469803    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/95b69c15-6fcc-4109-bbe1-c34043671a6a-var-lib-kubelet\") pod \"tuned-wdqj2\" (UID: \"95b69c15-6fcc-4109-bbe1-c34043671a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wdqj2"
Sep 20 00:47:47.473227 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.469830    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2n4k\" (UniqueName: \"kubernetes.io/projected/e543f7c5-f70d-49ab-877a-2ff1cf7d30c3-kube-api-access-q2n4k\") pod \"node-ca-5f7zt\" (UID: \"e543f7c5-f70d-49ab-877a-2ff1cf7d30c3\") " pod="openshift-image-registry/node-ca-5f7zt"
Sep 20 00:47:47.473227 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:47.469884    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0d1f872-b92c-4b72-bdee-a7ac18493d84-metrics-certs podName:a0d1f872-b92c-4b72-bdee-a7ac18493d84 nodeName:}" failed. No retries permitted until 2026-09-20 00:47:47.969839852 +0000 UTC m=+4.583995747 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a0d1f872-b92c-4b72-bdee-a7ac18493d84-metrics-certs") pod "network-metrics-daemon-94nzn" (UID: "a0d1f872-b92c-4b72-bdee-a7ac18493d84") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 00:47:47.473227 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.469914    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-ovn-node-metrics-cert\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.473227 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.469938    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a588c630-f4a9-49b7-9ff1-1386742f40e3-original-pull-secret\") pod \"global-pull-secret-syncer-9mws2\" (UID: \"a588c630-f4a9-49b7-9ff1-1386742f40e3\") " pod="kube-system/global-pull-secret-syncer-9mws2"
Sep 20 00:47:47.473227 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.469960    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/95b69c15-6fcc-4109-bbe1-c34043671a6a-etc-sysconfig\") pod \"tuned-wdqj2\" (UID: \"95b69c15-6fcc-4109-bbe1-c34043671a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wdqj2"
Sep 20 00:47:47.473227 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.469981    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dk9dt\" (UniqueName: \"kubernetes.io/projected/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-kube-api-access-dk9dt\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.473227 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.470001    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-host-run-netns\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.473227 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.469999    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5453e2eb-f239-4ae0-a01e-f8e78bac3e5e-socket-dir\") pod \"aws-ebs-csi-driver-node-bcxxk\" (UID: \"5453e2eb-f239-4ae0-a01e-f8e78bac3e5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxxk"
Sep 20 00:47:47.473227 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.470020    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-run-openvswitch\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.473227 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.470044    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-node-log\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.473227 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.470064    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/93db881a-91b4-44c0-8725-bc9832172d1b-host-var-lib-cni-multus\") pod \"multus-hfwr4\" (UID: \"93db881a-91b4-44c0-8725-bc9832172d1b\") " pod="openshift-multus/multus-hfwr4"
Sep 20 00:47:47.473227 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.470065    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0922c703-f848-4c79-9355-82285e120a06-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ghfbt\" (UID: \"0922c703-f848-4c79-9355-82285e120a06\") " pod="openshift-multus/multus-additional-cni-plugins-ghfbt"
Sep 20 00:47:47.473227 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.470078    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/93db881a-91b4-44c0-8725-bc9832172d1b-host-run-multus-certs\") pod \"multus-hfwr4\" (UID: \"93db881a-91b4-44c0-8725-bc9832172d1b\") " pod="openshift-multus/multus-hfwr4"
Sep 20 00:47:47.473873 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.470105    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqlf5\" (UniqueName: \"kubernetes.io/projected/a0d1f872-b92c-4b72-bdee-a7ac18493d84-kube-api-access-gqlf5\") pod \"network-metrics-daemon-94nzn\" (UID: \"a0d1f872-b92c-4b72-bdee-a7ac18493d84\") " pod="openshift-multus/network-metrics-daemon-94nzn"
Sep 20 00:47:47.473873 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.470111    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e543f7c5-f70d-49ab-877a-2ff1cf7d30c3-serviceca\") pod \"node-ca-5f7zt\" (UID: \"e543f7c5-f70d-49ab-877a-2ff1cf7d30c3\") " pod="openshift-image-registry/node-ca-5f7zt"
Sep 20 00:47:47.473873 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.470108    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-ovnkube-config\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.473873 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.470122    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0922c703-f848-4c79-9355-82285e120a06-system-cni-dir\") pod \"multus-additional-cni-plugins-ghfbt\" (UID: \"0922c703-f848-4c79-9355-82285e120a06\") " pod="openshift-multus/multus-additional-cni-plugins-ghfbt"
Sep 20 00:47:47.473873 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.470160    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5453e2eb-f239-4ae0-a01e-f8e78bac3e5e-sys-fs\") pod \"aws-ebs-csi-driver-node-bcxxk\" (UID: \"5453e2eb-f239-4ae0-a01e-f8e78bac3e5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxxk"
Sep 20 00:47:47.473873 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.470196    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a588c630-f4a9-49b7-9ff1-1386742f40e3-kubelet-config\") pod \"global-pull-secret-syncer-9mws2\" (UID: \"a588c630-f4a9-49b7-9ff1-1386742f40e3\") " pod="kube-system/global-pull-secret-syncer-9mws2"
Sep 20 00:47:47.473873 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.470227    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/95b69c15-6fcc-4109-bbe1-c34043671a6a-lib-modules\") pod \"tuned-wdqj2\" (UID: \"95b69c15-6fcc-4109-bbe1-c34043671a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wdqj2"
Sep 20 00:47:47.473873 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.470272    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/93db881a-91b4-44c0-8725-bc9832172d1b-multus-socket-dir-parent\") pod \"multus-hfwr4\" (UID: \"93db881a-91b4-44c0-8725-bc9832172d1b\") " pod="openshift-multus/multus-hfwr4"
Sep 20 00:47:47.473873 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.470281    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5453e2eb-f239-4ae0-a01e-f8e78bac3e5e-device-dir\") pod \"aws-ebs-csi-driver-node-bcxxk\" (UID: \"5453e2eb-f239-4ae0-a01e-f8e78bac3e5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxxk"
Sep 20 00:47:47.473873 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.469653    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93db881a-91b4-44c0-8725-bc9832172d1b-multus-cni-dir\") pod \"multus-hfwr4\" (UID: \"93db881a-91b4-44c0-8725-bc9832172d1b\") " pod="openshift-multus/multus-hfwr4"
Sep 20 00:47:47.473873 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.470366    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93db881a-91b4-44c0-8725-bc9832172d1b-system-cni-dir\") pod \"multus-hfwr4\" (UID: \"93db881a-91b4-44c0-8725-bc9832172d1b\") " pod="openshift-multus/multus-hfwr4"
Sep 20 00:47:47.473873 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.470400    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/95b69c15-6fcc-4109-bbe1-c34043671a6a-etc-sysctl-d\") pod \"tuned-wdqj2\" (UID: \"95b69c15-6fcc-4109-bbe1-c34043671a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wdqj2"
Sep 20 00:47:47.473873 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.470406    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/95b69c15-6fcc-4109-bbe1-c34043671a6a-etc-systemd\") pod \"tuned-wdqj2\" (UID: \"95b69c15-6fcc-4109-bbe1-c34043671a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wdqj2"
Sep 20 00:47:47.473873 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:47.470472    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 20 00:47:47.473873 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:47.470527    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a588c630-f4a9-49b7-9ff1-1386742f40e3-original-pull-secret podName:a588c630-f4a9-49b7-9ff1-1386742f40e3 nodeName:}" failed. No retries permitted until 2026-09-20 00:47:47.970511814 +0000 UTC m=+4.584667710 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a588c630-f4a9-49b7-9ff1-1386742f40e3-original-pull-secret") pod "global-pull-secret-syncer-9mws2" (UID: "a588c630-f4a9-49b7-9ff1-1386742f40e3") : object "kube-system"/"original-pull-secret" not registered
Sep 20 00:47:47.473873 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.470536    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0922c703-f848-4c79-9355-82285e120a06-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ghfbt\" (UID: \"0922c703-f848-4c79-9355-82285e120a06\") " pod="openshift-multus/multus-additional-cni-plugins-ghfbt"
Sep 20 00:47:47.473873 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.470568    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95b69c15-6fcc-4109-bbe1-c34043671a6a-etc-kubernetes\") pod \"tuned-wdqj2\" (UID: \"95b69c15-6fcc-4109-bbe1-c34043671a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wdqj2"
Sep 20 00:47:47.474617 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.470581    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/95b69c15-6fcc-4109-bbe1-c34043671a6a-var-lib-kubelet\") pod \"tuned-wdqj2\" (UID: \"95b69c15-6fcc-4109-bbe1-c34043671a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wdqj2"
Sep 20 00:47:47.474617 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.470595    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/95b69c15-6fcc-4109-bbe1-c34043671a6a-etc-sysconfig\") pod \"tuned-wdqj2\" (UID: \"95b69c15-6fcc-4109-bbe1-c34043671a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wdqj2"
Sep 20 00:47:47.474617 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.470597    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-host-run-netns\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.474617 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.470620    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/95b69c15-6fcc-4109-bbe1-c34043671a6a-host\") pod \"tuned-wdqj2\" (UID: \"95b69c15-6fcc-4109-bbe1-c34043671a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wdqj2"
Sep 20 00:47:47.474617 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.470638    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-run-openvswitch\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.474617 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.470646    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-etc-openvswitch\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.474617 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.470678    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.474617 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.470694    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93db881a-91b4-44c0-8725-bc9832172d1b-host-var-lib-kubelet\") pod \"multus-hfwr4\" (UID: \"93db881a-91b4-44c0-8725-bc9832172d1b\") " pod="openshift-multus/multus-hfwr4"
Sep 20 00:47:47.474617 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.470719    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/95b69c15-6fcc-4109-bbe1-c34043671a6a-run\") pod \"tuned-wdqj2\" (UID: \"95b69c15-6fcc-4109-bbe1-c34043671a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wdqj2"
Sep 20 00:47:47.474617 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.470828    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/95b69c15-6fcc-4109-bbe1-c34043671a6a-etc-sysctl-conf\") pod \"tuned-wdqj2\" (UID: \"95b69c15-6fcc-4109-bbe1-c34043671a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wdqj2"
Sep 20 00:47:47.474617 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.470851    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-host-kubelet\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.474617 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.470893    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-run-ovn\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.474617 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.470908    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-env-overrides\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.474617 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.470922    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/93db881a-91b4-44c0-8725-bc9832172d1b-cnibin\") pod \"multus-hfwr4\" (UID: \"93db881a-91b4-44c0-8725-bc9832172d1b\") " pod="openshift-multus/multus-hfwr4"
Sep 20 00:47:47.474617 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.470944    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/93db881a-91b4-44c0-8725-bc9832172d1b-multus-daemon-config\") pod \"multus-hfwr4\" (UID: \"93db881a-91b4-44c0-8725-bc9832172d1b\") " pod="openshift-multus/multus-hfwr4"
Sep 20 00:47:47.474617 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.470968    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93db881a-91b4-44c0-8725-bc9832172d1b-etc-kubernetes\") pod \"multus-hfwr4\" (UID: \"93db881a-91b4-44c0-8725-bc9832172d1b\") " pod="openshift-multus/multus-hfwr4"
Sep 20 00:47:47.474617 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.471007    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6a07188-d164-4385-8a38-35289b53a7be-tmp-dir\") pod \"node-resolver-7zwqs\" (UID: \"a6a07188-d164-4385-8a38-35289b53a7be\") " pod="openshift-dns/node-resolver-7zwqs"
Sep 20 00:47:47.474617 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.471032    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/becc2877-6923-45c5-b169-5c211abd16dd-host-slash\") pod \"iptables-alerter-9mgf7\" (UID: \"becc2877-6923-45c5-b169-5c211abd16dd\") " pod="openshift-network-operator/iptables-alerter-9mgf7"
Sep 20 00:47:47.475227 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.471063    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/becc2877-6923-45c5-b169-5c211abd16dd-iptables-alerter-script\") pod \"iptables-alerter-9mgf7\" (UID: \"becc2877-6923-45c5-b169-5c211abd16dd\") " pod="openshift-network-operator/iptables-alerter-9mgf7"
Sep 20 00:47:47.475227 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.471081    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/93db881a-91b4-44c0-8725-bc9832172d1b-cnibin\") pod \"multus-hfwr4\" (UID: \"93db881a-91b4-44c0-8725-bc9832172d1b\") " pod="openshift-multus/multus-hfwr4"
Sep 20 00:47:47.475227 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.471087    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-452gw\" (UniqueName: \"kubernetes.io/projected/becc2877-6923-45c5-b169-5c211abd16dd-kube-api-access-452gw\") pod \"iptables-alerter-9mgf7\" (UID: \"becc2877-6923-45c5-b169-5c211abd16dd\") " pod="openshift-network-operator/iptables-alerter-9mgf7"
Sep 20 00:47:47.475227 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.471126    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0922c703-f848-4c79-9355-82285e120a06-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ghfbt\" (UID: \"0922c703-f848-4c79-9355-82285e120a06\") " pod="openshift-multus/multus-additional-cni-plugins-ghfbt"
Sep 20 00:47:47.475227 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.471153    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-ovnkube-script-lib\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.475227 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.471219    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95b69c15-6fcc-4109-bbe1-c34043671a6a-sys\") pod \"tuned-wdqj2\" (UID: \"95b69c15-6fcc-4109-bbe1-c34043671a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wdqj2"
Sep 20 00:47:47.475227 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.471270    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-var-lib-openvswitch\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.475227 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.471274    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/95b69c15-6fcc-4109-bbe1-c34043671a6a-etc-sysctl-conf\") pod \"tuned-wdqj2\" (UID: \"95b69c15-6fcc-4109-bbe1-c34043671a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wdqj2"
Sep 20 00:47:47.475227 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.471315    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-log-socket\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.475227 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.471351    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-node-log\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.475227 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.471387    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/93db881a-91b4-44c0-8725-bc9832172d1b-hostroot\") pod \"multus-hfwr4\" (UID: \"93db881a-91b4-44c0-8725-bc9832172d1b\") " pod="openshift-multus/multus-hfwr4"
Sep 20 00:47:47.475227 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.471156    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95b69c15-6fcc-4109-bbe1-c34043671a6a-sys\") pod \"tuned-wdqj2\" (UID: \"95b69c15-6fcc-4109-bbe1-c34043671a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wdqj2"
Sep 20 00:47:47.475227 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.471590    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-run-systemd\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.475227 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.471615    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/93db881a-91b4-44c0-8725-bc9832172d1b-cni-binary-copy\") pod \"multus-hfwr4\" (UID: \"93db881a-91b4-44c0-8725-bc9832172d1b\") " pod="openshift-multus/multus-hfwr4"
Sep 20 00:47:47.475227 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.471640    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/93db881a-91b4-44c0-8725-bc9832172d1b-multus-conf-dir\") pod \"multus-hfwr4\" (UID: \"93db881a-91b4-44c0-8725-bc9832172d1b\") " pod="openshift-multus/multus-hfwr4"
Sep 20 00:47:47.475227 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.471664    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5453e2eb-f239-4ae0-a01e-f8e78bac3e5e-etc-selinux\") pod \"aws-ebs-csi-driver-node-bcxxk\" (UID: \"5453e2eb-f239-4ae0-a01e-f8e78bac3e5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxxk"
Sep 20 00:47:47.475227 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.471688    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-host-run-ovn-kubernetes\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.475227 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.471702    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-env-overrides\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.475931 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.471713    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-host-cni-bin\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.475931 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.471736    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-host-cni-netd\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.475931 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.471762    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5cf64fad-2d77-43e8-a13d-fb2758010192-konnectivity-ca\") pod \"konnectivity-agent-sd6xd\" (UID: \"5cf64fad-2d77-43e8-a13d-fb2758010192\") " pod="kube-system/konnectivity-agent-sd6xd"
Sep 20 00:47:47.475931 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.471763    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0922c703-f848-4c79-9355-82285e120a06-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ghfbt\" (UID: \"0922c703-f848-4c79-9355-82285e120a06\") " pod="openshift-multus/multus-additional-cni-plugins-ghfbt"
Sep 20 00:47:47.475931 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.471785    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/95b69c15-6fcc-4109-bbe1-c34043671a6a-etc-modprobe-d\") pod \"tuned-wdqj2\" (UID: \"95b69c15-6fcc-4109-bbe1-c34043671a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wdqj2"
Sep 20 00:47:47.475931 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.471811    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/93db881a-91b4-44c0-8725-bc9832172d1b-host-run-netns\") pod \"multus-hfwr4\" (UID: \"93db881a-91b4-44c0-8725-bc9832172d1b\") " pod="openshift-multus/multus-hfwr4"
Sep 20 00:47:47.475931 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.471822    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-run-systemd\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.475931 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.471827    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/93db881a-91b4-44c0-8725-bc9832172d1b-multus-conf-dir\") pod \"multus-hfwr4\" (UID: \"93db881a-91b4-44c0-8725-bc9832172d1b\") " pod="openshift-multus/multus-hfwr4"
Sep 20 00:47:47.475931 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.471831    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5453e2eb-f239-4ae0-a01e-f8e78bac3e5e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bcxxk\" (UID: \"5453e2eb-f239-4ae0-a01e-f8e78bac3e5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxxk"
Sep 20 00:47:47.475931 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.471853    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0922c703-f848-4c79-9355-82285e120a06-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ghfbt\" (UID: \"0922c703-f848-4c79-9355-82285e120a06\") " pod="openshift-multus/multus-additional-cni-plugins-ghfbt"
Sep 20 00:47:47.475931 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.471886    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/93db881a-91b4-44c0-8725-bc9832172d1b-multus-daemon-config\") pod \"multus-hfwr4\" (UID: \"93db881a-91b4-44c0-8725-bc9832172d1b\") " pod="openshift-multus/multus-hfwr4"
Sep 20 00:47:47.475931 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.471958    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/becc2877-6923-45c5-b169-5c211abd16dd-host-slash\") pod \"iptables-alerter-9mgf7\" (UID: \"becc2877-6923-45c5-b169-5c211abd16dd\") " pod="openshift-network-operator/iptables-alerter-9mgf7"
Sep 20 00:47:47.475931 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.472059    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0922c703-f848-4c79-9355-82285e120a06-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ghfbt\" (UID: \"0922c703-f848-4c79-9355-82285e120a06\") " pod="openshift-multus/multus-additional-cni-plugins-ghfbt"
Sep 20 00:47:47.475931 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.472101    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-host-run-ovn-kubernetes\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.475931 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.472116    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6a07188-d164-4385-8a38-35289b53a7be-tmp-dir\") pod \"node-resolver-7zwqs\" (UID: \"a6a07188-d164-4385-8a38-35289b53a7be\") " pod="openshift-dns/node-resolver-7zwqs"
Sep 20 00:47:47.475931 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.472139    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-host-cni-bin\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.475931 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.472185    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/93db881a-91b4-44c0-8725-bc9832172d1b-host-run-k8s-cni-cncf-io\") pod \"multus-hfwr4\" (UID: \"93db881a-91b4-44c0-8725-bc9832172d1b\") " pod="openshift-multus/multus-hfwr4"
Sep 20 00:47:47.476613 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.472195    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93db881a-91b4-44c0-8725-bc9832172d1b-etc-kubernetes\") pod \"multus-hfwr4\" (UID: \"93db881a-91b4-44c0-8725-bc9832172d1b\") " pod="openshift-multus/multus-hfwr4"
Sep 20 00:47:47.476613 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.472225    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-host-kubelet\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.476613 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.472301    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5453e2eb-f239-4ae0-a01e-f8e78bac3e5e-etc-selinux\") pod \"aws-ebs-csi-driver-node-bcxxk\" (UID: \"5453e2eb-f239-4ae0-a01e-f8e78bac3e5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxxk"
Sep 20 00:47:47.476613 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.471785    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-run-ovn\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.476613 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.472344    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/93db881a-91b4-44c0-8725-bc9832172d1b-cni-binary-copy\") pod \"multus-hfwr4\" (UID: \"93db881a-91b4-44c0-8725-bc9832172d1b\") " pod="openshift-multus/multus-hfwr4"
Sep 20 00:47:47.476613 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.472446    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/95b69c15-6fcc-4109-bbe1-c34043671a6a-etc-modprobe-d\") pod \"tuned-wdqj2\" (UID: \"95b69c15-6fcc-4109-bbe1-c34043671a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wdqj2"
Sep 20 00:47:47.476613 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.472500    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5453e2eb-f239-4ae0-a01e-f8e78bac3e5e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bcxxk\" (UID: \"5453e2eb-f239-4ae0-a01e-f8e78bac3e5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxxk"
Sep 20 00:47:47.476613 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.472544    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/93db881a-91b4-44c0-8725-bc9832172d1b-host-run-netns\") pod \"multus-hfwr4\" (UID: \"93db881a-91b4-44c0-8725-bc9832172d1b\") " pod="openshift-multus/multus-hfwr4"
Sep 20 00:47:47.476613 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.472553    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/becc2877-6923-45c5-b169-5c211abd16dd-iptables-alerter-script\") pod \"iptables-alerter-9mgf7\" (UID: \"becc2877-6923-45c5-b169-5c211abd16dd\") " pod="openshift-network-operator/iptables-alerter-9mgf7"
Sep 20 00:47:47.476613 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.472576    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-host-cni-netd\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.476613 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.472676    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0922c703-f848-4c79-9355-82285e120a06-cni-binary-copy\") pod \"multus-additional-cni-plugins-ghfbt\" (UID: \"0922c703-f848-4c79-9355-82285e120a06\") " pod="openshift-multus/multus-additional-cni-plugins-ghfbt"
Sep 20 00:47:47.476613 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.472815    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5cf64fad-2d77-43e8-a13d-fb2758010192-konnectivity-ca\") pod \"konnectivity-agent-sd6xd\" (UID: \"5cf64fad-2d77-43e8-a13d-fb2758010192\") " pod="kube-system/konnectivity-agent-sd6xd"
Sep 20 00:47:47.476613 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.473273    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95b69c15-6fcc-4109-bbe1-c34043671a6a-tmp\") pod \"tuned-wdqj2\" (UID: \"95b69c15-6fcc-4109-bbe1-c34043671a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wdqj2"
Sep 20 00:47:47.476613 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.473481    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-ovn-node-metrics-cert\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.476613 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.473575    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/95b69c15-6fcc-4109-bbe1-c34043671a6a-etc-tuned\") pod \"tuned-wdqj2\" (UID: \"95b69c15-6fcc-4109-bbe1-c34043671a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wdqj2"
Sep 20 00:47:47.476613 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.475105    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5cf64fad-2d77-43e8-a13d-fb2758010192-agent-certs\") pod \"konnectivity-agent-sd6xd\" (UID: \"5cf64fad-2d77-43e8-a13d-fb2758010192\") " pod="kube-system/konnectivity-agent-sd6xd"
Sep 20 00:47:47.482357 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:47.482328    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 20 00:47:47.482357 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:47.482350    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 20 00:47:47.482357 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:47.482362    2570 projected.go:196] Error preparing data for projected volume kube-api-access-l5hsb for pod openshift-network-diagnostics/network-check-target-t6qv8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 20 00:47:47.482546 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:47.482421    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0167375-aa59-43a4-a5ba-e0b165da8b30-kube-api-access-l5hsb podName:e0167375-aa59-43a4-a5ba-e0b165da8b30 nodeName:}" failed. No retries permitted until 2026-09-20 00:47:47.982405438 +0000 UTC m=+4.596561315 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-l5hsb" (UniqueName: "kubernetes.io/projected/e0167375-aa59-43a4-a5ba-e0b165da8b30-kube-api-access-l5hsb") pod "network-check-target-t6qv8" (UID: "e0167375-aa59-43a4-a5ba-e0b165da8b30") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 20 00:47:47.485384 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.485357    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fp26r\" (UniqueName: \"kubernetes.io/projected/a6a07188-d164-4385-8a38-35289b53a7be-kube-api-access-fp26r\") pod \"node-resolver-7zwqs\" (UID: \"a6a07188-d164-4385-8a38-35289b53a7be\") " pod="openshift-dns/node-resolver-7zwqs"
Sep 20 00:47:47.485991 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.485968    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-968kc\" (UniqueName: \"kubernetes.io/projected/5453e2eb-f239-4ae0-a01e-f8e78bac3e5e-kube-api-access-968kc\") pod \"aws-ebs-csi-driver-node-bcxxk\" (UID: \"5453e2eb-f239-4ae0-a01e-f8e78bac3e5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxxk"
Sep 20 00:47:47.486224 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.486203    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-452gw\" (UniqueName: \"kubernetes.io/projected/becc2877-6923-45c5-b169-5c211abd16dd-kube-api-access-452gw\") pod \"iptables-alerter-9mgf7\" (UID: \"becc2877-6923-45c5-b169-5c211abd16dd\") " pod="openshift-network-operator/iptables-alerter-9mgf7"
Sep 20 00:47:47.486422 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.486401    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcjc5\" (UniqueName: \"kubernetes.io/projected/93db881a-91b4-44c0-8725-bc9832172d1b-kube-api-access-zcjc5\") pod \"multus-hfwr4\" (UID: \"93db881a-91b4-44c0-8725-bc9832172d1b\") " pod="openshift-multus/multus-hfwr4"
Sep 20 00:47:47.486509 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.486429    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdnq5\" (UniqueName: \"kubernetes.io/projected/95b69c15-6fcc-4109-bbe1-c34043671a6a-kube-api-access-fdnq5\") pod \"tuned-wdqj2\" (UID: \"95b69c15-6fcc-4109-bbe1-c34043671a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wdqj2"
Sep 20 00:47:47.486567 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.486535    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqlf5\" (UniqueName: \"kubernetes.io/projected/a0d1f872-b92c-4b72-bdee-a7ac18493d84-kube-api-access-gqlf5\") pod \"network-metrics-daemon-94nzn\" (UID: \"a0d1f872-b92c-4b72-bdee-a7ac18493d84\") " pod="openshift-multus/network-metrics-daemon-94nzn"
Sep 20 00:47:47.486725 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.486708    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tw8w\" (UniqueName: \"kubernetes.io/projected/0922c703-f848-4c79-9355-82285e120a06-kube-api-access-9tw8w\") pod \"multus-additional-cni-plugins-ghfbt\" (UID: \"0922c703-f848-4c79-9355-82285e120a06\") " pod="openshift-multus/multus-additional-cni-plugins-ghfbt"
Sep 20 00:47:47.488215 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.488192    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dk9dt\" (UniqueName: \"kubernetes.io/projected/bf898d8f-ed0f-4b4e-9a87-8e6167b29481-kube-api-access-dk9dt\") pod \"ovnkube-node-65l6f\" (UID: \"bf898d8f-ed0f-4b4e-9a87-8e6167b29481\") " pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.488662 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.488641    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2n4k\" (UniqueName: \"kubernetes.io/projected/e543f7c5-f70d-49ab-877a-2ff1cf7d30c3-kube-api-access-q2n4k\") pod \"node-ca-5f7zt\" (UID: \"e543f7c5-f70d-49ab-877a-2ff1cf7d30c3\") " pod="openshift-image-registry/node-ca-5f7zt"
Sep 20 00:47:47.629305 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.629263    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sd6xd"
Sep 20 00:47:47.637149 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.637092    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxxk"
Sep 20 00:47:47.646938 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.646917    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7zwqs"
Sep 20 00:47:47.653535 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.653518    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wdqj2"
Sep 20 00:47:47.660344 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.660326    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5f7zt"
Sep 20 00:47:47.667096 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.667060    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:47:47.682674 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.682655    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9mgf7"
Sep 20 00:47:47.691328 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.691311    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ghfbt"
Sep 20 00:47:47.698893 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.698872    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hfwr4"
Sep 20 00:47:47.716234 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.716212    2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 20 00:47:47.975718 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.975632    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0d1f872-b92c-4b72-bdee-a7ac18493d84-metrics-certs\") pod \"network-metrics-daemon-94nzn\" (UID: \"a0d1f872-b92c-4b72-bdee-a7ac18493d84\") " pod="openshift-multus/network-metrics-daemon-94nzn"
Sep 20 00:47:47.975718 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:47.975686    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a588c630-f4a9-49b7-9ff1-1386742f40e3-original-pull-secret\") pod \"global-pull-secret-syncer-9mws2\" (UID: \"a588c630-f4a9-49b7-9ff1-1386742f40e3\") " pod="kube-system/global-pull-secret-syncer-9mws2"
Sep 20 00:47:47.975962 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:47.975801    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 20 00:47:47.975962 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:47.975808    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 00:47:47.975962 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:47.975888    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a588c630-f4a9-49b7-9ff1-1386742f40e3-original-pull-secret podName:a588c630-f4a9-49b7-9ff1-1386742f40e3 nodeName:}" failed. No retries permitted until 2026-09-20 00:47:48.975849073 +0000 UTC m=+5.590004964 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a588c630-f4a9-49b7-9ff1-1386742f40e3-original-pull-secret") pod "global-pull-secret-syncer-9mws2" (UID: "a588c630-f4a9-49b7-9ff1-1386742f40e3") : object "kube-system"/"original-pull-secret" not registered
Sep 20 00:47:47.975962 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:47.975907    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0d1f872-b92c-4b72-bdee-a7ac18493d84-metrics-certs podName:a0d1f872-b92c-4b72-bdee-a7ac18493d84 nodeName:}" failed. No retries permitted until 2026-09-20 00:47:48.975897736 +0000 UTC m=+5.590053611 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a0d1f872-b92c-4b72-bdee-a7ac18493d84-metrics-certs") pod "network-metrics-daemon-94nzn" (UID: "a0d1f872-b92c-4b72-bdee-a7ac18493d84") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 00:47:48.076637 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:48.076590    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5hsb\" (UniqueName: \"kubernetes.io/projected/e0167375-aa59-43a4-a5ba-e0b165da8b30-kube-api-access-l5hsb\") pod \"network-check-target-t6qv8\" (UID: \"e0167375-aa59-43a4-a5ba-e0b165da8b30\") " pod="openshift-network-diagnostics/network-check-target-t6qv8"
Sep 20 00:47:48.076820 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:48.076719    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 20 00:47:48.076820 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:48.076733    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 20 00:47:48.076820 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:48.076742    2570 projected.go:196] Error preparing data for projected volume kube-api-access-l5hsb for pod openshift-network-diagnostics/network-check-target-t6qv8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 20 00:47:48.076820 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:48.076796    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0167375-aa59-43a4-a5ba-e0b165da8b30-kube-api-access-l5hsb podName:e0167375-aa59-43a4-a5ba-e0b165da8b30 nodeName:}" failed. No retries permitted until 2026-09-20 00:47:49.076779536 +0000 UTC m=+5.690935414 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-l5hsb" (UniqueName: "kubernetes.io/projected/e0167375-aa59-43a4-a5ba-e0b165da8b30-kube-api-access-l5hsb") pod "network-check-target-t6qv8" (UID: "e0167375-aa59-43a4-a5ba-e0b165da8b30") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 20 00:47:48.406466 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:48.406380    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-19 00:42:47 +0000 UTC" deadline="2028-05-03 22:27:35.357327862 +0000 UTC"
Sep 20 00:47:48.406466 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:48.406419    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14205h39m46.950914066s"
Sep 20 00:47:48.549772 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:48.549645    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf898d8f_ed0f_4b4e_9a87_8e6167b29481.slice/crio-01a46d5d7b46a8d3bd5a11f16ddd40de3bd424519d5ad323609911f6a8e3a7bf WatchSource:0}: Error finding container 01a46d5d7b46a8d3bd5a11f16ddd40de3bd424519d5ad323609911f6a8e3a7bf: Status 404 returned error can't find the container with id 01a46d5d7b46a8d3bd5a11f16ddd40de3bd424519d5ad323609911f6a8e3a7bf
Sep 20 00:47:48.550678 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:48.550544    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbecc2877_6923_45c5_b169_5c211abd16dd.slice/crio-848bda776e951b9a003bc77739d7a292e1a4e9a1243ddfbd75f16edc078a4b3e WatchSource:0}: Error finding container 848bda776e951b9a003bc77739d7a292e1a4e9a1243ddfbd75f16edc078a4b3e: Status 404 returned error can't find the container with id 848bda776e951b9a003bc77739d7a292e1a4e9a1243ddfbd75f16edc078a4b3e
Sep 20 00:47:48.554444 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:48.554421    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95b69c15_6fcc_4109_bbe1_c34043671a6a.slice/crio-d8a20c0e073603abe2794d4203578044b78131a346304d5032f1a7bdcac1f783 WatchSource:0}: Error finding container d8a20c0e073603abe2794d4203578044b78131a346304d5032f1a7bdcac1f783: Status 404 returned error can't find the container with id d8a20c0e073603abe2794d4203578044b78131a346304d5032f1a7bdcac1f783
Sep 20 00:47:48.558026 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:48.557999    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93db881a_91b4_44c0_8725_bc9832172d1b.slice/crio-f99169c2b3a06459bbd8b7ad46d1882f2d7638a25f2dda9ca54ee7daca63ba29 WatchSource:0}: Error finding container f99169c2b3a06459bbd8b7ad46d1882f2d7638a25f2dda9ca54ee7daca63ba29: Status 404 returned error can't find the container with id f99169c2b3a06459bbd8b7ad46d1882f2d7638a25f2dda9ca54ee7daca63ba29
Sep 20 00:47:48.558893 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:48.558839    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode543f7c5_f70d_49ab_877a_2ff1cf7d30c3.slice/crio-f0b3d9aa5329e4e15fd1fb0f75fbb2b340b473d7e9807fc90e0bf7eb2f379bd9 WatchSource:0}: Error finding container f0b3d9aa5329e4e15fd1fb0f75fbb2b340b473d7e9807fc90e0bf7eb2f379bd9: Status 404 returned error can't find the container with id f0b3d9aa5329e4e15fd1fb0f75fbb2b340b473d7e9807fc90e0bf7eb2f379bd9
Sep 20 00:47:48.559552 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:48.559274    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5453e2eb_f239_4ae0_a01e_f8e78bac3e5e.slice/crio-e14ea6f2c33fd0152f4c8ce5b3ed3e380ecdb0d947122c81303e7fc2387d7626 WatchSource:0}: Error finding container e14ea6f2c33fd0152f4c8ce5b3ed3e380ecdb0d947122c81303e7fc2387d7626: Status 404 returned error can't find the container with id e14ea6f2c33fd0152f4c8ce5b3ed3e380ecdb0d947122c81303e7fc2387d7626
Sep 20 00:47:48.559770 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:48.559747    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0922c703_f848_4c79_9355_82285e120a06.slice/crio-51cca01bb962c59ba2c4b01bc3537d28d867a8dcaa34cb7d9ca0c4df959d71f2 WatchSource:0}: Error finding container 51cca01bb962c59ba2c4b01bc3537d28d867a8dcaa34cb7d9ca0c4df959d71f2: Status 404 returned error can't find the container with id 51cca01bb962c59ba2c4b01bc3537d28d867a8dcaa34cb7d9ca0c4df959d71f2
Sep 20 00:47:48.561320 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:48.561034    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6a07188_d164_4385_8a38_35289b53a7be.slice/crio-ca799d408ebe7d64572fc4d32f38ef1164fb2bead87c6dbab9bafe7147d9273a WatchSource:0}: Error finding container ca799d408ebe7d64572fc4d32f38ef1164fb2bead87c6dbab9bafe7147d9273a: Status 404 returned error can't find the container with id ca799d408ebe7d64572fc4d32f38ef1164fb2bead87c6dbab9bafe7147d9273a
Sep 20 00:47:48.561670 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:47:48.561508    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cf64fad_2d77_43e8_a13d_fb2758010192.slice/crio-e9fb78f2d7859d5bb2dbf9f8eb874fafaa785724edd7afbf5b0ed9c2d3106e16 WatchSource:0}: Error finding container e9fb78f2d7859d5bb2dbf9f8eb874fafaa785724edd7afbf5b0ed9c2d3106e16: Status 404 returned error can't find the container with id e9fb78f2d7859d5bb2dbf9f8eb874fafaa785724edd7afbf5b0ed9c2d3106e16
Sep 20 00:47:48.983470 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:48.982716    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a588c630-f4a9-49b7-9ff1-1386742f40e3-original-pull-secret\") pod \"global-pull-secret-syncer-9mws2\" (UID: \"a588c630-f4a9-49b7-9ff1-1386742f40e3\") " pod="kube-system/global-pull-secret-syncer-9mws2"
Sep 20 00:47:48.983470 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:48.983019    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 20 00:47:48.983470 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:48.983085    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0d1f872-b92c-4b72-bdee-a7ac18493d84-metrics-certs\") pod \"network-metrics-daemon-94nzn\" (UID: \"a0d1f872-b92c-4b72-bdee-a7ac18493d84\") " pod="openshift-multus/network-metrics-daemon-94nzn"
Sep 20 00:47:48.983470 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:48.983097    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a588c630-f4a9-49b7-9ff1-1386742f40e3-original-pull-secret podName:a588c630-f4a9-49b7-9ff1-1386742f40e3 nodeName:}" failed. No retries permitted until 2026-09-20 00:47:50.983076277 +0000 UTC m=+7.597232166 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a588c630-f4a9-49b7-9ff1-1386742f40e3-original-pull-secret") pod "global-pull-secret-syncer-9mws2" (UID: "a588c630-f4a9-49b7-9ff1-1386742f40e3") : object "kube-system"/"original-pull-secret" not registered
Sep 20 00:47:48.983470 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:48.983174    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 00:47:48.983470 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:48.983228    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0d1f872-b92c-4b72-bdee-a7ac18493d84-metrics-certs podName:a0d1f872-b92c-4b72-bdee-a7ac18493d84 nodeName:}" failed. No retries permitted until 2026-09-20 00:47:50.9832113 +0000 UTC m=+7.597367198 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a0d1f872-b92c-4b72-bdee-a7ac18493d84-metrics-certs") pod "network-metrics-daemon-94nzn" (UID: "a0d1f872-b92c-4b72-bdee-a7ac18493d84") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 00:47:49.083573 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:49.083489    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5hsb\" (UniqueName: \"kubernetes.io/projected/e0167375-aa59-43a4-a5ba-e0b165da8b30-kube-api-access-l5hsb\") pod \"network-check-target-t6qv8\" (UID: \"e0167375-aa59-43a4-a5ba-e0b165da8b30\") " pod="openshift-network-diagnostics/network-check-target-t6qv8"
Sep 20 00:47:49.083723 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:49.083705    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 20 00:47:49.083782 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:49.083727    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 20 00:47:49.083782 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:49.083740    2570 projected.go:196] Error preparing data for projected volume kube-api-access-l5hsb for pod openshift-network-diagnostics/network-check-target-t6qv8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 20 00:47:49.083910 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:49.083803    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0167375-aa59-43a4-a5ba-e0b165da8b30-kube-api-access-l5hsb podName:e0167375-aa59-43a4-a5ba-e0b165da8b30 nodeName:}" failed. No retries permitted until 2026-09-20 00:47:51.08378191 +0000 UTC m=+7.697937793 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-l5hsb" (UniqueName: "kubernetes.io/projected/e0167375-aa59-43a4-a5ba-e0b165da8b30-kube-api-access-l5hsb") pod "network-check-target-t6qv8" (UID: "e0167375-aa59-43a4-a5ba-e0b165da8b30") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 20 00:47:49.406812 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:49.406726    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-19 00:42:47 +0000 UTC" deadline="2028-06-04 16:21:08.11182317 +0000 UTC"
Sep 20 00:47:49.406812 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:49.406768    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14967h33m18.70506029s"
Sep 20 00:47:49.457996 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:49.456807    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6qv8"
Sep 20 00:47:49.457996 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:49.456995    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6qv8" podUID="e0167375-aa59-43a4-a5ba-e0b165da8b30"
Sep 20 00:47:49.457996 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:49.457504    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mws2"
Sep 20 00:47:49.457996 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:49.457627    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mws2" podUID="a588c630-f4a9-49b7-9ff1-1386742f40e3"
Sep 20 00:47:49.457996 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:49.457719    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94nzn"
Sep 20 00:47:49.457996 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:49.457838    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94nzn" podUID="a0d1f872-b92c-4b72-bdee-a7ac18493d84"
Sep 20 00:47:49.467205 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:49.466966    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hfwr4" event={"ID":"93db881a-91b4-44c0-8725-bc9832172d1b","Type":"ContainerStarted","Data":"f99169c2b3a06459bbd8b7ad46d1882f2d7638a25f2dda9ca54ee7daca63ba29"}
Sep 20 00:47:49.475962 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:49.475877    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxxk" event={"ID":"5453e2eb-f239-4ae0-a01e-f8e78bac3e5e","Type":"ContainerStarted","Data":"e14ea6f2c33fd0152f4c8ce5b3ed3e380ecdb0d947122c81303e7fc2387d7626"}
Sep 20 00:47:49.477852 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:49.477795    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5f7zt" event={"ID":"e543f7c5-f70d-49ab-877a-2ff1cf7d30c3","Type":"ContainerStarted","Data":"f0b3d9aa5329e4e15fd1fb0f75fbb2b340b473d7e9807fc90e0bf7eb2f379bd9"}
Sep 20 00:47:49.482815 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:49.482760    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9mgf7" event={"ID":"becc2877-6923-45c5-b169-5c211abd16dd","Type":"ContainerStarted","Data":"848bda776e951b9a003bc77739d7a292e1a4e9a1243ddfbd75f16edc078a4b3e"}
Sep 20 00:47:49.501972 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:49.501931    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sd6xd" event={"ID":"5cf64fad-2d77-43e8-a13d-fb2758010192","Type":"ContainerStarted","Data":"e9fb78f2d7859d5bb2dbf9f8eb874fafaa785724edd7afbf5b0ed9c2d3106e16"}
Sep 20 00:47:49.511258 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:49.511232    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wdqj2" event={"ID":"95b69c15-6fcc-4109-bbe1-c34043671a6a","Type":"ContainerStarted","Data":"d8a20c0e073603abe2794d4203578044b78131a346304d5032f1a7bdcac1f783"}
Sep 20 00:47:49.521356 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:49.521305    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-65l6f" event={"ID":"bf898d8f-ed0f-4b4e-9a87-8e6167b29481","Type":"ContainerStarted","Data":"01a46d5d7b46a8d3bd5a11f16ddd40de3bd424519d5ad323609911f6a8e3a7bf"}
Sep 20 00:47:49.537851 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:49.537824    2570 generic.go:356] "Generic (PLEG): container finished" podID="cf200e0815bd4d9afec83c9f28df3bc2" containerID="3fc0b9ef0576430235fb6a482e5111b08f995203f531ae74bb2574b48de1f5bd" exitCode=0
Sep 20 00:47:49.537956 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:49.537916    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-108.ec2.internal" event={"ID":"cf200e0815bd4d9afec83c9f28df3bc2","Type":"ContainerDied","Data":"3fc0b9ef0576430235fb6a482e5111b08f995203f531ae74bb2574b48de1f5bd"}
Sep 20 00:47:49.566491 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:49.566468    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-108.ec2.internal" event={"ID":"1556c8746d3b9e131e1e9b890fd41c30","Type":"ContainerStarted","Data":"e790d2ee48407d1b45c14c9d22ba0dd4b86b6d7ce35d70e6562f2bf22b6790d9"}
Sep 20 00:47:49.588467 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:49.588427    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7zwqs" event={"ID":"a6a07188-d164-4385-8a38-35289b53a7be","Type":"ContainerStarted","Data":"ca799d408ebe7d64572fc4d32f38ef1164fb2bead87c6dbab9bafe7147d9273a"}
Sep 20 00:47:49.604633 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:49.604605    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ghfbt" event={"ID":"0922c703-f848-4c79-9355-82285e120a06","Type":"ContainerStarted","Data":"51cca01bb962c59ba2c4b01bc3537d28d867a8dcaa34cb7d9ca0c4df959d71f2"}
Sep 20 00:47:50.639202 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:50.639161    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-108.ec2.internal" event={"ID":"cf200e0815bd4d9afec83c9f28df3bc2","Type":"ContainerStarted","Data":"2155b81463bbdedb909451fea4f073a0145485717f01f1af04c1f4ff6df9602f"}
Sep 20 00:47:50.652577 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:50.652524    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-108.ec2.internal" podStartSLOduration=4.652458789 podStartE2EDuration="4.652458789s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-20 00:47:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:47:50.652132211 +0000 UTC m=+7.266288134" watchObservedRunningTime="2026-09-20 00:47:50.652458789 +0000 UTC m=+7.266614689"
Sep 20 00:47:50.652828 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:50.652795    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-108.ec2.internal" podStartSLOduration=4.652786668 podStartE2EDuration="4.652786668s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-20 00:47:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:47:49.579228255 +0000 UTC m=+6.193384153" watchObservedRunningTime="2026-09-20 00:47:50.652786668 +0000 UTC m=+7.266942567"
Sep 20 00:47:51.001733 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:51.001641    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0d1f872-b92c-4b72-bdee-a7ac18493d84-metrics-certs\") pod \"network-metrics-daemon-94nzn\" (UID: \"a0d1f872-b92c-4b72-bdee-a7ac18493d84\") " pod="openshift-multus/network-metrics-daemon-94nzn"
Sep 20 00:47:51.001733 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:51.001710    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a588c630-f4a9-49b7-9ff1-1386742f40e3-original-pull-secret\") pod \"global-pull-secret-syncer-9mws2\" (UID: \"a588c630-f4a9-49b7-9ff1-1386742f40e3\") " pod="kube-system/global-pull-secret-syncer-9mws2"
Sep 20 00:47:51.002012 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:51.001847    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 20 00:47:51.002012 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:51.001930    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a588c630-f4a9-49b7-9ff1-1386742f40e3-original-pull-secret podName:a588c630-f4a9-49b7-9ff1-1386742f40e3 nodeName:}" failed. No retries permitted until 2026-09-20 00:47:55.00191185 +0000 UTC m=+11.616067746 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a588c630-f4a9-49b7-9ff1-1386742f40e3-original-pull-secret") pod "global-pull-secret-syncer-9mws2" (UID: "a588c630-f4a9-49b7-9ff1-1386742f40e3") : object "kube-system"/"original-pull-secret" not registered
Sep 20 00:47:51.002012 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:51.001994    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 00:47:51.002174 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:51.002028    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0d1f872-b92c-4b72-bdee-a7ac18493d84-metrics-certs podName:a0d1f872-b92c-4b72-bdee-a7ac18493d84 nodeName:}" failed. No retries permitted until 2026-09-20 00:47:55.002015896 +0000 UTC m=+11.616171777 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a0d1f872-b92c-4b72-bdee-a7ac18493d84-metrics-certs") pod "network-metrics-daemon-94nzn" (UID: "a0d1f872-b92c-4b72-bdee-a7ac18493d84") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 00:47:51.102456 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:51.102416    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5hsb\" (UniqueName: \"kubernetes.io/projected/e0167375-aa59-43a4-a5ba-e0b165da8b30-kube-api-access-l5hsb\") pod \"network-check-target-t6qv8\" (UID: \"e0167375-aa59-43a4-a5ba-e0b165da8b30\") " pod="openshift-network-diagnostics/network-check-target-t6qv8"
Sep 20 00:47:51.102623 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:51.102613    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 20 00:47:51.102680 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:51.102632    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 20 00:47:51.102680 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:51.102644    2570 projected.go:196] Error preparing data for projected volume kube-api-access-l5hsb for pod openshift-network-diagnostics/network-check-target-t6qv8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 20 00:47:51.102814 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:51.102701    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0167375-aa59-43a4-a5ba-e0b165da8b30-kube-api-access-l5hsb podName:e0167375-aa59-43a4-a5ba-e0b165da8b30 nodeName:}" failed. No retries permitted until 2026-09-20 00:47:55.102683095 +0000 UTC m=+11.716838975 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-l5hsb" (UniqueName: "kubernetes.io/projected/e0167375-aa59-43a4-a5ba-e0b165da8b30-kube-api-access-l5hsb") pod "network-check-target-t6qv8" (UID: "e0167375-aa59-43a4-a5ba-e0b165da8b30") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 20 00:47:51.448057 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:51.447973    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mws2"
Sep 20 00:47:51.448217 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:51.448080    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mws2" podUID="a588c630-f4a9-49b7-9ff1-1386742f40e3"
Sep 20 00:47:51.448284 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:51.448238    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94nzn"
Sep 20 00:47:51.448339 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:51.447973    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6qv8"
Sep 20 00:47:51.448515 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:51.448381    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94nzn" podUID="a0d1f872-b92c-4b72-bdee-a7ac18493d84"
Sep 20 00:47:51.448515 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:51.448466    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6qv8" podUID="e0167375-aa59-43a4-a5ba-e0b165da8b30"
Sep 20 00:47:53.448841 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:53.448810    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mws2"
Sep 20 00:47:53.449306 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:53.448958    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mws2" podUID="a588c630-f4a9-49b7-9ff1-1386742f40e3"
Sep 20 00:47:53.449403 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:53.449370    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6qv8"
Sep 20 00:47:53.449587 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:53.449468    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6qv8" podUID="e0167375-aa59-43a4-a5ba-e0b165da8b30"
Sep 20 00:47:53.449587 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:53.449528    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94nzn"
Sep 20 00:47:53.449773 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:53.449605    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94nzn" podUID="a0d1f872-b92c-4b72-bdee-a7ac18493d84"
Sep 20 00:47:55.037730 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:55.037695    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0d1f872-b92c-4b72-bdee-a7ac18493d84-metrics-certs\") pod \"network-metrics-daemon-94nzn\" (UID: \"a0d1f872-b92c-4b72-bdee-a7ac18493d84\") " pod="openshift-multus/network-metrics-daemon-94nzn"
Sep 20 00:47:55.038192 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:55.037791    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a588c630-f4a9-49b7-9ff1-1386742f40e3-original-pull-secret\") pod \"global-pull-secret-syncer-9mws2\" (UID: \"a588c630-f4a9-49b7-9ff1-1386742f40e3\") " pod="kube-system/global-pull-secret-syncer-9mws2"
Sep 20 00:47:55.038192 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:55.037932    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 20 00:47:55.038192 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:55.037996    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a588c630-f4a9-49b7-9ff1-1386742f40e3-original-pull-secret podName:a588c630-f4a9-49b7-9ff1-1386742f40e3 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:03.037978209 +0000 UTC m=+19.652134089 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a588c630-f4a9-49b7-9ff1-1386742f40e3-original-pull-secret") pod "global-pull-secret-syncer-9mws2" (UID: "a588c630-f4a9-49b7-9ff1-1386742f40e3") : object "kube-system"/"original-pull-secret" not registered
Sep 20 00:47:55.038374 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:55.038309    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 00:47:55.038374 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:55.038348    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0d1f872-b92c-4b72-bdee-a7ac18493d84-metrics-certs podName:a0d1f872-b92c-4b72-bdee-a7ac18493d84 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:03.038334587 +0000 UTC m=+19.652490463 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a0d1f872-b92c-4b72-bdee-a7ac18493d84-metrics-certs") pod "network-metrics-daemon-94nzn" (UID: "a0d1f872-b92c-4b72-bdee-a7ac18493d84") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 00:47:55.138825 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:55.138785    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5hsb\" (UniqueName: \"kubernetes.io/projected/e0167375-aa59-43a4-a5ba-e0b165da8b30-kube-api-access-l5hsb\") pod \"network-check-target-t6qv8\" (UID: \"e0167375-aa59-43a4-a5ba-e0b165da8b30\") " pod="openshift-network-diagnostics/network-check-target-t6qv8"
Sep 20 00:47:55.139025 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:55.138974    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 20 00:47:55.139025 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:55.139000    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 20 00:47:55.139025 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:55.139013    2570 projected.go:196] Error preparing data for projected volume kube-api-access-l5hsb for pod openshift-network-diagnostics/network-check-target-t6qv8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 20 00:47:55.139196 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:55.139073    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0167375-aa59-43a4-a5ba-e0b165da8b30-kube-api-access-l5hsb podName:e0167375-aa59-43a4-a5ba-e0b165da8b30 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:03.139053527 +0000 UTC m=+19.753209418 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-l5hsb" (UniqueName: "kubernetes.io/projected/e0167375-aa59-43a4-a5ba-e0b165da8b30-kube-api-access-l5hsb") pod "network-check-target-t6qv8" (UID: "e0167375-aa59-43a4-a5ba-e0b165da8b30") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 20 00:47:55.448846 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:55.448767    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mws2"
Sep 20 00:47:55.449015 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:55.448901    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mws2" podUID="a588c630-f4a9-49b7-9ff1-1386742f40e3"
Sep 20 00:47:55.449015 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:55.448930    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6qv8"
Sep 20 00:47:55.449015 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:55.448948    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94nzn"
Sep 20 00:47:55.449214 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:55.449037    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6qv8" podUID="e0167375-aa59-43a4-a5ba-e0b165da8b30"
Sep 20 00:47:55.449214 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:55.449133    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94nzn" podUID="a0d1f872-b92c-4b72-bdee-a7ac18493d84"
Sep 20 00:47:57.447242 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:57.447207    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94nzn"
Sep 20 00:47:57.447803 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:57.447339    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94nzn" podUID="a0d1f872-b92c-4b72-bdee-a7ac18493d84"
Sep 20 00:47:57.447803 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:57.447740    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mws2"
Sep 20 00:47:57.447973 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:57.447827    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mws2" podUID="a588c630-f4a9-49b7-9ff1-1386742f40e3"
Sep 20 00:47:57.447973 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:57.447932    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6qv8"
Sep 20 00:47:57.448070 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:57.448037    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6qv8" podUID="e0167375-aa59-43a4-a5ba-e0b165da8b30"
Sep 20 00:47:59.447199 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:59.447154    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mws2"
Sep 20 00:47:59.447622 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:59.447261    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mws2" podUID="a588c630-f4a9-49b7-9ff1-1386742f40e3"
Sep 20 00:47:59.447622 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:59.447301    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6qv8"
Sep 20 00:47:59.447622 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:47:59.447350    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94nzn"
Sep 20 00:47:59.447622 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:59.447452    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94nzn" podUID="a0d1f872-b92c-4b72-bdee-a7ac18493d84"
Sep 20 00:47:59.447622 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:47:59.447489    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6qv8" podUID="e0167375-aa59-43a4-a5ba-e0b165da8b30"
Sep 20 00:48:01.447300 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:01.447258    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94nzn"
Sep 20 00:48:01.447300 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:01.447287    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6qv8"
Sep 20 00:48:01.447300 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:01.447262    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mws2"
Sep 20 00:48:01.447729 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:01.447400    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94nzn" podUID="a0d1f872-b92c-4b72-bdee-a7ac18493d84"
Sep 20 00:48:01.447729 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:01.447437    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mws2" podUID="a588c630-f4a9-49b7-9ff1-1386742f40e3"
Sep 20 00:48:01.447729 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:01.447528    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6qv8" podUID="e0167375-aa59-43a4-a5ba-e0b165da8b30"
Sep 20 00:48:03.092773 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:03.092741    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a588c630-f4a9-49b7-9ff1-1386742f40e3-original-pull-secret\") pod \"global-pull-secret-syncer-9mws2\" (UID: \"a588c630-f4a9-49b7-9ff1-1386742f40e3\") " pod="kube-system/global-pull-secret-syncer-9mws2"
Sep 20 00:48:03.093294 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:03.092806    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0d1f872-b92c-4b72-bdee-a7ac18493d84-metrics-certs\") pod \"network-metrics-daemon-94nzn\" (UID: \"a0d1f872-b92c-4b72-bdee-a7ac18493d84\") " pod="openshift-multus/network-metrics-daemon-94nzn"
Sep 20 00:48:03.093294 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:03.092919    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 00:48:03.093294 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:03.092919    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 20 00:48:03.093294 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:03.092983    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0d1f872-b92c-4b72-bdee-a7ac18493d84-metrics-certs podName:a0d1f872-b92c-4b72-bdee-a7ac18493d84 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:19.092966882 +0000 UTC m=+35.707122757 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a0d1f872-b92c-4b72-bdee-a7ac18493d84-metrics-certs") pod "network-metrics-daemon-94nzn" (UID: "a0d1f872-b92c-4b72-bdee-a7ac18493d84") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 00:48:03.093294 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:03.092997    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a588c630-f4a9-49b7-9ff1-1386742f40e3-original-pull-secret podName:a588c630-f4a9-49b7-9ff1-1386742f40e3 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:19.092991155 +0000 UTC m=+35.707147029 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a588c630-f4a9-49b7-9ff1-1386742f40e3-original-pull-secret") pod "global-pull-secret-syncer-9mws2" (UID: "a588c630-f4a9-49b7-9ff1-1386742f40e3") : object "kube-system"/"original-pull-secret" not registered
Sep 20 00:48:03.193144 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:03.193107    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5hsb\" (UniqueName: \"kubernetes.io/projected/e0167375-aa59-43a4-a5ba-e0b165da8b30-kube-api-access-l5hsb\") pod \"network-check-target-t6qv8\" (UID: \"e0167375-aa59-43a4-a5ba-e0b165da8b30\") " pod="openshift-network-diagnostics/network-check-target-t6qv8"
Sep 20 00:48:03.193319 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:03.193273    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 20 00:48:03.193319 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:03.193292    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 20 00:48:03.193319 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:03.193301    2570 projected.go:196] Error preparing data for projected volume kube-api-access-l5hsb for pod openshift-network-diagnostics/network-check-target-t6qv8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 20 00:48:03.193449 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:03.193364    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0167375-aa59-43a4-a5ba-e0b165da8b30-kube-api-access-l5hsb podName:e0167375-aa59-43a4-a5ba-e0b165da8b30 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:19.193344763 +0000 UTC m=+35.807500661 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-l5hsb" (UniqueName: "kubernetes.io/projected/e0167375-aa59-43a4-a5ba-e0b165da8b30-kube-api-access-l5hsb") pod "network-check-target-t6qv8" (UID: "e0167375-aa59-43a4-a5ba-e0b165da8b30") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 20 00:48:03.447673 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:03.447599    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6qv8"
Sep 20 00:48:03.447673 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:03.447636    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94nzn"
Sep 20 00:48:03.447918 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:03.447597    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mws2"
Sep 20 00:48:03.447918 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:03.447786    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6qv8" podUID="e0167375-aa59-43a4-a5ba-e0b165da8b30"
Sep 20 00:48:03.447918 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:03.447884    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mws2" podUID="a588c630-f4a9-49b7-9ff1-1386742f40e3"
Sep 20 00:48:03.448062 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:03.448014    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94nzn" podUID="a0d1f872-b92c-4b72-bdee-a7ac18493d84"
Sep 20 00:48:05.448539 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:05.448500    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mws2"
Sep 20 00:48:05.449007 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:05.448599    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mws2" podUID="a588c630-f4a9-49b7-9ff1-1386742f40e3"
Sep 20 00:48:05.449007 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:05.448697    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6qv8"
Sep 20 00:48:05.449007 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:05.448784    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6qv8" podUID="e0167375-aa59-43a4-a5ba-e0b165da8b30"
Sep 20 00:48:05.449007 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:05.448835    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94nzn"
Sep 20 00:48:05.449007 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:05.448925    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94nzn" podUID="a0d1f872-b92c-4b72-bdee-a7ac18493d84"
Sep 20 00:48:06.671557 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:06.671161    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wdqj2" event={"ID":"95b69c15-6fcc-4109-bbe1-c34043671a6a","Type":"ContainerStarted","Data":"c8dc6bbc634aa063217791adef3be9ac474bc106f4327aaa6a995d7ba59c645f"}
Sep 20 00:48:06.673579 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:06.673558    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7zwqs" event={"ID":"a6a07188-d164-4385-8a38-35289b53a7be","Type":"ContainerStarted","Data":"354a9eb016ba496fa062aaefd411d50645a88b79bc50f640b796003247e2898e"}
Sep 20 00:48:06.675444 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:06.675137    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5f7zt" event={"ID":"e543f7c5-f70d-49ab-877a-2ff1cf7d30c3","Type":"ContainerStarted","Data":"73421fd89401089338dd585c6a40ad0f3da480773103344326a9bc6201fea5f0"}
Sep 20 00:48:06.678056 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:06.677272    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sd6xd" event={"ID":"5cf64fad-2d77-43e8-a13d-fb2758010192","Type":"ContainerStarted","Data":"11a2bad7f6feb7d00f4b44bfb214abdfe5057bc1cd58233280c4662716084524"}
Sep 20 00:48:06.687026 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:06.686935    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wdqj2" podStartSLOduration=3.869473913 podStartE2EDuration="21.686918127s" totalImagesPullingTime="17.817444214s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-20 00:47:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:06.686413626 +0000 UTC m=+23.300569522" watchObservedRunningTime="2026-09-20 00:48:06.686918127 +0000 UTC m=+23.301074028"
Sep 20 00:48:06.699047 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:06.698889    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7zwqs" podStartSLOduration=3.888682578 podStartE2EDuration="21.698877599s" totalImagesPullingTime="17.810195021s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-20 00:47:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:06.69870596 +0000 UTC m=+23.312861861" watchObservedRunningTime="2026-09-20 00:48:06.698877599 +0000 UTC m=+23.313033496"
Sep 20 00:48:06.725002 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:06.724962    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-sd6xd" podStartSLOduration=4.007398553 podStartE2EDuration="21.72494845s" totalImagesPullingTime="17.717549897s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:47:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:06.724806544 +0000 UTC m=+23.338962452" watchObservedRunningTime="2026-09-20 00:48:06.72494845 +0000 UTC m=+23.339104347"
Sep 20 00:48:06.725487 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:06.725457    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5f7zt" podStartSLOduration=3.91289257 podStartE2EDuration="21.725448134s" totalImagesPullingTime="17.812555564s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-20 00:47:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:06.711796752 +0000 UTC m=+23.325952673" watchObservedRunningTime="2026-09-20 00:48:06.725448134 +0000 UTC m=+23.339604031"
Sep 20 00:48:07.448166 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:07.447923    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6qv8"
Sep 20 00:48:07.448348 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:07.447925    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mws2"
Sep 20 00:48:07.448348 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:07.448271    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6qv8" podUID="e0167375-aa59-43a4-a5ba-e0b165da8b30"
Sep 20 00:48:07.448348 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:07.448336    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mws2" podUID="a588c630-f4a9-49b7-9ff1-1386742f40e3"
Sep 20 00:48:07.448519 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:07.447954    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94nzn"
Sep 20 00:48:07.448519 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:07.448421    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94nzn" podUID="a0d1f872-b92c-4b72-bdee-a7ac18493d84"
Sep 20 00:48:07.681056 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:07.681030    2570 generic.go:356] "Generic (PLEG): container finished" podID="0922c703-f848-4c79-9355-82285e120a06" containerID="e08af205e5a03c618d42c911edad517c99ff5a85dc8ee70f9e3e092ceb21ba9c" exitCode=0
Sep 20 00:48:07.681677 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:07.681124    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ghfbt" event={"ID":"0922c703-f848-4c79-9355-82285e120a06","Type":"ContainerDied","Data":"e08af205e5a03c618d42c911edad517c99ff5a85dc8ee70f9e3e092ceb21ba9c"}
Sep 20 00:48:07.682806 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:07.682771    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hfwr4" event={"ID":"93db881a-91b4-44c0-8725-bc9832172d1b","Type":"ContainerStarted","Data":"797896a983a7713378aab85bb6eefef94ec6abee1771134bc7f5d90ffc69ac46"}
Sep 20 00:48:07.684498 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:07.684478    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxxk" event={"ID":"5453e2eb-f239-4ae0-a01e-f8e78bac3e5e","Type":"ContainerStarted","Data":"f3b533f3ddcf161c13b2f0ed795b085c5557940c05983d4c9d29719fcb5b49ba"}
Sep 20 00:48:07.687297 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:07.687271    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65l6f_bf898d8f-ed0f-4b4e-9a87-8e6167b29481/ovn-acl-logging/0.log"
Sep 20 00:48:07.687585 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:07.687568    2570 generic.go:356] "Generic (PLEG): container finished" podID="bf898d8f-ed0f-4b4e-9a87-8e6167b29481" containerID="fa13d916b1264c7a787bd6a4ef4204174a63715eb8350ea8861585bff5d77482" exitCode=1
Sep 20 00:48:07.687669 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:07.687646    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-65l6f" event={"ID":"bf898d8f-ed0f-4b4e-9a87-8e6167b29481","Type":"ContainerStarted","Data":"7c42e1503a91893f55ee77a7538844ab6ce233a41b607958dd632a6ff2784206"}
Sep 20 00:48:07.687760 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:07.687717    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-65l6f" event={"ID":"bf898d8f-ed0f-4b4e-9a87-8e6167b29481","Type":"ContainerStarted","Data":"12d4a15a5b094f40bb473521b792ab71d8a8db51451f9c082202efe1cfedd237"}
Sep 20 00:48:07.687800 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:07.687769    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-65l6f" event={"ID":"bf898d8f-ed0f-4b4e-9a87-8e6167b29481","Type":"ContainerStarted","Data":"5a9ed6a4524bafef9ee0dbd7cd38a547bdabdac530865bbeb9d38a54552717d0"}
Sep 20 00:48:07.687846 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:07.687819    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-65l6f" event={"ID":"bf898d8f-ed0f-4b4e-9a87-8e6167b29481","Type":"ContainerStarted","Data":"ed7ec7c28af7f01232091ff82974e39b25b376f8103606b992931c33356b6d35"}
Sep 20 00:48:07.688048 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:07.687956    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-65l6f" event={"ID":"bf898d8f-ed0f-4b4e-9a87-8e6167b29481","Type":"ContainerDied","Data":"fa13d916b1264c7a787bd6a4ef4204174a63715eb8350ea8861585bff5d77482"}
Sep 20 00:48:07.688048 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:07.688003    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-65l6f" event={"ID":"bf898d8f-ed0f-4b4e-9a87-8e6167b29481","Type":"ContainerStarted","Data":"d3b70b99de43fd18dcdeaba4ce9aa55dce7367bd809fa632b6c2afc6bd55fc7f"}
Sep 20 00:48:07.714436 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:07.714393    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hfwr4" podStartSLOduration=4.818537542 podStartE2EDuration="22.714380978s" totalImagesPullingTime="17.895843436s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-20 00:47:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:07.714345725 +0000 UTC m=+24.328501647" watchObservedRunningTime="2026-09-20 00:48:07.714380978 +0000 UTC m=+24.328536900"
Sep 20 00:48:07.718568 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:07.718548    2570 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 20 00:48:08.434003 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:08.433875    2570 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-20T00:48:07.718564499Z","UUID":"8f828d2e-273b-428b-9bf8-550678730a46","Handler":null,"Name":"","Endpoint":""}
Sep 20 00:48:08.435582 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:08.435541    2570 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 20 00:48:08.435722 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:08.435668    2570 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 20 00:48:08.692588 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:08.692499    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxxk" event={"ID":"5453e2eb-f239-4ae0-a01e-f8e78bac3e5e","Type":"ContainerStarted","Data":"59dcbb8594252c8ef05bc48c980b97aac89317f24980060531ef67a8e24f29f8"}
Sep 20 00:48:08.693979 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:08.693952    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9mgf7" event={"ID":"becc2877-6923-45c5-b169-5c211abd16dd","Type":"ContainerStarted","Data":"a8ae7ab896f46e393ec90f272083b3b31744534c563f51dde8b622f3de52fc0d"}
Sep 20 00:48:08.709236 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:08.709186    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9mgf7" podStartSLOduration=5.843270926 podStartE2EDuration="23.7091718s" totalImagesPullingTime="17.865900874s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-20 00:47:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:08.708922025 +0000 UTC m=+25.323077943" watchObservedRunningTime="2026-09-20 00:48:08.7091718 +0000 UTC m=+25.323327699"
Sep 20 00:48:09.447410 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:09.447384    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6qv8"
Sep 20 00:48:09.447524 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:09.447384    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mws2"
Sep 20 00:48:09.447524 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:09.447488    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6qv8" podUID="e0167375-aa59-43a4-a5ba-e0b165da8b30"
Sep 20 00:48:09.447650 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:09.447396    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94nzn"
Sep 20 00:48:09.447707 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:09.447613    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mws2" podUID="a588c630-f4a9-49b7-9ff1-1386742f40e3"
Sep 20 00:48:09.447763 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:09.447709    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94nzn" podUID="a0d1f872-b92c-4b72-bdee-a7ac18493d84"
Sep 20 00:48:09.700194 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:09.700117    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65l6f_bf898d8f-ed0f-4b4e-9a87-8e6167b29481/ovn-acl-logging/0.log"
Sep 20 00:48:09.700623 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:09.700525    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-65l6f" event={"ID":"bf898d8f-ed0f-4b4e-9a87-8e6167b29481","Type":"ContainerStarted","Data":"3ece929273d6efe3cdeb3649b3526bcd7f54317ea712ed8861ac84dac9998c96"}
Sep 20 00:48:09.703016 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:09.702914    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxxk" event={"ID":"5453e2eb-f239-4ae0-a01e-f8e78bac3e5e","Type":"ContainerStarted","Data":"e1969e15ed4d54fe57be77e8d33b9d389993da5ddfd69f804e8649dd5735a5a3"}
Sep 20 00:48:09.722157 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:09.722109    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxxk" podStartSLOduration=5.054113884 podStartE2EDuration="24.722091765s" totalImagesPullingTime="19.667977881s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-20 00:47:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:09.721817616 +0000 UTC m=+26.335973515" watchObservedRunningTime="2026-09-20 00:48:09.722091765 +0000 UTC m=+26.336247664"
Sep 20 00:48:10.086522 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:10.086441    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-sd6xd"
Sep 20 00:48:10.087141 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:10.087114    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-sd6xd"
Sep 20 00:48:10.705615 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:10.705402    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-sd6xd"
Sep 20 00:48:10.706223 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:10.706200    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-sd6xd"
Sep 20 00:48:11.448094 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:11.447607    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6qv8"
Sep 20 00:48:11.448094 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:11.447623    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94nzn"
Sep 20 00:48:11.448094 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:11.447733    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6qv8" podUID="e0167375-aa59-43a4-a5ba-e0b165da8b30"
Sep 20 00:48:11.448094 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:11.447779    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mws2"
Sep 20 00:48:11.448094 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:11.447895    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94nzn" podUID="a0d1f872-b92c-4b72-bdee-a7ac18493d84"
Sep 20 00:48:11.448094 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:11.447991    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mws2" podUID="a588c630-f4a9-49b7-9ff1-1386742f40e3"
Sep 20 00:48:12.619939 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:12.619749    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7zwqs_a6a07188-d164-4385-8a38-35289b53a7be/dns-node-resolver/0.log"
Sep 20 00:48:12.712806 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:12.712781    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65l6f_bf898d8f-ed0f-4b4e-9a87-8e6167b29481/ovn-acl-logging/0.log"
Sep 20 00:48:12.713206 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:12.713177    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-65l6f" event={"ID":"bf898d8f-ed0f-4b4e-9a87-8e6167b29481","Type":"ContainerStarted","Data":"88cef217c7373d634e952a14c9d988c912f1bec74e08e624e27b14e550c291f3"}
Sep 20 00:48:12.713491 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:12.713466    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:48:12.713608 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:12.713541    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:48:12.713608 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:12.713589    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:48:12.713696 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:12.713621    2570 scope.go:117] "RemoveContainer" containerID="fa13d916b1264c7a787bd6a4ef4204174a63715eb8350ea8861585bff5d77482"
Sep 20 00:48:12.715321 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:12.715299    2570 generic.go:356] "Generic (PLEG): container finished" podID="0922c703-f848-4c79-9355-82285e120a06" containerID="cf0a230c35f6b97e1da1d1bf9804af69f7e68b28d97a57eb83cb1827d243850b" exitCode=0
Sep 20 00:48:12.715438 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:12.715408    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ghfbt" event={"ID":"0922c703-f848-4c79-9355-82285e120a06","Type":"ContainerDied","Data":"cf0a230c35f6b97e1da1d1bf9804af69f7e68b28d97a57eb83cb1827d243850b"}
Sep 20 00:48:12.730400 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:12.730368    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:48:12.730485 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:12.730470    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:48:13.400664 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:13.400632    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5f7zt_e543f7c5-f70d-49ab-877a-2ff1cf7d30c3/node-ca/0.log"
Sep 20 00:48:13.447349 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:13.447322    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6qv8"
Sep 20 00:48:13.447508 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:13.447323    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94nzn"
Sep 20 00:48:13.447508 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:13.447425    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6qv8" podUID="e0167375-aa59-43a4-a5ba-e0b165da8b30"
Sep 20 00:48:13.447607 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:13.447503    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94nzn" podUID="a0d1f872-b92c-4b72-bdee-a7ac18493d84"
Sep 20 00:48:13.447607 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:13.447336    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mws2"
Sep 20 00:48:13.447607 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:13.447593    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mws2" podUID="a588c630-f4a9-49b7-9ff1-1386742f40e3"
Sep 20 00:48:13.721961 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:13.721942    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65l6f_bf898d8f-ed0f-4b4e-9a87-8e6167b29481/ovn-acl-logging/0.log"
Sep 20 00:48:13.722421 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:13.722371    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-65l6f" event={"ID":"bf898d8f-ed0f-4b4e-9a87-8e6167b29481","Type":"ContainerStarted","Data":"1d1ed84af5c48a35f9c7cdd7479dcb6776a58e40f2acdb7c44aaa92f4374c4a0"}
Sep 20 00:48:13.762186 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:13.762133    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-65l6f" podStartSLOduration=10.892845896 podStartE2EDuration="28.76211702s" totalImagesPullingTime="17.869271124s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-20 00:47:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:13.760529738 +0000 UTC m=+30.374685685" watchObservedRunningTime="2026-09-20 00:48:13.76211702 +0000 UTC m=+30.376272917"
Sep 20 00:48:13.768797 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:13.768765    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-t6qv8"]
Sep 20 00:48:13.768955 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:13.768895    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6qv8"
Sep 20 00:48:13.769021 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:13.769002    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6qv8" podUID="e0167375-aa59-43a4-a5ba-e0b165da8b30"
Sep 20 00:48:13.772620 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:13.772601    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9mws2"]
Sep 20 00:48:13.772728 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:13.772675    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mws2"
Sep 20 00:48:13.772793 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:13.772751    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mws2" podUID="a588c630-f4a9-49b7-9ff1-1386742f40e3"
Sep 20 00:48:13.773360 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:13.773334    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-94nzn"]
Sep 20 00:48:13.773472 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:13.773435    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94nzn"
Sep 20 00:48:13.773551 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:13.773530    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94nzn" podUID="a0d1f872-b92c-4b72-bdee-a7ac18493d84"
Sep 20 00:48:14.726584 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:14.726548    2570 generic.go:356] "Generic (PLEG): container finished" podID="0922c703-f848-4c79-9355-82285e120a06" containerID="569928970faa5d6fccecc321db34471c22112448821b68a5f869d5cc2c9e09f6" exitCode=0
Sep 20 00:48:14.726983 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:14.726639    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ghfbt" event={"ID":"0922c703-f848-4c79-9355-82285e120a06","Type":"ContainerDied","Data":"569928970faa5d6fccecc321db34471c22112448821b68a5f869d5cc2c9e09f6"}
Sep 20 00:48:15.451055 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:15.451015    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mws2"
Sep 20 00:48:15.451445 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:15.451405    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94nzn"
Sep 20 00:48:15.451445 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:15.451429    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6qv8"
Sep 20 00:48:15.451591 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:15.451524    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mws2" podUID="a588c630-f4a9-49b7-9ff1-1386742f40e3"
Sep 20 00:48:15.451645 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:15.451593    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6qv8" podUID="e0167375-aa59-43a4-a5ba-e0b165da8b30"
Sep 20 00:48:15.451746 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:15.451715    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94nzn" podUID="a0d1f872-b92c-4b72-bdee-a7ac18493d84"
Sep 20 00:48:16.734051 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:16.733880    2570 generic.go:356] "Generic (PLEG): container finished" podID="0922c703-f848-4c79-9355-82285e120a06" containerID="28e842255ae236e8b7900dd2252ff7c08dfc2a6cb807e820c8aef44a47b909cc" exitCode=0
Sep 20 00:48:16.734452 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:16.733960    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ghfbt" event={"ID":"0922c703-f848-4c79-9355-82285e120a06","Type":"ContainerDied","Data":"28e842255ae236e8b7900dd2252ff7c08dfc2a6cb807e820c8aef44a47b909cc"}
Sep 20 00:48:17.447602 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:17.447559    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mws2"
Sep 20 00:48:17.447602 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:17.447585    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94nzn"
Sep 20 00:48:17.447845 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:17.447562    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6qv8"
Sep 20 00:48:17.447845 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:17.447674    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mws2" podUID="a588c630-f4a9-49b7-9ff1-1386742f40e3"
Sep 20 00:48:17.447845 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:17.447753    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6qv8" podUID="e0167375-aa59-43a4-a5ba-e0b165da8b30"
Sep 20 00:48:17.447989 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:17.447843    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94nzn" podUID="a0d1f872-b92c-4b72-bdee-a7ac18493d84"
Sep 20 00:48:19.105278 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:19.105240    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0d1f872-b92c-4b72-bdee-a7ac18493d84-metrics-certs\") pod \"network-metrics-daemon-94nzn\" (UID: \"a0d1f872-b92c-4b72-bdee-a7ac18493d84\") " pod="openshift-multus/network-metrics-daemon-94nzn"
Sep 20 00:48:19.105837 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:19.105291    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a588c630-f4a9-49b7-9ff1-1386742f40e3-original-pull-secret\") pod \"global-pull-secret-syncer-9mws2\" (UID: \"a588c630-f4a9-49b7-9ff1-1386742f40e3\") " pod="kube-system/global-pull-secret-syncer-9mws2"
Sep 20 00:48:19.105837 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:19.105411    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 00:48:19.105837 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:19.105480    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0d1f872-b92c-4b72-bdee-a7ac18493d84-metrics-certs podName:a0d1f872-b92c-4b72-bdee-a7ac18493d84 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:51.105464951 +0000 UTC m=+67.719620828 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a0d1f872-b92c-4b72-bdee-a7ac18493d84-metrics-certs") pod "network-metrics-daemon-94nzn" (UID: "a0d1f872-b92c-4b72-bdee-a7ac18493d84") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 20 00:48:19.105837 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:19.105412    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 20 00:48:19.105837 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:19.105571    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a588c630-f4a9-49b7-9ff1-1386742f40e3-original-pull-secret podName:a588c630-f4a9-49b7-9ff1-1386742f40e3 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:51.105551499 +0000 UTC m=+67.719707390 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a588c630-f4a9-49b7-9ff1-1386742f40e3-original-pull-secret") pod "global-pull-secret-syncer-9mws2" (UID: "a588c630-f4a9-49b7-9ff1-1386742f40e3") : object "kube-system"/"original-pull-secret" not registered
Sep 20 00:48:19.206303 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:19.206266    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5hsb\" (UniqueName: \"kubernetes.io/projected/e0167375-aa59-43a4-a5ba-e0b165da8b30-kube-api-access-l5hsb\") pod \"network-check-target-t6qv8\" (UID: \"e0167375-aa59-43a4-a5ba-e0b165da8b30\") " pod="openshift-network-diagnostics/network-check-target-t6qv8"
Sep 20 00:48:19.206484 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:19.206442    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 20 00:48:19.206484 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:19.206469    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 20 00:48:19.206484 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:19.206481    2570 projected.go:196] Error preparing data for projected volume kube-api-access-l5hsb for pod openshift-network-diagnostics/network-check-target-t6qv8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 20 00:48:19.206641 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:19.206547    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0167375-aa59-43a4-a5ba-e0b165da8b30-kube-api-access-l5hsb podName:e0167375-aa59-43a4-a5ba-e0b165da8b30 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:51.20652786 +0000 UTC m=+67.820683749 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-l5hsb" (UniqueName: "kubernetes.io/projected/e0167375-aa59-43a4-a5ba-e0b165da8b30-kube-api-access-l5hsb") pod "network-check-target-t6qv8" (UID: "e0167375-aa59-43a4-a5ba-e0b165da8b30") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 20 00:48:19.447428 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:19.447392    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mws2"
Sep 20 00:48:19.447610 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:19.447401    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94nzn"
Sep 20 00:48:19.447610 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:19.447536    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6qv8"
Sep 20 00:48:19.447610 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:19.447529    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mws2" podUID="a588c630-f4a9-49b7-9ff1-1386742f40e3"
Sep 20 00:48:19.447763 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:19.447672    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94nzn" podUID="a0d1f872-b92c-4b72-bdee-a7ac18493d84"
Sep 20 00:48:19.447763 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:19.447740    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6qv8" podUID="e0167375-aa59-43a4-a5ba-e0b165da8b30"
Sep 20 00:48:21.447627 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:21.447598    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6qv8"
Sep 20 00:48:21.447627 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:21.447618    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94nzn"
Sep 20 00:48:21.448228 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:21.447598    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mws2"
Sep 20 00:48:21.448228 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:21.447706    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6qv8" podUID="e0167375-aa59-43a4-a5ba-e0b165da8b30"
Sep 20 00:48:21.448228 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:21.447773    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94nzn" podUID="a0d1f872-b92c-4b72-bdee-a7ac18493d84"
Sep 20 00:48:21.448228 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:21.447888    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mws2" podUID="a588c630-f4a9-49b7-9ff1-1386742f40e3"
Sep 20 00:48:21.748304 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:21.748211    2570 generic.go:356] "Generic (PLEG): container finished" podID="0922c703-f848-4c79-9355-82285e120a06" containerID="1c6c13cd10cbd5039e81838af09ce572e2d01fc04cf0a9578a3d3535c284be69" exitCode=0
Sep 20 00:48:21.748304 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:21.748267    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ghfbt" event={"ID":"0922c703-f848-4c79-9355-82285e120a06","Type":"ContainerDied","Data":"1c6c13cd10cbd5039e81838af09ce572e2d01fc04cf0a9578a3d3535c284be69"}
Sep 20 00:48:22.753624 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:22.753593    2570 generic.go:356] "Generic (PLEG): container finished" podID="0922c703-f848-4c79-9355-82285e120a06" containerID="43979ed7f963fe599d7195d6385d03a9c368f954d5a0e862a99db9e67a9a2ae3" exitCode=0
Sep 20 00:48:22.754093 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:22.753639    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ghfbt" event={"ID":"0922c703-f848-4c79-9355-82285e120a06","Type":"ContainerDied","Data":"43979ed7f963fe599d7195d6385d03a9c368f954d5a0e862a99db9e67a9a2ae3"}
Sep 20 00:48:23.447332 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:23.447308    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94nzn"
Sep 20 00:48:23.447490 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:23.447345    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6qv8"
Sep 20 00:48:23.447490 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:23.447307    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mws2"
Sep 20 00:48:23.447490 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:23.447431    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94nzn" podUID="a0d1f872-b92c-4b72-bdee-a7ac18493d84"
Sep 20 00:48:23.447674 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:23.447493    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mws2" podUID="a588c630-f4a9-49b7-9ff1-1386742f40e3"
Sep 20 00:48:23.447674 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:23.447590    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6qv8" podUID="e0167375-aa59-43a4-a5ba-e0b165da8b30"
Sep 20 00:48:23.759734 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:23.759703    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ghfbt" event={"ID":"0922c703-f848-4c79-9355-82285e120a06","Type":"ContainerStarted","Data":"e12054c41eacb1e58cc954c95e7f315e7b9d91dc31ca13d680e6e0f46f0936be"}
Sep 20 00:48:23.779256 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:23.779214    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ghfbt" podStartSLOduration=10.619429937 podStartE2EDuration="38.779201088s" totalImagesPullingTime="28.159771151s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-20 00:47:45 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:23.77899037 +0000 UTC m=+40.393146286" watchObservedRunningTime="2026-09-20 00:48:23.779201088 +0000 UTC m=+40.393356985"
Sep 20 00:48:25.447994 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:25.447961    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mws2"
Sep 20 00:48:25.448465 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:25.448035    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6qv8"
Sep 20 00:48:25.448465 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:25.448059    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mws2" podUID="a588c630-f4a9-49b7-9ff1-1386742f40e3"
Sep 20 00:48:25.448465 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:25.448100    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6qv8" podUID="e0167375-aa59-43a4-a5ba-e0b165da8b30"
Sep 20 00:48:25.448465 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:25.448150    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94nzn"
Sep 20 00:48:25.448465 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:25.448231    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94nzn" podUID="a0d1f872-b92c-4b72-bdee-a7ac18493d84"
Sep 20 00:48:27.447781 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:27.447747    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6qv8"
Sep 20 00:48:27.447781 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:27.447769    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94nzn"
Sep 20 00:48:27.448302 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:27.447747    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mws2"
Sep 20 00:48:27.448302 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:27.447851    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6qv8" podUID="e0167375-aa59-43a4-a5ba-e0b165da8b30"
Sep 20 00:48:27.448302 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:27.447954    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94nzn" podUID="a0d1f872-b92c-4b72-bdee-a7ac18493d84"
Sep 20 00:48:27.448302 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:27.448028    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mws2" podUID="a588c630-f4a9-49b7-9ff1-1386742f40e3"
Sep 20 00:48:29.447229 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:29.447195    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mws2"
Sep 20 00:48:29.447611 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:29.447197    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6qv8"
Sep 20 00:48:29.447611 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:29.447314    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mws2" podUID="a588c630-f4a9-49b7-9ff1-1386742f40e3"
Sep 20 00:48:29.447611 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:29.447211    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94nzn"
Sep 20 00:48:29.447611 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:29.447357    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6qv8" podUID="e0167375-aa59-43a4-a5ba-e0b165da8b30"
Sep 20 00:48:29.447611 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:29.447436    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94nzn" podUID="a0d1f872-b92c-4b72-bdee-a7ac18493d84"
Sep 20 00:48:31.447413 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:31.447383    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mws2"
Sep 20 00:48:31.447413 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:31.447405    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94nzn"
Sep 20 00:48:31.447815 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:31.447383    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6qv8"
Sep 20 00:48:31.447815 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:31.447490    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mws2" podUID="a588c630-f4a9-49b7-9ff1-1386742f40e3"
Sep 20 00:48:31.447815 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:31.447549    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t6qv8" podUID="e0167375-aa59-43a4-a5ba-e0b165da8b30"
Sep 20 00:48:31.447815 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:31.447631    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94nzn" podUID="a0d1f872-b92c-4b72-bdee-a7ac18493d84"
Sep 20 00:48:33.269970 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.269944    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-108.ec2.internal" event="NodeReady"
Sep 20 00:48:33.270275 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.270070    2570 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 20 00:48:33.318276 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.318247    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-r6nc6"]
Sep 20 00:48:33.331253 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.331227    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-chdwt"]
Sep 20 00:48:33.331380 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.331356    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-r6nc6"
Sep 20 00:48:33.333303 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.333282    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 20 00:48:33.333429 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.333282    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 20 00:48:33.333429 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.333334    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 20 00:48:33.333627 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.333610    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wzh76\""
Sep 20 00:48:33.333701 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.333679    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 20 00:48:33.341378 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.341357    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-chdwt"]
Sep 20 00:48:33.341472 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.341386    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-r6nc6"]
Sep 20 00:48:33.341508 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.341470    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-chdwt"
Sep 20 00:48:33.343718 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.343701    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bsbfw\""
Sep 20 00:48:33.343814 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.343733    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 20 00:48:33.343814 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.343756    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 20 00:48:33.343814 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.343733    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 20 00:48:33.415813 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.415781    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qrjb2"]
Sep 20 00:48:33.439497 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.439441    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qrjb2"]
Sep 20 00:48:33.439603 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.439546    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qrjb2"
Sep 20 00:48:33.441621 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.441588    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 20 00:48:33.441745 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.441734    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wd7tm\""
Sep 20 00:48:33.441852 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.441836    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 20 00:48:33.447178 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.447159    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mws2"
Sep 20 00:48:33.447289 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.447176    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6qv8"
Sep 20 00:48:33.447289 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.447179    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94nzn"
Sep 20 00:48:33.450663 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.449236    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 20 00:48:33.450663 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.450166    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 20 00:48:33.450663 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.450448    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 20 00:48:33.450663 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.450565    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lkppn\""
Sep 20 00:48:33.451188 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.450970    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fnqwj\""
Sep 20 00:48:33.451188 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.451091    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 20 00:48:33.511478 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.511455    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tsph\" (UniqueName: \"kubernetes.io/projected/58c25490-b7ea-4685-b91e-3d9f0c365538-kube-api-access-7tsph\") pod \"insights-runtime-extractor-r6nc6\" (UID: \"58c25490-b7ea-4685-b91e-3d9f0c365538\") " pod="openshift-insights/insights-runtime-extractor-r6nc6"
Sep 20 00:48:33.511596 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.511487    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/58c25490-b7ea-4685-b91e-3d9f0c365538-crio-socket\") pod \"insights-runtime-extractor-r6nc6\" (UID: \"58c25490-b7ea-4685-b91e-3d9f0c365538\") " pod="openshift-insights/insights-runtime-extractor-r6nc6"
Sep 20 00:48:33.511596 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.511518    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/58c25490-b7ea-4685-b91e-3d9f0c365538-data-volume\") pod \"insights-runtime-extractor-r6nc6\" (UID: \"58c25490-b7ea-4685-b91e-3d9f0c365538\") " pod="openshift-insights/insights-runtime-extractor-r6nc6"
Sep 20 00:48:33.511596 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.511539    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be4b8837-ac8d-4851-a2c5-40f016b30525-cert\") pod \"ingress-canary-chdwt\" (UID: \"be4b8837-ac8d-4851-a2c5-40f016b30525\") " pod="openshift-ingress-canary/ingress-canary-chdwt"
Sep 20 00:48:33.511596 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.511556    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/58c25490-b7ea-4685-b91e-3d9f0c365538-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r6nc6\" (UID: \"58c25490-b7ea-4685-b91e-3d9f0c365538\") " pod="openshift-insights/insights-runtime-extractor-r6nc6"
Sep 20 00:48:33.511720 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.511631    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/58c25490-b7ea-4685-b91e-3d9f0c365538-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r6nc6\" (UID: \"58c25490-b7ea-4685-b91e-3d9f0c365538\") " pod="openshift-insights/insights-runtime-extractor-r6nc6"
Sep 20 00:48:33.511720 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.511657    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4njbh\" (UniqueName: \"kubernetes.io/projected/be4b8837-ac8d-4851-a2c5-40f016b30525-kube-api-access-4njbh\") pod \"ingress-canary-chdwt\" (UID: \"be4b8837-ac8d-4851-a2c5-40f016b30525\") " pod="openshift-ingress-canary/ingress-canary-chdwt"
Sep 20 00:48:33.612830 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.612798    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/58c25490-b7ea-4685-b91e-3d9f0c365538-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r6nc6\" (UID: \"58c25490-b7ea-4685-b91e-3d9f0c365538\") " pod="openshift-insights/insights-runtime-extractor-r6nc6"
Sep 20 00:48:33.612830 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.612832    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4njbh\" (UniqueName: \"kubernetes.io/projected/be4b8837-ac8d-4851-a2c5-40f016b30525-kube-api-access-4njbh\") pod \"ingress-canary-chdwt\" (UID: \"be4b8837-ac8d-4851-a2c5-40f016b30525\") " pod="openshift-ingress-canary/ingress-canary-chdwt"
Sep 20 00:48:33.613034 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.612897    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tsph\" (UniqueName: \"kubernetes.io/projected/58c25490-b7ea-4685-b91e-3d9f0c365538-kube-api-access-7tsph\") pod \"insights-runtime-extractor-r6nc6\" (UID: \"58c25490-b7ea-4685-b91e-3d9f0c365538\") " pod="openshift-insights/insights-runtime-extractor-r6nc6"
Sep 20 00:48:33.613034 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.612918    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/58c25490-b7ea-4685-b91e-3d9f0c365538-crio-socket\") pod \"insights-runtime-extractor-r6nc6\" (UID: \"58c25490-b7ea-4685-b91e-3d9f0c365538\") " pod="openshift-insights/insights-runtime-extractor-r6nc6"
Sep 20 00:48:33.613034 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.612956    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/58c25490-b7ea-4685-b91e-3d9f0c365538-data-volume\") pod \"insights-runtime-extractor-r6nc6\" (UID: \"58c25490-b7ea-4685-b91e-3d9f0c365538\") " pod="openshift-insights/insights-runtime-extractor-r6nc6"
Sep 20 00:48:33.613034 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.612980    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c4722ca-5852-4741-ac72-c7f9e17e4e70-metrics-tls\") pod \"dns-default-qrjb2\" (UID: \"7c4722ca-5852-4741-ac72-c7f9e17e4e70\") " pod="openshift-dns/dns-default-qrjb2"
Sep 20 00:48:33.613034 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.613019    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c4722ca-5852-4741-ac72-c7f9e17e4e70-tmp-dir\") pod \"dns-default-qrjb2\" (UID: \"7c4722ca-5852-4741-ac72-c7f9e17e4e70\") " pod="openshift-dns/dns-default-qrjb2"
Sep 20 00:48:33.613270 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.613049    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be4b8837-ac8d-4851-a2c5-40f016b30525-cert\") pod \"ingress-canary-chdwt\" (UID: \"be4b8837-ac8d-4851-a2c5-40f016b30525\") " pod="openshift-ingress-canary/ingress-canary-chdwt"
Sep 20 00:48:33.613270 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.613075    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/58c25490-b7ea-4685-b91e-3d9f0c365538-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r6nc6\" (UID: \"58c25490-b7ea-4685-b91e-3d9f0c365538\") " pod="openshift-insights/insights-runtime-extractor-r6nc6"
Sep 20 00:48:33.613270 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.613103    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7c4722ca-5852-4741-ac72-c7f9e17e4e70-config-volume\") pod \"dns-default-qrjb2\" (UID: \"7c4722ca-5852-4741-ac72-c7f9e17e4e70\") " pod="openshift-dns/dns-default-qrjb2"
Sep 20 00:48:33.613270 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.613128    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87zxp\" (UniqueName: \"kubernetes.io/projected/7c4722ca-5852-4741-ac72-c7f9e17e4e70-kube-api-access-87zxp\") pod \"dns-default-qrjb2\" (UID: \"7c4722ca-5852-4741-ac72-c7f9e17e4e70\") " pod="openshift-dns/dns-default-qrjb2"
Sep 20 00:48:33.613270 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.613176    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/58c25490-b7ea-4685-b91e-3d9f0c365538-crio-socket\") pod \"insights-runtime-extractor-r6nc6\" (UID: \"58c25490-b7ea-4685-b91e-3d9f0c365538\") " pod="openshift-insights/insights-runtime-extractor-r6nc6"
Sep 20 00:48:33.613492 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.613267    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/58c25490-b7ea-4685-b91e-3d9f0c365538-data-volume\") pod \"insights-runtime-extractor-r6nc6\" (UID: \"58c25490-b7ea-4685-b91e-3d9f0c365538\") " pod="openshift-insights/insights-runtime-extractor-r6nc6"
Sep 20 00:48:33.613685 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.613660    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/58c25490-b7ea-4685-b91e-3d9f0c365538-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r6nc6\" (UID: \"58c25490-b7ea-4685-b91e-3d9f0c365538\") " pod="openshift-insights/insights-runtime-extractor-r6nc6"
Sep 20 00:48:33.616920 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.616895    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/58c25490-b7ea-4685-b91e-3d9f0c365538-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r6nc6\" (UID: \"58c25490-b7ea-4685-b91e-3d9f0c365538\") " pod="openshift-insights/insights-runtime-extractor-r6nc6"
Sep 20 00:48:33.617203 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.617184    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be4b8837-ac8d-4851-a2c5-40f016b30525-cert\") pod \"ingress-canary-chdwt\" (UID: \"be4b8837-ac8d-4851-a2c5-40f016b30525\") " pod="openshift-ingress-canary/ingress-canary-chdwt"
Sep 20 00:48:33.619995 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.619976    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tsph\" (UniqueName: \"kubernetes.io/projected/58c25490-b7ea-4685-b91e-3d9f0c365538-kube-api-access-7tsph\") pod \"insights-runtime-extractor-r6nc6\" (UID: \"58c25490-b7ea-4685-b91e-3d9f0c365538\") " pod="openshift-insights/insights-runtime-extractor-r6nc6"
Sep 20 00:48:33.620150 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.620129    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4njbh\" (UniqueName: \"kubernetes.io/projected/be4b8837-ac8d-4851-a2c5-40f016b30525-kube-api-access-4njbh\") pod \"ingress-canary-chdwt\" (UID: \"be4b8837-ac8d-4851-a2c5-40f016b30525\") " pod="openshift-ingress-canary/ingress-canary-chdwt"
Sep 20 00:48:33.641014 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.640996    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-r6nc6"
Sep 20 00:48:33.649109 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.649092    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-chdwt"
Sep 20 00:48:33.714322 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.714292    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c4722ca-5852-4741-ac72-c7f9e17e4e70-metrics-tls\") pod \"dns-default-qrjb2\" (UID: \"7c4722ca-5852-4741-ac72-c7f9e17e4e70\") " pod="openshift-dns/dns-default-qrjb2"
Sep 20 00:48:33.714322 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.714334    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c4722ca-5852-4741-ac72-c7f9e17e4e70-tmp-dir\") pod \"dns-default-qrjb2\" (UID: \"7c4722ca-5852-4741-ac72-c7f9e17e4e70\") " pod="openshift-dns/dns-default-qrjb2"
Sep 20 00:48:33.714539 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.714374    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7c4722ca-5852-4741-ac72-c7f9e17e4e70-config-volume\") pod \"dns-default-qrjb2\" (UID: \"7c4722ca-5852-4741-ac72-c7f9e17e4e70\") " pod="openshift-dns/dns-default-qrjb2"
Sep 20 00:48:33.714539 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.714423    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87zxp\" (UniqueName: \"kubernetes.io/projected/7c4722ca-5852-4741-ac72-c7f9e17e4e70-kube-api-access-87zxp\") pod \"dns-default-qrjb2\" (UID: \"7c4722ca-5852-4741-ac72-c7f9e17e4e70\") " pod="openshift-dns/dns-default-qrjb2"
Sep 20 00:48:33.714976 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.714942    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c4722ca-5852-4741-ac72-c7f9e17e4e70-tmp-dir\") pod \"dns-default-qrjb2\" (UID: \"7c4722ca-5852-4741-ac72-c7f9e17e4e70\") " pod="openshift-dns/dns-default-qrjb2"
Sep 20 00:48:33.715205 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.715182    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7c4722ca-5852-4741-ac72-c7f9e17e4e70-config-volume\") pod \"dns-default-qrjb2\" (UID: \"7c4722ca-5852-4741-ac72-c7f9e17e4e70\") " pod="openshift-dns/dns-default-qrjb2"
Sep 20 00:48:33.717075 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.717050    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c4722ca-5852-4741-ac72-c7f9e17e4e70-metrics-tls\") pod \"dns-default-qrjb2\" (UID: \"7c4722ca-5852-4741-ac72-c7f9e17e4e70\") " pod="openshift-dns/dns-default-qrjb2"
Sep 20 00:48:33.721854 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.721829    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87zxp\" (UniqueName: \"kubernetes.io/projected/7c4722ca-5852-4741-ac72-c7f9e17e4e70-kube-api-access-87zxp\") pod \"dns-default-qrjb2\" (UID: \"7c4722ca-5852-4741-ac72-c7f9e17e4e70\") " pod="openshift-dns/dns-default-qrjb2"
Sep 20 00:48:33.747812 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.747785    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qrjb2"
Sep 20 00:48:33.959768 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.959696    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-chdwt"]
Sep 20 00:48:33.963116 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:33.963093    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-r6nc6"]
Sep 20 00:48:33.963224 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:48:33.963182    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe4b8837_ac8d_4851_a2c5_40f016b30525.slice/crio-e300fab99fee1009a430f3c55f3feb671288fab61814d1aaa6d5be9700a3919b WatchSource:0}: Error finding container e300fab99fee1009a430f3c55f3feb671288fab61814d1aaa6d5be9700a3919b: Status 404 returned error can't find the container with id e300fab99fee1009a430f3c55f3feb671288fab61814d1aaa6d5be9700a3919b
Sep 20 00:48:33.966163 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:48:33.966142    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58c25490_b7ea_4685_b91e_3d9f0c365538.slice/crio-ff56a5b96a77f163ed44b8bd25233e1b33509bcfe6f41bdc62e12110bcda1c78 WatchSource:0}: Error finding container ff56a5b96a77f163ed44b8bd25233e1b33509bcfe6f41bdc62e12110bcda1c78: Status 404 returned error can't find the container with id ff56a5b96a77f163ed44b8bd25233e1b33509bcfe6f41bdc62e12110bcda1c78
Sep 20 00:48:34.046768 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:34.046744    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qrjb2"]
Sep 20 00:48:34.057752 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:48:34.057727    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c4722ca_5852_4741_ac72_c7f9e17e4e70.slice/crio-85c7eb6d9a6b3b113642178528eb5286c6569915b0410bb9bacdd902cc4e7613 WatchSource:0}: Error finding container 85c7eb6d9a6b3b113642178528eb5286c6569915b0410bb9bacdd902cc4e7613: Status 404 returned error can't find the container with id 85c7eb6d9a6b3b113642178528eb5286c6569915b0410bb9bacdd902cc4e7613
Sep 20 00:48:34.788692 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:34.788620    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qrjb2" event={"ID":"7c4722ca-5852-4741-ac72-c7f9e17e4e70","Type":"ContainerStarted","Data":"85c7eb6d9a6b3b113642178528eb5286c6569915b0410bb9bacdd902cc4e7613"}
Sep 20 00:48:34.790204 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:34.790176    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-chdwt" event={"ID":"be4b8837-ac8d-4851-a2c5-40f016b30525","Type":"ContainerStarted","Data":"e300fab99fee1009a430f3c55f3feb671288fab61814d1aaa6d5be9700a3919b"}
Sep 20 00:48:34.792086 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:34.792062    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r6nc6" event={"ID":"58c25490-b7ea-4685-b91e-3d9f0c365538","Type":"ContainerStarted","Data":"56e380c15d5f269ce6400a0dad06bb668073871041c6f9d1f45c0fb88f1c6295"}
Sep 20 00:48:34.792162 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:34.792116    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r6nc6" event={"ID":"58c25490-b7ea-4685-b91e-3d9f0c365538","Type":"ContainerStarted","Data":"ff56a5b96a77f163ed44b8bd25233e1b33509bcfe6f41bdc62e12110bcda1c78"}
Sep 20 00:48:35.795915 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:35.795884    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r6nc6" event={"ID":"58c25490-b7ea-4685-b91e-3d9f0c365538","Type":"ContainerStarted","Data":"8ab5935008365ad18f55ba0921e0f6cd2de58841d23e674d17930ec9abd42c20"}
Sep 20 00:48:37.161366 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:37.161332    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-vjkqj"]
Sep 20 00:48:37.185839 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:37.185817    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-vjkqj"]
Sep 20 00:48:37.186003 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:37.185921    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-vjkqj"
Sep 20 00:48:37.188247 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:37.188228    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 20 00:48:37.188365 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:37.188278    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-rhj9q\""
Sep 20 00:48:37.342739 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:37.342663    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1171b65f-910d-410a-8004-d85fd9ef639c-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-vjkqj\" (UID: \"1171b65f-910d-410a-8004-d85fd9ef639c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-vjkqj"
Sep 20 00:48:37.443330 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:37.443296    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1171b65f-910d-410a-8004-d85fd9ef639c-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-vjkqj\" (UID: \"1171b65f-910d-410a-8004-d85fd9ef639c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-vjkqj"
Sep 20 00:48:37.443510 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:37.443488    2570 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Sep 20 00:48:37.443620 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:37.443563    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1171b65f-910d-410a-8004-d85fd9ef639c-tls-certificates podName:1171b65f-910d-410a-8004-d85fd9ef639c nodeName:}" failed. No retries permitted until 2026-09-20 00:48:37.943542147 +0000 UTC m=+54.557698021 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/1171b65f-910d-410a-8004-d85fd9ef639c-tls-certificates") pod "prometheus-operator-admission-webhook-5c6747dc7b-vjkqj" (UID: "1171b65f-910d-410a-8004-d85fd9ef639c") : secret "prometheus-operator-admission-webhook-tls" not found
Sep 20 00:48:37.803190 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:37.803160    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qrjb2" event={"ID":"7c4722ca-5852-4741-ac72-c7f9e17e4e70","Type":"ContainerStarted","Data":"d7dd4a7ccdc545ef81573a390f8eaea4cd5bacf157123259a7bc17a10f8a6227"}
Sep 20 00:48:37.803307 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:37.803217    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qrjb2" event={"ID":"7c4722ca-5852-4741-ac72-c7f9e17e4e70","Type":"ContainerStarted","Data":"b487c4d5ce70c0f336211efbc3ec5270895771c118a57160404e56343f711a7d"}
Sep 20 00:48:37.803307 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:37.803241    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qrjb2"
Sep 20 00:48:37.804614 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:37.804595    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-chdwt" event={"ID":"be4b8837-ac8d-4851-a2c5-40f016b30525","Type":"ContainerStarted","Data":"c175f80f79e3ac30451548092ba01886abd8b620df1add0e110bfba8c9420bb1"}
Sep 20 00:48:37.820474 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:37.820436    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qrjb2" podStartSLOduration=1.472284916 podStartE2EDuration="4.820421685s" totalImagesPullingTime="3.348136769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:48:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:37.819637636 +0000 UTC m=+54.433793546" watchObservedRunningTime="2026-09-20 00:48:37.820421685 +0000 UTC m=+54.434577579"
Sep 20 00:48:37.834749 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:37.834709    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-chdwt" podStartSLOduration=1.39240822 podStartE2EDuration="4.834694446s" totalImagesPullingTime="3.442286226s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:48:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:37.834198086 +0000 UTC m=+54.448354001" watchObservedRunningTime="2026-09-20 00:48:37.834694446 +0000 UTC m=+54.448850343"
Sep 20 00:48:37.947750 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:37.947715    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1171b65f-910d-410a-8004-d85fd9ef639c-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-vjkqj\" (UID: \"1171b65f-910d-410a-8004-d85fd9ef639c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-vjkqj"
Sep 20 00:48:37.950363 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:37.950337    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1171b65f-910d-410a-8004-d85fd9ef639c-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-vjkqj\" (UID: \"1171b65f-910d-410a-8004-d85fd9ef639c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-vjkqj"
Sep 20 00:48:38.096599 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:38.096564    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-vjkqj"
Sep 20 00:48:38.384385 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:38.384355    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-vjkqj"]
Sep 20 00:48:38.387445 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:48:38.387420    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1171b65f_910d_410a_8004_d85fd9ef639c.slice/crio-990955f13d8dc369d12186abdf9dba6b18c55d7898dfa3007bd9326bc4cf14d6 WatchSource:0}: Error finding container 990955f13d8dc369d12186abdf9dba6b18c55d7898dfa3007bd9326bc4cf14d6: Status 404 returned error can't find the container with id 990955f13d8dc369d12186abdf9dba6b18c55d7898dfa3007bd9326bc4cf14d6
Sep 20 00:48:38.811315 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:38.811226    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r6nc6" event={"ID":"58c25490-b7ea-4685-b91e-3d9f0c365538","Type":"ContainerStarted","Data":"a6ae244d741a6c45eeba229d0040ecafd67f435d0ce5389b0044dcb47b6f7059"}
Sep 20 00:48:38.812831 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:38.812807    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-vjkqj" event={"ID":"1171b65f-910d-410a-8004-d85fd9ef639c","Type":"ContainerStarted","Data":"990955f13d8dc369d12186abdf9dba6b18c55d7898dfa3007bd9326bc4cf14d6"}
Sep 20 00:48:38.827724 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:38.827672    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-r6nc6" podStartSLOduration=2.349790062 podStartE2EDuration="5.827659912s" totalImagesPullingTime="3.47786985s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-20 00:48:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:38.826648172 +0000 UTC m=+55.440804115" watchObservedRunningTime="2026-09-20 00:48:38.827659912 +0000 UTC m=+55.441815809"
Sep 20 00:48:40.820946 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:40.820907    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-vjkqj" event={"ID":"1171b65f-910d-410a-8004-d85fd9ef639c","Type":"ContainerStarted","Data":"3a9fe33154ed35d24d83c53a0d9cff9ab31596024fec44ead9ab1548d304329a"}
Sep 20 00:48:40.821374 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:40.821057    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-vjkqj"
Sep 20 00:48:40.825704 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:40.825680    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-vjkqj"
Sep 20 00:48:40.835743 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:40.835702    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-vjkqj" podStartSLOduration=2.399021803 podStartE2EDuration="3.835687936s" totalImagesPullingTime="1.436666133s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:48:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:40.835226175 +0000 UTC m=+57.449382098" watchObservedRunningTime="2026-09-20 00:48:40.835687936 +0000 UTC m=+57.449843833"
Sep 20 00:48:41.224087 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:41.224054    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-gfrkj"]
Sep 20 00:48:41.245333 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:41.245310    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-gfrkj"]
Sep 20 00:48:41.245469 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:41.245416    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-gfrkj"
Sep 20 00:48:41.247889 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:41.247848    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 20 00:48:41.248000 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:41.247899    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 20 00:48:41.248000 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:41.247873    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 20 00:48:41.248000 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:41.247954    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-dksgw\""
Sep 20 00:48:41.249887 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:41.249007    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 20 00:48:41.249887 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:41.249009    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 20 00:48:41.369159 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:41.369129    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/199273a0-d5e1-42fa-94f4-57f2d74b06b6-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-gfrkj\" (UID: \"199273a0-d5e1-42fa-94f4-57f2d74b06b6\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-gfrkj"
Sep 20 00:48:41.369297 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:41.369239    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/199273a0-d5e1-42fa-94f4-57f2d74b06b6-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-gfrkj\" (UID: \"199273a0-d5e1-42fa-94f4-57f2d74b06b6\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-gfrkj"
Sep 20 00:48:41.369297 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:41.369270    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/199273a0-d5e1-42fa-94f4-57f2d74b06b6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-gfrkj\" (UID: \"199273a0-d5e1-42fa-94f4-57f2d74b06b6\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-gfrkj"
Sep 20 00:48:41.369297 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:41.369289    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cd879\" (UniqueName: \"kubernetes.io/projected/199273a0-d5e1-42fa-94f4-57f2d74b06b6-kube-api-access-cd879\") pod \"prometheus-operator-7bd5d56d6-gfrkj\" (UID: \"199273a0-d5e1-42fa-94f4-57f2d74b06b6\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-gfrkj"
Sep 20 00:48:41.470551 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:41.470517    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/199273a0-d5e1-42fa-94f4-57f2d74b06b6-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-gfrkj\" (UID: \"199273a0-d5e1-42fa-94f4-57f2d74b06b6\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-gfrkj"
Sep 20 00:48:41.470715 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:41.470553    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/199273a0-d5e1-42fa-94f4-57f2d74b06b6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-gfrkj\" (UID: \"199273a0-d5e1-42fa-94f4-57f2d74b06b6\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-gfrkj"
Sep 20 00:48:41.470715 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:41.470578    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cd879\" (UniqueName: \"kubernetes.io/projected/199273a0-d5e1-42fa-94f4-57f2d74b06b6-kube-api-access-cd879\") pod \"prometheus-operator-7bd5d56d6-gfrkj\" (UID: \"199273a0-d5e1-42fa-94f4-57f2d74b06b6\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-gfrkj"
Sep 20 00:48:41.470830 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:41.470742    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/199273a0-d5e1-42fa-94f4-57f2d74b06b6-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-gfrkj\" (UID: \"199273a0-d5e1-42fa-94f4-57f2d74b06b6\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-gfrkj"
Sep 20 00:48:41.471357 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:41.471334    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/199273a0-d5e1-42fa-94f4-57f2d74b06b6-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-gfrkj\" (UID: \"199273a0-d5e1-42fa-94f4-57f2d74b06b6\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-gfrkj"
Sep 20 00:48:41.473041 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:41.473016    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/199273a0-d5e1-42fa-94f4-57f2d74b06b6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-gfrkj\" (UID: \"199273a0-d5e1-42fa-94f4-57f2d74b06b6\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-gfrkj"
Sep 20 00:48:41.473130 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:41.473097    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/199273a0-d5e1-42fa-94f4-57f2d74b06b6-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-gfrkj\" (UID: \"199273a0-d5e1-42fa-94f4-57f2d74b06b6\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-gfrkj"
Sep 20 00:48:41.478248 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:41.478189    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cd879\" (UniqueName: \"kubernetes.io/projected/199273a0-d5e1-42fa-94f4-57f2d74b06b6-kube-api-access-cd879\") pod \"prometheus-operator-7bd5d56d6-gfrkj\" (UID: \"199273a0-d5e1-42fa-94f4-57f2d74b06b6\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-gfrkj"
Sep 20 00:48:41.556097 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:41.556074    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-gfrkj"
Sep 20 00:48:41.842020 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:41.841954    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-gfrkj"]
Sep 20 00:48:41.845041 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:48:41.845017    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod199273a0_d5e1_42fa_94f4_57f2d74b06b6.slice/crio-0907e1e64105866d233a089c3d54e28246fc92599c066680c7c640754f78a3d5 WatchSource:0}: Error finding container 0907e1e64105866d233a089c3d54e28246fc92599c066680c7c640754f78a3d5: Status 404 returned error can't find the container with id 0907e1e64105866d233a089c3d54e28246fc92599c066680c7c640754f78a3d5
Sep 20 00:48:42.828999 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:42.828914    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-gfrkj" event={"ID":"199273a0-d5e1-42fa-94f4-57f2d74b06b6","Type":"ContainerStarted","Data":"0907e1e64105866d233a089c3d54e28246fc92599c066680c7c640754f78a3d5"}
Sep 20 00:48:42.954934 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:42.954904    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d7bfffc48-jdrmz"]
Sep 20 00:48:42.970576 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:42.970537    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d7bfffc48-jdrmz"]
Sep 20 00:48:42.970715 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:42.970654    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d7bfffc48-jdrmz"
Sep 20 00:48:42.973549 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:42.973075    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 20 00:48:42.973549 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:42.973205    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 20 00:48:42.973549 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:42.973368    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 20 00:48:42.973549 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:42.973452    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 20 00:48:42.973954 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:42.973903    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 20 00:48:42.974564 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:42.974113    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 20 00:48:42.974564 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:42.974170    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 20 00:48:42.974564 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:42.974331    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-z8v9r\""
Sep 20 00:48:43.084943 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:43.084837    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0e8a5437-95e7-4fed-baca-62bae7d71c4a-console-config\") pod \"console-5d7bfffc48-jdrmz\" (UID: \"0e8a5437-95e7-4fed-baca-62bae7d71c4a\") " pod="openshift-console/console-5d7bfffc48-jdrmz"
Sep 20 00:48:43.085119 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:43.084978    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0e8a5437-95e7-4fed-baca-62bae7d71c4a-service-ca\") pod \"console-5d7bfffc48-jdrmz\" (UID: \"0e8a5437-95e7-4fed-baca-62bae7d71c4a\") " pod="openshift-console/console-5d7bfffc48-jdrmz"
Sep 20 00:48:43.085119 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:43.085014    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0e8a5437-95e7-4fed-baca-62bae7d71c4a-console-oauth-config\") pod \"console-5d7bfffc48-jdrmz\" (UID: \"0e8a5437-95e7-4fed-baca-62bae7d71c4a\") " pod="openshift-console/console-5d7bfffc48-jdrmz"
Sep 20 00:48:43.085119 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:43.085031    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0e8a5437-95e7-4fed-baca-62bae7d71c4a-oauth-serving-cert\") pod \"console-5d7bfffc48-jdrmz\" (UID: \"0e8a5437-95e7-4fed-baca-62bae7d71c4a\") " pod="openshift-console/console-5d7bfffc48-jdrmz"
Sep 20 00:48:43.085119 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:43.085048    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcwbp\" (UniqueName: \"kubernetes.io/projected/0e8a5437-95e7-4fed-baca-62bae7d71c4a-kube-api-access-gcwbp\") pod \"console-5d7bfffc48-jdrmz\" (UID: \"0e8a5437-95e7-4fed-baca-62bae7d71c4a\") " pod="openshift-console/console-5d7bfffc48-jdrmz"
Sep 20 00:48:43.085119 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:43.085077    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e8a5437-95e7-4fed-baca-62bae7d71c4a-console-serving-cert\") pod \"console-5d7bfffc48-jdrmz\" (UID: \"0e8a5437-95e7-4fed-baca-62bae7d71c4a\") " pod="openshift-console/console-5d7bfffc48-jdrmz"
Sep 20 00:48:43.186471 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:43.186444    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0e8a5437-95e7-4fed-baca-62bae7d71c4a-console-oauth-config\") pod \"console-5d7bfffc48-jdrmz\" (UID: \"0e8a5437-95e7-4fed-baca-62bae7d71c4a\") " pod="openshift-console/console-5d7bfffc48-jdrmz"
Sep 20 00:48:43.186567 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:43.186484    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0e8a5437-95e7-4fed-baca-62bae7d71c4a-oauth-serving-cert\") pod \"console-5d7bfffc48-jdrmz\" (UID: \"0e8a5437-95e7-4fed-baca-62bae7d71c4a\") " pod="openshift-console/console-5d7bfffc48-jdrmz"
Sep 20 00:48:43.186567 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:43.186512    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcwbp\" (UniqueName: \"kubernetes.io/projected/0e8a5437-95e7-4fed-baca-62bae7d71c4a-kube-api-access-gcwbp\") pod \"console-5d7bfffc48-jdrmz\" (UID: \"0e8a5437-95e7-4fed-baca-62bae7d71c4a\") " pod="openshift-console/console-5d7bfffc48-jdrmz"
Sep 20 00:48:43.186567 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:43.186536    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e8a5437-95e7-4fed-baca-62bae7d71c4a-console-serving-cert\") pod \"console-5d7bfffc48-jdrmz\" (UID: \"0e8a5437-95e7-4fed-baca-62bae7d71c4a\") " pod="openshift-console/console-5d7bfffc48-jdrmz"
Sep 20 00:48:43.186707 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:43.186569    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0e8a5437-95e7-4fed-baca-62bae7d71c4a-console-config\") pod \"console-5d7bfffc48-jdrmz\" (UID: \"0e8a5437-95e7-4fed-baca-62bae7d71c4a\") " pod="openshift-console/console-5d7bfffc48-jdrmz"
Sep 20 00:48:43.186801 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:43.186780    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0e8a5437-95e7-4fed-baca-62bae7d71c4a-service-ca\") pod \"console-5d7bfffc48-jdrmz\" (UID: \"0e8a5437-95e7-4fed-baca-62bae7d71c4a\") " pod="openshift-console/console-5d7bfffc48-jdrmz"
Sep 20 00:48:43.187326 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:43.187166    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0e8a5437-95e7-4fed-baca-62bae7d71c4a-oauth-serving-cert\") pod \"console-5d7bfffc48-jdrmz\" (UID: \"0e8a5437-95e7-4fed-baca-62bae7d71c4a\") " pod="openshift-console/console-5d7bfffc48-jdrmz"
Sep 20 00:48:43.187425 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:43.187399    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0e8a5437-95e7-4fed-baca-62bae7d71c4a-console-config\") pod \"console-5d7bfffc48-jdrmz\" (UID: \"0e8a5437-95e7-4fed-baca-62bae7d71c4a\") " pod="openshift-console/console-5d7bfffc48-jdrmz"
Sep 20 00:48:43.187487 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:43.187404    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0e8a5437-95e7-4fed-baca-62bae7d71c4a-service-ca\") pod \"console-5d7bfffc48-jdrmz\" (UID: \"0e8a5437-95e7-4fed-baca-62bae7d71c4a\") " pod="openshift-console/console-5d7bfffc48-jdrmz"
Sep 20 00:48:43.189144 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:43.189117    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0e8a5437-95e7-4fed-baca-62bae7d71c4a-console-oauth-config\") pod \"console-5d7bfffc48-jdrmz\" (UID: \"0e8a5437-95e7-4fed-baca-62bae7d71c4a\") " pod="openshift-console/console-5d7bfffc48-jdrmz"
Sep 20 00:48:43.189233 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:43.189156    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e8a5437-95e7-4fed-baca-62bae7d71c4a-console-serving-cert\") pod \"console-5d7bfffc48-jdrmz\" (UID: \"0e8a5437-95e7-4fed-baca-62bae7d71c4a\") " pod="openshift-console/console-5d7bfffc48-jdrmz"
Sep 20 00:48:43.199963 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:43.199939    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcwbp\" (UniqueName: \"kubernetes.io/projected/0e8a5437-95e7-4fed-baca-62bae7d71c4a-kube-api-access-gcwbp\") pod \"console-5d7bfffc48-jdrmz\" (UID: \"0e8a5437-95e7-4fed-baca-62bae7d71c4a\") " pod="openshift-console/console-5d7bfffc48-jdrmz"
Sep 20 00:48:43.281999 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:43.281967    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d7bfffc48-jdrmz"
Sep 20 00:48:43.555723 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:43.555691    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d7bfffc48-jdrmz"]
Sep 20 00:48:43.558954 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:48:43.558925    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e8a5437_95e7_4fed_baca_62bae7d71c4a.slice/crio-0a0153d3947b271327e8569ff7ba4c6e98b67d71cadd7bd2385fd9f34382810d WatchSource:0}: Error finding container 0a0153d3947b271327e8569ff7ba4c6e98b67d71cadd7bd2385fd9f34382810d: Status 404 returned error can't find the container with id 0a0153d3947b271327e8569ff7ba4c6e98b67d71cadd7bd2385fd9f34382810d
Sep 20 00:48:43.837520 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:43.837432    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-gfrkj" event={"ID":"199273a0-d5e1-42fa-94f4-57f2d74b06b6","Type":"ContainerStarted","Data":"568eba117fb1a6952e2b79e72c4b0b77a83127777a5d15f7963b7500af7f88ca"}
Sep 20 00:48:43.837783 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:43.837756    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-gfrkj" event={"ID":"199273a0-d5e1-42fa-94f4-57f2d74b06b6","Type":"ContainerStarted","Data":"7cafe1753085a4fae00d7618fba65405913459b2a4a538c2a6ef86a1cd940a12"}
Sep 20 00:48:43.838820 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:43.838797    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d7bfffc48-jdrmz" event={"ID":"0e8a5437-95e7-4fed-baca-62bae7d71c4a","Type":"ContainerStarted","Data":"0a0153d3947b271327e8569ff7ba4c6e98b67d71cadd7bd2385fd9f34382810d"}
Sep 20 00:48:43.861365 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:43.861325    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-gfrkj" podStartSLOduration=1.5704799 podStartE2EDuration="2.861313227s" totalImagesPullingTime="1.290833327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:48:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:43.861102213 +0000 UTC m=+60.475258109" watchObservedRunningTime="2026-09-20 00:48:43.861313227 +0000 UTC m=+60.475469124"
Sep 20 00:48:44.739757 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:44.739723    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-65l6f"
Sep 20 00:48:45.619287 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.619258    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-8l78p"]
Sep 20 00:48:45.621499 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.621472    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8l78p"
Sep 20 00:48:45.623445 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.623417    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 20 00:48:45.623575 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.623485    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-jrw4x\""
Sep 20 00:48:45.623943 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.623895    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 20 00:48:45.634690 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.634668    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-8l78p"]
Sep 20 00:48:45.637375 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.637354    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-9nmdf"]
Sep 20 00:48:45.639419 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.639402    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-9nmdf"
Sep 20 00:48:45.642572 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.642549    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 20 00:48:45.643020 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.643002    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 20 00:48:45.643109 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.643022    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 20 00:48:45.643109 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.643054    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-7jmlr\""
Sep 20 00:48:45.657064 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.656843    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-9nmdf"]
Sep 20 00:48:45.657475 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.657452    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pjrnt"]
Sep 20 00:48:45.661201 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.661182    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pjrnt"
Sep 20 00:48:45.663134 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.663114    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mwr4l\""
Sep 20 00:48:45.663253 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.663234    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 20 00:48:45.663991 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.663968    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 20 00:48:45.664529 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.664513    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 20 00:48:45.706778 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.706750    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7208e8f8-14b5-4807-9033-030973fc1776-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pjrnt\" (UID: \"7208e8f8-14b5-4807-9033-030973fc1776\") " pod="openshift-monitoring/node-exporter-pjrnt"
Sep 20 00:48:45.706957 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.706787    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7208e8f8-14b5-4807-9033-030973fc1776-node-exporter-tls\") pod \"node-exporter-pjrnt\" (UID: \"7208e8f8-14b5-4807-9033-030973fc1776\") " pod="openshift-monitoring/node-exporter-pjrnt"
Sep 20 00:48:45.706957 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.706820    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1493406-5ee3-4730-a7b5-fd36f59263d4-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-8l78p\" (UID: \"b1493406-5ee3-4730-a7b5-fd36f59263d4\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8l78p"
Sep 20 00:48:45.706957 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.706847    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg8vt\" (UniqueName: \"kubernetes.io/projected/c86586fe-ddbb-4bda-8f1d-51a41f70b978-kube-api-access-sg8vt\") pod \"kube-state-metrics-84c885658c-9nmdf\" (UID: \"c86586fe-ddbb-4bda-8f1d-51a41f70b978\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-9nmdf"
Sep 20 00:48:45.706957 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.706942    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7208e8f8-14b5-4807-9033-030973fc1776-node-exporter-accelerators-collector-config\") pod \"node-exporter-pjrnt\" (UID: \"7208e8f8-14b5-4807-9033-030973fc1776\") " pod="openshift-monitoring/node-exporter-pjrnt"
Sep 20 00:48:45.707093 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.706990    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7208e8f8-14b5-4807-9033-030973fc1776-sys\") pod \"node-exporter-pjrnt\" (UID: \"7208e8f8-14b5-4807-9033-030973fc1776\") " pod="openshift-monitoring/node-exporter-pjrnt"
Sep 20 00:48:45.707093 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.707020    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c86586fe-ddbb-4bda-8f1d-51a41f70b978-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-9nmdf\" (UID: \"c86586fe-ddbb-4bda-8f1d-51a41f70b978\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-9nmdf"
Sep 20 00:48:45.707186 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.707089    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c86586fe-ddbb-4bda-8f1d-51a41f70b978-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-9nmdf\" (UID: \"c86586fe-ddbb-4bda-8f1d-51a41f70b978\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-9nmdf"
Sep 20 00:48:45.707186 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.707162    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c86586fe-ddbb-4bda-8f1d-51a41f70b978-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-9nmdf\" (UID: \"c86586fe-ddbb-4bda-8f1d-51a41f70b978\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-9nmdf"
Sep 20 00:48:45.707291 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.707194    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c86586fe-ddbb-4bda-8f1d-51a41f70b978-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-9nmdf\" (UID: \"c86586fe-ddbb-4bda-8f1d-51a41f70b978\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-9nmdf"
Sep 20 00:48:45.707291 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.707251    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7208e8f8-14b5-4807-9033-030973fc1776-node-exporter-textfile\") pod \"node-exporter-pjrnt\" (UID: \"7208e8f8-14b5-4807-9033-030973fc1776\") " pod="openshift-monitoring/node-exporter-pjrnt"
Sep 20 00:48:45.707355 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.707298    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xd29g\" (UniqueName: \"kubernetes.io/projected/7208e8f8-14b5-4807-9033-030973fc1776-kube-api-access-xd29g\") pod \"node-exporter-pjrnt\" (UID: \"7208e8f8-14b5-4807-9033-030973fc1776\") " pod="openshift-monitoring/node-exporter-pjrnt"
Sep 20 00:48:45.707355 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.707332    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7208e8f8-14b5-4807-9033-030973fc1776-metrics-client-ca\") pod \"node-exporter-pjrnt\" (UID: \"7208e8f8-14b5-4807-9033-030973fc1776\") " pod="openshift-monitoring/node-exporter-pjrnt"
Sep 20 00:48:45.707414 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.707357    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1493406-5ee3-4730-a7b5-fd36f59263d4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-8l78p\" (UID: \"b1493406-5ee3-4730-a7b5-fd36f59263d4\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8l78p"
Sep 20 00:48:45.707414 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.707392    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c86586fe-ddbb-4bda-8f1d-51a41f70b978-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-9nmdf\" (UID: \"c86586fe-ddbb-4bda-8f1d-51a41f70b978\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-9nmdf"
Sep 20 00:48:45.707478 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.707416    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7208e8f8-14b5-4807-9033-030973fc1776-node-exporter-wtmp\") pod \"node-exporter-pjrnt\" (UID: \"7208e8f8-14b5-4807-9033-030973fc1776\") " pod="openshift-monitoring/node-exporter-pjrnt"
Sep 20 00:48:45.707478 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.707441    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7208e8f8-14b5-4807-9033-030973fc1776-root\") pod \"node-exporter-pjrnt\" (UID: \"7208e8f8-14b5-4807-9033-030973fc1776\") " pod="openshift-monitoring/node-exporter-pjrnt"
Sep 20 00:48:45.707478 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.707466    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ff7xf\" (UniqueName: \"kubernetes.io/projected/b1493406-5ee3-4730-a7b5-fd36f59263d4-kube-api-access-ff7xf\") pod \"openshift-state-metrics-86c5bc79d6-8l78p\" (UID: \"b1493406-5ee3-4730-a7b5-fd36f59263d4\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8l78p"
Sep 20 00:48:45.707588 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.707489    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b1493406-5ee3-4730-a7b5-fd36f59263d4-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-8l78p\" (UID: \"b1493406-5ee3-4730-a7b5-fd36f59263d4\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8l78p"
Sep 20 00:48:45.808237 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.808202    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1493406-5ee3-4730-a7b5-fd36f59263d4-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-8l78p\" (UID: \"b1493406-5ee3-4730-a7b5-fd36f59263d4\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8l78p"
Sep 20 00:48:45.808644 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.808251    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg8vt\" (UniqueName: \"kubernetes.io/projected/c86586fe-ddbb-4bda-8f1d-51a41f70b978-kube-api-access-sg8vt\") pod \"kube-state-metrics-84c885658c-9nmdf\" (UID: \"c86586fe-ddbb-4bda-8f1d-51a41f70b978\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-9nmdf"
Sep 20 00:48:45.808644 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.808379    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7208e8f8-14b5-4807-9033-030973fc1776-node-exporter-accelerators-collector-config\") pod \"node-exporter-pjrnt\" (UID: \"7208e8f8-14b5-4807-9033-030973fc1776\") " pod="openshift-monitoring/node-exporter-pjrnt"
Sep 20 00:48:45.808644 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.808432    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7208e8f8-14b5-4807-9033-030973fc1776-sys\") pod \"node-exporter-pjrnt\" (UID: \"7208e8f8-14b5-4807-9033-030973fc1776\") " pod="openshift-monitoring/node-exporter-pjrnt"
Sep 20 00:48:45.808644 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.808464    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c86586fe-ddbb-4bda-8f1d-51a41f70b978-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-9nmdf\" (UID: \"c86586fe-ddbb-4bda-8f1d-51a41f70b978\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-9nmdf"
Sep 20 00:48:45.808644 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.808495    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c86586fe-ddbb-4bda-8f1d-51a41f70b978-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-9nmdf\" (UID: \"c86586fe-ddbb-4bda-8f1d-51a41f70b978\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-9nmdf"
Sep 20 00:48:45.808644 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.808527    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c86586fe-ddbb-4bda-8f1d-51a41f70b978-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-9nmdf\" (UID: \"c86586fe-ddbb-4bda-8f1d-51a41f70b978\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-9nmdf"
Sep 20 00:48:45.808644 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.808556    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c86586fe-ddbb-4bda-8f1d-51a41f70b978-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-9nmdf\" (UID: \"c86586fe-ddbb-4bda-8f1d-51a41f70b978\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-9nmdf"
Sep 20 00:48:45.808644 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.808586    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7208e8f8-14b5-4807-9033-030973fc1776-node-exporter-textfile\") pod \"node-exporter-pjrnt\" (UID: \"7208e8f8-14b5-4807-9033-030973fc1776\") " pod="openshift-monitoring/node-exporter-pjrnt"
Sep 20 00:48:45.808644 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.808626    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xd29g\" (UniqueName: \"kubernetes.io/projected/7208e8f8-14b5-4807-9033-030973fc1776-kube-api-access-xd29g\") pod \"node-exporter-pjrnt\" (UID: \"7208e8f8-14b5-4807-9033-030973fc1776\") " pod="openshift-monitoring/node-exporter-pjrnt"
Sep 20 00:48:45.808996 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.808659    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7208e8f8-14b5-4807-9033-030973fc1776-metrics-client-ca\") pod \"node-exporter-pjrnt\" (UID: \"7208e8f8-14b5-4807-9033-030973fc1776\") " pod="openshift-monitoring/node-exporter-pjrnt"
Sep 20 00:48:45.808996 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.808684    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1493406-5ee3-4730-a7b5-fd36f59263d4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-8l78p\" (UID: \"b1493406-5ee3-4730-a7b5-fd36f59263d4\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8l78p"
Sep 20 00:48:45.808996 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.808714    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c86586fe-ddbb-4bda-8f1d-51a41f70b978-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-9nmdf\" (UID: \"c86586fe-ddbb-4bda-8f1d-51a41f70b978\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-9nmdf"
Sep 20 00:48:45.808996 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.808745    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7208e8f8-14b5-4807-9033-030973fc1776-node-exporter-wtmp\") pod \"node-exporter-pjrnt\" (UID: \"7208e8f8-14b5-4807-9033-030973fc1776\") " pod="openshift-monitoring/node-exporter-pjrnt"
Sep 20 00:48:45.808996 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.808771    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7208e8f8-14b5-4807-9033-030973fc1776-root\") pod \"node-exporter-pjrnt\" (UID: \"7208e8f8-14b5-4807-9033-030973fc1776\") " pod="openshift-monitoring/node-exporter-pjrnt"
Sep 20 00:48:45.808996 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.808799    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ff7xf\" (UniqueName: \"kubernetes.io/projected/b1493406-5ee3-4730-a7b5-fd36f59263d4-kube-api-access-ff7xf\") pod \"openshift-state-metrics-86c5bc79d6-8l78p\" (UID: \"b1493406-5ee3-4730-a7b5-fd36f59263d4\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8l78p"
Sep 20 00:48:45.808996 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.808833    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b1493406-5ee3-4730-a7b5-fd36f59263d4-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-8l78p\" (UID: \"b1493406-5ee3-4730-a7b5-fd36f59263d4\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8l78p"
Sep 20 00:48:45.808996 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.808901    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7208e8f8-14b5-4807-9033-030973fc1776-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pjrnt\" (UID: \"7208e8f8-14b5-4807-9033-030973fc1776\") " pod="openshift-monitoring/node-exporter-pjrnt"
Sep 20 00:48:45.808996 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.808927    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7208e8f8-14b5-4807-9033-030973fc1776-node-exporter-tls\") pod \"node-exporter-pjrnt\" (UID: \"7208e8f8-14b5-4807-9033-030973fc1776\") " pod="openshift-monitoring/node-exporter-pjrnt"
Sep 20 00:48:45.809518 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.809492    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7208e8f8-14b5-4807-9033-030973fc1776-node-exporter-wtmp\") pod \"node-exporter-pjrnt\" (UID: \"7208e8f8-14b5-4807-9033-030973fc1776\") " pod="openshift-monitoring/node-exporter-pjrnt"
Sep 20 00:48:45.810533 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:45.809896    2570 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Sep 20 00:48:45.810533 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.809918    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7208e8f8-14b5-4807-9033-030973fc1776-node-exporter-textfile\") pod \"node-exporter-pjrnt\" (UID: \"7208e8f8-14b5-4807-9033-030973fc1776\") " pod="openshift-monitoring/node-exporter-pjrnt"
Sep 20 00:48:45.810533 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:45.809980    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c86586fe-ddbb-4bda-8f1d-51a41f70b978-kube-state-metrics-tls podName:c86586fe-ddbb-4bda-8f1d-51a41f70b978 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:46.309958675 +0000 UTC m=+62.924114553 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/c86586fe-ddbb-4bda-8f1d-51a41f70b978-kube-state-metrics-tls") pod "kube-state-metrics-84c885658c-9nmdf" (UID: "c86586fe-ddbb-4bda-8f1d-51a41f70b978") : secret "kube-state-metrics-tls" not found
Sep 20 00:48:45.810533 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.809992    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7208e8f8-14b5-4807-9033-030973fc1776-node-exporter-accelerators-collector-config\") pod \"node-exporter-pjrnt\" (UID: \"7208e8f8-14b5-4807-9033-030973fc1776\") " pod="openshift-monitoring/node-exporter-pjrnt"
Sep 20 00:48:45.810533 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.810007    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c86586fe-ddbb-4bda-8f1d-51a41f70b978-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-9nmdf\" (UID: \"c86586fe-ddbb-4bda-8f1d-51a41f70b978\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-9nmdf"
Sep 20 00:48:45.810533 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.810053    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1493406-5ee3-4730-a7b5-fd36f59263d4-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-8l78p\" (UID: \"b1493406-5ee3-4730-a7b5-fd36f59263d4\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8l78p"
Sep 20 00:48:45.810533 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.810074    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7208e8f8-14b5-4807-9033-030973fc1776-sys\") pod \"node-exporter-pjrnt\" (UID: \"7208e8f8-14b5-4807-9033-030973fc1776\") " pod="openshift-monitoring/node-exporter-pjrnt"
Sep 20 00:48:45.810533 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:45.810133    2570 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Sep 20 00:48:45.810533 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:45.810192    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1493406-5ee3-4730-a7b5-fd36f59263d4-openshift-state-metrics-tls podName:b1493406-5ee3-4730-a7b5-fd36f59263d4 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:46.310174646 +0000 UTC m=+62.924330523 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/b1493406-5ee3-4730-a7b5-fd36f59263d4-openshift-state-metrics-tls") pod "openshift-state-metrics-86c5bc79d6-8l78p" (UID: "b1493406-5ee3-4730-a7b5-fd36f59263d4") : secret "openshift-state-metrics-tls" not found
Sep 20 00:48:45.810533 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.810220    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c86586fe-ddbb-4bda-8f1d-51a41f70b978-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-9nmdf\" (UID: \"c86586fe-ddbb-4bda-8f1d-51a41f70b978\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-9nmdf"
Sep 20 00:48:45.810533 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.810283    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7208e8f8-14b5-4807-9033-030973fc1776-root\") pod \"node-exporter-pjrnt\" (UID: \"7208e8f8-14b5-4807-9033-030973fc1776\") " pod="openshift-monitoring/node-exporter-pjrnt"
Sep 20 00:48:45.810533 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.810434    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7208e8f8-14b5-4807-9033-030973fc1776-metrics-client-ca\") pod \"node-exporter-pjrnt\" (UID: \"7208e8f8-14b5-4807-9033-030973fc1776\") " pod="openshift-monitoring/node-exporter-pjrnt"
Sep 20 00:48:45.810533 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.810530    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c86586fe-ddbb-4bda-8f1d-51a41f70b978-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-9nmdf\" (UID: \"c86586fe-ddbb-4bda-8f1d-51a41f70b978\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-9nmdf"
Sep 20 00:48:45.812151 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.812126    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7208e8f8-14b5-4807-9033-030973fc1776-node-exporter-tls\") pod \"node-exporter-pjrnt\" (UID: \"7208e8f8-14b5-4807-9033-030973fc1776\") " pod="openshift-monitoring/node-exporter-pjrnt"
Sep 20 00:48:45.812571 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.812520    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c86586fe-ddbb-4bda-8f1d-51a41f70b978-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-9nmdf\" (UID: \"c86586fe-ddbb-4bda-8f1d-51a41f70b978\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-9nmdf"
Sep 20 00:48:45.812982 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.812951    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b1493406-5ee3-4730-a7b5-fd36f59263d4-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-8l78p\" (UID: \"b1493406-5ee3-4730-a7b5-fd36f59263d4\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8l78p"
Sep 20 00:48:45.814636 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.814604    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7208e8f8-14b5-4807-9033-030973fc1776-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pjrnt\" (UID: \"7208e8f8-14b5-4807-9033-030973fc1776\") " pod="openshift-monitoring/node-exporter-pjrnt"
Sep 20 00:48:45.821501 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.821449    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xd29g\" (UniqueName: \"kubernetes.io/projected/7208e8f8-14b5-4807-9033-030973fc1776-kube-api-access-xd29g\") pod \"node-exporter-pjrnt\" (UID: \"7208e8f8-14b5-4807-9033-030973fc1776\") " pod="openshift-monitoring/node-exporter-pjrnt"
Sep 20 00:48:45.821853 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.821830    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg8vt\" (UniqueName: \"kubernetes.io/projected/c86586fe-ddbb-4bda-8f1d-51a41f70b978-kube-api-access-sg8vt\") pod \"kube-state-metrics-84c885658c-9nmdf\" (UID: \"c86586fe-ddbb-4bda-8f1d-51a41f70b978\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-9nmdf"
Sep 20 00:48:45.822851 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.822831    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ff7xf\" (UniqueName: \"kubernetes.io/projected/b1493406-5ee3-4730-a7b5-fd36f59263d4-kube-api-access-ff7xf\") pod \"openshift-state-metrics-86c5bc79d6-8l78p\" (UID: \"b1493406-5ee3-4730-a7b5-fd36f59263d4\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8l78p"
Sep 20 00:48:45.971269 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:45.971163    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pjrnt"
Sep 20 00:48:46.313209 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:46.313132    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1493406-5ee3-4730-a7b5-fd36f59263d4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-8l78p\" (UID: \"b1493406-5ee3-4730-a7b5-fd36f59263d4\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8l78p"
Sep 20 00:48:46.313353 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:46.313221    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c86586fe-ddbb-4bda-8f1d-51a41f70b978-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-9nmdf\" (UID: \"c86586fe-ddbb-4bda-8f1d-51a41f70b978\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-9nmdf"
Sep 20 00:48:46.313353 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:46.313304    2570 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Sep 20 00:48:46.313441 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:46.313380    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1493406-5ee3-4730-a7b5-fd36f59263d4-openshift-state-metrics-tls podName:b1493406-5ee3-4730-a7b5-fd36f59263d4 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:47.313363409 +0000 UTC m=+63.927519284 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/b1493406-5ee3-4730-a7b5-fd36f59263d4-openshift-state-metrics-tls") pod "openshift-state-metrics-86c5bc79d6-8l78p" (UID: "b1493406-5ee3-4730-a7b5-fd36f59263d4") : secret "openshift-state-metrics-tls" not found
Sep 20 00:48:46.313441 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:46.313309    2570 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Sep 20 00:48:46.313441 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:46.313424    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c86586fe-ddbb-4bda-8f1d-51a41f70b978-kube-state-metrics-tls podName:c86586fe-ddbb-4bda-8f1d-51a41f70b978 nodeName:}" failed. No retries permitted until 2026-09-20 00:48:47.313415329 +0000 UTC m=+63.927571204 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/c86586fe-ddbb-4bda-8f1d-51a41f70b978-kube-state-metrics-tls") pod "kube-state-metrics-84c885658c-9nmdf" (UID: "c86586fe-ddbb-4bda-8f1d-51a41f70b978") : secret "kube-state-metrics-tls" not found
Sep 20 00:48:46.684877 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:46.684823    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 20 00:48:46.689554 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:46.688268    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:48:46.690892 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:46.690666    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 20 00:48:46.690892 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:46.690719    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 20 00:48:46.690892 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:46.690793    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 20 00:48:46.690892 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:46.690826    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 20 00:48:46.691171 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:46.691033    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 20 00:48:46.691171 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:46.691136    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 20 00:48:46.691875 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:46.691657    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 20 00:48:46.691875 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:46.691672    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-p2skq\""
Sep 20 00:48:46.691875 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:46.691698    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 20 00:48:46.691875 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:46.691659    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 20 00:48:46.703486 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:46.703462    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 20 00:48:46.717452 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:46.717424    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/de4f227e-8211-434f-b703-970798d1cb7e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"de4f227e-8211-434f-b703-970798d1cb7e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:48:46.717578 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:46.717466    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de4f227e-8211-434f-b703-970798d1cb7e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"de4f227e-8211-434f-b703-970798d1cb7e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:48:46.717578 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:46.717495    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/de4f227e-8211-434f-b703-970798d1cb7e-config-volume\") pod \"alertmanager-main-0\" (UID: \"de4f227e-8211-434f-b703-970798d1cb7e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:48:46.717578 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:46.717523    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/de4f227e-8211-434f-b703-970798d1cb7e-config-out\") pod \"alertmanager-main-0\" (UID: \"de4f227e-8211-434f-b703-970798d1cb7e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:48:46.717578 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:46.717549    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/de4f227e-8211-434f-b703-970798d1cb7e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"de4f227e-8211-434f-b703-970798d1cb7e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:48:46.717749 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:46.717579    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/de4f227e-8211-434f-b703-970798d1cb7e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"de4f227e-8211-434f-b703-970798d1cb7e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:48:46.717749 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:46.717635    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/de4f227e-8211-434f-b703-970798d1cb7e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"de4f227e-8211-434f-b703-970798d1cb7e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:48:46.717749 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:46.717680    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/de4f227e-8211-434f-b703-970798d1cb7e-web-config\") pod \"alertmanager-main-0\" (UID: \"de4f227e-8211-434f-b703-970798d1cb7e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:48:46.717907 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:46.717760    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/de4f227e-8211-434f-b703-970798d1cb7e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"de4f227e-8211-434f-b703-970798d1cb7e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:48:46.717907 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:46.717780    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de4f227e-8211-434f-b703-970798d1cb7e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"de4f227e-8211-434f-b703-970798d1cb7e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:48:46.717907 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:46.717811    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/de4f227e-8211-434f-b703-970798d1cb7e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"de4f227e-8211-434f-b703-970798d1cb7e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:48:46.718041 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:46.717947    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2pr8\" (UniqueName: \"kubernetes.io/projected/de4f227e-8211-434f-b703-970798d1cb7e-kube-api-access-t2pr8\") pod \"alertmanager-main-0\" (UID: \"de4f227e-8211-434f-b703-970798d1cb7e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:48:46.718041 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:46.717978    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/de4f227e-8211-434f-b703-970798d1cb7e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"de4f227e-8211-434f-b703-970798d1cb7e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:48:46.819170 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:46.819132    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2pr8\" (UniqueName: \"kubernetes.io/projected/de4f227e-8211-434f-b703-970798d1cb7e-kube-api-access-t2pr8\") pod \"alertmanager-main-0\" (UID: \"de4f227e-8211-434f-b703-970798d1cb7e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:48:46.819170 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:46.819174    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/de4f227e-8211-434f-b703-970798d1cb7e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"de4f227e-8211-434f-b703-970798d1cb7e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:48:46.819672 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:46.819223    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/de4f227e-8211-434f-b703-970798d1cb7e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"de4f227e-8211-434f-b703-970798d1cb7e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:48:46.819672 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:46.819247    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de4f227e-8211-434f-b703-970798d1cb7e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"de4f227e-8211-434f-b703-970798d1cb7e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:48:46.819672 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:46.819277    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/de4f227e-8211-434f-b703-970798d1cb7e-config-volume\") pod \"alertmanager-main-0\" (UID: \"de4f227e-8211-434f-b703-970798d1cb7e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:48:46.819672 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:46.819300    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/de4f227e-8211-434f-b703-970798d1cb7e-config-out\") pod \"alertmanager-main-0\" (UID: \"de4f227e-8211-434f-b703-970798d1cb7e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:48:46.819672 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:46.819526    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/de4f227e-8211-434f-b703-970798d1cb7e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"de4f227e-8211-434f-b703-970798d1cb7e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:48:46.819672 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:46.819557    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/de4f227e-8211-434f-b703-970798d1cb7e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"de4f227e-8211-434f-b703-970798d1cb7e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:48:46.819672 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:46.819590    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/de4f227e-8211-434f-b703-970798d1cb7e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"de4f227e-8211-434f-b703-970798d1cb7e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:48:46.819672 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:46.819610    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/de4f227e-8211-434f-b703-970798d1cb7e-web-config\") pod \"alertmanager-main-0\" (UID: \"de4f227e-8211-434f-b703-970798d1cb7e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:48:46.819672 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:46.819641    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/de4f227e-8211-434f-b703-970798d1cb7e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"de4f227e-8211-434f-b703-970798d1cb7e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:48:46.820304 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:46.819730    2570 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Sep 20 00:48:46.820304 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:46.819797    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de4f227e-8211-434f-b703-970798d1cb7e-secret-alertmanager-main-tls podName:de4f227e-8211-434f-b703-970798d1cb7e nodeName:}" failed. No retries permitted until 2026-09-20 00:48:47.319776612 +0000 UTC m=+63.933932496 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/de4f227e-8211-434f-b703-970798d1cb7e-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "de4f227e-8211-434f-b703-970798d1cb7e") : secret "alertmanager-main-tls" not found
Sep 20 00:48:46.820304 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:46.820272    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de4f227e-8211-434f-b703-970798d1cb7e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"de4f227e-8211-434f-b703-970798d1cb7e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:48:46.821457 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:46.820901    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de4f227e-8211-434f-b703-970798d1cb7e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"de4f227e-8211-434f-b703-970798d1cb7e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:48:46.821457 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:46.820972    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/de4f227e-8211-434f-b703-970798d1cb7e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"de4f227e-8211-434f-b703-970798d1cb7e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:48:46.821457 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:46.821135    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/de4f227e-8211-434f-b703-970798d1cb7e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"de4f227e-8211-434f-b703-970798d1cb7e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:48:46.821457 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:48:46.821239    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/de4f227e-8211-434f-b703-970798d1cb7e-alertmanager-trusted-ca-bundle podName:de4f227e-8211-434f-b703-970798d1cb7e nodeName:}" failed. No retries permitted until 2026-09-20 00:48:47.321219062 +0000 UTC m=+63.935374960 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/de4f227e-8211-434f-b703-970798d1cb7e-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "de4f227e-8211-434f-b703-970798d1cb7e") : configmap references non-existent config key: ca-bundle.crt
Sep 20 00:48:46.822748 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:46.822722    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/de4f227e-8211-434f-b703-970798d1cb7e-config-volume\") pod \"alertmanager-main-0\" (UID: \"de4f227e-8211-434f-b703-970798d1cb7e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:48:46.822847 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:46.822769    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/de4f227e-8211-434f-b703-970798d1cb7e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"de4f227e-8211-434f-b703-970798d1cb7e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:48:46.823335 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:46.823310    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/de4f227e-8211-434f-b703-970798d1cb7e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"de4f227e-8211-434f-b703-970798d1cb7e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:48:46.823558 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:46.823537    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/de4f227e-8211-434f-b703-970798d1cb7e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"de4f227e-8211-434f-b703-970798d1cb7e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:48:46.824353 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:46.824316    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/de4f227e-8211-434f-b703-970798d1cb7e-config-out\") pod \"alertmanager-main-0\" (UID: \"de4f227e-8211-434f-b703-970798d1cb7e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:48:46.825214 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:46.825191    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/de4f227e-8211-434f-b703-970798d1cb7e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"de4f227e-8211-434f-b703-970798d1cb7e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:48:46.825319 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:46.825290    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/de4f227e-8211-434f-b703-970798d1cb7e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"de4f227e-8211-434f-b703-970798d1cb7e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:48:46.825733 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:46.825687    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/de4f227e-8211-434f-b703-970798d1cb7e-web-config\") pod \"alertmanager-main-0\" (UID: \"de4f227e-8211-434f-b703-970798d1cb7e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:48:46.827846 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:46.827823    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2pr8\" (UniqueName: \"kubernetes.io/projected/de4f227e-8211-434f-b703-970798d1cb7e-kube-api-access-t2pr8\") pod \"alertmanager-main-0\" (UID: \"de4f227e-8211-434f-b703-970798d1cb7e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:48:47.325255 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.325200    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1493406-5ee3-4730-a7b5-fd36f59263d4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-8l78p\" (UID: \"b1493406-5ee3-4730-a7b5-fd36f59263d4\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8l78p"
Sep 20 00:48:47.325448 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.325290    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/de4f227e-8211-434f-b703-970798d1cb7e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"de4f227e-8211-434f-b703-970798d1cb7e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:48:47.325448 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.325357    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de4f227e-8211-434f-b703-970798d1cb7e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"de4f227e-8211-434f-b703-970798d1cb7e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:48:47.325448 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.325398    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c86586fe-ddbb-4bda-8f1d-51a41f70b978-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-9nmdf\" (UID: \"c86586fe-ddbb-4bda-8f1d-51a41f70b978\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-9nmdf"
Sep 20 00:48:47.326567 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.326506    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de4f227e-8211-434f-b703-970798d1cb7e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"de4f227e-8211-434f-b703-970798d1cb7e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:48:47.328416 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.328390    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b1493406-5ee3-4730-a7b5-fd36f59263d4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-8l78p\" (UID: \"b1493406-5ee3-4730-a7b5-fd36f59263d4\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8l78p"
Sep 20 00:48:47.328533 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.328419    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/de4f227e-8211-434f-b703-970798d1cb7e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"de4f227e-8211-434f-b703-970798d1cb7e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:48:47.329037 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.329015    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c86586fe-ddbb-4bda-8f1d-51a41f70b978-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-9nmdf\" (UID: \"c86586fe-ddbb-4bda-8f1d-51a41f70b978\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-9nmdf"
Sep 20 00:48:47.392913 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:48:47.392886    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7208e8f8_14b5_4807_9033_030973fc1776.slice/crio-efcd951a275780390129835996cda65ece9e601ede3a15fb7a101957f6783b82 WatchSource:0}: Error finding container efcd951a275780390129835996cda65ece9e601ede3a15fb7a101957f6783b82: Status 404 returned error can't find the container with id efcd951a275780390129835996cda65ece9e601ede3a15fb7a101957f6783b82
Sep 20 00:48:47.430453 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.430424    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8l78p"
Sep 20 00:48:47.448892 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.448846    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-9nmdf"
Sep 20 00:48:47.600463 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.600381    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:48:47.710917 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.710884    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-8l78p"]
Sep 20 00:48:47.714211 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:48:47.714179    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1493406_5ee3_4730_a7b5_fd36f59263d4.slice/crio-f8df69b604c1a871598225a6b73c1488074a4a6b4d9627bed355f78d6346e83a WatchSource:0}: Error finding container f8df69b604c1a871598225a6b73c1488074a4a6b4d9627bed355f78d6346e83a: Status 404 returned error can't find the container with id f8df69b604c1a871598225a6b73c1488074a4a6b4d9627bed355f78d6346e83a
Sep 20 00:48:47.734073 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.734048    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-85dc985d44-l9zh2"]
Sep 20 00:48:47.737573 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.737551    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-85dc985d44-l9zh2"
Sep 20 00:48:47.739849 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.739820    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 20 00:48:47.739961 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.739927    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 20 00:48:47.739961 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.739937    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 20 00:48:47.740072 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.739969    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-5bu4kpb2pmba6\""
Sep 20 00:48:47.740160 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.740141    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 20 00:48:47.740288 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.740237    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 20 00:48:47.740586 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.740569    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-kgfc7\""
Sep 20 00:48:47.749875 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.749835    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-85dc985d44-l9zh2"]
Sep 20 00:48:47.760366 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.760182    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-9nmdf"]
Sep 20 00:48:47.762415 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:48:47.762314    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc86586fe_ddbb_4bda_8f1d_51a41f70b978.slice/crio-31549b97d0978a5d2f9052319068ff76cc77d702b67560198ad880155b118d42 WatchSource:0}: Error finding container 31549b97d0978a5d2f9052319068ff76cc77d702b67560198ad880155b118d42: Status 404 returned error can't find the container with id 31549b97d0978a5d2f9052319068ff76cc77d702b67560198ad880155b118d42
Sep 20 00:48:47.815559 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.815538    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qrjb2"
Sep 20 00:48:47.828896 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.828849    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vw45\" (UniqueName: \"kubernetes.io/projected/dc4e60f1-1008-4d97-b338-e095aa0b887d-kube-api-access-8vw45\") pod \"thanos-querier-85dc985d44-l9zh2\" (UID: \"dc4e60f1-1008-4d97-b338-e095aa0b887d\") " pod="openshift-monitoring/thanos-querier-85dc985d44-l9zh2"
Sep 20 00:48:47.829298 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.828952    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/dc4e60f1-1008-4d97-b338-e095aa0b887d-secret-thanos-querier-tls\") pod \"thanos-querier-85dc985d44-l9zh2\" (UID: \"dc4e60f1-1008-4d97-b338-e095aa0b887d\") " pod="openshift-monitoring/thanos-querier-85dc985d44-l9zh2"
Sep 20 00:48:47.829298 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.828996    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/dc4e60f1-1008-4d97-b338-e095aa0b887d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-85dc985d44-l9zh2\" (UID: \"dc4e60f1-1008-4d97-b338-e095aa0b887d\") " pod="openshift-monitoring/thanos-querier-85dc985d44-l9zh2"
Sep 20 00:48:47.829298 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.829018    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/dc4e60f1-1008-4d97-b338-e095aa0b887d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-85dc985d44-l9zh2\" (UID: \"dc4e60f1-1008-4d97-b338-e095aa0b887d\") " pod="openshift-monitoring/thanos-querier-85dc985d44-l9zh2"
Sep 20 00:48:47.829298 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.829047    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dc4e60f1-1008-4d97-b338-e095aa0b887d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-85dc985d44-l9zh2\" (UID: \"dc4e60f1-1008-4d97-b338-e095aa0b887d\") " pod="openshift-monitoring/thanos-querier-85dc985d44-l9zh2"
Sep 20 00:48:47.829298 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.829073    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dc4e60f1-1008-4d97-b338-e095aa0b887d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-85dc985d44-l9zh2\" (UID: \"dc4e60f1-1008-4d97-b338-e095aa0b887d\") " pod="openshift-monitoring/thanos-querier-85dc985d44-l9zh2"
Sep 20 00:48:47.829298 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.829088    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc4e60f1-1008-4d97-b338-e095aa0b887d-metrics-client-ca\") pod \"thanos-querier-85dc985d44-l9zh2\" (UID: \"dc4e60f1-1008-4d97-b338-e095aa0b887d\") " pod="openshift-monitoring/thanos-querier-85dc985d44-l9zh2"
Sep 20 00:48:47.829298 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.829113    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dc4e60f1-1008-4d97-b338-e095aa0b887d-secret-grpc-tls\") pod \"thanos-querier-85dc985d44-l9zh2\" (UID: \"dc4e60f1-1008-4d97-b338-e095aa0b887d\") " pod="openshift-monitoring/thanos-querier-85dc985d44-l9zh2"
Sep 20 00:48:47.861840 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.858035    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-9nmdf" event={"ID":"c86586fe-ddbb-4bda-8f1d-51a41f70b978","Type":"ContainerStarted","Data":"31549b97d0978a5d2f9052319068ff76cc77d702b67560198ad880155b118d42"}
Sep 20 00:48:47.862956 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.862922    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pjrnt" event={"ID":"7208e8f8-14b5-4807-9033-030973fc1776","Type":"ContainerStarted","Data":"efcd951a275780390129835996cda65ece9e601ede3a15fb7a101957f6783b82"}
Sep 20 00:48:47.865683 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.865655    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8l78p" event={"ID":"b1493406-5ee3-4730-a7b5-fd36f59263d4","Type":"ContainerStarted","Data":"47aae58b6a6393aeb4afb479fff4e6d6cbbb16409ea0fba87bfbfd12dff9982c"}
Sep 20 00:48:47.865761 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.865717    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8l78p" event={"ID":"b1493406-5ee3-4730-a7b5-fd36f59263d4","Type":"ContainerStarted","Data":"e0eccd7f852234c59419184297334c880aa2769245134db05163e9d03ba3992e"}
Sep 20 00:48:47.865761 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.865745    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8l78p" event={"ID":"b1493406-5ee3-4730-a7b5-fd36f59263d4","Type":"ContainerStarted","Data":"f8df69b604c1a871598225a6b73c1488074a4a6b4d9627bed355f78d6346e83a"}
Sep 20 00:48:47.868490 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.867907    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d7bfffc48-jdrmz" event={"ID":"0e8a5437-95e7-4fed-baca-62bae7d71c4a","Type":"ContainerStarted","Data":"a2554038fd683942215aa9cf22b7b859699e040fc3f1fb4cc097793bfafb7408"}
Sep 20 00:48:47.875276 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.875250    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 20 00:48:47.887545 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.887499    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d7bfffc48-jdrmz" podStartSLOduration=2.022883799 podStartE2EDuration="5.887484079s" totalImagesPullingTime="3.86460028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:48:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:47.886573795 +0000 UTC m=+64.500729715" watchObservedRunningTime="2026-09-20 00:48:47.887484079 +0000 UTC m=+64.501639977"
Sep 20 00:48:47.929822 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.929788    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vw45\" (UniqueName: \"kubernetes.io/projected/dc4e60f1-1008-4d97-b338-e095aa0b887d-kube-api-access-8vw45\") pod \"thanos-querier-85dc985d44-l9zh2\" (UID: \"dc4e60f1-1008-4d97-b338-e095aa0b887d\") " pod="openshift-monitoring/thanos-querier-85dc985d44-l9zh2"
Sep 20 00:48:47.930023 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.929882    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/dc4e60f1-1008-4d97-b338-e095aa0b887d-secret-thanos-querier-tls\") pod \"thanos-querier-85dc985d44-l9zh2\" (UID: \"dc4e60f1-1008-4d97-b338-e095aa0b887d\") " pod="openshift-monitoring/thanos-querier-85dc985d44-l9zh2"
Sep 20 00:48:47.930023 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.929968    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/dc4e60f1-1008-4d97-b338-e095aa0b887d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-85dc985d44-l9zh2\" (UID: \"dc4e60f1-1008-4d97-b338-e095aa0b887d\") " pod="openshift-monitoring/thanos-querier-85dc985d44-l9zh2"
Sep 20 00:48:47.930023 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.930000    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/dc4e60f1-1008-4d97-b338-e095aa0b887d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-85dc985d44-l9zh2\" (UID: \"dc4e60f1-1008-4d97-b338-e095aa0b887d\") " pod="openshift-monitoring/thanos-querier-85dc985d44-l9zh2"
Sep 20 00:48:47.930199 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.930044    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dc4e60f1-1008-4d97-b338-e095aa0b887d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-85dc985d44-l9zh2\" (UID: \"dc4e60f1-1008-4d97-b338-e095aa0b887d\") " pod="openshift-monitoring/thanos-querier-85dc985d44-l9zh2"
Sep 20 00:48:47.930199 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.930081    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dc4e60f1-1008-4d97-b338-e095aa0b887d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-85dc985d44-l9zh2\" (UID: \"dc4e60f1-1008-4d97-b338-e095aa0b887d\") " pod="openshift-monitoring/thanos-querier-85dc985d44-l9zh2"
Sep 20 00:48:47.930199 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.930121    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc4e60f1-1008-4d97-b338-e095aa0b887d-metrics-client-ca\") pod \"thanos-querier-85dc985d44-l9zh2\" (UID: \"dc4e60f1-1008-4d97-b338-e095aa0b887d\") " pod="openshift-monitoring/thanos-querier-85dc985d44-l9zh2"
Sep 20 00:48:47.930199 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.930147    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dc4e60f1-1008-4d97-b338-e095aa0b887d-secret-grpc-tls\") pod \"thanos-querier-85dc985d44-l9zh2\" (UID: \"dc4e60f1-1008-4d97-b338-e095aa0b887d\") " pod="openshift-monitoring/thanos-querier-85dc985d44-l9zh2"
Sep 20 00:48:47.931517 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.931491    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc4e60f1-1008-4d97-b338-e095aa0b887d-metrics-client-ca\") pod \"thanos-querier-85dc985d44-l9zh2\" (UID: \"dc4e60f1-1008-4d97-b338-e095aa0b887d\") " pod="openshift-monitoring/thanos-querier-85dc985d44-l9zh2"
Sep 20 00:48:47.933541 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.933489    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dc4e60f1-1008-4d97-b338-e095aa0b887d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-85dc985d44-l9zh2\" (UID: \"dc4e60f1-1008-4d97-b338-e095aa0b887d\") " pod="openshift-monitoring/thanos-querier-85dc985d44-l9zh2"
Sep 20 00:48:47.933675 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.933639    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dc4e60f1-1008-4d97-b338-e095aa0b887d-secret-grpc-tls\") pod \"thanos-querier-85dc985d44-l9zh2\" (UID: \"dc4e60f1-1008-4d97-b338-e095aa0b887d\") " pod="openshift-monitoring/thanos-querier-85dc985d44-l9zh2"
Sep 20 00:48:47.934100 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.934075    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/dc4e60f1-1008-4d97-b338-e095aa0b887d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-85dc985d44-l9zh2\" (UID: \"dc4e60f1-1008-4d97-b338-e095aa0b887d\") " pod="openshift-monitoring/thanos-querier-85dc985d44-l9zh2"
Sep 20 00:48:47.934433 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.934406    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dc4e60f1-1008-4d97-b338-e095aa0b887d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-85dc985d44-l9zh2\" (UID: \"dc4e60f1-1008-4d97-b338-e095aa0b887d\") " pod="openshift-monitoring/thanos-querier-85dc985d44-l9zh2"
Sep 20 00:48:47.934951 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.934930    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/dc4e60f1-1008-4d97-b338-e095aa0b887d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-85dc985d44-l9zh2\" (UID: \"dc4e60f1-1008-4d97-b338-e095aa0b887d\") " pod="openshift-monitoring/thanos-querier-85dc985d44-l9zh2"
Sep 20 00:48:47.935394 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.935372    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/dc4e60f1-1008-4d97-b338-e095aa0b887d-secret-thanos-querier-tls\") pod \"thanos-querier-85dc985d44-l9zh2\" (UID: \"dc4e60f1-1008-4d97-b338-e095aa0b887d\") " pod="openshift-monitoring/thanos-querier-85dc985d44-l9zh2"
Sep 20 00:48:47.940158 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:47.940133    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vw45\" (UniqueName: \"kubernetes.io/projected/dc4e60f1-1008-4d97-b338-e095aa0b887d-kube-api-access-8vw45\") pod \"thanos-querier-85dc985d44-l9zh2\" (UID: \"dc4e60f1-1008-4d97-b338-e095aa0b887d\") " pod="openshift-monitoring/thanos-querier-85dc985d44-l9zh2"
Sep 20 00:48:48.057284 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:48.057248    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-85dc985d44-l9zh2"
Sep 20 00:48:48.448972 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:48.448651    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-85dc985d44-l9zh2"]
Sep 20 00:48:48.452403 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:48:48.452362    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc4e60f1_1008_4d97_b338_e095aa0b887d.slice/crio-d8ee648f36a59579c3a52d913f63818e87f5f807c19c7355ff05c56e0f99be24 WatchSource:0}: Error finding container d8ee648f36a59579c3a52d913f63818e87f5f807c19c7355ff05c56e0f99be24: Status 404 returned error can't find the container with id d8ee648f36a59579c3a52d913f63818e87f5f807c19c7355ff05c56e0f99be24
Sep 20 00:48:48.873739 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:48.873699    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"de4f227e-8211-434f-b703-970798d1cb7e","Type":"ContainerStarted","Data":"f8f2df86beb99e126eeabe570f8f83e8f72e30e39ce433ad9a3865e05f39cf69"}
Sep 20 00:48:48.875132 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:48.875106    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85dc985d44-l9zh2" event={"ID":"dc4e60f1-1008-4d97-b338-e095aa0b887d","Type":"ContainerStarted","Data":"d8ee648f36a59579c3a52d913f63818e87f5f807c19c7355ff05c56e0f99be24"}
Sep 20 00:48:48.876927 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:48.876903    2570 generic.go:356] "Generic (PLEG): container finished" podID="7208e8f8-14b5-4807-9033-030973fc1776" containerID="bbd793bf33123c2599a07db4155a850dc9e64a24551a415deff373cff64d68b7" exitCode=0
Sep 20 00:48:48.877031 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:48.876997    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pjrnt" event={"ID":"7208e8f8-14b5-4807-9033-030973fc1776","Type":"ContainerDied","Data":"bbd793bf33123c2599a07db4155a850dc9e64a24551a415deff373cff64d68b7"}
Sep 20 00:48:49.720288 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:49.720244    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c9858598c-269xh"]
Sep 20 00:48:49.724447 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:49.724424    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c9858598c-269xh"
Sep 20 00:48:49.732187 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:49.732144    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 20 00:48:49.735397 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:49.735372    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c9858598c-269xh"]
Sep 20 00:48:49.746346 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:49.746317    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pv4fg\" (UniqueName: \"kubernetes.io/projected/fe17b8a5-9160-4dee-baf3-fb5a31de8337-kube-api-access-pv4fg\") pod \"console-7c9858598c-269xh\" (UID: \"fe17b8a5-9160-4dee-baf3-fb5a31de8337\") " pod="openshift-console/console-7c9858598c-269xh"
Sep 20 00:48:49.746519 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:49.746455    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe17b8a5-9160-4dee-baf3-fb5a31de8337-console-oauth-config\") pod \"console-7c9858598c-269xh\" (UID: \"fe17b8a5-9160-4dee-baf3-fb5a31de8337\") " pod="openshift-console/console-7c9858598c-269xh"
Sep 20 00:48:49.746519 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:49.746497    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe17b8a5-9160-4dee-baf3-fb5a31de8337-oauth-serving-cert\") pod \"console-7c9858598c-269xh\" (UID: \"fe17b8a5-9160-4dee-baf3-fb5a31de8337\") " pod="openshift-console/console-7c9858598c-269xh"
Sep 20 00:48:49.746642 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:49.746523    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe17b8a5-9160-4dee-baf3-fb5a31de8337-console-serving-cert\") pod \"console-7c9858598c-269xh\" (UID: \"fe17b8a5-9160-4dee-baf3-fb5a31de8337\") " pod="openshift-console/console-7c9858598c-269xh"
Sep 20 00:48:49.746642 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:49.746565    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe17b8a5-9160-4dee-baf3-fb5a31de8337-console-config\") pod \"console-7c9858598c-269xh\" (UID: \"fe17b8a5-9160-4dee-baf3-fb5a31de8337\") " pod="openshift-console/console-7c9858598c-269xh"
Sep 20 00:48:49.746642 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:49.746605    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe17b8a5-9160-4dee-baf3-fb5a31de8337-service-ca\") pod \"console-7c9858598c-269xh\" (UID: \"fe17b8a5-9160-4dee-baf3-fb5a31de8337\") " pod="openshift-console/console-7c9858598c-269xh"
Sep 20 00:48:49.746730 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:49.746644    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe17b8a5-9160-4dee-baf3-fb5a31de8337-trusted-ca-bundle\") pod \"console-7c9858598c-269xh\" (UID: \"fe17b8a5-9160-4dee-baf3-fb5a31de8337\") " pod="openshift-console/console-7c9858598c-269xh"
Sep 20 00:48:49.848332 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:49.848297    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe17b8a5-9160-4dee-baf3-fb5a31de8337-console-oauth-config\") pod \"console-7c9858598c-269xh\" (UID: \"fe17b8a5-9160-4dee-baf3-fb5a31de8337\") " pod="openshift-console/console-7c9858598c-269xh"
Sep 20 00:48:49.848488 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:49.848344    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe17b8a5-9160-4dee-baf3-fb5a31de8337-oauth-serving-cert\") pod \"console-7c9858598c-269xh\" (UID: \"fe17b8a5-9160-4dee-baf3-fb5a31de8337\") " pod="openshift-console/console-7c9858598c-269xh"
Sep 20 00:48:49.848488 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:49.848371    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe17b8a5-9160-4dee-baf3-fb5a31de8337-console-serving-cert\") pod \"console-7c9858598c-269xh\" (UID: \"fe17b8a5-9160-4dee-baf3-fb5a31de8337\") " pod="openshift-console/console-7c9858598c-269xh"
Sep 20 00:48:49.848488 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:49.848412    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe17b8a5-9160-4dee-baf3-fb5a31de8337-console-config\") pod \"console-7c9858598c-269xh\" (UID: \"fe17b8a5-9160-4dee-baf3-fb5a31de8337\") " pod="openshift-console/console-7c9858598c-269xh"
Sep 20 00:48:49.848715 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:49.848678    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe17b8a5-9160-4dee-baf3-fb5a31de8337-service-ca\") pod \"console-7c9858598c-269xh\" (UID: \"fe17b8a5-9160-4dee-baf3-fb5a31de8337\") " pod="openshift-console/console-7c9858598c-269xh"
Sep 20 00:48:49.848923 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:49.848728    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe17b8a5-9160-4dee-baf3-fb5a31de8337-trusted-ca-bundle\") pod \"console-7c9858598c-269xh\" (UID: \"fe17b8a5-9160-4dee-baf3-fb5a31de8337\") " pod="openshift-console/console-7c9858598c-269xh"
Sep 20 00:48:49.848923 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:49.848826    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv4fg\" (UniqueName: \"kubernetes.io/projected/fe17b8a5-9160-4dee-baf3-fb5a31de8337-kube-api-access-pv4fg\") pod \"console-7c9858598c-269xh\" (UID: \"fe17b8a5-9160-4dee-baf3-fb5a31de8337\") " pod="openshift-console/console-7c9858598c-269xh"
Sep 20 00:48:49.849258 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:49.849237    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe17b8a5-9160-4dee-baf3-fb5a31de8337-oauth-serving-cert\") pod \"console-7c9858598c-269xh\" (UID: \"fe17b8a5-9160-4dee-baf3-fb5a31de8337\") " pod="openshift-console/console-7c9858598c-269xh"
Sep 20 00:48:49.849363 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:49.849295    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe17b8a5-9160-4dee-baf3-fb5a31de8337-console-config\") pod \"console-7c9858598c-269xh\" (UID: \"fe17b8a5-9160-4dee-baf3-fb5a31de8337\") " pod="openshift-console/console-7c9858598c-269xh"
Sep 20 00:48:49.849617 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:49.849591    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe17b8a5-9160-4dee-baf3-fb5a31de8337-service-ca\") pod \"console-7c9858598c-269xh\" (UID: \"fe17b8a5-9160-4dee-baf3-fb5a31de8337\") " pod="openshift-console/console-7c9858598c-269xh"
Sep 20 00:48:49.850309 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:49.850236    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe17b8a5-9160-4dee-baf3-fb5a31de8337-trusted-ca-bundle\") pod \"console-7c9858598c-269xh\" (UID: \"fe17b8a5-9160-4dee-baf3-fb5a31de8337\") " pod="openshift-console/console-7c9858598c-269xh"
Sep 20 00:48:49.851659 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:49.851618    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe17b8a5-9160-4dee-baf3-fb5a31de8337-console-oauth-config\") pod \"console-7c9858598c-269xh\" (UID: \"fe17b8a5-9160-4dee-baf3-fb5a31de8337\") " pod="openshift-console/console-7c9858598c-269xh"
Sep 20 00:48:49.852114 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:49.852095    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe17b8a5-9160-4dee-baf3-fb5a31de8337-console-serving-cert\") pod \"console-7c9858598c-269xh\" (UID: \"fe17b8a5-9160-4dee-baf3-fb5a31de8337\") " pod="openshift-console/console-7c9858598c-269xh"
Sep 20 00:48:49.859901 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:49.859877    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pv4fg\" (UniqueName: \"kubernetes.io/projected/fe17b8a5-9160-4dee-baf3-fb5a31de8337-kube-api-access-pv4fg\") pod \"console-7c9858598c-269xh\" (UID: \"fe17b8a5-9160-4dee-baf3-fb5a31de8337\") " pod="openshift-console/console-7c9858598c-269xh"
Sep 20 00:48:49.884483 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:49.884013    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8l78p" event={"ID":"b1493406-5ee3-4730-a7b5-fd36f59263d4","Type":"ContainerStarted","Data":"a023ac41d5be45977ba1a8acd5637062c8d7340bbbcd1570f8a3cf022cb30d61"}
Sep 20 00:48:49.885978 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:49.885948    2570 generic.go:356] "Generic (PLEG): container finished" podID="de4f227e-8211-434f-b703-970798d1cb7e" containerID="d249b5bf137ac102267472676a0d8c2281cd997e14a0825175d9216affed8840" exitCode=0
Sep 20 00:48:49.886118 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:49.886060    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"de4f227e-8211-434f-b703-970798d1cb7e","Type":"ContainerDied","Data":"d249b5bf137ac102267472676a0d8c2281cd997e14a0825175d9216affed8840"}
Sep 20 00:48:49.890097 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:49.889884    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-9nmdf" event={"ID":"c86586fe-ddbb-4bda-8f1d-51a41f70b978","Type":"ContainerStarted","Data":"50e5e0bfb7299730edd33d243a984516a086d939d8097b1aac1ef58926ae64a5"}
Sep 20 00:48:49.890097 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:49.889942    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-9nmdf" event={"ID":"c86586fe-ddbb-4bda-8f1d-51a41f70b978","Type":"ContainerStarted","Data":"fe7aa016208aad8e72280d4ce789b050a0b47577513b148934313bc9c4aa4236"}
Sep 20 00:48:49.890097 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:49.889970    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-9nmdf" event={"ID":"c86586fe-ddbb-4bda-8f1d-51a41f70b978","Type":"ContainerStarted","Data":"78b0596f365cafcdc890107d744898dc4987e1d9f5e22d7854776db8c88db9c5"}
Sep 20 00:48:49.892472 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:49.892450    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pjrnt" event={"ID":"7208e8f8-14b5-4807-9033-030973fc1776","Type":"ContainerStarted","Data":"4b0825faf37a68d57d4d94cc2f801ec28c85015ec2d25c60547b138205c70ec7"}
Sep 20 00:48:49.892544 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:49.892495    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pjrnt" event={"ID":"7208e8f8-14b5-4807-9033-030973fc1776","Type":"ContainerStarted","Data":"aec67f205438582b886b4e7903c2c4859856b808bb51ccd7198f6062d939bbd8"}
Sep 20 00:48:49.901196 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:49.901148    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-8l78p" podStartSLOduration=3.291740279 podStartE2EDuration="4.901130406s" totalImagesPullingTime="1.609390127s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:48:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:49.899908876 +0000 UTC m=+66.514064804" watchObservedRunningTime="2026-09-20 00:48:49.901130406 +0000 UTC m=+66.515286298"
Sep 20 00:48:49.943877 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:49.943818    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pjrnt" podStartSLOduration=4.06361468 podStartE2EDuration="4.943802253s" totalImagesPullingTime="799.141426ms" totalInitContainerRuntime="81.046147ms" isStatefulPod=true podCreationTimestamp="2026-09-20 00:48:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:49.9430044 +0000 UTC m=+66.557160330" watchObservedRunningTime="2026-09-20 00:48:49.943802253 +0000 UTC m=+66.557958149"
Sep 20 00:48:49.960483 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:49.960389    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-84c885658c-9nmdf" podStartSLOduration=3.2596949029999998 podStartE2EDuration="4.960368962s" totalImagesPullingTime="1.700674059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:48:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:49.959462807 +0000 UTC m=+66.573618729" watchObservedRunningTime="2026-09-20 00:48:49.960368962 +0000 UTC m=+66.574524860"
Sep 20 00:48:50.046704 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:50.046555    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c9858598c-269xh"
Sep 20 00:48:50.123672 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:50.123635    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-68df66cd47-2gps6"]
Sep 20 00:48:50.126124 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:50.126094    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-68df66cd47-2gps6"
Sep 20 00:48:50.128221 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:50.128190    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 20 00:48:50.128371 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:50.128340    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-6mqt2a9ltolnd\""
Sep 20 00:48:50.128523 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:50.128471    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 20 00:48:50.128594 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:50.128549    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-66wgs\""
Sep 20 00:48:50.128655 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:50.128643    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 20 00:48:50.128805 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:50.128787    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 20 00:48:50.137151 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:50.137125    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-68df66cd47-2gps6"]
Sep 20 00:48:50.153507 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:50.153476    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/937b56ff-1068-4a7c-83f4-549093b1bfc4-metrics-server-audit-profiles\") pod \"metrics-server-68df66cd47-2gps6\" (UID: \"937b56ff-1068-4a7c-83f4-549093b1bfc4\") " pod="openshift-monitoring/metrics-server-68df66cd47-2gps6"
Sep 20 00:48:50.153644 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:50.153552    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5g6ff\" (UniqueName: \"kubernetes.io/projected/937b56ff-1068-4a7c-83f4-549093b1bfc4-kube-api-access-5g6ff\") pod \"metrics-server-68df66cd47-2gps6\" (UID: \"937b56ff-1068-4a7c-83f4-549093b1bfc4\") " pod="openshift-monitoring/metrics-server-68df66cd47-2gps6"
Sep 20 00:48:50.153644 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:50.153579    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/937b56ff-1068-4a7c-83f4-549093b1bfc4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-68df66cd47-2gps6\" (UID: \"937b56ff-1068-4a7c-83f4-549093b1bfc4\") " pod="openshift-monitoring/metrics-server-68df66cd47-2gps6"
Sep 20 00:48:50.153767 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:50.153642    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/937b56ff-1068-4a7c-83f4-549093b1bfc4-secret-metrics-server-client-certs\") pod \"metrics-server-68df66cd47-2gps6\" (UID: \"937b56ff-1068-4a7c-83f4-549093b1bfc4\") " pod="openshift-monitoring/metrics-server-68df66cd47-2gps6"
Sep 20 00:48:50.153767 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:50.153682    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/937b56ff-1068-4a7c-83f4-549093b1bfc4-secret-metrics-server-tls\") pod \"metrics-server-68df66cd47-2gps6\" (UID: \"937b56ff-1068-4a7c-83f4-549093b1bfc4\") " pod="openshift-monitoring/metrics-server-68df66cd47-2gps6"
Sep 20 00:48:50.153767 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:50.153705    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/937b56ff-1068-4a7c-83f4-549093b1bfc4-audit-log\") pod \"metrics-server-68df66cd47-2gps6\" (UID: \"937b56ff-1068-4a7c-83f4-549093b1bfc4\") " pod="openshift-monitoring/metrics-server-68df66cd47-2gps6"
Sep 20 00:48:50.153767 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:50.153753    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/937b56ff-1068-4a7c-83f4-549093b1bfc4-client-ca-bundle\") pod \"metrics-server-68df66cd47-2gps6\" (UID: \"937b56ff-1068-4a7c-83f4-549093b1bfc4\") " pod="openshift-monitoring/metrics-server-68df66cd47-2gps6"
Sep 20 00:48:50.254997 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:50.254910    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/937b56ff-1068-4a7c-83f4-549093b1bfc4-metrics-server-audit-profiles\") pod \"metrics-server-68df66cd47-2gps6\" (UID: \"937b56ff-1068-4a7c-83f4-549093b1bfc4\") " pod="openshift-monitoring/metrics-server-68df66cd47-2gps6"
Sep 20 00:48:50.254997 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:50.254990    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5g6ff\" (UniqueName: \"kubernetes.io/projected/937b56ff-1068-4a7c-83f4-549093b1bfc4-kube-api-access-5g6ff\") pod \"metrics-server-68df66cd47-2gps6\" (UID: \"937b56ff-1068-4a7c-83f4-549093b1bfc4\") " pod="openshift-monitoring/metrics-server-68df66cd47-2gps6"
Sep 20 00:48:50.255210 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:50.255032    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/937b56ff-1068-4a7c-83f4-549093b1bfc4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-68df66cd47-2gps6\" (UID: \"937b56ff-1068-4a7c-83f4-549093b1bfc4\") " pod="openshift-monitoring/metrics-server-68df66cd47-2gps6"
Sep 20 00:48:50.255210 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:50.255088    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/937b56ff-1068-4a7c-83f4-549093b1bfc4-secret-metrics-server-client-certs\") pod \"metrics-server-68df66cd47-2gps6\" (UID: \"937b56ff-1068-4a7c-83f4-549093b1bfc4\") " pod="openshift-monitoring/metrics-server-68df66cd47-2gps6"
Sep 20 00:48:50.255210 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:50.255124    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/937b56ff-1068-4a7c-83f4-549093b1bfc4-secret-metrics-server-tls\") pod \"metrics-server-68df66cd47-2gps6\" (UID: \"937b56ff-1068-4a7c-83f4-549093b1bfc4\") " pod="openshift-monitoring/metrics-server-68df66cd47-2gps6"
Sep 20 00:48:50.255210 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:50.255148    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/937b56ff-1068-4a7c-83f4-549093b1bfc4-audit-log\") pod \"metrics-server-68df66cd47-2gps6\" (UID: \"937b56ff-1068-4a7c-83f4-549093b1bfc4\") " pod="openshift-monitoring/metrics-server-68df66cd47-2gps6"
Sep 20 00:48:50.255391 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:50.255215    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/937b56ff-1068-4a7c-83f4-549093b1bfc4-client-ca-bundle\") pod \"metrics-server-68df66cd47-2gps6\" (UID: \"937b56ff-1068-4a7c-83f4-549093b1bfc4\") " pod="openshift-monitoring/metrics-server-68df66cd47-2gps6"
Sep 20 00:48:50.255676 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:50.255646    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/937b56ff-1068-4a7c-83f4-549093b1bfc4-audit-log\") pod \"metrics-server-68df66cd47-2gps6\" (UID: \"937b56ff-1068-4a7c-83f4-549093b1bfc4\") " pod="openshift-monitoring/metrics-server-68df66cd47-2gps6"
Sep 20 00:48:50.256234 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:50.256200    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/937b56ff-1068-4a7c-83f4-549093b1bfc4-metrics-server-audit-profiles\") pod \"metrics-server-68df66cd47-2gps6\" (UID: \"937b56ff-1068-4a7c-83f4-549093b1bfc4\") " pod="openshift-monitoring/metrics-server-68df66cd47-2gps6"
Sep 20 00:48:50.256388 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:50.256368    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/937b56ff-1068-4a7c-83f4-549093b1bfc4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-68df66cd47-2gps6\" (UID: \"937b56ff-1068-4a7c-83f4-549093b1bfc4\") " pod="openshift-monitoring/metrics-server-68df66cd47-2gps6"
Sep 20 00:48:50.258235 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:50.258132    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/937b56ff-1068-4a7c-83f4-549093b1bfc4-secret-metrics-server-tls\") pod \"metrics-server-68df66cd47-2gps6\" (UID: \"937b56ff-1068-4a7c-83f4-549093b1bfc4\") " pod="openshift-monitoring/metrics-server-68df66cd47-2gps6"
Sep 20 00:48:50.258235 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:50.258219    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/937b56ff-1068-4a7c-83f4-549093b1bfc4-secret-metrics-server-client-certs\") pod \"metrics-server-68df66cd47-2gps6\" (UID: \"937b56ff-1068-4a7c-83f4-549093b1bfc4\") " pod="openshift-monitoring/metrics-server-68df66cd47-2gps6"
Sep 20 00:48:50.258400 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:50.258273    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/937b56ff-1068-4a7c-83f4-549093b1bfc4-client-ca-bundle\") pod \"metrics-server-68df66cd47-2gps6\" (UID: \"937b56ff-1068-4a7c-83f4-549093b1bfc4\") " pod="openshift-monitoring/metrics-server-68df66cd47-2gps6"
Sep 20 00:48:50.262447 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:50.262424    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5g6ff\" (UniqueName: \"kubernetes.io/projected/937b56ff-1068-4a7c-83f4-549093b1bfc4-kube-api-access-5g6ff\") pod \"metrics-server-68df66cd47-2gps6\" (UID: \"937b56ff-1068-4a7c-83f4-549093b1bfc4\") " pod="openshift-monitoring/metrics-server-68df66cd47-2gps6"
Sep 20 00:48:50.438803 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:50.438387    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-68df66cd47-2gps6"
Sep 20 00:48:50.666683 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:50.666651    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c9858598c-269xh"]
Sep 20 00:48:50.669765 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:48:50.669742    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe17b8a5_9160_4dee_baf3_fb5a31de8337.slice/crio-8747f9734f8da03da9d24a1d131172088af538a19c3d6325054b7c22fe03fbc0 WatchSource:0}: Error finding container 8747f9734f8da03da9d24a1d131172088af538a19c3d6325054b7c22fe03fbc0: Status 404 returned error can't find the container with id 8747f9734f8da03da9d24a1d131172088af538a19c3d6325054b7c22fe03fbc0
Sep 20 00:48:50.713057 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:50.712983    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-68df66cd47-2gps6"]
Sep 20 00:48:50.719065 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:48:50.719034    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod937b56ff_1068_4a7c_83f4_549093b1bfc4.slice/crio-fe0d08cc67c2ea350be89b787c1e58d6da21e5c425b95f92a14b9bed3602b141 WatchSource:0}: Error finding container fe0d08cc67c2ea350be89b787c1e58d6da21e5c425b95f92a14b9bed3602b141: Status 404 returned error can't find the container with id fe0d08cc67c2ea350be89b787c1e58d6da21e5c425b95f92a14b9bed3602b141
Sep 20 00:48:50.901138 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:50.901107    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85dc985d44-l9zh2" event={"ID":"dc4e60f1-1008-4d97-b338-e095aa0b887d","Type":"ContainerStarted","Data":"62b1e4b3fd7b4fe61dc5645af86a226f0d17db5db57de295a607d3c63d88c53a"}
Sep 20 00:48:50.901608 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:50.901174    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85dc985d44-l9zh2" event={"ID":"dc4e60f1-1008-4d97-b338-e095aa0b887d","Type":"ContainerStarted","Data":"1b5c1909ce9588abf45d4fd8913e36c49c27c19cbaed0aeb9e2b82c99ad52aa4"}
Sep 20 00:48:50.901608 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:50.901206    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85dc985d44-l9zh2" event={"ID":"dc4e60f1-1008-4d97-b338-e095aa0b887d","Type":"ContainerStarted","Data":"d54782f87be35018dfa4676febe64087666f49206e841fc92aa51d1a16580f23"}
Sep 20 00:48:50.903080 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:50.903049    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c9858598c-269xh" event={"ID":"fe17b8a5-9160-4dee-baf3-fb5a31de8337","Type":"ContainerStarted","Data":"84ad5fa52324bc71b1b2fc8a6b2b1864249c53d32debfb30fac06a4e252c239b"}
Sep 20 00:48:50.903196 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:50.903103    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c9858598c-269xh" event={"ID":"fe17b8a5-9160-4dee-baf3-fb5a31de8337","Type":"ContainerStarted","Data":"8747f9734f8da03da9d24a1d131172088af538a19c3d6325054b7c22fe03fbc0"}
Sep 20 00:48:50.904556 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:50.904528    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-68df66cd47-2gps6" event={"ID":"937b56ff-1068-4a7c-83f4-549093b1bfc4","Type":"ContainerStarted","Data":"fe0d08cc67c2ea350be89b787c1e58d6da21e5c425b95f92a14b9bed3602b141"}
Sep 20 00:48:50.921439 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:50.921376    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c9858598c-269xh" podStartSLOduration=1.9213573240000001 podStartE2EDuration="1.921357324s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:48:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:50.919235148 +0000 UTC m=+67.533391066" watchObservedRunningTime="2026-09-20 00:48:50.921357324 +0000 UTC m=+67.535513222"
Sep 20 00:48:51.166139 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:51.166044    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a588c630-f4a9-49b7-9ff1-1386742f40e3-original-pull-secret\") pod \"global-pull-secret-syncer-9mws2\" (UID: \"a588c630-f4a9-49b7-9ff1-1386742f40e3\") " pod="kube-system/global-pull-secret-syncer-9mws2"
Sep 20 00:48:51.166139 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:51.166119    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0d1f872-b92c-4b72-bdee-a7ac18493d84-metrics-certs\") pod \"network-metrics-daemon-94nzn\" (UID: \"a0d1f872-b92c-4b72-bdee-a7ac18493d84\") " pod="openshift-multus/network-metrics-daemon-94nzn"
Sep 20 00:48:51.168125 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:51.168094    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 20 00:48:51.168352 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:51.168334    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 20 00:48:51.179653 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:51.179599    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a588c630-f4a9-49b7-9ff1-1386742f40e3-original-pull-secret\") pod \"global-pull-secret-syncer-9mws2\" (UID: \"a588c630-f4a9-49b7-9ff1-1386742f40e3\") " pod="kube-system/global-pull-secret-syncer-9mws2"
Sep 20 00:48:51.180143 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:51.180121    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0d1f872-b92c-4b72-bdee-a7ac18493d84-metrics-certs\") pod \"network-metrics-daemon-94nzn\" (UID: \"a0d1f872-b92c-4b72-bdee-a7ac18493d84\") " pod="openshift-multus/network-metrics-daemon-94nzn"
Sep 20 00:48:51.266582 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:51.266541    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5hsb\" (UniqueName: \"kubernetes.io/projected/e0167375-aa59-43a4-a5ba-e0b165da8b30-kube-api-access-l5hsb\") pod \"network-check-target-t6qv8\" (UID: \"e0167375-aa59-43a4-a5ba-e0b165da8b30\") " pod="openshift-network-diagnostics/network-check-target-t6qv8"
Sep 20 00:48:51.269209 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:51.269160    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 20 00:48:51.279707 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:51.279676    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 20 00:48:51.291848 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:51.291821    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5hsb\" (UniqueName: \"kubernetes.io/projected/e0167375-aa59-43a4-a5ba-e0b165da8b30-kube-api-access-l5hsb\") pod \"network-check-target-t6qv8\" (UID: \"e0167375-aa59-43a4-a5ba-e0b165da8b30\") " pod="openshift-network-diagnostics/network-check-target-t6qv8"
Sep 20 00:48:51.459421 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:51.459340    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mws2"
Sep 20 00:48:51.466784 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:51.466566    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fnqwj\""
Sep 20 00:48:51.472036 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:51.472016    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lkppn\""
Sep 20 00:48:51.474785 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:51.474620    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t6qv8"
Sep 20 00:48:51.480648 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:51.480619    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94nzn"
Sep 20 00:48:52.301202 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:52.300058    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9mws2"]
Sep 20 00:48:52.305059 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:48:52.305012    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda588c630_f4a9_49b7_9ff1_1386742f40e3.slice/crio-a8ae68201056b2e0a4a4d7e4385d4e1658e3f03989d35998597662c1aad071b9 WatchSource:0}: Error finding container a8ae68201056b2e0a4a4d7e4385d4e1658e3f03989d35998597662c1aad071b9: Status 404 returned error can't find the container with id a8ae68201056b2e0a4a4d7e4385d4e1658e3f03989d35998597662c1aad071b9
Sep 20 00:48:52.305903 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:52.305880    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-t6qv8"]
Sep 20 00:48:52.309024 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:48:52.308999    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0167375_aa59_43a4_a5ba_e0b165da8b30.slice/crio-1926ef04874b14523f545755e43f50a43f0d60a965ce73b02539248ffc19faa5 WatchSource:0}: Error finding container 1926ef04874b14523f545755e43f50a43f0d60a965ce73b02539248ffc19faa5: Status 404 returned error can't find the container with id 1926ef04874b14523f545755e43f50a43f0d60a965ce73b02539248ffc19faa5
Sep 20 00:48:52.319739 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:52.319719    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-94nzn"]
Sep 20 00:48:52.324451 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:48:52.324419    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0d1f872_b92c_4b72_bdee_a7ac18493d84.slice/crio-1f38ca1191e489a41478a95f1020d9a6b7aa53406e6f81cc3e050f425533bf16 WatchSource:0}: Error finding container 1f38ca1191e489a41478a95f1020d9a6b7aa53406e6f81cc3e050f425533bf16: Status 404 returned error can't find the container with id 1f38ca1191e489a41478a95f1020d9a6b7aa53406e6f81cc3e050f425533bf16
Sep 20 00:48:52.920708 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:52.920663    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-94nzn" event={"ID":"a0d1f872-b92c-4b72-bdee-a7ac18493d84","Type":"ContainerStarted","Data":"1f38ca1191e489a41478a95f1020d9a6b7aa53406e6f81cc3e050f425533bf16"}
Sep 20 00:48:52.923431 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:52.923285    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-t6qv8" event={"ID":"e0167375-aa59-43a4-a5ba-e0b165da8b30","Type":"ContainerStarted","Data":"1926ef04874b14523f545755e43f50a43f0d60a965ce73b02539248ffc19faa5"}
Sep 20 00:48:52.931603 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:52.931576    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"de4f227e-8211-434f-b703-970798d1cb7e","Type":"ContainerStarted","Data":"dc10b14681de5db9f16415bb49bf850939d8f032fe533d85928563e4094a0d89"}
Sep 20 00:48:52.931905 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:52.931635    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"de4f227e-8211-434f-b703-970798d1cb7e","Type":"ContainerStarted","Data":"d869d498ec41d5dc56bf81464349ecf1caf15ba1e74da1f9969779e4c537cb94"}
Sep 20 00:48:52.931905 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:52.931669    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"de4f227e-8211-434f-b703-970798d1cb7e","Type":"ContainerStarted","Data":"50d293c55841f1813ff06aa04a881bb332193ada25ad056c10e28b0ccbe9e75c"}
Sep 20 00:48:52.931905 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:52.931702    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"de4f227e-8211-434f-b703-970798d1cb7e","Type":"ContainerStarted","Data":"a0efc6908f1e2c5762f7e7aea42a8ea1550d7acaf25d064055b42293f150868f"}
Sep 20 00:48:52.931905 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:52.931729    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"de4f227e-8211-434f-b703-970798d1cb7e","Type":"ContainerStarted","Data":"4e4834c56fd9a8ffc83a889d321c55ed55d56e75eaa26716e9b9a08987a57b4d"}
Sep 20 00:48:52.931905 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:52.931752    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"de4f227e-8211-434f-b703-970798d1cb7e","Type":"ContainerStarted","Data":"f967d1691ea43a8ef80ec647fae6b0bd45c1a538540093fb3c2192f8949c0c99"}
Sep 20 00:48:52.934638 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:52.934606    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-68df66cd47-2gps6" event={"ID":"937b56ff-1068-4a7c-83f4-549093b1bfc4","Type":"ContainerStarted","Data":"0a46c653d5cfab89289a02dedcd58d35d634f363576cd876fef957e72cbc0b89"}
Sep 20 00:48:52.941588 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:52.940637    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85dc985d44-l9zh2" event={"ID":"dc4e60f1-1008-4d97-b338-e095aa0b887d","Type":"ContainerStarted","Data":"ba4c4d3b78dcf2f926839ac1d04dca4cbb4d20eea27eb9f1249e583d650760e7"}
Sep 20 00:48:52.941588 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:52.940714    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85dc985d44-l9zh2" event={"ID":"dc4e60f1-1008-4d97-b338-e095aa0b887d","Type":"ContainerStarted","Data":"3bb1760544ae07984b1e6a3028a5310e17da0064fc70d83fd931eb75cc862f7a"}
Sep 20 00:48:52.941588 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:52.940764    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85dc985d44-l9zh2" event={"ID":"dc4e60f1-1008-4d97-b338-e095aa0b887d","Type":"ContainerStarted","Data":"614014fb5a142b2532bc837ca9fc357279013534d9362f5b7e4bb4f94df6e161"}
Sep 20 00:48:52.941588 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:52.940937    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-85dc985d44-l9zh2"
Sep 20 00:48:52.942450 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:52.942431    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9mws2" event={"ID":"a588c630-f4a9-49b7-9ff1-1386742f40e3","Type":"ContainerStarted","Data":"a8ae68201056b2e0a4a4d7e4385d4e1658e3f03989d35998597662c1aad071b9"}
Sep 20 00:48:52.960654 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:52.960511    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.22957812 podStartE2EDuration="6.96049455s" totalImagesPullingTime="3.713347086s" totalInitContainerRuntime="17.569344ms" isStatefulPod=false podCreationTimestamp="2026-09-20 00:48:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:52.959084449 +0000 UTC m=+69.573240370" watchObservedRunningTime="2026-09-20 00:48:52.96049455 +0000 UTC m=+69.574650465"
Sep 20 00:48:52.983400 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:52.981983    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-85dc985d44-l9zh2" podStartSLOduration=2.627142101 podStartE2EDuration="5.981965309s" totalImagesPullingTime="3.354823208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:48:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:52.981248947 +0000 UTC m=+69.595404893" watchObservedRunningTime="2026-09-20 00:48:52.981965309 +0000 UTC m=+69.596121219"
Sep 20 00:48:53.002627 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:53.001540    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-68df66cd47-2gps6" podStartSLOduration=1.649774795 podStartE2EDuration="3.001519568s" totalImagesPullingTime="1.351744773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:48:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:52.999756148 +0000 UTC m=+69.613912069" watchObservedRunningTime="2026-09-20 00:48:53.001519568 +0000 UTC m=+69.615675466"
Sep 20 00:48:53.282663 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:53.282582    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d7bfffc48-jdrmz"
Sep 20 00:48:53.283339 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:53.283314    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d7bfffc48-jdrmz"
Sep 20 00:48:53.290729 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:53.290499    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d7bfffc48-jdrmz"
Sep 20 00:48:53.951438 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:53.951394    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-94nzn" event={"ID":"a0d1f872-b92c-4b72-bdee-a7ac18493d84","Type":"ContainerStarted","Data":"ed4f4245072478e1d63514e24124706bcff4f16be1fb1fc43e26e6b141dae900"}
Sep 20 00:48:53.951890 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:53.951454    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-94nzn" event={"ID":"a0d1f872-b92c-4b72-bdee-a7ac18493d84","Type":"ContainerStarted","Data":"02e2231ab49f4c80e37f0109118e537b806e61981988c58133756473f1874ba3"}
Sep 20 00:48:53.957472 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:53.957447    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d7bfffc48-jdrmz"
Sep 20 00:48:53.966504 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:53.966022    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-94nzn" podStartSLOduration=67.813679225 podStartE2EDuration="1m8.966003225s" totalImagesPullingTime="1.152324s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:47:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:53.965252358 +0000 UTC m=+70.579408283" watchObservedRunningTime="2026-09-20 00:48:53.966003225 +0000 UTC m=+70.580159122"
Sep 20 00:48:54.940013 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:54.939470    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c9858598c-269xh"]
Sep 20 00:48:54.956871 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:54.956841    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-75bf798c6d-8jjsh"]
Sep 20 00:48:54.962172 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:54.962150    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75bf798c6d-8jjsh"
Sep 20 00:48:54.969384 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:54.969358    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75bf798c6d-8jjsh"]
Sep 20 00:48:55.009266 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:55.007621    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e828c99-0418-4cab-bcfb-ce31e5b2b5a4-trusted-ca-bundle\") pod \"console-75bf798c6d-8jjsh\" (UID: \"2e828c99-0418-4cab-bcfb-ce31e5b2b5a4\") " pod="openshift-console/console-75bf798c6d-8jjsh"
Sep 20 00:48:55.009266 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:55.007716    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2e828c99-0418-4cab-bcfb-ce31e5b2b5a4-service-ca\") pod \"console-75bf798c6d-8jjsh\" (UID: \"2e828c99-0418-4cab-bcfb-ce31e5b2b5a4\") " pod="openshift-console/console-75bf798c6d-8jjsh"
Sep 20 00:48:55.009266 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:55.007760    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2e828c99-0418-4cab-bcfb-ce31e5b2b5a4-console-oauth-config\") pod \"console-75bf798c6d-8jjsh\" (UID: \"2e828c99-0418-4cab-bcfb-ce31e5b2b5a4\") " pod="openshift-console/console-75bf798c6d-8jjsh"
Sep 20 00:48:55.009266 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:55.007795    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2e828c99-0418-4cab-bcfb-ce31e5b2b5a4-console-serving-cert\") pod \"console-75bf798c6d-8jjsh\" (UID: \"2e828c99-0418-4cab-bcfb-ce31e5b2b5a4\") " pod="openshift-console/console-75bf798c6d-8jjsh"
Sep 20 00:48:55.009266 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:55.007831    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2e828c99-0418-4cab-bcfb-ce31e5b2b5a4-oauth-serving-cert\") pod \"console-75bf798c6d-8jjsh\" (UID: \"2e828c99-0418-4cab-bcfb-ce31e5b2b5a4\") " pod="openshift-console/console-75bf798c6d-8jjsh"
Sep 20 00:48:55.009266 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:55.007854    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtw2r\" (UniqueName: \"kubernetes.io/projected/2e828c99-0418-4cab-bcfb-ce31e5b2b5a4-kube-api-access-dtw2r\") pod \"console-75bf798c6d-8jjsh\" (UID: \"2e828c99-0418-4cab-bcfb-ce31e5b2b5a4\") " pod="openshift-console/console-75bf798c6d-8jjsh"
Sep 20 00:48:55.009266 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:55.007903    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2e828c99-0418-4cab-bcfb-ce31e5b2b5a4-console-config\") pod \"console-75bf798c6d-8jjsh\" (UID: \"2e828c99-0418-4cab-bcfb-ce31e5b2b5a4\") " pod="openshift-console/console-75bf798c6d-8jjsh"
Sep 20 00:48:55.109036 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:55.108990    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2e828c99-0418-4cab-bcfb-ce31e5b2b5a4-service-ca\") pod \"console-75bf798c6d-8jjsh\" (UID: \"2e828c99-0418-4cab-bcfb-ce31e5b2b5a4\") " pod="openshift-console/console-75bf798c6d-8jjsh"
Sep 20 00:48:55.109229 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:55.109054    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2e828c99-0418-4cab-bcfb-ce31e5b2b5a4-console-oauth-config\") pod \"console-75bf798c6d-8jjsh\" (UID: \"2e828c99-0418-4cab-bcfb-ce31e5b2b5a4\") " pod="openshift-console/console-75bf798c6d-8jjsh"
Sep 20 00:48:55.109229 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:55.109087    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2e828c99-0418-4cab-bcfb-ce31e5b2b5a4-console-serving-cert\") pod \"console-75bf798c6d-8jjsh\" (UID: \"2e828c99-0418-4cab-bcfb-ce31e5b2b5a4\") " pod="openshift-console/console-75bf798c6d-8jjsh"
Sep 20 00:48:55.109229 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:55.109117    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2e828c99-0418-4cab-bcfb-ce31e5b2b5a4-oauth-serving-cert\") pod \"console-75bf798c6d-8jjsh\" (UID: \"2e828c99-0418-4cab-bcfb-ce31e5b2b5a4\") " pod="openshift-console/console-75bf798c6d-8jjsh"
Sep 20 00:48:55.109229 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:55.109140    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtw2r\" (UniqueName: \"kubernetes.io/projected/2e828c99-0418-4cab-bcfb-ce31e5b2b5a4-kube-api-access-dtw2r\") pod \"console-75bf798c6d-8jjsh\" (UID: \"2e828c99-0418-4cab-bcfb-ce31e5b2b5a4\") " pod="openshift-console/console-75bf798c6d-8jjsh"
Sep 20 00:48:55.109229 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:55.109166    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2e828c99-0418-4cab-bcfb-ce31e5b2b5a4-console-config\") pod \"console-75bf798c6d-8jjsh\" (UID: \"2e828c99-0418-4cab-bcfb-ce31e5b2b5a4\") " pod="openshift-console/console-75bf798c6d-8jjsh"
Sep 20 00:48:55.109229 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:55.109224    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e828c99-0418-4cab-bcfb-ce31e5b2b5a4-trusted-ca-bundle\") pod \"console-75bf798c6d-8jjsh\" (UID: \"2e828c99-0418-4cab-bcfb-ce31e5b2b5a4\") " pod="openshift-console/console-75bf798c6d-8jjsh"
Sep 20 00:48:55.109935 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:55.109905    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2e828c99-0418-4cab-bcfb-ce31e5b2b5a4-service-ca\") pod \"console-75bf798c6d-8jjsh\" (UID: \"2e828c99-0418-4cab-bcfb-ce31e5b2b5a4\") " pod="openshift-console/console-75bf798c6d-8jjsh"
Sep 20 00:48:55.110075 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:55.110056    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e828c99-0418-4cab-bcfb-ce31e5b2b5a4-trusted-ca-bundle\") pod \"console-75bf798c6d-8jjsh\" (UID: \"2e828c99-0418-4cab-bcfb-ce31e5b2b5a4\") " pod="openshift-console/console-75bf798c6d-8jjsh"
Sep 20 00:48:55.110296 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:55.110264    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2e828c99-0418-4cab-bcfb-ce31e5b2b5a4-console-config\") pod \"console-75bf798c6d-8jjsh\" (UID: \"2e828c99-0418-4cab-bcfb-ce31e5b2b5a4\") " pod="openshift-console/console-75bf798c6d-8jjsh"
Sep 20 00:48:55.110471 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:55.110451    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2e828c99-0418-4cab-bcfb-ce31e5b2b5a4-oauth-serving-cert\") pod \"console-75bf798c6d-8jjsh\" (UID: \"2e828c99-0418-4cab-bcfb-ce31e5b2b5a4\") " pod="openshift-console/console-75bf798c6d-8jjsh"
Sep 20 00:48:55.112700 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:55.112676    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2e828c99-0418-4cab-bcfb-ce31e5b2b5a4-console-oauth-config\") pod \"console-75bf798c6d-8jjsh\" (UID: \"2e828c99-0418-4cab-bcfb-ce31e5b2b5a4\") " pod="openshift-console/console-75bf798c6d-8jjsh"
Sep 20 00:48:55.112831 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:55.112812    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2e828c99-0418-4cab-bcfb-ce31e5b2b5a4-console-serving-cert\") pod \"console-75bf798c6d-8jjsh\" (UID: \"2e828c99-0418-4cab-bcfb-ce31e5b2b5a4\") " pod="openshift-console/console-75bf798c6d-8jjsh"
Sep 20 00:48:55.117627 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:55.117604    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtw2r\" (UniqueName: \"kubernetes.io/projected/2e828c99-0418-4cab-bcfb-ce31e5b2b5a4-kube-api-access-dtw2r\") pod \"console-75bf798c6d-8jjsh\" (UID: \"2e828c99-0418-4cab-bcfb-ce31e5b2b5a4\") " pod="openshift-console/console-75bf798c6d-8jjsh"
Sep 20 00:48:55.275589 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:55.275504    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75bf798c6d-8jjsh"
Sep 20 00:48:57.521801 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:57.521673    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75bf798c6d-8jjsh"]
Sep 20 00:48:57.525981 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:48:57.525950    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e828c99_0418_4cab_bcfb_ce31e5b2b5a4.slice/crio-57eadbe6e38de00b08d2c7d787f1f453cb87bb83f8af1aea66f258badcde4ceb WatchSource:0}: Error finding container 57eadbe6e38de00b08d2c7d787f1f453cb87bb83f8af1aea66f258badcde4ceb: Status 404 returned error can't find the container with id 57eadbe6e38de00b08d2c7d787f1f453cb87bb83f8af1aea66f258badcde4ceb
Sep 20 00:48:57.975494 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:57.975461    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9mws2" event={"ID":"a588c630-f4a9-49b7-9ff1-1386742f40e3","Type":"ContainerStarted","Data":"0de11762173830ea1fa50e05c4705fb50e1a8c75c7e33bd8181191aec9d2c77f"}
Sep 20 00:48:57.977205 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:57.977180    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75bf798c6d-8jjsh" event={"ID":"2e828c99-0418-4cab-bcfb-ce31e5b2b5a4","Type":"ContainerStarted","Data":"e5a2b83f22399fad67d07f996d6c4b869ecd7c5e400714d6d0253eb24c0c9246"}
Sep 20 00:48:57.977312 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:57.977223    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75bf798c6d-8jjsh" event={"ID":"2e828c99-0418-4cab-bcfb-ce31e5b2b5a4","Type":"ContainerStarted","Data":"57eadbe6e38de00b08d2c7d787f1f453cb87bb83f8af1aea66f258badcde4ceb"}
Sep 20 00:48:57.978665 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:57.978638    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-t6qv8" event={"ID":"e0167375-aa59-43a4-a5ba-e0b165da8b30","Type":"ContainerStarted","Data":"99d498e1bb91d6ff204070fe5322d665f96f284faca55ffed364e8d5b2398a5a"}
Sep 20 00:48:57.978773 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:57.978758    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-t6qv8"
Sep 20 00:48:57.988838 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:57.988800    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9mws2" podStartSLOduration=68.030946672 podStartE2EDuration="1m12.988787307s" totalImagesPullingTime="4.957840635s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-20 00:47:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:57.987822121 +0000 UTC m=+74.601978019" watchObservedRunningTime="2026-09-20 00:48:57.988787307 +0000 UTC m=+74.602943204"
Sep 20 00:48:58.003159 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:58.003115    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-75bf798c6d-8jjsh" podStartSLOduration=4.003100635 podStartE2EDuration="4.003100635s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:48:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:58.002639164 +0000 UTC m=+74.616795118" watchObservedRunningTime="2026-09-20 00:48:58.003100635 +0000 UTC m=+74.617256532"
Sep 20 00:48:58.016336 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:58.016298    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-t6qv8" podStartSLOduration=68.070573283 podStartE2EDuration="1m13.016285108s" totalImagesPullingTime="4.945711825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:47:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:48:58.015337066 +0000 UTC m=+74.629492984" watchObservedRunningTime="2026-09-20 00:48:58.016285108 +0000 UTC m=+74.630441004"
Sep 20 00:48:58.959126 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:48:58.959098    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-85dc985d44-l9zh2"
Sep 20 00:49:00.046995 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:00.046950    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c9858598c-269xh"
Sep 20 00:49:05.276505 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:05.276468    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75bf798c6d-8jjsh"
Sep 20 00:49:05.276971 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:05.276525    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75bf798c6d-8jjsh"
Sep 20 00:49:05.281400 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:05.281379    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-75bf798c6d-8jjsh"
Sep 20 00:49:06.015425 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:06.015391    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75bf798c6d-8jjsh"
Sep 20 00:49:06.055961 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:06.055927    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d7bfffc48-jdrmz"]
Sep 20 00:49:10.439559 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:10.439525    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-68df66cd47-2gps6"
Sep 20 00:49:10.439954 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:10.439587    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-68df66cd47-2gps6"
Sep 20 00:49:19.968010 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:19.967961    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7c9858598c-269xh" podUID="fe17b8a5-9160-4dee-baf3-fb5a31de8337" containerName="console" containerID="cri-o://84ad5fa52324bc71b1b2fc8a6b2b1864249c53d32debfb30fac06a4e252c239b" gracePeriod=15
Sep 20 00:49:20.718188 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:20.718165    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c9858598c-269xh"
Sep 20 00:49:20.835771 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:20.835740    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pv4fg\" (UniqueName: \"kubernetes.io/projected/fe17b8a5-9160-4dee-baf3-fb5a31de8337-kube-api-access-pv4fg\") pod \"fe17b8a5-9160-4dee-baf3-fb5a31de8337\" (UID: \"fe17b8a5-9160-4dee-baf3-fb5a31de8337\") "
Sep 20 00:49:20.835965 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:20.835807    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe17b8a5-9160-4dee-baf3-fb5a31de8337-console-serving-cert\") pod \"fe17b8a5-9160-4dee-baf3-fb5a31de8337\" (UID: \"fe17b8a5-9160-4dee-baf3-fb5a31de8337\") "
Sep 20 00:49:20.835965 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:20.835880    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe17b8a5-9160-4dee-baf3-fb5a31de8337-oauth-serving-cert\") pod \"fe17b8a5-9160-4dee-baf3-fb5a31de8337\" (UID: \"fe17b8a5-9160-4dee-baf3-fb5a31de8337\") "
Sep 20 00:49:20.835965 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:20.835904    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe17b8a5-9160-4dee-baf3-fb5a31de8337-console-config\") pod \"fe17b8a5-9160-4dee-baf3-fb5a31de8337\" (UID: \"fe17b8a5-9160-4dee-baf3-fb5a31de8337\") "
Sep 20 00:49:20.835965 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:20.835935    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe17b8a5-9160-4dee-baf3-fb5a31de8337-trusted-ca-bundle\") pod \"fe17b8a5-9160-4dee-baf3-fb5a31de8337\" (UID: \"fe17b8a5-9160-4dee-baf3-fb5a31de8337\") "
Sep 20 00:49:20.835965 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:20.835962    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe17b8a5-9160-4dee-baf3-fb5a31de8337-console-oauth-config\") pod \"fe17b8a5-9160-4dee-baf3-fb5a31de8337\" (UID: \"fe17b8a5-9160-4dee-baf3-fb5a31de8337\") "
Sep 20 00:49:20.836210 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:20.836005    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe17b8a5-9160-4dee-baf3-fb5a31de8337-service-ca\") pod \"fe17b8a5-9160-4dee-baf3-fb5a31de8337\" (UID: \"fe17b8a5-9160-4dee-baf3-fb5a31de8337\") "
Sep 20 00:49:20.836269 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:20.836243    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe17b8a5-9160-4dee-baf3-fb5a31de8337-console-config" (OuterVolumeSpecName: "console-config") pod "fe17b8a5-9160-4dee-baf3-fb5a31de8337" (UID: "fe17b8a5-9160-4dee-baf3-fb5a31de8337"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 00:49:20.836410 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:20.836302    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe17b8a5-9160-4dee-baf3-fb5a31de8337-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fe17b8a5-9160-4dee-baf3-fb5a31de8337" (UID: "fe17b8a5-9160-4dee-baf3-fb5a31de8337"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 00:49:20.836716 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:20.836414    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe17b8a5-9160-4dee-baf3-fb5a31de8337-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "fe17b8a5-9160-4dee-baf3-fb5a31de8337" (UID: "fe17b8a5-9160-4dee-baf3-fb5a31de8337"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 00:49:20.836716 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:20.836471    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe17b8a5-9160-4dee-baf3-fb5a31de8337-service-ca" (OuterVolumeSpecName: "service-ca") pod "fe17b8a5-9160-4dee-baf3-fb5a31de8337" (UID: "fe17b8a5-9160-4dee-baf3-fb5a31de8337"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 00:49:20.838469 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:20.838438    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe17b8a5-9160-4dee-baf3-fb5a31de8337-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fe17b8a5-9160-4dee-baf3-fb5a31de8337" (UID: "fe17b8a5-9160-4dee-baf3-fb5a31de8337"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 00:49:20.838562 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:20.838481    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe17b8a5-9160-4dee-baf3-fb5a31de8337-kube-api-access-pv4fg" (OuterVolumeSpecName: "kube-api-access-pv4fg") pod "fe17b8a5-9160-4dee-baf3-fb5a31de8337" (UID: "fe17b8a5-9160-4dee-baf3-fb5a31de8337"). InnerVolumeSpecName "kube-api-access-pv4fg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 00:49:20.838562 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:20.838495    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe17b8a5-9160-4dee-baf3-fb5a31de8337-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fe17b8a5-9160-4dee-baf3-fb5a31de8337" (UID: "fe17b8a5-9160-4dee-baf3-fb5a31de8337"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 00:49:20.937534 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:20.937500    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pv4fg\" (UniqueName: \"kubernetes.io/projected/fe17b8a5-9160-4dee-baf3-fb5a31de8337-kube-api-access-pv4fg\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 00:49:20.937534 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:20.937530    2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe17b8a5-9160-4dee-baf3-fb5a31de8337-console-serving-cert\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 00:49:20.937534 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:20.937539    2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe17b8a5-9160-4dee-baf3-fb5a31de8337-oauth-serving-cert\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 00:49:20.937752 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:20.937549    2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe17b8a5-9160-4dee-baf3-fb5a31de8337-console-config\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 00:49:20.937752 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:20.937557    2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe17b8a5-9160-4dee-baf3-fb5a31de8337-trusted-ca-bundle\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 00:49:20.937752 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:20.937566    2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe17b8a5-9160-4dee-baf3-fb5a31de8337-console-oauth-config\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 00:49:20.937752 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:20.937574    2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe17b8a5-9160-4dee-baf3-fb5a31de8337-service-ca\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 00:49:21.070032 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:21.070001    2570 generic.go:356] "Generic (PLEG): container finished" podID="fe17b8a5-9160-4dee-baf3-fb5a31de8337" containerID="84ad5fa52324bc71b1b2fc8a6b2b1864249c53d32debfb30fac06a4e252c239b" exitCode=0
Sep 20 00:49:21.070505 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:21.070056    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c9858598c-269xh"
Sep 20 00:49:21.070505 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:21.070088    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c9858598c-269xh" event={"ID":"fe17b8a5-9160-4dee-baf3-fb5a31de8337","Type":"ContainerDied","Data":"84ad5fa52324bc71b1b2fc8a6b2b1864249c53d32debfb30fac06a4e252c239b"}
Sep 20 00:49:21.070505 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:21.070135    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c9858598c-269xh" event={"ID":"fe17b8a5-9160-4dee-baf3-fb5a31de8337","Type":"ContainerDied","Data":"8747f9734f8da03da9d24a1d131172088af538a19c3d6325054b7c22fe03fbc0"}
Sep 20 00:49:21.070505 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:21.070155    2570 scope.go:117] "RemoveContainer" containerID="84ad5fa52324bc71b1b2fc8a6b2b1864249c53d32debfb30fac06a4e252c239b"
Sep 20 00:49:21.091245 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:21.091226    2570 scope.go:117] "RemoveContainer" containerID="84ad5fa52324bc71b1b2fc8a6b2b1864249c53d32debfb30fac06a4e252c239b"
Sep 20 00:49:21.091574 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:49:21.091554    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84ad5fa52324bc71b1b2fc8a6b2b1864249c53d32debfb30fac06a4e252c239b\": container with ID starting with 84ad5fa52324bc71b1b2fc8a6b2b1864249c53d32debfb30fac06a4e252c239b not found: ID does not exist" containerID="84ad5fa52324bc71b1b2fc8a6b2b1864249c53d32debfb30fac06a4e252c239b"
Sep 20 00:49:21.091642 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:21.091581    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84ad5fa52324bc71b1b2fc8a6b2b1864249c53d32debfb30fac06a4e252c239b"} err="failed to get container status \"84ad5fa52324bc71b1b2fc8a6b2b1864249c53d32debfb30fac06a4e252c239b\": rpc error: code = NotFound desc = could not find container \"84ad5fa52324bc71b1b2fc8a6b2b1864249c53d32debfb30fac06a4e252c239b\": container with ID starting with 84ad5fa52324bc71b1b2fc8a6b2b1864249c53d32debfb30fac06a4e252c239b not found: ID does not exist"
Sep 20 00:49:21.091839 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:21.091821    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c9858598c-269xh"]
Sep 20 00:49:21.097558 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:21.097505    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7c9858598c-269xh"]
Sep 20 00:49:21.452044 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:21.452012    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe17b8a5-9160-4dee-baf3-fb5a31de8337" path="/var/lib/kubelet/pods/fe17b8a5-9160-4dee-baf3-fb5a31de8337/volumes"
Sep 20 00:49:28.986409 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:28.986379    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-t6qv8"
Sep 20 00:49:30.446238 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:30.444851    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-68df66cd47-2gps6"
Sep 20 00:49:30.450330 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:30.450307    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-68df66cd47-2gps6"
Sep 20 00:49:31.077636 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:31.077595    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5d7bfffc48-jdrmz" podUID="0e8a5437-95e7-4fed-baca-62bae7d71c4a" containerName="console" containerID="cri-o://a2554038fd683942215aa9cf22b7b859699e040fc3f1fb4cc097793bfafb7408" gracePeriod=15
Sep 20 00:49:31.360402 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:31.360326    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d7bfffc48-jdrmz"
Sep 20 00:49:31.413743 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:31.413709    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0e8a5437-95e7-4fed-baca-62bae7d71c4a-oauth-serving-cert\") pod \"0e8a5437-95e7-4fed-baca-62bae7d71c4a\" (UID: \"0e8a5437-95e7-4fed-baca-62bae7d71c4a\") "
Sep 20 00:49:31.413743 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:31.413746    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0e8a5437-95e7-4fed-baca-62bae7d71c4a-console-config\") pod \"0e8a5437-95e7-4fed-baca-62bae7d71c4a\" (UID: \"0e8a5437-95e7-4fed-baca-62bae7d71c4a\") "
Sep 20 00:49:31.413997 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:31.413765    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e8a5437-95e7-4fed-baca-62bae7d71c4a-console-serving-cert\") pod \"0e8a5437-95e7-4fed-baca-62bae7d71c4a\" (UID: \"0e8a5437-95e7-4fed-baca-62bae7d71c4a\") "
Sep 20 00:49:31.413997 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:31.413817    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gcwbp\" (UniqueName: \"kubernetes.io/projected/0e8a5437-95e7-4fed-baca-62bae7d71c4a-kube-api-access-gcwbp\") pod \"0e8a5437-95e7-4fed-baca-62bae7d71c4a\" (UID: \"0e8a5437-95e7-4fed-baca-62bae7d71c4a\") "
Sep 20 00:49:31.413997 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:31.413847    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0e8a5437-95e7-4fed-baca-62bae7d71c4a-console-oauth-config\") pod \"0e8a5437-95e7-4fed-baca-62bae7d71c4a\" (UID: \"0e8a5437-95e7-4fed-baca-62bae7d71c4a\") "
Sep 20 00:49:31.413997 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:31.413878    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0e8a5437-95e7-4fed-baca-62bae7d71c4a-service-ca\") pod \"0e8a5437-95e7-4fed-baca-62bae7d71c4a\" (UID: \"0e8a5437-95e7-4fed-baca-62bae7d71c4a\") "
Sep 20 00:49:31.414226 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:31.414196    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e8a5437-95e7-4fed-baca-62bae7d71c4a-console-config" (OuterVolumeSpecName: "console-config") pod "0e8a5437-95e7-4fed-baca-62bae7d71c4a" (UID: "0e8a5437-95e7-4fed-baca-62bae7d71c4a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 00:49:31.414226 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:31.414215    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e8a5437-95e7-4fed-baca-62bae7d71c4a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0e8a5437-95e7-4fed-baca-62bae7d71c4a" (UID: "0e8a5437-95e7-4fed-baca-62bae7d71c4a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 00:49:31.414347 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:31.414328    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e8a5437-95e7-4fed-baca-62bae7d71c4a-service-ca" (OuterVolumeSpecName: "service-ca") pod "0e8a5437-95e7-4fed-baca-62bae7d71c4a" (UID: "0e8a5437-95e7-4fed-baca-62bae7d71c4a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 00:49:31.416230 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:31.416199    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e8a5437-95e7-4fed-baca-62bae7d71c4a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0e8a5437-95e7-4fed-baca-62bae7d71c4a" (UID: "0e8a5437-95e7-4fed-baca-62bae7d71c4a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 00:49:31.416335 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:31.416320    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e8a5437-95e7-4fed-baca-62bae7d71c4a-kube-api-access-gcwbp" (OuterVolumeSpecName: "kube-api-access-gcwbp") pod "0e8a5437-95e7-4fed-baca-62bae7d71c4a" (UID: "0e8a5437-95e7-4fed-baca-62bae7d71c4a"). InnerVolumeSpecName "kube-api-access-gcwbp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 00:49:31.416335 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:31.416316    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e8a5437-95e7-4fed-baca-62bae7d71c4a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0e8a5437-95e7-4fed-baca-62bae7d71c4a" (UID: "0e8a5437-95e7-4fed-baca-62bae7d71c4a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 00:49:31.514917 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:31.514885    2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0e8a5437-95e7-4fed-baca-62bae7d71c4a-console-oauth-config\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 00:49:31.514917 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:31.514910    2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0e8a5437-95e7-4fed-baca-62bae7d71c4a-service-ca\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 00:49:31.514917 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:31.514920    2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0e8a5437-95e7-4fed-baca-62bae7d71c4a-oauth-serving-cert\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 00:49:31.515300 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:31.514928    2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0e8a5437-95e7-4fed-baca-62bae7d71c4a-console-config\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 00:49:31.515300 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:31.514937    2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e8a5437-95e7-4fed-baca-62bae7d71c4a-console-serving-cert\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 00:49:31.515300 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:31.514944    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gcwbp\" (UniqueName: \"kubernetes.io/projected/0e8a5437-95e7-4fed-baca-62bae7d71c4a-kube-api-access-gcwbp\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 00:49:32.117548 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:32.117506    2570 generic.go:356] "Generic (PLEG): container finished" podID="0e8a5437-95e7-4fed-baca-62bae7d71c4a" containerID="a2554038fd683942215aa9cf22b7b859699e040fc3f1fb4cc097793bfafb7408" exitCode=0
Sep 20 00:49:32.117732 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:32.117551    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d7bfffc48-jdrmz" event={"ID":"0e8a5437-95e7-4fed-baca-62bae7d71c4a","Type":"ContainerDied","Data":"a2554038fd683942215aa9cf22b7b859699e040fc3f1fb4cc097793bfafb7408"}
Sep 20 00:49:32.117732 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:32.117579    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d7bfffc48-jdrmz"
Sep 20 00:49:32.117732 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:32.117617    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d7bfffc48-jdrmz" event={"ID":"0e8a5437-95e7-4fed-baca-62bae7d71c4a","Type":"ContainerDied","Data":"0a0153d3947b271327e8569ff7ba4c6e98b67d71cadd7bd2385fd9f34382810d"}
Sep 20 00:49:32.117732 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:32.117644    2570 scope.go:117] "RemoveContainer" containerID="a2554038fd683942215aa9cf22b7b859699e040fc3f1fb4cc097793bfafb7408"
Sep 20 00:49:32.126039 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:32.126020    2570 scope.go:117] "RemoveContainer" containerID="a2554038fd683942215aa9cf22b7b859699e040fc3f1fb4cc097793bfafb7408"
Sep 20 00:49:32.126331 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:49:32.126313    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2554038fd683942215aa9cf22b7b859699e040fc3f1fb4cc097793bfafb7408\": container with ID starting with a2554038fd683942215aa9cf22b7b859699e040fc3f1fb4cc097793bfafb7408 not found: ID does not exist" containerID="a2554038fd683942215aa9cf22b7b859699e040fc3f1fb4cc097793bfafb7408"
Sep 20 00:49:32.126390 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:32.126343    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2554038fd683942215aa9cf22b7b859699e040fc3f1fb4cc097793bfafb7408"} err="failed to get container status \"a2554038fd683942215aa9cf22b7b859699e040fc3f1fb4cc097793bfafb7408\": rpc error: code = NotFound desc = could not find container \"a2554038fd683942215aa9cf22b7b859699e040fc3f1fb4cc097793bfafb7408\": container with ID starting with a2554038fd683942215aa9cf22b7b859699e040fc3f1fb4cc097793bfafb7408 not found: ID does not exist"
Sep 20 00:49:32.132668 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:32.132644    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d7bfffc48-jdrmz"]
Sep 20 00:49:32.136731 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:32.136708    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5d7bfffc48-jdrmz"]
Sep 20 00:49:33.451829 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:49:33.451791    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e8a5437-95e7-4fed-baca-62bae7d71c4a" path="/var/lib/kubelet/pods/0e8a5437-95e7-4fed-baca-62bae7d71c4a/volumes"
Sep 20 00:50:05.981052 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:05.981018    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 20 00:50:05.981580 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:05.981328    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="de4f227e-8211-434f-b703-970798d1cb7e" containerName="alertmanager" containerID="cri-o://f967d1691ea43a8ef80ec647fae6b0bd45c1a538540093fb3c2192f8949c0c99" gracePeriod=120
Sep 20 00:50:05.981580 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:05.981434    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="de4f227e-8211-434f-b703-970798d1cb7e" containerName="kube-rbac-proxy-web" containerID="cri-o://a0efc6908f1e2c5762f7e7aea42a8ea1550d7acaf25d064055b42293f150868f" gracePeriod=120
Sep 20 00:50:05.981580 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:05.981458    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="de4f227e-8211-434f-b703-970798d1cb7e" containerName="config-reloader" containerID="cri-o://4e4834c56fd9a8ffc83a889d321c55ed55d56e75eaa26716e9b9a08987a57b4d" gracePeriod=120
Sep 20 00:50:05.981580 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:05.981517    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="de4f227e-8211-434f-b703-970798d1cb7e" containerName="prom-label-proxy" containerID="cri-o://dc10b14681de5db9f16415bb49bf850939d8f032fe533d85928563e4094a0d89" gracePeriod=120
Sep 20 00:50:05.981580 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:05.981449    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="de4f227e-8211-434f-b703-970798d1cb7e" containerName="kube-rbac-proxy" containerID="cri-o://50d293c55841f1813ff06aa04a881bb332193ada25ad056c10e28b0ccbe9e75c" gracePeriod=120
Sep 20 00:50:05.982117 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:05.981389    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="de4f227e-8211-434f-b703-970798d1cb7e" containerName="kube-rbac-proxy-metric" containerID="cri-o://d869d498ec41d5dc56bf81464349ecf1caf15ba1e74da1f9969779e4c537cb94" gracePeriod=120
Sep 20 00:50:06.247179 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:06.247094    2570 generic.go:356] "Generic (PLEG): container finished" podID="de4f227e-8211-434f-b703-970798d1cb7e" containerID="dc10b14681de5db9f16415bb49bf850939d8f032fe533d85928563e4094a0d89" exitCode=0
Sep 20 00:50:06.247179 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:06.247118    2570 generic.go:356] "Generic (PLEG): container finished" podID="de4f227e-8211-434f-b703-970798d1cb7e" containerID="50d293c55841f1813ff06aa04a881bb332193ada25ad056c10e28b0ccbe9e75c" exitCode=0
Sep 20 00:50:06.247179 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:06.247125    2570 generic.go:356] "Generic (PLEG): container finished" podID="de4f227e-8211-434f-b703-970798d1cb7e" containerID="a0efc6908f1e2c5762f7e7aea42a8ea1550d7acaf25d064055b42293f150868f" exitCode=0
Sep 20 00:50:06.247179 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:06.247131    2570 generic.go:356] "Generic (PLEG): container finished" podID="de4f227e-8211-434f-b703-970798d1cb7e" containerID="4e4834c56fd9a8ffc83a889d321c55ed55d56e75eaa26716e9b9a08987a57b4d" exitCode=0
Sep 20 00:50:06.247179 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:06.247136    2570 generic.go:356] "Generic (PLEG): container finished" podID="de4f227e-8211-434f-b703-970798d1cb7e" containerID="f967d1691ea43a8ef80ec647fae6b0bd45c1a538540093fb3c2192f8949c0c99" exitCode=0
Sep 20 00:50:06.247179 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:06.247162    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"de4f227e-8211-434f-b703-970798d1cb7e","Type":"ContainerDied","Data":"dc10b14681de5db9f16415bb49bf850939d8f032fe533d85928563e4094a0d89"}
Sep 20 00:50:06.247467 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:06.247225    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"de4f227e-8211-434f-b703-970798d1cb7e","Type":"ContainerDied","Data":"50d293c55841f1813ff06aa04a881bb332193ada25ad056c10e28b0ccbe9e75c"}
Sep 20 00:50:06.247467 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:06.247251    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"de4f227e-8211-434f-b703-970798d1cb7e","Type":"ContainerDied","Data":"a0efc6908f1e2c5762f7e7aea42a8ea1550d7acaf25d064055b42293f150868f"}
Sep 20 00:50:06.247467 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:06.247275    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"de4f227e-8211-434f-b703-970798d1cb7e","Type":"ContainerDied","Data":"4e4834c56fd9a8ffc83a889d321c55ed55d56e75eaa26716e9b9a08987a57b4d"}
Sep 20 00:50:06.247467 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:06.247300    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"de4f227e-8211-434f-b703-970798d1cb7e","Type":"ContainerDied","Data":"f967d1691ea43a8ef80ec647fae6b0bd45c1a538540093fb3c2192f8949c0c99"}
Sep 20 00:50:07.217511 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.217482    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:50:07.255528 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.255500    2570 generic.go:356] "Generic (PLEG): container finished" podID="de4f227e-8211-434f-b703-970798d1cb7e" containerID="d869d498ec41d5dc56bf81464349ecf1caf15ba1e74da1f9969779e4c537cb94" exitCode=0
Sep 20 00:50:07.255694 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.255540    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"de4f227e-8211-434f-b703-970798d1cb7e","Type":"ContainerDied","Data":"d869d498ec41d5dc56bf81464349ecf1caf15ba1e74da1f9969779e4c537cb94"}
Sep 20 00:50:07.255694 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.255612    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"de4f227e-8211-434f-b703-970798d1cb7e","Type":"ContainerDied","Data":"f8f2df86beb99e126eeabe570f8f83e8f72e30e39ce433ad9a3865e05f39cf69"}
Sep 20 00:50:07.255694 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.255625    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:50:07.255694 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.255654    2570 scope.go:117] "RemoveContainer" containerID="dc10b14681de5db9f16415bb49bf850939d8f032fe533d85928563e4094a0d89"
Sep 20 00:50:07.267028 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.266998    2570 scope.go:117] "RemoveContainer" containerID="d869d498ec41d5dc56bf81464349ecf1caf15ba1e74da1f9969779e4c537cb94"
Sep 20 00:50:07.275159 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.275140    2570 scope.go:117] "RemoveContainer" containerID="50d293c55841f1813ff06aa04a881bb332193ada25ad056c10e28b0ccbe9e75c"
Sep 20 00:50:07.282230 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.282210    2570 scope.go:117] "RemoveContainer" containerID="a0efc6908f1e2c5762f7e7aea42a8ea1550d7acaf25d064055b42293f150868f"
Sep 20 00:50:07.289007 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.288977    2570 scope.go:117] "RemoveContainer" containerID="4e4834c56fd9a8ffc83a889d321c55ed55d56e75eaa26716e9b9a08987a57b4d"
Sep 20 00:50:07.289483 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.289463    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/de4f227e-8211-434f-b703-970798d1cb7e-alertmanager-main-db\") pod \"de4f227e-8211-434f-b703-970798d1cb7e\" (UID: \"de4f227e-8211-434f-b703-970798d1cb7e\") "
Sep 20 00:50:07.289576 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.289492    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/de4f227e-8211-434f-b703-970798d1cb7e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"de4f227e-8211-434f-b703-970798d1cb7e\" (UID: \"de4f227e-8211-434f-b703-970798d1cb7e\") "
Sep 20 00:50:07.289576 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.289523    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/de4f227e-8211-434f-b703-970798d1cb7e-cluster-tls-config\") pod \"de4f227e-8211-434f-b703-970798d1cb7e\" (UID: \"de4f227e-8211-434f-b703-970798d1cb7e\") "
Sep 20 00:50:07.289576 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.289557    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/de4f227e-8211-434f-b703-970798d1cb7e-secret-alertmanager-main-tls\") pod \"de4f227e-8211-434f-b703-970798d1cb7e\" (UID: \"de4f227e-8211-434f-b703-970798d1cb7e\") "
Sep 20 00:50:07.289789 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.289598    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de4f227e-8211-434f-b703-970798d1cb7e-alertmanager-trusted-ca-bundle\") pod \"de4f227e-8211-434f-b703-970798d1cb7e\" (UID: \"de4f227e-8211-434f-b703-970798d1cb7e\") "
Sep 20 00:50:07.289789 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.289627    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/de4f227e-8211-434f-b703-970798d1cb7e-config-volume\") pod \"de4f227e-8211-434f-b703-970798d1cb7e\" (UID: \"de4f227e-8211-434f-b703-970798d1cb7e\") "
Sep 20 00:50:07.289789 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.289651    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/de4f227e-8211-434f-b703-970798d1cb7e-config-out\") pod \"de4f227e-8211-434f-b703-970798d1cb7e\" (UID: \"de4f227e-8211-434f-b703-970798d1cb7e\") "
Sep 20 00:50:07.289973 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.289847    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de4f227e-8211-434f-b703-970798d1cb7e-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "de4f227e-8211-434f-b703-970798d1cb7e" (UID: "de4f227e-8211-434f-b703-970798d1cb7e"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 00:50:07.289973 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.289931    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de4f227e-8211-434f-b703-970798d1cb7e-metrics-client-ca\") pod \"de4f227e-8211-434f-b703-970798d1cb7e\" (UID: \"de4f227e-8211-434f-b703-970798d1cb7e\") "
Sep 20 00:50:07.290086 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.289986    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/de4f227e-8211-434f-b703-970798d1cb7e-secret-alertmanager-kube-rbac-proxy\") pod \"de4f227e-8211-434f-b703-970798d1cb7e\" (UID: \"de4f227e-8211-434f-b703-970798d1cb7e\") "
Sep 20 00:50:07.290086 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.290019    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/de4f227e-8211-434f-b703-970798d1cb7e-secret-alertmanager-kube-rbac-proxy-web\") pod \"de4f227e-8211-434f-b703-970798d1cb7e\" (UID: \"de4f227e-8211-434f-b703-970798d1cb7e\") "
Sep 20 00:50:07.290086 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.290050    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/de4f227e-8211-434f-b703-970798d1cb7e-web-config\") pod \"de4f227e-8211-434f-b703-970798d1cb7e\" (UID: \"de4f227e-8211-434f-b703-970798d1cb7e\") "
Sep 20 00:50:07.290086 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.290074    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/de4f227e-8211-434f-b703-970798d1cb7e-tls-assets\") pod \"de4f227e-8211-434f-b703-970798d1cb7e\" (UID: \"de4f227e-8211-434f-b703-970798d1cb7e\") "
Sep 20 00:50:07.290287 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.290085    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de4f227e-8211-434f-b703-970798d1cb7e-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "de4f227e-8211-434f-b703-970798d1cb7e" (UID: "de4f227e-8211-434f-b703-970798d1cb7e"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 00:50:07.290287 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.290118    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2pr8\" (UniqueName: \"kubernetes.io/projected/de4f227e-8211-434f-b703-970798d1cb7e-kube-api-access-t2pr8\") pod \"de4f227e-8211-434f-b703-970798d1cb7e\" (UID: \"de4f227e-8211-434f-b703-970798d1cb7e\") "
Sep 20 00:50:07.291010 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.290540    2570 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/de4f227e-8211-434f-b703-970798d1cb7e-alertmanager-main-db\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 00:50:07.291010 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.290561    2570 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de4f227e-8211-434f-b703-970798d1cb7e-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 00:50:07.291010 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.290976    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de4f227e-8211-434f-b703-970798d1cb7e-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "de4f227e-8211-434f-b703-970798d1cb7e" (UID: "de4f227e-8211-434f-b703-970798d1cb7e"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 00:50:07.294173 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.294146    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de4f227e-8211-434f-b703-970798d1cb7e-kube-api-access-t2pr8" (OuterVolumeSpecName: "kube-api-access-t2pr8") pod "de4f227e-8211-434f-b703-970798d1cb7e" (UID: "de4f227e-8211-434f-b703-970798d1cb7e"). InnerVolumeSpecName "kube-api-access-t2pr8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 00:50:07.294318 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.294184    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de4f227e-8211-434f-b703-970798d1cb7e-config-out" (OuterVolumeSpecName: "config-out") pod "de4f227e-8211-434f-b703-970798d1cb7e" (UID: "de4f227e-8211-434f-b703-970798d1cb7e"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 00:50:07.294415 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.294384    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de4f227e-8211-434f-b703-970798d1cb7e-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "de4f227e-8211-434f-b703-970798d1cb7e" (UID: "de4f227e-8211-434f-b703-970798d1cb7e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 00:50:07.294768 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.294584    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de4f227e-8211-434f-b703-970798d1cb7e-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "de4f227e-8211-434f-b703-970798d1cb7e" (UID: "de4f227e-8211-434f-b703-970798d1cb7e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 00:50:07.294768 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.294726    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de4f227e-8211-434f-b703-970798d1cb7e-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "de4f227e-8211-434f-b703-970798d1cb7e" (UID: "de4f227e-8211-434f-b703-970798d1cb7e"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 00:50:07.294954 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.294897    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de4f227e-8211-434f-b703-970798d1cb7e-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "de4f227e-8211-434f-b703-970798d1cb7e" (UID: "de4f227e-8211-434f-b703-970798d1cb7e"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 00:50:07.295023 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.295005    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de4f227e-8211-434f-b703-970798d1cb7e-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "de4f227e-8211-434f-b703-970798d1cb7e" (UID: "de4f227e-8211-434f-b703-970798d1cb7e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 00:50:07.296578 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.296556    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de4f227e-8211-434f-b703-970798d1cb7e-config-volume" (OuterVolumeSpecName: "config-volume") pod "de4f227e-8211-434f-b703-970798d1cb7e" (UID: "de4f227e-8211-434f-b703-970798d1cb7e"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 00:50:07.298814 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.298788    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de4f227e-8211-434f-b703-970798d1cb7e-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "de4f227e-8211-434f-b703-970798d1cb7e" (UID: "de4f227e-8211-434f-b703-970798d1cb7e"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 00:50:07.306274 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.306216    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de4f227e-8211-434f-b703-970798d1cb7e-web-config" (OuterVolumeSpecName: "web-config") pod "de4f227e-8211-434f-b703-970798d1cb7e" (UID: "de4f227e-8211-434f-b703-970798d1cb7e"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 00:50:07.313032 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.312979    2570 scope.go:117] "RemoveContainer" containerID="f967d1691ea43a8ef80ec647fae6b0bd45c1a538540093fb3c2192f8949c0c99"
Sep 20 00:50:07.320245 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.320225    2570 scope.go:117] "RemoveContainer" containerID="d249b5bf137ac102267472676a0d8c2281cd997e14a0825175d9216affed8840"
Sep 20 00:50:07.326947 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.326927    2570 scope.go:117] "RemoveContainer" containerID="dc10b14681de5db9f16415bb49bf850939d8f032fe533d85928563e4094a0d89"
Sep 20 00:50:07.327227 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:50:07.327209    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc10b14681de5db9f16415bb49bf850939d8f032fe533d85928563e4094a0d89\": container with ID starting with dc10b14681de5db9f16415bb49bf850939d8f032fe533d85928563e4094a0d89 not found: ID does not exist" containerID="dc10b14681de5db9f16415bb49bf850939d8f032fe533d85928563e4094a0d89"
Sep 20 00:50:07.327290 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.327234    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc10b14681de5db9f16415bb49bf850939d8f032fe533d85928563e4094a0d89"} err="failed to get container status \"dc10b14681de5db9f16415bb49bf850939d8f032fe533d85928563e4094a0d89\": rpc error: code = NotFound desc = could not find container \"dc10b14681de5db9f16415bb49bf850939d8f032fe533d85928563e4094a0d89\": container with ID starting with dc10b14681de5db9f16415bb49bf850939d8f032fe533d85928563e4094a0d89 not found: ID does not exist"
Sep 20 00:50:07.327290 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.327252    2570 scope.go:117] "RemoveContainer" containerID="d869d498ec41d5dc56bf81464349ecf1caf15ba1e74da1f9969779e4c537cb94"
Sep 20 00:50:07.327507 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:50:07.327490    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d869d498ec41d5dc56bf81464349ecf1caf15ba1e74da1f9969779e4c537cb94\": container with ID starting with d869d498ec41d5dc56bf81464349ecf1caf15ba1e74da1f9969779e4c537cb94 not found: ID does not exist" containerID="d869d498ec41d5dc56bf81464349ecf1caf15ba1e74da1f9969779e4c537cb94"
Sep 20 00:50:07.327546 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.327518    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d869d498ec41d5dc56bf81464349ecf1caf15ba1e74da1f9969779e4c537cb94"} err="failed to get container status \"d869d498ec41d5dc56bf81464349ecf1caf15ba1e74da1f9969779e4c537cb94\": rpc error: code = NotFound desc = could not find container \"d869d498ec41d5dc56bf81464349ecf1caf15ba1e74da1f9969779e4c537cb94\": container with ID starting with d869d498ec41d5dc56bf81464349ecf1caf15ba1e74da1f9969779e4c537cb94 not found: ID does not exist"
Sep 20 00:50:07.327546 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.327538    2570 scope.go:117] "RemoveContainer" containerID="50d293c55841f1813ff06aa04a881bb332193ada25ad056c10e28b0ccbe9e75c"
Sep 20 00:50:07.327792 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:50:07.327775    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50d293c55841f1813ff06aa04a881bb332193ada25ad056c10e28b0ccbe9e75c\": container with ID starting with 50d293c55841f1813ff06aa04a881bb332193ada25ad056c10e28b0ccbe9e75c not found: ID does not exist" containerID="50d293c55841f1813ff06aa04a881bb332193ada25ad056c10e28b0ccbe9e75c"
Sep 20 00:50:07.327831 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.327797    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50d293c55841f1813ff06aa04a881bb332193ada25ad056c10e28b0ccbe9e75c"} err="failed to get container status \"50d293c55841f1813ff06aa04a881bb332193ada25ad056c10e28b0ccbe9e75c\": rpc error: code = NotFound desc = could not find container \"50d293c55841f1813ff06aa04a881bb332193ada25ad056c10e28b0ccbe9e75c\": container with ID starting with 50d293c55841f1813ff06aa04a881bb332193ada25ad056c10e28b0ccbe9e75c not found: ID does not exist"
Sep 20 00:50:07.327831 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.327813    2570 scope.go:117] "RemoveContainer" containerID="a0efc6908f1e2c5762f7e7aea42a8ea1550d7acaf25d064055b42293f150868f"
Sep 20 00:50:07.328098 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:50:07.328081    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0efc6908f1e2c5762f7e7aea42a8ea1550d7acaf25d064055b42293f150868f\": container with ID starting with a0efc6908f1e2c5762f7e7aea42a8ea1550d7acaf25d064055b42293f150868f not found: ID does not exist" containerID="a0efc6908f1e2c5762f7e7aea42a8ea1550d7acaf25d064055b42293f150868f"
Sep 20 00:50:07.328151 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.328102    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0efc6908f1e2c5762f7e7aea42a8ea1550d7acaf25d064055b42293f150868f"} err="failed to get container status \"a0efc6908f1e2c5762f7e7aea42a8ea1550d7acaf25d064055b42293f150868f\": rpc error: code = NotFound desc = could not find container \"a0efc6908f1e2c5762f7e7aea42a8ea1550d7acaf25d064055b42293f150868f\": container with ID starting with a0efc6908f1e2c5762f7e7aea42a8ea1550d7acaf25d064055b42293f150868f not found: ID does not exist"
Sep 20 00:50:07.328151 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.328115    2570 scope.go:117] "RemoveContainer" containerID="4e4834c56fd9a8ffc83a889d321c55ed55d56e75eaa26716e9b9a08987a57b4d"
Sep 20 00:50:07.328365 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:50:07.328349    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e4834c56fd9a8ffc83a889d321c55ed55d56e75eaa26716e9b9a08987a57b4d\": container with ID starting with 4e4834c56fd9a8ffc83a889d321c55ed55d56e75eaa26716e9b9a08987a57b4d not found: ID does not exist" containerID="4e4834c56fd9a8ffc83a889d321c55ed55d56e75eaa26716e9b9a08987a57b4d"
Sep 20 00:50:07.328405 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.328369    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e4834c56fd9a8ffc83a889d321c55ed55d56e75eaa26716e9b9a08987a57b4d"} err="failed to get container status \"4e4834c56fd9a8ffc83a889d321c55ed55d56e75eaa26716e9b9a08987a57b4d\": rpc error: code = NotFound desc = could not find container \"4e4834c56fd9a8ffc83a889d321c55ed55d56e75eaa26716e9b9a08987a57b4d\": container with ID starting with 4e4834c56fd9a8ffc83a889d321c55ed55d56e75eaa26716e9b9a08987a57b4d not found: ID does not exist"
Sep 20 00:50:07.328405 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.328381    2570 scope.go:117] "RemoveContainer" containerID="f967d1691ea43a8ef80ec647fae6b0bd45c1a538540093fb3c2192f8949c0c99"
Sep 20 00:50:07.328617 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:50:07.328601    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f967d1691ea43a8ef80ec647fae6b0bd45c1a538540093fb3c2192f8949c0c99\": container with ID starting with f967d1691ea43a8ef80ec647fae6b0bd45c1a538540093fb3c2192f8949c0c99 not found: ID does not exist" containerID="f967d1691ea43a8ef80ec647fae6b0bd45c1a538540093fb3c2192f8949c0c99"
Sep 20 00:50:07.328669 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.328619    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f967d1691ea43a8ef80ec647fae6b0bd45c1a538540093fb3c2192f8949c0c99"} err="failed to get container status \"f967d1691ea43a8ef80ec647fae6b0bd45c1a538540093fb3c2192f8949c0c99\": rpc error: code = NotFound desc = could not find container \"f967d1691ea43a8ef80ec647fae6b0bd45c1a538540093fb3c2192f8949c0c99\": container with ID starting with f967d1691ea43a8ef80ec647fae6b0bd45c1a538540093fb3c2192f8949c0c99 not found: ID does not exist"
Sep 20 00:50:07.328669 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.328630    2570 scope.go:117] "RemoveContainer" containerID="d249b5bf137ac102267472676a0d8c2281cd997e14a0825175d9216affed8840"
Sep 20 00:50:07.328837 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:50:07.328822    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d249b5bf137ac102267472676a0d8c2281cd997e14a0825175d9216affed8840\": container with ID starting with d249b5bf137ac102267472676a0d8c2281cd997e14a0825175d9216affed8840 not found: ID does not exist" containerID="d249b5bf137ac102267472676a0d8c2281cd997e14a0825175d9216affed8840"
Sep 20 00:50:07.328896 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.328840    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d249b5bf137ac102267472676a0d8c2281cd997e14a0825175d9216affed8840"} err="failed to get container status \"d249b5bf137ac102267472676a0d8c2281cd997e14a0825175d9216affed8840\": rpc error: code = NotFound desc = could not find container \"d249b5bf137ac102267472676a0d8c2281cd997e14a0825175d9216affed8840\": container with ID starting with d249b5bf137ac102267472676a0d8c2281cd997e14a0825175d9216affed8840 not found: ID does not exist"
Sep 20 00:50:07.391960 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.391924    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de4f227e-8211-434f-b703-970798d1cb7e-metrics-client-ca\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 00:50:07.391960 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.391953    2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/de4f227e-8211-434f-b703-970798d1cb7e-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 00:50:07.391960 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.391963    2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/de4f227e-8211-434f-b703-970798d1cb7e-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 00:50:07.392176 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.391973    2570 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/de4f227e-8211-434f-b703-970798d1cb7e-web-config\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 00:50:07.392176 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.391981    2570 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/de4f227e-8211-434f-b703-970798d1cb7e-tls-assets\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 00:50:07.392176 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.391989    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2pr8\" (UniqueName: \"kubernetes.io/projected/de4f227e-8211-434f-b703-970798d1cb7e-kube-api-access-t2pr8\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 00:50:07.392176 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.391997    2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/de4f227e-8211-434f-b703-970798d1cb7e-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 00:50:07.392176 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.392006    2570 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/de4f227e-8211-434f-b703-970798d1cb7e-cluster-tls-config\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 00:50:07.392176 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.392016    2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/de4f227e-8211-434f-b703-970798d1cb7e-secret-alertmanager-main-tls\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 00:50:07.392176 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.392023    2570 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/de4f227e-8211-434f-b703-970798d1cb7e-config-volume\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 00:50:07.392176 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.392032    2570 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/de4f227e-8211-434f-b703-970798d1cb7e-config-out\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 00:50:07.575013 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.574942    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 20 00:50:07.581571 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.581548    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 20 00:50:07.641897 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.641852    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 20 00:50:07.642126 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.642114    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de4f227e-8211-434f-b703-970798d1cb7e" containerName="kube-rbac-proxy"
Sep 20 00:50:07.642172 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.642127    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="de4f227e-8211-434f-b703-970798d1cb7e" containerName="kube-rbac-proxy"
Sep 20 00:50:07.642172 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.642139    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de4f227e-8211-434f-b703-970798d1cb7e" containerName="config-reloader"
Sep 20 00:50:07.642172 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.642145    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="de4f227e-8211-434f-b703-970798d1cb7e" containerName="config-reloader"
Sep 20 00:50:07.642172 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.642151    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de4f227e-8211-434f-b703-970798d1cb7e" containerName="kube-rbac-proxy-metric"
Sep 20 00:50:07.642172 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.642156    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="de4f227e-8211-434f-b703-970798d1cb7e" containerName="kube-rbac-proxy-metric"
Sep 20 00:50:07.642172 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.642163    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de4f227e-8211-434f-b703-970798d1cb7e" containerName="prom-label-proxy"
Sep 20 00:50:07.642172 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.642168    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="de4f227e-8211-434f-b703-970798d1cb7e" containerName="prom-label-proxy"
Sep 20 00:50:07.642172 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.642174    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe17b8a5-9160-4dee-baf3-fb5a31de8337" containerName="console"
Sep 20 00:50:07.642437 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.642180    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe17b8a5-9160-4dee-baf3-fb5a31de8337" containerName="console"
Sep 20 00:50:07.642437 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.642187    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de4f227e-8211-434f-b703-970798d1cb7e" containerName="alertmanager"
Sep 20 00:50:07.642437 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.642192    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="de4f227e-8211-434f-b703-970798d1cb7e" containerName="alertmanager"
Sep 20 00:50:07.642437 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.642201    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e8a5437-95e7-4fed-baca-62bae7d71c4a" containerName="console"
Sep 20 00:50:07.642437 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.642206    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e8a5437-95e7-4fed-baca-62bae7d71c4a" containerName="console"
Sep 20 00:50:07.642437 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.642210    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de4f227e-8211-434f-b703-970798d1cb7e" containerName="kube-rbac-proxy-web"
Sep 20 00:50:07.642437 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.642216    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="de4f227e-8211-434f-b703-970798d1cb7e" containerName="kube-rbac-proxy-web"
Sep 20 00:50:07.642437 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.642225    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de4f227e-8211-434f-b703-970798d1cb7e" containerName="init-config-reloader"
Sep 20 00:50:07.642437 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.642231    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="de4f227e-8211-434f-b703-970798d1cb7e" containerName="init-config-reloader"
Sep 20 00:50:07.642437 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.642272    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="de4f227e-8211-434f-b703-970798d1cb7e" containerName="alertmanager"
Sep 20 00:50:07.642437 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.642279    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="de4f227e-8211-434f-b703-970798d1cb7e" containerName="kube-rbac-proxy-metric"
Sep 20 00:50:07.642437 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.642284    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="de4f227e-8211-434f-b703-970798d1cb7e" containerName="config-reloader"
Sep 20 00:50:07.642437 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.642291    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e8a5437-95e7-4fed-baca-62bae7d71c4a" containerName="console"
Sep 20 00:50:07.642437 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.642297    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="de4f227e-8211-434f-b703-970798d1cb7e" containerName="kube-rbac-proxy-web"
Sep 20 00:50:07.642437 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.642304    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="de4f227e-8211-434f-b703-970798d1cb7e" containerName="prom-label-proxy"
Sep 20 00:50:07.642437 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.642311    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="de4f227e-8211-434f-b703-970798d1cb7e" containerName="kube-rbac-proxy"
Sep 20 00:50:07.642437 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.642316    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe17b8a5-9160-4dee-baf3-fb5a31de8337" containerName="console"
Sep 20 00:50:07.645894 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.645854    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:50:07.650519 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.650491    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 20 00:50:07.650627 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.650585    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 20 00:50:07.650627 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.650593    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 20 00:50:07.650902 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.650884    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 20 00:50:07.650987 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.650936    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 20 00:50:07.651045 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.650992    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-p2skq\""
Sep 20 00:50:07.651045 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.650983    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 20 00:50:07.651151 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.651099    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 20 00:50:07.651386 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.651368    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 20 00:50:07.658306 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.658127    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 20 00:50:07.660535 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.660515    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 20 00:50:07.796562 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.796533    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ed29b1c6-f95d-4454-8e6e-4b175bde7d0c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ed29b1c6-f95d-4454-8e6e-4b175bde7d0c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:50:07.796739 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.796567    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed29b1c6-f95d-4454-8e6e-4b175bde7d0c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ed29b1c6-f95d-4454-8e6e-4b175bde7d0c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:50:07.796739 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.796594    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ed29b1c6-f95d-4454-8e6e-4b175bde7d0c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ed29b1c6-f95d-4454-8e6e-4b175bde7d0c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:50:07.796739 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.796611    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ed29b1c6-f95d-4454-8e6e-4b175bde7d0c-config-out\") pod \"alertmanager-main-0\" (UID: \"ed29b1c6-f95d-4454-8e6e-4b175bde7d0c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:50:07.796739 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.796655    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nds9c\" (UniqueName: \"kubernetes.io/projected/ed29b1c6-f95d-4454-8e6e-4b175bde7d0c-kube-api-access-nds9c\") pod \"alertmanager-main-0\" (UID: \"ed29b1c6-f95d-4454-8e6e-4b175bde7d0c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:50:07.796739 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.796699    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ed29b1c6-f95d-4454-8e6e-4b175bde7d0c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ed29b1c6-f95d-4454-8e6e-4b175bde7d0c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:50:07.796739 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.796715    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ed29b1c6-f95d-4454-8e6e-4b175bde7d0c-web-config\") pod \"alertmanager-main-0\" (UID: \"ed29b1c6-f95d-4454-8e6e-4b175bde7d0c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:50:07.796739 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.796728    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ed29b1c6-f95d-4454-8e6e-4b175bde7d0c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ed29b1c6-f95d-4454-8e6e-4b175bde7d0c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:50:07.797022 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.796746    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ed29b1c6-f95d-4454-8e6e-4b175bde7d0c-config-volume\") pod \"alertmanager-main-0\" (UID: \"ed29b1c6-f95d-4454-8e6e-4b175bde7d0c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:50:07.797022 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.796764    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ed29b1c6-f95d-4454-8e6e-4b175bde7d0c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ed29b1c6-f95d-4454-8e6e-4b175bde7d0c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:50:07.797022 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.796801    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed29b1c6-f95d-4454-8e6e-4b175bde7d0c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ed29b1c6-f95d-4454-8e6e-4b175bde7d0c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:50:07.797022 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.796828    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ed29b1c6-f95d-4454-8e6e-4b175bde7d0c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ed29b1c6-f95d-4454-8e6e-4b175bde7d0c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:50:07.797022 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.796845    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ed29b1c6-f95d-4454-8e6e-4b175bde7d0c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ed29b1c6-f95d-4454-8e6e-4b175bde7d0c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:50:07.898055 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.898016    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nds9c\" (UniqueName: \"kubernetes.io/projected/ed29b1c6-f95d-4454-8e6e-4b175bde7d0c-kube-api-access-nds9c\") pod \"alertmanager-main-0\" (UID: \"ed29b1c6-f95d-4454-8e6e-4b175bde7d0c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:50:07.898209 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.898077    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ed29b1c6-f95d-4454-8e6e-4b175bde7d0c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ed29b1c6-f95d-4454-8e6e-4b175bde7d0c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:50:07.898209 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.898188    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ed29b1c6-f95d-4454-8e6e-4b175bde7d0c-web-config\") pod \"alertmanager-main-0\" (UID: \"ed29b1c6-f95d-4454-8e6e-4b175bde7d0c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:50:07.898275 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.898223    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ed29b1c6-f95d-4454-8e6e-4b175bde7d0c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ed29b1c6-f95d-4454-8e6e-4b175bde7d0c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:50:07.898275 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.898264    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ed29b1c6-f95d-4454-8e6e-4b175bde7d0c-config-volume\") pod \"alertmanager-main-0\" (UID: \"ed29b1c6-f95d-4454-8e6e-4b175bde7d0c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:50:07.898361 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.898298    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ed29b1c6-f95d-4454-8e6e-4b175bde7d0c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ed29b1c6-f95d-4454-8e6e-4b175bde7d0c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:50:07.898361 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.898334    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed29b1c6-f95d-4454-8e6e-4b175bde7d0c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ed29b1c6-f95d-4454-8e6e-4b175bde7d0c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:50:07.898482 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.898459    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ed29b1c6-f95d-4454-8e6e-4b175bde7d0c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ed29b1c6-f95d-4454-8e6e-4b175bde7d0c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:50:07.898535 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.898500    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ed29b1c6-f95d-4454-8e6e-4b175bde7d0c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ed29b1c6-f95d-4454-8e6e-4b175bde7d0c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:50:07.898585 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.898532    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ed29b1c6-f95d-4454-8e6e-4b175bde7d0c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ed29b1c6-f95d-4454-8e6e-4b175bde7d0c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:50:07.898585 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.898565    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed29b1c6-f95d-4454-8e6e-4b175bde7d0c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ed29b1c6-f95d-4454-8e6e-4b175bde7d0c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:50:07.898689 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.898610    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ed29b1c6-f95d-4454-8e6e-4b175bde7d0c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ed29b1c6-f95d-4454-8e6e-4b175bde7d0c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:50:07.898689 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.898638    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ed29b1c6-f95d-4454-8e6e-4b175bde7d0c-config-out\") pod \"alertmanager-main-0\" (UID: \"ed29b1c6-f95d-4454-8e6e-4b175bde7d0c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:50:07.898790 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.898709    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ed29b1c6-f95d-4454-8e6e-4b175bde7d0c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ed29b1c6-f95d-4454-8e6e-4b175bde7d0c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:50:07.899301 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.899274    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed29b1c6-f95d-4454-8e6e-4b175bde7d0c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ed29b1c6-f95d-4454-8e6e-4b175bde7d0c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:50:07.900417 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.900385    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed29b1c6-f95d-4454-8e6e-4b175bde7d0c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ed29b1c6-f95d-4454-8e6e-4b175bde7d0c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:50:07.901560 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.901535    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ed29b1c6-f95d-4454-8e6e-4b175bde7d0c-config-out\") pod \"alertmanager-main-0\" (UID: \"ed29b1c6-f95d-4454-8e6e-4b175bde7d0c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:50:07.901560 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.901548    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ed29b1c6-f95d-4454-8e6e-4b175bde7d0c-config-volume\") pod \"alertmanager-main-0\" (UID: \"ed29b1c6-f95d-4454-8e6e-4b175bde7d0c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:50:07.901839 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.901810    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ed29b1c6-f95d-4454-8e6e-4b175bde7d0c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ed29b1c6-f95d-4454-8e6e-4b175bde7d0c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:50:07.901941 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.901891    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ed29b1c6-f95d-4454-8e6e-4b175bde7d0c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ed29b1c6-f95d-4454-8e6e-4b175bde7d0c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:50:07.902017 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.901992    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ed29b1c6-f95d-4454-8e6e-4b175bde7d0c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ed29b1c6-f95d-4454-8e6e-4b175bde7d0c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:50:07.902197 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.902174    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ed29b1c6-f95d-4454-8e6e-4b175bde7d0c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ed29b1c6-f95d-4454-8e6e-4b175bde7d0c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:50:07.902332 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.902317    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ed29b1c6-f95d-4454-8e6e-4b175bde7d0c-web-config\") pod \"alertmanager-main-0\" (UID: \"ed29b1c6-f95d-4454-8e6e-4b175bde7d0c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:50:07.902744 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.902723    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ed29b1c6-f95d-4454-8e6e-4b175bde7d0c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ed29b1c6-f95d-4454-8e6e-4b175bde7d0c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:50:07.903148 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.903130    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ed29b1c6-f95d-4454-8e6e-4b175bde7d0c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ed29b1c6-f95d-4454-8e6e-4b175bde7d0c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:50:07.905646 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.905629    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nds9c\" (UniqueName: \"kubernetes.io/projected/ed29b1c6-f95d-4454-8e6e-4b175bde7d0c-kube-api-access-nds9c\") pod \"alertmanager-main-0\" (UID: \"ed29b1c6-f95d-4454-8e6e-4b175bde7d0c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:50:07.956250 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:07.956222    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 20 00:50:08.232527 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:08.232505    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 20 00:50:08.234302 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:50:08.234270    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded29b1c6_f95d_4454_8e6e_4b175bde7d0c.slice/crio-486614e131606f4351a8e6161a16dd10c1213129e214cd546ca9d65ae3ef8260 WatchSource:0}: Error finding container 486614e131606f4351a8e6161a16dd10c1213129e214cd546ca9d65ae3ef8260: Status 404 returned error can't find the container with id 486614e131606f4351a8e6161a16dd10c1213129e214cd546ca9d65ae3ef8260
Sep 20 00:50:08.261805 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:08.261777    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ed29b1c6-f95d-4454-8e6e-4b175bde7d0c","Type":"ContainerStarted","Data":"486614e131606f4351a8e6161a16dd10c1213129e214cd546ca9d65ae3ef8260"}
Sep 20 00:50:09.266403 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:09.266367    2570 generic.go:356] "Generic (PLEG): container finished" podID="ed29b1c6-f95d-4454-8e6e-4b175bde7d0c" containerID="ca51d1b6ddb483204f6ebfe0f05925adfcf0546cdfaf5bd62d686ac0abddbc6a" exitCode=0
Sep 20 00:50:09.266740 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:09.266438    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ed29b1c6-f95d-4454-8e6e-4b175bde7d0c","Type":"ContainerDied","Data":"ca51d1b6ddb483204f6ebfe0f05925adfcf0546cdfaf5bd62d686ac0abddbc6a"}
Sep 20 00:50:09.453277 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:09.453253    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de4f227e-8211-434f-b703-970798d1cb7e" path="/var/lib/kubelet/pods/de4f227e-8211-434f-b703-970798d1cb7e/volumes"
Sep 20 00:50:10.007789 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:10.007749    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7874f84956-6dqrp"]
Sep 20 00:50:10.010938 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:10.010911    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7874f84956-6dqrp"
Sep 20 00:50:10.013131 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:10.013106    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-td5kn\""
Sep 20 00:50:10.013243 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:10.013106    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 20 00:50:10.013243 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:10.013185    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 20 00:50:10.013446 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:10.013421    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 20 00:50:10.013554 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:10.013421    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 20 00:50:10.013554 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:10.013468    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 20 00:50:10.019575 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:10.019553    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 20 00:50:10.022479 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:10.022454    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7874f84956-6dqrp"]
Sep 20 00:50:10.118139 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:10.118096    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0d4c4e8-4b0c-4618-8903-a0892659b76e-serving-certs-ca-bundle\") pod \"telemeter-client-7874f84956-6dqrp\" (UID: \"a0d4c4e8-4b0c-4618-8903-a0892659b76e\") " pod="openshift-monitoring/telemeter-client-7874f84956-6dqrp"
Sep 20 00:50:10.118313 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:10.118201    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a0d4c4e8-4b0c-4618-8903-a0892659b76e-secret-telemeter-client\") pod \"telemeter-client-7874f84956-6dqrp\" (UID: \"a0d4c4e8-4b0c-4618-8903-a0892659b76e\") " pod="openshift-monitoring/telemeter-client-7874f84956-6dqrp"
Sep 20 00:50:10.118313 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:10.118272    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0d4c4e8-4b0c-4618-8903-a0892659b76e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7874f84956-6dqrp\" (UID: \"a0d4c4e8-4b0c-4618-8903-a0892659b76e\") " pod="openshift-monitoring/telemeter-client-7874f84956-6dqrp"
Sep 20 00:50:10.118435 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:10.118333    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a0d4c4e8-4b0c-4618-8903-a0892659b76e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7874f84956-6dqrp\" (UID: \"a0d4c4e8-4b0c-4618-8903-a0892659b76e\") " pod="openshift-monitoring/telemeter-client-7874f84956-6dqrp"
Sep 20 00:50:10.118435 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:10.118417    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a0d4c4e8-4b0c-4618-8903-a0892659b76e-federate-client-tls\") pod \"telemeter-client-7874f84956-6dqrp\" (UID: \"a0d4c4e8-4b0c-4618-8903-a0892659b76e\") " pod="openshift-monitoring/telemeter-client-7874f84956-6dqrp"
Sep 20 00:50:10.118520 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:10.118477    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0d4c4e8-4b0c-4618-8903-a0892659b76e-metrics-client-ca\") pod \"telemeter-client-7874f84956-6dqrp\" (UID: \"a0d4c4e8-4b0c-4618-8903-a0892659b76e\") " pod="openshift-monitoring/telemeter-client-7874f84956-6dqrp"
Sep 20 00:50:10.118520 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:10.118509    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a0d4c4e8-4b0c-4618-8903-a0892659b76e-telemeter-client-tls\") pod \"telemeter-client-7874f84956-6dqrp\" (UID: \"a0d4c4e8-4b0c-4618-8903-a0892659b76e\") " pod="openshift-monitoring/telemeter-client-7874f84956-6dqrp"
Sep 20 00:50:10.118598 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:10.118523    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r26qt\" (UniqueName: \"kubernetes.io/projected/a0d4c4e8-4b0c-4618-8903-a0892659b76e-kube-api-access-r26qt\") pod \"telemeter-client-7874f84956-6dqrp\" (UID: \"a0d4c4e8-4b0c-4618-8903-a0892659b76e\") " pod="openshift-monitoring/telemeter-client-7874f84956-6dqrp"
Sep 20 00:50:10.219730 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:10.219695    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0d4c4e8-4b0c-4618-8903-a0892659b76e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7874f84956-6dqrp\" (UID: \"a0d4c4e8-4b0c-4618-8903-a0892659b76e\") " pod="openshift-monitoring/telemeter-client-7874f84956-6dqrp"
Sep 20 00:50:10.219900 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:10.219746    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a0d4c4e8-4b0c-4618-8903-a0892659b76e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7874f84956-6dqrp\" (UID: \"a0d4c4e8-4b0c-4618-8903-a0892659b76e\") " pod="openshift-monitoring/telemeter-client-7874f84956-6dqrp"
Sep 20 00:50:10.219900 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:10.219782    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a0d4c4e8-4b0c-4618-8903-a0892659b76e-federate-client-tls\") pod \"telemeter-client-7874f84956-6dqrp\" (UID: \"a0d4c4e8-4b0c-4618-8903-a0892659b76e\") " pod="openshift-monitoring/telemeter-client-7874f84956-6dqrp"
Sep 20 00:50:10.219900 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:10.219801    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0d4c4e8-4b0c-4618-8903-a0892659b76e-metrics-client-ca\") pod \"telemeter-client-7874f84956-6dqrp\" (UID: \"a0d4c4e8-4b0c-4618-8903-a0892659b76e\") " pod="openshift-monitoring/telemeter-client-7874f84956-6dqrp"
Sep 20 00:50:10.219900 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:10.219817    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a0d4c4e8-4b0c-4618-8903-a0892659b76e-telemeter-client-tls\") pod \"telemeter-client-7874f84956-6dqrp\" (UID: \"a0d4c4e8-4b0c-4618-8903-a0892659b76e\") " pod="openshift-monitoring/telemeter-client-7874f84956-6dqrp"
Sep 20 00:50:10.219900 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:10.219831    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r26qt\" (UniqueName: \"kubernetes.io/projected/a0d4c4e8-4b0c-4618-8903-a0892659b76e-kube-api-access-r26qt\") pod \"telemeter-client-7874f84956-6dqrp\" (UID: \"a0d4c4e8-4b0c-4618-8903-a0892659b76e\") " pod="openshift-monitoring/telemeter-client-7874f84956-6dqrp"
Sep 20 00:50:10.219900 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:10.219849    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0d4c4e8-4b0c-4618-8903-a0892659b76e-serving-certs-ca-bundle\") pod \"telemeter-client-7874f84956-6dqrp\" (UID: \"a0d4c4e8-4b0c-4618-8903-a0892659b76e\") " pod="openshift-monitoring/telemeter-client-7874f84956-6dqrp"
Sep 20 00:50:10.220201 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:10.219911    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a0d4c4e8-4b0c-4618-8903-a0892659b76e-secret-telemeter-client\") pod \"telemeter-client-7874f84956-6dqrp\" (UID: \"a0d4c4e8-4b0c-4618-8903-a0892659b76e\") " pod="openshift-monitoring/telemeter-client-7874f84956-6dqrp"
Sep 20 00:50:10.221293 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:10.221263    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0d4c4e8-4b0c-4618-8903-a0892659b76e-serving-certs-ca-bundle\") pod \"telemeter-client-7874f84956-6dqrp\" (UID: \"a0d4c4e8-4b0c-4618-8903-a0892659b76e\") " pod="openshift-monitoring/telemeter-client-7874f84956-6dqrp"
Sep 20 00:50:10.221485 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:10.221275    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0d4c4e8-4b0c-4618-8903-a0892659b76e-metrics-client-ca\") pod \"telemeter-client-7874f84956-6dqrp\" (UID: \"a0d4c4e8-4b0c-4618-8903-a0892659b76e\") " pod="openshift-monitoring/telemeter-client-7874f84956-6dqrp"
Sep 20 00:50:10.222313 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:10.222288    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0d4c4e8-4b0c-4618-8903-a0892659b76e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7874f84956-6dqrp\" (UID: \"a0d4c4e8-4b0c-4618-8903-a0892659b76e\") " pod="openshift-monitoring/telemeter-client-7874f84956-6dqrp"
Sep 20 00:50:10.223140 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:10.223111    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a0d4c4e8-4b0c-4618-8903-a0892659b76e-federate-client-tls\") pod \"telemeter-client-7874f84956-6dqrp\" (UID: \"a0d4c4e8-4b0c-4618-8903-a0892659b76e\") " pod="openshift-monitoring/telemeter-client-7874f84956-6dqrp"
Sep 20 00:50:10.223314 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:10.223268    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a0d4c4e8-4b0c-4618-8903-a0892659b76e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7874f84956-6dqrp\" (UID: \"a0d4c4e8-4b0c-4618-8903-a0892659b76e\") " pod="openshift-monitoring/telemeter-client-7874f84956-6dqrp"
Sep 20 00:50:10.223854 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:10.223834    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a0d4c4e8-4b0c-4618-8903-a0892659b76e-secret-telemeter-client\") pod \"telemeter-client-7874f84956-6dqrp\" (UID: \"a0d4c4e8-4b0c-4618-8903-a0892659b76e\") " pod="openshift-monitoring/telemeter-client-7874f84956-6dqrp"
Sep 20 00:50:10.224477 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:10.224455    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a0d4c4e8-4b0c-4618-8903-a0892659b76e-telemeter-client-tls\") pod \"telemeter-client-7874f84956-6dqrp\" (UID: \"a0d4c4e8-4b0c-4618-8903-a0892659b76e\") " pod="openshift-monitoring/telemeter-client-7874f84956-6dqrp"
Sep 20 00:50:10.227958 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:10.227937    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r26qt\" (UniqueName: \"kubernetes.io/projected/a0d4c4e8-4b0c-4618-8903-a0892659b76e-kube-api-access-r26qt\") pod \"telemeter-client-7874f84956-6dqrp\" (UID: \"a0d4c4e8-4b0c-4618-8903-a0892659b76e\") " pod="openshift-monitoring/telemeter-client-7874f84956-6dqrp"
Sep 20 00:50:10.274374 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:10.274295    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ed29b1c6-f95d-4454-8e6e-4b175bde7d0c","Type":"ContainerStarted","Data":"6c3e3afc2b02bcd294904466d33d923010c15d0346e0b410f619f97172c3a8ef"}
Sep 20 00:50:10.274374 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:10.274356    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ed29b1c6-f95d-4454-8e6e-4b175bde7d0c","Type":"ContainerStarted","Data":"fbaeb512a364110306f136413e06b4e34a499e4986d79166d749ac732389a79f"}
Sep 20 00:50:10.274820 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:10.274381    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ed29b1c6-f95d-4454-8e6e-4b175bde7d0c","Type":"ContainerStarted","Data":"6c2dd6b4050128ed3e930eafd3e609192eff2ce8d8f0b09f3defcf43f306ede3"}
Sep 20 00:50:10.274820 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:10.274405    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ed29b1c6-f95d-4454-8e6e-4b175bde7d0c","Type":"ContainerStarted","Data":"0c2d83798990a96aa9b8f161cc56720539ba4a08a723997a0186a108edcc8596"}
Sep 20 00:50:10.274820 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:10.274427    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ed29b1c6-f95d-4454-8e6e-4b175bde7d0c","Type":"ContainerStarted","Data":"03efab3be473479a031a93ce6ef77cae7b45ac640f72022c2be8eda24dc658c6"}
Sep 20 00:50:10.274820 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:10.274450    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ed29b1c6-f95d-4454-8e6e-4b175bde7d0c","Type":"ContainerStarted","Data":"961e760c5169b2e4c00c8f1e11c794a167640b391658d715d4b7189d06be99fd"}
Sep 20 00:50:10.298501 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:10.298440    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.278505312 podStartE2EDuration="3.298420275s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.914963ms" isStatefulPod=false podCreationTimestamp="2026-09-20 00:50:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:50:10.297651182 +0000 UTC m=+146.911807136" watchObservedRunningTime="2026-09-20 00:50:10.298420275 +0000 UTC m=+146.912576200"
Sep 20 00:50:10.322568 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:10.322534    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7874f84956-6dqrp"
Sep 20 00:50:10.617557 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:10.617420    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7874f84956-6dqrp"]
Sep 20 00:50:10.620914 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:50:10.620881    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0d4c4e8_4b0c_4618_8903_a0892659b76e.slice/crio-d30471318aadda348e574f48f6ffa8288c90f4bff5424ad8d31636313c4dc9b1 WatchSource:0}: Error finding container d30471318aadda348e574f48f6ffa8288c90f4bff5424ad8d31636313c4dc9b1: Status 404 returned error can't find the container with id d30471318aadda348e574f48f6ffa8288c90f4bff5424ad8d31636313c4dc9b1
Sep 20 00:50:11.280019 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:11.279986    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7874f84956-6dqrp" event={"ID":"a0d4c4e8-4b0c-4618-8903-a0892659b76e","Type":"ContainerStarted","Data":"d30471318aadda348e574f48f6ffa8288c90f4bff5424ad8d31636313c4dc9b1"}
Sep 20 00:50:13.290798 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:13.290765    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7874f84956-6dqrp" event={"ID":"a0d4c4e8-4b0c-4618-8903-a0892659b76e","Type":"ContainerStarted","Data":"51139d84f09a424eabc1bf0653dd852758d48222bec29b6609102f0674c20cf0"}
Sep 20 00:50:13.291183 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:13.290819    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7874f84956-6dqrp" event={"ID":"a0d4c4e8-4b0c-4618-8903-a0892659b76e","Type":"ContainerStarted","Data":"6538aecc8a030a32929bfa06ef49a15d31be82cab247a472ff63e49962284c64"}
Sep 20 00:50:13.291183 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:13.290838    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7874f84956-6dqrp" event={"ID":"a0d4c4e8-4b0c-4618-8903-a0892659b76e","Type":"ContainerStarted","Data":"9c4cb77614a12c35c3af9fac2477f4bc9160e1e23adc640653d5e31a2f8eb4d1"}
Sep 20 00:50:13.311353 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:13.311305    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7874f84956-6dqrp" podStartSLOduration=2.468016121 podStartE2EDuration="4.311289548s" totalImagesPullingTime="1.843273427s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:50:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:50:13.310385847 +0000 UTC m=+149.924541764" watchObservedRunningTime="2026-09-20 00:50:13.311289548 +0000 UTC m=+149.925445444"
Sep 20 00:50:13.387023 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:13.386986    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7cb4558f8d-45bcf"]
Sep 20 00:50:13.389408 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:13.389388    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cb4558f8d-45bcf"
Sep 20 00:50:13.402633 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:13.402608    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cb4558f8d-45bcf"]
Sep 20 00:50:13.550552 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:13.550458    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtm6h\" (UniqueName: \"kubernetes.io/projected/5a5862c5-4f8c-4ebe-ba29-14459e91d31f-kube-api-access-jtm6h\") pod \"console-7cb4558f8d-45bcf\" (UID: \"5a5862c5-4f8c-4ebe-ba29-14459e91d31f\") " pod="openshift-console/console-7cb4558f8d-45bcf"
Sep 20 00:50:13.550552 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:13.550529    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a5862c5-4f8c-4ebe-ba29-14459e91d31f-console-oauth-config\") pod \"console-7cb4558f8d-45bcf\" (UID: \"5a5862c5-4f8c-4ebe-ba29-14459e91d31f\") " pod="openshift-console/console-7cb4558f8d-45bcf"
Sep 20 00:50:13.550552 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:13.550557    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a5862c5-4f8c-4ebe-ba29-14459e91d31f-console-serving-cert\") pod \"console-7cb4558f8d-45bcf\" (UID: \"5a5862c5-4f8c-4ebe-ba29-14459e91d31f\") " pod="openshift-console/console-7cb4558f8d-45bcf"
Sep 20 00:50:13.550846 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:13.550575    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a5862c5-4f8c-4ebe-ba29-14459e91d31f-console-config\") pod \"console-7cb4558f8d-45bcf\" (UID: \"5a5862c5-4f8c-4ebe-ba29-14459e91d31f\") " pod="openshift-console/console-7cb4558f8d-45bcf"
Sep 20 00:50:13.550846 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:13.550594    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a5862c5-4f8c-4ebe-ba29-14459e91d31f-service-ca\") pod \"console-7cb4558f8d-45bcf\" (UID: \"5a5862c5-4f8c-4ebe-ba29-14459e91d31f\") " pod="openshift-console/console-7cb4558f8d-45bcf"
Sep 20 00:50:13.550846 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:13.550614    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a5862c5-4f8c-4ebe-ba29-14459e91d31f-trusted-ca-bundle\") pod \"console-7cb4558f8d-45bcf\" (UID: \"5a5862c5-4f8c-4ebe-ba29-14459e91d31f\") " pod="openshift-console/console-7cb4558f8d-45bcf"
Sep 20 00:50:13.550846 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:13.550636    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a5862c5-4f8c-4ebe-ba29-14459e91d31f-oauth-serving-cert\") pod \"console-7cb4558f8d-45bcf\" (UID: \"5a5862c5-4f8c-4ebe-ba29-14459e91d31f\") " pod="openshift-console/console-7cb4558f8d-45bcf"
Sep 20 00:50:13.651325 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:13.651286    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtm6h\" (UniqueName: \"kubernetes.io/projected/5a5862c5-4f8c-4ebe-ba29-14459e91d31f-kube-api-access-jtm6h\") pod \"console-7cb4558f8d-45bcf\" (UID: \"5a5862c5-4f8c-4ebe-ba29-14459e91d31f\") " pod="openshift-console/console-7cb4558f8d-45bcf"
Sep 20 00:50:13.651466 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:13.651342    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a5862c5-4f8c-4ebe-ba29-14459e91d31f-console-oauth-config\") pod \"console-7cb4558f8d-45bcf\" (UID: \"5a5862c5-4f8c-4ebe-ba29-14459e91d31f\") " pod="openshift-console/console-7cb4558f8d-45bcf"
Sep 20 00:50:13.651510 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:13.651465    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a5862c5-4f8c-4ebe-ba29-14459e91d31f-console-serving-cert\") pod \"console-7cb4558f8d-45bcf\" (UID: \"5a5862c5-4f8c-4ebe-ba29-14459e91d31f\") " pod="openshift-console/console-7cb4558f8d-45bcf"
Sep 20 00:50:13.651510 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:13.651500    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a5862c5-4f8c-4ebe-ba29-14459e91d31f-console-config\") pod \"console-7cb4558f8d-45bcf\" (UID: \"5a5862c5-4f8c-4ebe-ba29-14459e91d31f\") " pod="openshift-console/console-7cb4558f8d-45bcf"
Sep 20 00:50:13.651591 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:13.651519    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a5862c5-4f8c-4ebe-ba29-14459e91d31f-service-ca\") pod \"console-7cb4558f8d-45bcf\" (UID: \"5a5862c5-4f8c-4ebe-ba29-14459e91d31f\") " pod="openshift-console/console-7cb4558f8d-45bcf"
Sep 20 00:50:13.651591 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:13.651547    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a5862c5-4f8c-4ebe-ba29-14459e91d31f-trusted-ca-bundle\") pod \"console-7cb4558f8d-45bcf\" (UID: \"5a5862c5-4f8c-4ebe-ba29-14459e91d31f\") " pod="openshift-console/console-7cb4558f8d-45bcf"
Sep 20 00:50:13.651591 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:13.651571    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a5862c5-4f8c-4ebe-ba29-14459e91d31f-oauth-serving-cert\") pod \"console-7cb4558f8d-45bcf\" (UID: \"5a5862c5-4f8c-4ebe-ba29-14459e91d31f\") " pod="openshift-console/console-7cb4558f8d-45bcf"
Sep 20 00:50:13.652345 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:13.652318    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a5862c5-4f8c-4ebe-ba29-14459e91d31f-console-config\") pod \"console-7cb4558f8d-45bcf\" (UID: \"5a5862c5-4f8c-4ebe-ba29-14459e91d31f\") " pod="openshift-console/console-7cb4558f8d-45bcf"
Sep 20 00:50:13.652478 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:13.652372    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a5862c5-4f8c-4ebe-ba29-14459e91d31f-service-ca\") pod \"console-7cb4558f8d-45bcf\" (UID: \"5a5862c5-4f8c-4ebe-ba29-14459e91d31f\") " pod="openshift-console/console-7cb4558f8d-45bcf"
Sep 20 00:50:13.652478 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:13.652418    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a5862c5-4f8c-4ebe-ba29-14459e91d31f-oauth-serving-cert\") pod \"console-7cb4558f8d-45bcf\" (UID: \"5a5862c5-4f8c-4ebe-ba29-14459e91d31f\") " pod="openshift-console/console-7cb4558f8d-45bcf"
Sep 20 00:50:13.652901 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:13.652852    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a5862c5-4f8c-4ebe-ba29-14459e91d31f-trusted-ca-bundle\") pod \"console-7cb4558f8d-45bcf\" (UID: \"5a5862c5-4f8c-4ebe-ba29-14459e91d31f\") " pod="openshift-console/console-7cb4558f8d-45bcf"
Sep 20 00:50:13.654009 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:13.653988    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a5862c5-4f8c-4ebe-ba29-14459e91d31f-console-oauth-config\") pod \"console-7cb4558f8d-45bcf\" (UID: \"5a5862c5-4f8c-4ebe-ba29-14459e91d31f\") " pod="openshift-console/console-7cb4558f8d-45bcf"
Sep 20 00:50:13.654139 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:13.654122    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a5862c5-4f8c-4ebe-ba29-14459e91d31f-console-serving-cert\") pod \"console-7cb4558f8d-45bcf\" (UID: \"5a5862c5-4f8c-4ebe-ba29-14459e91d31f\") " pod="openshift-console/console-7cb4558f8d-45bcf"
Sep 20 00:50:13.658778 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:13.658762    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtm6h\" (UniqueName: \"kubernetes.io/projected/5a5862c5-4f8c-4ebe-ba29-14459e91d31f-kube-api-access-jtm6h\") pod \"console-7cb4558f8d-45bcf\" (UID: \"5a5862c5-4f8c-4ebe-ba29-14459e91d31f\") " pod="openshift-console/console-7cb4558f8d-45bcf"
Sep 20 00:50:13.697808 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:13.697784    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cb4558f8d-45bcf"
Sep 20 00:50:13.967566 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:13.967535    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cb4558f8d-45bcf"]
Sep 20 00:50:13.970348 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:50:13.970317    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a5862c5_4f8c_4ebe_ba29_14459e91d31f.slice/crio-505c748cdf549b7bea9a4c50e1b61a84a1fbfecb0ffd890c8509c39fa951b80b WatchSource:0}: Error finding container 505c748cdf549b7bea9a4c50e1b61a84a1fbfecb0ffd890c8509c39fa951b80b: Status 404 returned error can't find the container with id 505c748cdf549b7bea9a4c50e1b61a84a1fbfecb0ffd890c8509c39fa951b80b
Sep 20 00:50:14.296967 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:14.296876    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cb4558f8d-45bcf" event={"ID":"5a5862c5-4f8c-4ebe-ba29-14459e91d31f","Type":"ContainerStarted","Data":"b295c4892fcba443b8d4f5649e30ece264ddc19921e62ad91db00508a3216d32"}
Sep 20 00:50:14.296967 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:14.296929    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cb4558f8d-45bcf" event={"ID":"5a5862c5-4f8c-4ebe-ba29-14459e91d31f","Type":"ContainerStarted","Data":"505c748cdf549b7bea9a4c50e1b61a84a1fbfecb0ffd890c8509c39fa951b80b"}
Sep 20 00:50:14.314449 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:14.314379    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7cb4558f8d-45bcf" podStartSLOduration=1.31436011 podStartE2EDuration="1.31436011s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:50:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:50:14.313753462 +0000 UTC m=+150.927909381" watchObservedRunningTime="2026-09-20 00:50:14.31436011 +0000 UTC m=+150.928516009"
Sep 20 00:50:23.698485 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:23.698451    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7cb4558f8d-45bcf"
Sep 20 00:50:23.698844 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:23.698516    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7cb4558f8d-45bcf"
Sep 20 00:50:23.703247 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:23.703228    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7cb4558f8d-45bcf"
Sep 20 00:50:24.340779 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:24.340752    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7cb4558f8d-45bcf"
Sep 20 00:50:24.387290 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:24.387256    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75bf798c6d-8jjsh"]
Sep 20 00:50:49.407707 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:49.407646    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-75bf798c6d-8jjsh" podUID="2e828c99-0418-4cab-bcfb-ce31e5b2b5a4" containerName="console" containerID="cri-o://e5a2b83f22399fad67d07f996d6c4b869ecd7c5e400714d6d0253eb24c0c9246" gracePeriod=15
Sep 20 00:50:49.637372 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:49.637350    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75bf798c6d-8jjsh"
Sep 20 00:50:49.738168 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:49.738088    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dtw2r\" (UniqueName: \"kubernetes.io/projected/2e828c99-0418-4cab-bcfb-ce31e5b2b5a4-kube-api-access-dtw2r\") pod \"2e828c99-0418-4cab-bcfb-ce31e5b2b5a4\" (UID: \"2e828c99-0418-4cab-bcfb-ce31e5b2b5a4\") "
Sep 20 00:50:49.738168 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:49.738153    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2e828c99-0418-4cab-bcfb-ce31e5b2b5a4-console-oauth-config\") pod \"2e828c99-0418-4cab-bcfb-ce31e5b2b5a4\" (UID: \"2e828c99-0418-4cab-bcfb-ce31e5b2b5a4\") "
Sep 20 00:50:49.738384 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:49.738208    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2e828c99-0418-4cab-bcfb-ce31e5b2b5a4-service-ca\") pod \"2e828c99-0418-4cab-bcfb-ce31e5b2b5a4\" (UID: \"2e828c99-0418-4cab-bcfb-ce31e5b2b5a4\") "
Sep 20 00:50:49.738384 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:49.738243    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2e828c99-0418-4cab-bcfb-ce31e5b2b5a4-console-serving-cert\") pod \"2e828c99-0418-4cab-bcfb-ce31e5b2b5a4\" (UID: \"2e828c99-0418-4cab-bcfb-ce31e5b2b5a4\") "
Sep 20 00:50:49.738384 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:49.738265    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2e828c99-0418-4cab-bcfb-ce31e5b2b5a4-console-config\") pod \"2e828c99-0418-4cab-bcfb-ce31e5b2b5a4\" (UID: \"2e828c99-0418-4cab-bcfb-ce31e5b2b5a4\") "
Sep 20 00:50:49.738384 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:49.738294    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2e828c99-0418-4cab-bcfb-ce31e5b2b5a4-oauth-serving-cert\") pod \"2e828c99-0418-4cab-bcfb-ce31e5b2b5a4\" (UID: \"2e828c99-0418-4cab-bcfb-ce31e5b2b5a4\") "
Sep 20 00:50:49.738384 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:49.738324    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e828c99-0418-4cab-bcfb-ce31e5b2b5a4-trusted-ca-bundle\") pod \"2e828c99-0418-4cab-bcfb-ce31e5b2b5a4\" (UID: \"2e828c99-0418-4cab-bcfb-ce31e5b2b5a4\") "
Sep 20 00:50:49.738768 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:49.738656    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e828c99-0418-4cab-bcfb-ce31e5b2b5a4-service-ca" (OuterVolumeSpecName: "service-ca") pod "2e828c99-0418-4cab-bcfb-ce31e5b2b5a4" (UID: "2e828c99-0418-4cab-bcfb-ce31e5b2b5a4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 00:50:49.738768 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:49.738744    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e828c99-0418-4cab-bcfb-ce31e5b2b5a4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2e828c99-0418-4cab-bcfb-ce31e5b2b5a4" (UID: "2e828c99-0418-4cab-bcfb-ce31e5b2b5a4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 00:50:49.738928 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:49.738744    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e828c99-0418-4cab-bcfb-ce31e5b2b5a4-console-config" (OuterVolumeSpecName: "console-config") pod "2e828c99-0418-4cab-bcfb-ce31e5b2b5a4" (UID: "2e828c99-0418-4cab-bcfb-ce31e5b2b5a4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 00:50:49.738928 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:49.738821    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e828c99-0418-4cab-bcfb-ce31e5b2b5a4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2e828c99-0418-4cab-bcfb-ce31e5b2b5a4" (UID: "2e828c99-0418-4cab-bcfb-ce31e5b2b5a4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 00:50:49.740433 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:49.740408    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e828c99-0418-4cab-bcfb-ce31e5b2b5a4-kube-api-access-dtw2r" (OuterVolumeSpecName: "kube-api-access-dtw2r") pod "2e828c99-0418-4cab-bcfb-ce31e5b2b5a4" (UID: "2e828c99-0418-4cab-bcfb-ce31e5b2b5a4"). InnerVolumeSpecName "kube-api-access-dtw2r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 00:50:49.740738 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:49.740717    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e828c99-0418-4cab-bcfb-ce31e5b2b5a4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2e828c99-0418-4cab-bcfb-ce31e5b2b5a4" (UID: "2e828c99-0418-4cab-bcfb-ce31e5b2b5a4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 00:50:49.740814 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:49.740793    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e828c99-0418-4cab-bcfb-ce31e5b2b5a4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2e828c99-0418-4cab-bcfb-ce31e5b2b5a4" (UID: "2e828c99-0418-4cab-bcfb-ce31e5b2b5a4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 00:50:49.839871 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:49.839825    2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2e828c99-0418-4cab-bcfb-ce31e5b2b5a4-service-ca\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 00:50:49.840039 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:49.839854    2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2e828c99-0418-4cab-bcfb-ce31e5b2b5a4-console-serving-cert\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 00:50:49.840039 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:49.839896    2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2e828c99-0418-4cab-bcfb-ce31e5b2b5a4-console-config\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 00:50:49.840039 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:49.839904    2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2e828c99-0418-4cab-bcfb-ce31e5b2b5a4-oauth-serving-cert\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 00:50:49.840039 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:49.839914    2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e828c99-0418-4cab-bcfb-ce31e5b2b5a4-trusted-ca-bundle\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 00:50:49.840039 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:49.839923    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtw2r\" (UniqueName: \"kubernetes.io/projected/2e828c99-0418-4cab-bcfb-ce31e5b2b5a4-kube-api-access-dtw2r\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 00:50:49.840039 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:49.839932    2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2e828c99-0418-4cab-bcfb-ce31e5b2b5a4-console-oauth-config\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 00:50:50.440898 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:50.440838    2570 generic.go:356] "Generic (PLEG): container finished" podID="2e828c99-0418-4cab-bcfb-ce31e5b2b5a4" containerID="e5a2b83f22399fad67d07f996d6c4b869ecd7c5e400714d6d0253eb24c0c9246" exitCode=0
Sep 20 00:50:50.441365 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:50.440907    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75bf798c6d-8jjsh"
Sep 20 00:50:50.441365 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:50.440902    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75bf798c6d-8jjsh" event={"ID":"2e828c99-0418-4cab-bcfb-ce31e5b2b5a4","Type":"ContainerDied","Data":"e5a2b83f22399fad67d07f996d6c4b869ecd7c5e400714d6d0253eb24c0c9246"}
Sep 20 00:50:50.441365 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:50.440963    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75bf798c6d-8jjsh" event={"ID":"2e828c99-0418-4cab-bcfb-ce31e5b2b5a4","Type":"ContainerDied","Data":"57eadbe6e38de00b08d2c7d787f1f453cb87bb83f8af1aea66f258badcde4ceb"}
Sep 20 00:50:50.441365 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:50.440990    2570 scope.go:117] "RemoveContainer" containerID="e5a2b83f22399fad67d07f996d6c4b869ecd7c5e400714d6d0253eb24c0c9246"
Sep 20 00:50:50.450174 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:50.450152    2570 scope.go:117] "RemoveContainer" containerID="e5a2b83f22399fad67d07f996d6c4b869ecd7c5e400714d6d0253eb24c0c9246"
Sep 20 00:50:50.450435 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:50:50.450416    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5a2b83f22399fad67d07f996d6c4b869ecd7c5e400714d6d0253eb24c0c9246\": container with ID starting with e5a2b83f22399fad67d07f996d6c4b869ecd7c5e400714d6d0253eb24c0c9246 not found: ID does not exist" containerID="e5a2b83f22399fad67d07f996d6c4b869ecd7c5e400714d6d0253eb24c0c9246"
Sep 20 00:50:50.450503 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:50.450442    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5a2b83f22399fad67d07f996d6c4b869ecd7c5e400714d6d0253eb24c0c9246"} err="failed to get container status \"e5a2b83f22399fad67d07f996d6c4b869ecd7c5e400714d6d0253eb24c0c9246\": rpc error: code = NotFound desc = could not find container \"e5a2b83f22399fad67d07f996d6c4b869ecd7c5e400714d6d0253eb24c0c9246\": container with ID starting with e5a2b83f22399fad67d07f996d6c4b869ecd7c5e400714d6d0253eb24c0c9246 not found: ID does not exist"
Sep 20 00:50:50.460460 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:50.460437    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75bf798c6d-8jjsh"]
Sep 20 00:50:50.464020 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:50.464002    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-75bf798c6d-8jjsh"]
Sep 20 00:50:51.452337 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:50:51.452305    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e828c99-0418-4cab-bcfb-ce31e5b2b5a4" path="/var/lib/kubelet/pods/2e828c99-0418-4cab-bcfb-ce31e5b2b5a4/volumes"
Sep 20 00:51:20.954605 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:20.954574    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7569b6d66c-4j682"]
Sep 20 00:51:20.955079 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:20.954896    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e828c99-0418-4cab-bcfb-ce31e5b2b5a4" containerName="console"
Sep 20 00:51:20.955079 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:20.954907    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e828c99-0418-4cab-bcfb-ce31e5b2b5a4" containerName="console"
Sep 20 00:51:20.955079 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:20.954968    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e828c99-0418-4cab-bcfb-ce31e5b2b5a4" containerName="console"
Sep 20 00:51:20.958087 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:20.958066    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7569b6d66c-4j682"
Sep 20 00:51:20.968801 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:20.968775    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7569b6d66c-4j682"]
Sep 20 00:51:20.986932 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:20.986907    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f381c9d5-fa45-4451-9a6f-379aa7001e81-oauth-serving-cert\") pod \"console-7569b6d66c-4j682\" (UID: \"f381c9d5-fa45-4451-9a6f-379aa7001e81\") " pod="openshift-console/console-7569b6d66c-4j682"
Sep 20 00:51:20.987039 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:20.986937    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f381c9d5-fa45-4451-9a6f-379aa7001e81-service-ca\") pod \"console-7569b6d66c-4j682\" (UID: \"f381c9d5-fa45-4451-9a6f-379aa7001e81\") " pod="openshift-console/console-7569b6d66c-4j682"
Sep 20 00:51:20.987039 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:20.986958    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f381c9d5-fa45-4451-9a6f-379aa7001e81-console-serving-cert\") pod \"console-7569b6d66c-4j682\" (UID: \"f381c9d5-fa45-4451-9a6f-379aa7001e81\") " pod="openshift-console/console-7569b6d66c-4j682"
Sep 20 00:51:20.987039 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:20.986972    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f381c9d5-fa45-4451-9a6f-379aa7001e81-console-oauth-config\") pod \"console-7569b6d66c-4j682\" (UID: \"f381c9d5-fa45-4451-9a6f-379aa7001e81\") " pod="openshift-console/console-7569b6d66c-4j682"
Sep 20 00:51:20.987184 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:20.987059    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f381c9d5-fa45-4451-9a6f-379aa7001e81-console-config\") pod \"console-7569b6d66c-4j682\" (UID: \"f381c9d5-fa45-4451-9a6f-379aa7001e81\") " pod="openshift-console/console-7569b6d66c-4j682"
Sep 20 00:51:20.987184 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:20.987085    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxrpw\" (UniqueName: \"kubernetes.io/projected/f381c9d5-fa45-4451-9a6f-379aa7001e81-kube-api-access-cxrpw\") pod \"console-7569b6d66c-4j682\" (UID: \"f381c9d5-fa45-4451-9a6f-379aa7001e81\") " pod="openshift-console/console-7569b6d66c-4j682"
Sep 20 00:51:20.987184 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:20.987121    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f381c9d5-fa45-4451-9a6f-379aa7001e81-trusted-ca-bundle\") pod \"console-7569b6d66c-4j682\" (UID: \"f381c9d5-fa45-4451-9a6f-379aa7001e81\") " pod="openshift-console/console-7569b6d66c-4j682"
Sep 20 00:51:21.088320 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:21.088281    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f381c9d5-fa45-4451-9a6f-379aa7001e81-trusted-ca-bundle\") pod \"console-7569b6d66c-4j682\" (UID: \"f381c9d5-fa45-4451-9a6f-379aa7001e81\") " pod="openshift-console/console-7569b6d66c-4j682"
Sep 20 00:51:21.088475 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:21.088339    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f381c9d5-fa45-4451-9a6f-379aa7001e81-oauth-serving-cert\") pod \"console-7569b6d66c-4j682\" (UID: \"f381c9d5-fa45-4451-9a6f-379aa7001e81\") " pod="openshift-console/console-7569b6d66c-4j682"
Sep 20 00:51:21.088475 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:21.088367    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f381c9d5-fa45-4451-9a6f-379aa7001e81-service-ca\") pod \"console-7569b6d66c-4j682\" (UID: \"f381c9d5-fa45-4451-9a6f-379aa7001e81\") " pod="openshift-console/console-7569b6d66c-4j682"
Sep 20 00:51:21.088475 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:21.088404    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f381c9d5-fa45-4451-9a6f-379aa7001e81-console-serving-cert\") pod \"console-7569b6d66c-4j682\" (UID: \"f381c9d5-fa45-4451-9a6f-379aa7001e81\") " pod="openshift-console/console-7569b6d66c-4j682"
Sep 20 00:51:21.088475 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:21.088427    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f381c9d5-fa45-4451-9a6f-379aa7001e81-console-oauth-config\") pod \"console-7569b6d66c-4j682\" (UID: \"f381c9d5-fa45-4451-9a6f-379aa7001e81\") " pod="openshift-console/console-7569b6d66c-4j682"
Sep 20 00:51:21.088678 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:21.088483    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f381c9d5-fa45-4451-9a6f-379aa7001e81-console-config\") pod \"console-7569b6d66c-4j682\" (UID: \"f381c9d5-fa45-4451-9a6f-379aa7001e81\") " pod="openshift-console/console-7569b6d66c-4j682"
Sep 20 00:51:21.088678 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:21.088508    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxrpw\" (UniqueName: \"kubernetes.io/projected/f381c9d5-fa45-4451-9a6f-379aa7001e81-kube-api-access-cxrpw\") pod \"console-7569b6d66c-4j682\" (UID: \"f381c9d5-fa45-4451-9a6f-379aa7001e81\") " pod="openshift-console/console-7569b6d66c-4j682"
Sep 20 00:51:21.089271 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:21.089199    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f381c9d5-fa45-4451-9a6f-379aa7001e81-service-ca\") pod \"console-7569b6d66c-4j682\" (UID: \"f381c9d5-fa45-4451-9a6f-379aa7001e81\") " pod="openshift-console/console-7569b6d66c-4j682"
Sep 20 00:51:21.089271 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:21.089269    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f381c9d5-fa45-4451-9a6f-379aa7001e81-console-config\") pod \"console-7569b6d66c-4j682\" (UID: \"f381c9d5-fa45-4451-9a6f-379aa7001e81\") " pod="openshift-console/console-7569b6d66c-4j682"
Sep 20 00:51:21.089271 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:21.089297    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f381c9d5-fa45-4451-9a6f-379aa7001e81-trusted-ca-bundle\") pod \"console-7569b6d66c-4j682\" (UID: \"f381c9d5-fa45-4451-9a6f-379aa7001e81\") " pod="openshift-console/console-7569b6d66c-4j682"
Sep 20 00:51:21.089561 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:21.089382    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f381c9d5-fa45-4451-9a6f-379aa7001e81-oauth-serving-cert\") pod \"console-7569b6d66c-4j682\" (UID: \"f381c9d5-fa45-4451-9a6f-379aa7001e81\") " pod="openshift-console/console-7569b6d66c-4j682"
Sep 20 00:51:21.091082 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:21.091063    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f381c9d5-fa45-4451-9a6f-379aa7001e81-console-serving-cert\") pod \"console-7569b6d66c-4j682\" (UID: \"f381c9d5-fa45-4451-9a6f-379aa7001e81\") " pod="openshift-console/console-7569b6d66c-4j682"
Sep 20 00:51:21.091082 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:21.091071    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f381c9d5-fa45-4451-9a6f-379aa7001e81-console-oauth-config\") pod \"console-7569b6d66c-4j682\" (UID: \"f381c9d5-fa45-4451-9a6f-379aa7001e81\") " pod="openshift-console/console-7569b6d66c-4j682"
Sep 20 00:51:21.096678 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:21.096641    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxrpw\" (UniqueName: \"kubernetes.io/projected/f381c9d5-fa45-4451-9a6f-379aa7001e81-kube-api-access-cxrpw\") pod \"console-7569b6d66c-4j682\" (UID: \"f381c9d5-fa45-4451-9a6f-379aa7001e81\") " pod="openshift-console/console-7569b6d66c-4j682"
Sep 20 00:51:21.267548 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:21.267473    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7569b6d66c-4j682"
Sep 20 00:51:21.538683 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:21.538658    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7569b6d66c-4j682"]
Sep 20 00:51:21.541222 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:51:21.541195    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf381c9d5_fa45_4451_9a6f_379aa7001e81.slice/crio-140ca9c3c8160fbbcd7a3bca8ad425e9b5b6cddd6be0050028de859a91ab3ca0 WatchSource:0}: Error finding container 140ca9c3c8160fbbcd7a3bca8ad425e9b5b6cddd6be0050028de859a91ab3ca0: Status 404 returned error can't find the container with id 140ca9c3c8160fbbcd7a3bca8ad425e9b5b6cddd6be0050028de859a91ab3ca0
Sep 20 00:51:21.567122 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:21.567092    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7569b6d66c-4j682" event={"ID":"f381c9d5-fa45-4451-9a6f-379aa7001e81","Type":"ContainerStarted","Data":"140ca9c3c8160fbbcd7a3bca8ad425e9b5b6cddd6be0050028de859a91ab3ca0"}
Sep 20 00:51:22.572873 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:22.572824    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7569b6d66c-4j682" event={"ID":"f381c9d5-fa45-4451-9a6f-379aa7001e81","Type":"ContainerStarted","Data":"e3402ff90529f4680559cc1d7e946cf463a77c735b6e8bb25bab05a9708933d2"}
Sep 20 00:51:22.589825 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:22.589777    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7569b6d66c-4j682" podStartSLOduration=2.589761839 podStartE2EDuration="2.589761839s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:51:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:51:22.588735456 +0000 UTC m=+219.202891408" watchObservedRunningTime="2026-09-20 00:51:22.589761839 +0000 UTC m=+219.203917735"
Sep 20 00:51:31.268350 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:31.268297    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7569b6d66c-4j682"
Sep 20 00:51:31.268350 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:31.268370    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7569b6d66c-4j682"
Sep 20 00:51:31.273064 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:31.273041    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7569b6d66c-4j682"
Sep 20 00:51:31.610587 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:31.610510    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7569b6d66c-4j682"
Sep 20 00:51:31.656511 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:31.656479    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cb4558f8d-45bcf"]
Sep 20 00:51:56.676681 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:56.676570    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7cb4558f8d-45bcf" podUID="5a5862c5-4f8c-4ebe-ba29-14459e91d31f" containerName="console" containerID="cri-o://b295c4892fcba443b8d4f5649e30ece264ddc19921e62ad91db00508a3216d32" gracePeriod=15
Sep 20 00:51:56.917790 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:56.917768    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cb4558f8d-45bcf"
Sep 20 00:51:57.085758 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:57.085657    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a5862c5-4f8c-4ebe-ba29-14459e91d31f-console-serving-cert\") pod \"5a5862c5-4f8c-4ebe-ba29-14459e91d31f\" (UID: \"5a5862c5-4f8c-4ebe-ba29-14459e91d31f\") "
Sep 20 00:51:57.085758 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:57.085718    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a5862c5-4f8c-4ebe-ba29-14459e91d31f-console-config\") pod \"5a5862c5-4f8c-4ebe-ba29-14459e91d31f\" (UID: \"5a5862c5-4f8c-4ebe-ba29-14459e91d31f\") "
Sep 20 00:51:57.086017 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:57.085764    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtm6h\" (UniqueName: \"kubernetes.io/projected/5a5862c5-4f8c-4ebe-ba29-14459e91d31f-kube-api-access-jtm6h\") pod \"5a5862c5-4f8c-4ebe-ba29-14459e91d31f\" (UID: \"5a5862c5-4f8c-4ebe-ba29-14459e91d31f\") "
Sep 20 00:51:57.086017 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:57.085812    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a5862c5-4f8c-4ebe-ba29-14459e91d31f-console-oauth-config\") pod \"5a5862c5-4f8c-4ebe-ba29-14459e91d31f\" (UID: \"5a5862c5-4f8c-4ebe-ba29-14459e91d31f\") "
Sep 20 00:51:57.086017 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:57.085833    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a5862c5-4f8c-4ebe-ba29-14459e91d31f-oauth-serving-cert\") pod \"5a5862c5-4f8c-4ebe-ba29-14459e91d31f\" (UID: \"5a5862c5-4f8c-4ebe-ba29-14459e91d31f\") "
Sep 20 00:51:57.086017 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:57.085889    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a5862c5-4f8c-4ebe-ba29-14459e91d31f-service-ca\") pod \"5a5862c5-4f8c-4ebe-ba29-14459e91d31f\" (UID: \"5a5862c5-4f8c-4ebe-ba29-14459e91d31f\") "
Sep 20 00:51:57.086017 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:57.085931    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a5862c5-4f8c-4ebe-ba29-14459e91d31f-trusted-ca-bundle\") pod \"5a5862c5-4f8c-4ebe-ba29-14459e91d31f\" (UID: \"5a5862c5-4f8c-4ebe-ba29-14459e91d31f\") "
Sep 20 00:51:57.086277 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:57.086185    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a5862c5-4f8c-4ebe-ba29-14459e91d31f-console-config" (OuterVolumeSpecName: "console-config") pod "5a5862c5-4f8c-4ebe-ba29-14459e91d31f" (UID: "5a5862c5-4f8c-4ebe-ba29-14459e91d31f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 00:51:57.086335 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:57.086308    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a5862c5-4f8c-4ebe-ba29-14459e91d31f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5a5862c5-4f8c-4ebe-ba29-14459e91d31f" (UID: "5a5862c5-4f8c-4ebe-ba29-14459e91d31f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 00:51:57.086395 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:57.086336    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a5862c5-4f8c-4ebe-ba29-14459e91d31f-service-ca" (OuterVolumeSpecName: "service-ca") pod "5a5862c5-4f8c-4ebe-ba29-14459e91d31f" (UID: "5a5862c5-4f8c-4ebe-ba29-14459e91d31f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 00:51:57.086452 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:57.086393    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a5862c5-4f8c-4ebe-ba29-14459e91d31f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5a5862c5-4f8c-4ebe-ba29-14459e91d31f" (UID: "5a5862c5-4f8c-4ebe-ba29-14459e91d31f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 00:51:57.088134 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:57.088097    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a5862c5-4f8c-4ebe-ba29-14459e91d31f-kube-api-access-jtm6h" (OuterVolumeSpecName: "kube-api-access-jtm6h") pod "5a5862c5-4f8c-4ebe-ba29-14459e91d31f" (UID: "5a5862c5-4f8c-4ebe-ba29-14459e91d31f"). InnerVolumeSpecName "kube-api-access-jtm6h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 00:51:57.088134 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:57.088108    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a5862c5-4f8c-4ebe-ba29-14459e91d31f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5a5862c5-4f8c-4ebe-ba29-14459e91d31f" (UID: "5a5862c5-4f8c-4ebe-ba29-14459e91d31f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 00:51:57.088449 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:57.088429    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a5862c5-4f8c-4ebe-ba29-14459e91d31f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5a5862c5-4f8c-4ebe-ba29-14459e91d31f" (UID: "5a5862c5-4f8c-4ebe-ba29-14459e91d31f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 00:51:57.187341 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:57.187311    2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a5862c5-4f8c-4ebe-ba29-14459e91d31f-console-serving-cert\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 00:51:57.187341 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:57.187338    2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a5862c5-4f8c-4ebe-ba29-14459e91d31f-console-config\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 00:51:57.187341 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:57.187348    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtm6h\" (UniqueName: \"kubernetes.io/projected/5a5862c5-4f8c-4ebe-ba29-14459e91d31f-kube-api-access-jtm6h\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 00:51:57.187535 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:57.187356    2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a5862c5-4f8c-4ebe-ba29-14459e91d31f-console-oauth-config\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 00:51:57.187535 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:57.187365    2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a5862c5-4f8c-4ebe-ba29-14459e91d31f-oauth-serving-cert\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 00:51:57.187535 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:57.187372    2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a5862c5-4f8c-4ebe-ba29-14459e91d31f-service-ca\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 00:51:57.187535 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:57.187380    2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a5862c5-4f8c-4ebe-ba29-14459e91d31f-trusted-ca-bundle\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 00:51:57.712745 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:57.712661    2570 generic.go:356] "Generic (PLEG): container finished" podID="5a5862c5-4f8c-4ebe-ba29-14459e91d31f" containerID="b295c4892fcba443b8d4f5649e30ece264ddc19921e62ad91db00508a3216d32" exitCode=0
Sep 20 00:51:57.712745 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:57.712704    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cb4558f8d-45bcf"
Sep 20 00:51:57.713181 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:57.712749    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cb4558f8d-45bcf" event={"ID":"5a5862c5-4f8c-4ebe-ba29-14459e91d31f","Type":"ContainerDied","Data":"b295c4892fcba443b8d4f5649e30ece264ddc19921e62ad91db00508a3216d32"}
Sep 20 00:51:57.713181 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:57.712795    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cb4558f8d-45bcf" event={"ID":"5a5862c5-4f8c-4ebe-ba29-14459e91d31f","Type":"ContainerDied","Data":"505c748cdf549b7bea9a4c50e1b61a84a1fbfecb0ffd890c8509c39fa951b80b"}
Sep 20 00:51:57.713181 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:57.712819    2570 scope.go:117] "RemoveContainer" containerID="b295c4892fcba443b8d4f5649e30ece264ddc19921e62ad91db00508a3216d32"
Sep 20 00:51:57.721017 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:57.720999    2570 scope.go:117] "RemoveContainer" containerID="b295c4892fcba443b8d4f5649e30ece264ddc19921e62ad91db00508a3216d32"
Sep 20 00:51:57.721309 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:51:57.721283    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b295c4892fcba443b8d4f5649e30ece264ddc19921e62ad91db00508a3216d32\": container with ID starting with b295c4892fcba443b8d4f5649e30ece264ddc19921e62ad91db00508a3216d32 not found: ID does not exist" containerID="b295c4892fcba443b8d4f5649e30ece264ddc19921e62ad91db00508a3216d32"
Sep 20 00:51:57.721352 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:57.721319    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b295c4892fcba443b8d4f5649e30ece264ddc19921e62ad91db00508a3216d32"} err="failed to get container status \"b295c4892fcba443b8d4f5649e30ece264ddc19921e62ad91db00508a3216d32\": rpc error: code = NotFound desc = could not find container \"b295c4892fcba443b8d4f5649e30ece264ddc19921e62ad91db00508a3216d32\": container with ID starting with b295c4892fcba443b8d4f5649e30ece264ddc19921e62ad91db00508a3216d32 not found: ID does not exist"
Sep 20 00:51:57.728159 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:57.728139    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cb4558f8d-45bcf"]
Sep 20 00:51:57.731096 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:57.731077    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7cb4558f8d-45bcf"]
Sep 20 00:51:59.452531 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:51:59.452495    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a5862c5-4f8c-4ebe-ba29-14459e91d31f" path="/var/lib/kubelet/pods/5a5862c5-4f8c-4ebe-ba29-14459e91d31f/volumes"
Sep 20 00:52:02.638595 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:02.638563    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-644d7fcd8d-tnpq9"]
Sep 20 00:52:02.638975 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:02.638877    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a5862c5-4f8c-4ebe-ba29-14459e91d31f" containerName="console"
Sep 20 00:52:02.638975 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:02.638888    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a5862c5-4f8c-4ebe-ba29-14459e91d31f" containerName="console"
Sep 20 00:52:02.638975 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:02.638959    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a5862c5-4f8c-4ebe-ba29-14459e91d31f" containerName="console"
Sep 20 00:52:02.643140 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:02.643123    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-644d7fcd8d-tnpq9"
Sep 20 00:52:02.646012 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:02.645985    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 20 00:52:02.646141 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:02.646037    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 20 00:52:02.646141 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:02.646091    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-qjrnm\""
Sep 20 00:52:02.646141 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:02.646045    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 20 00:52:02.646273 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:02.646037    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 20 00:52:02.648834 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:02.648812    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-644d7fcd8d-tnpq9"]
Sep 20 00:52:02.765123 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:02.765087    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f49b677f9-5whch"]
Sep 20 00:52:02.768422 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:02.768407    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f49b677f9-5whch"
Sep 20 00:52:02.770835 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:02.770815    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 20 00:52:02.770999 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:02.770893    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 20 00:52:02.770999 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:02.770925    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 20 00:52:02.771097 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:02.771013    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 20 00:52:02.778275 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:02.778251    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f49b677f9-5whch"]
Sep 20 00:52:02.833844 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:02.833812    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-576zn\" (UniqueName: \"kubernetes.io/projected/d2086883-dcc6-45ba-9354-286590441a02-kube-api-access-576zn\") pod \"managed-serviceaccount-addon-agent-644d7fcd8d-tnpq9\" (UID: \"d2086883-dcc6-45ba-9354-286590441a02\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-644d7fcd8d-tnpq9"
Sep 20 00:52:02.834036 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:02.833854    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d2086883-dcc6-45ba-9354-286590441a02-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-644d7fcd8d-tnpq9\" (UID: \"d2086883-dcc6-45ba-9354-286590441a02\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-644d7fcd8d-tnpq9"
Sep 20 00:52:02.935240 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:02.935144    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5d4230cb-8748-4cb0-a3fd-ffde6bf878ec-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5f49b677f9-5whch\" (UID: \"5d4230cb-8748-4cb0-a3fd-ffde6bf878ec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f49b677f9-5whch"
Sep 20 00:52:02.935240 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:02.935189    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5d4230cb-8748-4cb0-a3fd-ffde6bf878ec-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5f49b677f9-5whch\" (UID: \"5d4230cb-8748-4cb0-a3fd-ffde6bf878ec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f49b677f9-5whch"
Sep 20 00:52:02.935459 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:02.935261    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-576zn\" (UniqueName: \"kubernetes.io/projected/d2086883-dcc6-45ba-9354-286590441a02-kube-api-access-576zn\") pod \"managed-serviceaccount-addon-agent-644d7fcd8d-tnpq9\" (UID: \"d2086883-dcc6-45ba-9354-286590441a02\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-644d7fcd8d-tnpq9"
Sep 20 00:52:02.935459 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:02.935299    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d4230cb-8748-4cb0-a3fd-ffde6bf878ec-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5f49b677f9-5whch\" (UID: \"5d4230cb-8748-4cb0-a3fd-ffde6bf878ec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f49b677f9-5whch"
Sep 20 00:52:02.935459 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:02.935325    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnlgn\" (UniqueName: \"kubernetes.io/projected/5d4230cb-8748-4cb0-a3fd-ffde6bf878ec-kube-api-access-gnlgn\") pod \"cluster-proxy-proxy-agent-5f49b677f9-5whch\" (UID: \"5d4230cb-8748-4cb0-a3fd-ffde6bf878ec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f49b677f9-5whch"
Sep 20 00:52:02.935459 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:02.935362    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d2086883-dcc6-45ba-9354-286590441a02-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-644d7fcd8d-tnpq9\" (UID: \"d2086883-dcc6-45ba-9354-286590441a02\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-644d7fcd8d-tnpq9"
Sep 20 00:52:02.935459 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:02.935408    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5d4230cb-8748-4cb0-a3fd-ffde6bf878ec-hub\") pod \"cluster-proxy-proxy-agent-5f49b677f9-5whch\" (UID: \"5d4230cb-8748-4cb0-a3fd-ffde6bf878ec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f49b677f9-5whch"
Sep 20 00:52:02.935459 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:02.935449    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5d4230cb-8748-4cb0-a3fd-ffde6bf878ec-ca\") pod \"cluster-proxy-proxy-agent-5f49b677f9-5whch\" (UID: \"5d4230cb-8748-4cb0-a3fd-ffde6bf878ec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f49b677f9-5whch"
Sep 20 00:52:02.938210 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:02.938181    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d2086883-dcc6-45ba-9354-286590441a02-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-644d7fcd8d-tnpq9\" (UID: \"d2086883-dcc6-45ba-9354-286590441a02\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-644d7fcd8d-tnpq9"
Sep 20 00:52:02.945431 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:02.945407    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-576zn\" (UniqueName: \"kubernetes.io/projected/d2086883-dcc6-45ba-9354-286590441a02-kube-api-access-576zn\") pod \"managed-serviceaccount-addon-agent-644d7fcd8d-tnpq9\" (UID: \"d2086883-dcc6-45ba-9354-286590441a02\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-644d7fcd8d-tnpq9"
Sep 20 00:52:02.959380 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:02.959349    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-644d7fcd8d-tnpq9"
Sep 20 00:52:03.036381 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:03.036350    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5d4230cb-8748-4cb0-a3fd-ffde6bf878ec-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5f49b677f9-5whch\" (UID: \"5d4230cb-8748-4cb0-a3fd-ffde6bf878ec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f49b677f9-5whch"
Sep 20 00:52:03.036542 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:03.036396    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5d4230cb-8748-4cb0-a3fd-ffde6bf878ec-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5f49b677f9-5whch\" (UID: \"5d4230cb-8748-4cb0-a3fd-ffde6bf878ec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f49b677f9-5whch"
Sep 20 00:52:03.036542 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:03.036437    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d4230cb-8748-4cb0-a3fd-ffde6bf878ec-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5f49b677f9-5whch\" (UID: \"5d4230cb-8748-4cb0-a3fd-ffde6bf878ec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f49b677f9-5whch"
Sep 20 00:52:03.036542 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:03.036463    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnlgn\" (UniqueName: \"kubernetes.io/projected/5d4230cb-8748-4cb0-a3fd-ffde6bf878ec-kube-api-access-gnlgn\") pod \"cluster-proxy-proxy-agent-5f49b677f9-5whch\" (UID: \"5d4230cb-8748-4cb0-a3fd-ffde6bf878ec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f49b677f9-5whch"
Sep 20 00:52:03.036542 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:03.036507    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5d4230cb-8748-4cb0-a3fd-ffde6bf878ec-hub\") pod \"cluster-proxy-proxy-agent-5f49b677f9-5whch\" (UID: \"5d4230cb-8748-4cb0-a3fd-ffde6bf878ec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f49b677f9-5whch"
Sep 20 00:52:03.036742 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:03.036545    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5d4230cb-8748-4cb0-a3fd-ffde6bf878ec-ca\") pod \"cluster-proxy-proxy-agent-5f49b677f9-5whch\" (UID: \"5d4230cb-8748-4cb0-a3fd-ffde6bf878ec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f49b677f9-5whch"
Sep 20 00:52:03.037456 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:03.037429    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d4230cb-8748-4cb0-a3fd-ffde6bf878ec-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5f49b677f9-5whch\" (UID: \"5d4230cb-8748-4cb0-a3fd-ffde6bf878ec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f49b677f9-5whch"
Sep 20 00:52:03.039415 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:03.039387    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5d4230cb-8748-4cb0-a3fd-ffde6bf878ec-ca\") pod \"cluster-proxy-proxy-agent-5f49b677f9-5whch\" (UID: \"5d4230cb-8748-4cb0-a3fd-ffde6bf878ec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f49b677f9-5whch"
Sep 20 00:52:03.039707 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:03.039689    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5d4230cb-8748-4cb0-a3fd-ffde6bf878ec-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5f49b677f9-5whch\" (UID: \"5d4230cb-8748-4cb0-a3fd-ffde6bf878ec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f49b677f9-5whch"
Sep 20 00:52:03.039768 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:03.039746    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5d4230cb-8748-4cb0-a3fd-ffde6bf878ec-hub\") pod \"cluster-proxy-proxy-agent-5f49b677f9-5whch\" (UID: \"5d4230cb-8748-4cb0-a3fd-ffde6bf878ec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f49b677f9-5whch"
Sep 20 00:52:03.039807 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:03.039798    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5d4230cb-8748-4cb0-a3fd-ffde6bf878ec-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5f49b677f9-5whch\" (UID: \"5d4230cb-8748-4cb0-a3fd-ffde6bf878ec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f49b677f9-5whch"
Sep 20 00:52:03.046027 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:03.046010    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnlgn\" (UniqueName: \"kubernetes.io/projected/5d4230cb-8748-4cb0-a3fd-ffde6bf878ec-kube-api-access-gnlgn\") pod \"cluster-proxy-proxy-agent-5f49b677f9-5whch\" (UID: \"5d4230cb-8748-4cb0-a3fd-ffde6bf878ec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f49b677f9-5whch"
Sep 20 00:52:03.077958 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:03.077926    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f49b677f9-5whch"
Sep 20 00:52:03.230806 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:03.230603    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-644d7fcd8d-tnpq9"]
Sep 20 00:52:03.233423 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:52:03.233396    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd2086883_dcc6_45ba_9354_286590441a02.slice/crio-9fb8cdfc818545bb61909ed39f2a6647ddd22b492a3d024baa70d32de3ab546c WatchSource:0}: Error finding container 9fb8cdfc818545bb61909ed39f2a6647ddd22b492a3d024baa70d32de3ab546c: Status 404 returned error can't find the container with id 9fb8cdfc818545bb61909ed39f2a6647ddd22b492a3d024baa70d32de3ab546c
Sep 20 00:52:03.348460 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:03.348307    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f49b677f9-5whch"]
Sep 20 00:52:03.350845 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:52:03.350820    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5d4230cb_8748_4cb0_a3fd_ffde6bf878ec.slice/crio-1d0e01e068b5be5a80a4dc29c3c5850140934dd59583212a40ade5421cc1dd23 WatchSource:0}: Error finding container 1d0e01e068b5be5a80a4dc29c3c5850140934dd59583212a40ade5421cc1dd23: Status 404 returned error can't find the container with id 1d0e01e068b5be5a80a4dc29c3c5850140934dd59583212a40ade5421cc1dd23
Sep 20 00:52:03.737017 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:03.736977    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-644d7fcd8d-tnpq9" event={"ID":"d2086883-dcc6-45ba-9354-286590441a02","Type":"ContainerStarted","Data":"9fb8cdfc818545bb61909ed39f2a6647ddd22b492a3d024baa70d32de3ab546c"}
Sep 20 00:52:03.738184 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:03.738161    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f49b677f9-5whch" event={"ID":"5d4230cb-8748-4cb0-a3fd-ffde6bf878ec","Type":"ContainerStarted","Data":"1d0e01e068b5be5a80a4dc29c3c5850140934dd59583212a40ade5421cc1dd23"}
Sep 20 00:52:06.754026 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:06.753927    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-644d7fcd8d-tnpq9" event={"ID":"d2086883-dcc6-45ba-9354-286590441a02","Type":"ContainerStarted","Data":"0e59f0270c86b401ace805fa4dfe943fb5672a37dfbdf6d69ca985cef2d66a98"}
Sep 20 00:52:06.768326 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:06.768278    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-644d7fcd8d-tnpq9" podStartSLOduration=1.905241095 podStartE2EDuration="4.768257676s" totalImagesPullingTime="2.863016581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:52:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:52:06.766914869 +0000 UTC m=+263.381070767" watchObservedRunningTime="2026-09-20 00:52:06.768257676 +0000 UTC m=+263.382413574"
Sep 20 00:52:10.781330 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:10.781295    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f49b677f9-5whch" event={"ID":"5d4230cb-8748-4cb0-a3fd-ffde6bf878ec","Type":"ContainerStarted","Data":"6fe0e8eab3086a1dafb1a180e5254f779c912aea8dfa42f9396983b98eec6290"}
Sep 20 00:52:10.781723 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:10.781344    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f49b677f9-5whch" event={"ID":"5d4230cb-8748-4cb0-a3fd-ffde6bf878ec","Type":"ContainerStarted","Data":"ee90fd190106cae009115598fd3a5c395aa07a408a4b4aae3c328c58455092b2"}
Sep 20 00:52:10.781723 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:10.781360    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f49b677f9-5whch" event={"ID":"5d4230cb-8748-4cb0-a3fd-ffde6bf878ec","Type":"ContainerStarted","Data":"e79407f7f757992f18e302ac74809d3339897374a316514ab93d8612d108694c"}
Sep 20 00:52:10.800352 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:10.800307    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f49b677f9-5whch" podStartSLOduration=1.952541342 podStartE2EDuration="8.800289326s" totalImagesPullingTime="6.847747984s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:52:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:52:10.798993411 +0000 UTC m=+267.413149307" watchObservedRunningTime="2026-09-20 00:52:10.800289326 +0000 UTC m=+267.414445222"
Sep 20 00:52:45.373316 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:45.373280    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65l6f_bf898d8f-ed0f-4b4e-9a87-8e6167b29481/ovn-acl-logging/0.log"
Sep 20 00:52:45.382203 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:45.382173    2570 kubelet.go:1648] "Image garbage collection succeeded"
Sep 20 00:52:45.387448 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:52:45.387429    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65l6f_bf898d8f-ed0f-4b4e-9a87-8e6167b29481/ovn-acl-logging/0.log"
Sep 20 00:53:43.960839 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:53:43.960754    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-84494cccd-snf2k"]
Sep 20 00:53:43.963283 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:53:43.963261    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84494cccd-snf2k"
Sep 20 00:53:43.980746 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:53:43.980709    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84494cccd-snf2k"]
Sep 20 00:53:43.992778 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:53:43.992744    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j94bp\" (UniqueName: \"kubernetes.io/projected/4d3e0171-e6d1-4270-affb-7cca74ccab53-kube-api-access-j94bp\") pod \"console-84494cccd-snf2k\" (UID: \"4d3e0171-e6d1-4270-affb-7cca74ccab53\") " pod="openshift-console/console-84494cccd-snf2k"
Sep 20 00:53:43.992960 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:53:43.992782    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d3e0171-e6d1-4270-affb-7cca74ccab53-oauth-serving-cert\") pod \"console-84494cccd-snf2k\" (UID: \"4d3e0171-e6d1-4270-affb-7cca74ccab53\") " pod="openshift-console/console-84494cccd-snf2k"
Sep 20 00:53:43.992960 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:53:43.992809    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d3e0171-e6d1-4270-affb-7cca74ccab53-trusted-ca-bundle\") pod \"console-84494cccd-snf2k\" (UID: \"4d3e0171-e6d1-4270-affb-7cca74ccab53\") " pod="openshift-console/console-84494cccd-snf2k"
Sep 20 00:53:43.992960 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:53:43.992852    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d3e0171-e6d1-4270-affb-7cca74ccab53-console-config\") pod \"console-84494cccd-snf2k\" (UID: \"4d3e0171-e6d1-4270-affb-7cca74ccab53\") " pod="openshift-console/console-84494cccd-snf2k"
Sep 20 00:53:43.992960 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:53:43.992916    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d3e0171-e6d1-4270-affb-7cca74ccab53-service-ca\") pod \"console-84494cccd-snf2k\" (UID: \"4d3e0171-e6d1-4270-affb-7cca74ccab53\") " pod="openshift-console/console-84494cccd-snf2k"
Sep 20 00:53:43.993130 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:53:43.992992    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d3e0171-e6d1-4270-affb-7cca74ccab53-console-serving-cert\") pod \"console-84494cccd-snf2k\" (UID: \"4d3e0171-e6d1-4270-affb-7cca74ccab53\") " pod="openshift-console/console-84494cccd-snf2k"
Sep 20 00:53:43.993130 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:53:43.993025    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d3e0171-e6d1-4270-affb-7cca74ccab53-console-oauth-config\") pod \"console-84494cccd-snf2k\" (UID: \"4d3e0171-e6d1-4270-affb-7cca74ccab53\") " pod="openshift-console/console-84494cccd-snf2k"
Sep 20 00:53:44.094288 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:53:44.094242    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d3e0171-e6d1-4270-affb-7cca74ccab53-console-serving-cert\") pod \"console-84494cccd-snf2k\" (UID: \"4d3e0171-e6d1-4270-affb-7cca74ccab53\") " pod="openshift-console/console-84494cccd-snf2k"
Sep 20 00:53:44.094288 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:53:44.094287    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d3e0171-e6d1-4270-affb-7cca74ccab53-console-oauth-config\") pod \"console-84494cccd-snf2k\" (UID: \"4d3e0171-e6d1-4270-affb-7cca74ccab53\") " pod="openshift-console/console-84494cccd-snf2k"
Sep 20 00:53:44.094535 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:53:44.094347    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j94bp\" (UniqueName: \"kubernetes.io/projected/4d3e0171-e6d1-4270-affb-7cca74ccab53-kube-api-access-j94bp\") pod \"console-84494cccd-snf2k\" (UID: \"4d3e0171-e6d1-4270-affb-7cca74ccab53\") " pod="openshift-console/console-84494cccd-snf2k"
Sep 20 00:53:44.094535 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:53:44.094373    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d3e0171-e6d1-4270-affb-7cca74ccab53-oauth-serving-cert\") pod \"console-84494cccd-snf2k\" (UID: \"4d3e0171-e6d1-4270-affb-7cca74ccab53\") " pod="openshift-console/console-84494cccd-snf2k"
Sep 20 00:53:44.094535 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:53:44.094401    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d3e0171-e6d1-4270-affb-7cca74ccab53-trusted-ca-bundle\") pod \"console-84494cccd-snf2k\" (UID: \"4d3e0171-e6d1-4270-affb-7cca74ccab53\") " pod="openshift-console/console-84494cccd-snf2k"
Sep 20 00:53:44.094535 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:53:44.094433    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d3e0171-e6d1-4270-affb-7cca74ccab53-console-config\") pod \"console-84494cccd-snf2k\" (UID: \"4d3e0171-e6d1-4270-affb-7cca74ccab53\") " pod="openshift-console/console-84494cccd-snf2k"
Sep 20 00:53:44.094535 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:53:44.094468    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d3e0171-e6d1-4270-affb-7cca74ccab53-service-ca\") pod \"console-84494cccd-snf2k\" (UID: \"4d3e0171-e6d1-4270-affb-7cca74ccab53\") " pod="openshift-console/console-84494cccd-snf2k"
Sep 20 00:53:44.095324 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:53:44.095286    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d3e0171-e6d1-4270-affb-7cca74ccab53-trusted-ca-bundle\") pod \"console-84494cccd-snf2k\" (UID: \"4d3e0171-e6d1-4270-affb-7cca74ccab53\") " pod="openshift-console/console-84494cccd-snf2k"
Sep 20 00:53:44.095324 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:53:44.095298    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d3e0171-e6d1-4270-affb-7cca74ccab53-oauth-serving-cert\") pod \"console-84494cccd-snf2k\" (UID: \"4d3e0171-e6d1-4270-affb-7cca74ccab53\") " pod="openshift-console/console-84494cccd-snf2k"
Sep 20 00:53:44.095509 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:53:44.095298    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d3e0171-e6d1-4270-affb-7cca74ccab53-console-config\") pod \"console-84494cccd-snf2k\" (UID: \"4d3e0171-e6d1-4270-affb-7cca74ccab53\") " pod="openshift-console/console-84494cccd-snf2k"
Sep 20 00:53:44.095509 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:53:44.095370    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d3e0171-e6d1-4270-affb-7cca74ccab53-service-ca\") pod \"console-84494cccd-snf2k\" (UID: \"4d3e0171-e6d1-4270-affb-7cca74ccab53\") " pod="openshift-console/console-84494cccd-snf2k"
Sep 20 00:53:44.096967 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:53:44.096949    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d3e0171-e6d1-4270-affb-7cca74ccab53-console-serving-cert\") pod \"console-84494cccd-snf2k\" (UID: \"4d3e0171-e6d1-4270-affb-7cca74ccab53\") " pod="openshift-console/console-84494cccd-snf2k"
Sep 20 00:53:44.097056 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:53:44.097005    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d3e0171-e6d1-4270-affb-7cca74ccab53-console-oauth-config\") pod \"console-84494cccd-snf2k\" (UID: \"4d3e0171-e6d1-4270-affb-7cca74ccab53\") " pod="openshift-console/console-84494cccd-snf2k"
Sep 20 00:53:44.102226 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:53:44.102202    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j94bp\" (UniqueName: \"kubernetes.io/projected/4d3e0171-e6d1-4270-affb-7cca74ccab53-kube-api-access-j94bp\") pod \"console-84494cccd-snf2k\" (UID: \"4d3e0171-e6d1-4270-affb-7cca74ccab53\") " pod="openshift-console/console-84494cccd-snf2k"
Sep 20 00:53:44.272087 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:53:44.272000    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84494cccd-snf2k"
Sep 20 00:53:44.541796 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:53:44.541728    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84494cccd-snf2k"]
Sep 20 00:53:44.544116 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:53:44.544080    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d3e0171_e6d1_4270_affb_7cca74ccab53.slice/crio-959184e16577bab92f522a2c1c57b480f5b001529c5022131ba11205aa42b5d7 WatchSource:0}: Error finding container 959184e16577bab92f522a2c1c57b480f5b001529c5022131ba11205aa42b5d7: Status 404 returned error can't find the container with id 959184e16577bab92f522a2c1c57b480f5b001529c5022131ba11205aa42b5d7
Sep 20 00:53:45.157410 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:53:45.157368    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84494cccd-snf2k" event={"ID":"4d3e0171-e6d1-4270-affb-7cca74ccab53","Type":"ContainerStarted","Data":"56acbfbd8a7c79aeab2fd9eeca82ea4c3a172b649be3ab2f29ef5c3ab0337688"}
Sep 20 00:53:45.157780 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:53:45.157426    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84494cccd-snf2k" event={"ID":"4d3e0171-e6d1-4270-affb-7cca74ccab53","Type":"ContainerStarted","Data":"959184e16577bab92f522a2c1c57b480f5b001529c5022131ba11205aa42b5d7"}
Sep 20 00:53:45.174935 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:53:45.174884    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-84494cccd-snf2k" podStartSLOduration=2.174846009 podStartE2EDuration="2.174846009s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:53:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:53:45.173324889 +0000 UTC m=+361.787480796" watchObservedRunningTime="2026-09-20 00:53:45.174846009 +0000 UTC m=+361.789001907"
Sep 20 00:53:54.272953 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:53:54.272908    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-84494cccd-snf2k"
Sep 20 00:53:54.273351 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:53:54.272971    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84494cccd-snf2k"
Sep 20 00:53:54.277762 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:53:54.277739    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-84494cccd-snf2k"
Sep 20 00:53:55.203746 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:53:55.203716    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-84494cccd-snf2k"
Sep 20 00:53:55.248535 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:53:55.248499    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7569b6d66c-4j682"]
Sep 20 00:54:02.198923 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:02.198885    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-99bfbc77d-2gx5n"]
Sep 20 00:54:02.201691 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:02.201670    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-2gx5n"
Sep 20 00:54:02.206394 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:02.206365    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 20 00:54:02.206394 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:02.206381    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 20 00:54:02.206721 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:02.206700    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 20 00:54:02.207055 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:02.207028    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-wtnkv\""
Sep 20 00:54:02.207161 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:02.207067    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 20 00:54:02.223328 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:02.223296    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-99bfbc77d-2gx5n"]
Sep 20 00:54:02.247973 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:02.247928    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h9jd\" (UniqueName: \"kubernetes.io/projected/7cf96de0-7b50-4f1c-9b86-a31dd87210d1-kube-api-access-2h9jd\") pod \"opendatahub-operator-controller-manager-99bfbc77d-2gx5n\" (UID: \"7cf96de0-7b50-4f1c-9b86-a31dd87210d1\") " pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-2gx5n"
Sep 20 00:54:02.248138 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:02.247986    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7cf96de0-7b50-4f1c-9b86-a31dd87210d1-webhook-cert\") pod \"opendatahub-operator-controller-manager-99bfbc77d-2gx5n\" (UID: \"7cf96de0-7b50-4f1c-9b86-a31dd87210d1\") " pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-2gx5n"
Sep 20 00:54:02.248138 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:02.248055    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7cf96de0-7b50-4f1c-9b86-a31dd87210d1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-99bfbc77d-2gx5n\" (UID: \"7cf96de0-7b50-4f1c-9b86-a31dd87210d1\") " pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-2gx5n"
Sep 20 00:54:02.248138 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:02.248096    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7cf96de0-7b50-4f1c-9b86-a31dd87210d1-tmp\") pod \"opendatahub-operator-controller-manager-99bfbc77d-2gx5n\" (UID: \"7cf96de0-7b50-4f1c-9b86-a31dd87210d1\") " pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-2gx5n"
Sep 20 00:54:02.248138 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:02.248118    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7cf96de0-7b50-4f1c-9b86-a31dd87210d1-manifests\") pod \"opendatahub-operator-controller-manager-99bfbc77d-2gx5n\" (UID: \"7cf96de0-7b50-4f1c-9b86-a31dd87210d1\") " pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-2gx5n"
Sep 20 00:54:02.348735 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:02.348691    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h9jd\" (UniqueName: \"kubernetes.io/projected/7cf96de0-7b50-4f1c-9b86-a31dd87210d1-kube-api-access-2h9jd\") pod \"opendatahub-operator-controller-manager-99bfbc77d-2gx5n\" (UID: \"7cf96de0-7b50-4f1c-9b86-a31dd87210d1\") " pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-2gx5n"
Sep 20 00:54:02.348735 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:02.348742    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7cf96de0-7b50-4f1c-9b86-a31dd87210d1-webhook-cert\") pod \"opendatahub-operator-controller-manager-99bfbc77d-2gx5n\" (UID: \"7cf96de0-7b50-4f1c-9b86-a31dd87210d1\") " pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-2gx5n"
Sep 20 00:54:02.348974 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:02.348891    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7cf96de0-7b50-4f1c-9b86-a31dd87210d1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-99bfbc77d-2gx5n\" (UID: \"7cf96de0-7b50-4f1c-9b86-a31dd87210d1\") " pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-2gx5n"
Sep 20 00:54:02.348974 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:02.348939    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7cf96de0-7b50-4f1c-9b86-a31dd87210d1-tmp\") pod \"opendatahub-operator-controller-manager-99bfbc77d-2gx5n\" (UID: \"7cf96de0-7b50-4f1c-9b86-a31dd87210d1\") " pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-2gx5n"
Sep 20 00:54:02.349044 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:02.348975    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7cf96de0-7b50-4f1c-9b86-a31dd87210d1-manifests\") pod \"opendatahub-operator-controller-manager-99bfbc77d-2gx5n\" (UID: \"7cf96de0-7b50-4f1c-9b86-a31dd87210d1\") " pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-2gx5n"
Sep 20 00:54:02.349339 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:02.349320    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7cf96de0-7b50-4f1c-9b86-a31dd87210d1-manifests\") pod \"opendatahub-operator-controller-manager-99bfbc77d-2gx5n\" (UID: \"7cf96de0-7b50-4f1c-9b86-a31dd87210d1\") " pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-2gx5n"
Sep 20 00:54:02.351296 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:02.351259    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7cf96de0-7b50-4f1c-9b86-a31dd87210d1-tmp\") pod \"opendatahub-operator-controller-manager-99bfbc77d-2gx5n\" (UID: \"7cf96de0-7b50-4f1c-9b86-a31dd87210d1\") " pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-2gx5n"
Sep 20 00:54:02.351410 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:02.351330    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7cf96de0-7b50-4f1c-9b86-a31dd87210d1-webhook-cert\") pod \"opendatahub-operator-controller-manager-99bfbc77d-2gx5n\" (UID: \"7cf96de0-7b50-4f1c-9b86-a31dd87210d1\") " pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-2gx5n"
Sep 20 00:54:02.351484 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:02.351466    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7cf96de0-7b50-4f1c-9b86-a31dd87210d1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-99bfbc77d-2gx5n\" (UID: \"7cf96de0-7b50-4f1c-9b86-a31dd87210d1\") " pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-2gx5n"
Sep 20 00:54:02.374056 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:02.374030    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h9jd\" (UniqueName: \"kubernetes.io/projected/7cf96de0-7b50-4f1c-9b86-a31dd87210d1-kube-api-access-2h9jd\") pod \"opendatahub-operator-controller-manager-99bfbc77d-2gx5n\" (UID: \"7cf96de0-7b50-4f1c-9b86-a31dd87210d1\") " pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-2gx5n"
Sep 20 00:54:02.513229 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:02.513136    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-2gx5n"
Sep 20 00:54:02.792704 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:02.792630    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-99bfbc77d-2gx5n"]
Sep 20 00:54:02.796247 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:54:02.796209    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cf96de0_7b50_4f1c_9b86_a31dd87210d1.slice/crio-03e139c8bb7a90e8f59d2f933543f01132f11c62f4dca8f1ef4966b5e8f361f6 WatchSource:0}: Error finding container 03e139c8bb7a90e8f59d2f933543f01132f11c62f4dca8f1ef4966b5e8f361f6: Status 404 returned error can't find the container with id 03e139c8bb7a90e8f59d2f933543f01132f11c62f4dca8f1ef4966b5e8f361f6
Sep 20 00:54:02.798095 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:02.798077    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 20 00:54:03.238969 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:03.238930    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-2gx5n" event={"ID":"7cf96de0-7b50-4f1c-9b86-a31dd87210d1","Type":"ContainerStarted","Data":"03e139c8bb7a90e8f59d2f933543f01132f11c62f4dca8f1ef4966b5e8f361f6"}
Sep 20 00:54:06.257402 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:06.257301    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-2gx5n" event={"ID":"7cf96de0-7b50-4f1c-9b86-a31dd87210d1","Type":"ContainerStarted","Data":"39e06ce33cdbb410c8d5f03f5f8aec8fda868a8fd5989dc2e0f555b85346e4d5"}
Sep 20 00:54:07.263444 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:07.263409    2570 generic.go:356] "Generic (PLEG): container finished" podID="7cf96de0-7b50-4f1c-9b86-a31dd87210d1" containerID="39e06ce33cdbb410c8d5f03f5f8aec8fda868a8fd5989dc2e0f555b85346e4d5" exitCode=0
Sep 20 00:54:07.263835 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:07.263495    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-2gx5n" event={"ID":"7cf96de0-7b50-4f1c-9b86-a31dd87210d1","Type":"ContainerDied","Data":"39e06ce33cdbb410c8d5f03f5f8aec8fda868a8fd5989dc2e0f555b85346e4d5"}
Sep 20 00:54:08.270014 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:08.269974    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-2gx5n" event={"ID":"7cf96de0-7b50-4f1c-9b86-a31dd87210d1","Type":"ContainerStarted","Data":"9574a53c2ad483b8f6c063303eb0eec939538ba3afdb42c9d194efc1d4d22bfb"}
Sep 20 00:54:08.270414 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:08.270093    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-2gx5n"
Sep 20 00:54:08.298174 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:08.298109    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-2gx5n" podStartSLOduration=1.832034841 podStartE2EDuration="6.298086563s" totalImagesPullingTime="3.403098648s" totalInitContainerRuntime="1.062953074s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:54:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:54:08.29680405 +0000 UTC m=+384.910959971" watchObservedRunningTime="2026-09-20 00:54:08.298086563 +0000 UTC m=+384.912242461"
Sep 20 00:54:19.277783 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:19.277745    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-99bfbc77d-2gx5n"
Sep 20 00:54:20.268679 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:20.268621    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7569b6d66c-4j682" podUID="f381c9d5-fa45-4451-9a6f-379aa7001e81" containerName="console" containerID="cri-o://e3402ff90529f4680559cc1d7e946cf463a77c735b6e8bb25bab05a9708933d2" gracePeriod=15
Sep 20 00:54:20.507261 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:20.507235    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7569b6d66c-4j682"
Sep 20 00:54:20.614910 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:20.614803    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f381c9d5-fa45-4451-9a6f-379aa7001e81-service-ca\") pod \"f381c9d5-fa45-4451-9a6f-379aa7001e81\" (UID: \"f381c9d5-fa45-4451-9a6f-379aa7001e81\") "
Sep 20 00:54:20.614910 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:20.614893    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cxrpw\" (UniqueName: \"kubernetes.io/projected/f381c9d5-fa45-4451-9a6f-379aa7001e81-kube-api-access-cxrpw\") pod \"f381c9d5-fa45-4451-9a6f-379aa7001e81\" (UID: \"f381c9d5-fa45-4451-9a6f-379aa7001e81\") "
Sep 20 00:54:20.615152 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:20.614935    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f381c9d5-fa45-4451-9a6f-379aa7001e81-trusted-ca-bundle\") pod \"f381c9d5-fa45-4451-9a6f-379aa7001e81\" (UID: \"f381c9d5-fa45-4451-9a6f-379aa7001e81\") "
Sep 20 00:54:20.615152 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:20.614957    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f381c9d5-fa45-4451-9a6f-379aa7001e81-console-oauth-config\") pod \"f381c9d5-fa45-4451-9a6f-379aa7001e81\" (UID: \"f381c9d5-fa45-4451-9a6f-379aa7001e81\") "
Sep 20 00:54:20.615152 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:20.615013    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f381c9d5-fa45-4451-9a6f-379aa7001e81-oauth-serving-cert\") pod \"f381c9d5-fa45-4451-9a6f-379aa7001e81\" (UID: \"f381c9d5-fa45-4451-9a6f-379aa7001e81\") "
Sep 20 00:54:20.615152 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:20.615139    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f381c9d5-fa45-4451-9a6f-379aa7001e81-console-config\") pod \"f381c9d5-fa45-4451-9a6f-379aa7001e81\" (UID: \"f381c9d5-fa45-4451-9a6f-379aa7001e81\") "
Sep 20 00:54:20.615371 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:20.615191    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f381c9d5-fa45-4451-9a6f-379aa7001e81-console-serving-cert\") pod \"f381c9d5-fa45-4451-9a6f-379aa7001e81\" (UID: \"f381c9d5-fa45-4451-9a6f-379aa7001e81\") "
Sep 20 00:54:20.615371 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:20.615201    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f381c9d5-fa45-4451-9a6f-379aa7001e81-service-ca" (OuterVolumeSpecName: "service-ca") pod "f381c9d5-fa45-4451-9a6f-379aa7001e81" (UID: "f381c9d5-fa45-4451-9a6f-379aa7001e81"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 00:54:20.615466 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:20.615408    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f381c9d5-fa45-4451-9a6f-379aa7001e81-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f381c9d5-fa45-4451-9a6f-379aa7001e81" (UID: "f381c9d5-fa45-4451-9a6f-379aa7001e81"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 00:54:20.615466 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:20.615426    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f381c9d5-fa45-4451-9a6f-379aa7001e81-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f381c9d5-fa45-4451-9a6f-379aa7001e81" (UID: "f381c9d5-fa45-4451-9a6f-379aa7001e81"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 00:54:20.615564 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:20.615483    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f381c9d5-fa45-4451-9a6f-379aa7001e81-console-config" (OuterVolumeSpecName: "console-config") pod "f381c9d5-fa45-4451-9a6f-379aa7001e81" (UID: "f381c9d5-fa45-4451-9a6f-379aa7001e81"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 00:54:20.615564 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:20.615503    2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f381c9d5-fa45-4451-9a6f-379aa7001e81-service-ca\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 00:54:20.615564 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:20.615518    2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f381c9d5-fa45-4451-9a6f-379aa7001e81-trusted-ca-bundle\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 00:54:20.615564 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:20.615528    2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f381c9d5-fa45-4451-9a6f-379aa7001e81-oauth-serving-cert\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 00:54:20.617348 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:20.617324    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f381c9d5-fa45-4451-9a6f-379aa7001e81-kube-api-access-cxrpw" (OuterVolumeSpecName: "kube-api-access-cxrpw") pod "f381c9d5-fa45-4451-9a6f-379aa7001e81" (UID: "f381c9d5-fa45-4451-9a6f-379aa7001e81"). InnerVolumeSpecName "kube-api-access-cxrpw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 00:54:20.617348 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:20.617334    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f381c9d5-fa45-4451-9a6f-379aa7001e81-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f381c9d5-fa45-4451-9a6f-379aa7001e81" (UID: "f381c9d5-fa45-4451-9a6f-379aa7001e81"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 00:54:20.617522 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:20.617350    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f381c9d5-fa45-4451-9a6f-379aa7001e81-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f381c9d5-fa45-4451-9a6f-379aa7001e81" (UID: "f381c9d5-fa45-4451-9a6f-379aa7001e81"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 00:54:20.716948 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:20.716912    2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f381c9d5-fa45-4451-9a6f-379aa7001e81-console-config\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 00:54:20.716948 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:20.716941    2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f381c9d5-fa45-4451-9a6f-379aa7001e81-console-serving-cert\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 00:54:20.716948 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:20.716952    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cxrpw\" (UniqueName: \"kubernetes.io/projected/f381c9d5-fa45-4451-9a6f-379aa7001e81-kube-api-access-cxrpw\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 00:54:20.717174 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:20.716962    2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f381c9d5-fa45-4451-9a6f-379aa7001e81-console-oauth-config\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 00:54:21.328633 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:21.328592    2570 generic.go:356] "Generic (PLEG): container finished" podID="f381c9d5-fa45-4451-9a6f-379aa7001e81" containerID="e3402ff90529f4680559cc1d7e946cf463a77c735b6e8bb25bab05a9708933d2" exitCode=0
Sep 20 00:54:21.328789 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:21.328646    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7569b6d66c-4j682"
Sep 20 00:54:21.328789 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:21.328682    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7569b6d66c-4j682" event={"ID":"f381c9d5-fa45-4451-9a6f-379aa7001e81","Type":"ContainerDied","Data":"e3402ff90529f4680559cc1d7e946cf463a77c735b6e8bb25bab05a9708933d2"}
Sep 20 00:54:21.328789 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:21.328737    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7569b6d66c-4j682" event={"ID":"f381c9d5-fa45-4451-9a6f-379aa7001e81","Type":"ContainerDied","Data":"140ca9c3c8160fbbcd7a3bca8ad425e9b5b6cddd6be0050028de859a91ab3ca0"}
Sep 20 00:54:21.328789 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:21.328763    2570 scope.go:117] "RemoveContainer" containerID="e3402ff90529f4680559cc1d7e946cf463a77c735b6e8bb25bab05a9708933d2"
Sep 20 00:54:21.337463 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:21.337443    2570 scope.go:117] "RemoveContainer" containerID="e3402ff90529f4680559cc1d7e946cf463a77c735b6e8bb25bab05a9708933d2"
Sep 20 00:54:21.337742 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:54:21.337726    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3402ff90529f4680559cc1d7e946cf463a77c735b6e8bb25bab05a9708933d2\": container with ID starting with e3402ff90529f4680559cc1d7e946cf463a77c735b6e8bb25bab05a9708933d2 not found: ID does not exist" containerID="e3402ff90529f4680559cc1d7e946cf463a77c735b6e8bb25bab05a9708933d2"
Sep 20 00:54:21.337792 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:21.337748    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3402ff90529f4680559cc1d7e946cf463a77c735b6e8bb25bab05a9708933d2"} err="failed to get container status \"e3402ff90529f4680559cc1d7e946cf463a77c735b6e8bb25bab05a9708933d2\": rpc error: code = NotFound desc = could not find container \"e3402ff90529f4680559cc1d7e946cf463a77c735b6e8bb25bab05a9708933d2\": container with ID starting with e3402ff90529f4680559cc1d7e946cf463a77c735b6e8bb25bab05a9708933d2 not found: ID does not exist"
Sep 20 00:54:21.375560 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:21.375521    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7569b6d66c-4j682"]
Sep 20 00:54:21.391551 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:21.391517    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7569b6d66c-4j682"]
Sep 20 00:54:21.453037 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:21.453004    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f381c9d5-fa45-4451-9a6f-379aa7001e81" path="/var/lib/kubelet/pods/f381c9d5-fa45-4451-9a6f-379aa7001e81/volumes"
Sep 20 00:54:28.239456 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:28.239420    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5hffd"]
Sep 20 00:54:28.239930 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:28.239742    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f381c9d5-fa45-4451-9a6f-379aa7001e81" containerName="console"
Sep 20 00:54:28.239930 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:28.239753    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="f381c9d5-fa45-4451-9a6f-379aa7001e81" containerName="console"
Sep 20 00:54:28.239930 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:28.239824    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="f381c9d5-fa45-4451-9a6f-379aa7001e81" containerName="console"
Sep 20 00:54:28.242814 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:28.242796    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5hffd"
Sep 20 00:54:28.244982 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:28.244942    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 20 00:54:28.245116 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:28.245095    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 20 00:54:28.245190 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:28.245096    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-b9ch7\""
Sep 20 00:54:28.245190 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:28.245103    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 20 00:54:28.254331 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:28.254309    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5hffd"]
Sep 20 00:54:28.387142 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:28.387110    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e3fabcde-10b5-4503-b7f1-fc0904b1447f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c5hffd\" (UID: \"e3fabcde-10b5-4503-b7f1-fc0904b1447f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5hffd"
Sep 20 00:54:28.387349 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:28.387151    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46fr4\" (UniqueName: \"kubernetes.io/projected/e3fabcde-10b5-4503-b7f1-fc0904b1447f-kube-api-access-46fr4\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c5hffd\" (UID: \"e3fabcde-10b5-4503-b7f1-fc0904b1447f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5hffd"
Sep 20 00:54:28.387349 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:28.387188    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3fabcde-10b5-4503-b7f1-fc0904b1447f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c5hffd\" (UID: \"e3fabcde-10b5-4503-b7f1-fc0904b1447f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5hffd"
Sep 20 00:54:28.387349 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:28.387263    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3fabcde-10b5-4503-b7f1-fc0904b1447f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c5hffd\" (UID: \"e3fabcde-10b5-4503-b7f1-fc0904b1447f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5hffd"
Sep 20 00:54:28.387349 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:28.387321    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e3fabcde-10b5-4503-b7f1-fc0904b1447f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c5hffd\" (UID: \"e3fabcde-10b5-4503-b7f1-fc0904b1447f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5hffd"
Sep 20 00:54:28.387349 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:28.387346    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e3fabcde-10b5-4503-b7f1-fc0904b1447f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c5hffd\" (UID: \"e3fabcde-10b5-4503-b7f1-fc0904b1447f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5hffd"
Sep 20 00:54:28.387544 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:28.387380    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3fabcde-10b5-4503-b7f1-fc0904b1447f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c5hffd\" (UID: \"e3fabcde-10b5-4503-b7f1-fc0904b1447f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5hffd"
Sep 20 00:54:28.387544 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:28.387411    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e3fabcde-10b5-4503-b7f1-fc0904b1447f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c5hffd\" (UID: \"e3fabcde-10b5-4503-b7f1-fc0904b1447f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5hffd"
Sep 20 00:54:28.387544 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:28.387449    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3fabcde-10b5-4503-b7f1-fc0904b1447f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c5hffd\" (UID: \"e3fabcde-10b5-4503-b7f1-fc0904b1447f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5hffd"
Sep 20 00:54:28.487932 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:28.487896    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3fabcde-10b5-4503-b7f1-fc0904b1447f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c5hffd\" (UID: \"e3fabcde-10b5-4503-b7f1-fc0904b1447f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5hffd"
Sep 20 00:54:28.487932 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:28.487937    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3fabcde-10b5-4503-b7f1-fc0904b1447f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c5hffd\" (UID: \"e3fabcde-10b5-4503-b7f1-fc0904b1447f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5hffd"
Sep 20 00:54:28.488156 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:28.487973    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e3fabcde-10b5-4503-b7f1-fc0904b1447f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c5hffd\" (UID: \"e3fabcde-10b5-4503-b7f1-fc0904b1447f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5hffd"
Sep 20 00:54:28.488156 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:28.487990    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e3fabcde-10b5-4503-b7f1-fc0904b1447f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c5hffd\" (UID: \"e3fabcde-10b5-4503-b7f1-fc0904b1447f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5hffd"
Sep 20 00:54:28.488156 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:28.488008    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3fabcde-10b5-4503-b7f1-fc0904b1447f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c5hffd\" (UID: \"e3fabcde-10b5-4503-b7f1-fc0904b1447f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5hffd"
Sep 20 00:54:28.488300 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:28.488182    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e3fabcde-10b5-4503-b7f1-fc0904b1447f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c5hffd\" (UID: \"e3fabcde-10b5-4503-b7f1-fc0904b1447f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5hffd"
Sep 20 00:54:28.488300 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:28.488268    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3fabcde-10b5-4503-b7f1-fc0904b1447f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c5hffd\" (UID: \"e3fabcde-10b5-4503-b7f1-fc0904b1447f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5hffd"
Sep 20 00:54:28.488405 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:28.488320    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3fabcde-10b5-4503-b7f1-fc0904b1447f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c5hffd\" (UID: \"e3fabcde-10b5-4503-b7f1-fc0904b1447f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5hffd"
Sep 20 00:54:28.488405 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:28.488335    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e3fabcde-10b5-4503-b7f1-fc0904b1447f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c5hffd\" (UID: \"e3fabcde-10b5-4503-b7f1-fc0904b1447f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5hffd"
Sep 20 00:54:28.488405 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:28.488383    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46fr4\" (UniqueName: \"kubernetes.io/projected/e3fabcde-10b5-4503-b7f1-fc0904b1447f-kube-api-access-46fr4\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c5hffd\" (UID: \"e3fabcde-10b5-4503-b7f1-fc0904b1447f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5hffd"
Sep 20 00:54:28.488567 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:28.488385    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3fabcde-10b5-4503-b7f1-fc0904b1447f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c5hffd\" (UID: \"e3fabcde-10b5-4503-b7f1-fc0904b1447f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5hffd"
Sep 20 00:54:28.488687 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:28.488665    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3fabcde-10b5-4503-b7f1-fc0904b1447f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c5hffd\" (UID: \"e3fabcde-10b5-4503-b7f1-fc0904b1447f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5hffd"
Sep 20 00:54:28.488745 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:28.488660    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e3fabcde-10b5-4503-b7f1-fc0904b1447f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c5hffd\" (UID: \"e3fabcde-10b5-4503-b7f1-fc0904b1447f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5hffd"
Sep 20 00:54:28.488790 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:28.488759    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e3fabcde-10b5-4503-b7f1-fc0904b1447f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c5hffd\" (UID: \"e3fabcde-10b5-4503-b7f1-fc0904b1447f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5hffd"
Sep 20 00:54:28.490600 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:28.490540    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e3fabcde-10b5-4503-b7f1-fc0904b1447f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c5hffd\" (UID: \"e3fabcde-10b5-4503-b7f1-fc0904b1447f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5hffd"
Sep 20 00:54:28.490699 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:28.490681    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e3fabcde-10b5-4503-b7f1-fc0904b1447f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c5hffd\" (UID: \"e3fabcde-10b5-4503-b7f1-fc0904b1447f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5hffd"
Sep 20 00:54:28.497038 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:28.497013    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3fabcde-10b5-4503-b7f1-fc0904b1447f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c5hffd\" (UID: \"e3fabcde-10b5-4503-b7f1-fc0904b1447f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5hffd"
Sep 20 00:54:28.497244 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:28.497222    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46fr4\" (UniqueName: \"kubernetes.io/projected/e3fabcde-10b5-4503-b7f1-fc0904b1447f-kube-api-access-46fr4\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c5hffd\" (UID: \"e3fabcde-10b5-4503-b7f1-fc0904b1447f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5hffd"
Sep 20 00:54:28.553544 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:28.553510    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5hffd"
Sep 20 00:54:28.827383 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:28.827162    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5hffd"]
Sep 20 00:54:28.830047 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:54:28.830020    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3fabcde_10b5_4503_b7f1_fc0904b1447f.slice/crio-219ced151bed75f9a2987bb964b881f00122e5255e6a7d323ddc622f2e46e2ac WatchSource:0}: Error finding container 219ced151bed75f9a2987bb964b881f00122e5255e6a7d323ddc622f2e46e2ac: Status 404 returned error can't find the container with id 219ced151bed75f9a2987bb964b881f00122e5255e6a7d323ddc622f2e46e2ac
Sep 20 00:54:29.367308 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:29.367272    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5hffd" event={"ID":"e3fabcde-10b5-4503-b7f1-fc0904b1447f","Type":"ContainerStarted","Data":"219ced151bed75f9a2987bb964b881f00122e5255e6a7d323ddc622f2e46e2ac"}
Sep 20 00:54:31.718528 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:31.718487    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 00:54:31.718911 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:31.718601    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 00:54:31.718911 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:31.718665    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 00:54:32.387625 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:32.387587    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5hffd" event={"ID":"e3fabcde-10b5-4503-b7f1-fc0904b1447f","Type":"ContainerStarted","Data":"fb840da6ed4753d9fbcda5e1ee9eb3083d5621c8c4f8567e8597b30103ab46ae"}
Sep 20 00:54:32.395777 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:32.395750    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-hq79w"]
Sep 20 00:54:32.399092 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:32.399077    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-hq79w"
Sep 20 00:54:32.402236 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:32.402211    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 20 00:54:32.402334 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:32.402225    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-tpf5n\""
Sep 20 00:54:32.410215 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:32.410189    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-hq79w"]
Sep 20 00:54:32.424148 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:32.424118    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pfwg\" (UniqueName: \"kubernetes.io/projected/0ed3197a-8774-4834-804c-f5801f51efc3-kube-api-access-8pfwg\") pod \"odh-model-controller-7998c67dc4-hq79w\" (UID: \"0ed3197a-8774-4834-804c-f5801f51efc3\") " pod="opendatahub/odh-model-controller-7998c67dc4-hq79w"
Sep 20 00:54:32.424276 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:32.424182    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0ed3197a-8774-4834-804c-f5801f51efc3-cert\") pod \"odh-model-controller-7998c67dc4-hq79w\" (UID: \"0ed3197a-8774-4834-804c-f5801f51efc3\") " pod="opendatahub/odh-model-controller-7998c67dc4-hq79w"
Sep 20 00:54:32.433954 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:32.433896    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5hffd" podStartSLOduration=1.547720993 podStartE2EDuration="4.43387902s" totalImagesPullingTime="2.886158027s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:54:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:54:32.432077509 +0000 UTC m=+409.046233426" watchObservedRunningTime="2026-09-20 00:54:32.43387902 +0000 UTC m=+409.048034918"
Sep 20 00:54:32.525337 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:32.525292    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pfwg\" (UniqueName: \"kubernetes.io/projected/0ed3197a-8774-4834-804c-f5801f51efc3-kube-api-access-8pfwg\") pod \"odh-model-controller-7998c67dc4-hq79w\" (UID: \"0ed3197a-8774-4834-804c-f5801f51efc3\") " pod="opendatahub/odh-model-controller-7998c67dc4-hq79w"
Sep 20 00:54:32.525502 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:32.525372    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0ed3197a-8774-4834-804c-f5801f51efc3-cert\") pod \"odh-model-controller-7998c67dc4-hq79w\" (UID: \"0ed3197a-8774-4834-804c-f5801f51efc3\") " pod="opendatahub/odh-model-controller-7998c67dc4-hq79w"
Sep 20 00:54:32.525541 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:54:32.525520    2570 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 20 00:54:32.525594 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:54:32.525584    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ed3197a-8774-4834-804c-f5801f51efc3-cert podName:0ed3197a-8774-4834-804c-f5801f51efc3 nodeName:}" failed. No retries permitted until 2026-09-20 00:54:33.025565274 +0000 UTC m=+409.639721149 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0ed3197a-8774-4834-804c-f5801f51efc3-cert") pod "odh-model-controller-7998c67dc4-hq79w" (UID: "0ed3197a-8774-4834-804c-f5801f51efc3") : secret "odh-model-controller-webhook-cert" not found
Sep 20 00:54:32.533849 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:32.533825    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pfwg\" (UniqueName: \"kubernetes.io/projected/0ed3197a-8774-4834-804c-f5801f51efc3-kube-api-access-8pfwg\") pod \"odh-model-controller-7998c67dc4-hq79w\" (UID: \"0ed3197a-8774-4834-804c-f5801f51efc3\") " pod="opendatahub/odh-model-controller-7998c67dc4-hq79w"
Sep 20 00:54:32.554275 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:32.554241    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5hffd"
Sep 20 00:54:32.558709 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:32.558684    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5hffd"
Sep 20 00:54:33.017783 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:33.017752    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-z9sjt"]
Sep 20 00:54:33.021281 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:33.021262    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-z9sjt"
Sep 20 00:54:33.023546 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:33.023523    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 20 00:54:33.023657 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:33.023526    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-grvsb\""
Sep 20 00:54:33.029059 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:33.029034    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6q9l\" (UniqueName: \"kubernetes.io/projected/5b08a46b-ee88-4021-ab05-fdcb2d511a7e-kube-api-access-t6q9l\") pod \"model-serving-api-54d89bd5fc-z9sjt\" (UID: \"5b08a46b-ee88-4021-ab05-fdcb2d511a7e\") " pod="opendatahub/model-serving-api-54d89bd5fc-z9sjt"
Sep 20 00:54:33.029208 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:33.029072    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b08a46b-ee88-4021-ab05-fdcb2d511a7e-tls-certs\") pod \"model-serving-api-54d89bd5fc-z9sjt\" (UID: \"5b08a46b-ee88-4021-ab05-fdcb2d511a7e\") " pod="opendatahub/model-serving-api-54d89bd5fc-z9sjt"
Sep 20 00:54:33.029208 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:33.029108    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0ed3197a-8774-4834-804c-f5801f51efc3-cert\") pod \"odh-model-controller-7998c67dc4-hq79w\" (UID: \"0ed3197a-8774-4834-804c-f5801f51efc3\") " pod="opendatahub/odh-model-controller-7998c67dc4-hq79w"
Sep 20 00:54:33.032305 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:33.032276    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0ed3197a-8774-4834-804c-f5801f51efc3-cert\") pod \"odh-model-controller-7998c67dc4-hq79w\" (UID: \"0ed3197a-8774-4834-804c-f5801f51efc3\") " pod="opendatahub/odh-model-controller-7998c67dc4-hq79w"
Sep 20 00:54:33.032407 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:33.032313    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-z9sjt"]
Sep 20 00:54:33.130122 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:33.130088    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6q9l\" (UniqueName: \"kubernetes.io/projected/5b08a46b-ee88-4021-ab05-fdcb2d511a7e-kube-api-access-t6q9l\") pod \"model-serving-api-54d89bd5fc-z9sjt\" (UID: \"5b08a46b-ee88-4021-ab05-fdcb2d511a7e\") " pod="opendatahub/model-serving-api-54d89bd5fc-z9sjt"
Sep 20 00:54:33.130122 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:33.130127    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b08a46b-ee88-4021-ab05-fdcb2d511a7e-tls-certs\") pod \"model-serving-api-54d89bd5fc-z9sjt\" (UID: \"5b08a46b-ee88-4021-ab05-fdcb2d511a7e\") " pod="opendatahub/model-serving-api-54d89bd5fc-z9sjt"
Sep 20 00:54:33.130359 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:54:33.130252    2570 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Sep 20 00:54:33.130359 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:54:33.130316    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b08a46b-ee88-4021-ab05-fdcb2d511a7e-tls-certs podName:5b08a46b-ee88-4021-ab05-fdcb2d511a7e nodeName:}" failed. No retries permitted until 2026-09-20 00:54:33.630297604 +0000 UTC m=+410.244453478 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/5b08a46b-ee88-4021-ab05-fdcb2d511a7e-tls-certs") pod "model-serving-api-54d89bd5fc-z9sjt" (UID: "5b08a46b-ee88-4021-ab05-fdcb2d511a7e") : secret "model-serving-api-tls" not found
Sep 20 00:54:33.141171 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:33.141134    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6q9l\" (UniqueName: \"kubernetes.io/projected/5b08a46b-ee88-4021-ab05-fdcb2d511a7e-kube-api-access-t6q9l\") pod \"model-serving-api-54d89bd5fc-z9sjt\" (UID: \"5b08a46b-ee88-4021-ab05-fdcb2d511a7e\") " pod="opendatahub/model-serving-api-54d89bd5fc-z9sjt"
Sep 20 00:54:33.309357 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:33.309270    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-hq79w"
Sep 20 00:54:33.393014 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:33.392984    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5hffd"
Sep 20 00:54:33.394242 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:33.394224    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5hffd"
Sep 20 00:54:33.586246 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:33.586166    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-hq79w"]
Sep 20 00:54:33.590240 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:54:33.590213    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ed3197a_8774_4834_804c_f5801f51efc3.slice/crio-8d951ef3667027f3c077edb81acaef76160c461f0dd9f8df3ffa6bf821d58ea9 WatchSource:0}: Error finding container 8d951ef3667027f3c077edb81acaef76160c461f0dd9f8df3ffa6bf821d58ea9: Status 404 returned error can't find the container with id 8d951ef3667027f3c077edb81acaef76160c461f0dd9f8df3ffa6bf821d58ea9
Sep 20 00:54:33.634315 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:33.634272    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b08a46b-ee88-4021-ab05-fdcb2d511a7e-tls-certs\") pod \"model-serving-api-54d89bd5fc-z9sjt\" (UID: \"5b08a46b-ee88-4021-ab05-fdcb2d511a7e\") " pod="opendatahub/model-serving-api-54d89bd5fc-z9sjt"
Sep 20 00:54:33.634487 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:54:33.634421    2570 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Sep 20 00:54:33.634528 ip-10-0-132-108 kubenswrapper[2570]: E0920 00:54:33.634490    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b08a46b-ee88-4021-ab05-fdcb2d511a7e-tls-certs podName:5b08a46b-ee88-4021-ab05-fdcb2d511a7e nodeName:}" failed. No retries permitted until 2026-09-20 00:54:34.634471906 +0000 UTC m=+411.248627798 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/5b08a46b-ee88-4021-ab05-fdcb2d511a7e-tls-certs") pod "model-serving-api-54d89bd5fc-z9sjt" (UID: "5b08a46b-ee88-4021-ab05-fdcb2d511a7e") : secret "model-serving-api-tls" not found
Sep 20 00:54:34.397921 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:34.397883    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-hq79w" event={"ID":"0ed3197a-8774-4834-804c-f5801f51efc3","Type":"ContainerStarted","Data":"8d951ef3667027f3c077edb81acaef76160c461f0dd9f8df3ffa6bf821d58ea9"}
Sep 20 00:54:34.644382 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:34.643907    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b08a46b-ee88-4021-ab05-fdcb2d511a7e-tls-certs\") pod \"model-serving-api-54d89bd5fc-z9sjt\" (UID: \"5b08a46b-ee88-4021-ab05-fdcb2d511a7e\") " pod="opendatahub/model-serving-api-54d89bd5fc-z9sjt"
Sep 20 00:54:34.653806 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:34.653353    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b08a46b-ee88-4021-ab05-fdcb2d511a7e-tls-certs\") pod \"model-serving-api-54d89bd5fc-z9sjt\" (UID: \"5b08a46b-ee88-4021-ab05-fdcb2d511a7e\") " pod="opendatahub/model-serving-api-54d89bd5fc-z9sjt"
Sep 20 00:54:34.832855 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:34.832813    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-z9sjt"
Sep 20 00:54:35.115304 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:35.115270    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-z9sjt"]
Sep 20 00:54:35.117708 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:54:35.117672    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b08a46b_ee88_4021_ab05_fdcb2d511a7e.slice/crio-94bc11010e5302c006a897027c86647c51ac6bc6d28a724646ca1a677e69b91d WatchSource:0}: Error finding container 94bc11010e5302c006a897027c86647c51ac6bc6d28a724646ca1a677e69b91d: Status 404 returned error can't find the container with id 94bc11010e5302c006a897027c86647c51ac6bc6d28a724646ca1a677e69b91d
Sep 20 00:54:35.405103 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:35.405063    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-z9sjt" event={"ID":"5b08a46b-ee88-4021-ab05-fdcb2d511a7e","Type":"ContainerStarted","Data":"94bc11010e5302c006a897027c86647c51ac6bc6d28a724646ca1a677e69b91d"}
Sep 20 00:54:37.416621 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:37.416577    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-hq79w" event={"ID":"0ed3197a-8774-4834-804c-f5801f51efc3","Type":"ContainerStarted","Data":"effb266258ec6078fa83fa842547cc91967bef2706decaa5aecb7df7baebb444"}
Sep 20 00:54:37.417084 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:37.416677    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-hq79w"
Sep 20 00:54:37.434829 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:37.434781    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-hq79w" podStartSLOduration=2.417179727 podStartE2EDuration="5.434765508s" totalImagesPullingTime="3.017585781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:54:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:54:37.433787005 +0000 UTC m=+414.047942923" watchObservedRunningTime="2026-09-20 00:54:37.434765508 +0000 UTC m=+414.048921407"
Sep 20 00:54:38.654667 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:38.654630    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-mhxvq"]
Sep 20 00:54:38.658004 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:38.657988    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mhxvq"
Sep 20 00:54:38.660161 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:38.660141    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 20 00:54:38.660320 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:38.660268    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 20 00:54:38.660320 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:38.660284    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-w4chb\""
Sep 20 00:54:38.660501 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:38.660480    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 20 00:54:38.669573 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:38.669549    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-mhxvq"]
Sep 20 00:54:38.688386 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:38.688355    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/236875ba-bff6-4596-b571-d694d3f72371-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-mhxvq\" (UID: \"236875ba-bff6-4596-b571-d694d3f72371\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mhxvq"
Sep 20 00:54:38.688513 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:38.688395    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/236875ba-bff6-4596-b571-d694d3f72371-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-mhxvq\" (UID: \"236875ba-bff6-4596-b571-d694d3f72371\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mhxvq"
Sep 20 00:54:38.688513 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:38.688413    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/236875ba-bff6-4596-b571-d694d3f72371-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-mhxvq\" (UID: \"236875ba-bff6-4596-b571-d694d3f72371\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mhxvq"
Sep 20 00:54:38.688513 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:38.688446    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sg85\" (UniqueName: \"kubernetes.io/projected/236875ba-bff6-4596-b571-d694d3f72371-kube-api-access-4sg85\") pod \"istiod-openshift-gateway-5677ccb49b-mhxvq\" (UID: \"236875ba-bff6-4596-b571-d694d3f72371\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mhxvq"
Sep 20 00:54:38.688665 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:38.688536    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/236875ba-bff6-4596-b571-d694d3f72371-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-mhxvq\" (UID: \"236875ba-bff6-4596-b571-d694d3f72371\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mhxvq"
Sep 20 00:54:38.688665 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:38.688562    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/236875ba-bff6-4596-b571-d694d3f72371-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-mhxvq\" (UID: \"236875ba-bff6-4596-b571-d694d3f72371\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mhxvq"
Sep 20 00:54:38.688665 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:38.688610    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/236875ba-bff6-4596-b571-d694d3f72371-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-mhxvq\" (UID: \"236875ba-bff6-4596-b571-d694d3f72371\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mhxvq"
Sep 20 00:54:38.790023 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:38.789935    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/236875ba-bff6-4596-b571-d694d3f72371-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-mhxvq\" (UID: \"236875ba-bff6-4596-b571-d694d3f72371\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mhxvq"
Sep 20 00:54:38.790023 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:38.790000    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/236875ba-bff6-4596-b571-d694d3f72371-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-mhxvq\" (UID: \"236875ba-bff6-4596-b571-d694d3f72371\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mhxvq"
Sep 20 00:54:38.790249 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:38.790053    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/236875ba-bff6-4596-b571-d694d3f72371-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-mhxvq\" (UID: \"236875ba-bff6-4596-b571-d694d3f72371\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mhxvq"
Sep 20 00:54:38.790249 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:38.790096    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/236875ba-bff6-4596-b571-d694d3f72371-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-mhxvq\" (UID: \"236875ba-bff6-4596-b571-d694d3f72371\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mhxvq"
Sep 20 00:54:38.790249 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:38.790126    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/236875ba-bff6-4596-b571-d694d3f72371-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-mhxvq\" (UID: \"236875ba-bff6-4596-b571-d694d3f72371\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mhxvq"
Sep 20 00:54:38.790249 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:38.790148    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/236875ba-bff6-4596-b571-d694d3f72371-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-mhxvq\" (UID: \"236875ba-bff6-4596-b571-d694d3f72371\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mhxvq"
Sep 20 00:54:38.790249 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:38.790172    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sg85\" (UniqueName: \"kubernetes.io/projected/236875ba-bff6-4596-b571-d694d3f72371-kube-api-access-4sg85\") pod \"istiod-openshift-gateway-5677ccb49b-mhxvq\" (UID: \"236875ba-bff6-4596-b571-d694d3f72371\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mhxvq"
Sep 20 00:54:38.790882 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:38.790774    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/236875ba-bff6-4596-b571-d694d3f72371-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-mhxvq\" (UID: \"236875ba-bff6-4596-b571-d694d3f72371\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mhxvq"
Sep 20 00:54:38.792571 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:38.792550    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/236875ba-bff6-4596-b571-d694d3f72371-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-mhxvq\" (UID: \"236875ba-bff6-4596-b571-d694d3f72371\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mhxvq"
Sep 20 00:54:38.792651 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:38.792635    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/236875ba-bff6-4596-b571-d694d3f72371-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-mhxvq\" (UID: \"236875ba-bff6-4596-b571-d694d3f72371\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mhxvq"
Sep 20 00:54:38.793664 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:38.793645    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/236875ba-bff6-4596-b571-d694d3f72371-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-mhxvq\" (UID: \"236875ba-bff6-4596-b571-d694d3f72371\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mhxvq"
Sep 20 00:54:38.793745 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:38.793727    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/236875ba-bff6-4596-b571-d694d3f72371-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-mhxvq\" (UID: \"236875ba-bff6-4596-b571-d694d3f72371\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mhxvq"
Sep 20 00:54:38.803232 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:38.803206    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/236875ba-bff6-4596-b571-d694d3f72371-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-mhxvq\" (UID: \"236875ba-bff6-4596-b571-d694d3f72371\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mhxvq"
Sep 20 00:54:38.806736 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:38.806710    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sg85\" (UniqueName: \"kubernetes.io/projected/236875ba-bff6-4596-b571-d694d3f72371-kube-api-access-4sg85\") pod \"istiod-openshift-gateway-5677ccb49b-mhxvq\" (UID: \"236875ba-bff6-4596-b571-d694d3f72371\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mhxvq"
Sep 20 00:54:38.967332 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:38.967298    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mhxvq"
Sep 20 00:54:39.238179 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:39.238141    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-694bb85cb6-9526l"]
Sep 20 00:54:39.242875 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:39.242839    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-694bb85cb6-9526l"
Sep 20 00:54:39.247248 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:39.247211    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-bqpmn\""
Sep 20 00:54:39.247738 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:39.247714    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 20 00:54:39.247850 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:39.247771    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 20 00:54:39.247988 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:39.247971    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 20 00:54:39.248087 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:39.248070    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 20 00:54:39.248141 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:39.248083    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 20 00:54:39.262265 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:39.262226    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-694bb85cb6-9526l"]
Sep 20 00:54:39.268275 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:39.268248    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-mhxvq"]
Sep 20 00:54:39.275819 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:54:39.275777    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod236875ba_bff6_4596_b571_d694d3f72371.slice/crio-ac34e7fbcdb7a9b9d01817ce64e9ac04b3ea7a49ef40f4a8e6d0a31a525ae3fa WatchSource:0}: Error finding container ac34e7fbcdb7a9b9d01817ce64e9ac04b3ea7a49ef40f4a8e6d0a31a525ae3fa: Status 404 returned error can't find the container with id ac34e7fbcdb7a9b9d01817ce64e9ac04b3ea7a49ef40f4a8e6d0a31a525ae3fa
Sep 20 00:54:39.295961 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:39.295932    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j77rw\" (UniqueName: \"kubernetes.io/projected/abc9afb9-c281-4164-b4f2-2ae7e9da1f35-kube-api-access-j77rw\") pod \"lws-controller-manager-694bb85cb6-9526l\" (UID: \"abc9afb9-c281-4164-b4f2-2ae7e9da1f35\") " pod="openshift-lws-operator/lws-controller-manager-694bb85cb6-9526l"
Sep 20 00:54:39.296101 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:39.295971    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/abc9afb9-c281-4164-b4f2-2ae7e9da1f35-cert\") pod \"lws-controller-manager-694bb85cb6-9526l\" (UID: \"abc9afb9-c281-4164-b4f2-2ae7e9da1f35\") " pod="openshift-lws-operator/lws-controller-manager-694bb85cb6-9526l"
Sep 20 00:54:39.296143 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:39.296098    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/abc9afb9-c281-4164-b4f2-2ae7e9da1f35-manager-config\") pod \"lws-controller-manager-694bb85cb6-9526l\" (UID: \"abc9afb9-c281-4164-b4f2-2ae7e9da1f35\") " pod="openshift-lws-operator/lws-controller-manager-694bb85cb6-9526l"
Sep 20 00:54:39.296143 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:39.296126    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/abc9afb9-c281-4164-b4f2-2ae7e9da1f35-metrics-cert\") pod \"lws-controller-manager-694bb85cb6-9526l\" (UID: \"abc9afb9-c281-4164-b4f2-2ae7e9da1f35\") " pod="openshift-lws-operator/lws-controller-manager-694bb85cb6-9526l"
Sep 20 00:54:39.396978 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:39.396933    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/abc9afb9-c281-4164-b4f2-2ae7e9da1f35-manager-config\") pod \"lws-controller-manager-694bb85cb6-9526l\" (UID: \"abc9afb9-c281-4164-b4f2-2ae7e9da1f35\") " pod="openshift-lws-operator/lws-controller-manager-694bb85cb6-9526l"
Sep 20 00:54:39.396978 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:39.396979    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/abc9afb9-c281-4164-b4f2-2ae7e9da1f35-metrics-cert\") pod \"lws-controller-manager-694bb85cb6-9526l\" (UID: \"abc9afb9-c281-4164-b4f2-2ae7e9da1f35\") " pod="openshift-lws-operator/lws-controller-manager-694bb85cb6-9526l"
Sep 20 00:54:39.397184 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:39.397162    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j77rw\" (UniqueName: \"kubernetes.io/projected/abc9afb9-c281-4164-b4f2-2ae7e9da1f35-kube-api-access-j77rw\") pod \"lws-controller-manager-694bb85cb6-9526l\" (UID: \"abc9afb9-c281-4164-b4f2-2ae7e9da1f35\") " pod="openshift-lws-operator/lws-controller-manager-694bb85cb6-9526l"
Sep 20 00:54:39.397225 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:39.397203    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/abc9afb9-c281-4164-b4f2-2ae7e9da1f35-cert\") pod \"lws-controller-manager-694bb85cb6-9526l\" (UID: \"abc9afb9-c281-4164-b4f2-2ae7e9da1f35\") " pod="openshift-lws-operator/lws-controller-manager-694bb85cb6-9526l"
Sep 20 00:54:39.397745 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:39.397719    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/abc9afb9-c281-4164-b4f2-2ae7e9da1f35-manager-config\") pod \"lws-controller-manager-694bb85cb6-9526l\" (UID: \"abc9afb9-c281-4164-b4f2-2ae7e9da1f35\") " pod="openshift-lws-operator/lws-controller-manager-694bb85cb6-9526l"
Sep 20 00:54:39.399599 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:39.399580    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/abc9afb9-c281-4164-b4f2-2ae7e9da1f35-metrics-cert\") pod \"lws-controller-manager-694bb85cb6-9526l\" (UID: \"abc9afb9-c281-4164-b4f2-2ae7e9da1f35\") " pod="openshift-lws-operator/lws-controller-manager-694bb85cb6-9526l"
Sep 20 00:54:39.399688 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:39.399613    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/abc9afb9-c281-4164-b4f2-2ae7e9da1f35-cert\") pod \"lws-controller-manager-694bb85cb6-9526l\" (UID: \"abc9afb9-c281-4164-b4f2-2ae7e9da1f35\") " pod="openshift-lws-operator/lws-controller-manager-694bb85cb6-9526l"
Sep 20 00:54:39.405235 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:39.405215    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j77rw\" (UniqueName: \"kubernetes.io/projected/abc9afb9-c281-4164-b4f2-2ae7e9da1f35-kube-api-access-j77rw\") pod \"lws-controller-manager-694bb85cb6-9526l\" (UID: \"abc9afb9-c281-4164-b4f2-2ae7e9da1f35\") " pod="openshift-lws-operator/lws-controller-manager-694bb85cb6-9526l"
Sep 20 00:54:39.434716 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:39.434663    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-z9sjt" event={"ID":"5b08a46b-ee88-4021-ab05-fdcb2d511a7e","Type":"ContainerStarted","Data":"893ec3d08aa0004ad8ef9bc55e4b314bc9180d1a5c02717fc8b3d29c92368119"}
Sep 20 00:54:39.434915 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:39.434896    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-z9sjt"
Sep 20 00:54:39.435917 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:39.435896    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mhxvq" event={"ID":"236875ba-bff6-4596-b571-d694d3f72371","Type":"ContainerStarted","Data":"ac34e7fbcdb7a9b9d01817ce64e9ac04b3ea7a49ef40f4a8e6d0a31a525ae3fa"}
Sep 20 00:54:39.451511 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:39.451453    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-z9sjt" podStartSLOduration=3.044510414 podStartE2EDuration="6.451432836s" totalImagesPullingTime="3.406922422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:54:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:54:39.449224901 +0000 UTC m=+416.063380816" watchObservedRunningTime="2026-09-20 00:54:39.451432836 +0000 UTC m=+416.065588735"
Sep 20 00:54:39.552994 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:39.552918    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-694bb85cb6-9526l"
Sep 20 00:54:39.846040 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:39.846009    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-694bb85cb6-9526l"]
Sep 20 00:54:39.848677 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:54:39.848646    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabc9afb9_c281_4164_b4f2_2ae7e9da1f35.slice/crio-7b43e5673d0c7f0147471ec6f4ac3585c2c28b76864b3b8d84c97d592d2d8bb0 WatchSource:0}: Error finding container 7b43e5673d0c7f0147471ec6f4ac3585c2c28b76864b3b8d84c97d592d2d8bb0: Status 404 returned error can't find the container with id 7b43e5673d0c7f0147471ec6f4ac3585c2c28b76864b3b8d84c97d592d2d8bb0
Sep 20 00:54:40.443689 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:40.443647    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-694bb85cb6-9526l" event={"ID":"abc9afb9-c281-4164-b4f2-2ae7e9da1f35","Type":"ContainerStarted","Data":"7b43e5673d0c7f0147471ec6f4ac3585c2c28b76864b3b8d84c97d592d2d8bb0"}
Sep 20 00:54:42.647247 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:42.647215    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 00:54:42.647500 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:42.647279    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 00:54:43.463148 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:43.463115    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mhxvq" event={"ID":"236875ba-bff6-4596-b571-d694d3f72371","Type":"ContainerStarted","Data":"85d80a69b726adecb7425e0a4f50c05bb9538258f968df79ca755bf756decf93"}
Sep 20 00:54:43.463148 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:43.463167    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mhxvq"
Sep 20 00:54:43.464880 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:43.464828    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-694bb85cb6-9526l" event={"ID":"abc9afb9-c281-4164-b4f2-2ae7e9da1f35","Type":"ContainerStarted","Data":"eec15ec270efeecf51d36d000be542af62da9214c73f917d0d13677fd448b346"}
Sep 20 00:54:43.465003 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:43.464973    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-694bb85cb6-9526l"
Sep 20 00:54:43.465055 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:43.464973    2570 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-mhxvq container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 20 00:54:43.465089 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:43.465046    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mhxvq" podUID="236875ba-bff6-4596-b571-d694d3f72371" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 20 00:54:43.485616 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:43.485567    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mhxvq" podStartSLOduration=2.116637953 podStartE2EDuration="5.485551106s" totalImagesPullingTime="3.368913153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:54:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:54:43.483764717 +0000 UTC m=+420.097920664" watchObservedRunningTime="2026-09-20 00:54:43.485551106 +0000 UTC m=+420.099707003"
Sep 20 00:54:43.500037 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:43.499987    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-694bb85cb6-9526l" podStartSLOduration=1.644912623 podStartE2EDuration="4.499967226s" totalImagesPullingTime="2.855054603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:54:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:54:43.499107492 +0000 UTC m=+420.113263411" watchObservedRunningTime="2026-09-20 00:54:43.499967226 +0000 UTC m=+420.114123128"
Sep 20 00:54:44.474455 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:44.474423    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mhxvq"
Sep 20 00:54:48.424748 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:48.424715    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-hq79w"
Sep 20 00:54:50.447856 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:50.447822    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-z9sjt"
Sep 20 00:54:54.473005 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:54:54.472973    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-694bb85cb6-9526l"
Sep 20 00:57:45.410517 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:57:45.410490    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65l6f_bf898d8f-ed0f-4b4e-9a87-8e6167b29481/ovn-acl-logging/0.log"
Sep 20 00:57:45.417603 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:57:45.417582    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65l6f_bf898d8f-ed0f-4b4e-9a87-8e6167b29481/ovn-acl-logging/0.log"
Sep 20 00:58:13.639683 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:13.639649    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-chm2z"]
Sep 20 00:58:13.642342 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:13.642321    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-chm2z"
Sep 20 00:58:13.644523 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:13.644501    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 20 00:58:13.654675 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:13.654649    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-chm2z"]
Sep 20 00:58:13.672188 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:13.672157    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-r26vb"]
Sep 20 00:58:13.674495 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:13.674475    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-r26vb"
Sep 20 00:58:13.676797 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:13.676775    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-hvwdk\""
Sep 20 00:58:13.684834 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:13.684811    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-r26vb"]
Sep 20 00:58:13.688652 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:13.688629    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a4d97a9f-f7c2-4261-813d-60ecc6926d65-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-chm2z\" (UID: \"a4d97a9f-f7c2-4261-813d-60ecc6926d65\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-chm2z"
Sep 20 00:58:13.688739 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:13.688685    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xvd9\" (UniqueName: \"kubernetes.io/projected/a4d97a9f-f7c2-4261-813d-60ecc6926d65-kube-api-access-7xvd9\") pod \"payload-pre-processing-59fbc47bf8-chm2z\" (UID: \"a4d97a9f-f7c2-4261-813d-60ecc6926d65\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-chm2z"
Sep 20 00:58:13.789256 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:13.789221    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xvd9\" (UniqueName: \"kubernetes.io/projected/a4d97a9f-f7c2-4261-813d-60ecc6926d65-kube-api-access-7xvd9\") pod \"payload-pre-processing-59fbc47bf8-chm2z\" (UID: \"a4d97a9f-f7c2-4261-813d-60ecc6926d65\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-chm2z"
Sep 20 00:58:13.789445 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:13.789290    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9abb97c7-ec96-4d9f-a385-5b15a95ef793-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-r26vb\" (UID: \"9abb97c7-ec96-4d9f-a385-5b15a95ef793\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-r26vb"
Sep 20 00:58:13.789445 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:13.789333    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a4d97a9f-f7c2-4261-813d-60ecc6926d65-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-chm2z\" (UID: \"a4d97a9f-f7c2-4261-813d-60ecc6926d65\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-chm2z"
Sep 20 00:58:13.789445 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:13.789429    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjtf2\" (UniqueName: \"kubernetes.io/projected/9abb97c7-ec96-4d9f-a385-5b15a95ef793-kube-api-access-zjtf2\") pod \"payload-processing-5b54b7fbb7-r26vb\" (UID: \"9abb97c7-ec96-4d9f-a385-5b15a95ef793\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-r26vb"
Sep 20 00:58:13.790219 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:13.790200    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a4d97a9f-f7c2-4261-813d-60ecc6926d65-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-chm2z\" (UID: \"a4d97a9f-f7c2-4261-813d-60ecc6926d65\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-chm2z"
Sep 20 00:58:13.797139 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:13.797114    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xvd9\" (UniqueName: \"kubernetes.io/projected/a4d97a9f-f7c2-4261-813d-60ecc6926d65-kube-api-access-7xvd9\") pod \"payload-pre-processing-59fbc47bf8-chm2z\" (UID: \"a4d97a9f-f7c2-4261-813d-60ecc6926d65\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-chm2z"
Sep 20 00:58:13.890372 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:13.890290    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjtf2\" (UniqueName: \"kubernetes.io/projected/9abb97c7-ec96-4d9f-a385-5b15a95ef793-kube-api-access-zjtf2\") pod \"payload-processing-5b54b7fbb7-r26vb\" (UID: \"9abb97c7-ec96-4d9f-a385-5b15a95ef793\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-r26vb"
Sep 20 00:58:13.890519 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:13.890373    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9abb97c7-ec96-4d9f-a385-5b15a95ef793-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-r26vb\" (UID: \"9abb97c7-ec96-4d9f-a385-5b15a95ef793\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-r26vb"
Sep 20 00:58:13.891118 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:13.891095    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9abb97c7-ec96-4d9f-a385-5b15a95ef793-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-r26vb\" (UID: \"9abb97c7-ec96-4d9f-a385-5b15a95ef793\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-r26vb"
Sep 20 00:58:13.898818 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:13.898790    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjtf2\" (UniqueName: \"kubernetes.io/projected/9abb97c7-ec96-4d9f-a385-5b15a95ef793-kube-api-access-zjtf2\") pod \"payload-processing-5b54b7fbb7-r26vb\" (UID: \"9abb97c7-ec96-4d9f-a385-5b15a95ef793\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-r26vb"
Sep 20 00:58:13.952799 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:13.952764    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-chm2z"
Sep 20 00:58:13.985762 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:13.985732    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-r26vb"
Sep 20 00:58:14.223902 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:14.223810    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-chm2z"]
Sep 20 00:58:14.227018 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:58:14.226995    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4d97a9f_f7c2_4261_813d_60ecc6926d65.slice/crio-a34f327a929f4436bfdbf518cc480c8420db904a12952e69a7391574f624f12e WatchSource:0}: Error finding container a34f327a929f4436bfdbf518cc480c8420db904a12952e69a7391574f624f12e: Status 404 returned error can't find the container with id a34f327a929f4436bfdbf518cc480c8420db904a12952e69a7391574f624f12e
Sep 20 00:58:14.265561 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:14.265539    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-r26vb"]
Sep 20 00:58:14.267794 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:58:14.267757    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9abb97c7_ec96_4d9f_a385_5b15a95ef793.slice/crio-fe1eaae24dec7f2fd8587ea5b09efc8a60e73e0aaf1de7725a5f63df6e6da660 WatchSource:0}: Error finding container fe1eaae24dec7f2fd8587ea5b09efc8a60e73e0aaf1de7725a5f63df6e6da660: Status 404 returned error can't find the container with id fe1eaae24dec7f2fd8587ea5b09efc8a60e73e0aaf1de7725a5f63df6e6da660
Sep 20 00:58:14.431019 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:14.430972    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-r26vb" event={"ID":"9abb97c7-ec96-4d9f-a385-5b15a95ef793","Type":"ContainerStarted","Data":"fe1eaae24dec7f2fd8587ea5b09efc8a60e73e0aaf1de7725a5f63df6e6da660"}
Sep 20 00:58:14.432152 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:14.432128    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-chm2z" event={"ID":"a4d97a9f-f7c2-4261-813d-60ecc6926d65","Type":"ContainerStarted","Data":"a34f327a929f4436bfdbf518cc480c8420db904a12952e69a7391574f624f12e"}
Sep 20 00:58:17.461289 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:17.455659    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-r26vb" event={"ID":"9abb97c7-ec96-4d9f-a385-5b15a95ef793","Type":"ContainerStarted","Data":"4194c34b13d08812a4dd941cf89c05cf975124b2ab79894b1ee7fabe4d452d75"}
Sep 20 00:58:17.461289 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:17.455727    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-chm2z" event={"ID":"a4d97a9f-f7c2-4261-813d-60ecc6926d65","Type":"ContainerStarted","Data":"e4da4aee5ce42c34684d208d128958e78f7e11dcfa41b6a3a0b54dcf5ee7caf6"}
Sep 20 00:58:17.461289 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:17.455760    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-r26vb"
Sep 20 00:58:17.461289 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:17.455796    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-chm2z"
Sep 20 00:58:17.468899 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:17.468837    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-r26vb" podStartSLOduration=2.051179912 podStartE2EDuration="4.468821474s" totalImagesPullingTime="2.417641562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:58:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:58:17.467108948 +0000 UTC m=+634.081264864" watchObservedRunningTime="2026-09-20 00:58:17.468821474 +0000 UTC m=+634.082977371"
Sep 20 00:58:17.482539 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:17.482490    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-chm2z" podStartSLOduration=2.014760877 podStartE2EDuration="4.482475355s" totalImagesPullingTime="2.467714478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:58:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:58:17.481361134 +0000 UTC m=+634.095517052" watchObservedRunningTime="2026-09-20 00:58:17.482475355 +0000 UTC m=+634.096631253"
Sep 20 00:58:28.460347 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:28.460312    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-r26vb"
Sep 20 00:58:28.460894 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:28.460603    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-chm2z"
Sep 20 00:58:35.490538 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:35.490505    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-f72vk"]
Sep 20 00:58:35.498931 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:35.498904    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f72vk"
Sep 20 00:58:35.501808 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:35.501782    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 20 00:58:35.501808 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:35.501799    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 20 00:58:35.502006 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:35.501830    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-dtt4r\""
Sep 20 00:58:35.502006 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:35.501889    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 20 00:58:35.502204 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:35.502183    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-f72vk"]
Sep 20 00:58:35.590774 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:35.590742    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b2ebbab-42b7-4b76-a3e6-d93d398bbfce-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f72vk\" (UID: \"0b2ebbab-42b7-4b76-a3e6-d93d398bbfce\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f72vk"
Sep 20 00:58:35.591003 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:35.590796    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b2ebbab-42b7-4b76-a3e6-d93d398bbfce-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f72vk\" (UID: \"0b2ebbab-42b7-4b76-a3e6-d93d398bbfce\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f72vk"
Sep 20 00:58:35.591003 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:35.590825    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzkg5\" (UniqueName: \"kubernetes.io/projected/0b2ebbab-42b7-4b76-a3e6-d93d398bbfce-kube-api-access-hzkg5\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f72vk\" (UID: \"0b2ebbab-42b7-4b76-a3e6-d93d398bbfce\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f72vk"
Sep 20 00:58:35.591003 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:35.590851    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b2ebbab-42b7-4b76-a3e6-d93d398bbfce-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f72vk\" (UID: \"0b2ebbab-42b7-4b76-a3e6-d93d398bbfce\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f72vk"
Sep 20 00:58:35.591003 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:35.590924    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b2ebbab-42b7-4b76-a3e6-d93d398bbfce-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f72vk\" (UID: \"0b2ebbab-42b7-4b76-a3e6-d93d398bbfce\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f72vk"
Sep 20 00:58:35.591003 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:35.590949    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b2ebbab-42b7-4b76-a3e6-d93d398bbfce-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f72vk\" (UID: \"0b2ebbab-42b7-4b76-a3e6-d93d398bbfce\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f72vk"
Sep 20 00:58:35.691844 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:35.691808    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b2ebbab-42b7-4b76-a3e6-d93d398bbfce-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f72vk\" (UID: \"0b2ebbab-42b7-4b76-a3e6-d93d398bbfce\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f72vk"
Sep 20 00:58:35.691844 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:35.691844    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzkg5\" (UniqueName: \"kubernetes.io/projected/0b2ebbab-42b7-4b76-a3e6-d93d398bbfce-kube-api-access-hzkg5\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f72vk\" (UID: \"0b2ebbab-42b7-4b76-a3e6-d93d398bbfce\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f72vk"
Sep 20 00:58:35.692085 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:35.691897    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b2ebbab-42b7-4b76-a3e6-d93d398bbfce-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f72vk\" (UID: \"0b2ebbab-42b7-4b76-a3e6-d93d398bbfce\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f72vk"
Sep 20 00:58:35.692085 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:35.691930    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b2ebbab-42b7-4b76-a3e6-d93d398bbfce-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f72vk\" (UID: \"0b2ebbab-42b7-4b76-a3e6-d93d398bbfce\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f72vk"
Sep 20 00:58:35.692085 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:35.691951    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b2ebbab-42b7-4b76-a3e6-d93d398bbfce-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f72vk\" (UID: \"0b2ebbab-42b7-4b76-a3e6-d93d398bbfce\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f72vk"
Sep 20 00:58:35.692085 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:35.692049    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b2ebbab-42b7-4b76-a3e6-d93d398bbfce-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f72vk\" (UID: \"0b2ebbab-42b7-4b76-a3e6-d93d398bbfce\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f72vk"
Sep 20 00:58:35.692295 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:35.692271    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b2ebbab-42b7-4b76-a3e6-d93d398bbfce-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f72vk\" (UID: \"0b2ebbab-42b7-4b76-a3e6-d93d398bbfce\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f72vk"
Sep 20 00:58:35.692359 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:35.692337    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b2ebbab-42b7-4b76-a3e6-d93d398bbfce-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f72vk\" (UID: \"0b2ebbab-42b7-4b76-a3e6-d93d398bbfce\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f72vk"
Sep 20 00:58:35.692420 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:35.692392    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b2ebbab-42b7-4b76-a3e6-d93d398bbfce-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f72vk\" (UID: \"0b2ebbab-42b7-4b76-a3e6-d93d398bbfce\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f72vk"
Sep 20 00:58:35.694342 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:35.694326    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b2ebbab-42b7-4b76-a3e6-d93d398bbfce-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f72vk\" (UID: \"0b2ebbab-42b7-4b76-a3e6-d93d398bbfce\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f72vk"
Sep 20 00:58:35.694581 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:35.694565    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b2ebbab-42b7-4b76-a3e6-d93d398bbfce-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f72vk\" (UID: \"0b2ebbab-42b7-4b76-a3e6-d93d398bbfce\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f72vk"
Sep 20 00:58:35.699054 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:35.699032    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzkg5\" (UniqueName: \"kubernetes.io/projected/0b2ebbab-42b7-4b76-a3e6-d93d398bbfce-kube-api-access-hzkg5\") pod \"e2e-distinct-simulated-kserve-59975d69f9-f72vk\" (UID: \"0b2ebbab-42b7-4b76-a3e6-d93d398bbfce\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f72vk"
Sep 20 00:58:35.823339 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:35.823261    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f72vk"
Sep 20 00:58:36.092146 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:36.092121    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-f72vk"]
Sep 20 00:58:36.094948 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:58:36.094922    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b2ebbab_42b7_4b76_a3e6_d93d398bbfce.slice/crio-430e80d7acc602dfe10a20cc65acee7cbc7213e86e4cdecb4a5bf9b50f294e1e WatchSource:0}: Error finding container 430e80d7acc602dfe10a20cc65acee7cbc7213e86e4cdecb4a5bf9b50f294e1e: Status 404 returned error can't find the container with id 430e80d7acc602dfe10a20cc65acee7cbc7213e86e4cdecb4a5bf9b50f294e1e
Sep 20 00:58:36.543883 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:36.543818    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f72vk" event={"ID":"0b2ebbab-42b7-4b76-a3e6-d93d398bbfce","Type":"ContainerStarted","Data":"430e80d7acc602dfe10a20cc65acee7cbc7213e86e4cdecb4a5bf9b50f294e1e"}
Sep 20 00:58:37.550320 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:37.550284    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f72vk" event={"ID":"0b2ebbab-42b7-4b76-a3e6-d93d398bbfce","Type":"ContainerStarted","Data":"b50c63c235aa05cf2bf8fbd1e345a0e4fbbe982d0101507e241438d719daba42"}
Sep 20 00:58:37.566618 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:37.566572    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f72vk" podStartSLOduration=1.5794718890000001 podStartE2EDuration="2.566556574s" totalImagesPullingTime="987.084685ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:58:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:58:37.564796147 +0000 UTC m=+654.178952079" watchObservedRunningTime="2026-09-20 00:58:37.566556574 +0000 UTC m=+654.180712471"
Sep 20 00:58:45.823413 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:45.823369    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f72vk"
Sep 20 00:58:45.823943 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:45.823439    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f72vk"
Sep 20 00:58:45.836024 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:45.835996    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f72vk"
Sep 20 00:58:46.604490 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:58:46.604461    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-f72vk"
Sep 20 00:59:01.897781 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:59:01.897744    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjxbnr"]
Sep 20 00:59:01.901319 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:59:01.901289    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjxbnr"
Sep 20 00:59:01.903526 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:59:01.903506    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 20 00:59:01.909018 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:59:01.908993    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjxbnr"]
Sep 20 00:59:02.033716 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:59:02.033680    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6cf7874f-4e23-44b2-9da4-0e934c29f2de-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjxbnr\" (UID: \"6cf7874f-4e23-44b2-9da4-0e934c29f2de\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjxbnr"
Sep 20 00:59:02.033940 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:59:02.033760    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6cf7874f-4e23-44b2-9da4-0e934c29f2de-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjxbnr\" (UID: \"6cf7874f-4e23-44b2-9da4-0e934c29f2de\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjxbnr"
Sep 20 00:59:02.033940 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:59:02.033792    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6cf7874f-4e23-44b2-9da4-0e934c29f2de-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjxbnr\" (UID: \"6cf7874f-4e23-44b2-9da4-0e934c29f2de\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjxbnr"
Sep 20 00:59:02.033940 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:59:02.033809    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92qwl\" (UniqueName: \"kubernetes.io/projected/6cf7874f-4e23-44b2-9da4-0e934c29f2de-kube-api-access-92qwl\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjxbnr\" (UID: \"6cf7874f-4e23-44b2-9da4-0e934c29f2de\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjxbnr"
Sep 20 00:59:02.033940 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:59:02.033848    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6cf7874f-4e23-44b2-9da4-0e934c29f2de-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjxbnr\" (UID: \"6cf7874f-4e23-44b2-9da4-0e934c29f2de\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjxbnr"
Sep 20 00:59:02.034117 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:59:02.033991    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6cf7874f-4e23-44b2-9da4-0e934c29f2de-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjxbnr\" (UID: \"6cf7874f-4e23-44b2-9da4-0e934c29f2de\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjxbnr"
Sep 20 00:59:02.135027 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:59:02.134983    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6cf7874f-4e23-44b2-9da4-0e934c29f2de-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjxbnr\" (UID: \"6cf7874f-4e23-44b2-9da4-0e934c29f2de\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjxbnr"
Sep 20 00:59:02.135224 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:59:02.135032    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6cf7874f-4e23-44b2-9da4-0e934c29f2de-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjxbnr\" (UID: \"6cf7874f-4e23-44b2-9da4-0e934c29f2de\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjxbnr"
Sep 20 00:59:02.135224 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:59:02.135066    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92qwl\" (UniqueName: \"kubernetes.io/projected/6cf7874f-4e23-44b2-9da4-0e934c29f2de-kube-api-access-92qwl\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjxbnr\" (UID: \"6cf7874f-4e23-44b2-9da4-0e934c29f2de\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjxbnr"
Sep 20 00:59:02.135224 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:59:02.135105    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6cf7874f-4e23-44b2-9da4-0e934c29f2de-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjxbnr\" (UID: \"6cf7874f-4e23-44b2-9da4-0e934c29f2de\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjxbnr"
Sep 20 00:59:02.135224 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:59:02.135138    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6cf7874f-4e23-44b2-9da4-0e934c29f2de-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjxbnr\" (UID: \"6cf7874f-4e23-44b2-9da4-0e934c29f2de\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjxbnr"
Sep 20 00:59:02.135224 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:59:02.135196    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6cf7874f-4e23-44b2-9da4-0e934c29f2de-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjxbnr\" (UID: \"6cf7874f-4e23-44b2-9da4-0e934c29f2de\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjxbnr"
Sep 20 00:59:02.135539 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:59:02.135518    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6cf7874f-4e23-44b2-9da4-0e934c29f2de-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjxbnr\" (UID: \"6cf7874f-4e23-44b2-9da4-0e934c29f2de\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjxbnr"
Sep 20 00:59:02.135610 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:59:02.135593    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6cf7874f-4e23-44b2-9da4-0e934c29f2de-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjxbnr\" (UID: \"6cf7874f-4e23-44b2-9da4-0e934c29f2de\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjxbnr"
Sep 20 00:59:02.135667 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:59:02.135630    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6cf7874f-4e23-44b2-9da4-0e934c29f2de-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjxbnr\" (UID: \"6cf7874f-4e23-44b2-9da4-0e934c29f2de\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjxbnr"
Sep 20 00:59:02.137415 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:59:02.137396    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6cf7874f-4e23-44b2-9da4-0e934c29f2de-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjxbnr\" (UID: \"6cf7874f-4e23-44b2-9da4-0e934c29f2de\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjxbnr"
Sep 20 00:59:02.137660 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:59:02.137644    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6cf7874f-4e23-44b2-9da4-0e934c29f2de-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjxbnr\" (UID: \"6cf7874f-4e23-44b2-9da4-0e934c29f2de\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjxbnr"
Sep 20 00:59:02.146115 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:59:02.146090    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92qwl\" (UniqueName: \"kubernetes.io/projected/6cf7874f-4e23-44b2-9da4-0e934c29f2de-kube-api-access-92qwl\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjxbnr\" (UID: \"6cf7874f-4e23-44b2-9da4-0e934c29f2de\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjxbnr"
Sep 20 00:59:02.213375 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:59:02.213292    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjxbnr"
Sep 20 00:59:02.482841 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:59:02.482815    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjxbnr"]
Sep 20 00:59:02.484688 ip-10-0-132-108 kubenswrapper[2570]: W0920 00:59:02.484663    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cf7874f_4e23_44b2_9da4_0e934c29f2de.slice/crio-0cd45bd2d30234ff3c64797de4b3498885383c05003f3b687bf42b3956852ea5 WatchSource:0}: Error finding container 0cd45bd2d30234ff3c64797de4b3498885383c05003f3b687bf42b3956852ea5: Status 404 returned error can't find the container with id 0cd45bd2d30234ff3c64797de4b3498885383c05003f3b687bf42b3956852ea5
Sep 20 00:59:02.665854 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:59:02.665816    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjxbnr" event={"ID":"6cf7874f-4e23-44b2-9da4-0e934c29f2de","Type":"ContainerStarted","Data":"0cd45bd2d30234ff3c64797de4b3498885383c05003f3b687bf42b3956852ea5"}
Sep 20 00:59:03.672278 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:59:03.672247    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjxbnr" event={"ID":"6cf7874f-4e23-44b2-9da4-0e934c29f2de","Type":"ContainerStarted","Data":"776310e41f85ece75866f4d96674eafe1211966a75bd0d27bad95cc491646e38"}
Sep 20 00:59:03.688776 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:59:03.688728    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjxbnr" podStartSLOduration=2.523219032 podStartE2EDuration="2.688712446s" totalImagesPullingTime="165.493414ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 00:59:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 00:59:03.687676307 +0000 UTC m=+680.301832238" watchObservedRunningTime="2026-09-20 00:59:03.688712446 +0000 UTC m=+680.302868344"
Sep 20 00:59:12.214250 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:59:12.214217    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjxbnr"
Sep 20 00:59:12.214626 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:59:12.214281    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjxbnr"
Sep 20 00:59:12.226686 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:59:12.226661    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjxbnr"
Sep 20 00:59:12.726610 ip-10-0-132-108 kubenswrapper[2570]: I0920 00:59:12.726576    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjxbnr"
Sep 20 01:00:00.140879 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:00.140795    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29831100-gxjsl"]
Sep 20 01:00:00.144205 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:00.144188    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29831100-gxjsl"
Sep 20 01:00:00.146642 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:00.146623    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5xngg\""
Sep 20 01:00:00.150469 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:00.150446    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29831100-gxjsl"]
Sep 20 01:00:00.155750 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:00.155727    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29831100-gxjsl"
Sep 20 01:00:00.425672 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:00.425591    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29831100-gxjsl"]
Sep 20 01:00:00.428634 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:00:00.428604    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81a7c19b_8482_42e3_a0bf_64fd897c0fc0.slice/crio-aad2a0ecc95512aa32b40a439f58a116da9de0b93f7c75e4373102d0e1e1053f WatchSource:0}: Error finding container aad2a0ecc95512aa32b40a439f58a116da9de0b93f7c75e4373102d0e1e1053f: Status 404 returned error can't find the container with id aad2a0ecc95512aa32b40a439f58a116da9de0b93f7c75e4373102d0e1e1053f
Sep 20 01:00:00.430544 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:00.430527    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 20 01:00:00.949983 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:00.949949    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29831100-gxjsl" event={"ID":"81a7c19b-8482-42e3-a0bf-64fd897c0fc0","Type":"ContainerStarted","Data":"aad2a0ecc95512aa32b40a439f58a116da9de0b93f7c75e4373102d0e1e1053f"}
Sep 20 01:00:03.966477 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:03.966392    2570 generic.go:356] "Generic (PLEG): container finished" podID="81a7c19b-8482-42e3-a0bf-64fd897c0fc0" containerID="d89cc509aff3a8debbdf4b68998d23663a3afbcda998915aff2c9886c2854c65" exitCode=0
Sep 20 01:00:03.966477 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:03.966452    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29831100-gxjsl" event={"ID":"81a7c19b-8482-42e3-a0bf-64fd897c0fc0","Type":"ContainerDied","Data":"d89cc509aff3a8debbdf4b68998d23663a3afbcda998915aff2c9886c2854c65"}
Sep 20 01:00:05.100492 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:05.100467    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29831100-gxjsl"
Sep 20 01:00:05.976968 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:05.976923    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29831100-gxjsl" event={"ID":"81a7c19b-8482-42e3-a0bf-64fd897c0fc0","Type":"ContainerDied","Data":"aad2a0ecc95512aa32b40a439f58a116da9de0b93f7c75e4373102d0e1e1053f"}
Sep 20 01:00:05.977168 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:05.976984    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aad2a0ecc95512aa32b40a439f58a116da9de0b93f7c75e4373102d0e1e1053f"
Sep 20 01:00:05.977168 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:05.976945    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29831100-gxjsl"
Sep 20 01:00:51.014319 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.014285    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl"]
Sep 20 01:00:51.014776 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.014683    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81a7c19b-8482-42e3-a0bf-64fd897c0fc0" containerName="cleanup"
Sep 20 01:00:51.014776 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.014694    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="81a7c19b-8482-42e3-a0bf-64fd897c0fc0" containerName="cleanup"
Sep 20 01:00:51.014776 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.014754    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="81a7c19b-8482-42e3-a0bf-64fd897c0fc0" containerName="cleanup"
Sep 20 01:00:51.018198 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.018177    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl"
Sep 20 01:00:51.020331 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.020307    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-2fd525-openshift-default-dockercfg-xgs2k\""
Sep 20 01:00:51.032011 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.031986    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl"]
Sep 20 01:00:51.041788 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.041757    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/008e3f25-a8f0-42f0-a09e-3e4166749faa-workload-socket\") pod \"e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl\" (UID: \"008e3f25-a8f0-42f0-a09e-3e4166749faa\") " pod="openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl"
Sep 20 01:00:51.041968 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.041803    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xm255\" (UniqueName: \"kubernetes.io/projected/008e3f25-a8f0-42f0-a09e-3e4166749faa-kube-api-access-xm255\") pod \"e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl\" (UID: \"008e3f25-a8f0-42f0-a09e-3e4166749faa\") " pod="openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl"
Sep 20 01:00:51.041968 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.041872    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/008e3f25-a8f0-42f0-a09e-3e4166749faa-istiod-ca-cert\") pod \"e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl\" (UID: \"008e3f25-a8f0-42f0-a09e-3e4166749faa\") " pod="openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl"
Sep 20 01:00:51.041968 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.041899    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/008e3f25-a8f0-42f0-a09e-3e4166749faa-credential-socket\") pod \"e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl\" (UID: \"008e3f25-a8f0-42f0-a09e-3e4166749faa\") " pod="openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl"
Sep 20 01:00:51.041968 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.041914    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/008e3f25-a8f0-42f0-a09e-3e4166749faa-istio-podinfo\") pod \"e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl\" (UID: \"008e3f25-a8f0-42f0-a09e-3e4166749faa\") " pod="openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl"
Sep 20 01:00:51.041968 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.041946    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/008e3f25-a8f0-42f0-a09e-3e4166749faa-workload-certs\") pod \"e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl\" (UID: \"008e3f25-a8f0-42f0-a09e-3e4166749faa\") " pod="openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl"
Sep 20 01:00:51.041968 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.041966    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/008e3f25-a8f0-42f0-a09e-3e4166749faa-istio-token\") pod \"e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl\" (UID: \"008e3f25-a8f0-42f0-a09e-3e4166749faa\") " pod="openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl"
Sep 20 01:00:51.042229 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.042063    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/008e3f25-a8f0-42f0-a09e-3e4166749faa-istio-envoy\") pod \"e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl\" (UID: \"008e3f25-a8f0-42f0-a09e-3e4166749faa\") " pod="openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl"
Sep 20 01:00:51.042229 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.042101    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/008e3f25-a8f0-42f0-a09e-3e4166749faa-istio-data\") pod \"e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl\" (UID: \"008e3f25-a8f0-42f0-a09e-3e4166749faa\") " pod="openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl"
Sep 20 01:00:51.142975 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.142940    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/008e3f25-a8f0-42f0-a09e-3e4166749faa-workload-certs\") pod \"e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl\" (UID: \"008e3f25-a8f0-42f0-a09e-3e4166749faa\") " pod="openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl"
Sep 20 01:00:51.142975 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.142980    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/008e3f25-a8f0-42f0-a09e-3e4166749faa-istio-token\") pod \"e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl\" (UID: \"008e3f25-a8f0-42f0-a09e-3e4166749faa\") " pod="openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl"
Sep 20 01:00:51.143226 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.143010    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/008e3f25-a8f0-42f0-a09e-3e4166749faa-istio-envoy\") pod \"e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl\" (UID: \"008e3f25-a8f0-42f0-a09e-3e4166749faa\") " pod="openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl"
Sep 20 01:00:51.143226 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.143027    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/008e3f25-a8f0-42f0-a09e-3e4166749faa-istio-data\") pod \"e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl\" (UID: \"008e3f25-a8f0-42f0-a09e-3e4166749faa\") " pod="openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl"
Sep 20 01:00:51.143226 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.143205    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/008e3f25-a8f0-42f0-a09e-3e4166749faa-workload-socket\") pod \"e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl\" (UID: \"008e3f25-a8f0-42f0-a09e-3e4166749faa\") " pod="openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl"
Sep 20 01:00:51.143383 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.143250    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xm255\" (UniqueName: \"kubernetes.io/projected/008e3f25-a8f0-42f0-a09e-3e4166749faa-kube-api-access-xm255\") pod \"e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl\" (UID: \"008e3f25-a8f0-42f0-a09e-3e4166749faa\") " pod="openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl"
Sep 20 01:00:51.143383 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.143316    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/008e3f25-a8f0-42f0-a09e-3e4166749faa-istiod-ca-cert\") pod \"e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl\" (UID: \"008e3f25-a8f0-42f0-a09e-3e4166749faa\") " pod="openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl"
Sep 20 01:00:51.143383 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.143325    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/008e3f25-a8f0-42f0-a09e-3e4166749faa-workload-certs\") pod \"e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl\" (UID: \"008e3f25-a8f0-42f0-a09e-3e4166749faa\") " pod="openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl"
Sep 20 01:00:51.143383 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.143354    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/008e3f25-a8f0-42f0-a09e-3e4166749faa-credential-socket\") pod \"e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl\" (UID: \"008e3f25-a8f0-42f0-a09e-3e4166749faa\") " pod="openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl"
Sep 20 01:00:51.143383 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.143381    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/008e3f25-a8f0-42f0-a09e-3e4166749faa-istio-podinfo\") pod \"e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl\" (UID: \"008e3f25-a8f0-42f0-a09e-3e4166749faa\") " pod="openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl"
Sep 20 01:00:51.143659 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.143428    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/008e3f25-a8f0-42f0-a09e-3e4166749faa-istio-data\") pod \"e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl\" (UID: \"008e3f25-a8f0-42f0-a09e-3e4166749faa\") " pod="openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl"
Sep 20 01:00:51.143659 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.143538    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/008e3f25-a8f0-42f0-a09e-3e4166749faa-workload-socket\") pod \"e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl\" (UID: \"008e3f25-a8f0-42f0-a09e-3e4166749faa\") " pod="openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl"
Sep 20 01:00:51.143659 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.143644    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/008e3f25-a8f0-42f0-a09e-3e4166749faa-credential-socket\") pod \"e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl\" (UID: \"008e3f25-a8f0-42f0-a09e-3e4166749faa\") " pod="openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl"
Sep 20 01:00:51.144240 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.144214    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/008e3f25-a8f0-42f0-a09e-3e4166749faa-istiod-ca-cert\") pod \"e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl\" (UID: \"008e3f25-a8f0-42f0-a09e-3e4166749faa\") " pod="openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl"
Sep 20 01:00:51.145575 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.145549    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/008e3f25-a8f0-42f0-a09e-3e4166749faa-istio-envoy\") pod \"e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl\" (UID: \"008e3f25-a8f0-42f0-a09e-3e4166749faa\") " pod="openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl"
Sep 20 01:00:51.145908 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.145884    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/008e3f25-a8f0-42f0-a09e-3e4166749faa-istio-podinfo\") pod \"e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl\" (UID: \"008e3f25-a8f0-42f0-a09e-3e4166749faa\") " pod="openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl"
Sep 20 01:00:51.158664 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.158633    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/008e3f25-a8f0-42f0-a09e-3e4166749faa-istio-token\") pod \"e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl\" (UID: \"008e3f25-a8f0-42f0-a09e-3e4166749faa\") " pod="openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl"
Sep 20 01:00:51.159517 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.159490    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xm255\" (UniqueName: \"kubernetes.io/projected/008e3f25-a8f0-42f0-a09e-3e4166749faa-kube-api-access-xm255\") pod \"e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl\" (UID: \"008e3f25-a8f0-42f0-a09e-3e4166749faa\") " pod="openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl"
Sep 20 01:00:51.171807 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.171774    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw"]
Sep 20 01:00:51.177223 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.177194    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw"
Sep 20 01:00:51.179822 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.179799    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-4e301e-openshift-default-dockercfg-9lk8v\""
Sep 20 01:00:51.186402 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.186379    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw"]
Sep 20 01:00:51.243847 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.243810    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3eb309b9-abfa-4b3a-b447-fca1a5421a15-istio-podinfo\") pod \"e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw\" (UID: \"3eb309b9-abfa-4b3a-b447-fca1a5421a15\") " pod="openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw"
Sep 20 01:00:51.243847 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.243847    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3eb309b9-abfa-4b3a-b447-fca1a5421a15-istio-data\") pod \"e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw\" (UID: \"3eb309b9-abfa-4b3a-b447-fca1a5421a15\") " pod="openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw"
Sep 20 01:00:51.244077 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.243898    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rprd4\" (UniqueName: \"kubernetes.io/projected/3eb309b9-abfa-4b3a-b447-fca1a5421a15-kube-api-access-rprd4\") pod \"e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw\" (UID: \"3eb309b9-abfa-4b3a-b447-fca1a5421a15\") " pod="openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw"
Sep 20 01:00:51.244077 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.243939    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3eb309b9-abfa-4b3a-b447-fca1a5421a15-credential-socket\") pod \"e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw\" (UID: \"3eb309b9-abfa-4b3a-b447-fca1a5421a15\") " pod="openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw"
Sep 20 01:00:51.244077 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.243974    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3eb309b9-abfa-4b3a-b447-fca1a5421a15-workload-socket\") pod \"e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw\" (UID: \"3eb309b9-abfa-4b3a-b447-fca1a5421a15\") " pod="openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw"
Sep 20 01:00:51.244077 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.244011    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3eb309b9-abfa-4b3a-b447-fca1a5421a15-workload-certs\") pod \"e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw\" (UID: \"3eb309b9-abfa-4b3a-b447-fca1a5421a15\") " pod="openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw"
Sep 20 01:00:51.244215 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.244082    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3eb309b9-abfa-4b3a-b447-fca1a5421a15-istio-envoy\") pod \"e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw\" (UID: \"3eb309b9-abfa-4b3a-b447-fca1a5421a15\") " pod="openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw"
Sep 20 01:00:51.244215 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.244120    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3eb309b9-abfa-4b3a-b447-fca1a5421a15-istio-token\") pod \"e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw\" (UID: \"3eb309b9-abfa-4b3a-b447-fca1a5421a15\") " pod="openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw"
Sep 20 01:00:51.244215 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.244154    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3eb309b9-abfa-4b3a-b447-fca1a5421a15-istiod-ca-cert\") pod \"e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw\" (UID: \"3eb309b9-abfa-4b3a-b447-fca1a5421a15\") " pod="openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw"
Sep 20 01:00:51.328693 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.328618    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl"
Sep 20 01:00:51.344797 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.344750    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3eb309b9-abfa-4b3a-b447-fca1a5421a15-istio-podinfo\") pod \"e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw\" (UID: \"3eb309b9-abfa-4b3a-b447-fca1a5421a15\") " pod="openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw"
Sep 20 01:00:51.345746 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.345662    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3eb309b9-abfa-4b3a-b447-fca1a5421a15-istio-data\") pod \"e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw\" (UID: \"3eb309b9-abfa-4b3a-b447-fca1a5421a15\") " pod="openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw"
Sep 20 01:00:51.345746 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.345704    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rprd4\" (UniqueName: \"kubernetes.io/projected/3eb309b9-abfa-4b3a-b447-fca1a5421a15-kube-api-access-rprd4\") pod \"e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw\" (UID: \"3eb309b9-abfa-4b3a-b447-fca1a5421a15\") " pod="openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw"
Sep 20 01:00:51.345845 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.345748    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3eb309b9-abfa-4b3a-b447-fca1a5421a15-credential-socket\") pod \"e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw\" (UID: \"3eb309b9-abfa-4b3a-b447-fca1a5421a15\") " pod="openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw"
Sep 20 01:00:51.345845 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.345780    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3eb309b9-abfa-4b3a-b447-fca1a5421a15-workload-socket\") pod \"e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw\" (UID: \"3eb309b9-abfa-4b3a-b447-fca1a5421a15\") " pod="openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw"
Sep 20 01:00:51.345845 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.345840    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3eb309b9-abfa-4b3a-b447-fca1a5421a15-workload-certs\") pod \"e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw\" (UID: \"3eb309b9-abfa-4b3a-b447-fca1a5421a15\") " pod="openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw"
Sep 20 01:00:51.346370 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.346126    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3eb309b9-abfa-4b3a-b447-fca1a5421a15-istio-envoy\") pod \"e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw\" (UID: \"3eb309b9-abfa-4b3a-b447-fca1a5421a15\") " pod="openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw"
Sep 20 01:00:51.346370 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.346169    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3eb309b9-abfa-4b3a-b447-fca1a5421a15-istio-token\") pod \"e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw\" (UID: \"3eb309b9-abfa-4b3a-b447-fca1a5421a15\") " pod="openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw"
Sep 20 01:00:51.346370 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.346195    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3eb309b9-abfa-4b3a-b447-fca1a5421a15-istiod-ca-cert\") pod \"e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw\" (UID: \"3eb309b9-abfa-4b3a-b447-fca1a5421a15\") " pod="openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw"
Sep 20 01:00:51.346560 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.346523    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3eb309b9-abfa-4b3a-b447-fca1a5421a15-istio-data\") pod \"e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw\" (UID: \"3eb309b9-abfa-4b3a-b447-fca1a5421a15\") " pod="openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw"
Sep 20 01:00:51.346917 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.346643    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3eb309b9-abfa-4b3a-b447-fca1a5421a15-workload-certs\") pod \"e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw\" (UID: \"3eb309b9-abfa-4b3a-b447-fca1a5421a15\") " pod="openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw"
Sep 20 01:00:51.347002 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.346915    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3eb309b9-abfa-4b3a-b447-fca1a5421a15-workload-socket\") pod \"e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw\" (UID: \"3eb309b9-abfa-4b3a-b447-fca1a5421a15\") " pod="openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw"
Sep 20 01:00:51.347002 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.346973    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3eb309b9-abfa-4b3a-b447-fca1a5421a15-istiod-ca-cert\") pod \"e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw\" (UID: \"3eb309b9-abfa-4b3a-b447-fca1a5421a15\") " pod="openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw"
Sep 20 01:00:51.347132 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.347104    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3eb309b9-abfa-4b3a-b447-fca1a5421a15-credential-socket\") pod \"e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw\" (UID: \"3eb309b9-abfa-4b3a-b447-fca1a5421a15\") " pod="openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw"
Sep 20 01:00:51.348026 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.348000    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3eb309b9-abfa-4b3a-b447-fca1a5421a15-istio-podinfo\") pod \"e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw\" (UID: \"3eb309b9-abfa-4b3a-b447-fca1a5421a15\") " pod="openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw"
Sep 20 01:00:51.349292 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.349250    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3eb309b9-abfa-4b3a-b447-fca1a5421a15-istio-envoy\") pod \"e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw\" (UID: \"3eb309b9-abfa-4b3a-b447-fca1a5421a15\") " pod="openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw"
Sep 20 01:00:51.354163 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.354136    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3eb309b9-abfa-4b3a-b447-fca1a5421a15-istio-token\") pod \"e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw\" (UID: \"3eb309b9-abfa-4b3a-b447-fca1a5421a15\") " pod="openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw"
Sep 20 01:00:51.354379 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.354358    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rprd4\" (UniqueName: \"kubernetes.io/projected/3eb309b9-abfa-4b3a-b447-fca1a5421a15-kube-api-access-rprd4\") pod \"e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw\" (UID: \"3eb309b9-abfa-4b3a-b447-fca1a5421a15\") " pod="openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw"
Sep 20 01:00:51.489413 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.489371    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw"
Sep 20 01:00:51.618431 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.618407    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl"]
Sep 20 01:00:51.620577 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:00:51.620551    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod008e3f25_a8f0_42f0_a09e_3e4166749faa.slice/crio-2ff5efddf3b61fe965ad5b6001f26537c1c4a002bf7c005e4440c836b4193960 WatchSource:0}: Error finding container 2ff5efddf3b61fe965ad5b6001f26537c1c4a002bf7c005e4440c836b4193960: Status 404 returned error can't find the container with id 2ff5efddf3b61fe965ad5b6001f26537c1c4a002bf7c005e4440c836b4193960
Sep 20 01:00:51.622711 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.622679    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:00:51.622794 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.622756    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:00:51.622848 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.622800    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:00:51.764331 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.764308    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw"]
Sep 20 01:00:51.767333 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:00:51.767306    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3eb309b9_abfa_4b3a_b447_fca1a5421a15.slice/crio-847b87f138561c6331e75ab7a1ccb5677a39c0c8f7e7608f032bea10a6428704 WatchSource:0}: Error finding container 847b87f138561c6331e75ab7a1ccb5677a39c0c8f7e7608f032bea10a6428704: Status 404 returned error can't find the container with id 847b87f138561c6331e75ab7a1ccb5677a39c0c8f7e7608f032bea10a6428704
Sep 20 01:00:51.770265 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.770235    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:00:51.770379 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.770304    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:00:51.770379 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:51.770332    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:00:52.200254 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:52.200215    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw" event={"ID":"3eb309b9-abfa-4b3a-b447-fca1a5421a15","Type":"ContainerStarted","Data":"ad34c5365078c43de51caefb9a64dcfbbae8109cc8ec760ca65080699269c286"}
Sep 20 01:00:52.200687 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:52.200289    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw" event={"ID":"3eb309b9-abfa-4b3a-b447-fca1a5421a15","Type":"ContainerStarted","Data":"847b87f138561c6331e75ab7a1ccb5677a39c0c8f7e7608f032bea10a6428704"}
Sep 20 01:00:52.202298 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:52.202263    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl" event={"ID":"008e3f25-a8f0-42f0-a09e-3e4166749faa","Type":"ContainerStarted","Data":"46d19f3039b7b63a35c21ba233a2ea0570dded53eed83bd551f4c4a6e0b8ddb7"}
Sep 20 01:00:52.202402 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:52.202321    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl" event={"ID":"008e3f25-a8f0-42f0-a09e-3e4166749faa","Type":"ContainerStarted","Data":"2ff5efddf3b61fe965ad5b6001f26537c1c4a002bf7c005e4440c836b4193960"}
Sep 20 01:00:52.220014 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:52.219965    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw" podStartSLOduration=1.219947646 podStartE2EDuration="1.219947646s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:00:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:00:52.218654463 +0000 UTC m=+788.832810385" watchObservedRunningTime="2026-09-20 01:00:52.219947646 +0000 UTC m=+788.834103545"
Sep 20 01:00:52.239210 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:52.239164    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl" podStartSLOduration=2.239148899 podStartE2EDuration="2.239148899s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:00:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:00:52.237574442 +0000 UTC m=+788.851730391" watchObservedRunningTime="2026-09-20 01:00:52.239148899 +0000 UTC m=+788.853304795"
Sep 20 01:00:52.329255 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:52.329219    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl"
Sep 20 01:00:52.334195 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:52.334166    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl"
Sep 20 01:00:52.490418 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:52.490333    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw"
Sep 20 01:00:52.495187 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:52.495164    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw"
Sep 20 01:00:53.207852 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:53.207818    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl"
Sep 20 01:00:53.208305 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:53.207893    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw"
Sep 20 01:00:53.208582 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:53.208561    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw"
Sep 20 01:00:53.208688 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:53.208671    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl"
Sep 20 01:00:55.707710 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:55.707676    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-e2e8bc-57f58c8cfd-6dn2t"]
Sep 20 01:00:55.711276 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:55.711258    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-e2e8bc-57f58c8cfd-6dn2t"
Sep 20 01:00:55.716165 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:55.716142    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-e2e8bc-dockercfg-jng4h\""
Sep 20 01:00:55.716263 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:55.716142    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-e2e8bc\""
Sep 20 01:00:55.729165 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:55.729138    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-e2e8bc-57f58c8cfd-6dn2t"]
Sep 20 01:00:55.731127 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:55.731107    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-e2e8bc-58f75785bf-wbzxs"]
Sep 20 01:00:55.734527 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:55.734508    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-e2e8bc-58f75785bf-wbzxs"
Sep 20 01:00:55.746300 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:55.746273    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-e2e8bc-58f75785bf-wbzxs"]
Sep 20 01:00:55.792612 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:55.792580    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4psg\" (UniqueName: \"kubernetes.io/projected/f5edfb15-d988-4370-8eb6-f27c3628abdc-kube-api-access-j4psg\") pod \"payload-processing-e2e-worker-w0-e2e8bc-58f75785bf-wbzxs\" (UID: \"f5edfb15-d988-4370-8eb6-f27c3628abdc\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-e2e8bc-58f75785bf-wbzxs"
Sep 20 01:00:55.792750 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:55.792636    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmhv2\" (UniqueName: \"kubernetes.io/projected/17e26ad0-572c-4a3a-972f-21e24f432836-kube-api-access-tmhv2\") pod \"payload-pre-processing-e2e-worker-w0-e2e8bc-57f58c8cfd-6dn2t\" (UID: \"17e26ad0-572c-4a3a-972f-21e24f432836\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-e2e8bc-57f58c8cfd-6dn2t"
Sep 20 01:00:55.792750 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:55.792661    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5edfb15-d988-4370-8eb6-f27c3628abdc-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-e2e8bc-58f75785bf-wbzxs\" (UID: \"f5edfb15-d988-4370-8eb6-f27c3628abdc\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-e2e8bc-58f75785bf-wbzxs"
Sep 20 01:00:55.792750 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:55.792722    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17e26ad0-572c-4a3a-972f-21e24f432836-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-e2e8bc-57f58c8cfd-6dn2t\" (UID: \"17e26ad0-572c-4a3a-972f-21e24f432836\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-e2e8bc-57f58c8cfd-6dn2t"
Sep 20 01:00:55.893826 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:55.893732    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmhv2\" (UniqueName: \"kubernetes.io/projected/17e26ad0-572c-4a3a-972f-21e24f432836-kube-api-access-tmhv2\") pod \"payload-pre-processing-e2e-worker-w0-e2e8bc-57f58c8cfd-6dn2t\" (UID: \"17e26ad0-572c-4a3a-972f-21e24f432836\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-e2e8bc-57f58c8cfd-6dn2t"
Sep 20 01:00:55.893826 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:55.893805    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5edfb15-d988-4370-8eb6-f27c3628abdc-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-e2e8bc-58f75785bf-wbzxs\" (UID: \"f5edfb15-d988-4370-8eb6-f27c3628abdc\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-e2e8bc-58f75785bf-wbzxs"
Sep 20 01:00:55.894059 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:55.893878    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17e26ad0-572c-4a3a-972f-21e24f432836-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-e2e8bc-57f58c8cfd-6dn2t\" (UID: \"17e26ad0-572c-4a3a-972f-21e24f432836\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-e2e8bc-57f58c8cfd-6dn2t"
Sep 20 01:00:55.894059 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:55.893935    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4psg\" (UniqueName: \"kubernetes.io/projected/f5edfb15-d988-4370-8eb6-f27c3628abdc-kube-api-access-j4psg\") pod \"payload-processing-e2e-worker-w0-e2e8bc-58f75785bf-wbzxs\" (UID: \"f5edfb15-d988-4370-8eb6-f27c3628abdc\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-e2e8bc-58f75785bf-wbzxs"
Sep 20 01:00:55.894555 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:55.894535    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5edfb15-d988-4370-8eb6-f27c3628abdc-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-e2e8bc-58f75785bf-wbzxs\" (UID: \"f5edfb15-d988-4370-8eb6-f27c3628abdc\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-e2e8bc-58f75785bf-wbzxs"
Sep 20 01:00:55.894626 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:55.894605    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17e26ad0-572c-4a3a-972f-21e24f432836-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-e2e8bc-57f58c8cfd-6dn2t\" (UID: \"17e26ad0-572c-4a3a-972f-21e24f432836\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-e2e8bc-57f58c8cfd-6dn2t"
Sep 20 01:00:55.901487 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:55.901464    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4psg\" (UniqueName: \"kubernetes.io/projected/f5edfb15-d988-4370-8eb6-f27c3628abdc-kube-api-access-j4psg\") pod \"payload-processing-e2e-worker-w0-e2e8bc-58f75785bf-wbzxs\" (UID: \"f5edfb15-d988-4370-8eb6-f27c3628abdc\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-e2e8bc-58f75785bf-wbzxs"
Sep 20 01:00:55.901699 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:55.901678    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmhv2\" (UniqueName: \"kubernetes.io/projected/17e26ad0-572c-4a3a-972f-21e24f432836-kube-api-access-tmhv2\") pod \"payload-pre-processing-e2e-worker-w0-e2e8bc-57f58c8cfd-6dn2t\" (UID: \"17e26ad0-572c-4a3a-972f-21e24f432836\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-e2e8bc-57f58c8cfd-6dn2t"
Sep 20 01:00:56.022561 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:56.022477    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-e2e8bc-57f58c8cfd-6dn2t"
Sep 20 01:00:56.046560 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:56.046531    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-e2e8bc-58f75785bf-wbzxs"
Sep 20 01:00:56.296437 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:56.296367    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-e2e8bc-57f58c8cfd-6dn2t"]
Sep 20 01:00:56.299470 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:00:56.299448    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17e26ad0_572c_4a3a_972f_21e24f432836.slice/crio-1971ceaa22d45a4cccf9a79754fde5f6d55ef361f978a17a0edbf33fc75a967c WatchSource:0}: Error finding container 1971ceaa22d45a4cccf9a79754fde5f6d55ef361f978a17a0edbf33fc75a967c: Status 404 returned error can't find the container with id 1971ceaa22d45a4cccf9a79754fde5f6d55ef361f978a17a0edbf33fc75a967c
Sep 20 01:00:56.328510 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:56.328488    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-e2e8bc-58f75785bf-wbzxs"]
Sep 20 01:00:56.331130 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:00:56.331105    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5edfb15_d988_4370_8eb6_f27c3628abdc.slice/crio-08708ae95258d8837e45c8a2562513eb898a66eac60784c269c9e4c714542134 WatchSource:0}: Error finding container 08708ae95258d8837e45c8a2562513eb898a66eac60784c269c9e4c714542134: Status 404 returned error can't find the container with id 08708ae95258d8837e45c8a2562513eb898a66eac60784c269c9e4c714542134
Sep 20 01:00:56.792673 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:56.792646    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-4e301e-779cf8d855-vcx2q"]
Sep 20 01:00:56.796361 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:56.796341    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-4e301e-779cf8d855-vcx2q"
Sep 20 01:00:56.798506 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:56.798483    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-4e301e\""
Sep 20 01:00:56.798506 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:56.798497    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-4e301e-dockercfg-x5zwd\""
Sep 20 01:00:56.806565 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:56.806543    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-4e301e-779cf8d855-vcx2q"]
Sep 20 01:00:56.903708 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:56.903674    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a6b99d7-c704-4470-8dbd-afd2dc4e0be6-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-4e301e-779cf8d855-vcx2q\" (UID: \"9a6b99d7-c704-4470-8dbd-afd2dc4e0be6\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-4e301e-779cf8d855-vcx2q"
Sep 20 01:00:56.903927 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:56.903726    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sst4j\" (UniqueName: \"kubernetes.io/projected/9a6b99d7-c704-4470-8dbd-afd2dc4e0be6-kube-api-access-sst4j\") pod \"payload-processing-e2e-worker-w4-4e301e-779cf8d855-vcx2q\" (UID: \"9a6b99d7-c704-4470-8dbd-afd2dc4e0be6\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-4e301e-779cf8d855-vcx2q"
Sep 20 01:00:57.004944 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:57.004892    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a6b99d7-c704-4470-8dbd-afd2dc4e0be6-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-4e301e-779cf8d855-vcx2q\" (UID: \"9a6b99d7-c704-4470-8dbd-afd2dc4e0be6\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-4e301e-779cf8d855-vcx2q"
Sep 20 01:00:57.005164 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:57.004971    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sst4j\" (UniqueName: \"kubernetes.io/projected/9a6b99d7-c704-4470-8dbd-afd2dc4e0be6-kube-api-access-sst4j\") pod \"payload-processing-e2e-worker-w4-4e301e-779cf8d855-vcx2q\" (UID: \"9a6b99d7-c704-4470-8dbd-afd2dc4e0be6\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-4e301e-779cf8d855-vcx2q"
Sep 20 01:00:57.005754 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:57.005731    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a6b99d7-c704-4470-8dbd-afd2dc4e0be6-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-4e301e-779cf8d855-vcx2q\" (UID: \"9a6b99d7-c704-4470-8dbd-afd2dc4e0be6\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-4e301e-779cf8d855-vcx2q"
Sep 20 01:00:57.013128 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:57.013105    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sst4j\" (UniqueName: \"kubernetes.io/projected/9a6b99d7-c704-4470-8dbd-afd2dc4e0be6-kube-api-access-sst4j\") pod \"payload-processing-e2e-worker-w4-4e301e-779cf8d855-vcx2q\" (UID: \"9a6b99d7-c704-4470-8dbd-afd2dc4e0be6\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-4e301e-779cf8d855-vcx2q"
Sep 20 01:00:57.108335 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:57.108261    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-4e301e-779cf8d855-vcx2q"
Sep 20 01:00:57.232386 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:57.232132    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-e2e8bc-58f75785bf-wbzxs" event={"ID":"f5edfb15-d988-4370-8eb6-f27c3628abdc","Type":"ContainerStarted","Data":"1069f503bc5234c12d760f9357805d3dd51cd606aceb1f516f1a5f3346f5db1d"}
Sep 20 01:00:57.232651 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:57.232632    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-e2e8bc-58f75785bf-wbzxs"
Sep 20 01:00:57.232817 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:57.232802    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-e2e8bc-58f75785bf-wbzxs" event={"ID":"f5edfb15-d988-4370-8eb6-f27c3628abdc","Type":"ContainerStarted","Data":"08708ae95258d8837e45c8a2562513eb898a66eac60784c269c9e4c714542134"}
Sep 20 01:00:57.234294 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:57.234270    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-e2e8bc-57f58c8cfd-6dn2t" event={"ID":"17e26ad0-572c-4a3a-972f-21e24f432836","Type":"ContainerStarted","Data":"cfd6721449e789b9e252ce7a98cf7e5672acf729c33ac71e1eff5183288e6c74"}
Sep 20 01:00:57.234407 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:57.234311    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-e2e8bc-57f58c8cfd-6dn2t" event={"ID":"17e26ad0-572c-4a3a-972f-21e24f432836","Type":"ContainerStarted","Data":"1971ceaa22d45a4cccf9a79754fde5f6d55ef361f978a17a0edbf33fc75a967c"}
Sep 20 01:00:57.234723 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:57.234707    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-e2e8bc-57f58c8cfd-6dn2t"
Sep 20 01:00:57.250383 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:57.250332    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w0-e2e8bc-58f75785bf-wbzxs" podStartSLOduration=2.2503126460000002 podStartE2EDuration="2.250312646s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:00:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:00:57.249447943 +0000 UTC m=+793.863603851" watchObservedRunningTime="2026-09-20 01:00:57.250312646 +0000 UTC m=+793.864468544"
Sep 20 01:00:57.265982 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:57.265937    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-e2e8bc-57f58c8cfd-6dn2t" podStartSLOduration=2.265924898 podStartE2EDuration="2.265924898s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:00:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:00:57.264552367 +0000 UTC m=+793.878708266" watchObservedRunningTime="2026-09-20 01:00:57.265924898 +0000 UTC m=+793.880080794"
Sep 20 01:00:57.386766 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:57.385654    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-4e301e-779cf8d855-vcx2q"]
Sep 20 01:00:57.390288 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:00:57.390258    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a6b99d7_c704_4470_8dbd_afd2dc4e0be6.slice/crio-3ccfd0ccc918d60693a92026e67f80700cdc1e643db4ad644e5242381642755f WatchSource:0}: Error finding container 3ccfd0ccc918d60693a92026e67f80700cdc1e643db4ad644e5242381642755f: Status 404 returned error can't find the container with id 3ccfd0ccc918d60693a92026e67f80700cdc1e643db4ad644e5242381642755f
Sep 20 01:00:57.991671 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:57.991628    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-2fd525-788df86f6f-fvf2s"]
Sep 20 01:00:57.995629 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:57.995604    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-2fd525-788df86f6f-fvf2s"
Sep 20 01:00:57.997960 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:57.997936    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-2fd525-dockercfg-cxlt5\""
Sep 20 01:00:57.998058 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:57.998014    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-2fd525\""
Sep 20 01:00:58.003929 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:58.003878    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-2fd525-788df86f6f-fvf2s"]
Sep 20 01:00:58.118666 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:58.118632    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4970e83f-b770-4bef-a595-f95674094c5b-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-2fd525-788df86f6f-fvf2s\" (UID: \"4970e83f-b770-4bef-a595-f95674094c5b\") " pod="openshift-ingress/payload-processing-e2e-inf-a-2fd525-788df86f6f-fvf2s"
Sep 20 01:00:58.118854 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:58.118815    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktbd6\" (UniqueName: \"kubernetes.io/projected/4970e83f-b770-4bef-a595-f95674094c5b-kube-api-access-ktbd6\") pod \"payload-processing-e2e-inf-a-2fd525-788df86f6f-fvf2s\" (UID: \"4970e83f-b770-4bef-a595-f95674094c5b\") " pod="openshift-ingress/payload-processing-e2e-inf-a-2fd525-788df86f6f-fvf2s"
Sep 20 01:00:58.220114 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:58.220070    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktbd6\" (UniqueName: \"kubernetes.io/projected/4970e83f-b770-4bef-a595-f95674094c5b-kube-api-access-ktbd6\") pod \"payload-processing-e2e-inf-a-2fd525-788df86f6f-fvf2s\" (UID: \"4970e83f-b770-4bef-a595-f95674094c5b\") " pod="openshift-ingress/payload-processing-e2e-inf-a-2fd525-788df86f6f-fvf2s"
Sep 20 01:00:58.220300 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:58.220151    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4970e83f-b770-4bef-a595-f95674094c5b-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-2fd525-788df86f6f-fvf2s\" (UID: \"4970e83f-b770-4bef-a595-f95674094c5b\") " pod="openshift-ingress/payload-processing-e2e-inf-a-2fd525-788df86f6f-fvf2s"
Sep 20 01:00:58.220977 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:58.220953    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4970e83f-b770-4bef-a595-f95674094c5b-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-2fd525-788df86f6f-fvf2s\" (UID: \"4970e83f-b770-4bef-a595-f95674094c5b\") " pod="openshift-ingress/payload-processing-e2e-inf-a-2fd525-788df86f6f-fvf2s"
Sep 20 01:00:58.228035 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:58.227852    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktbd6\" (UniqueName: \"kubernetes.io/projected/4970e83f-b770-4bef-a595-f95674094c5b-kube-api-access-ktbd6\") pod \"payload-processing-e2e-inf-a-2fd525-788df86f6f-fvf2s\" (UID: \"4970e83f-b770-4bef-a595-f95674094c5b\") " pod="openshift-ingress/payload-processing-e2e-inf-a-2fd525-788df86f6f-fvf2s"
Sep 20 01:00:58.241090 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:58.241056    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-4e301e-779cf8d855-vcx2q" event={"ID":"9a6b99d7-c704-4470-8dbd-afd2dc4e0be6","Type":"ContainerStarted","Data":"c99ffc2284fc148431fae78a5be085bf6b4d3efc024be5882fe0a94d3163a79e"}
Sep 20 01:00:58.241199 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:58.241112    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-4e301e-779cf8d855-vcx2q" event={"ID":"9a6b99d7-c704-4470-8dbd-afd2dc4e0be6","Type":"ContainerStarted","Data":"3ccfd0ccc918d60693a92026e67f80700cdc1e643db4ad644e5242381642755f"}
Sep 20 01:00:58.256838 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:58.256724    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w4-4e301e-779cf8d855-vcx2q" podStartSLOduration=2.256704646 podStartE2EDuration="2.256704646s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:00:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:00:58.256463847 +0000 UTC m=+794.870619789" watchObservedRunningTime="2026-09-20 01:00:58.256704646 +0000 UTC m=+794.870860557"
Sep 20 01:00:58.310278 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:58.310250    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-2fd525-788df86f6f-fvf2s"
Sep 20 01:00:58.589193 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:58.589161    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-2fd525-788df86f6f-fvf2s"]
Sep 20 01:00:58.590385 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:00:58.590353    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4970e83f_b770_4bef_a595_f95674094c5b.slice/crio-00473addf354a86280e0c60ed70953819b83baf3cf8e2aa703a435a8edbbc3b9 WatchSource:0}: Error finding container 00473addf354a86280e0c60ed70953819b83baf3cf8e2aa703a435a8edbbc3b9: Status 404 returned error can't find the container with id 00473addf354a86280e0c60ed70953819b83baf3cf8e2aa703a435a8edbbc3b9
Sep 20 01:00:59.248593 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:59.248544    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-2fd525-788df86f6f-fvf2s" event={"ID":"4970e83f-b770-4bef-a595-f95674094c5b","Type":"ContainerStarted","Data":"e2386244598108dcb7a387f320921031d769ef4b4be426f79353cb8a8d939a72"}
Sep 20 01:00:59.249119 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:59.248614    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-2fd525-788df86f6f-fvf2s" event={"ID":"4970e83f-b770-4bef-a595-f95674094c5b","Type":"ContainerStarted","Data":"00473addf354a86280e0c60ed70953819b83baf3cf8e2aa703a435a8edbbc3b9"}
Sep 20 01:00:59.249180 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:59.249169    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-2fd525-788df86f6f-fvf2s"
Sep 20 01:00:59.249219 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:59.249210    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-4e301e-779cf8d855-vcx2q"
Sep 20 01:00:59.272846 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:00:59.272783    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-2fd525-788df86f6f-fvf2s" podStartSLOduration=2.272764891 podStartE2EDuration="2.272764891s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:00:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:00:59.268533881 +0000 UTC m=+795.882689779" watchObservedRunningTime="2026-09-20 01:00:59.272764891 +0000 UTC m=+795.886920790"
Sep 20 01:01:06.899017 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:06.898981    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-173fde-76dc8f579d-kgkl8"]
Sep 20 01:01:06.904612 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:06.904223    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-173fde-76dc8f579d-kgkl8"
Sep 20 01:01:06.908435 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:06.908195    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-173fde\""
Sep 20 01:01:06.908580 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:06.908499    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-173fde-76dc8f579d-kgkl8"]
Sep 20 01:01:06.908990 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:06.908968    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-173fde-dockercfg-zvfmp\""
Sep 20 01:01:06.926129 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:06.926091    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-173fde-66f5ffd4c7-b4qpd"]
Sep 20 01:01:06.929872 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:06.929832    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-173fde-66f5ffd4c7-b4qpd"
Sep 20 01:01:06.945472 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:06.945447    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-173fde-66f5ffd4c7-b4qpd"]
Sep 20 01:01:07.019586 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:07.019541    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqjnr\" (UniqueName: \"kubernetes.io/projected/03055f25-00b5-4b37-8db8-9eac71eb747d-kube-api-access-qqjnr\") pod \"payload-pre-processing-e2e-autores-173fde-76dc8f579d-kgkl8\" (UID: \"03055f25-00b5-4b37-8db8-9eac71eb747d\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-173fde-76dc8f579d-kgkl8"
Sep 20 01:01:07.019798 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:07.019617    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03055f25-00b5-4b37-8db8-9eac71eb747d-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-173fde-76dc8f579d-kgkl8\" (UID: \"03055f25-00b5-4b37-8db8-9eac71eb747d\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-173fde-76dc8f579d-kgkl8"
Sep 20 01:01:07.019798 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:07.019694    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03609516-a4f2-48f0-bc8e-7599b6d5e222-plugins-config-volume\") pod \"payload-processing-e2e-autores-173fde-66f5ffd4c7-b4qpd\" (UID: \"03609516-a4f2-48f0-bc8e-7599b6d5e222\") " pod="openshift-ingress/payload-processing-e2e-autores-173fde-66f5ffd4c7-b4qpd"
Sep 20 01:01:07.019798 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:07.019742    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvdzn\" (UniqueName: \"kubernetes.io/projected/03609516-a4f2-48f0-bc8e-7599b6d5e222-kube-api-access-wvdzn\") pod \"payload-processing-e2e-autores-173fde-66f5ffd4c7-b4qpd\" (UID: \"03609516-a4f2-48f0-bc8e-7599b6d5e222\") " pod="openshift-ingress/payload-processing-e2e-autores-173fde-66f5ffd4c7-b4qpd"
Sep 20 01:01:07.120469 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:07.120423    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvdzn\" (UniqueName: \"kubernetes.io/projected/03609516-a4f2-48f0-bc8e-7599b6d5e222-kube-api-access-wvdzn\") pod \"payload-processing-e2e-autores-173fde-66f5ffd4c7-b4qpd\" (UID: \"03609516-a4f2-48f0-bc8e-7599b6d5e222\") " pod="openshift-ingress/payload-processing-e2e-autores-173fde-66f5ffd4c7-b4qpd"
Sep 20 01:01:07.120672 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:07.120526    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqjnr\" (UniqueName: \"kubernetes.io/projected/03055f25-00b5-4b37-8db8-9eac71eb747d-kube-api-access-qqjnr\") pod \"payload-pre-processing-e2e-autores-173fde-76dc8f579d-kgkl8\" (UID: \"03055f25-00b5-4b37-8db8-9eac71eb747d\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-173fde-76dc8f579d-kgkl8"
Sep 20 01:01:07.120672 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:07.120568    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03055f25-00b5-4b37-8db8-9eac71eb747d-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-173fde-76dc8f579d-kgkl8\" (UID: \"03055f25-00b5-4b37-8db8-9eac71eb747d\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-173fde-76dc8f579d-kgkl8"
Sep 20 01:01:07.120672 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:07.120631    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03609516-a4f2-48f0-bc8e-7599b6d5e222-plugins-config-volume\") pod \"payload-processing-e2e-autores-173fde-66f5ffd4c7-b4qpd\" (UID: \"03609516-a4f2-48f0-bc8e-7599b6d5e222\") " pod="openshift-ingress/payload-processing-e2e-autores-173fde-66f5ffd4c7-b4qpd"
Sep 20 01:01:07.121535 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:07.121510    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03609516-a4f2-48f0-bc8e-7599b6d5e222-plugins-config-volume\") pod \"payload-processing-e2e-autores-173fde-66f5ffd4c7-b4qpd\" (UID: \"03609516-a4f2-48f0-bc8e-7599b6d5e222\") " pod="openshift-ingress/payload-processing-e2e-autores-173fde-66f5ffd4c7-b4qpd"
Sep 20 01:01:07.121697 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:07.121679    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03055f25-00b5-4b37-8db8-9eac71eb747d-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-173fde-76dc8f579d-kgkl8\" (UID: \"03055f25-00b5-4b37-8db8-9eac71eb747d\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-173fde-76dc8f579d-kgkl8"
Sep 20 01:01:07.128853 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:07.128823    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqjnr\" (UniqueName: \"kubernetes.io/projected/03055f25-00b5-4b37-8db8-9eac71eb747d-kube-api-access-qqjnr\") pod \"payload-pre-processing-e2e-autores-173fde-76dc8f579d-kgkl8\" (UID: \"03055f25-00b5-4b37-8db8-9eac71eb747d\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-173fde-76dc8f579d-kgkl8"
Sep 20 01:01:07.129009 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:07.128994    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvdzn\" (UniqueName: \"kubernetes.io/projected/03609516-a4f2-48f0-bc8e-7599b6d5e222-kube-api-access-wvdzn\") pod \"payload-processing-e2e-autores-173fde-66f5ffd4c7-b4qpd\" (UID: \"03609516-a4f2-48f0-bc8e-7599b6d5e222\") " pod="openshift-ingress/payload-processing-e2e-autores-173fde-66f5ffd4c7-b4qpd"
Sep 20 01:01:07.219095 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:07.218991    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-173fde-76dc8f579d-kgkl8"
Sep 20 01:01:07.240142 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:07.240113    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-173fde-66f5ffd4c7-b4qpd"
Sep 20 01:01:07.569046 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:07.568890    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-173fde-76dc8f579d-kgkl8"]
Sep 20 01:01:07.581412 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:01:07.581374    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03055f25_00b5_4b37_8db8_9eac71eb747d.slice/crio-4ac2c2ad7fbbc5be6315bf8245e3fc782cdd77b10e12cc398d394b93ef69c7a2 WatchSource:0}: Error finding container 4ac2c2ad7fbbc5be6315bf8245e3fc782cdd77b10e12cc398d394b93ef69c7a2: Status 404 returned error can't find the container with id 4ac2c2ad7fbbc5be6315bf8245e3fc782cdd77b10e12cc398d394b93ef69c7a2
Sep 20 01:01:07.642668 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:07.642640    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-173fde-66f5ffd4c7-b4qpd"]
Sep 20 01:01:07.912889 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:07.912736    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e3070304-7c86775bc9-6q9l7"]
Sep 20 01:01:07.920221 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:07.920201    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-e3070304-7c86775bc9-6q9l7"
Sep 20 01:01:07.922907 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:07.922706    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-e3070304\""
Sep 20 01:01:07.923283 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:07.923232    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-e3070304-dockercfg-jrwlb\""
Sep 20 01:01:07.931559 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:07.931533    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e3070304-7c86775bc9-6q9l7"]
Sep 20 01:01:08.029419 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:08.029377    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8m4v\" (UniqueName: \"kubernetes.io/projected/5f77517a-9e6e-4d29-a0dd-fede0ad781ca-kube-api-access-h8m4v\") pod \"payload-processing-e2e-ait-e3070304-7c86775bc9-6q9l7\" (UID: \"5f77517a-9e6e-4d29-a0dd-fede0ad781ca\") " pod="openshift-ingress/payload-processing-e2e-ait-e3070304-7c86775bc9-6q9l7"
Sep 20 01:01:08.029617 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:08.029428    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f77517a-9e6e-4d29-a0dd-fede0ad781ca-plugins-config-volume\") pod \"payload-processing-e2e-ait-e3070304-7c86775bc9-6q9l7\" (UID: \"5f77517a-9e6e-4d29-a0dd-fede0ad781ca\") " pod="openshift-ingress/payload-processing-e2e-ait-e3070304-7c86775bc9-6q9l7"
Sep 20 01:01:08.131103 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:08.131060    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8m4v\" (UniqueName: \"kubernetes.io/projected/5f77517a-9e6e-4d29-a0dd-fede0ad781ca-kube-api-access-h8m4v\") pod \"payload-processing-e2e-ait-e3070304-7c86775bc9-6q9l7\" (UID: \"5f77517a-9e6e-4d29-a0dd-fede0ad781ca\") " pod="openshift-ingress/payload-processing-e2e-ait-e3070304-7c86775bc9-6q9l7"
Sep 20 01:01:08.131103 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:08.131104    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f77517a-9e6e-4d29-a0dd-fede0ad781ca-plugins-config-volume\") pod \"payload-processing-e2e-ait-e3070304-7c86775bc9-6q9l7\" (UID: \"5f77517a-9e6e-4d29-a0dd-fede0ad781ca\") " pod="openshift-ingress/payload-processing-e2e-ait-e3070304-7c86775bc9-6q9l7"
Sep 20 01:01:08.131792 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:08.131770    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f77517a-9e6e-4d29-a0dd-fede0ad781ca-plugins-config-volume\") pod \"payload-processing-e2e-ait-e3070304-7c86775bc9-6q9l7\" (UID: \"5f77517a-9e6e-4d29-a0dd-fede0ad781ca\") " pod="openshift-ingress/payload-processing-e2e-ait-e3070304-7c86775bc9-6q9l7"
Sep 20 01:01:08.140311 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:08.140282    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8m4v\" (UniqueName: \"kubernetes.io/projected/5f77517a-9e6e-4d29-a0dd-fede0ad781ca-kube-api-access-h8m4v\") pod \"payload-processing-e2e-ait-e3070304-7c86775bc9-6q9l7\" (UID: \"5f77517a-9e6e-4d29-a0dd-fede0ad781ca\") " pod="openshift-ingress/payload-processing-e2e-ait-e3070304-7c86775bc9-6q9l7"
Sep 20 01:01:08.234165 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:08.234057    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-e3070304-7c86775bc9-6q9l7"
Sep 20 01:01:08.325837 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:08.325714    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-173fde-76dc8f579d-kgkl8" event={"ID":"03055f25-00b5-4b37-8db8-9eac71eb747d","Type":"ContainerStarted","Data":"ca653581d17c3464aa2fce4623e9919e8e533be09ba155817570e20201bc77a4"}
Sep 20 01:01:08.325837 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:08.325781    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-173fde-76dc8f579d-kgkl8" event={"ID":"03055f25-00b5-4b37-8db8-9eac71eb747d","Type":"ContainerStarted","Data":"4ac2c2ad7fbbc5be6315bf8245e3fc782cdd77b10e12cc398d394b93ef69c7a2"}
Sep 20 01:01:08.326143 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:08.326048    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-173fde-76dc8f579d-kgkl8"
Sep 20 01:01:08.328589 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:08.328552    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-173fde-66f5ffd4c7-b4qpd" event={"ID":"03609516-a4f2-48f0-bc8e-7599b6d5e222","Type":"ContainerStarted","Data":"c1ce2384cf45b51b729cde56aac8a2be9fcb02aa08cb5befda06687008e4113f"}
Sep 20 01:01:08.328760 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:08.328608    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-173fde-66f5ffd4c7-b4qpd" event={"ID":"03609516-a4f2-48f0-bc8e-7599b6d5e222","Type":"ContainerStarted","Data":"d81b8e5efce630095b793ca192f9dd2ce003f1bdc4dbad5e6be1dd938e28d74d"}
Sep 20 01:01:08.328916 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:08.328897    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-173fde-66f5ffd4c7-b4qpd"
Sep 20 01:01:08.345787 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:08.345150    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-autores-173fde-76dc8f579d-kgkl8" podStartSLOduration=2.345126939 podStartE2EDuration="2.345126939s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:01:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:01:08.343517001 +0000 UTC m=+804.957672918" watchObservedRunningTime="2026-09-20 01:01:08.345126939 +0000 UTC m=+804.959282837"
Sep 20 01:01:08.567715 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:08.567582    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-173fde-66f5ffd4c7-b4qpd" podStartSLOduration=2.567557505 podStartE2EDuration="2.567557505s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:01:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:01:08.383231649 +0000 UTC m=+804.997387547" watchObservedRunningTime="2026-09-20 01:01:08.567557505 +0000 UTC m=+805.181713404"
Sep 20 01:01:08.569829 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:08.569792    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e3070304-7c86775bc9-6q9l7"]
Sep 20 01:01:09.253721 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:09.253687    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-e2e8bc-58f75785bf-wbzxs"
Sep 20 01:01:09.254199 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:09.253775    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-e2e8bc-57f58c8cfd-6dn2t"
Sep 20 01:01:09.343378 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:09.343336    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-e3070304-7c86775bc9-6q9l7" event={"ID":"5f77517a-9e6e-4d29-a0dd-fede0ad781ca","Type":"ContainerStarted","Data":"93a7b9351221c54ef2e6e2ea96feeb677705991f773271dda927bbd09ae82204"}
Sep 20 01:01:09.343561 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:09.343390    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-e3070304-7c86775bc9-6q9l7" event={"ID":"5f77517a-9e6e-4d29-a0dd-fede0ad781ca","Type":"ContainerStarted","Data":"de8d9e7ffce94121eef61fb2234ad02498d835ad4655829c0d12b6200ac78d8b"}
Sep 20 01:01:09.344378 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:09.343880    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-e3070304-7c86775bc9-6q9l7"
Sep 20 01:01:10.255976 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:10.255943    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-4e301e-779cf8d855-vcx2q"
Sep 20 01:01:10.273749 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:10.273694    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-e3070304-7c86775bc9-6q9l7" podStartSLOduration=3.273671184 podStartE2EDuration="3.273671184s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:01:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:01:09.38885303 +0000 UTC m=+806.003008928" watchObservedRunningTime="2026-09-20 01:01:10.273671184 +0000 UTC m=+806.887827081"
Sep 20 01:01:11.260727 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:11.260689    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-2fd525-788df86f6f-fvf2s"
Sep 20 01:01:13.371068 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:13.371038    2570 generic.go:356] "Generic (PLEG): container finished" podID="3eb309b9-abfa-4b3a-b447-fca1a5421a15" containerID="ad34c5365078c43de51caefb9a64dcfbbae8109cc8ec760ca65080699269c286" exitCode=0
Sep 20 01:01:13.371486 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:13.371124    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw" event={"ID":"3eb309b9-abfa-4b3a-b447-fca1a5421a15","Type":"ContainerDied","Data":"ad34c5365078c43de51caefb9a64dcfbbae8109cc8ec760ca65080699269c286"}
Sep 20 01:01:13.371691 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:13.371671    2570 scope.go:117] "RemoveContainer" containerID="ad34c5365078c43de51caefb9a64dcfbbae8109cc8ec760ca65080699269c286"
Sep 20 01:01:13.373123 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:13.373085    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:01:13.373228 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:13.373184    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:01:13.373298 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:13.373234    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:01:14.382506 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:14.382472    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw" event={"ID":"3eb309b9-abfa-4b3a-b447-fca1a5421a15","Type":"ContainerStarted","Data":"fa89e0dc3e02ea5f94537620bdf2dc215345acc715da23fe2b5403aaf4d7f04e"}
Sep 20 01:01:14.384230 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:14.384206    2570 generic.go:356] "Generic (PLEG): container finished" podID="008e3f25-a8f0-42f0-a09e-3e4166749faa" containerID="46d19f3039b7b63a35c21ba233a2ea0570dded53eed83bd551f4c4a6e0b8ddb7" exitCode=0
Sep 20 01:01:14.384353 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:14.384278    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl" event={"ID":"008e3f25-a8f0-42f0-a09e-3e4166749faa","Type":"ContainerDied","Data":"46d19f3039b7b63a35c21ba233a2ea0570dded53eed83bd551f4c4a6e0b8ddb7"}
Sep 20 01:01:14.384662 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:14.384649    2570 scope.go:117] "RemoveContainer" containerID="46d19f3039b7b63a35c21ba233a2ea0570dded53eed83bd551f4c4a6e0b8ddb7"
Sep 20 01:01:14.385739 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:14.385716    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:01:14.385798 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:14.385788    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:01:14.385838 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:14.385822    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:01:14.489630 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:14.489540    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw"
Sep 20 01:01:14.489811 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:14.489710    2570 patch_prober.go:28] interesting pod/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 20 01:01:14.489811 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:14.489764    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw" podUID="3eb309b9-abfa-4b3a-b447-fca1a5421a15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 20 01:01:15.399127 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:15.398694    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl" event={"ID":"008e3f25-a8f0-42f0-a09e-3e4166749faa","Type":"ContainerStarted","Data":"eceb9b8c29f28bfed823f967e4fd1a9e6c085135350535dd7466c6745cac5551"}
Sep 20 01:01:15.490808 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:15.490753    2570 patch_prober.go:28] interesting pod/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 20 01:01:15.491045 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:15.490834    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw" podUID="3eb309b9-abfa-4b3a-b447-fca1a5421a15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 20 01:01:16.329474 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:16.329434    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl"
Sep 20 01:01:16.329675 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:16.329623    2570 patch_prober.go:28] interesting pod/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 20 01:01:16.329762 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:16.329685    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl" podUID="008e3f25-a8f0-42f0-a09e-3e4166749faa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 20 01:01:16.490235 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:16.490188    2570 patch_prober.go:28] interesting pod/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 20 01:01:16.490709 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:16.490279    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw" podUID="3eb309b9-abfa-4b3a-b447-fca1a5421a15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 20 01:01:17.329503 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:17.329464    2570 patch_prober.go:28] interesting pod/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 20 01:01:17.329679 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:17.329529    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl" podUID="008e3f25-a8f0-42f0-a09e-3e4166749faa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 20 01:01:17.489797 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:17.489759    2570 patch_prober.go:28] interesting pod/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 20 01:01:17.490099 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:17.490066    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw" podUID="3eb309b9-abfa-4b3a-b447-fca1a5421a15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 20 01:01:18.329303 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:18.329266    2570 patch_prober.go:28] interesting pod/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 20 01:01:18.329677 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:18.329364    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl" podUID="008e3f25-a8f0-42f0-a09e-3e4166749faa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 20 01:01:18.490773 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:18.490732    2570 patch_prober.go:28] interesting pod/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 20 01:01:18.491094 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:18.491061    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw" podUID="3eb309b9-abfa-4b3a-b447-fca1a5421a15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 20 01:01:19.329822 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:19.329783    2570 patch_prober.go:28] interesting pod/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 20 01:01:19.330243 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:19.329879    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl" podUID="008e3f25-a8f0-42f0-a09e-3e4166749faa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 20 01:01:19.344589 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:19.344565    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-173fde-66f5ffd4c7-b4qpd"
Sep 20 01:01:19.344973 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:19.344955    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-173fde-76dc8f579d-kgkl8"
Sep 20 01:01:19.489954 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:19.489910    2570 patch_prober.go:28] interesting pod/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 20 01:01:19.490131 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:19.489985    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw" podUID="3eb309b9-abfa-4b3a-b447-fca1a5421a15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 20 01:01:20.329143 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:20.329105    2570 patch_prober.go:28] interesting pod/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 20 01:01:20.329310 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:20.329185    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl" podUID="008e3f25-a8f0-42f0-a09e-3e4166749faa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 20 01:01:20.494214 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:20.494184    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw"
Sep 20 01:01:20.494723 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:20.494458    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw"
Sep 20 01:01:20.495219 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:20.495200    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw"
Sep 20 01:01:21.332913 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:21.332883    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl"
Sep 20 01:01:21.333198 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:21.333178    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl"
Sep 20 01:01:21.333813 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:21.333796    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl"
Sep 20 01:01:21.359330 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:21.359305    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-e3070304-7c86775bc9-6q9l7"
Sep 20 01:01:44.301565 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:44.301533    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e3070304-7c86775bc9-6q9l7"]
Sep 20 01:01:44.302065 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:44.301842    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-e3070304-7c86775bc9-6q9l7" podUID="5f77517a-9e6e-4d29-a0dd-fede0ad781ca" containerName="payload-processing" containerID="cri-o://93a7b9351221c54ef2e6e2ea96feeb677705991f773271dda927bbd09ae82204" gracePeriod=30
Sep 20 01:01:44.560794 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:44.560766    2570 generic.go:356] "Generic (PLEG): container finished" podID="5f77517a-9e6e-4d29-a0dd-fede0ad781ca" containerID="93a7b9351221c54ef2e6e2ea96feeb677705991f773271dda927bbd09ae82204" exitCode=0
Sep 20 01:01:44.560940 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:44.560841    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-e3070304-7c86775bc9-6q9l7" event={"ID":"5f77517a-9e6e-4d29-a0dd-fede0ad781ca","Type":"ContainerDied","Data":"93a7b9351221c54ef2e6e2ea96feeb677705991f773271dda927bbd09ae82204"}
Sep 20 01:01:44.560940 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:44.560925    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-e3070304-7c86775bc9-6q9l7" event={"ID":"5f77517a-9e6e-4d29-a0dd-fede0ad781ca","Type":"ContainerDied","Data":"de8d9e7ffce94121eef61fb2234ad02498d835ad4655829c0d12b6200ac78d8b"}
Sep 20 01:01:44.561032 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:44.560950    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="de8d9e7ffce94121eef61fb2234ad02498d835ad4655829c0d12b6200ac78d8b"
Sep 20 01:01:44.570271 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:44.570253    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-e3070304-7c86775bc9-6q9l7"
Sep 20 01:01:44.721790 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:44.721757    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h8m4v\" (UniqueName: \"kubernetes.io/projected/5f77517a-9e6e-4d29-a0dd-fede0ad781ca-kube-api-access-h8m4v\") pod \"5f77517a-9e6e-4d29-a0dd-fede0ad781ca\" (UID: \"5f77517a-9e6e-4d29-a0dd-fede0ad781ca\") "
Sep 20 01:01:44.722011 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:44.721812    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f77517a-9e6e-4d29-a0dd-fede0ad781ca-plugins-config-volume\") pod \"5f77517a-9e6e-4d29-a0dd-fede0ad781ca\" (UID: \"5f77517a-9e6e-4d29-a0dd-fede0ad781ca\") "
Sep 20 01:01:44.722173 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:44.722147    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f77517a-9e6e-4d29-a0dd-fede0ad781ca-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5f77517a-9e6e-4d29-a0dd-fede0ad781ca" (UID: "5f77517a-9e6e-4d29-a0dd-fede0ad781ca"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:01:44.724306 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:44.724282    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f77517a-9e6e-4d29-a0dd-fede0ad781ca-kube-api-access-h8m4v" (OuterVolumeSpecName: "kube-api-access-h8m4v") pod "5f77517a-9e6e-4d29-a0dd-fede0ad781ca" (UID: "5f77517a-9e6e-4d29-a0dd-fede0ad781ca"). InnerVolumeSpecName "kube-api-access-h8m4v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:01:44.823261 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:44.823180    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8m4v\" (UniqueName: \"kubernetes.io/projected/5f77517a-9e6e-4d29-a0dd-fede0ad781ca-kube-api-access-h8m4v\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:01:44.823261 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:44.823207    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f77517a-9e6e-4d29-a0dd-fede0ad781ca-plugins-config-volume\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:01:45.567380 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:45.567348    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-e3070304-7c86775bc9-6q9l7"
Sep 20 01:01:45.592185 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:45.592147    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e3070304-7c86775bc9-6q9l7"]
Sep 20 01:01:45.605308 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:45.605279    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e3070304-7c86775bc9-6q9l7"]
Sep 20 01:01:45.667837 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:45.667808    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2"]
Sep 20 01:01:45.668279 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:45.668265    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f77517a-9e6e-4d29-a0dd-fede0ad781ca" containerName="payload-processing"
Sep 20 01:01:45.668332 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:45.668281    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f77517a-9e6e-4d29-a0dd-fede0ad781ca" containerName="payload-processing"
Sep 20 01:01:45.668367 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:45.668356    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f77517a-9e6e-4d29-a0dd-fede0ad781ca" containerName="payload-processing"
Sep 20 01:01:45.670739 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:45.670719    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2"
Sep 20 01:01:45.673542 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:45.673524    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-816f617b-gw-openshift-default-dockercfg-4t868\""
Sep 20 01:01:45.694547 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:45.694518    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2"]
Sep 20 01:01:45.833266 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:45.833164    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd-istio-data\") pod \"e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2\" (UID: \"9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd\") " pod="openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2"
Sep 20 01:01:45.833266 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:45.833255    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd-workload-socket\") pod \"e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2\" (UID: \"9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd\") " pod="openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2"
Sep 20 01:01:45.833511 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:45.833294    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd-istiod-ca-cert\") pod \"e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2\" (UID: \"9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd\") " pod="openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2"
Sep 20 01:01:45.833511 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:45.833347    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd-workload-certs\") pod \"e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2\" (UID: \"9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd\") " pod="openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2"
Sep 20 01:01:45.833511 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:45.833384    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd-istio-podinfo\") pod \"e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2\" (UID: \"9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd\") " pod="openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2"
Sep 20 01:01:45.833511 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:45.833412    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nzh6\" (UniqueName: \"kubernetes.io/projected/9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd-kube-api-access-8nzh6\") pod \"e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2\" (UID: \"9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd\") " pod="openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2"
Sep 20 01:01:45.833511 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:45.833486    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd-istio-envoy\") pod \"e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2\" (UID: \"9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd\") " pod="openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2"
Sep 20 01:01:45.833829 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:45.833540    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd-istio-token\") pod \"e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2\" (UID: \"9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd\") " pod="openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2"
Sep 20 01:01:45.833829 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:45.833566    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd-credential-socket\") pod \"e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2\" (UID: \"9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd\") " pod="openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2"
Sep 20 01:01:45.934994 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:45.934954    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd-istio-envoy\") pod \"e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2\" (UID: \"9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd\") " pod="openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2"
Sep 20 01:01:45.935199 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:45.935021    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd-istio-token\") pod \"e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2\" (UID: \"9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd\") " pod="openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2"
Sep 20 01:01:45.935199 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:45.935047    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd-credential-socket\") pod \"e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2\" (UID: \"9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd\") " pod="openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2"
Sep 20 01:01:45.935199 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:45.935082    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd-istio-data\") pod \"e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2\" (UID: \"9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd\") " pod="openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2"
Sep 20 01:01:45.935199 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:45.935149    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd-workload-socket\") pod \"e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2\" (UID: \"9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd\") " pod="openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2"
Sep 20 01:01:45.935199 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:45.935183    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd-istiod-ca-cert\") pod \"e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2\" (UID: \"9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd\") " pod="openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2"
Sep 20 01:01:45.935533 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:45.935241    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd-workload-certs\") pod \"e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2\" (UID: \"9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd\") " pod="openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2"
Sep 20 01:01:45.935533 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:45.935271    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd-istio-podinfo\") pod \"e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2\" (UID: \"9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd\") " pod="openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2"
Sep 20 01:01:45.935533 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:45.935302    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nzh6\" (UniqueName: \"kubernetes.io/projected/9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd-kube-api-access-8nzh6\") pod \"e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2\" (UID: \"9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd\") " pod="openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2"
Sep 20 01:01:45.935683 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:45.935552    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd-workload-socket\") pod \"e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2\" (UID: \"9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd\") " pod="openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2"
Sep 20 01:01:45.935683 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:45.935590    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd-istio-data\") pod \"e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2\" (UID: \"9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd\") " pod="openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2"
Sep 20 01:01:45.935683 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:45.935623    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd-workload-certs\") pod \"e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2\" (UID: \"9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd\") " pod="openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2"
Sep 20 01:01:45.935846 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:45.935739    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd-credential-socket\") pod \"e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2\" (UID: \"9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd\") " pod="openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2"
Sep 20 01:01:45.935976 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:45.935958    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd-istiod-ca-cert\") pod \"e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2\" (UID: \"9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd\") " pod="openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2"
Sep 20 01:01:45.937456 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:45.937434    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd-istio-envoy\") pod \"e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2\" (UID: \"9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd\") " pod="openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2"
Sep 20 01:01:45.937781 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:45.937764    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd-istio-podinfo\") pod \"e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2\" (UID: \"9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd\") " pod="openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2"
Sep 20 01:01:45.943215 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:45.943194    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd-istio-token\") pod \"e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2\" (UID: \"9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd\") " pod="openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2"
Sep 20 01:01:45.943576 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:45.943554    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nzh6\" (UniqueName: \"kubernetes.io/projected/9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd-kube-api-access-8nzh6\") pod \"e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2\" (UID: \"9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd\") " pod="openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2"
Sep 20 01:01:45.981369 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:45.981335    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2"
Sep 20 01:01:46.255627 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:46.255595    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2"]
Sep 20 01:01:46.257657 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:01:46.257630    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ff16ea5_d008_4bbf_89c5_6acd4df6c7fd.slice/crio-66444a7535f6389afe2ead3f4472156b54b7a69bfeaa3af1d562b565fa2bc438 WatchSource:0}: Error finding container 66444a7535f6389afe2ead3f4472156b54b7a69bfeaa3af1d562b565fa2bc438: Status 404 returned error can't find the container with id 66444a7535f6389afe2ead3f4472156b54b7a69bfeaa3af1d562b565fa2bc438
Sep 20 01:01:46.260137 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:46.260101    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:01:46.260258 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:46.260170    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:01:46.260258 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:46.260197    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:01:46.574950 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:46.574838    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2" event={"ID":"9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd","Type":"ContainerStarted","Data":"d0cb5561061d16c978a2955e766b1e08e928db2415469c16d669fb8b6a1b6e29"}
Sep 20 01:01:46.574950 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:46.574914    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2" event={"ID":"9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd","Type":"ContainerStarted","Data":"66444a7535f6389afe2ead3f4472156b54b7a69bfeaa3af1d562b565fa2bc438"}
Sep 20 01:01:46.598005 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:46.597949    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2" podStartSLOduration=1.597921631 podStartE2EDuration="1.597921631s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:01:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:01:46.597754617 +0000 UTC m=+843.211910546" watchObservedRunningTime="2026-09-20 01:01:46.597921631 +0000 UTC m=+843.212077530"
Sep 20 01:01:46.981960 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:46.981920    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2"
Sep 20 01:01:47.461547 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:47.461516    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f77517a-9e6e-4d29-a0dd-fede0ad781ca" path="/var/lib/kubelet/pods/5f77517a-9e6e-4d29-a0dd-fede0ad781ca/volumes"
Sep 20 01:01:47.986972 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:47.986937    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2"
Sep 20 01:01:48.584902 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:48.584854    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2"
Sep 20 01:01:48.585926 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:01:48.585906    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2"
Sep 20 01:02:09.713264 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:09.713171    2570 generic.go:356] "Generic (PLEG): container finished" podID="9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd" containerID="d0cb5561061d16c978a2955e766b1e08e928db2415469c16d669fb8b6a1b6e29" exitCode=0
Sep 20 01:02:09.713672 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:09.713253    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2" event={"ID":"9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd","Type":"ContainerDied","Data":"d0cb5561061d16c978a2955e766b1e08e928db2415469c16d669fb8b6a1b6e29"}
Sep 20 01:02:09.713716 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:09.713684    2570 scope.go:117] "RemoveContainer" containerID="d0cb5561061d16c978a2955e766b1e08e928db2415469c16d669fb8b6a1b6e29"
Sep 20 01:02:09.714896 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:09.714836    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:02:09.715005 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:09.714951    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:02:09.715070 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:09.715004    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:02:10.721057 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:10.721022    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2" event={"ID":"9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd","Type":"ContainerStarted","Data":"4d6a06af961ff734ced2a40e37bbb29b5ac07335579470963ee7a6d11303cdc7"}
Sep 20 01:02:10.982184 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:10.982090    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2"
Sep 20 01:02:10.982355 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:10.982335    2570 patch_prober.go:28] interesting pod/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 20 01:02:10.982431 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:10.982413    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2" podUID="9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 20 01:02:11.982183 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:11.982146    2570 patch_prober.go:28] interesting pod/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 20 01:02:11.982587 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:11.982203    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2" podUID="9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 20 01:02:12.982037 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:12.982004    2570 patch_prober.go:28] interesting pod/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 20 01:02:12.982228 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:12.982078    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2" podUID="9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 20 01:02:13.982663 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:13.982631    2570 patch_prober.go:28] interesting pod/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 20 01:02:13.983087 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:13.982699    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2" podUID="9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 20 01:02:14.981716 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:14.981677    2570 patch_prober.go:28] interesting pod/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 20 01:02:14.981921 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:14.981744    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2" podUID="9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 20 01:02:15.985942 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:15.985906    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2"
Sep 20 01:02:15.986356 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:15.986203    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2"
Sep 20 01:02:15.986835 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:15.986815    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2"
Sep 20 01:02:19.776795 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:19.776765    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2"]
Sep 20 01:02:19.777305 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:19.777028    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2" podUID="9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd" containerName="istio-proxy" containerID="cri-o://4d6a06af961ff734ced2a40e37bbb29b5ac07335579470963ee7a6d11303cdc7" gracePeriod=30
Sep 20 01:02:25.038956 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.038891    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2"
Sep 20 01:02:25.144237 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.144204    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd-istio-token\") pod \"9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd\" (UID: \"9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd\") "
Sep 20 01:02:25.144435 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.144259    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd-istio-data\") pod \"9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd\" (UID: \"9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd\") "
Sep 20 01:02:25.144435 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.144280    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd-workload-certs\") pod \"9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd\" (UID: \"9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd\") "
Sep 20 01:02:25.144435 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.144339    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd-istio-envoy\") pod \"9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd\" (UID: \"9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd\") "
Sep 20 01:02:25.144435 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.144364    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8nzh6\" (UniqueName: \"kubernetes.io/projected/9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd-kube-api-access-8nzh6\") pod \"9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd\" (UID: \"9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd\") "
Sep 20 01:02:25.144435 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.144395    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd-istio-podinfo\") pod \"9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd\" (UID: \"9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd\") "
Sep 20 01:02:25.144435 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.144426    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd-workload-socket\") pod \"9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd\" (UID: \"9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd\") "
Sep 20 01:02:25.144738 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.144472    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd-credential-socket\") pod \"9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd\" (UID: \"9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd\") "
Sep 20 01:02:25.144738 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.144552    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd-istiod-ca-cert\") pod \"9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd\" (UID: \"9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd\") "
Sep 20 01:02:25.144738 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.144555    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd-istio-data" (OuterVolumeSpecName: "istio-data") pod "9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd" (UID: "9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:02:25.144738 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.144571    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd" (UID: "9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:02:25.145288 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.145094    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd" (UID: "9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:02:25.145288 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.145261    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd-istio-data\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:02:25.145410 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.145295    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd-workload-certs\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:02:25.145470 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.145406    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd" (UID: "9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:02:25.145470 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.145438    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd" (UID: "9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:02:25.147855 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.147820    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd-istio-token" (OuterVolumeSpecName: "istio-token") pod "9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd" (UID: "9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:02:25.148096 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.147828    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd-kube-api-access-8nzh6" (OuterVolumeSpecName: "kube-api-access-8nzh6") pod "9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd" (UID: "9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd"). InnerVolumeSpecName "kube-api-access-8nzh6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:02:25.148183 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.147913    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd" (UID: "9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:02:25.148251 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.147909    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd" (UID: "9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 20 01:02:25.246292 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.246255    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd-istio-envoy\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:02:25.246292 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.246290    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8nzh6\" (UniqueName: \"kubernetes.io/projected/9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd-kube-api-access-8nzh6\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:02:25.246292 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.246302    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd-istio-podinfo\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:02:25.246551 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.246310    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd-workload-socket\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:02:25.246551 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.246320    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd-credential-socket\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:02:25.246551 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.246327    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd-istiod-ca-cert\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:02:25.246551 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.246335    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd-istio-token\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:02:25.661587 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.661559    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-083e5ca1-7cf5b77546-v47sm"]
Sep 20 01:02:25.662067 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.662050    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd" containerName="istio-proxy"
Sep 20 01:02:25.662067 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.662068    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd" containerName="istio-proxy"
Sep 20 01:02:25.662205 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.662087    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd" containerName="istio-proxy"
Sep 20 01:02:25.662205 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.662096    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd" containerName="istio-proxy"
Sep 20 01:02:25.662205 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.662188    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd" containerName="istio-proxy"
Sep 20 01:02:25.662205 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.662202    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd" containerName="istio-proxy"
Sep 20 01:02:25.664744 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.664723    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-083e5ca1-7cf5b77546-v47sm"
Sep 20 01:02:25.667023 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.667000    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-083e5ca1-dockercfg-spnhz\""
Sep 20 01:02:25.667023 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.667012    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-083e5ca1\""
Sep 20 01:02:25.677899 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.677846    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-083e5ca1-7cf5b77546-v47sm"]
Sep 20 01:02:25.696458 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.696421    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-083e5ca1-7bd8899d47-pzwpn"]
Sep 20 01:02:25.699201 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.699181    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-083e5ca1-7bd8899d47-pzwpn"
Sep 20 01:02:25.711076 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.711017    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-083e5ca1-7bd8899d47-pzwpn"]
Sep 20 01:02:25.807537 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.807504    2570 generic.go:356] "Generic (PLEG): container finished" podID="9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd" containerID="4d6a06af961ff734ced2a40e37bbb29b5ac07335579470963ee7a6d11303cdc7" exitCode=0
Sep 20 01:02:25.807731 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.807589    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2"
Sep 20 01:02:25.807731 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.807590    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2" event={"ID":"9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd","Type":"ContainerDied","Data":"4d6a06af961ff734ced2a40e37bbb29b5ac07335579470963ee7a6d11303cdc7"}
Sep 20 01:02:25.807731 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.807713    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2" event={"ID":"9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd","Type":"ContainerDied","Data":"66444a7535f6389afe2ead3f4472156b54b7a69bfeaa3af1d562b565fa2bc438"}
Sep 20 01:02:25.807889 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.807747    2570 scope.go:117] "RemoveContainer" containerID="4d6a06af961ff734ced2a40e37bbb29b5ac07335579470963ee7a6d11303cdc7"
Sep 20 01:02:25.818962 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.818944    2570 scope.go:117] "RemoveContainer" containerID="d0cb5561061d16c978a2955e766b1e08e928db2415469c16d669fb8b6a1b6e29"
Sep 20 01:02:25.829335 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.829316    2570 scope.go:117] "RemoveContainer" containerID="4d6a06af961ff734ced2a40e37bbb29b5ac07335579470963ee7a6d11303cdc7"
Sep 20 01:02:25.829696 ip-10-0-132-108 kubenswrapper[2570]: E0920 01:02:25.829664    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d6a06af961ff734ced2a40e37bbb29b5ac07335579470963ee7a6d11303cdc7\": container with ID starting with 4d6a06af961ff734ced2a40e37bbb29b5ac07335579470963ee7a6d11303cdc7 not found: ID does not exist" containerID="4d6a06af961ff734ced2a40e37bbb29b5ac07335579470963ee7a6d11303cdc7"
Sep 20 01:02:25.829807 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.829705    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d6a06af961ff734ced2a40e37bbb29b5ac07335579470963ee7a6d11303cdc7"} err="failed to get container status \"4d6a06af961ff734ced2a40e37bbb29b5ac07335579470963ee7a6d11303cdc7\": rpc error: code = NotFound desc = could not find container \"4d6a06af961ff734ced2a40e37bbb29b5ac07335579470963ee7a6d11303cdc7\": container with ID starting with 4d6a06af961ff734ced2a40e37bbb29b5ac07335579470963ee7a6d11303cdc7 not found: ID does not exist"
Sep 20 01:02:25.829807 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.829723    2570 scope.go:117] "RemoveContainer" containerID="d0cb5561061d16c978a2955e766b1e08e928db2415469c16d669fb8b6a1b6e29"
Sep 20 01:02:25.829807 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.829728    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2"]
Sep 20 01:02:25.830114 ip-10-0-132-108 kubenswrapper[2570]: E0920 01:02:25.830090    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0cb5561061d16c978a2955e766b1e08e928db2415469c16d669fb8b6a1b6e29\": container with ID starting with d0cb5561061d16c978a2955e766b1e08e928db2415469c16d669fb8b6a1b6e29 not found: ID does not exist" containerID="d0cb5561061d16c978a2955e766b1e08e928db2415469c16d669fb8b6a1b6e29"
Sep 20 01:02:25.830236 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.830125    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0cb5561061d16c978a2955e766b1e08e928db2415469c16d669fb8b6a1b6e29"} err="failed to get container status \"d0cb5561061d16c978a2955e766b1e08e928db2415469c16d669fb8b6a1b6e29\": rpc error: code = NotFound desc = could not find container \"d0cb5561061d16c978a2955e766b1e08e928db2415469c16d669fb8b6a1b6e29\": container with ID starting with d0cb5561061d16c978a2955e766b1e08e928db2415469c16d669fb8b6a1b6e29 not found: ID does not exist"
Sep 20 01:02:25.833122 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.833100    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-816f617b-gw-openshift-default-89d5545dd-8bbc2"]
Sep 20 01:02:25.856507 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.856485    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fde44f50-656d-4693-95c7-7551f7ade4bb-plugins-config-volume\") pod \"payload-processing-e2e-ait-083e5ca1-7bd8899d47-pzwpn\" (UID: \"fde44f50-656d-4693-95c7-7551f7ade4bb\") " pod="openshift-ingress/payload-processing-e2e-ait-083e5ca1-7bd8899d47-pzwpn"
Sep 20 01:02:25.856638 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.856514    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k92dd\" (UniqueName: \"kubernetes.io/projected/fde44f50-656d-4693-95c7-7551f7ade4bb-kube-api-access-k92dd\") pod \"payload-processing-e2e-ait-083e5ca1-7bd8899d47-pzwpn\" (UID: \"fde44f50-656d-4693-95c7-7551f7ade4bb\") " pod="openshift-ingress/payload-processing-e2e-ait-083e5ca1-7bd8899d47-pzwpn"
Sep 20 01:02:25.856638 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.856557    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48e0c599-5f65-4fe3-807b-6056a53f0d81-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-083e5ca1-7cf5b77546-v47sm\" (UID: \"48e0c599-5f65-4fe3-807b-6056a53f0d81\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-083e5ca1-7cf5b77546-v47sm"
Sep 20 01:02:25.856638 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.856612    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppktg\" (UniqueName: \"kubernetes.io/projected/48e0c599-5f65-4fe3-807b-6056a53f0d81-kube-api-access-ppktg\") pod \"payload-pre-processing-e2e-ait-083e5ca1-7cf5b77546-v47sm\" (UID: \"48e0c599-5f65-4fe3-807b-6056a53f0d81\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-083e5ca1-7cf5b77546-v47sm"
Sep 20 01:02:25.957410 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.957328    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48e0c599-5f65-4fe3-807b-6056a53f0d81-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-083e5ca1-7cf5b77546-v47sm\" (UID: \"48e0c599-5f65-4fe3-807b-6056a53f0d81\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-083e5ca1-7cf5b77546-v47sm"
Sep 20 01:02:25.957410 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.957378    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppktg\" (UniqueName: \"kubernetes.io/projected/48e0c599-5f65-4fe3-807b-6056a53f0d81-kube-api-access-ppktg\") pod \"payload-pre-processing-e2e-ait-083e5ca1-7cf5b77546-v47sm\" (UID: \"48e0c599-5f65-4fe3-807b-6056a53f0d81\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-083e5ca1-7cf5b77546-v47sm"
Sep 20 01:02:25.957615 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.957522    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fde44f50-656d-4693-95c7-7551f7ade4bb-plugins-config-volume\") pod \"payload-processing-e2e-ait-083e5ca1-7bd8899d47-pzwpn\" (UID: \"fde44f50-656d-4693-95c7-7551f7ade4bb\") " pod="openshift-ingress/payload-processing-e2e-ait-083e5ca1-7bd8899d47-pzwpn"
Sep 20 01:02:25.957615 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.957547    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k92dd\" (UniqueName: \"kubernetes.io/projected/fde44f50-656d-4693-95c7-7551f7ade4bb-kube-api-access-k92dd\") pod \"payload-processing-e2e-ait-083e5ca1-7bd8899d47-pzwpn\" (UID: \"fde44f50-656d-4693-95c7-7551f7ade4bb\") " pod="openshift-ingress/payload-processing-e2e-ait-083e5ca1-7bd8899d47-pzwpn"
Sep 20 01:02:25.958268 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.958243    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48e0c599-5f65-4fe3-807b-6056a53f0d81-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-083e5ca1-7cf5b77546-v47sm\" (UID: \"48e0c599-5f65-4fe3-807b-6056a53f0d81\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-083e5ca1-7cf5b77546-v47sm"
Sep 20 01:02:25.958364 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.958349    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fde44f50-656d-4693-95c7-7551f7ade4bb-plugins-config-volume\") pod \"payload-processing-e2e-ait-083e5ca1-7bd8899d47-pzwpn\" (UID: \"fde44f50-656d-4693-95c7-7551f7ade4bb\") " pod="openshift-ingress/payload-processing-e2e-ait-083e5ca1-7bd8899d47-pzwpn"
Sep 20 01:02:25.965483 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.965422    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k92dd\" (UniqueName: \"kubernetes.io/projected/fde44f50-656d-4693-95c7-7551f7ade4bb-kube-api-access-k92dd\") pod \"payload-processing-e2e-ait-083e5ca1-7bd8899d47-pzwpn\" (UID: \"fde44f50-656d-4693-95c7-7551f7ade4bb\") " pod="openshift-ingress/payload-processing-e2e-ait-083e5ca1-7bd8899d47-pzwpn"
Sep 20 01:02:25.965823 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.965805    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppktg\" (UniqueName: \"kubernetes.io/projected/48e0c599-5f65-4fe3-807b-6056a53f0d81-kube-api-access-ppktg\") pod \"payload-pre-processing-e2e-ait-083e5ca1-7cf5b77546-v47sm\" (UID: \"48e0c599-5f65-4fe3-807b-6056a53f0d81\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-083e5ca1-7cf5b77546-v47sm"
Sep 20 01:02:25.977761 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:25.977742    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-083e5ca1-7cf5b77546-v47sm"
Sep 20 01:02:26.011045 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:26.011017    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-083e5ca1-7bd8899d47-pzwpn"
Sep 20 01:02:26.258162 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:26.258136    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-083e5ca1-7cf5b77546-v47sm"]
Sep 20 01:02:26.260134 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:02:26.260100    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48e0c599_5f65_4fe3_807b_6056a53f0d81.slice/crio-005581e733feaba0900fed1cd88f14e946fcf5123139d6d6f261e6ee12bae99d WatchSource:0}: Error finding container 005581e733feaba0900fed1cd88f14e946fcf5123139d6d6f261e6ee12bae99d: Status 404 returned error can't find the container with id 005581e733feaba0900fed1cd88f14e946fcf5123139d6d6f261e6ee12bae99d
Sep 20 01:02:26.307327 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:26.307302    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-083e5ca1-7bd8899d47-pzwpn"]
Sep 20 01:02:26.313952 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:02:26.313924    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfde44f50_656d_4693_95c7_7551f7ade4bb.slice/crio-394d48417f5aacd119e823ac7f129b23b3783c3ad1caa7eabb7901006dfc5f89 WatchSource:0}: Error finding container 394d48417f5aacd119e823ac7f129b23b3783c3ad1caa7eabb7901006dfc5f89: Status 404 returned error can't find the container with id 394d48417f5aacd119e823ac7f129b23b3783c3ad1caa7eabb7901006dfc5f89
Sep 20 01:02:26.815238 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:26.815205    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-083e5ca1-7cf5b77546-v47sm" event={"ID":"48e0c599-5f65-4fe3-807b-6056a53f0d81","Type":"ContainerStarted","Data":"087b69c6ba1c320aa07389a522df03e87cfd41b0509771bb57e509d683117bbb"}
Sep 20 01:02:26.815418 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:26.815377    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-083e5ca1-7cf5b77546-v47sm"
Sep 20 01:02:26.815418 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:26.815413    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-083e5ca1-7cf5b77546-v47sm" event={"ID":"48e0c599-5f65-4fe3-807b-6056a53f0d81","Type":"ContainerStarted","Data":"005581e733feaba0900fed1cd88f14e946fcf5123139d6d6f261e6ee12bae99d"}
Sep 20 01:02:26.816905 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:26.816877    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-083e5ca1-7bd8899d47-pzwpn" event={"ID":"fde44f50-656d-4693-95c7-7551f7ade4bb","Type":"ContainerStarted","Data":"4e22b6006228230bc1556bd4041a6246634566ed471afdbe4a721987a542b50f"}
Sep 20 01:02:26.817026 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:26.816921    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-083e5ca1-7bd8899d47-pzwpn" event={"ID":"fde44f50-656d-4693-95c7-7551f7ade4bb","Type":"ContainerStarted","Data":"394d48417f5aacd119e823ac7f129b23b3783c3ad1caa7eabb7901006dfc5f89"}
Sep 20 01:02:26.817026 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:26.816949    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-083e5ca1-7bd8899d47-pzwpn"
Sep 20 01:02:26.832885 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:26.832815    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-083e5ca1-7cf5b77546-v47sm" podStartSLOduration=1.8327983479999999 podStartE2EDuration="1.832798348s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:02:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:02:26.832160629 +0000 UTC m=+883.446316539" watchObservedRunningTime="2026-09-20 01:02:26.832798348 +0000 UTC m=+883.446954267"
Sep 20 01:02:26.848935 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:26.848897    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-083e5ca1-7bd8899d47-pzwpn" podStartSLOduration=1.848881574 podStartE2EDuration="1.848881574s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:02:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:02:26.846987925 +0000 UTC m=+883.461143842" watchObservedRunningTime="2026-09-20 01:02:26.848881574 +0000 UTC m=+883.463037474"
Sep 20 01:02:27.463127 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:27.463089    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd" path="/var/lib/kubelet/pods/9ff16ea5-d008-4bbf-89c5-6acd4df6c7fd/volumes"
Sep 20 01:02:37.826640 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:37.826609    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-083e5ca1-7cf5b77546-v47sm"
Sep 20 01:02:37.827065 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:37.826677    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-083e5ca1-7bd8899d47-pzwpn"
Sep 20 01:02:45.451784 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:45.451757    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65l6f_bf898d8f-ed0f-4b4e-9a87-8e6167b29481/ovn-acl-logging/0.log"
Sep 20 01:02:45.457311 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:45.457289    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65l6f_bf898d8f-ed0f-4b4e-9a87-8e6167b29481/ovn-acl-logging/0.log"
Sep 20 01:02:48.549817 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:48.549779    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-083e5ca1-8fxt6"]
Sep 20 01:02:48.554111 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:48.554086    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-083e5ca1-8fxt6"]
Sep 20 01:02:48.554238 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:48.554172    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-083e5ca1-8fxt6"
Sep 20 01:02:48.556700 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:48.556403    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 20 01:02:48.556700 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:48.556451    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5xngg\""
Sep 20 01:02:48.684600 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:48.684563    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/966d4e28-9253-411a-8835-d4b1c39db8fc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-083e5ca1-8fxt6\" (UID: \"966d4e28-9253-411a-8835-d4b1c39db8fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-083e5ca1-8fxt6"
Sep 20 01:02:48.785197 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:48.785160    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/966d4e28-9253-411a-8835-d4b1c39db8fc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-083e5ca1-8fxt6\" (UID: \"966d4e28-9253-411a-8835-d4b1c39db8fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-083e5ca1-8fxt6"
Sep 20 01:02:48.785818 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:48.785798    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/966d4e28-9253-411a-8835-d4b1c39db8fc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-083e5ca1-8fxt6\" (UID: \"966d4e28-9253-411a-8835-d4b1c39db8fc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-083e5ca1-8fxt6"
Sep 20 01:02:48.866308 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:48.866278    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-083e5ca1-8fxt6"
Sep 20 01:02:49.148441 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:49.148415    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-083e5ca1-8fxt6"]
Sep 20 01:02:49.150535 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:02:49.150508    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod966d4e28_9253_411a_8835_d4b1c39db8fc.slice/crio-aac273c64f9b719dad87e1a46ad0397f8aecc5cddcb6ab397400c456154d97cf WatchSource:0}: Error finding container aac273c64f9b719dad87e1a46ad0397f8aecc5cddcb6ab397400c456154d97cf: Status 404 returned error can't find the container with id aac273c64f9b719dad87e1a46ad0397f8aecc5cddcb6ab397400c456154d97cf
Sep 20 01:02:49.947991 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:49.947959    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-083e5ca1-8fxt6" event={"ID":"966d4e28-9253-411a-8835-d4b1c39db8fc","Type":"ContainerStarted","Data":"72ee9b872f4a0918a5aea651b0155fd8b513537787b9164b138f1617cbd01074"}
Sep 20 01:02:49.948357 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:49.948012    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-083e5ca1-8fxt6" event={"ID":"966d4e28-9253-411a-8835-d4b1c39db8fc","Type":"ContainerStarted","Data":"aac273c64f9b719dad87e1a46ad0397f8aecc5cddcb6ab397400c456154d97cf"}
Sep 20 01:02:49.963148 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:49.963094    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-083e5ca1-8fxt6" podStartSLOduration=1.9630735719999999 podStartE2EDuration="1.963073572s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:02:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:02:49.962662085 +0000 UTC m=+906.576818016" watchObservedRunningTime="2026-09-20 01:02:49.963073572 +0000 UTC m=+906.577229480"
Sep 20 01:02:50.954905 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:50.954851    2570 generic.go:356] "Generic (PLEG): container finished" podID="966d4e28-9253-411a-8835-d4b1c39db8fc" containerID="72ee9b872f4a0918a5aea651b0155fd8b513537787b9164b138f1617cbd01074" exitCode=0
Sep 20 01:02:50.955291 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:50.954926    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-083e5ca1-8fxt6" event={"ID":"966d4e28-9253-411a-8835-d4b1c39db8fc","Type":"ContainerDied","Data":"72ee9b872f4a0918a5aea651b0155fd8b513537787b9164b138f1617cbd01074"}
Sep 20 01:02:52.102454 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:52.102429    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-083e5ca1-8fxt6"
Sep 20 01:02:52.221283 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:52.221207    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/966d4e28-9253-411a-8835-d4b1c39db8fc-maas-api-service-ca\") pod \"966d4e28-9253-411a-8835-d4b1c39db8fc\" (UID: \"966d4e28-9253-411a-8835-d4b1c39db8fc\") "
Sep 20 01:02:52.221601 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:52.221581    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/966d4e28-9253-411a-8835-d4b1c39db8fc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "966d4e28-9253-411a-8835-d4b1c39db8fc" (UID: "966d4e28-9253-411a-8835-d4b1c39db8fc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:02:52.322293 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:52.322261    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/966d4e28-9253-411a-8835-d4b1c39db8fc-maas-api-service-ca\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:02:52.966737 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:52.966709    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-083e5ca1-8fxt6"
Sep 20 01:02:52.966946 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:52.966712    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-083e5ca1-8fxt6" event={"ID":"966d4e28-9253-411a-8835-d4b1c39db8fc","Type":"ContainerDied","Data":"aac273c64f9b719dad87e1a46ad0397f8aecc5cddcb6ab397400c456154d97cf"}
Sep 20 01:02:52.966946 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:52.966832    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aac273c64f9b719dad87e1a46ad0397f8aecc5cddcb6ab397400c456154d97cf"
Sep 20 01:02:54.995799 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:54.995759    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-083e5ca1-7bd8899d47-pzwpn"]
Sep 20 01:02:54.996366 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:54.996029    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-083e5ca1-7bd8899d47-pzwpn" podUID="fde44f50-656d-4693-95c7-7551f7ade4bb" containerName="payload-processing" containerID="cri-o://4e22b6006228230bc1556bd4041a6246634566ed471afdbe4a721987a542b50f" gracePeriod=30
Sep 20 01:02:55.004768 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:55.004741    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-083e5ca1-7cf5b77546-v47sm"]
Sep 20 01:02:55.005100 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:55.004984    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-083e5ca1-7cf5b77546-v47sm" podUID="48e0c599-5f65-4fe3-807b-6056a53f0d81" containerName="payload-pre-processing" containerID="cri-o://087b69c6ba1c320aa07389a522df03e87cfd41b0509771bb57e509d683117bbb" gracePeriod=30
Sep 20 01:02:55.183931 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:55.183884    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-083e5ca1-8fxt6"]
Sep 20 01:02:55.187061 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:55.187034    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-083e5ca1-8fxt6"]
Sep 20 01:02:55.287056 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:55.287034    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-083e5ca1-7bd8899d47-pzwpn"
Sep 20 01:02:55.290002 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:55.289984    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-083e5ca1-7cf5b77546-v47sm"
Sep 20 01:02:55.454022 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:55.453990    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="966d4e28-9253-411a-8835-d4b1c39db8fc" path="/var/lib/kubelet/pods/966d4e28-9253-411a-8835-d4b1c39db8fc/volumes"
Sep 20 01:02:55.455697 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:55.455679    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ppktg\" (UniqueName: \"kubernetes.io/projected/48e0c599-5f65-4fe3-807b-6056a53f0d81-kube-api-access-ppktg\") pod \"48e0c599-5f65-4fe3-807b-6056a53f0d81\" (UID: \"48e0c599-5f65-4fe3-807b-6056a53f0d81\") "
Sep 20 01:02:55.455803 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:55.455714    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fde44f50-656d-4693-95c7-7551f7ade4bb-plugins-config-volume\") pod \"fde44f50-656d-4693-95c7-7551f7ade4bb\" (UID: \"fde44f50-656d-4693-95c7-7551f7ade4bb\") "
Sep 20 01:02:55.456060 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:55.456043    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48e0c599-5f65-4fe3-807b-6056a53f0d81-plugins-config-volume\") pod \"48e0c599-5f65-4fe3-807b-6056a53f0d81\" (UID: \"48e0c599-5f65-4fe3-807b-6056a53f0d81\") "
Sep 20 01:02:55.456112 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:55.456076    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k92dd\" (UniqueName: \"kubernetes.io/projected/fde44f50-656d-4693-95c7-7551f7ade4bb-kube-api-access-k92dd\") pod \"fde44f50-656d-4693-95c7-7551f7ade4bb\" (UID: \"fde44f50-656d-4693-95c7-7551f7ade4bb\") "
Sep 20 01:02:55.456217 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:55.456187    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fde44f50-656d-4693-95c7-7551f7ade4bb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fde44f50-656d-4693-95c7-7551f7ade4bb" (UID: "fde44f50-656d-4693-95c7-7551f7ade4bb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:02:55.456409 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:55.456387    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fde44f50-656d-4693-95c7-7551f7ade4bb-plugins-config-volume\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:02:55.456518 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:55.456411    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48e0c599-5f65-4fe3-807b-6056a53f0d81-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "48e0c599-5f65-4fe3-807b-6056a53f0d81" (UID: "48e0c599-5f65-4fe3-807b-6056a53f0d81"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:02:55.458139 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:55.458120    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48e0c599-5f65-4fe3-807b-6056a53f0d81-kube-api-access-ppktg" (OuterVolumeSpecName: "kube-api-access-ppktg") pod "48e0c599-5f65-4fe3-807b-6056a53f0d81" (UID: "48e0c599-5f65-4fe3-807b-6056a53f0d81"). InnerVolumeSpecName "kube-api-access-ppktg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:02:55.458247 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:55.458228    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fde44f50-656d-4693-95c7-7551f7ade4bb-kube-api-access-k92dd" (OuterVolumeSpecName: "kube-api-access-k92dd") pod "fde44f50-656d-4693-95c7-7551f7ade4bb" (UID: "fde44f50-656d-4693-95c7-7551f7ade4bb"). InnerVolumeSpecName "kube-api-access-k92dd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:02:55.557485 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:55.557406    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ppktg\" (UniqueName: \"kubernetes.io/projected/48e0c599-5f65-4fe3-807b-6056a53f0d81-kube-api-access-ppktg\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:02:55.557485 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:55.557436    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48e0c599-5f65-4fe3-807b-6056a53f0d81-plugins-config-volume\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:02:55.557485 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:55.557445    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k92dd\" (UniqueName: \"kubernetes.io/projected/fde44f50-656d-4693-95c7-7551f7ade4bb-kube-api-access-k92dd\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:02:55.986538 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:55.986506    2570 generic.go:356] "Generic (PLEG): container finished" podID="48e0c599-5f65-4fe3-807b-6056a53f0d81" containerID="087b69c6ba1c320aa07389a522df03e87cfd41b0509771bb57e509d683117bbb" exitCode=0
Sep 20 01:02:55.986739 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:55.986551    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-083e5ca1-7cf5b77546-v47sm"
Sep 20 01:02:55.986739 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:55.986599    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-083e5ca1-7cf5b77546-v47sm" event={"ID":"48e0c599-5f65-4fe3-807b-6056a53f0d81","Type":"ContainerDied","Data":"087b69c6ba1c320aa07389a522df03e87cfd41b0509771bb57e509d683117bbb"}
Sep 20 01:02:55.986739 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:55.986647    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-083e5ca1-7cf5b77546-v47sm" event={"ID":"48e0c599-5f65-4fe3-807b-6056a53f0d81","Type":"ContainerDied","Data":"005581e733feaba0900fed1cd88f14e946fcf5123139d6d6f261e6ee12bae99d"}
Sep 20 01:02:55.986739 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:55.986670    2570 scope.go:117] "RemoveContainer" containerID="087b69c6ba1c320aa07389a522df03e87cfd41b0509771bb57e509d683117bbb"
Sep 20 01:02:55.988214 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:55.988190    2570 generic.go:356] "Generic (PLEG): container finished" podID="fde44f50-656d-4693-95c7-7551f7ade4bb" containerID="4e22b6006228230bc1556bd4041a6246634566ed471afdbe4a721987a542b50f" exitCode=0
Sep 20 01:02:55.988334 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:55.988237    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-083e5ca1-7bd8899d47-pzwpn" event={"ID":"fde44f50-656d-4693-95c7-7551f7ade4bb","Type":"ContainerDied","Data":"4e22b6006228230bc1556bd4041a6246634566ed471afdbe4a721987a542b50f"}
Sep 20 01:02:55.988334 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:55.988251    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-083e5ca1-7bd8899d47-pzwpn"
Sep 20 01:02:55.988453 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:55.988382    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-083e5ca1-7bd8899d47-pzwpn" event={"ID":"fde44f50-656d-4693-95c7-7551f7ade4bb","Type":"ContainerDied","Data":"394d48417f5aacd119e823ac7f129b23b3783c3ad1caa7eabb7901006dfc5f89"}
Sep 20 01:02:55.999776 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:55.999453    2570 scope.go:117] "RemoveContainer" containerID="087b69c6ba1c320aa07389a522df03e87cfd41b0509771bb57e509d683117bbb"
Sep 20 01:02:56.000142 ip-10-0-132-108 kubenswrapper[2570]: E0920 01:02:55.999771    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"087b69c6ba1c320aa07389a522df03e87cfd41b0509771bb57e509d683117bbb\": container with ID starting with 087b69c6ba1c320aa07389a522df03e87cfd41b0509771bb57e509d683117bbb not found: ID does not exist" containerID="087b69c6ba1c320aa07389a522df03e87cfd41b0509771bb57e509d683117bbb"
Sep 20 01:02:56.000142 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:55.999796    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"087b69c6ba1c320aa07389a522df03e87cfd41b0509771bb57e509d683117bbb"} err="failed to get container status \"087b69c6ba1c320aa07389a522df03e87cfd41b0509771bb57e509d683117bbb\": rpc error: code = NotFound desc = could not find container \"087b69c6ba1c320aa07389a522df03e87cfd41b0509771bb57e509d683117bbb\": container with ID starting with 087b69c6ba1c320aa07389a522df03e87cfd41b0509771bb57e509d683117bbb not found: ID does not exist"
Sep 20 01:02:56.000142 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:55.999811    2570 scope.go:117] "RemoveContainer" containerID="4e22b6006228230bc1556bd4041a6246634566ed471afdbe4a721987a542b50f"
Sep 20 01:02:56.008656 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:56.008638    2570 scope.go:117] "RemoveContainer" containerID="4e22b6006228230bc1556bd4041a6246634566ed471afdbe4a721987a542b50f"
Sep 20 01:02:56.008985 ip-10-0-132-108 kubenswrapper[2570]: E0920 01:02:56.008964    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e22b6006228230bc1556bd4041a6246634566ed471afdbe4a721987a542b50f\": container with ID starting with 4e22b6006228230bc1556bd4041a6246634566ed471afdbe4a721987a542b50f not found: ID does not exist" containerID="4e22b6006228230bc1556bd4041a6246634566ed471afdbe4a721987a542b50f"
Sep 20 01:02:56.009063 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:56.008998    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e22b6006228230bc1556bd4041a6246634566ed471afdbe4a721987a542b50f"} err="failed to get container status \"4e22b6006228230bc1556bd4041a6246634566ed471afdbe4a721987a542b50f\": rpc error: code = NotFound desc = could not find container \"4e22b6006228230bc1556bd4041a6246634566ed471afdbe4a721987a542b50f\": container with ID starting with 4e22b6006228230bc1556bd4041a6246634566ed471afdbe4a721987a542b50f not found: ID does not exist"
Sep 20 01:02:56.013616 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:56.013595    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-083e5ca1-7cf5b77546-v47sm"]
Sep 20 01:02:56.019996 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:56.019973    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-083e5ca1-7cf5b77546-v47sm"]
Sep 20 01:02:56.029435 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:56.029416    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-083e5ca1-7bd8899d47-pzwpn"]
Sep 20 01:02:56.032557 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:56.032539    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-083e5ca1-7bd8899d47-pzwpn"]
Sep 20 01:02:56.998082 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:56.998042    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg"]
Sep 20 01:02:56.999100 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:56.999075    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fde44f50-656d-4693-95c7-7551f7ade4bb" containerName="payload-processing"
Sep 20 01:02:56.999100 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:56.999102    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="fde44f50-656d-4693-95c7-7551f7ade4bb" containerName="payload-processing"
Sep 20 01:02:56.999283 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:56.999119    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="966d4e28-9253-411a-8835-d4b1c39db8fc" containerName="revoke-keys"
Sep 20 01:02:56.999283 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:56.999128    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="966d4e28-9253-411a-8835-d4b1c39db8fc" containerName="revoke-keys"
Sep 20 01:02:56.999283 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:56.999193    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48e0c599-5f65-4fe3-807b-6056a53f0d81" containerName="payload-pre-processing"
Sep 20 01:02:56.999283 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:56.999203    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="48e0c599-5f65-4fe3-807b-6056a53f0d81" containerName="payload-pre-processing"
Sep 20 01:02:56.999501 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:56.999385    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="966d4e28-9253-411a-8835-d4b1c39db8fc" containerName="revoke-keys"
Sep 20 01:02:56.999501 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:56.999407    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="48e0c599-5f65-4fe3-807b-6056a53f0d81" containerName="payload-pre-processing"
Sep 20 01:02:56.999501 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:56.999424    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="fde44f50-656d-4693-95c7-7551f7ade4bb" containerName="payload-processing"
Sep 20 01:02:57.003915 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:57.003890    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg"
Sep 20 01:02:57.006049 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:57.006026    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-f689c4cd-openshift-default-dockercfg-vgwws\""
Sep 20 01:02:57.014484 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:57.014459    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg"]
Sep 20 01:02:57.172184 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:57.172146    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3077aa12-4eb7-48fa-9eb0-383b45dd8c25-istio-envoy\") pod \"e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg\" (UID: \"3077aa12-4eb7-48fa-9eb0-383b45dd8c25\") " pod="openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg"
Sep 20 01:02:57.172393 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:57.172207    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3077aa12-4eb7-48fa-9eb0-383b45dd8c25-workload-socket\") pod \"e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg\" (UID: \"3077aa12-4eb7-48fa-9eb0-383b45dd8c25\") " pod="openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg"
Sep 20 01:02:57.172393 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:57.172232    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3077aa12-4eb7-48fa-9eb0-383b45dd8c25-istiod-ca-cert\") pod \"e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg\" (UID: \"3077aa12-4eb7-48fa-9eb0-383b45dd8c25\") " pod="openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg"
Sep 20 01:02:57.172393 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:57.172276    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3077aa12-4eb7-48fa-9eb0-383b45dd8c25-workload-certs\") pod \"e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg\" (UID: \"3077aa12-4eb7-48fa-9eb0-383b45dd8c25\") " pod="openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg"
Sep 20 01:02:57.172393 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:57.172358    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3077aa12-4eb7-48fa-9eb0-383b45dd8c25-istio-data\") pod \"e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg\" (UID: \"3077aa12-4eb7-48fa-9eb0-383b45dd8c25\") " pod="openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg"
Sep 20 01:02:57.172393 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:57.172393    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3077aa12-4eb7-48fa-9eb0-383b45dd8c25-istio-podinfo\") pod \"e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg\" (UID: \"3077aa12-4eb7-48fa-9eb0-383b45dd8c25\") " pod="openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg"
Sep 20 01:02:57.172603 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:57.172420    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3077aa12-4eb7-48fa-9eb0-383b45dd8c25-credential-socket\") pod \"e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg\" (UID: \"3077aa12-4eb7-48fa-9eb0-383b45dd8c25\") " pod="openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg"
Sep 20 01:02:57.172603 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:57.172448    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-556dh\" (UniqueName: \"kubernetes.io/projected/3077aa12-4eb7-48fa-9eb0-383b45dd8c25-kube-api-access-556dh\") pod \"e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg\" (UID: \"3077aa12-4eb7-48fa-9eb0-383b45dd8c25\") " pod="openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg"
Sep 20 01:02:57.172603 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:57.172512    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3077aa12-4eb7-48fa-9eb0-383b45dd8c25-istio-token\") pod \"e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg\" (UID: \"3077aa12-4eb7-48fa-9eb0-383b45dd8c25\") " pod="openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg"
Sep 20 01:02:57.273374 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:57.273281    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3077aa12-4eb7-48fa-9eb0-383b45dd8c25-workload-socket\") pod \"e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg\" (UID: \"3077aa12-4eb7-48fa-9eb0-383b45dd8c25\") " pod="openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg"
Sep 20 01:02:57.273374 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:57.273332    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3077aa12-4eb7-48fa-9eb0-383b45dd8c25-istiod-ca-cert\") pod \"e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg\" (UID: \"3077aa12-4eb7-48fa-9eb0-383b45dd8c25\") " pod="openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg"
Sep 20 01:02:57.273374 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:57.273371    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3077aa12-4eb7-48fa-9eb0-383b45dd8c25-workload-certs\") pod \"e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg\" (UID: \"3077aa12-4eb7-48fa-9eb0-383b45dd8c25\") " pod="openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg"
Sep 20 01:02:57.273667 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:57.273431    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3077aa12-4eb7-48fa-9eb0-383b45dd8c25-istio-data\") pod \"e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg\" (UID: \"3077aa12-4eb7-48fa-9eb0-383b45dd8c25\") " pod="openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg"
Sep 20 01:02:57.273667 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:57.273462    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3077aa12-4eb7-48fa-9eb0-383b45dd8c25-istio-podinfo\") pod \"e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg\" (UID: \"3077aa12-4eb7-48fa-9eb0-383b45dd8c25\") " pod="openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg"
Sep 20 01:02:57.273667 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:57.273496    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3077aa12-4eb7-48fa-9eb0-383b45dd8c25-credential-socket\") pod \"e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg\" (UID: \"3077aa12-4eb7-48fa-9eb0-383b45dd8c25\") " pod="openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg"
Sep 20 01:02:57.273667 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:57.273517    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-556dh\" (UniqueName: \"kubernetes.io/projected/3077aa12-4eb7-48fa-9eb0-383b45dd8c25-kube-api-access-556dh\") pod \"e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg\" (UID: \"3077aa12-4eb7-48fa-9eb0-383b45dd8c25\") " pod="openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg"
Sep 20 01:02:57.273667 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:57.273548    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3077aa12-4eb7-48fa-9eb0-383b45dd8c25-istio-token\") pod \"e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg\" (UID: \"3077aa12-4eb7-48fa-9eb0-383b45dd8c25\") " pod="openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg"
Sep 20 01:02:57.273943 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:57.273745    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3077aa12-4eb7-48fa-9eb0-383b45dd8c25-workload-socket\") pod \"e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg\" (UID: \"3077aa12-4eb7-48fa-9eb0-383b45dd8c25\") " pod="openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg"
Sep 20 01:02:57.273943 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:57.273761    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3077aa12-4eb7-48fa-9eb0-383b45dd8c25-workload-certs\") pod \"e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg\" (UID: \"3077aa12-4eb7-48fa-9eb0-383b45dd8c25\") " pod="openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg"
Sep 20 01:02:57.273943 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:57.273782    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3077aa12-4eb7-48fa-9eb0-383b45dd8c25-istio-envoy\") pod \"e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg\" (UID: \"3077aa12-4eb7-48fa-9eb0-383b45dd8c25\") " pod="openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg"
Sep 20 01:02:57.273943 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:57.273852    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3077aa12-4eb7-48fa-9eb0-383b45dd8c25-credential-socket\") pod \"e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg\" (UID: \"3077aa12-4eb7-48fa-9eb0-383b45dd8c25\") " pod="openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg"
Sep 20 01:02:57.274156 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:57.274084    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3077aa12-4eb7-48fa-9eb0-383b45dd8c25-istio-data\") pod \"e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg\" (UID: \"3077aa12-4eb7-48fa-9eb0-383b45dd8c25\") " pod="openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg"
Sep 20 01:02:57.274246 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:57.274226    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3077aa12-4eb7-48fa-9eb0-383b45dd8c25-istiod-ca-cert\") pod \"e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg\" (UID: \"3077aa12-4eb7-48fa-9eb0-383b45dd8c25\") " pod="openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg"
Sep 20 01:02:57.276155 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:57.276129    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3077aa12-4eb7-48fa-9eb0-383b45dd8c25-istio-envoy\") pod \"e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg\" (UID: \"3077aa12-4eb7-48fa-9eb0-383b45dd8c25\") " pod="openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg"
Sep 20 01:02:57.276309 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:57.276201    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3077aa12-4eb7-48fa-9eb0-383b45dd8c25-istio-podinfo\") pod \"e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg\" (UID: \"3077aa12-4eb7-48fa-9eb0-383b45dd8c25\") " pod="openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg"
Sep 20 01:02:57.281782 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:57.281753    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3077aa12-4eb7-48fa-9eb0-383b45dd8c25-istio-token\") pod \"e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg\" (UID: \"3077aa12-4eb7-48fa-9eb0-383b45dd8c25\") " pod="openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg"
Sep 20 01:02:57.281899 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:57.281882    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-556dh\" (UniqueName: \"kubernetes.io/projected/3077aa12-4eb7-48fa-9eb0-383b45dd8c25-kube-api-access-556dh\") pod \"e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg\" (UID: \"3077aa12-4eb7-48fa-9eb0-383b45dd8c25\") " pod="openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg"
Sep 20 01:02:57.316538 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:57.316507    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg"
Sep 20 01:02:57.454211 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:57.454176    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48e0c599-5f65-4fe3-807b-6056a53f0d81" path="/var/lib/kubelet/pods/48e0c599-5f65-4fe3-807b-6056a53f0d81/volumes"
Sep 20 01:02:57.454537 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:57.454524    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fde44f50-656d-4693-95c7-7551f7ade4bb" path="/var/lib/kubelet/pods/fde44f50-656d-4693-95c7-7551f7ade4bb/volumes"
Sep 20 01:02:57.597526 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:57.597447    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg"]
Sep 20 01:02:57.599359 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:02:57.599332    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3077aa12_4eb7_48fa_9eb0_383b45dd8c25.slice/crio-b40fbd4bdb2b87d1b7a6f44c3c0d65c6a655b8c12cf5bf115c0771d90fff2503 WatchSource:0}: Error finding container b40fbd4bdb2b87d1b7a6f44c3c0d65c6a655b8c12cf5bf115c0771d90fff2503: Status 404 returned error can't find the container with id b40fbd4bdb2b87d1b7a6f44c3c0d65c6a655b8c12cf5bf115c0771d90fff2503
Sep 20 01:02:57.601928 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:57.601896    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:02:57.602042 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:57.601967    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:02:57.602042 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:57.601997    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:02:58.007796 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:58.007758    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg" event={"ID":"3077aa12-4eb7-48fa-9eb0-383b45dd8c25","Type":"ContainerStarted","Data":"c0acb02fdf20c478f2809998ef4e5152baa306e2ac5b781a1e6a9ac2536a0cb6"}
Sep 20 01:02:58.008232 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:58.007822    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg" event={"ID":"3077aa12-4eb7-48fa-9eb0-383b45dd8c25","Type":"ContainerStarted","Data":"b40fbd4bdb2b87d1b7a6f44c3c0d65c6a655b8c12cf5bf115c0771d90fff2503"}
Sep 20 01:02:58.053970 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:58.053899    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg" podStartSLOduration=2.053878844 podStartE2EDuration="2.053878844s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:02:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:02:58.052902105 +0000 UTC m=+914.667058002" watchObservedRunningTime="2026-09-20 01:02:58.053878844 +0000 UTC m=+914.668034733"
Sep 20 01:02:58.317713 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:58.317625    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg"
Sep 20 01:02:58.323073 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:58.323051    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg"
Sep 20 01:02:59.013151 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:59.013120    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg"
Sep 20 01:02:59.014203 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:02:59.014185    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg"
Sep 20 01:03:01.357309 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:01.357269    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-f689c4cd-67cdd9ff85-9m4vq"]
Sep 20 01:03:01.360154 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:01.360137    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-f689c4cd-67cdd9ff85-9m4vq"
Sep 20 01:03:01.362235 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:01.362210    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-f689c4cd-dockercfg-s7npl\""
Sep 20 01:03:01.362369 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:01.362225    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-f689c4cd\""
Sep 20 01:03:01.370745 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:01.370725    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-f689c4cd-67cdd9ff85-9m4vq"]
Sep 20 01:03:01.516090 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:01.516048    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8edcc80-6cd9-4bc2-895f-dfd2a3de8ce4-plugins-config-volume\") pod \"payload-processing-e2e-derive-f689c4cd-67cdd9ff85-9m4vq\" (UID: \"a8edcc80-6cd9-4bc2-895f-dfd2a3de8ce4\") " pod="openshift-ingress/payload-processing-e2e-derive-f689c4cd-67cdd9ff85-9m4vq"
Sep 20 01:03:01.516271 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:01.516108    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bgjq\" (UniqueName: \"kubernetes.io/projected/a8edcc80-6cd9-4bc2-895f-dfd2a3de8ce4-kube-api-access-2bgjq\") pod \"payload-processing-e2e-derive-f689c4cd-67cdd9ff85-9m4vq\" (UID: \"a8edcc80-6cd9-4bc2-895f-dfd2a3de8ce4\") " pod="openshift-ingress/payload-processing-e2e-derive-f689c4cd-67cdd9ff85-9m4vq"
Sep 20 01:03:01.617142 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:01.617110    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bgjq\" (UniqueName: \"kubernetes.io/projected/a8edcc80-6cd9-4bc2-895f-dfd2a3de8ce4-kube-api-access-2bgjq\") pod \"payload-processing-e2e-derive-f689c4cd-67cdd9ff85-9m4vq\" (UID: \"a8edcc80-6cd9-4bc2-895f-dfd2a3de8ce4\") " pod="openshift-ingress/payload-processing-e2e-derive-f689c4cd-67cdd9ff85-9m4vq"
Sep 20 01:03:01.617304 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:01.617259    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8edcc80-6cd9-4bc2-895f-dfd2a3de8ce4-plugins-config-volume\") pod \"payload-processing-e2e-derive-f689c4cd-67cdd9ff85-9m4vq\" (UID: \"a8edcc80-6cd9-4bc2-895f-dfd2a3de8ce4\") " pod="openshift-ingress/payload-processing-e2e-derive-f689c4cd-67cdd9ff85-9m4vq"
Sep 20 01:03:01.617966 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:01.617947    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8edcc80-6cd9-4bc2-895f-dfd2a3de8ce4-plugins-config-volume\") pod \"payload-processing-e2e-derive-f689c4cd-67cdd9ff85-9m4vq\" (UID: \"a8edcc80-6cd9-4bc2-895f-dfd2a3de8ce4\") " pod="openshift-ingress/payload-processing-e2e-derive-f689c4cd-67cdd9ff85-9m4vq"
Sep 20 01:03:01.625229 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:01.625206    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bgjq\" (UniqueName: \"kubernetes.io/projected/a8edcc80-6cd9-4bc2-895f-dfd2a3de8ce4-kube-api-access-2bgjq\") pod \"payload-processing-e2e-derive-f689c4cd-67cdd9ff85-9m4vq\" (UID: \"a8edcc80-6cd9-4bc2-895f-dfd2a3de8ce4\") " pod="openshift-ingress/payload-processing-e2e-derive-f689c4cd-67cdd9ff85-9m4vq"
Sep 20 01:03:01.674057 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:01.674024    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-f689c4cd-67cdd9ff85-9m4vq"
Sep 20 01:03:01.951039 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:01.951013    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-f689c4cd-67cdd9ff85-9m4vq"]
Sep 20 01:03:01.952847 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:03:01.952819    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8edcc80_6cd9_4bc2_895f_dfd2a3de8ce4.slice/crio-55631173e171b8fae99f2b8f06b16249a44a10cf1073b7f8c48d1468cd854bc8 WatchSource:0}: Error finding container 55631173e171b8fae99f2b8f06b16249a44a10cf1073b7f8c48d1468cd854bc8: Status 404 returned error can't find the container with id 55631173e171b8fae99f2b8f06b16249a44a10cf1073b7f8c48d1468cd854bc8
Sep 20 01:03:02.060608 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:02.060576    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-f689c4cd-67cdd9ff85-9m4vq" event={"ID":"a8edcc80-6cd9-4bc2-895f-dfd2a3de8ce4","Type":"ContainerStarted","Data":"0c26e8e570813a7cd113965c6de38a0cffbe1034320b9900abc0d70933e4f72e"}
Sep 20 01:03:02.060775 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:02.060631    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-f689c4cd-67cdd9ff85-9m4vq" event={"ID":"a8edcc80-6cd9-4bc2-895f-dfd2a3de8ce4","Type":"ContainerStarted","Data":"55631173e171b8fae99f2b8f06b16249a44a10cf1073b7f8c48d1468cd854bc8"}
Sep 20 01:03:02.060775 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:02.060661    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-f689c4cd-67cdd9ff85-9m4vq"
Sep 20 01:03:02.076252 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:02.076200    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-f689c4cd-67cdd9ff85-9m4vq" podStartSLOduration=1.0761781049999999 podStartE2EDuration="1.076178105s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:03:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:03:02.075210919 +0000 UTC m=+918.689366863" watchObservedRunningTime="2026-09-20 01:03:02.076178105 +0000 UTC m=+918.690334002"
Sep 20 01:03:13.069430 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:13.069395    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-f689c4cd-67cdd9ff85-9m4vq"
Sep 20 01:03:24.193497 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:24.193462    2570 generic.go:356] "Generic (PLEG): container finished" podID="3077aa12-4eb7-48fa-9eb0-383b45dd8c25" containerID="c0acb02fdf20c478f2809998ef4e5152baa306e2ac5b781a1e6a9ac2536a0cb6" exitCode=0
Sep 20 01:03:24.193933 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:24.193534    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg" event={"ID":"3077aa12-4eb7-48fa-9eb0-383b45dd8c25","Type":"ContainerDied","Data":"c0acb02fdf20c478f2809998ef4e5152baa306e2ac5b781a1e6a9ac2536a0cb6"}
Sep 20 01:03:24.193999 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:24.193985    2570 scope.go:117] "RemoveContainer" containerID="c0acb02fdf20c478f2809998ef4e5152baa306e2ac5b781a1e6a9ac2536a0cb6"
Sep 20 01:03:24.195156 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:24.195102    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:03:24.195251 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:24.195202    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:03:24.195251 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:24.195233    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:03:24.207995 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:24.207973    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f689c4cd-wf6d6"]
Sep 20 01:03:24.211210 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:24.211193    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f689c4cd-wf6d6"
Sep 20 01:03:24.213888 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:24.213850    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5xngg\""
Sep 20 01:03:24.214000 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:24.213942    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 20 01:03:24.218621 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:24.218599    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f689c4cd-wf6d6"]
Sep 20 01:03:24.346255 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:24.346220    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/97c6988a-1f22-4be7-8841-7d17e4f5387a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f689c4cd-wf6d6\" (UID: \"97c6988a-1f22-4be7-8841-7d17e4f5387a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f689c4cd-wf6d6"
Sep 20 01:03:24.447347 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:24.447246    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/97c6988a-1f22-4be7-8841-7d17e4f5387a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f689c4cd-wf6d6\" (UID: \"97c6988a-1f22-4be7-8841-7d17e4f5387a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f689c4cd-wf6d6"
Sep 20 01:03:24.447961 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:24.447938    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/97c6988a-1f22-4be7-8841-7d17e4f5387a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f689c4cd-wf6d6\" (UID: \"97c6988a-1f22-4be7-8841-7d17e4f5387a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f689c4cd-wf6d6"
Sep 20 01:03:24.544976 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:24.544931    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f689c4cd-wf6d6"
Sep 20 01:03:24.818561 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:24.818535    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f689c4cd-wf6d6"]
Sep 20 01:03:24.820350 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:03:24.820320    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97c6988a_1f22_4be7_8841_7d17e4f5387a.slice/crio-9918db2bf4e8626d3059a9148532ccdd5636d7a121e3ba0b45819f0cece7e16e WatchSource:0}: Error finding container 9918db2bf4e8626d3059a9148532ccdd5636d7a121e3ba0b45819f0cece7e16e: Status 404 returned error can't find the container with id 9918db2bf4e8626d3059a9148532ccdd5636d7a121e3ba0b45819f0cece7e16e
Sep 20 01:03:25.201138 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:25.201103    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f689c4cd-wf6d6" event={"ID":"97c6988a-1f22-4be7-8841-7d17e4f5387a","Type":"ContainerStarted","Data":"9047f04d76c8892dcdaf0702654ceffc531109045087c93b4eaa1a08c8a3d8e5"}
Sep 20 01:03:25.201549 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:25.201161    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f689c4cd-wf6d6" event={"ID":"97c6988a-1f22-4be7-8841-7d17e4f5387a","Type":"ContainerStarted","Data":"9918db2bf4e8626d3059a9148532ccdd5636d7a121e3ba0b45819f0cece7e16e"}
Sep 20 01:03:25.203386 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:25.203364    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg" event={"ID":"3077aa12-4eb7-48fa-9eb0-383b45dd8c25","Type":"ContainerStarted","Data":"53b5830a0f45f5ba23d8add9a99785ff8eefeba8e0ac2105fbab2e71df874893"}
Sep 20 01:03:25.215571 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:25.215529    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f689c4cd-wf6d6" podStartSLOduration=1.215512335 podStartE2EDuration="1.215512335s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:03:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:03:25.214544381 +0000 UTC m=+941.828700303" watchObservedRunningTime="2026-09-20 01:03:25.215512335 +0000 UTC m=+941.829668231"
Sep 20 01:03:25.317550 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:25.317519    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg"
Sep 20 01:03:25.318663 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:25.318636    2570 patch_prober.go:28] interesting pod/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 20 01:03:25.318797 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:25.318691    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg" podUID="3077aa12-4eb7-48fa-9eb0-383b45dd8c25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 20 01:03:26.214047 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:26.214010    2570 generic.go:356] "Generic (PLEG): container finished" podID="97c6988a-1f22-4be7-8841-7d17e4f5387a" containerID="9047f04d76c8892dcdaf0702654ceffc531109045087c93b4eaa1a08c8a3d8e5" exitCode=0
Sep 20 01:03:26.214580 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:26.214095    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f689c4cd-wf6d6" event={"ID":"97c6988a-1f22-4be7-8841-7d17e4f5387a","Type":"ContainerDied","Data":"9047f04d76c8892dcdaf0702654ceffc531109045087c93b4eaa1a08c8a3d8e5"}
Sep 20 01:03:26.317630 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:26.317599    2570 patch_prober.go:28] interesting pod/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 20 01:03:26.317805 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:26.317654    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg" podUID="3077aa12-4eb7-48fa-9eb0-383b45dd8c25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 20 01:03:27.317575 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:27.317541    2570 patch_prober.go:28] interesting pod/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 20 01:03:27.317943 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:27.317601    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg" podUID="3077aa12-4eb7-48fa-9eb0-383b45dd8c25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 20 01:03:27.403075 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:27.403050    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f689c4cd-wf6d6"
Sep 20 01:03:27.486998 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:27.486914    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/97c6988a-1f22-4be7-8841-7d17e4f5387a-maas-api-service-ca\") pod \"97c6988a-1f22-4be7-8841-7d17e4f5387a\" (UID: \"97c6988a-1f22-4be7-8841-7d17e4f5387a\") "
Sep 20 01:03:27.487197 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:27.487176    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97c6988a-1f22-4be7-8841-7d17e4f5387a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "97c6988a-1f22-4be7-8841-7d17e4f5387a" (UID: "97c6988a-1f22-4be7-8841-7d17e4f5387a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:03:27.487256 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:27.487246    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/97c6988a-1f22-4be7-8841-7d17e4f5387a-maas-api-service-ca\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:03:28.228069 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:28.228038    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f689c4cd-wf6d6"
Sep 20 01:03:28.228244 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:28.228045    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f689c4cd-wf6d6" event={"ID":"97c6988a-1f22-4be7-8841-7d17e4f5387a","Type":"ContainerDied","Data":"9918db2bf4e8626d3059a9148532ccdd5636d7a121e3ba0b45819f0cece7e16e"}
Sep 20 01:03:28.228244 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:28.228164    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9918db2bf4e8626d3059a9148532ccdd5636d7a121e3ba0b45819f0cece7e16e"
Sep 20 01:03:28.317388 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:28.317355    2570 patch_prober.go:28] interesting pod/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 20 01:03:28.317568 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:28.317418    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg" podUID="3077aa12-4eb7-48fa-9eb0-383b45dd8c25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 20 01:03:29.013560 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:29.013520    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg"
Sep 20 01:03:29.317219 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:29.317126    2570 patch_prober.go:28] interesting pod/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 20 01:03:29.317219 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:29.317183    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg" podUID="3077aa12-4eb7-48fa-9eb0-383b45dd8c25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 20 01:03:30.317195 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:30.317160    2570 patch_prober.go:28] interesting pod/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 20 01:03:30.317632 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:30.317228    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg" podUID="3077aa12-4eb7-48fa-9eb0-383b45dd8c25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 20 01:03:31.320927 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:31.320897    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg"
Sep 20 01:03:31.321959 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:31.321939    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg"
Sep 20 01:03:31.642516 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:31.642482    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-f689c4cd-67cdd9ff85-9m4vq"]
Sep 20 01:03:31.642761 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:31.642735    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-f689c4cd-67cdd9ff85-9m4vq" podUID="a8edcc80-6cd9-4bc2-895f-dfd2a3de8ce4" containerName="payload-processing" containerID="cri-o://0c26e8e570813a7cd113965c6de38a0cffbe1034320b9900abc0d70933e4f72e" gracePeriod=30
Sep 20 01:03:31.822539 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:31.822502    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f689c4cd-wf6d6"]
Sep 20 01:03:31.825224 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:31.825196    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f689c4cd-wf6d6"]
Sep 20 01:03:31.897855 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:31.897789    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-f689c4cd-67cdd9ff85-9m4vq"
Sep 20 01:03:31.959631 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:31.959599    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg"]
Sep 20 01:03:32.033560 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:32.033526    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8edcc80-6cd9-4bc2-895f-dfd2a3de8ce4-plugins-config-volume\") pod \"a8edcc80-6cd9-4bc2-895f-dfd2a3de8ce4\" (UID: \"a8edcc80-6cd9-4bc2-895f-dfd2a3de8ce4\") "
Sep 20 01:03:32.033765 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:32.033624    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2bgjq\" (UniqueName: \"kubernetes.io/projected/a8edcc80-6cd9-4bc2-895f-dfd2a3de8ce4-kube-api-access-2bgjq\") pod \"a8edcc80-6cd9-4bc2-895f-dfd2a3de8ce4\" (UID: \"a8edcc80-6cd9-4bc2-895f-dfd2a3de8ce4\") "
Sep 20 01:03:32.033975 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:32.033950    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8edcc80-6cd9-4bc2-895f-dfd2a3de8ce4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a8edcc80-6cd9-4bc2-895f-dfd2a3de8ce4" (UID: "a8edcc80-6cd9-4bc2-895f-dfd2a3de8ce4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:03:32.035806 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:32.035787    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8edcc80-6cd9-4bc2-895f-dfd2a3de8ce4-kube-api-access-2bgjq" (OuterVolumeSpecName: "kube-api-access-2bgjq") pod "a8edcc80-6cd9-4bc2-895f-dfd2a3de8ce4" (UID: "a8edcc80-6cd9-4bc2-895f-dfd2a3de8ce4"). InnerVolumeSpecName "kube-api-access-2bgjq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:03:32.135481 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:32.135440    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8edcc80-6cd9-4bc2-895f-dfd2a3de8ce4-plugins-config-volume\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:03:32.135481 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:32.135474    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2bgjq\" (UniqueName: \"kubernetes.io/projected/a8edcc80-6cd9-4bc2-895f-dfd2a3de8ce4-kube-api-access-2bgjq\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:03:32.252501 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:32.252411    2570 generic.go:356] "Generic (PLEG): container finished" podID="a8edcc80-6cd9-4bc2-895f-dfd2a3de8ce4" containerID="0c26e8e570813a7cd113965c6de38a0cffbe1034320b9900abc0d70933e4f72e" exitCode=0
Sep 20 01:03:32.252501 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:32.252459    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-f689c4cd-67cdd9ff85-9m4vq"
Sep 20 01:03:32.252696 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:32.252513    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-f689c4cd-67cdd9ff85-9m4vq" event={"ID":"a8edcc80-6cd9-4bc2-895f-dfd2a3de8ce4","Type":"ContainerDied","Data":"0c26e8e570813a7cd113965c6de38a0cffbe1034320b9900abc0d70933e4f72e"}
Sep 20 01:03:32.252696 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:32.252572    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-f689c4cd-67cdd9ff85-9m4vq" event={"ID":"a8edcc80-6cd9-4bc2-895f-dfd2a3de8ce4","Type":"ContainerDied","Data":"55631173e171b8fae99f2b8f06b16249a44a10cf1073b7f8c48d1468cd854bc8"}
Sep 20 01:03:32.252696 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:32.252599    2570 scope.go:117] "RemoveContainer" containerID="0c26e8e570813a7cd113965c6de38a0cffbe1034320b9900abc0d70933e4f72e"
Sep 20 01:03:32.252987 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:32.252968    2570 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg" secret="" err="secret \"e2e-derive-f689c4cd-openshift-default-dockercfg-vgwws\" not found"
Sep 20 01:03:32.262531 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:32.262512    2570 scope.go:117] "RemoveContainer" containerID="0c26e8e570813a7cd113965c6de38a0cffbe1034320b9900abc0d70933e4f72e"
Sep 20 01:03:32.262816 ip-10-0-132-108 kubenswrapper[2570]: E0920 01:03:32.262794    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c26e8e570813a7cd113965c6de38a0cffbe1034320b9900abc0d70933e4f72e\": container with ID starting with 0c26e8e570813a7cd113965c6de38a0cffbe1034320b9900abc0d70933e4f72e not found: ID does not exist" containerID="0c26e8e570813a7cd113965c6de38a0cffbe1034320b9900abc0d70933e4f72e"
Sep 20 01:03:32.262888 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:32.262827    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c26e8e570813a7cd113965c6de38a0cffbe1034320b9900abc0d70933e4f72e"} err="failed to get container status \"0c26e8e570813a7cd113965c6de38a0cffbe1034320b9900abc0d70933e4f72e\": rpc error: code = NotFound desc = could not find container \"0c26e8e570813a7cd113965c6de38a0cffbe1034320b9900abc0d70933e4f72e\": container with ID starting with 0c26e8e570813a7cd113965c6de38a0cffbe1034320b9900abc0d70933e4f72e not found: ID does not exist"
Sep 20 01:03:32.274790 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:32.274761    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-f689c4cd-67cdd9ff85-9m4vq"]
Sep 20 01:03:32.276830 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:32.276809    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-f689c4cd-67cdd9ff85-9m4vq"]
Sep 20 01:03:33.259173 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:33.259134    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg" podUID="3077aa12-4eb7-48fa-9eb0-383b45dd8c25" containerName="istio-proxy" containerID="cri-o://53b5830a0f45f5ba23d8add9a99785ff8eefeba8e0ac2105fbab2e71df874893" gracePeriod=30
Sep 20 01:03:33.453984 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:33.453950    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97c6988a-1f22-4be7-8841-7d17e4f5387a" path="/var/lib/kubelet/pods/97c6988a-1f22-4be7-8841-7d17e4f5387a/volumes"
Sep 20 01:03:33.454338 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:33.454324    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8edcc80-6cd9-4bc2-895f-dfd2a3de8ce4" path="/var/lib/kubelet/pods/a8edcc80-6cd9-4bc2-895f-dfd2a3de8ce4/volumes"
Sep 20 01:03:38.528322 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:38.528268    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg"
Sep 20 01:03:38.702526 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:38.702494    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3077aa12-4eb7-48fa-9eb0-383b45dd8c25-istiod-ca-cert\") pod \"3077aa12-4eb7-48fa-9eb0-383b45dd8c25\" (UID: \"3077aa12-4eb7-48fa-9eb0-383b45dd8c25\") "
Sep 20 01:03:38.702526 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:38.702532    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3077aa12-4eb7-48fa-9eb0-383b45dd8c25-workload-certs\") pod \"3077aa12-4eb7-48fa-9eb0-383b45dd8c25\" (UID: \"3077aa12-4eb7-48fa-9eb0-383b45dd8c25\") "
Sep 20 01:03:38.702789 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:38.702550    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-556dh\" (UniqueName: \"kubernetes.io/projected/3077aa12-4eb7-48fa-9eb0-383b45dd8c25-kube-api-access-556dh\") pod \"3077aa12-4eb7-48fa-9eb0-383b45dd8c25\" (UID: \"3077aa12-4eb7-48fa-9eb0-383b45dd8c25\") "
Sep 20 01:03:38.702789 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:38.702569    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3077aa12-4eb7-48fa-9eb0-383b45dd8c25-istio-data\") pod \"3077aa12-4eb7-48fa-9eb0-383b45dd8c25\" (UID: \"3077aa12-4eb7-48fa-9eb0-383b45dd8c25\") "
Sep 20 01:03:38.702789 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:38.702603    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3077aa12-4eb7-48fa-9eb0-383b45dd8c25-istio-envoy\") pod \"3077aa12-4eb7-48fa-9eb0-383b45dd8c25\" (UID: \"3077aa12-4eb7-48fa-9eb0-383b45dd8c25\") "
Sep 20 01:03:38.702789 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:38.702656    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3077aa12-4eb7-48fa-9eb0-383b45dd8c25-credential-socket\") pod \"3077aa12-4eb7-48fa-9eb0-383b45dd8c25\" (UID: \"3077aa12-4eb7-48fa-9eb0-383b45dd8c25\") "
Sep 20 01:03:38.702789 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:38.702706    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3077aa12-4eb7-48fa-9eb0-383b45dd8c25-istio-podinfo\") pod \"3077aa12-4eb7-48fa-9eb0-383b45dd8c25\" (UID: \"3077aa12-4eb7-48fa-9eb0-383b45dd8c25\") "
Sep 20 01:03:38.702789 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:38.702750    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3077aa12-4eb7-48fa-9eb0-383b45dd8c25-workload-socket\") pod \"3077aa12-4eb7-48fa-9eb0-383b45dd8c25\" (UID: \"3077aa12-4eb7-48fa-9eb0-383b45dd8c25\") "
Sep 20 01:03:38.703141 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:38.702800    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3077aa12-4eb7-48fa-9eb0-383b45dd8c25-istio-token\") pod \"3077aa12-4eb7-48fa-9eb0-383b45dd8c25\" (UID: \"3077aa12-4eb7-48fa-9eb0-383b45dd8c25\") "
Sep 20 01:03:38.703141 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:38.702841    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3077aa12-4eb7-48fa-9eb0-383b45dd8c25-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3077aa12-4eb7-48fa-9eb0-383b45dd8c25" (UID: "3077aa12-4eb7-48fa-9eb0-383b45dd8c25"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:03:38.703141 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:38.702947    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3077aa12-4eb7-48fa-9eb0-383b45dd8c25-istio-data" (OuterVolumeSpecName: "istio-data") pod "3077aa12-4eb7-48fa-9eb0-383b45dd8c25" (UID: "3077aa12-4eb7-48fa-9eb0-383b45dd8c25"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:03:38.703141 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:38.702976    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3077aa12-4eb7-48fa-9eb0-383b45dd8c25-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3077aa12-4eb7-48fa-9eb0-383b45dd8c25" (UID: "3077aa12-4eb7-48fa-9eb0-383b45dd8c25"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:03:38.703141 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:38.703096    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3077aa12-4eb7-48fa-9eb0-383b45dd8c25-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3077aa12-4eb7-48fa-9eb0-383b45dd8c25" (UID: "3077aa12-4eb7-48fa-9eb0-383b45dd8c25"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:03:38.703569 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:38.703216    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3077aa12-4eb7-48fa-9eb0-383b45dd8c25-istiod-ca-cert\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:03:38.703569 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:38.703223    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3077aa12-4eb7-48fa-9eb0-383b45dd8c25-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3077aa12-4eb7-48fa-9eb0-383b45dd8c25" (UID: "3077aa12-4eb7-48fa-9eb0-383b45dd8c25"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:03:38.703569 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:38.703236    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3077aa12-4eb7-48fa-9eb0-383b45dd8c25-workload-certs\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:03:38.703569 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:38.703249    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3077aa12-4eb7-48fa-9eb0-383b45dd8c25-istio-data\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:03:38.703569 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:38.703261    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3077aa12-4eb7-48fa-9eb0-383b45dd8c25-workload-socket\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:03:38.705038 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:38.705015    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3077aa12-4eb7-48fa-9eb0-383b45dd8c25-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3077aa12-4eb7-48fa-9eb0-383b45dd8c25" (UID: "3077aa12-4eb7-48fa-9eb0-383b45dd8c25"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:03:38.705155 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:38.705074    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3077aa12-4eb7-48fa-9eb0-383b45dd8c25-istio-token" (OuterVolumeSpecName: "istio-token") pod "3077aa12-4eb7-48fa-9eb0-383b45dd8c25" (UID: "3077aa12-4eb7-48fa-9eb0-383b45dd8c25"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:03:38.705155 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:38.705074    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3077aa12-4eb7-48fa-9eb0-383b45dd8c25-kube-api-access-556dh" (OuterVolumeSpecName: "kube-api-access-556dh") pod "3077aa12-4eb7-48fa-9eb0-383b45dd8c25" (UID: "3077aa12-4eb7-48fa-9eb0-383b45dd8c25"). InnerVolumeSpecName "kube-api-access-556dh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:03:38.705249 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:38.705157    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3077aa12-4eb7-48fa-9eb0-383b45dd8c25-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3077aa12-4eb7-48fa-9eb0-383b45dd8c25" (UID: "3077aa12-4eb7-48fa-9eb0-383b45dd8c25"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 20 01:03:38.804389 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:38.804287    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3077aa12-4eb7-48fa-9eb0-383b45dd8c25-istio-podinfo\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:03:38.804389 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:38.804323    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3077aa12-4eb7-48fa-9eb0-383b45dd8c25-istio-token\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:03:38.804389 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:38.804336    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-556dh\" (UniqueName: \"kubernetes.io/projected/3077aa12-4eb7-48fa-9eb0-383b45dd8c25-kube-api-access-556dh\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:03:38.804389 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:38.804348    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3077aa12-4eb7-48fa-9eb0-383b45dd8c25-istio-envoy\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:03:38.804389 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:38.804360    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3077aa12-4eb7-48fa-9eb0-383b45dd8c25-credential-socket\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:03:39.294976 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:39.294943    2570 generic.go:356] "Generic (PLEG): container finished" podID="3077aa12-4eb7-48fa-9eb0-383b45dd8c25" containerID="53b5830a0f45f5ba23d8add9a99785ff8eefeba8e0ac2105fbab2e71df874893" exitCode=0
Sep 20 01:03:39.295160 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:39.295009    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg"
Sep 20 01:03:39.295160 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:39.295032    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg" event={"ID":"3077aa12-4eb7-48fa-9eb0-383b45dd8c25","Type":"ContainerDied","Data":"53b5830a0f45f5ba23d8add9a99785ff8eefeba8e0ac2105fbab2e71df874893"}
Sep 20 01:03:39.295160 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:39.295118    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg" event={"ID":"3077aa12-4eb7-48fa-9eb0-383b45dd8c25","Type":"ContainerDied","Data":"b40fbd4bdb2b87d1b7a6f44c3c0d65c6a655b8c12cf5bf115c0771d90fff2503"}
Sep 20 01:03:39.295160 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:39.295140    2570 scope.go:117] "RemoveContainer" containerID="53b5830a0f45f5ba23d8add9a99785ff8eefeba8e0ac2105fbab2e71df874893"
Sep 20 01:03:39.305077 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:39.305061    2570 scope.go:117] "RemoveContainer" containerID="c0acb02fdf20c478f2809998ef4e5152baa306e2ac5b781a1e6a9ac2536a0cb6"
Sep 20 01:03:39.313698 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:39.313619    2570 scope.go:117] "RemoveContainer" containerID="53b5830a0f45f5ba23d8add9a99785ff8eefeba8e0ac2105fbab2e71df874893"
Sep 20 01:03:39.313954 ip-10-0-132-108 kubenswrapper[2570]: E0920 01:03:39.313933    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53b5830a0f45f5ba23d8add9a99785ff8eefeba8e0ac2105fbab2e71df874893\": container with ID starting with 53b5830a0f45f5ba23d8add9a99785ff8eefeba8e0ac2105fbab2e71df874893 not found: ID does not exist" containerID="53b5830a0f45f5ba23d8add9a99785ff8eefeba8e0ac2105fbab2e71df874893"
Sep 20 01:03:39.314053 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:39.313967    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53b5830a0f45f5ba23d8add9a99785ff8eefeba8e0ac2105fbab2e71df874893"} err="failed to get container status \"53b5830a0f45f5ba23d8add9a99785ff8eefeba8e0ac2105fbab2e71df874893\": rpc error: code = NotFound desc = could not find container \"53b5830a0f45f5ba23d8add9a99785ff8eefeba8e0ac2105fbab2e71df874893\": container with ID starting with 53b5830a0f45f5ba23d8add9a99785ff8eefeba8e0ac2105fbab2e71df874893 not found: ID does not exist"
Sep 20 01:03:39.314053 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:39.313990    2570 scope.go:117] "RemoveContainer" containerID="c0acb02fdf20c478f2809998ef4e5152baa306e2ac5b781a1e6a9ac2536a0cb6"
Sep 20 01:03:39.314318 ip-10-0-132-108 kubenswrapper[2570]: E0920 01:03:39.314296    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0acb02fdf20c478f2809998ef4e5152baa306e2ac5b781a1e6a9ac2536a0cb6\": container with ID starting with c0acb02fdf20c478f2809998ef4e5152baa306e2ac5b781a1e6a9ac2536a0cb6 not found: ID does not exist" containerID="c0acb02fdf20c478f2809998ef4e5152baa306e2ac5b781a1e6a9ac2536a0cb6"
Sep 20 01:03:39.314361 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:39.314325    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0acb02fdf20c478f2809998ef4e5152baa306e2ac5b781a1e6a9ac2536a0cb6"} err="failed to get container status \"c0acb02fdf20c478f2809998ef4e5152baa306e2ac5b781a1e6a9ac2536a0cb6\": rpc error: code = NotFound desc = could not find container \"c0acb02fdf20c478f2809998ef4e5152baa306e2ac5b781a1e6a9ac2536a0cb6\": container with ID starting with c0acb02fdf20c478f2809998ef4e5152baa306e2ac5b781a1e6a9ac2536a0cb6 not found: ID does not exist"
Sep 20 01:03:39.316062 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:39.316043    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg"]
Sep 20 01:03:39.319263 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:39.319242    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-f689c4cd-openshift-default-5b687bdd5b-dsqlg"]
Sep 20 01:03:39.454439 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:39.454403    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3077aa12-4eb7-48fa-9eb0-383b45dd8c25" path="/var/lib/kubelet/pods/3077aa12-4eb7-48fa-9eb0-383b45dd8c25/volumes"
Sep 20 01:03:42.196303 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:42.196268    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-173fde-pb7wp"]
Sep 20 01:03:42.196802 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:42.196785    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97c6988a-1f22-4be7-8841-7d17e4f5387a" containerName="revoke-keys"
Sep 20 01:03:42.196851 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:42.196804    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="97c6988a-1f22-4be7-8841-7d17e4f5387a" containerName="revoke-keys"
Sep 20 01:03:42.196851 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:42.196826    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3077aa12-4eb7-48fa-9eb0-383b45dd8c25" containerName="istio-proxy"
Sep 20 01:03:42.196851 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:42.196832    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3077aa12-4eb7-48fa-9eb0-383b45dd8c25" containerName="istio-proxy"
Sep 20 01:03:42.196851 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:42.196840    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8edcc80-6cd9-4bc2-895f-dfd2a3de8ce4" containerName="payload-processing"
Sep 20 01:03:42.196851 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:42.196846    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8edcc80-6cd9-4bc2-895f-dfd2a3de8ce4" containerName="payload-processing"
Sep 20 01:03:42.197045 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:42.196853    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3077aa12-4eb7-48fa-9eb0-383b45dd8c25" containerName="istio-proxy"
Sep 20 01:03:42.197045 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:42.196875    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3077aa12-4eb7-48fa-9eb0-383b45dd8c25" containerName="istio-proxy"
Sep 20 01:03:42.197045 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:42.196939    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8edcc80-6cd9-4bc2-895f-dfd2a3de8ce4" containerName="payload-processing"
Sep 20 01:03:42.197045 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:42.196946    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="3077aa12-4eb7-48fa-9eb0-383b45dd8c25" containerName="istio-proxy"
Sep 20 01:03:42.197045 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:42.196953    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="97c6988a-1f22-4be7-8841-7d17e4f5387a" containerName="revoke-keys"
Sep 20 01:03:42.197045 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:42.196961    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="3077aa12-4eb7-48fa-9eb0-383b45dd8c25" containerName="istio-proxy"
Sep 20 01:03:42.201440 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:42.201424    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-173fde-pb7wp"
Sep 20 01:03:42.204979 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:42.204959    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5xngg\""
Sep 20 01:03:42.205832 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:42.205816    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 20 01:03:42.212056 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:42.212035    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-173fde-pb7wp"]
Sep 20 01:03:42.236577 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:42.236550    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/628b9288-1ee3-4f99-9caf-00c8d8d34000-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-173fde-pb7wp\" (UID: \"628b9288-1ee3-4f99-9caf-00c8d8d34000\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-173fde-pb7wp"
Sep 20 01:03:42.337432 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:42.337400    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/628b9288-1ee3-4f99-9caf-00c8d8d34000-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-173fde-pb7wp\" (UID: \"628b9288-1ee3-4f99-9caf-00c8d8d34000\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-173fde-pb7wp"
Sep 20 01:03:42.338087 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:42.338064    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/628b9288-1ee3-4f99-9caf-00c8d8d34000-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-173fde-pb7wp\" (UID: \"628b9288-1ee3-4f99-9caf-00c8d8d34000\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-173fde-pb7wp"
Sep 20 01:03:42.513052 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:42.512971    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-173fde-pb7wp"
Sep 20 01:03:42.785875 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:42.785833    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-173fde-pb7wp"]
Sep 20 01:03:42.788178 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:03:42.788153    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod628b9288_1ee3_4f99_9caf_00c8d8d34000.slice/crio-6341b86c517ca4da2592da6eb4250be20a15f3f60eb64a8c3737d1d581c5297c WatchSource:0}: Error finding container 6341b86c517ca4da2592da6eb4250be20a15f3f60eb64a8c3737d1d581c5297c: Status 404 returned error can't find the container with id 6341b86c517ca4da2592da6eb4250be20a15f3f60eb64a8c3737d1d581c5297c
Sep 20 01:03:43.320091 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:43.320005    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-173fde-pb7wp" event={"ID":"628b9288-1ee3-4f99-9caf-00c8d8d34000","Type":"ContainerStarted","Data":"bd56d14e238f29a0b2eb77ef870084c019b278b4f75f893062f1be5d1a6beb23"}
Sep 20 01:03:43.320091 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:43.320061    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-173fde-pb7wp" event={"ID":"628b9288-1ee3-4f99-9caf-00c8d8d34000","Type":"ContainerStarted","Data":"6341b86c517ca4da2592da6eb4250be20a15f3f60eb64a8c3737d1d581c5297c"}
Sep 20 01:03:43.335746 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:43.335694    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-173fde-pb7wp" podStartSLOduration=1.335676985 podStartE2EDuration="1.335676985s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:03:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:03:43.334212621 +0000 UTC m=+959.948368543" watchObservedRunningTime="2026-09-20 01:03:43.335676985 +0000 UTC m=+959.949832882"
Sep 20 01:03:44.327136 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:44.327104    2570 generic.go:356] "Generic (PLEG): container finished" podID="628b9288-1ee3-4f99-9caf-00c8d8d34000" containerID="bd56d14e238f29a0b2eb77ef870084c019b278b4f75f893062f1be5d1a6beb23" exitCode=0
Sep 20 01:03:44.327511 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:44.327157    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-173fde-pb7wp" event={"ID":"628b9288-1ee3-4f99-9caf-00c8d8d34000","Type":"ContainerDied","Data":"bd56d14e238f29a0b2eb77ef870084c019b278b4f75f893062f1be5d1a6beb23"}
Sep 20 01:03:45.472823 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:45.472788    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-173fde-pb7wp"
Sep 20 01:03:45.568914 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:45.568885    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/628b9288-1ee3-4f99-9caf-00c8d8d34000-maas-api-service-ca\") pod \"628b9288-1ee3-4f99-9caf-00c8d8d34000\" (UID: \"628b9288-1ee3-4f99-9caf-00c8d8d34000\") "
Sep 20 01:03:45.569154 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:45.569130    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/628b9288-1ee3-4f99-9caf-00c8d8d34000-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "628b9288-1ee3-4f99-9caf-00c8d8d34000" (UID: "628b9288-1ee3-4f99-9caf-00c8d8d34000"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:03:45.670067 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:45.670036    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/628b9288-1ee3-4f99-9caf-00c8d8d34000-maas-api-service-ca\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:03:46.339667 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:46.339638    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-173fde-pb7wp"
Sep 20 01:03:46.339853 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:46.339681    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-173fde-pb7wp" event={"ID":"628b9288-1ee3-4f99-9caf-00c8d8d34000","Type":"ContainerDied","Data":"6341b86c517ca4da2592da6eb4250be20a15f3f60eb64a8c3737d1d581c5297c"}
Sep 20 01:03:46.339853 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:46.339731    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6341b86c517ca4da2592da6eb4250be20a15f3f60eb64a8c3737d1d581c5297c"
Sep 20 01:03:52.737095 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:52.737055    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-173fde-66f5ffd4c7-b4qpd"]
Sep 20 01:03:52.737538 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:52.737310    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-173fde-66f5ffd4c7-b4qpd" podUID="03609516-a4f2-48f0-bc8e-7599b6d5e222" containerName="payload-processing" containerID="cri-o://c1ce2384cf45b51b729cde56aac8a2be9fcb02aa08cb5befda06687008e4113f" gracePeriod=30
Sep 20 01:03:52.747484 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:52.747448    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-173fde-76dc8f579d-kgkl8"]
Sep 20 01:03:52.747809 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:52.747780    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-autores-173fde-76dc8f579d-kgkl8" podUID="03055f25-00b5-4b37-8db8-9eac71eb747d" containerName="payload-pre-processing" containerID="cri-o://ca653581d17c3464aa2fce4623e9919e8e533be09ba155817570e20201bc77a4" gracePeriod=30
Sep 20 01:03:52.908767 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:52.908730    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-173fde-pb7wp"]
Sep 20 01:03:52.913029 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:52.912942    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-173fde-pb7wp"]
Sep 20 01:03:53.025506 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:53.025484    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-173fde-66f5ffd4c7-b4qpd"
Sep 20 01:03:53.028973 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:53.028951    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-173fde-76dc8f579d-kgkl8"
Sep 20 01:03:53.142433 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:53.142395    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03609516-a4f2-48f0-bc8e-7599b6d5e222-plugins-config-volume\") pod \"03609516-a4f2-48f0-bc8e-7599b6d5e222\" (UID: \"03609516-a4f2-48f0-bc8e-7599b6d5e222\") "
Sep 20 01:03:53.142609 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:53.142469    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03055f25-00b5-4b37-8db8-9eac71eb747d-plugins-config-volume\") pod \"03055f25-00b5-4b37-8db8-9eac71eb747d\" (UID: \"03055f25-00b5-4b37-8db8-9eac71eb747d\") "
Sep 20 01:03:53.142609 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:53.142546    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qqjnr\" (UniqueName: \"kubernetes.io/projected/03055f25-00b5-4b37-8db8-9eac71eb747d-kube-api-access-qqjnr\") pod \"03055f25-00b5-4b37-8db8-9eac71eb747d\" (UID: \"03055f25-00b5-4b37-8db8-9eac71eb747d\") "
Sep 20 01:03:53.142609 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:53.142572    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wvdzn\" (UniqueName: \"kubernetes.io/projected/03609516-a4f2-48f0-bc8e-7599b6d5e222-kube-api-access-wvdzn\") pod \"03609516-a4f2-48f0-bc8e-7599b6d5e222\" (UID: \"03609516-a4f2-48f0-bc8e-7599b6d5e222\") "
Sep 20 01:03:53.142801 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:53.142775    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03609516-a4f2-48f0-bc8e-7599b6d5e222-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "03609516-a4f2-48f0-bc8e-7599b6d5e222" (UID: "03609516-a4f2-48f0-bc8e-7599b6d5e222"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:03:53.142907 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:53.142882    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03055f25-00b5-4b37-8db8-9eac71eb747d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "03055f25-00b5-4b37-8db8-9eac71eb747d" (UID: "03055f25-00b5-4b37-8db8-9eac71eb747d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:03:53.143016 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:53.143001    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03609516-a4f2-48f0-bc8e-7599b6d5e222-plugins-config-volume\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:03:53.143056 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:53.143019    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/03055f25-00b5-4b37-8db8-9eac71eb747d-plugins-config-volume\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:03:53.144745 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:53.144729    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03609516-a4f2-48f0-bc8e-7599b6d5e222-kube-api-access-wvdzn" (OuterVolumeSpecName: "kube-api-access-wvdzn") pod "03609516-a4f2-48f0-bc8e-7599b6d5e222" (UID: "03609516-a4f2-48f0-bc8e-7599b6d5e222"). InnerVolumeSpecName "kube-api-access-wvdzn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:03:53.144745 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:53.144736    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03055f25-00b5-4b37-8db8-9eac71eb747d-kube-api-access-qqjnr" (OuterVolumeSpecName: "kube-api-access-qqjnr") pod "03055f25-00b5-4b37-8db8-9eac71eb747d" (UID: "03055f25-00b5-4b37-8db8-9eac71eb747d"). InnerVolumeSpecName "kube-api-access-qqjnr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:03:53.243797 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:53.243761    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqjnr\" (UniqueName: \"kubernetes.io/projected/03055f25-00b5-4b37-8db8-9eac71eb747d-kube-api-access-qqjnr\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:03:53.243797 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:53.243790    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wvdzn\" (UniqueName: \"kubernetes.io/projected/03609516-a4f2-48f0-bc8e-7599b6d5e222-kube-api-access-wvdzn\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:03:53.377460 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:53.377430    2570 generic.go:356] "Generic (PLEG): container finished" podID="03055f25-00b5-4b37-8db8-9eac71eb747d" containerID="ca653581d17c3464aa2fce4623e9919e8e533be09ba155817570e20201bc77a4" exitCode=0
Sep 20 01:03:53.377666 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:53.377484    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-173fde-76dc8f579d-kgkl8"
Sep 20 01:03:53.377666 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:53.377528    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-173fde-76dc8f579d-kgkl8" event={"ID":"03055f25-00b5-4b37-8db8-9eac71eb747d","Type":"ContainerDied","Data":"ca653581d17c3464aa2fce4623e9919e8e533be09ba155817570e20201bc77a4"}
Sep 20 01:03:53.377666 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:53.377582    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-173fde-76dc8f579d-kgkl8" event={"ID":"03055f25-00b5-4b37-8db8-9eac71eb747d","Type":"ContainerDied","Data":"4ac2c2ad7fbbc5be6315bf8245e3fc782cdd77b10e12cc398d394b93ef69c7a2"}
Sep 20 01:03:53.377666 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:53.377615    2570 scope.go:117] "RemoveContainer" containerID="ca653581d17c3464aa2fce4623e9919e8e533be09ba155817570e20201bc77a4"
Sep 20 01:03:53.378889 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:53.378836    2570 generic.go:356] "Generic (PLEG): container finished" podID="03609516-a4f2-48f0-bc8e-7599b6d5e222" containerID="c1ce2384cf45b51b729cde56aac8a2be9fcb02aa08cb5befda06687008e4113f" exitCode=0
Sep 20 01:03:53.379027 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:53.378896    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-173fde-66f5ffd4c7-b4qpd"
Sep 20 01:03:53.379027 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:53.378913    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-173fde-66f5ffd4c7-b4qpd" event={"ID":"03609516-a4f2-48f0-bc8e-7599b6d5e222","Type":"ContainerDied","Data":"c1ce2384cf45b51b729cde56aac8a2be9fcb02aa08cb5befda06687008e4113f"}
Sep 20 01:03:53.379027 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:53.378958    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-173fde-66f5ffd4c7-b4qpd" event={"ID":"03609516-a4f2-48f0-bc8e-7599b6d5e222","Type":"ContainerDied","Data":"d81b8e5efce630095b793ca192f9dd2ce003f1bdc4dbad5e6be1dd938e28d74d"}
Sep 20 01:03:53.387448 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:53.387413    2570 scope.go:117] "RemoveContainer" containerID="ca653581d17c3464aa2fce4623e9919e8e533be09ba155817570e20201bc77a4"
Sep 20 01:03:53.387757 ip-10-0-132-108 kubenswrapper[2570]: E0920 01:03:53.387734    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca653581d17c3464aa2fce4623e9919e8e533be09ba155817570e20201bc77a4\": container with ID starting with ca653581d17c3464aa2fce4623e9919e8e533be09ba155817570e20201bc77a4 not found: ID does not exist" containerID="ca653581d17c3464aa2fce4623e9919e8e533be09ba155817570e20201bc77a4"
Sep 20 01:03:53.387822 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:53.387770    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca653581d17c3464aa2fce4623e9919e8e533be09ba155817570e20201bc77a4"} err="failed to get container status \"ca653581d17c3464aa2fce4623e9919e8e533be09ba155817570e20201bc77a4\": rpc error: code = NotFound desc = could not find container \"ca653581d17c3464aa2fce4623e9919e8e533be09ba155817570e20201bc77a4\": container with ID starting with ca653581d17c3464aa2fce4623e9919e8e533be09ba155817570e20201bc77a4 not found: ID does not exist"
Sep 20 01:03:53.387822 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:53.387793    2570 scope.go:117] "RemoveContainer" containerID="c1ce2384cf45b51b729cde56aac8a2be9fcb02aa08cb5befda06687008e4113f"
Sep 20 01:03:53.396224 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:53.396205    2570 scope.go:117] "RemoveContainer" containerID="c1ce2384cf45b51b729cde56aac8a2be9fcb02aa08cb5befda06687008e4113f"
Sep 20 01:03:53.396478 ip-10-0-132-108 kubenswrapper[2570]: E0920 01:03:53.396459    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1ce2384cf45b51b729cde56aac8a2be9fcb02aa08cb5befda06687008e4113f\": container with ID starting with c1ce2384cf45b51b729cde56aac8a2be9fcb02aa08cb5befda06687008e4113f not found: ID does not exist" containerID="c1ce2384cf45b51b729cde56aac8a2be9fcb02aa08cb5befda06687008e4113f"
Sep 20 01:03:53.396536 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:53.396484    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1ce2384cf45b51b729cde56aac8a2be9fcb02aa08cb5befda06687008e4113f"} err="failed to get container status \"c1ce2384cf45b51b729cde56aac8a2be9fcb02aa08cb5befda06687008e4113f\": rpc error: code = NotFound desc = could not find container \"c1ce2384cf45b51b729cde56aac8a2be9fcb02aa08cb5befda06687008e4113f\": container with ID starting with c1ce2384cf45b51b729cde56aac8a2be9fcb02aa08cb5befda06687008e4113f not found: ID does not exist"
Sep 20 01:03:53.401441 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:53.401421    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-173fde-76dc8f579d-kgkl8"]
Sep 20 01:03:53.405377 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:53.405358    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-173fde-76dc8f579d-kgkl8"]
Sep 20 01:03:53.416612 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:53.416592    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-173fde-66f5ffd4c7-b4qpd"]
Sep 20 01:03:53.419830 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:53.419810    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-173fde-66f5ffd4c7-b4qpd"]
Sep 20 01:03:53.454626 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:53.454600    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03055f25-00b5-4b37-8db8-9eac71eb747d" path="/var/lib/kubelet/pods/03055f25-00b5-4b37-8db8-9eac71eb747d/volumes"
Sep 20 01:03:53.455055 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:53.455037    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03609516-a4f2-48f0-bc8e-7599b6d5e222" path="/var/lib/kubelet/pods/03609516-a4f2-48f0-bc8e-7599b6d5e222/volumes"
Sep 20 01:03:53.455373 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:03:53.455359    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="628b9288-1ee3-4f99-9caf-00c8d8d34000" path="/var/lib/kubelet/pods/628b9288-1ee3-4f99-9caf-00c8d8d34000/volumes"
Sep 20 01:04:05.029655 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:05.029565    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86"]
Sep 20 01:04:05.030330 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:05.030309    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="628b9288-1ee3-4f99-9caf-00c8d8d34000" containerName="revoke-keys"
Sep 20 01:04:05.030421 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:05.030333    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="628b9288-1ee3-4f99-9caf-00c8d8d34000" containerName="revoke-keys"
Sep 20 01:04:05.030421 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:05.030353    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03055f25-00b5-4b37-8db8-9eac71eb747d" containerName="payload-pre-processing"
Sep 20 01:04:05.030421 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:05.030360    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="03055f25-00b5-4b37-8db8-9eac71eb747d" containerName="payload-pre-processing"
Sep 20 01:04:05.030421 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:05.030394    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03609516-a4f2-48f0-bc8e-7599b6d5e222" containerName="payload-processing"
Sep 20 01:04:05.030421 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:05.030402    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="03609516-a4f2-48f0-bc8e-7599b6d5e222" containerName="payload-processing"
Sep 20 01:04:05.030671 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:05.030494    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="03609516-a4f2-48f0-bc8e-7599b6d5e222" containerName="payload-processing"
Sep 20 01:04:05.030671 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:05.030507    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="03055f25-00b5-4b37-8db8-9eac71eb747d" containerName="payload-pre-processing"
Sep 20 01:04:05.030671 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:05.030516    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="628b9288-1ee3-4f99-9caf-00c8d8d34000" containerName="revoke-keys"
Sep 20 01:04:05.033845 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:05.033825    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86"
Sep 20 01:04:05.037122 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:05.037101    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-7db579-openshift-default-dockercfg-27qqh\""
Sep 20 01:04:05.045718 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:05.045695    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86"]
Sep 20 01:04:05.163294 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:05.162803    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54618481-3343-40b6-8f54-b7af78018f2b-istio-data\") pod \"e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86\" (UID: \"54618481-3343-40b6-8f54-b7af78018f2b\") " pod="openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86"
Sep 20 01:04:05.163294 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:05.162850    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ggbc\" (UniqueName: \"kubernetes.io/projected/54618481-3343-40b6-8f54-b7af78018f2b-kube-api-access-5ggbc\") pod \"e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86\" (UID: \"54618481-3343-40b6-8f54-b7af78018f2b\") " pod="openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86"
Sep 20 01:04:05.163294 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:05.162907    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54618481-3343-40b6-8f54-b7af78018f2b-workload-socket\") pod \"e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86\" (UID: \"54618481-3343-40b6-8f54-b7af78018f2b\") " pod="openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86"
Sep 20 01:04:05.163294 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:05.162942    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54618481-3343-40b6-8f54-b7af78018f2b-istio-token\") pod \"e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86\" (UID: \"54618481-3343-40b6-8f54-b7af78018f2b\") " pod="openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86"
Sep 20 01:04:05.163294 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:05.163005    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54618481-3343-40b6-8f54-b7af78018f2b-istiod-ca-cert\") pod \"e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86\" (UID: \"54618481-3343-40b6-8f54-b7af78018f2b\") " pod="openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86"
Sep 20 01:04:05.163294 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:05.163056    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54618481-3343-40b6-8f54-b7af78018f2b-credential-socket\") pod \"e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86\" (UID: \"54618481-3343-40b6-8f54-b7af78018f2b\") " pod="openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86"
Sep 20 01:04:05.163294 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:05.163096    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54618481-3343-40b6-8f54-b7af78018f2b-workload-certs\") pod \"e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86\" (UID: \"54618481-3343-40b6-8f54-b7af78018f2b\") " pod="openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86"
Sep 20 01:04:05.163294 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:05.163147    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54618481-3343-40b6-8f54-b7af78018f2b-istio-envoy\") pod \"e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86\" (UID: \"54618481-3343-40b6-8f54-b7af78018f2b\") " pod="openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86"
Sep 20 01:04:05.163294 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:05.163202    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54618481-3343-40b6-8f54-b7af78018f2b-istio-podinfo\") pod \"e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86\" (UID: \"54618481-3343-40b6-8f54-b7af78018f2b\") " pod="openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86"
Sep 20 01:04:05.264181 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:05.264147    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54618481-3343-40b6-8f54-b7af78018f2b-istio-data\") pod \"e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86\" (UID: \"54618481-3343-40b6-8f54-b7af78018f2b\") " pod="openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86"
Sep 20 01:04:05.264181 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:05.264179    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ggbc\" (UniqueName: \"kubernetes.io/projected/54618481-3343-40b6-8f54-b7af78018f2b-kube-api-access-5ggbc\") pod \"e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86\" (UID: \"54618481-3343-40b6-8f54-b7af78018f2b\") " pod="openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86"
Sep 20 01:04:05.264518 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:05.264206    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54618481-3343-40b6-8f54-b7af78018f2b-workload-socket\") pod \"e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86\" (UID: \"54618481-3343-40b6-8f54-b7af78018f2b\") " pod="openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86"
Sep 20 01:04:05.264518 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:05.264226    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54618481-3343-40b6-8f54-b7af78018f2b-istio-token\") pod \"e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86\" (UID: \"54618481-3343-40b6-8f54-b7af78018f2b\") " pod="openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86"
Sep 20 01:04:05.264518 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:05.264278    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54618481-3343-40b6-8f54-b7af78018f2b-istiod-ca-cert\") pod \"e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86\" (UID: \"54618481-3343-40b6-8f54-b7af78018f2b\") " pod="openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86"
Sep 20 01:04:05.264518 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:05.264311    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54618481-3343-40b6-8f54-b7af78018f2b-credential-socket\") pod \"e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86\" (UID: \"54618481-3343-40b6-8f54-b7af78018f2b\") " pod="openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86"
Sep 20 01:04:05.264518 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:05.264348    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54618481-3343-40b6-8f54-b7af78018f2b-workload-certs\") pod \"e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86\" (UID: \"54618481-3343-40b6-8f54-b7af78018f2b\") " pod="openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86"
Sep 20 01:04:05.264518 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:05.264396    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54618481-3343-40b6-8f54-b7af78018f2b-istio-envoy\") pod \"e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86\" (UID: \"54618481-3343-40b6-8f54-b7af78018f2b\") " pod="openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86"
Sep 20 01:04:05.264518 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:05.264449    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54618481-3343-40b6-8f54-b7af78018f2b-istio-podinfo\") pod \"e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86\" (UID: \"54618481-3343-40b6-8f54-b7af78018f2b\") " pod="openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86"
Sep 20 01:04:05.264896 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:05.264625    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54618481-3343-40b6-8f54-b7af78018f2b-istio-data\") pod \"e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86\" (UID: \"54618481-3343-40b6-8f54-b7af78018f2b\") " pod="openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86"
Sep 20 01:04:05.264896 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:05.264639    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54618481-3343-40b6-8f54-b7af78018f2b-workload-socket\") pod \"e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86\" (UID: \"54618481-3343-40b6-8f54-b7af78018f2b\") " pod="openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86"
Sep 20 01:04:05.264896 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:05.264781    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54618481-3343-40b6-8f54-b7af78018f2b-credential-socket\") pod \"e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86\" (UID: \"54618481-3343-40b6-8f54-b7af78018f2b\") " pod="openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86"
Sep 20 01:04:05.264896 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:05.264875    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54618481-3343-40b6-8f54-b7af78018f2b-workload-certs\") pod \"e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86\" (UID: \"54618481-3343-40b6-8f54-b7af78018f2b\") " pod="openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86"
Sep 20 01:04:05.265126 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:05.265022    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54618481-3343-40b6-8f54-b7af78018f2b-istiod-ca-cert\") pod \"e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86\" (UID: \"54618481-3343-40b6-8f54-b7af78018f2b\") " pod="openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86"
Sep 20 01:04:05.267080 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:05.267062    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54618481-3343-40b6-8f54-b7af78018f2b-istio-envoy\") pod \"e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86\" (UID: \"54618481-3343-40b6-8f54-b7af78018f2b\") " pod="openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86"
Sep 20 01:04:05.267300 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:05.267282    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54618481-3343-40b6-8f54-b7af78018f2b-istio-podinfo\") pod \"e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86\" (UID: \"54618481-3343-40b6-8f54-b7af78018f2b\") " pod="openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86"
Sep 20 01:04:05.273086 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:05.273063    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ggbc\" (UniqueName: \"kubernetes.io/projected/54618481-3343-40b6-8f54-b7af78018f2b-kube-api-access-5ggbc\") pod \"e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86\" (UID: \"54618481-3343-40b6-8f54-b7af78018f2b\") " pod="openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86"
Sep 20 01:04:05.273217 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:05.273124    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54618481-3343-40b6-8f54-b7af78018f2b-istio-token\") pod \"e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86\" (UID: \"54618481-3343-40b6-8f54-b7af78018f2b\") " pod="openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86"
Sep 20 01:04:05.347497 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:05.347421    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86"
Sep 20 01:04:05.621323 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:05.621295    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86"]
Sep 20 01:04:05.624404 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:04:05.624377    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54618481_3343_40b6_8f54_b7af78018f2b.slice/crio-364a3309f9eb9ef55013d279569b913d9d12b26deed0281325e9ef503e8610a0 WatchSource:0}: Error finding container 364a3309f9eb9ef55013d279569b913d9d12b26deed0281325e9ef503e8610a0: Status 404 returned error can't find the container with id 364a3309f9eb9ef55013d279569b913d9d12b26deed0281325e9ef503e8610a0
Sep 20 01:04:05.626662 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:05.626631    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:04:05.626772 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:05.626692    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:04:05.626772 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:05.626724    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:04:06.451244 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:06.451210    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86" event={"ID":"54618481-3343-40b6-8f54-b7af78018f2b","Type":"ContainerStarted","Data":"993dccae486d25c04334a69acb8fae3cb12a0c266a56af3c7ef2bf17d1d388b2"}
Sep 20 01:04:06.451633 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:06.451262    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86" event={"ID":"54618481-3343-40b6-8f54-b7af78018f2b","Type":"ContainerStarted","Data":"364a3309f9eb9ef55013d279569b913d9d12b26deed0281325e9ef503e8610a0"}
Sep 20 01:04:06.471419 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:06.471365    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86" podStartSLOduration=1.471349286 podStartE2EDuration="1.471349286s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:04:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:04:06.469075379 +0000 UTC m=+983.083231296" watchObservedRunningTime="2026-09-20 01:04:06.471349286 +0000 UTC m=+983.085505183"
Sep 20 01:04:07.348244 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:07.348213    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86"
Sep 20 01:04:07.353781 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:07.353752    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86"
Sep 20 01:04:07.455921 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:07.455896    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86"
Sep 20 01:04:07.456935 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:07.456916    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86"
Sep 20 01:04:12.462111 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:12.462075    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-7db579-5d8f96c5d6-bv7bw"]
Sep 20 01:04:12.465944 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:12.465928    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-7db579-5d8f96c5d6-bv7bw"
Sep 20 01:04:12.468099 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:12.468079    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-7db579\""
Sep 20 01:04:12.468099 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:12.468091    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-7db579-dockercfg-l9vvh\""
Sep 20 01:04:12.475428 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:12.475401    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-7db579-5d8f96c5d6-bv7bw"]
Sep 20 01:04:12.506721 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:12.506689    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-7db579-84dc7b8885-qq6pr"]
Sep 20 01:04:12.510122 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:12.510105    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-7db579-84dc7b8885-qq6pr"
Sep 20 01:04:12.530516 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:12.530465    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-7db579-84dc7b8885-qq6pr"]
Sep 20 01:04:12.644357 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:12.644323    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3855d09e-b22a-4f7d-8712-dcd9a67787f6-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-7db579-5d8f96c5d6-bv7bw\" (UID: \"3855d09e-b22a-4f7d-8712-dcd9a67787f6\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-7db579-5d8f96c5d6-bv7bw"
Sep 20 01:04:12.644357 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:12.644359    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8czbm\" (UniqueName: \"kubernetes.io/projected/3855d09e-b22a-4f7d-8712-dcd9a67787f6-kube-api-access-8czbm\") pod \"payload-pre-processing-e2e-explicit-7db579-5d8f96c5d6-bv7bw\" (UID: \"3855d09e-b22a-4f7d-8712-dcd9a67787f6\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-7db579-5d8f96c5d6-bv7bw"
Sep 20 01:04:12.644610 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:12.644488    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grcnj\" (UniqueName: \"kubernetes.io/projected/7172d3a4-aef2-4462-af08-40baf2e291fa-kube-api-access-grcnj\") pod \"payload-processing-e2e-explicit-7db579-84dc7b8885-qq6pr\" (UID: \"7172d3a4-aef2-4462-af08-40baf2e291fa\") " pod="openshift-ingress/payload-processing-e2e-explicit-7db579-84dc7b8885-qq6pr"
Sep 20 01:04:12.644610 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:12.644553    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7172d3a4-aef2-4462-af08-40baf2e291fa-plugins-config-volume\") pod \"payload-processing-e2e-explicit-7db579-84dc7b8885-qq6pr\" (UID: \"7172d3a4-aef2-4462-af08-40baf2e291fa\") " pod="openshift-ingress/payload-processing-e2e-explicit-7db579-84dc7b8885-qq6pr"
Sep 20 01:04:12.745697 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:12.745618    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3855d09e-b22a-4f7d-8712-dcd9a67787f6-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-7db579-5d8f96c5d6-bv7bw\" (UID: \"3855d09e-b22a-4f7d-8712-dcd9a67787f6\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-7db579-5d8f96c5d6-bv7bw"
Sep 20 01:04:12.745697 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:12.745654    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8czbm\" (UniqueName: \"kubernetes.io/projected/3855d09e-b22a-4f7d-8712-dcd9a67787f6-kube-api-access-8czbm\") pod \"payload-pre-processing-e2e-explicit-7db579-5d8f96c5d6-bv7bw\" (UID: \"3855d09e-b22a-4f7d-8712-dcd9a67787f6\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-7db579-5d8f96c5d6-bv7bw"
Sep 20 01:04:12.745899 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:12.745747    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grcnj\" (UniqueName: \"kubernetes.io/projected/7172d3a4-aef2-4462-af08-40baf2e291fa-kube-api-access-grcnj\") pod \"payload-processing-e2e-explicit-7db579-84dc7b8885-qq6pr\" (UID: \"7172d3a4-aef2-4462-af08-40baf2e291fa\") " pod="openshift-ingress/payload-processing-e2e-explicit-7db579-84dc7b8885-qq6pr"
Sep 20 01:04:12.745899 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:12.745804    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7172d3a4-aef2-4462-af08-40baf2e291fa-plugins-config-volume\") pod \"payload-processing-e2e-explicit-7db579-84dc7b8885-qq6pr\" (UID: \"7172d3a4-aef2-4462-af08-40baf2e291fa\") " pod="openshift-ingress/payload-processing-e2e-explicit-7db579-84dc7b8885-qq6pr"
Sep 20 01:04:12.746373 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:12.746352    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3855d09e-b22a-4f7d-8712-dcd9a67787f6-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-7db579-5d8f96c5d6-bv7bw\" (UID: \"3855d09e-b22a-4f7d-8712-dcd9a67787f6\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-7db579-5d8f96c5d6-bv7bw"
Sep 20 01:04:12.746586 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:12.746564    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7172d3a4-aef2-4462-af08-40baf2e291fa-plugins-config-volume\") pod \"payload-processing-e2e-explicit-7db579-84dc7b8885-qq6pr\" (UID: \"7172d3a4-aef2-4462-af08-40baf2e291fa\") " pod="openshift-ingress/payload-processing-e2e-explicit-7db579-84dc7b8885-qq6pr"
Sep 20 01:04:12.759945 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:12.759922    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8czbm\" (UniqueName: \"kubernetes.io/projected/3855d09e-b22a-4f7d-8712-dcd9a67787f6-kube-api-access-8czbm\") pod \"payload-pre-processing-e2e-explicit-7db579-5d8f96c5d6-bv7bw\" (UID: \"3855d09e-b22a-4f7d-8712-dcd9a67787f6\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-7db579-5d8f96c5d6-bv7bw"
Sep 20 01:04:12.760122 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:12.760100    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grcnj\" (UniqueName: \"kubernetes.io/projected/7172d3a4-aef2-4462-af08-40baf2e291fa-kube-api-access-grcnj\") pod \"payload-processing-e2e-explicit-7db579-84dc7b8885-qq6pr\" (UID: \"7172d3a4-aef2-4462-af08-40baf2e291fa\") " pod="openshift-ingress/payload-processing-e2e-explicit-7db579-84dc7b8885-qq6pr"
Sep 20 01:04:12.777994 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:12.777966    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-7db579-5d8f96c5d6-bv7bw"
Sep 20 01:04:12.822924 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:12.822891    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-7db579-84dc7b8885-qq6pr"
Sep 20 01:04:13.057664 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:13.057636    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-7db579-5d8f96c5d6-bv7bw"]
Sep 20 01:04:13.059843 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:04:13.059816    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3855d09e_b22a_4f7d_8712_dcd9a67787f6.slice/crio-2d3fe002fb76c51440217120141ae609c2fbab188d2ae80d6a8447521acb658f WatchSource:0}: Error finding container 2d3fe002fb76c51440217120141ae609c2fbab188d2ae80d6a8447521acb658f: Status 404 returned error can't find the container with id 2d3fe002fb76c51440217120141ae609c2fbab188d2ae80d6a8447521acb658f
Sep 20 01:04:13.109620 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:13.109597    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-7db579-84dc7b8885-qq6pr"]
Sep 20 01:04:13.111959 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:04:13.111931    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7172d3a4_aef2_4462_af08_40baf2e291fa.slice/crio-f3628969a33d596f8d8b50b26b593f1e155102fffc63e37f7650d475606141e9 WatchSource:0}: Error finding container f3628969a33d596f8d8b50b26b593f1e155102fffc63e37f7650d475606141e9: Status 404 returned error can't find the container with id f3628969a33d596f8d8b50b26b593f1e155102fffc63e37f7650d475606141e9
Sep 20 01:04:13.490247 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:13.490204    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-7db579-84dc7b8885-qq6pr" event={"ID":"7172d3a4-aef2-4462-af08-40baf2e291fa","Type":"ContainerStarted","Data":"07cea0a969a06b1a9e1fb654623df0e128997a23178c59e1f0b34dda137d856b"}
Sep 20 01:04:13.490726 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:13.490272    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-7db579-84dc7b8885-qq6pr" event={"ID":"7172d3a4-aef2-4462-af08-40baf2e291fa","Type":"ContainerStarted","Data":"f3628969a33d596f8d8b50b26b593f1e155102fffc63e37f7650d475606141e9"}
Sep 20 01:04:13.490726 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:13.490301    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-7db579-84dc7b8885-qq6pr"
Sep 20 01:04:13.492135 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:13.492110    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-7db579-5d8f96c5d6-bv7bw" event={"ID":"3855d09e-b22a-4f7d-8712-dcd9a67787f6","Type":"ContainerStarted","Data":"c23ce2a3a03e284643e7c21628e87ab1f2970bc98e90f1378ed21768dadb7515"}
Sep 20 01:04:13.492273 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:13.492163    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-7db579-5d8f96c5d6-bv7bw" event={"ID":"3855d09e-b22a-4f7d-8712-dcd9a67787f6","Type":"ContainerStarted","Data":"2d3fe002fb76c51440217120141ae609c2fbab188d2ae80d6a8447521acb658f"}
Sep 20 01:04:13.492273 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:13.492194    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-7db579-5d8f96c5d6-bv7bw"
Sep 20 01:04:13.509533 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:13.509477    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-7db579-84dc7b8885-qq6pr" podStartSLOduration=1.50945798 podStartE2EDuration="1.50945798s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:04:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:04:13.505417339 +0000 UTC m=+990.119573230" watchObservedRunningTime="2026-09-20 01:04:13.50945798 +0000 UTC m=+990.123613879"
Sep 20 01:04:13.521206 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:13.521155    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-7db579-5d8f96c5d6-bv7bw" podStartSLOduration=1.52113761 podStartE2EDuration="1.52113761s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:04:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:04:13.519830368 +0000 UTC m=+990.133986300" watchObservedRunningTime="2026-09-20 01:04:13.52113761 +0000 UTC m=+990.135293508"
Sep 20 01:04:24.501430 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:24.501391    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-7db579-84dc7b8885-qq6pr"
Sep 20 01:04:24.501909 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:24.501467    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-7db579-5d8f96c5d6-bv7bw"
Sep 20 01:04:30.616094 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:30.616057    2570 generic.go:356] "Generic (PLEG): container finished" podID="54618481-3343-40b6-8f54-b7af78018f2b" containerID="993dccae486d25c04334a69acb8fae3cb12a0c266a56af3c7ef2bf17d1d388b2" exitCode=0
Sep 20 01:04:30.616505 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:30.616127    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86" event={"ID":"54618481-3343-40b6-8f54-b7af78018f2b","Type":"ContainerDied","Data":"993dccae486d25c04334a69acb8fae3cb12a0c266a56af3c7ef2bf17d1d388b2"}
Sep 20 01:04:30.616580 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:30.616566    2570 scope.go:117] "RemoveContainer" containerID="993dccae486d25c04334a69acb8fae3cb12a0c266a56af3c7ef2bf17d1d388b2"
Sep 20 01:04:30.617730 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:30.617702    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:04:30.617815 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:30.617767    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:04:30.617815 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:30.617799    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:04:31.624196 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:31.624161    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86" event={"ID":"54618481-3343-40b6-8f54-b7af78018f2b","Type":"ContainerStarted","Data":"a70f67d496536321e5912f76d7e18122b1c465050de3889a9dad8669526874b7"}
Sep 20 01:04:32.348143 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:32.348109    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86"
Sep 20 01:04:32.348665 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:32.348633    2570 patch_prober.go:28] interesting pod/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 20 01:04:32.348778 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:32.348726    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86" podUID="54618481-3343-40b6-8f54-b7af78018f2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 20 01:04:33.348434 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:33.348396    2570 patch_prober.go:28] interesting pod/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 20 01:04:33.349050 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:33.349016    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86" podUID="54618481-3343-40b6-8f54-b7af78018f2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 20 01:04:34.347990 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:34.347945    2570 patch_prober.go:28] interesting pod/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 20 01:04:34.348208 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:34.348014    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86" podUID="54618481-3343-40b6-8f54-b7af78018f2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 20 01:04:35.348272 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:35.348234    2570 patch_prober.go:28] interesting pod/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 20 01:04:35.348828 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:35.348794    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86" podUID="54618481-3343-40b6-8f54-b7af78018f2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 20 01:04:36.348220 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:36.348182    2570 patch_prober.go:28] interesting pod/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 20 01:04:36.348636 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:36.348606    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86" podUID="54618481-3343-40b6-8f54-b7af78018f2b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 20 01:04:37.351959 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:37.351927    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86"
Sep 20 01:04:37.352428 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:37.352356    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86"
Sep 20 01:04:37.353139 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:04:37.353121    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86"
Sep 20 01:05:08.852252 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:08.852219    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw"]
Sep 20 01:05:08.855104 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:08.855082    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw"
Sep 20 01:05:08.857245 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:08.857215    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-0b0a5312-openshift-default-dockercfg-hqmr6\""
Sep 20 01:05:08.866560 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:08.866532    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw"]
Sep 20 01:05:08.929346 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:08.929309    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdhdt\" (UniqueName: \"kubernetes.io/projected/5627007e-c412-4913-bc73-b07959da91d8-kube-api-access-jdhdt\") pod \"e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw\" (UID: \"5627007e-c412-4913-bc73-b07959da91d8\") " pod="openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw"
Sep 20 01:05:08.929545 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:08.929372    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5627007e-c412-4913-bc73-b07959da91d8-workload-certs\") pod \"e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw\" (UID: \"5627007e-c412-4913-bc73-b07959da91d8\") " pod="openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw"
Sep 20 01:05:08.929545 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:08.929438    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5627007e-c412-4913-bc73-b07959da91d8-istio-podinfo\") pod \"e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw\" (UID: \"5627007e-c412-4913-bc73-b07959da91d8\") " pod="openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw"
Sep 20 01:05:08.929545 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:08.929477    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5627007e-c412-4913-bc73-b07959da91d8-istio-token\") pod \"e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw\" (UID: \"5627007e-c412-4913-bc73-b07959da91d8\") " pod="openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw"
Sep 20 01:05:08.929545 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:08.929503    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5627007e-c412-4913-bc73-b07959da91d8-istiod-ca-cert\") pod \"e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw\" (UID: \"5627007e-c412-4913-bc73-b07959da91d8\") " pod="openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw"
Sep 20 01:05:08.929762 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:08.929548    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5627007e-c412-4913-bc73-b07959da91d8-workload-socket\") pod \"e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw\" (UID: \"5627007e-c412-4913-bc73-b07959da91d8\") " pod="openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw"
Sep 20 01:05:08.929762 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:08.929588    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5627007e-c412-4913-bc73-b07959da91d8-credential-socket\") pod \"e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw\" (UID: \"5627007e-c412-4913-bc73-b07959da91d8\") " pod="openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw"
Sep 20 01:05:08.929762 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:08.929662    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5627007e-c412-4913-bc73-b07959da91d8-istio-envoy\") pod \"e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw\" (UID: \"5627007e-c412-4913-bc73-b07959da91d8\") " pod="openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw"
Sep 20 01:05:08.929938 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:08.929758    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5627007e-c412-4913-bc73-b07959da91d8-istio-data\") pod \"e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw\" (UID: \"5627007e-c412-4913-bc73-b07959da91d8\") " pod="openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw"
Sep 20 01:05:09.030330 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:09.030297    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5627007e-c412-4913-bc73-b07959da91d8-istio-data\") pod \"e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw\" (UID: \"5627007e-c412-4913-bc73-b07959da91d8\") " pod="openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw"
Sep 20 01:05:09.030330 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:09.030342    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdhdt\" (UniqueName: \"kubernetes.io/projected/5627007e-c412-4913-bc73-b07959da91d8-kube-api-access-jdhdt\") pod \"e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw\" (UID: \"5627007e-c412-4913-bc73-b07959da91d8\") " pod="openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw"
Sep 20 01:05:09.030585 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:09.030389    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5627007e-c412-4913-bc73-b07959da91d8-workload-certs\") pod \"e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw\" (UID: \"5627007e-c412-4913-bc73-b07959da91d8\") " pod="openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw"
Sep 20 01:05:09.030585 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:09.030407    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5627007e-c412-4913-bc73-b07959da91d8-istio-podinfo\") pod \"e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw\" (UID: \"5627007e-c412-4913-bc73-b07959da91d8\") " pod="openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw"
Sep 20 01:05:09.030585 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:09.030431    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5627007e-c412-4913-bc73-b07959da91d8-istio-token\") pod \"e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw\" (UID: \"5627007e-c412-4913-bc73-b07959da91d8\") " pod="openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw"
Sep 20 01:05:09.030585 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:09.030454    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5627007e-c412-4913-bc73-b07959da91d8-istiod-ca-cert\") pod \"e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw\" (UID: \"5627007e-c412-4913-bc73-b07959da91d8\") " pod="openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw"
Sep 20 01:05:09.030585 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:09.030481    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5627007e-c412-4913-bc73-b07959da91d8-workload-socket\") pod \"e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw\" (UID: \"5627007e-c412-4913-bc73-b07959da91d8\") " pod="openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw"
Sep 20 01:05:09.030585 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:09.030531    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5627007e-c412-4913-bc73-b07959da91d8-credential-socket\") pod \"e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw\" (UID: \"5627007e-c412-4913-bc73-b07959da91d8\") " pod="openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw"
Sep 20 01:05:09.030585 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:09.030572    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5627007e-c412-4913-bc73-b07959da91d8-istio-envoy\") pod \"e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw\" (UID: \"5627007e-c412-4913-bc73-b07959da91d8\") " pod="openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw"
Sep 20 01:05:09.030977 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:09.030761    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5627007e-c412-4913-bc73-b07959da91d8-istio-data\") pod \"e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw\" (UID: \"5627007e-c412-4913-bc73-b07959da91d8\") " pod="openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw"
Sep 20 01:05:09.030977 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:09.030798    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5627007e-c412-4913-bc73-b07959da91d8-workload-certs\") pod \"e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw\" (UID: \"5627007e-c412-4913-bc73-b07959da91d8\") " pod="openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw"
Sep 20 01:05:09.030977 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:09.030949    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5627007e-c412-4913-bc73-b07959da91d8-workload-socket\") pod \"e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw\" (UID: \"5627007e-c412-4913-bc73-b07959da91d8\") " pod="openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw"
Sep 20 01:05:09.031151 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:09.030992    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5627007e-c412-4913-bc73-b07959da91d8-credential-socket\") pod \"e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw\" (UID: \"5627007e-c412-4913-bc73-b07959da91d8\") " pod="openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw"
Sep 20 01:05:09.031253 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:09.031229    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5627007e-c412-4913-bc73-b07959da91d8-istiod-ca-cert\") pod \"e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw\" (UID: \"5627007e-c412-4913-bc73-b07959da91d8\") " pod="openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw"
Sep 20 01:05:09.033036 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:09.033016    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5627007e-c412-4913-bc73-b07959da91d8-istio-envoy\") pod \"e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw\" (UID: \"5627007e-c412-4913-bc73-b07959da91d8\") " pod="openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw"
Sep 20 01:05:09.033158 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:09.033143    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5627007e-c412-4913-bc73-b07959da91d8-istio-podinfo\") pod \"e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw\" (UID: \"5627007e-c412-4913-bc73-b07959da91d8\") " pod="openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw"
Sep 20 01:05:09.038341 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:09.038314    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5627007e-c412-4913-bc73-b07959da91d8-istio-token\") pod \"e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw\" (UID: \"5627007e-c412-4913-bc73-b07959da91d8\") " pod="openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw"
Sep 20 01:05:09.038541 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:09.038518    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdhdt\" (UniqueName: \"kubernetes.io/projected/5627007e-c412-4913-bc73-b07959da91d8-kube-api-access-jdhdt\") pod \"e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw\" (UID: \"5627007e-c412-4913-bc73-b07959da91d8\") " pod="openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw"
Sep 20 01:05:09.166504 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:09.166469    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw"
Sep 20 01:05:09.500266 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:05:09.500233    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5627007e_c412_4913_bc73_b07959da91d8.slice/crio-93427040ca162d7ff89048ed6b1897d82c907da1f11ed1166ed51bf24d6c65ae WatchSource:0}: Error finding container 93427040ca162d7ff89048ed6b1897d82c907da1f11ed1166ed51bf24d6c65ae: Status 404 returned error can't find the container with id 93427040ca162d7ff89048ed6b1897d82c907da1f11ed1166ed51bf24d6c65ae
Sep 20 01:05:09.501496 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:09.501475    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw"]
Sep 20 01:05:09.502629 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:09.502601    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:05:09.502714 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:09.502660    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:05:09.502714 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:09.502689    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:05:09.847156 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:09.839774    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw" event={"ID":"5627007e-c412-4913-bc73-b07959da91d8","Type":"ContainerStarted","Data":"3fce0027468ca88a81270a0365534794560dc95972ce1a69d47603f5226e2d2a"}
Sep 20 01:05:09.847156 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:09.839889    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw" event={"ID":"5627007e-c412-4913-bc73-b07959da91d8","Type":"ContainerStarted","Data":"93427040ca162d7ff89048ed6b1897d82c907da1f11ed1166ed51bf24d6c65ae"}
Sep 20 01:05:09.862978 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:09.862921    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw" podStartSLOduration=1.862898719 podStartE2EDuration="1.862898719s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:05:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:05:09.859985139 +0000 UTC m=+1046.474141050" watchObservedRunningTime="2026-09-20 01:05:09.862898719 +0000 UTC m=+1046.477054616"
Sep 20 01:05:10.167252 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:10.167210    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw"
Sep 20 01:05:10.172949 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:10.172923    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw"
Sep 20 01:05:10.844927 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:10.844895    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw"
Sep 20 01:05:10.846088 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:10.846068    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw"
Sep 20 01:05:19.093776 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:19.093739    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0b0a5312-75ddc9c9d-szd9t"]
Sep 20 01:05:19.096581 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:19.096566    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0b0a5312-75ddc9c9d-szd9t"
Sep 20 01:05:19.098826 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:19.098801    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-0b0a5312-dockercfg-52br5\""
Sep 20 01:05:19.098959 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:19.098907    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-0b0a5312\""
Sep 20 01:05:19.104435 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:19.104409    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0b0a5312-75ddc9c9d-szd9t"]
Sep 20 01:05:19.121292 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:19.121260    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0b0a5312-b744bcfd5-2nsts"]
Sep 20 01:05:19.124107 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:19.124089    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-0b0a5312-b744bcfd5-2nsts"
Sep 20 01:05:19.134926 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:19.134900    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0b0a5312-b744bcfd5-2nsts"]
Sep 20 01:05:19.237241 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:19.237203    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6t9md\" (UniqueName: \"kubernetes.io/projected/ef173cbf-6b35-43c0-9dd8-f24b746ed44f-kube-api-access-6t9md\") pod \"payload-processing-e2e-mt-0b0a5312-b744bcfd5-2nsts\" (UID: \"ef173cbf-6b35-43c0-9dd8-f24b746ed44f\") " pod="openshift-ingress/payload-processing-e2e-mt-0b0a5312-b744bcfd5-2nsts"
Sep 20 01:05:19.237442 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:19.237274    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/65189dd6-70ec-4442-8bb3-df952fe63a57-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-0b0a5312-75ddc9c9d-szd9t\" (UID: \"65189dd6-70ec-4442-8bb3-df952fe63a57\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0b0a5312-75ddc9c9d-szd9t"
Sep 20 01:05:19.237442 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:19.237322    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6jkk\" (UniqueName: \"kubernetes.io/projected/65189dd6-70ec-4442-8bb3-df952fe63a57-kube-api-access-s6jkk\") pod \"payload-pre-processing-e2e-mt-0b0a5312-75ddc9c9d-szd9t\" (UID: \"65189dd6-70ec-4442-8bb3-df952fe63a57\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0b0a5312-75ddc9c9d-szd9t"
Sep 20 01:05:19.237442 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:19.237371    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef173cbf-6b35-43c0-9dd8-f24b746ed44f-plugins-config-volume\") pod \"payload-processing-e2e-mt-0b0a5312-b744bcfd5-2nsts\" (UID: \"ef173cbf-6b35-43c0-9dd8-f24b746ed44f\") " pod="openshift-ingress/payload-processing-e2e-mt-0b0a5312-b744bcfd5-2nsts"
Sep 20 01:05:19.338640 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:19.338604    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/65189dd6-70ec-4442-8bb3-df952fe63a57-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-0b0a5312-75ddc9c9d-szd9t\" (UID: \"65189dd6-70ec-4442-8bb3-df952fe63a57\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0b0a5312-75ddc9c9d-szd9t"
Sep 20 01:05:19.338640 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:19.338652    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6jkk\" (UniqueName: \"kubernetes.io/projected/65189dd6-70ec-4442-8bb3-df952fe63a57-kube-api-access-s6jkk\") pod \"payload-pre-processing-e2e-mt-0b0a5312-75ddc9c9d-szd9t\" (UID: \"65189dd6-70ec-4442-8bb3-df952fe63a57\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0b0a5312-75ddc9c9d-szd9t"
Sep 20 01:05:19.338959 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:19.338700    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef173cbf-6b35-43c0-9dd8-f24b746ed44f-plugins-config-volume\") pod \"payload-processing-e2e-mt-0b0a5312-b744bcfd5-2nsts\" (UID: \"ef173cbf-6b35-43c0-9dd8-f24b746ed44f\") " pod="openshift-ingress/payload-processing-e2e-mt-0b0a5312-b744bcfd5-2nsts"
Sep 20 01:05:19.338959 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:19.338807    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6t9md\" (UniqueName: \"kubernetes.io/projected/ef173cbf-6b35-43c0-9dd8-f24b746ed44f-kube-api-access-6t9md\") pod \"payload-processing-e2e-mt-0b0a5312-b744bcfd5-2nsts\" (UID: \"ef173cbf-6b35-43c0-9dd8-f24b746ed44f\") " pod="openshift-ingress/payload-processing-e2e-mt-0b0a5312-b744bcfd5-2nsts"
Sep 20 01:05:19.339602 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:19.339575    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/65189dd6-70ec-4442-8bb3-df952fe63a57-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-0b0a5312-75ddc9c9d-szd9t\" (UID: \"65189dd6-70ec-4442-8bb3-df952fe63a57\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0b0a5312-75ddc9c9d-szd9t"
Sep 20 01:05:19.339695 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:19.339680    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef173cbf-6b35-43c0-9dd8-f24b746ed44f-plugins-config-volume\") pod \"payload-processing-e2e-mt-0b0a5312-b744bcfd5-2nsts\" (UID: \"ef173cbf-6b35-43c0-9dd8-f24b746ed44f\") " pod="openshift-ingress/payload-processing-e2e-mt-0b0a5312-b744bcfd5-2nsts"
Sep 20 01:05:19.346691 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:19.346625    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6t9md\" (UniqueName: \"kubernetes.io/projected/ef173cbf-6b35-43c0-9dd8-f24b746ed44f-kube-api-access-6t9md\") pod \"payload-processing-e2e-mt-0b0a5312-b744bcfd5-2nsts\" (UID: \"ef173cbf-6b35-43c0-9dd8-f24b746ed44f\") " pod="openshift-ingress/payload-processing-e2e-mt-0b0a5312-b744bcfd5-2nsts"
Sep 20 01:05:19.346817 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:19.346793    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6jkk\" (UniqueName: \"kubernetes.io/projected/65189dd6-70ec-4442-8bb3-df952fe63a57-kube-api-access-s6jkk\") pod \"payload-pre-processing-e2e-mt-0b0a5312-75ddc9c9d-szd9t\" (UID: \"65189dd6-70ec-4442-8bb3-df952fe63a57\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0b0a5312-75ddc9c9d-szd9t"
Sep 20 01:05:19.409718 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:19.409679    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0b0a5312-75ddc9c9d-szd9t"
Sep 20 01:05:19.436372 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:19.436334    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-0b0a5312-b744bcfd5-2nsts"
Sep 20 01:05:19.720561 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:19.720532    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0b0a5312-75ddc9c9d-szd9t"]
Sep 20 01:05:19.722533 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:05:19.722506    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65189dd6_70ec_4442_8bb3_df952fe63a57.slice/crio-edd1942b9eed4def5a736e6f9fd690202b7c6b1631ba3a692f02313fccbd51d6 WatchSource:0}: Error finding container edd1942b9eed4def5a736e6f9fd690202b7c6b1631ba3a692f02313fccbd51d6: Status 404 returned error can't find the container with id edd1942b9eed4def5a736e6f9fd690202b7c6b1631ba3a692f02313fccbd51d6
Sep 20 01:05:19.737452 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:19.737430    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0b0a5312-b744bcfd5-2nsts"]
Sep 20 01:05:19.739386 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:05:19.739293    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef173cbf_6b35_43c0_9dd8_f24b746ed44f.slice/crio-965fb9f42e545716f54c636a9c8655fff17f27e685686611022f16bb640886c6 WatchSource:0}: Error finding container 965fb9f42e545716f54c636a9c8655fff17f27e685686611022f16bb640886c6: Status 404 returned error can't find the container with id 965fb9f42e545716f54c636a9c8655fff17f27e685686611022f16bb640886c6
Sep 20 01:05:19.896366 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:19.896324    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-0b0a5312-b744bcfd5-2nsts" event={"ID":"ef173cbf-6b35-43c0-9dd8-f24b746ed44f","Type":"ContainerStarted","Data":"841e111d02b72fbec8ba6b7ba54ed5129d667311ce5262bbdc567106da42a6c7"}
Sep 20 01:05:19.896579 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:19.896428    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-0b0a5312-b744bcfd5-2nsts" event={"ID":"ef173cbf-6b35-43c0-9dd8-f24b746ed44f","Type":"ContainerStarted","Data":"965fb9f42e545716f54c636a9c8655fff17f27e685686611022f16bb640886c6"}
Sep 20 01:05:19.896579 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:19.896459    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-0b0a5312-b744bcfd5-2nsts"
Sep 20 01:05:19.897997 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:19.897971    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0b0a5312-75ddc9c9d-szd9t" event={"ID":"65189dd6-70ec-4442-8bb3-df952fe63a57","Type":"ContainerStarted","Data":"cc7b1ba04659fdfd7d4ebd604e2b69e3f09f672ad51961a936af635dc9c0f849"}
Sep 20 01:05:19.898121 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:19.898022    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-0b0a5312-75ddc9c9d-szd9t"
Sep 20 01:05:19.898121 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:19.898040    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0b0a5312-75ddc9c9d-szd9t" event={"ID":"65189dd6-70ec-4442-8bb3-df952fe63a57","Type":"ContainerStarted","Data":"edd1942b9eed4def5a736e6f9fd690202b7c6b1631ba3a692f02313fccbd51d6"}
Sep 20 01:05:19.914329 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:19.914282    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-0b0a5312-b744bcfd5-2nsts" podStartSLOduration=0.914268606 podStartE2EDuration="914.268606ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:05:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:05:19.911267306 +0000 UTC m=+1056.525423243" watchObservedRunningTime="2026-09-20 01:05:19.914268606 +0000 UTC m=+1056.528424502"
Sep 20 01:05:19.926660 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:19.926609    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-0b0a5312-75ddc9c9d-szd9t" podStartSLOduration=0.926593404 podStartE2EDuration="926.593404ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:05:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:05:19.925339796 +0000 UTC m=+1056.539495695" watchObservedRunningTime="2026-09-20 01:05:19.926593404 +0000 UTC m=+1056.540749300"
Sep 20 01:05:30.906138 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:30.906059    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-0b0a5312-b744bcfd5-2nsts"
Sep 20 01:05:30.906138 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:30.906129    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-0b0a5312-75ddc9c9d-szd9t"
Sep 20 01:05:46.057659 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:46.057620    2570 generic.go:356] "Generic (PLEG): container finished" podID="5627007e-c412-4913-bc73-b07959da91d8" containerID="3fce0027468ca88a81270a0365534794560dc95972ce1a69d47603f5226e2d2a" exitCode=0
Sep 20 01:05:46.058178 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:46.057699    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw" event={"ID":"5627007e-c412-4913-bc73-b07959da91d8","Type":"ContainerDied","Data":"3fce0027468ca88a81270a0365534794560dc95972ce1a69d47603f5226e2d2a"}
Sep 20 01:05:46.058178 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:46.058163    2570 scope.go:117] "RemoveContainer" containerID="3fce0027468ca88a81270a0365534794560dc95972ce1a69d47603f5226e2d2a"
Sep 20 01:05:46.059278 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:46.059252    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:05:46.059333 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:46.059321    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:05:46.059370 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:46.059353    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:05:46.880485 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:46.880447    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-7db579-84dc7b8885-qq6pr"]
Sep 20 01:05:46.880747 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:46.880717    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-7db579-84dc7b8885-qq6pr" podUID="7172d3a4-aef2-4462-af08-40baf2e291fa" containerName="payload-processing" containerID="cri-o://07cea0a969a06b1a9e1fb654623df0e128997a23178c59e1f0b34dda137d856b" gracePeriod=30
Sep 20 01:05:46.889813 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:46.889779    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-7db579-5d8f96c5d6-bv7bw"]
Sep 20 01:05:46.890122 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:46.890087    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-7db579-5d8f96c5d6-bv7bw" podUID="3855d09e-b22a-4f7d-8712-dcd9a67787f6" containerName="payload-pre-processing" containerID="cri-o://c23ce2a3a03e284643e7c21628e87ab1f2970bc98e90f1378ed21768dadb7515" gracePeriod=30
Sep 20 01:05:47.070733 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:47.069914    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw" event={"ID":"5627007e-c412-4913-bc73-b07959da91d8","Type":"ContainerStarted","Data":"ea01f2e12c123ca1ce6626f197152ab9d79ad5ca7505acabead46ea7978a6ffc"}
Sep 20 01:05:47.072058 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:47.072029    2570 generic.go:356] "Generic (PLEG): container finished" podID="7172d3a4-aef2-4462-af08-40baf2e291fa" containerID="07cea0a969a06b1a9e1fb654623df0e128997a23178c59e1f0b34dda137d856b" exitCode=0
Sep 20 01:05:47.072190 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:47.072108    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-7db579-84dc7b8885-qq6pr" event={"ID":"7172d3a4-aef2-4462-af08-40baf2e291fa","Type":"ContainerDied","Data":"07cea0a969a06b1a9e1fb654623df0e128997a23178c59e1f0b34dda137d856b"}
Sep 20 01:05:47.084768 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:47.084724    2570 generic.go:356] "Generic (PLEG): container finished" podID="3855d09e-b22a-4f7d-8712-dcd9a67787f6" containerID="c23ce2a3a03e284643e7c21628e87ab1f2970bc98e90f1378ed21768dadb7515" exitCode=0
Sep 20 01:05:47.084956 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:47.084780    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-7db579-5d8f96c5d6-bv7bw" event={"ID":"3855d09e-b22a-4f7d-8712-dcd9a67787f6","Type":"ContainerDied","Data":"c23ce2a3a03e284643e7c21628e87ab1f2970bc98e90f1378ed21768dadb7515"}
Sep 20 01:05:47.151815 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:47.151789    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-7db579-84dc7b8885-qq6pr"
Sep 20 01:05:47.167393 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:47.167359    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw"
Sep 20 01:05:47.167584 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:47.167413    2570 patch_prober.go:28] interesting pod/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 20 01:05:47.167584 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:47.167469    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw" podUID="5627007e-c412-4913-bc73-b07959da91d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 20 01:05:47.206083 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:47.206035    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-7db579-5d8f96c5d6-bv7bw"
Sep 20 01:05:47.239724 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:47.239686    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grcnj\" (UniqueName: \"kubernetes.io/projected/7172d3a4-aef2-4462-af08-40baf2e291fa-kube-api-access-grcnj\") pod \"7172d3a4-aef2-4462-af08-40baf2e291fa\" (UID: \"7172d3a4-aef2-4462-af08-40baf2e291fa\") "
Sep 20 01:05:47.239958 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:47.239806    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7172d3a4-aef2-4462-af08-40baf2e291fa-plugins-config-volume\") pod \"7172d3a4-aef2-4462-af08-40baf2e291fa\" (UID: \"7172d3a4-aef2-4462-af08-40baf2e291fa\") "
Sep 20 01:05:47.240292 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:47.240260    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7172d3a4-aef2-4462-af08-40baf2e291fa-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7172d3a4-aef2-4462-af08-40baf2e291fa" (UID: "7172d3a4-aef2-4462-af08-40baf2e291fa"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:05:47.240449 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:47.240423    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7172d3a4-aef2-4462-af08-40baf2e291fa-plugins-config-volume\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:05:47.243043 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:47.243015    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7172d3a4-aef2-4462-af08-40baf2e291fa-kube-api-access-grcnj" (OuterVolumeSpecName: "kube-api-access-grcnj") pod "7172d3a4-aef2-4462-af08-40baf2e291fa" (UID: "7172d3a4-aef2-4462-af08-40baf2e291fa"). InnerVolumeSpecName "kube-api-access-grcnj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:05:47.341158 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:47.341120    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3855d09e-b22a-4f7d-8712-dcd9a67787f6-plugins-config-volume\") pod \"3855d09e-b22a-4f7d-8712-dcd9a67787f6\" (UID: \"3855d09e-b22a-4f7d-8712-dcd9a67787f6\") "
Sep 20 01:05:47.341356 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:47.341188    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8czbm\" (UniqueName: \"kubernetes.io/projected/3855d09e-b22a-4f7d-8712-dcd9a67787f6-kube-api-access-8czbm\") pod \"3855d09e-b22a-4f7d-8712-dcd9a67787f6\" (UID: \"3855d09e-b22a-4f7d-8712-dcd9a67787f6\") "
Sep 20 01:05:47.341518 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:47.341499    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grcnj\" (UniqueName: \"kubernetes.io/projected/7172d3a4-aef2-4462-af08-40baf2e291fa-kube-api-access-grcnj\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:05:47.341585 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:47.341499    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3855d09e-b22a-4f7d-8712-dcd9a67787f6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3855d09e-b22a-4f7d-8712-dcd9a67787f6" (UID: "3855d09e-b22a-4f7d-8712-dcd9a67787f6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:05:47.343404 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:47.343373    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3855d09e-b22a-4f7d-8712-dcd9a67787f6-kube-api-access-8czbm" (OuterVolumeSpecName: "kube-api-access-8czbm") pod "3855d09e-b22a-4f7d-8712-dcd9a67787f6" (UID: "3855d09e-b22a-4f7d-8712-dcd9a67787f6"). InnerVolumeSpecName "kube-api-access-8czbm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:05:47.442950 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:47.442855    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8czbm\" (UniqueName: \"kubernetes.io/projected/3855d09e-b22a-4f7d-8712-dcd9a67787f6-kube-api-access-8czbm\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:05:47.442950 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:47.442895    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3855d09e-b22a-4f7d-8712-dcd9a67787f6-plugins-config-volume\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:05:48.092077 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:48.092050    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-7db579-84dc7b8885-qq6pr"
Sep 20 01:05:48.092538 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:48.092050    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-7db579-84dc7b8885-qq6pr" event={"ID":"7172d3a4-aef2-4462-af08-40baf2e291fa","Type":"ContainerDied","Data":"f3628969a33d596f8d8b50b26b593f1e155102fffc63e37f7650d475606141e9"}
Sep 20 01:05:48.092538 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:48.092183    2570 scope.go:117] "RemoveContainer" containerID="07cea0a969a06b1a9e1fb654623df0e128997a23178c59e1f0b34dda137d856b"
Sep 20 01:05:48.093581 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:48.093559    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-7db579-5d8f96c5d6-bv7bw"
Sep 20 01:05:48.093683 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:48.093556    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-7db579-5d8f96c5d6-bv7bw" event={"ID":"3855d09e-b22a-4f7d-8712-dcd9a67787f6","Type":"ContainerDied","Data":"2d3fe002fb76c51440217120141ae609c2fbab188d2ae80d6a8447521acb658f"}
Sep 20 01:05:48.102333 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:48.102312    2570 scope.go:117] "RemoveContainer" containerID="c23ce2a3a03e284643e7c21628e87ab1f2970bc98e90f1378ed21768dadb7515"
Sep 20 01:05:48.110831 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:48.110803    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-7db579-84dc7b8885-qq6pr"]
Sep 20 01:05:48.114134 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:48.114112    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-7db579-84dc7b8885-qq6pr"]
Sep 20 01:05:48.123329 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:48.123290    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-7db579-5d8f96c5d6-bv7bw"]
Sep 20 01:05:48.128306 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:48.128283    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-7db579-5d8f96c5d6-bv7bw"]
Sep 20 01:05:48.167247 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:48.167147    2570 patch_prober.go:28] interesting pod/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 20 01:05:48.167247 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:48.167220    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw" podUID="5627007e-c412-4913-bc73-b07959da91d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 20 01:05:49.167059 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:49.167014    2570 patch_prober.go:28] interesting pod/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 20 01:05:49.167592 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:49.167282    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw" podUID="5627007e-c412-4913-bc73-b07959da91d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 20 01:05:49.459017 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:49.458920    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3855d09e-b22a-4f7d-8712-dcd9a67787f6" path="/var/lib/kubelet/pods/3855d09e-b22a-4f7d-8712-dcd9a67787f6/volumes"
Sep 20 01:05:49.459500 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:49.459477    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7172d3a4-aef2-4462-af08-40baf2e291fa" path="/var/lib/kubelet/pods/7172d3a4-aef2-4462-af08-40baf2e291fa/volumes"
Sep 20 01:05:50.167335 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:50.167291    2570 patch_prober.go:28] interesting pod/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 20 01:05:50.167830 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:50.167367    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw" podUID="5627007e-c412-4913-bc73-b07959da91d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 20 01:05:51.166941 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:51.166901    2570 patch_prober.go:28] interesting pod/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 20 01:05:51.167147 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:51.166995    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw" podUID="5627007e-c412-4913-bc73-b07959da91d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 20 01:05:52.167975 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:52.167927    2570 patch_prober.go:28] interesting pod/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 20 01:05:52.168489 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:52.168000    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw" podUID="5627007e-c412-4913-bc73-b07959da91d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 20 01:05:52.263334 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:52.263296    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0b0a5312-chs5c"]
Sep 20 01:05:52.266958 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:52.266925    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3855d09e-b22a-4f7d-8712-dcd9a67787f6" containerName="payload-pre-processing"
Sep 20 01:05:52.267143 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:52.267130    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3855d09e-b22a-4f7d-8712-dcd9a67787f6" containerName="payload-pre-processing"
Sep 20 01:05:52.267303 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:52.267289    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7172d3a4-aef2-4462-af08-40baf2e291fa" containerName="payload-processing"
Sep 20 01:05:52.267415 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:52.267405    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="7172d3a4-aef2-4462-af08-40baf2e291fa" containerName="payload-processing"
Sep 20 01:05:52.267667 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:52.267641    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="3855d09e-b22a-4f7d-8712-dcd9a67787f6" containerName="payload-pre-processing"
Sep 20 01:05:52.267795 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:52.267784    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="7172d3a4-aef2-4462-af08-40baf2e291fa" containerName="payload-processing"
Sep 20 01:05:52.271952 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:52.271926    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0b0a5312-chs5c"
Sep 20 01:05:52.274033 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:52.274010    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5xngg\""
Sep 20 01:05:52.274334 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:52.274013    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 20 01:05:52.275845 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:52.275822    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0b0a5312-chs5c"]
Sep 20 01:05:52.309186 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:52.309156    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ded501c7-32c2-4227-80a1-33a6f8e9c90d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-0b0a5312-chs5c\" (UID: \"ded501c7-32c2-4227-80a1-33a6f8e9c90d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0b0a5312-chs5c"
Sep 20 01:05:52.410716 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:52.410677    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ded501c7-32c2-4227-80a1-33a6f8e9c90d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-0b0a5312-chs5c\" (UID: \"ded501c7-32c2-4227-80a1-33a6f8e9c90d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0b0a5312-chs5c"
Sep 20 01:05:52.411349 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:52.411326    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ded501c7-32c2-4227-80a1-33a6f8e9c90d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-0b0a5312-chs5c\" (UID: \"ded501c7-32c2-4227-80a1-33a6f8e9c90d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0b0a5312-chs5c"
Sep 20 01:05:52.586098 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:52.586015    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0b0a5312-chs5c"
Sep 20 01:05:52.858781 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:52.858712    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0b0a5312-chs5c"]
Sep 20 01:05:52.862534 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:05:52.862504    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podded501c7_32c2_4227_80a1_33a6f8e9c90d.slice/crio-66d35b669c24e44eee40819112df34ec4a8eaa75605a86bbc95efa3632da5f8f WatchSource:0}: Error finding container 66d35b669c24e44eee40819112df34ec4a8eaa75605a86bbc95efa3632da5f8f: Status 404 returned error can't find the container with id 66d35b669c24e44eee40819112df34ec4a8eaa75605a86bbc95efa3632da5f8f
Sep 20 01:05:53.123750 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:53.123717    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0b0a5312-chs5c" event={"ID":"ded501c7-32c2-4227-80a1-33a6f8e9c90d","Type":"ContainerStarted","Data":"727e15140eaf63f86d1b10a18e10c3778f20dfd284b3822480df71996b21a39d"}
Sep 20 01:05:53.123934 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:53.123769    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0b0a5312-chs5c" event={"ID":"ded501c7-32c2-4227-80a1-33a6f8e9c90d","Type":"ContainerStarted","Data":"66d35b669c24e44eee40819112df34ec4a8eaa75605a86bbc95efa3632da5f8f"}
Sep 20 01:05:53.137293 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:53.137241    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0b0a5312-chs5c" podStartSLOduration=1.137225322 podStartE2EDuration="1.137225322s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:05:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:05:53.136444885 +0000 UTC m=+1089.750600806" watchObservedRunningTime="2026-09-20 01:05:53.137225322 +0000 UTC m=+1089.751381219"
Sep 20 01:05:53.170981 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:53.170949    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw"
Sep 20 01:05:53.171354 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:53.171334    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw"
Sep 20 01:05:53.172117 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:53.172095    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw"
Sep 20 01:05:54.135044 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:54.135003    2570 generic.go:356] "Generic (PLEG): container finished" podID="ded501c7-32c2-4227-80a1-33a6f8e9c90d" containerID="727e15140eaf63f86d1b10a18e10c3778f20dfd284b3822480df71996b21a39d" exitCode=0
Sep 20 01:05:54.136074 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:54.136039    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0b0a5312-chs5c" event={"ID":"ded501c7-32c2-4227-80a1-33a6f8e9c90d","Type":"ContainerDied","Data":"727e15140eaf63f86d1b10a18e10c3778f20dfd284b3822480df71996b21a39d"}
Sep 20 01:05:54.205142 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:54.205109    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86"]
Sep 20 01:05:54.205555 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:54.205357    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86" podUID="54618481-3343-40b6-8f54-b7af78018f2b" containerName="istio-proxy" containerID="cri-o://a70f67d496536321e5912f76d7e18122b1c465050de3889a9dad8669526874b7" gracePeriod=30
Sep 20 01:05:54.926930 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:54.926896    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5"]
Sep 20 01:05:54.930059 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:54.930037    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5"
Sep 20 01:05:54.931963 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:54.931942    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-106d40-openshift-default-dockercfg-zrwnz\""
Sep 20 01:05:54.941172 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:54.941148    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5"]
Sep 20 01:05:55.044888 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:55.042836    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a54c8c28-2e32-42c5-9c96-daccd7c5ec18-istio-data\") pod \"e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5\" (UID: \"a54c8c28-2e32-42c5-9c96-daccd7c5ec18\") " pod="openshift-ingress/e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5"
Sep 20 01:05:55.044888 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:55.042925    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a54c8c28-2e32-42c5-9c96-daccd7c5ec18-istio-token\") pod \"e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5\" (UID: \"a54c8c28-2e32-42c5-9c96-daccd7c5ec18\") " pod="openshift-ingress/e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5"
Sep 20 01:05:55.044888 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:55.042971    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a54c8c28-2e32-42c5-9c96-daccd7c5ec18-istio-envoy\") pod \"e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5\" (UID: \"a54c8c28-2e32-42c5-9c96-daccd7c5ec18\") " pod="openshift-ingress/e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5"
Sep 20 01:05:55.044888 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:55.043051    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ns2lj\" (UniqueName: \"kubernetes.io/projected/a54c8c28-2e32-42c5-9c96-daccd7c5ec18-kube-api-access-ns2lj\") pod \"e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5\" (UID: \"a54c8c28-2e32-42c5-9c96-daccd7c5ec18\") " pod="openshift-ingress/e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5"
Sep 20 01:05:55.044888 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:55.043110    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a54c8c28-2e32-42c5-9c96-daccd7c5ec18-workload-certs\") pod \"e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5\" (UID: \"a54c8c28-2e32-42c5-9c96-daccd7c5ec18\") " pod="openshift-ingress/e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5"
Sep 20 01:05:55.044888 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:55.043140    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a54c8c28-2e32-42c5-9c96-daccd7c5ec18-credential-socket\") pod \"e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5\" (UID: \"a54c8c28-2e32-42c5-9c96-daccd7c5ec18\") " pod="openshift-ingress/e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5"
Sep 20 01:05:55.044888 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:55.043182    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a54c8c28-2e32-42c5-9c96-daccd7c5ec18-istiod-ca-cert\") pod \"e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5\" (UID: \"a54c8c28-2e32-42c5-9c96-daccd7c5ec18\") " pod="openshift-ingress/e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5"
Sep 20 01:05:55.044888 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:55.043216    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a54c8c28-2e32-42c5-9c96-daccd7c5ec18-workload-socket\") pod \"e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5\" (UID: \"a54c8c28-2e32-42c5-9c96-daccd7c5ec18\") " pod="openshift-ingress/e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5"
Sep 20 01:05:55.044888 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:55.043289    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a54c8c28-2e32-42c5-9c96-daccd7c5ec18-istio-podinfo\") pod \"e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5\" (UID: \"a54c8c28-2e32-42c5-9c96-daccd7c5ec18\") " pod="openshift-ingress/e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5"
Sep 20 01:05:55.144183 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:55.144153    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a54c8c28-2e32-42c5-9c96-daccd7c5ec18-istio-data\") pod \"e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5\" (UID: \"a54c8c28-2e32-42c5-9c96-daccd7c5ec18\") " pod="openshift-ingress/e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5"
Sep 20 01:05:55.144183 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:55.144190    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a54c8c28-2e32-42c5-9c96-daccd7c5ec18-istio-token\") pod \"e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5\" (UID: \"a54c8c28-2e32-42c5-9c96-daccd7c5ec18\") " pod="openshift-ingress/e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5"
Sep 20 01:05:55.144382 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:55.144226    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a54c8c28-2e32-42c5-9c96-daccd7c5ec18-istio-envoy\") pod \"e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5\" (UID: \"a54c8c28-2e32-42c5-9c96-daccd7c5ec18\") " pod="openshift-ingress/e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5"
Sep 20 01:05:55.144382 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:55.144280    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ns2lj\" (UniqueName: \"kubernetes.io/projected/a54c8c28-2e32-42c5-9c96-daccd7c5ec18-kube-api-access-ns2lj\") pod \"e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5\" (UID: \"a54c8c28-2e32-42c5-9c96-daccd7c5ec18\") " pod="openshift-ingress/e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5"
Sep 20 01:05:55.144496 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:55.144387    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a54c8c28-2e32-42c5-9c96-daccd7c5ec18-workload-certs\") pod \"e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5\" (UID: \"a54c8c28-2e32-42c5-9c96-daccd7c5ec18\") " pod="openshift-ingress/e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5"
Sep 20 01:05:55.144496 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:55.144444    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a54c8c28-2e32-42c5-9c96-daccd7c5ec18-credential-socket\") pod \"e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5\" (UID: \"a54c8c28-2e32-42c5-9c96-daccd7c5ec18\") " pod="openshift-ingress/e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5"
Sep 20 01:05:55.144496 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:55.144492    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a54c8c28-2e32-42c5-9c96-daccd7c5ec18-istiod-ca-cert\") pod \"e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5\" (UID: \"a54c8c28-2e32-42c5-9c96-daccd7c5ec18\") " pod="openshift-ingress/e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5"
Sep 20 01:05:55.144658 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:55.144532    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a54c8c28-2e32-42c5-9c96-daccd7c5ec18-workload-socket\") pod \"e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5\" (UID: \"a54c8c28-2e32-42c5-9c96-daccd7c5ec18\") " pod="openshift-ingress/e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5"
Sep 20 01:05:55.144658 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:55.144609    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a54c8c28-2e32-42c5-9c96-daccd7c5ec18-istio-podinfo\") pod \"e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5\" (UID: \"a54c8c28-2e32-42c5-9c96-daccd7c5ec18\") " pod="openshift-ingress/e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5"
Sep 20 01:05:55.144658 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:55.144619    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a54c8c28-2e32-42c5-9c96-daccd7c5ec18-istio-data\") pod \"e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5\" (UID: \"a54c8c28-2e32-42c5-9c96-daccd7c5ec18\") " pod="openshift-ingress/e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5"
Sep 20 01:05:55.144819 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:55.144730    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a54c8c28-2e32-42c5-9c96-daccd7c5ec18-workload-certs\") pod \"e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5\" (UID: \"a54c8c28-2e32-42c5-9c96-daccd7c5ec18\") " pod="openshift-ingress/e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5"
Sep 20 01:05:55.144902 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:55.144838    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a54c8c28-2e32-42c5-9c96-daccd7c5ec18-credential-socket\") pod \"e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5\" (UID: \"a54c8c28-2e32-42c5-9c96-daccd7c5ec18\") " pod="openshift-ingress/e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5"
Sep 20 01:05:55.145048 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:55.145026    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a54c8c28-2e32-42c5-9c96-daccd7c5ec18-workload-socket\") pod \"e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5\" (UID: \"a54c8c28-2e32-42c5-9c96-daccd7c5ec18\") " pod="openshift-ingress/e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5"
Sep 20 01:05:55.145676 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:55.145648    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a54c8c28-2e32-42c5-9c96-daccd7c5ec18-istiod-ca-cert\") pod \"e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5\" (UID: \"a54c8c28-2e32-42c5-9c96-daccd7c5ec18\") " pod="openshift-ingress/e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5"
Sep 20 01:05:55.146799 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:55.146774    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a54c8c28-2e32-42c5-9c96-daccd7c5ec18-istio-envoy\") pod \"e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5\" (UID: \"a54c8c28-2e32-42c5-9c96-daccd7c5ec18\") " pod="openshift-ingress/e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5"
Sep 20 01:05:55.147271 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:55.147249    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a54c8c28-2e32-42c5-9c96-daccd7c5ec18-istio-podinfo\") pod \"e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5\" (UID: \"a54c8c28-2e32-42c5-9c96-daccd7c5ec18\") " pod="openshift-ingress/e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5"
Sep 20 01:05:55.151841 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:55.151820    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a54c8c28-2e32-42c5-9c96-daccd7c5ec18-istio-token\") pod \"e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5\" (UID: \"a54c8c28-2e32-42c5-9c96-daccd7c5ec18\") " pod="openshift-ingress/e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5"
Sep 20 01:05:55.152085 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:55.152064    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ns2lj\" (UniqueName: \"kubernetes.io/projected/a54c8c28-2e32-42c5-9c96-daccd7c5ec18-kube-api-access-ns2lj\") pod \"e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5\" (UID: \"a54c8c28-2e32-42c5-9c96-daccd7c5ec18\") " pod="openshift-ingress/e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5"
Sep 20 01:05:55.244507 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:55.244476    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5"
Sep 20 01:05:55.284236 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:55.284208    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0b0a5312-chs5c"
Sep 20 01:05:55.346747 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:55.346716    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ded501c7-32c2-4227-80a1-33a6f8e9c90d-maas-api-service-ca\") pod \"ded501c7-32c2-4227-80a1-33a6f8e9c90d\" (UID: \"ded501c7-32c2-4227-80a1-33a6f8e9c90d\") "
Sep 20 01:05:55.347122 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:55.347099    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ded501c7-32c2-4227-80a1-33a6f8e9c90d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ded501c7-32c2-4227-80a1-33a6f8e9c90d" (UID: "ded501c7-32c2-4227-80a1-33a6f8e9c90d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:05:55.448061 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:55.447971    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ded501c7-32c2-4227-80a1-33a6f8e9c90d-maas-api-service-ca\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:05:55.546698 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:55.546675    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5"]
Sep 20 01:05:55.548119 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:05:55.548093    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda54c8c28_2e32_42c5_9c96_daccd7c5ec18.slice/crio-c7e7625200300a662b499247fd6b210748e7a3bd2e4b10d1ffbbfff1eae57415 WatchSource:0}: Error finding container c7e7625200300a662b499247fd6b210748e7a3bd2e4b10d1ffbbfff1eae57415: Status 404 returned error can't find the container with id c7e7625200300a662b499247fd6b210748e7a3bd2e4b10d1ffbbfff1eae57415
Sep 20 01:05:55.550676 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:55.550645    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:05:55.550752 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:55.550709    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:05:55.550752 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:55.550738    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:05:56.147750 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:56.147722    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0b0a5312-chs5c"
Sep 20 01:05:56.147933 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:56.147775    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0b0a5312-chs5c" event={"ID":"ded501c7-32c2-4227-80a1-33a6f8e9c90d","Type":"ContainerDied","Data":"66d35b669c24e44eee40819112df34ec4a8eaa75605a86bbc95efa3632da5f8f"}
Sep 20 01:05:56.147933 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:56.147831    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="66d35b669c24e44eee40819112df34ec4a8eaa75605a86bbc95efa3632da5f8f"
Sep 20 01:05:56.149573 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:56.149553    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5" event={"ID":"a54c8c28-2e32-42c5-9c96-daccd7c5ec18","Type":"ContainerStarted","Data":"9c82ffc260ea698ec0f246320d9672cfc7f5eea95497073c24d51994cfe4e616"}
Sep 20 01:05:56.149701 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:56.149588    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5" event={"ID":"a54c8c28-2e32-42c5-9c96-daccd7c5ec18","Type":"ContainerStarted","Data":"c7e7625200300a662b499247fd6b210748e7a3bd2e4b10d1ffbbfff1eae57415"}
Sep 20 01:05:56.171235 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:56.171188    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5" podStartSLOduration=2.171173142 podStartE2EDuration="2.171173142s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:05:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:05:56.169830878 +0000 UTC m=+1092.783986800" watchObservedRunningTime="2026-09-20 01:05:56.171173142 +0000 UTC m=+1092.785329039"
Sep 20 01:05:56.245634 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:56.245604    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5"
Sep 20 01:05:56.250934 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:56.250906    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5"
Sep 20 01:05:57.156117 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:57.156080    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5"
Sep 20 01:05:57.157003 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:57.156984    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5"
Sep 20 01:05:59.463349 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:59.463326    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86"
Sep 20 01:05:59.594007 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:59.593922    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54618481-3343-40b6-8f54-b7af78018f2b-istio-token\") pod \"54618481-3343-40b6-8f54-b7af78018f2b\" (UID: \"54618481-3343-40b6-8f54-b7af78018f2b\") "
Sep 20 01:05:59.594007 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:59.593975    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54618481-3343-40b6-8f54-b7af78018f2b-workload-socket\") pod \"54618481-3343-40b6-8f54-b7af78018f2b\" (UID: \"54618481-3343-40b6-8f54-b7af78018f2b\") "
Sep 20 01:05:59.594007 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:59.593999    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54618481-3343-40b6-8f54-b7af78018f2b-credential-socket\") pod \"54618481-3343-40b6-8f54-b7af78018f2b\" (UID: \"54618481-3343-40b6-8f54-b7af78018f2b\") "
Sep 20 01:05:59.594294 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:59.594054    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54618481-3343-40b6-8f54-b7af78018f2b-istio-podinfo\") pod \"54618481-3343-40b6-8f54-b7af78018f2b\" (UID: \"54618481-3343-40b6-8f54-b7af78018f2b\") "
Sep 20 01:05:59.594294 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:59.594074    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54618481-3343-40b6-8f54-b7af78018f2b-istio-data\") pod \"54618481-3343-40b6-8f54-b7af78018f2b\" (UID: \"54618481-3343-40b6-8f54-b7af78018f2b\") "
Sep 20 01:05:59.594294 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:59.594100    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54618481-3343-40b6-8f54-b7af78018f2b-istiod-ca-cert\") pod \"54618481-3343-40b6-8f54-b7af78018f2b\" (UID: \"54618481-3343-40b6-8f54-b7af78018f2b\") "
Sep 20 01:05:59.594294 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:59.594152    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54618481-3343-40b6-8f54-b7af78018f2b-istio-envoy\") pod \"54618481-3343-40b6-8f54-b7af78018f2b\" (UID: \"54618481-3343-40b6-8f54-b7af78018f2b\") "
Sep 20 01:05:59.594294 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:59.594188    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5ggbc\" (UniqueName: \"kubernetes.io/projected/54618481-3343-40b6-8f54-b7af78018f2b-kube-api-access-5ggbc\") pod \"54618481-3343-40b6-8f54-b7af78018f2b\" (UID: \"54618481-3343-40b6-8f54-b7af78018f2b\") "
Sep 20 01:05:59.594518 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:59.594352    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54618481-3343-40b6-8f54-b7af78018f2b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "54618481-3343-40b6-8f54-b7af78018f2b" (UID: "54618481-3343-40b6-8f54-b7af78018f2b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:05:59.594518 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:59.594366    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54618481-3343-40b6-8f54-b7af78018f2b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "54618481-3343-40b6-8f54-b7af78018f2b" (UID: "54618481-3343-40b6-8f54-b7af78018f2b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:05:59.594518 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:59.594422    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54618481-3343-40b6-8f54-b7af78018f2b-istio-data" (OuterVolumeSpecName: "istio-data") pod "54618481-3343-40b6-8f54-b7af78018f2b" (UID: "54618481-3343-40b6-8f54-b7af78018f2b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:05:59.594518 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:59.594450    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54618481-3343-40b6-8f54-b7af78018f2b-workload-certs\") pod \"54618481-3343-40b6-8f54-b7af78018f2b\" (UID: \"54618481-3343-40b6-8f54-b7af78018f2b\") "
Sep 20 01:05:59.595313 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:59.595037    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54618481-3343-40b6-8f54-b7af78018f2b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "54618481-3343-40b6-8f54-b7af78018f2b" (UID: "54618481-3343-40b6-8f54-b7af78018f2b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:05:59.595313 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:59.595236    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54618481-3343-40b6-8f54-b7af78018f2b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "54618481-3343-40b6-8f54-b7af78018f2b" (UID: "54618481-3343-40b6-8f54-b7af78018f2b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:05:59.598562 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:59.596878    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54618481-3343-40b6-8f54-b7af78018f2b-istio-data\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:05:59.598562 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:59.596854    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/54618481-3343-40b6-8f54-b7af78018f2b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "54618481-3343-40b6-8f54-b7af78018f2b" (UID: "54618481-3343-40b6-8f54-b7af78018f2b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 20 01:05:59.598562 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:59.596912    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54618481-3343-40b6-8f54-b7af78018f2b-istiod-ca-cert\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:05:59.598562 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:59.596928    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54618481-3343-40b6-8f54-b7af78018f2b-workload-certs\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:05:59.598562 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:59.596942    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54618481-3343-40b6-8f54-b7af78018f2b-workload-socket\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:05:59.598562 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:59.596956    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54618481-3343-40b6-8f54-b7af78018f2b-credential-socket\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:05:59.598562 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:59.596933    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54618481-3343-40b6-8f54-b7af78018f2b-istio-token" (OuterVolumeSpecName: "istio-token") pod "54618481-3343-40b6-8f54-b7af78018f2b" (UID: "54618481-3343-40b6-8f54-b7af78018f2b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:05:59.598562 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:59.596977    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54618481-3343-40b6-8f54-b7af78018f2b-kube-api-access-5ggbc" (OuterVolumeSpecName: "kube-api-access-5ggbc") pod "54618481-3343-40b6-8f54-b7af78018f2b" (UID: "54618481-3343-40b6-8f54-b7af78018f2b"). InnerVolumeSpecName "kube-api-access-5ggbc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:05:59.604637 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:59.604610    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54618481-3343-40b6-8f54-b7af78018f2b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "54618481-3343-40b6-8f54-b7af78018f2b" (UID: "54618481-3343-40b6-8f54-b7af78018f2b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:05:59.698169 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:59.698133    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54618481-3343-40b6-8f54-b7af78018f2b-istio-podinfo\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:05:59.698169 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:59.698162    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54618481-3343-40b6-8f54-b7af78018f2b-istio-envoy\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:05:59.698169 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:59.698172    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5ggbc\" (UniqueName: \"kubernetes.io/projected/54618481-3343-40b6-8f54-b7af78018f2b-kube-api-access-5ggbc\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:05:59.698403 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:05:59.698182    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54618481-3343-40b6-8f54-b7af78018f2b-istio-token\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:06:00.173736 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:00.173703    2570 generic.go:356] "Generic (PLEG): container finished" podID="54618481-3343-40b6-8f54-b7af78018f2b" containerID="a70f67d496536321e5912f76d7e18122b1c465050de3889a9dad8669526874b7" exitCode=0
Sep 20 01:06:00.173950 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:00.173772    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86"
Sep 20 01:06:00.173950 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:00.173782    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86" event={"ID":"54618481-3343-40b6-8f54-b7af78018f2b","Type":"ContainerDied","Data":"a70f67d496536321e5912f76d7e18122b1c465050de3889a9dad8669526874b7"}
Sep 20 01:06:00.173950 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:00.173898    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86" event={"ID":"54618481-3343-40b6-8f54-b7af78018f2b","Type":"ContainerDied","Data":"364a3309f9eb9ef55013d279569b913d9d12b26deed0281325e9ef503e8610a0"}
Sep 20 01:06:00.173950 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:00.173925    2570 scope.go:117] "RemoveContainer" containerID="a70f67d496536321e5912f76d7e18122b1c465050de3889a9dad8669526874b7"
Sep 20 01:06:00.183957 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:00.183940    2570 scope.go:117] "RemoveContainer" containerID="993dccae486d25c04334a69acb8fae3cb12a0c266a56af3c7ef2bf17d1d388b2"
Sep 20 01:06:00.193881 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:00.193837    2570 scope.go:117] "RemoveContainer" containerID="a70f67d496536321e5912f76d7e18122b1c465050de3889a9dad8669526874b7"
Sep 20 01:06:00.194202 ip-10-0-132-108 kubenswrapper[2570]: E0920 01:06:00.194183    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a70f67d496536321e5912f76d7e18122b1c465050de3889a9dad8669526874b7\": container with ID starting with a70f67d496536321e5912f76d7e18122b1c465050de3889a9dad8669526874b7 not found: ID does not exist" containerID="a70f67d496536321e5912f76d7e18122b1c465050de3889a9dad8669526874b7"
Sep 20 01:06:00.194273 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:00.194213    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a70f67d496536321e5912f76d7e18122b1c465050de3889a9dad8669526874b7"} err="failed to get container status \"a70f67d496536321e5912f76d7e18122b1c465050de3889a9dad8669526874b7\": rpc error: code = NotFound desc = could not find container \"a70f67d496536321e5912f76d7e18122b1c465050de3889a9dad8669526874b7\": container with ID starting with a70f67d496536321e5912f76d7e18122b1c465050de3889a9dad8669526874b7 not found: ID does not exist"
Sep 20 01:06:00.194273 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:00.194232    2570 scope.go:117] "RemoveContainer" containerID="993dccae486d25c04334a69acb8fae3cb12a0c266a56af3c7ef2bf17d1d388b2"
Sep 20 01:06:00.194495 ip-10-0-132-108 kubenswrapper[2570]: E0920 01:06:00.194474    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"993dccae486d25c04334a69acb8fae3cb12a0c266a56af3c7ef2bf17d1d388b2\": container with ID starting with 993dccae486d25c04334a69acb8fae3cb12a0c266a56af3c7ef2bf17d1d388b2 not found: ID does not exist" containerID="993dccae486d25c04334a69acb8fae3cb12a0c266a56af3c7ef2bf17d1d388b2"
Sep 20 01:06:00.194536 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:00.194504    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"993dccae486d25c04334a69acb8fae3cb12a0c266a56af3c7ef2bf17d1d388b2"} err="failed to get container status \"993dccae486d25c04334a69acb8fae3cb12a0c266a56af3c7ef2bf17d1d388b2\": rpc error: code = NotFound desc = could not find container \"993dccae486d25c04334a69acb8fae3cb12a0c266a56af3c7ef2bf17d1d388b2\": container with ID starting with 993dccae486d25c04334a69acb8fae3cb12a0c266a56af3c7ef2bf17d1d388b2 not found: ID does not exist"
Sep 20 01:06:00.196819 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:00.196792    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86"]
Sep 20 01:06:00.199160 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:00.199140    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-7db579-openshift-default-55d58d4d68-w9f86"]
Sep 20 01:06:01.454837 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:01.454802    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54618481-3343-40b6-8f54-b7af78018f2b" path="/var/lib/kubelet/pods/54618481-3343-40b6-8f54-b7af78018f2b/volumes"
Sep 20 01:06:02.838436 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:02.838385    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0b0a5312-b744bcfd5-2nsts"]
Sep 20 01:06:02.838942 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:02.838641    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-0b0a5312-b744bcfd5-2nsts" podUID="ef173cbf-6b35-43c0-9dd8-f24b746ed44f" containerName="payload-processing" containerID="cri-o://841e111d02b72fbec8ba6b7ba54ed5129d667311ce5262bbdc567106da42a6c7" gracePeriod=30
Sep 20 01:06:02.845002 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:02.844978    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0b0a5312-75ddc9c9d-szd9t"]
Sep 20 01:06:02.845422 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:02.845208    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-0b0a5312-75ddc9c9d-szd9t" podUID="65189dd6-70ec-4442-8bb3-df952fe63a57" containerName="payload-pre-processing" containerID="cri-o://cc7b1ba04659fdfd7d4ebd604e2b69e3f09f672ad51961a936af635dc9c0f849" gracePeriod=30
Sep 20 01:06:03.023067 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:03.023007    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0b0a5312-chs5c"]
Sep 20 01:06:03.026738 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:03.026712    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0b0a5312-chs5c"]
Sep 20 01:06:03.122120 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:03.121785    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-0b0a5312-b744bcfd5-2nsts"
Sep 20 01:06:03.156780 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:03.156749    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0b0a5312-75ddc9c9d-szd9t"
Sep 20 01:06:03.199046 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:03.199008    2570 generic.go:356] "Generic (PLEG): container finished" podID="ef173cbf-6b35-43c0-9dd8-f24b746ed44f" containerID="841e111d02b72fbec8ba6b7ba54ed5129d667311ce5262bbdc567106da42a6c7" exitCode=0
Sep 20 01:06:03.199239 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:03.199060    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-0b0a5312-b744bcfd5-2nsts"
Sep 20 01:06:03.199239 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:03.199098    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-0b0a5312-b744bcfd5-2nsts" event={"ID":"ef173cbf-6b35-43c0-9dd8-f24b746ed44f","Type":"ContainerDied","Data":"841e111d02b72fbec8ba6b7ba54ed5129d667311ce5262bbdc567106da42a6c7"}
Sep 20 01:06:03.199239 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:03.199164    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-0b0a5312-b744bcfd5-2nsts" event={"ID":"ef173cbf-6b35-43c0-9dd8-f24b746ed44f","Type":"ContainerDied","Data":"965fb9f42e545716f54c636a9c8655fff17f27e685686611022f16bb640886c6"}
Sep 20 01:06:03.199239 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:03.199201    2570 scope.go:117] "RemoveContainer" containerID="841e111d02b72fbec8ba6b7ba54ed5129d667311ce5262bbdc567106da42a6c7"
Sep 20 01:06:03.200695 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:03.200671    2570 generic.go:356] "Generic (PLEG): container finished" podID="65189dd6-70ec-4442-8bb3-df952fe63a57" containerID="cc7b1ba04659fdfd7d4ebd604e2b69e3f09f672ad51961a936af635dc9c0f849" exitCode=0
Sep 20 01:06:03.200819 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:03.200773    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0b0a5312-75ddc9c9d-szd9t"
Sep 20 01:06:03.200819 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:03.200799    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0b0a5312-75ddc9c9d-szd9t" event={"ID":"65189dd6-70ec-4442-8bb3-df952fe63a57","Type":"ContainerDied","Data":"cc7b1ba04659fdfd7d4ebd604e2b69e3f09f672ad51961a936af635dc9c0f849"}
Sep 20 01:06:03.200948 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:03.200842    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0b0a5312-75ddc9c9d-szd9t" event={"ID":"65189dd6-70ec-4442-8bb3-df952fe63a57","Type":"ContainerDied","Data":"edd1942b9eed4def5a736e6f9fd690202b7c6b1631ba3a692f02313fccbd51d6"}
Sep 20 01:06:03.211498 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:03.211474    2570 scope.go:117] "RemoveContainer" containerID="841e111d02b72fbec8ba6b7ba54ed5129d667311ce5262bbdc567106da42a6c7"
Sep 20 01:06:03.211968 ip-10-0-132-108 kubenswrapper[2570]: E0920 01:06:03.211935    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"841e111d02b72fbec8ba6b7ba54ed5129d667311ce5262bbdc567106da42a6c7\": container with ID starting with 841e111d02b72fbec8ba6b7ba54ed5129d667311ce5262bbdc567106da42a6c7 not found: ID does not exist" containerID="841e111d02b72fbec8ba6b7ba54ed5129d667311ce5262bbdc567106da42a6c7"
Sep 20 01:06:03.212062 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:03.211981    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"841e111d02b72fbec8ba6b7ba54ed5129d667311ce5262bbdc567106da42a6c7"} err="failed to get container status \"841e111d02b72fbec8ba6b7ba54ed5129d667311ce5262bbdc567106da42a6c7\": rpc error: code = NotFound desc = could not find container \"841e111d02b72fbec8ba6b7ba54ed5129d667311ce5262bbdc567106da42a6c7\": container with ID starting with 841e111d02b72fbec8ba6b7ba54ed5129d667311ce5262bbdc567106da42a6c7 not found: ID does not exist"
Sep 20 01:06:03.212062 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:03.212005    2570 scope.go:117] "RemoveContainer" containerID="cc7b1ba04659fdfd7d4ebd604e2b69e3f09f672ad51961a936af635dc9c0f849"
Sep 20 01:06:03.222823 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:03.222805    2570 scope.go:117] "RemoveContainer" containerID="cc7b1ba04659fdfd7d4ebd604e2b69e3f09f672ad51961a936af635dc9c0f849"
Sep 20 01:06:03.223169 ip-10-0-132-108 kubenswrapper[2570]: E0920 01:06:03.223149    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc7b1ba04659fdfd7d4ebd604e2b69e3f09f672ad51961a936af635dc9c0f849\": container with ID starting with cc7b1ba04659fdfd7d4ebd604e2b69e3f09f672ad51961a936af635dc9c0f849 not found: ID does not exist" containerID="cc7b1ba04659fdfd7d4ebd604e2b69e3f09f672ad51961a936af635dc9c0f849"
Sep 20 01:06:03.223240 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:03.223179    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc7b1ba04659fdfd7d4ebd604e2b69e3f09f672ad51961a936af635dc9c0f849"} err="failed to get container status \"cc7b1ba04659fdfd7d4ebd604e2b69e3f09f672ad51961a936af635dc9c0f849\": rpc error: code = NotFound desc = could not find container \"cc7b1ba04659fdfd7d4ebd604e2b69e3f09f672ad51961a936af635dc9c0f849\": container with ID starting with cc7b1ba04659fdfd7d4ebd604e2b69e3f09f672ad51961a936af635dc9c0f849 not found: ID does not exist"
Sep 20 01:06:03.234594 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:03.234572    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/65189dd6-70ec-4442-8bb3-df952fe63a57-plugins-config-volume\") pod \"65189dd6-70ec-4442-8bb3-df952fe63a57\" (UID: \"65189dd6-70ec-4442-8bb3-df952fe63a57\") "
Sep 20 01:06:03.234690 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:03.234637    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s6jkk\" (UniqueName: \"kubernetes.io/projected/65189dd6-70ec-4442-8bb3-df952fe63a57-kube-api-access-s6jkk\") pod \"65189dd6-70ec-4442-8bb3-df952fe63a57\" (UID: \"65189dd6-70ec-4442-8bb3-df952fe63a57\") "
Sep 20 01:06:03.234690 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:03.234665    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef173cbf-6b35-43c0-9dd8-f24b746ed44f-plugins-config-volume\") pod \"ef173cbf-6b35-43c0-9dd8-f24b746ed44f\" (UID: \"ef173cbf-6b35-43c0-9dd8-f24b746ed44f\") "
Sep 20 01:06:03.234800 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:03.234709    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6t9md\" (UniqueName: \"kubernetes.io/projected/ef173cbf-6b35-43c0-9dd8-f24b746ed44f-kube-api-access-6t9md\") pod \"ef173cbf-6b35-43c0-9dd8-f24b746ed44f\" (UID: \"ef173cbf-6b35-43c0-9dd8-f24b746ed44f\") "
Sep 20 01:06:03.235057 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:03.235033    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65189dd6-70ec-4442-8bb3-df952fe63a57-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "65189dd6-70ec-4442-8bb3-df952fe63a57" (UID: "65189dd6-70ec-4442-8bb3-df952fe63a57"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:06:03.235159 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:03.235134    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef173cbf-6b35-43c0-9dd8-f24b746ed44f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ef173cbf-6b35-43c0-9dd8-f24b746ed44f" (UID: "ef173cbf-6b35-43c0-9dd8-f24b746ed44f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:06:03.235207 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:03.235168    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/65189dd6-70ec-4442-8bb3-df952fe63a57-plugins-config-volume\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:06:03.236844 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:03.236816    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65189dd6-70ec-4442-8bb3-df952fe63a57-kube-api-access-s6jkk" (OuterVolumeSpecName: "kube-api-access-s6jkk") pod "65189dd6-70ec-4442-8bb3-df952fe63a57" (UID: "65189dd6-70ec-4442-8bb3-df952fe63a57"). InnerVolumeSpecName "kube-api-access-s6jkk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:06:03.236952 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:03.236938    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef173cbf-6b35-43c0-9dd8-f24b746ed44f-kube-api-access-6t9md" (OuterVolumeSpecName: "kube-api-access-6t9md") pod "ef173cbf-6b35-43c0-9dd8-f24b746ed44f" (UID: "ef173cbf-6b35-43c0-9dd8-f24b746ed44f"). InnerVolumeSpecName "kube-api-access-6t9md". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:06:03.336359 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:03.336319    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s6jkk\" (UniqueName: \"kubernetes.io/projected/65189dd6-70ec-4442-8bb3-df952fe63a57-kube-api-access-s6jkk\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:06:03.336359 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:03.336352    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ef173cbf-6b35-43c0-9dd8-f24b746ed44f-plugins-config-volume\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:06:03.336359 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:03.336363    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6t9md\" (UniqueName: \"kubernetes.io/projected/ef173cbf-6b35-43c0-9dd8-f24b746ed44f-kube-api-access-6t9md\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:06:03.459173 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:03.458635    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ded501c7-32c2-4227-80a1-33a6f8e9c90d" path="/var/lib/kubelet/pods/ded501c7-32c2-4227-80a1-33a6f8e9c90d/volumes"
Sep 20 01:06:03.513811 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:03.513775    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0b0a5312-b744bcfd5-2nsts"]
Sep 20 01:06:03.516976 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:03.516952    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0b0a5312-b744bcfd5-2nsts"]
Sep 20 01:06:03.525813 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:03.525789    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0b0a5312-75ddc9c9d-szd9t"]
Sep 20 01:06:03.527918 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:03.527900    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0b0a5312-75ddc9c9d-szd9t"]
Sep 20 01:06:05.453606 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:05.453574    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65189dd6-70ec-4442-8bb3-df952fe63a57" path="/var/lib/kubelet/pods/65189dd6-70ec-4442-8bb3-df952fe63a57/volumes"
Sep 20 01:06:05.454004 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:05.453989    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef173cbf-6b35-43c0-9dd8-f24b746ed44f" path="/var/lib/kubelet/pods/ef173cbf-6b35-43c0-9dd8-f24b746ed44f/volumes"
Sep 20 01:06:09.243036 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:09.242997    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw"]
Sep 20 01:06:09.243527 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:09.243229    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw" podUID="5627007e-c412-4913-bc73-b07959da91d8" containerName="istio-proxy" containerID="cri-o://ea01f2e12c123ca1ce6626f197152ab9d79ad5ca7505acabead46ea7978a6ffc" gracePeriod=30
Sep 20 01:06:14.500590 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:14.500564    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw"
Sep 20 01:06:14.654227 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:14.654198    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5627007e-c412-4913-bc73-b07959da91d8-istio-podinfo\") pod \"5627007e-c412-4913-bc73-b07959da91d8\" (UID: \"5627007e-c412-4913-bc73-b07959da91d8\") "
Sep 20 01:06:14.654227 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:14.654233    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5627007e-c412-4913-bc73-b07959da91d8-workload-certs\") pod \"5627007e-c412-4913-bc73-b07959da91d8\" (UID: \"5627007e-c412-4913-bc73-b07959da91d8\") "
Sep 20 01:06:14.654423 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:14.654251    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5627007e-c412-4913-bc73-b07959da91d8-istiod-ca-cert\") pod \"5627007e-c412-4913-bc73-b07959da91d8\" (UID: \"5627007e-c412-4913-bc73-b07959da91d8\") "
Sep 20 01:06:14.654423 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:14.654274    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5627007e-c412-4913-bc73-b07959da91d8-istio-data\") pod \"5627007e-c412-4913-bc73-b07959da91d8\" (UID: \"5627007e-c412-4913-bc73-b07959da91d8\") "
Sep 20 01:06:14.654423 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:14.654322    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5627007e-c412-4913-bc73-b07959da91d8-istio-token\") pod \"5627007e-c412-4913-bc73-b07959da91d8\" (UID: \"5627007e-c412-4913-bc73-b07959da91d8\") "
Sep 20 01:06:14.654423 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:14.654383    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5627007e-c412-4913-bc73-b07959da91d8-istio-envoy\") pod \"5627007e-c412-4913-bc73-b07959da91d8\" (UID: \"5627007e-c412-4913-bc73-b07959da91d8\") "
Sep 20 01:06:14.654636 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:14.654454    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5627007e-c412-4913-bc73-b07959da91d8-credential-socket\") pod \"5627007e-c412-4913-bc73-b07959da91d8\" (UID: \"5627007e-c412-4913-bc73-b07959da91d8\") "
Sep 20 01:06:14.654636 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:14.654496    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5627007e-c412-4913-bc73-b07959da91d8-workload-socket\") pod \"5627007e-c412-4913-bc73-b07959da91d8\" (UID: \"5627007e-c412-4913-bc73-b07959da91d8\") "
Sep 20 01:06:14.654636 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:14.654521    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jdhdt\" (UniqueName: \"kubernetes.io/projected/5627007e-c412-4913-bc73-b07959da91d8-kube-api-access-jdhdt\") pod \"5627007e-c412-4913-bc73-b07959da91d8\" (UID: \"5627007e-c412-4913-bc73-b07959da91d8\") "
Sep 20 01:06:14.654636 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:14.654570    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5627007e-c412-4913-bc73-b07959da91d8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5627007e-c412-4913-bc73-b07959da91d8" (UID: "5627007e-c412-4913-bc73-b07959da91d8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:06:14.654636 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:14.654586    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5627007e-c412-4913-bc73-b07959da91d8-istio-data" (OuterVolumeSpecName: "istio-data") pod "5627007e-c412-4913-bc73-b07959da91d8" (UID: "5627007e-c412-4913-bc73-b07959da91d8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:06:14.654938 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:14.654669    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5627007e-c412-4913-bc73-b07959da91d8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5627007e-c412-4913-bc73-b07959da91d8" (UID: "5627007e-c412-4913-bc73-b07959da91d8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:06:14.654938 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:14.654784    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5627007e-c412-4913-bc73-b07959da91d8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5627007e-c412-4913-bc73-b07959da91d8" (UID: "5627007e-c412-4913-bc73-b07959da91d8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:06:14.654938 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:14.654914    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5627007e-c412-4913-bc73-b07959da91d8-workload-socket\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:06:14.654938 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:14.654916    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5627007e-c412-4913-bc73-b07959da91d8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5627007e-c412-4913-bc73-b07959da91d8" (UID: "5627007e-c412-4913-bc73-b07959da91d8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:06:14.654938 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:14.654936    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5627007e-c412-4913-bc73-b07959da91d8-workload-certs\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:06:14.655365 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:14.654955    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5627007e-c412-4913-bc73-b07959da91d8-istiod-ca-cert\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:06:14.655365 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:14.654968    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5627007e-c412-4913-bc73-b07959da91d8-istio-data\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:06:14.656589 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:14.656568    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5627007e-c412-4913-bc73-b07959da91d8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5627007e-c412-4913-bc73-b07959da91d8" (UID: "5627007e-c412-4913-bc73-b07959da91d8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 20 01:06:14.656715 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:14.656695    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5627007e-c412-4913-bc73-b07959da91d8-istio-token" (OuterVolumeSpecName: "istio-token") pod "5627007e-c412-4913-bc73-b07959da91d8" (UID: "5627007e-c412-4913-bc73-b07959da91d8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:06:14.656851 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:14.656829    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5627007e-c412-4913-bc73-b07959da91d8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5627007e-c412-4913-bc73-b07959da91d8" (UID: "5627007e-c412-4913-bc73-b07959da91d8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:06:14.656851 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:14.656832    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5627007e-c412-4913-bc73-b07959da91d8-kube-api-access-jdhdt" (OuterVolumeSpecName: "kube-api-access-jdhdt") pod "5627007e-c412-4913-bc73-b07959da91d8" (UID: "5627007e-c412-4913-bc73-b07959da91d8"). InnerVolumeSpecName "kube-api-access-jdhdt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:06:14.755832 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:14.755806    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5627007e-c412-4913-bc73-b07959da91d8-credential-socket\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:06:14.755832 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:14.755830    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jdhdt\" (UniqueName: \"kubernetes.io/projected/5627007e-c412-4913-bc73-b07959da91d8-kube-api-access-jdhdt\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:06:14.755832 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:14.755839    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5627007e-c412-4913-bc73-b07959da91d8-istio-podinfo\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:06:14.756098 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:14.755849    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5627007e-c412-4913-bc73-b07959da91d8-istio-token\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:06:14.756098 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:14.755883    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5627007e-c412-4913-bc73-b07959da91d8-istio-envoy\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:06:15.274875 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:15.274833    2570 generic.go:356] "Generic (PLEG): container finished" podID="5627007e-c412-4913-bc73-b07959da91d8" containerID="ea01f2e12c123ca1ce6626f197152ab9d79ad5ca7505acabead46ea7978a6ffc" exitCode=0
Sep 20 01:06:15.275064 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:15.274898    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw"
Sep 20 01:06:15.275064 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:15.274898    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw" event={"ID":"5627007e-c412-4913-bc73-b07959da91d8","Type":"ContainerDied","Data":"ea01f2e12c123ca1ce6626f197152ab9d79ad5ca7505acabead46ea7978a6ffc"}
Sep 20 01:06:15.275064 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:15.274951    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw" event={"ID":"5627007e-c412-4913-bc73-b07959da91d8","Type":"ContainerDied","Data":"93427040ca162d7ff89048ed6b1897d82c907da1f11ed1166ed51bf24d6c65ae"}
Sep 20 01:06:15.275064 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:15.274978    2570 scope.go:117] "RemoveContainer" containerID="ea01f2e12c123ca1ce6626f197152ab9d79ad5ca7505acabead46ea7978a6ffc"
Sep 20 01:06:15.285165 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:15.285147    2570 scope.go:117] "RemoveContainer" containerID="3fce0027468ca88a81270a0365534794560dc95972ce1a69d47603f5226e2d2a"
Sep 20 01:06:15.294434 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:15.294332    2570 scope.go:117] "RemoveContainer" containerID="ea01f2e12c123ca1ce6626f197152ab9d79ad5ca7505acabead46ea7978a6ffc"
Sep 20 01:06:15.294764 ip-10-0-132-108 kubenswrapper[2570]: E0920 01:06:15.294692    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea01f2e12c123ca1ce6626f197152ab9d79ad5ca7505acabead46ea7978a6ffc\": container with ID starting with ea01f2e12c123ca1ce6626f197152ab9d79ad5ca7505acabead46ea7978a6ffc not found: ID does not exist" containerID="ea01f2e12c123ca1ce6626f197152ab9d79ad5ca7505acabead46ea7978a6ffc"
Sep 20 01:06:15.294764 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:15.294727    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea01f2e12c123ca1ce6626f197152ab9d79ad5ca7505acabead46ea7978a6ffc"} err="failed to get container status \"ea01f2e12c123ca1ce6626f197152ab9d79ad5ca7505acabead46ea7978a6ffc\": rpc error: code = NotFound desc = could not find container \"ea01f2e12c123ca1ce6626f197152ab9d79ad5ca7505acabead46ea7978a6ffc\": container with ID starting with ea01f2e12c123ca1ce6626f197152ab9d79ad5ca7505acabead46ea7978a6ffc not found: ID does not exist"
Sep 20 01:06:15.294764 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:15.294751    2570 scope.go:117] "RemoveContainer" containerID="3fce0027468ca88a81270a0365534794560dc95972ce1a69d47603f5226e2d2a"
Sep 20 01:06:15.295098 ip-10-0-132-108 kubenswrapper[2570]: E0920 01:06:15.295074    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fce0027468ca88a81270a0365534794560dc95972ce1a69d47603f5226e2d2a\": container with ID starting with 3fce0027468ca88a81270a0365534794560dc95972ce1a69d47603f5226e2d2a not found: ID does not exist" containerID="3fce0027468ca88a81270a0365534794560dc95972ce1a69d47603f5226e2d2a"
Sep 20 01:06:15.295166 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:15.295107    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fce0027468ca88a81270a0365534794560dc95972ce1a69d47603f5226e2d2a"} err="failed to get container status \"3fce0027468ca88a81270a0365534794560dc95972ce1a69d47603f5226e2d2a\": rpc error: code = NotFound desc = could not find container \"3fce0027468ca88a81270a0365534794560dc95972ce1a69d47603f5226e2d2a\": container with ID starting with 3fce0027468ca88a81270a0365534794560dc95972ce1a69d47603f5226e2d2a not found: ID does not exist"
Sep 20 01:06:15.296539 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:15.296518    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw"]
Sep 20 01:06:15.301099 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:15.301075    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-0b0a5312-openshift-default-d4764f488-hjlmw"]
Sep 20 01:06:15.456450 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:15.456416    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5627007e-c412-4913-bc73-b07959da91d8" path="/var/lib/kubelet/pods/5627007e-c412-4913-bc73-b07959da91d8/volumes"
Sep 20 01:06:23.103597 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:23.103555    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g"]
Sep 20 01:06:23.104292 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:23.104269    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef173cbf-6b35-43c0-9dd8-f24b746ed44f" containerName="payload-processing"
Sep 20 01:06:23.104372 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:23.104295    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef173cbf-6b35-43c0-9dd8-f24b746ed44f" containerName="payload-processing"
Sep 20 01:06:23.104372 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:23.104318    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5627007e-c412-4913-bc73-b07959da91d8" containerName="istio-proxy"
Sep 20 01:06:23.104372 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:23.104327    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="5627007e-c412-4913-bc73-b07959da91d8" containerName="istio-proxy"
Sep 20 01:06:23.104372 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:23.104338    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ded501c7-32c2-4227-80a1-33a6f8e9c90d" containerName="revoke-keys"
Sep 20 01:06:23.104372 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:23.104346    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ded501c7-32c2-4227-80a1-33a6f8e9c90d" containerName="revoke-keys"
Sep 20 01:06:23.104372 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:23.104359    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54618481-3343-40b6-8f54-b7af78018f2b" containerName="istio-proxy"
Sep 20 01:06:23.104372 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:23.104368    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="54618481-3343-40b6-8f54-b7af78018f2b" containerName="istio-proxy"
Sep 20 01:06:23.104735 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:23.104381    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65189dd6-70ec-4442-8bb3-df952fe63a57" containerName="payload-pre-processing"
Sep 20 01:06:23.104735 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:23.104390    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="65189dd6-70ec-4442-8bb3-df952fe63a57" containerName="payload-pre-processing"
Sep 20 01:06:23.104735 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:23.104404    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54618481-3343-40b6-8f54-b7af78018f2b" containerName="istio-proxy"
Sep 20 01:06:23.104735 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:23.104411    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="54618481-3343-40b6-8f54-b7af78018f2b" containerName="istio-proxy"
Sep 20 01:06:23.104735 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:23.104531    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef173cbf-6b35-43c0-9dd8-f24b746ed44f" containerName="payload-processing"
Sep 20 01:06:23.104735 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:23.104544    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="54618481-3343-40b6-8f54-b7af78018f2b" containerName="istio-proxy"
Sep 20 01:06:23.104735 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:23.104554    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="54618481-3343-40b6-8f54-b7af78018f2b" containerName="istio-proxy"
Sep 20 01:06:23.104735 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:23.104562    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="ded501c7-32c2-4227-80a1-33a6f8e9c90d" containerName="revoke-keys"
Sep 20 01:06:23.104735 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:23.104570    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="5627007e-c412-4913-bc73-b07959da91d8" containerName="istio-proxy"
Sep 20 01:06:23.104735 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:23.104580    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="5627007e-c412-4913-bc73-b07959da91d8" containerName="istio-proxy"
Sep 20 01:06:23.104735 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:23.104588    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="65189dd6-70ec-4442-8bb3-df952fe63a57" containerName="payload-pre-processing"
Sep 20 01:06:23.107823 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:23.107800    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g"
Sep 20 01:06:23.109918 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:23.109888    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-0766ea-openshift-default-dockercfg-vfslr\""
Sep 20 01:06:23.117503 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:23.117476    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g"]
Sep 20 01:06:23.149183 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:23.149140    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1-istio-token\") pod \"e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g\" (UID: \"f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1\") " pod="openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g"
Sep 20 01:06:23.149364 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:23.149190    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c79ww\" (UniqueName: \"kubernetes.io/projected/f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1-kube-api-access-c79ww\") pod \"e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g\" (UID: \"f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1\") " pod="openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g"
Sep 20 01:06:23.149364 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:23.149253    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1-istio-podinfo\") pod \"e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g\" (UID: \"f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1\") " pod="openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g"
Sep 20 01:06:23.149506 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:23.149367    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1-istio-envoy\") pod \"e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g\" (UID: \"f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1\") " pod="openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g"
Sep 20 01:06:23.149506 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:23.149408    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1-workload-socket\") pod \"e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g\" (UID: \"f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1\") " pod="openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g"
Sep 20 01:06:23.149506 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:23.149433    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1-credential-socket\") pod \"e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g\" (UID: \"f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1\") " pod="openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g"
Sep 20 01:06:23.149506 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:23.149473    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1-istio-data\") pod \"e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g\" (UID: \"f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1\") " pod="openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g"
Sep 20 01:06:23.149656 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:23.149548    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1-istiod-ca-cert\") pod \"e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g\" (UID: \"f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1\") " pod="openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g"
Sep 20 01:06:23.149656 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:23.149582    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1-workload-certs\") pod \"e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g\" (UID: \"f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1\") " pod="openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g"
Sep 20 01:06:23.251110 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:23.251074    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1-istio-envoy\") pod \"e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g\" (UID: \"f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1\") " pod="openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g"
Sep 20 01:06:23.251110 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:23.251113    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1-workload-socket\") pod \"e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g\" (UID: \"f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1\") " pod="openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g"
Sep 20 01:06:23.251357 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:23.251130    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1-credential-socket\") pod \"e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g\" (UID: \"f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1\") " pod="openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g"
Sep 20 01:06:23.251357 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:23.251268    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1-istio-data\") pod \"e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g\" (UID: \"f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1\") " pod="openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g"
Sep 20 01:06:23.251357 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:23.251335    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1-istiod-ca-cert\") pod \"e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g\" (UID: \"f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1\") " pod="openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g"
Sep 20 01:06:23.251525 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:23.251364    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1-workload-certs\") pod \"e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g\" (UID: \"f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1\") " pod="openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g"
Sep 20 01:06:23.251525 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:23.251411    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1-istio-token\") pod \"e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g\" (UID: \"f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1\") " pod="openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g"
Sep 20 01:06:23.251525 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:23.251445    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c79ww\" (UniqueName: \"kubernetes.io/projected/f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1-kube-api-access-c79ww\") pod \"e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g\" (UID: \"f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1\") " pod="openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g"
Sep 20 01:06:23.251525 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:23.251485    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1-istio-podinfo\") pod \"e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g\" (UID: \"f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1\") " pod="openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g"
Sep 20 01:06:23.251525 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:23.251488    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1-credential-socket\") pod \"e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g\" (UID: \"f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1\") " pod="openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g"
Sep 20 01:06:23.251784 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:23.251573    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1-workload-socket\") pod \"e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g\" (UID: \"f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1\") " pod="openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g"
Sep 20 01:06:23.251784 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:23.251637    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1-istio-data\") pod \"e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g\" (UID: \"f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1\") " pod="openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g"
Sep 20 01:06:23.251855 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:23.251825    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1-workload-certs\") pod \"e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g\" (UID: \"f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1\") " pod="openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g"
Sep 20 01:06:23.252344 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:23.252319    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1-istiod-ca-cert\") pod \"e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g\" (UID: \"f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1\") " pod="openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g"
Sep 20 01:06:23.253672 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:23.253655    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1-istio-envoy\") pod \"e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g\" (UID: \"f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1\") " pod="openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g"
Sep 20 01:06:23.254001 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:23.253983    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1-istio-podinfo\") pod \"e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g\" (UID: \"f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1\") " pod="openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g"
Sep 20 01:06:23.258495 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:23.258471    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1-istio-token\") pod \"e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g\" (UID: \"f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1\") " pod="openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g"
Sep 20 01:06:23.258603 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:23.258582    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c79ww\" (UniqueName: \"kubernetes.io/projected/f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1-kube-api-access-c79ww\") pod \"e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g\" (UID: \"f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1\") " pod="openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g"
Sep 20 01:06:23.421559 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:23.421526    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g"
Sep 20 01:06:23.700447 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:23.700422    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g"]
Sep 20 01:06:23.703099 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:06:23.703074    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7c12ccc_5519_4ac9_a5b6_80bcbbc610e1.slice/crio-df962ba02d41ef8bae6787ca647dd505e085200eecb4604bc0b28ba5ac0a38fd WatchSource:0}: Error finding container df962ba02d41ef8bae6787ca647dd505e085200eecb4604bc0b28ba5ac0a38fd: Status 404 returned error can't find the container with id df962ba02d41ef8bae6787ca647dd505e085200eecb4604bc0b28ba5ac0a38fd
Sep 20 01:06:23.705455 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:23.705422    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:06:23.705557 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:23.705488    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:06:23.705557 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:23.705519    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:06:24.325958 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:24.325920    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g" event={"ID":"f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1","Type":"ContainerStarted","Data":"044e168d52048cc08075d273db38d29e59e6207fcc56c603d39c76411acb77e6"}
Sep 20 01:06:24.326315 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:24.325985    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g" event={"ID":"f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1","Type":"ContainerStarted","Data":"df962ba02d41ef8bae6787ca647dd505e085200eecb4604bc0b28ba5ac0a38fd"}
Sep 20 01:06:24.345870 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:24.345815    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g" podStartSLOduration=1.34580016 podStartE2EDuration="1.34580016s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:06:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:06:24.342804865 +0000 UTC m=+1120.956960762" watchObservedRunningTime="2026-09-20 01:06:24.34580016 +0000 UTC m=+1120.959956056"
Sep 20 01:06:24.422365 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:24.422330    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g"
Sep 20 01:06:24.427667 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:24.427644    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g"
Sep 20 01:06:25.331945 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:25.331844    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g"
Sep 20 01:06:25.332939 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:25.332917    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g"
Sep 20 01:06:29.917700 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:29.917661    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-0766ea-895d4469d-cvg9s"]
Sep 20 01:06:29.918139 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:29.918125    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5627007e-c412-4913-bc73-b07959da91d8" containerName="istio-proxy"
Sep 20 01:06:29.918139 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:29.918141    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="5627007e-c412-4913-bc73-b07959da91d8" containerName="istio-proxy"
Sep 20 01:06:29.920456 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:29.920441    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-0766ea-895d4469d-cvg9s"
Sep 20 01:06:29.922578 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:29.922555    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-0766ea-dockercfg-79bnn\""
Sep 20 01:06:29.922694 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:29.922552    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-0766ea\""
Sep 20 01:06:29.930517 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:29.930491    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-0766ea-895d4469d-cvg9s"]
Sep 20 01:06:29.936599 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:29.936567    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-0766ea-74d47477bc-5fb9v"]
Sep 20 01:06:29.939137 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:29.939122    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-0766ea-74d47477bc-5fb9v"
Sep 20 01:06:29.950942 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:29.950918    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-0766ea-74d47477bc-5fb9v"]
Sep 20 01:06:30.022800 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:30.022760    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnr8z\" (UniqueName: \"kubernetes.io/projected/c88462ad-2257-4514-8971-39e1039481f0-kube-api-access-lnr8z\") pod \"payload-pre-processing-e2e-shared-a-w2-0766ea-895d4469d-cvg9s\" (UID: \"c88462ad-2257-4514-8971-39e1039481f0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-0766ea-895d4469d-cvg9s"
Sep 20 01:06:30.023255 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:30.023213    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bgh6\" (UniqueName: \"kubernetes.io/projected/500e2256-a3b0-49d9-a296-7ce728705875-kube-api-access-6bgh6\") pod \"payload-processing-e2e-shared-a-w2-0766ea-74d47477bc-5fb9v\" (UID: \"500e2256-a3b0-49d9-a296-7ce728705875\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-0766ea-74d47477bc-5fb9v"
Sep 20 01:06:30.023502 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:30.023469    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/500e2256-a3b0-49d9-a296-7ce728705875-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-0766ea-74d47477bc-5fb9v\" (UID: \"500e2256-a3b0-49d9-a296-7ce728705875\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-0766ea-74d47477bc-5fb9v"
Sep 20 01:06:30.023632 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:30.023548    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c88462ad-2257-4514-8971-39e1039481f0-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-0766ea-895d4469d-cvg9s\" (UID: \"c88462ad-2257-4514-8971-39e1039481f0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-0766ea-895d4469d-cvg9s"
Sep 20 01:06:30.125052 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:30.125005    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c88462ad-2257-4514-8971-39e1039481f0-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-0766ea-895d4469d-cvg9s\" (UID: \"c88462ad-2257-4514-8971-39e1039481f0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-0766ea-895d4469d-cvg9s"
Sep 20 01:06:30.125264 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:30.125098    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnr8z\" (UniqueName: \"kubernetes.io/projected/c88462ad-2257-4514-8971-39e1039481f0-kube-api-access-lnr8z\") pod \"payload-pre-processing-e2e-shared-a-w2-0766ea-895d4469d-cvg9s\" (UID: \"c88462ad-2257-4514-8971-39e1039481f0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-0766ea-895d4469d-cvg9s"
Sep 20 01:06:30.125264 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:30.125119    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bgh6\" (UniqueName: \"kubernetes.io/projected/500e2256-a3b0-49d9-a296-7ce728705875-kube-api-access-6bgh6\") pod \"payload-processing-e2e-shared-a-w2-0766ea-74d47477bc-5fb9v\" (UID: \"500e2256-a3b0-49d9-a296-7ce728705875\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-0766ea-74d47477bc-5fb9v"
Sep 20 01:06:30.125264 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:30.125153    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/500e2256-a3b0-49d9-a296-7ce728705875-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-0766ea-74d47477bc-5fb9v\" (UID: \"500e2256-a3b0-49d9-a296-7ce728705875\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-0766ea-74d47477bc-5fb9v"
Sep 20 01:06:30.125739 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:30.125719    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c88462ad-2257-4514-8971-39e1039481f0-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-0766ea-895d4469d-cvg9s\" (UID: \"c88462ad-2257-4514-8971-39e1039481f0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-0766ea-895d4469d-cvg9s"
Sep 20 01:06:30.125798 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:30.125780    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/500e2256-a3b0-49d9-a296-7ce728705875-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-0766ea-74d47477bc-5fb9v\" (UID: \"500e2256-a3b0-49d9-a296-7ce728705875\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-0766ea-74d47477bc-5fb9v"
Sep 20 01:06:30.132834 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:30.132804    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bgh6\" (UniqueName: \"kubernetes.io/projected/500e2256-a3b0-49d9-a296-7ce728705875-kube-api-access-6bgh6\") pod \"payload-processing-e2e-shared-a-w2-0766ea-74d47477bc-5fb9v\" (UID: \"500e2256-a3b0-49d9-a296-7ce728705875\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-0766ea-74d47477bc-5fb9v"
Sep 20 01:06:30.132964 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:30.132804    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnr8z\" (UniqueName: \"kubernetes.io/projected/c88462ad-2257-4514-8971-39e1039481f0-kube-api-access-lnr8z\") pod \"payload-pre-processing-e2e-shared-a-w2-0766ea-895d4469d-cvg9s\" (UID: \"c88462ad-2257-4514-8971-39e1039481f0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-0766ea-895d4469d-cvg9s"
Sep 20 01:06:30.232589 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:30.232482    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-0766ea-895d4469d-cvg9s"
Sep 20 01:06:30.249827 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:30.249802    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-0766ea-74d47477bc-5fb9v"
Sep 20 01:06:30.504673 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:30.504590    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-0766ea-895d4469d-cvg9s"]
Sep 20 01:06:30.507493 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:06:30.507463    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc88462ad_2257_4514_8971_39e1039481f0.slice/crio-4fe843631c6afce3f9fcc6f3a5cc4b35d9167ca091938d2d5c80950cff6be4d9 WatchSource:0}: Error finding container 4fe843631c6afce3f9fcc6f3a5cc4b35d9167ca091938d2d5c80950cff6be4d9: Status 404 returned error can't find the container with id 4fe843631c6afce3f9fcc6f3a5cc4b35d9167ca091938d2d5c80950cff6be4d9
Sep 20 01:06:30.537608 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:30.537587    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-0766ea-74d47477bc-5fb9v"]
Sep 20 01:06:30.543028 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:06:30.543001    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod500e2256_a3b0_49d9_a296_7ce728705875.slice/crio-6f0261a12c4454c5a0a9a4a2d55ac8837a50abb74c99fc5d09688336d6a04fbd WatchSource:0}: Error finding container 6f0261a12c4454c5a0a9a4a2d55ac8837a50abb74c99fc5d09688336d6a04fbd: Status 404 returned error can't find the container with id 6f0261a12c4454c5a0a9a4a2d55ac8837a50abb74c99fc5d09688336d6a04fbd
Sep 20 01:06:31.368051 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:31.368012    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-0766ea-74d47477bc-5fb9v" event={"ID":"500e2256-a3b0-49d9-a296-7ce728705875","Type":"ContainerStarted","Data":"a441477b656c067e68908b3f7d7bd4cc409735f0e96000b802ee439e16ef8c67"}
Sep 20 01:06:31.368534 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:31.368110    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-0766ea-74d47477bc-5fb9v" event={"ID":"500e2256-a3b0-49d9-a296-7ce728705875","Type":"ContainerStarted","Data":"6f0261a12c4454c5a0a9a4a2d55ac8837a50abb74c99fc5d09688336d6a04fbd"}
Sep 20 01:06:31.368534 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:31.368144    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-0766ea-74d47477bc-5fb9v"
Sep 20 01:06:31.369792 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:31.369759    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-0766ea-895d4469d-cvg9s" event={"ID":"c88462ad-2257-4514-8971-39e1039481f0","Type":"ContainerStarted","Data":"3af5d85d5295e12085e822b298b3bd2a5af9bb9d00a77a51ac64baf644224f2d"}
Sep 20 01:06:31.369895 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:31.369805    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-0766ea-895d4469d-cvg9s" event={"ID":"c88462ad-2257-4514-8971-39e1039481f0","Type":"ContainerStarted","Data":"4fe843631c6afce3f9fcc6f3a5cc4b35d9167ca091938d2d5c80950cff6be4d9"}
Sep 20 01:06:31.369895 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:31.369827    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-0766ea-895d4469d-cvg9s"
Sep 20 01:06:31.383524 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:31.383479    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-0766ea-74d47477bc-5fb9v" podStartSLOduration=2.383460451 podStartE2EDuration="2.383460451s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:06:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:06:31.381222855 +0000 UTC m=+1127.995378752" watchObservedRunningTime="2026-09-20 01:06:31.383460451 +0000 UTC m=+1127.997616347"
Sep 20 01:06:31.398969 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:31.398915    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-0766ea-895d4469d-cvg9s" podStartSLOduration=2.398895773 podStartE2EDuration="2.398895773s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:06:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:06:31.395063945 +0000 UTC m=+1128.009219854" watchObservedRunningTime="2026-09-20 01:06:31.398895773 +0000 UTC m=+1128.013051668"
Sep 20 01:06:42.377595 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:42.377564    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-0766ea-74d47477bc-5fb9v"
Sep 20 01:06:42.378119 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:42.377901    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-0766ea-895d4469d-cvg9s"
Sep 20 01:06:54.515637 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:54.515547    2570 generic.go:356] "Generic (PLEG): container finished" podID="f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1" containerID="044e168d52048cc08075d273db38d29e59e6207fcc56c603d39c76411acb77e6" exitCode=0
Sep 20 01:06:54.515637 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:54.515623    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g" event={"ID":"f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1","Type":"ContainerDied","Data":"044e168d52048cc08075d273db38d29e59e6207fcc56c603d39c76411acb77e6"}
Sep 20 01:06:54.516085 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:54.516018    2570 scope.go:117] "RemoveContainer" containerID="044e168d52048cc08075d273db38d29e59e6207fcc56c603d39c76411acb77e6"
Sep 20 01:06:54.517129 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:54.517102    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:06:54.517230 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:54.517181    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:06:54.517294 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:54.517231    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:06:55.332417 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:55.332386    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g"
Sep 20 01:06:55.522919 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:55.522852    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g" event={"ID":"f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1","Type":"ContainerStarted","Data":"02bdf13967271bf8f3acbeca0813ad8f31600f9a159ed069a16f783018ada65a"}
Sep 20 01:06:56.422108 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:56.422021    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g"
Sep 20 01:06:56.423258 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:56.423233    2570 patch_prober.go:28] interesting pod/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 20 01:06:56.423373 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:56.423295    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g" podUID="f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 20 01:06:56.878771 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:56.878735    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb"]
Sep 20 01:06:56.882435 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:56.882411    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb"
Sep 20 01:06:56.884757 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:56.884734    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-b8cbf1-openshift-default-dockercfg-xl42m\""
Sep 20 01:06:56.895228 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:56.895205    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb"]
Sep 20 01:06:56.913645 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:56.913619    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54c03e2d-ff8f-41b0-a090-6c34ed6d034b-workload-certs\") pod \"e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb\" (UID: \"54c03e2d-ff8f-41b0-a090-6c34ed6d034b\") " pod="openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb"
Sep 20 01:06:56.913778 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:56.913659    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54c03e2d-ff8f-41b0-a090-6c34ed6d034b-istio-envoy\") pod \"e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb\" (UID: \"54c03e2d-ff8f-41b0-a090-6c34ed6d034b\") " pod="openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb"
Sep 20 01:06:56.913778 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:56.913701    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dhnr\" (UniqueName: \"kubernetes.io/projected/54c03e2d-ff8f-41b0-a090-6c34ed6d034b-kube-api-access-4dhnr\") pod \"e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb\" (UID: \"54c03e2d-ff8f-41b0-a090-6c34ed6d034b\") " pod="openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb"
Sep 20 01:06:56.913778 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:56.913759    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54c03e2d-ff8f-41b0-a090-6c34ed6d034b-istiod-ca-cert\") pod \"e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb\" (UID: \"54c03e2d-ff8f-41b0-a090-6c34ed6d034b\") " pod="openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb"
Sep 20 01:06:56.913927 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:56.913795    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54c03e2d-ff8f-41b0-a090-6c34ed6d034b-credential-socket\") pod \"e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb\" (UID: \"54c03e2d-ff8f-41b0-a090-6c34ed6d034b\") " pod="openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb"
Sep 20 01:06:56.913968 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:56.913946    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54c03e2d-ff8f-41b0-a090-6c34ed6d034b-istio-token\") pod \"e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb\" (UID: \"54c03e2d-ff8f-41b0-a090-6c34ed6d034b\") " pod="openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb"
Sep 20 01:06:56.914006 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:56.913991    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54c03e2d-ff8f-41b0-a090-6c34ed6d034b-istio-podinfo\") pod \"e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb\" (UID: \"54c03e2d-ff8f-41b0-a090-6c34ed6d034b\") " pod="openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb"
Sep 20 01:06:56.914041 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:56.914020    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54c03e2d-ff8f-41b0-a090-6c34ed6d034b-istio-data\") pod \"e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb\" (UID: \"54c03e2d-ff8f-41b0-a090-6c34ed6d034b\") " pod="openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb"
Sep 20 01:06:56.914078 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:56.914052    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54c03e2d-ff8f-41b0-a090-6c34ed6d034b-workload-socket\") pod \"e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb\" (UID: \"54c03e2d-ff8f-41b0-a090-6c34ed6d034b\") " pod="openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb"
Sep 20 01:06:57.015184 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:57.015142    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54c03e2d-ff8f-41b0-a090-6c34ed6d034b-istio-envoy\") pod \"e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb\" (UID: \"54c03e2d-ff8f-41b0-a090-6c34ed6d034b\") " pod="openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb"
Sep 20 01:06:57.015490 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:57.015226    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dhnr\" (UniqueName: \"kubernetes.io/projected/54c03e2d-ff8f-41b0-a090-6c34ed6d034b-kube-api-access-4dhnr\") pod \"e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb\" (UID: \"54c03e2d-ff8f-41b0-a090-6c34ed6d034b\") " pod="openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb"
Sep 20 01:06:57.015490 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:57.015264    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54c03e2d-ff8f-41b0-a090-6c34ed6d034b-istiod-ca-cert\") pod \"e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb\" (UID: \"54c03e2d-ff8f-41b0-a090-6c34ed6d034b\") " pod="openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb"
Sep 20 01:06:57.015490 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:57.015293    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54c03e2d-ff8f-41b0-a090-6c34ed6d034b-credential-socket\") pod \"e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb\" (UID: \"54c03e2d-ff8f-41b0-a090-6c34ed6d034b\") " pod="openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb"
Sep 20 01:06:57.015490 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:57.015404    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54c03e2d-ff8f-41b0-a090-6c34ed6d034b-istio-token\") pod \"e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb\" (UID: \"54c03e2d-ff8f-41b0-a090-6c34ed6d034b\") " pod="openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb"
Sep 20 01:06:57.015490 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:57.015466    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54c03e2d-ff8f-41b0-a090-6c34ed6d034b-istio-podinfo\") pod \"e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb\" (UID: \"54c03e2d-ff8f-41b0-a090-6c34ed6d034b\") " pod="openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb"
Sep 20 01:06:57.015980 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:57.015500    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54c03e2d-ff8f-41b0-a090-6c34ed6d034b-istio-data\") pod \"e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb\" (UID: \"54c03e2d-ff8f-41b0-a090-6c34ed6d034b\") " pod="openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb"
Sep 20 01:06:57.015980 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:57.015545    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54c03e2d-ff8f-41b0-a090-6c34ed6d034b-workload-socket\") pod \"e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb\" (UID: \"54c03e2d-ff8f-41b0-a090-6c34ed6d034b\") " pod="openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb"
Sep 20 01:06:57.015980 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:57.015576    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54c03e2d-ff8f-41b0-a090-6c34ed6d034b-workload-certs\") pod \"e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb\" (UID: \"54c03e2d-ff8f-41b0-a090-6c34ed6d034b\") " pod="openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb"
Sep 20 01:06:57.016151 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:57.016044    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54c03e2d-ff8f-41b0-a090-6c34ed6d034b-workload-certs\") pod \"e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb\" (UID: \"54c03e2d-ff8f-41b0-a090-6c34ed6d034b\") " pod="openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb"
Sep 20 01:06:57.016151 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:57.016112    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54c03e2d-ff8f-41b0-a090-6c34ed6d034b-credential-socket\") pod \"e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb\" (UID: \"54c03e2d-ff8f-41b0-a090-6c34ed6d034b\") " pod="openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb"
Sep 20 01:06:57.016370 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:57.016325    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54c03e2d-ff8f-41b0-a090-6c34ed6d034b-workload-socket\") pod \"e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb\" (UID: \"54c03e2d-ff8f-41b0-a090-6c34ed6d034b\") " pod="openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb"
Sep 20 01:06:57.016521 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:57.016493    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54c03e2d-ff8f-41b0-a090-6c34ed6d034b-istiod-ca-cert\") pod \"e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb\" (UID: \"54c03e2d-ff8f-41b0-a090-6c34ed6d034b\") " pod="openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb"
Sep 20 01:06:57.016775 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:57.016751    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54c03e2d-ff8f-41b0-a090-6c34ed6d034b-istio-data\") pod \"e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb\" (UID: \"54c03e2d-ff8f-41b0-a090-6c34ed6d034b\") " pod="openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb"
Sep 20 01:06:57.018992 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:57.018969    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54c03e2d-ff8f-41b0-a090-6c34ed6d034b-istio-envoy\") pod \"e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb\" (UID: \"54c03e2d-ff8f-41b0-a090-6c34ed6d034b\") " pod="openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb"
Sep 20 01:06:57.019659 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:57.019639    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54c03e2d-ff8f-41b0-a090-6c34ed6d034b-istio-podinfo\") pod \"e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb\" (UID: \"54c03e2d-ff8f-41b0-a090-6c34ed6d034b\") " pod="openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb"
Sep 20 01:06:57.028497 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:57.028460    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54c03e2d-ff8f-41b0-a090-6c34ed6d034b-istio-token\") pod \"e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb\" (UID: \"54c03e2d-ff8f-41b0-a090-6c34ed6d034b\") " pod="openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb"
Sep 20 01:06:57.029050 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:57.029026    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dhnr\" (UniqueName: \"kubernetes.io/projected/54c03e2d-ff8f-41b0-a090-6c34ed6d034b-kube-api-access-4dhnr\") pod \"e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb\" (UID: \"54c03e2d-ff8f-41b0-a090-6c34ed6d034b\") " pod="openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb"
Sep 20 01:06:57.196720 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:57.196627    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb"
Sep 20 01:06:57.422506 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:57.422469    2570 patch_prober.go:28] interesting pod/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 20 01:06:57.422659 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:57.422532    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g" podUID="f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 20 01:06:57.493623 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:57.493600    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb"]
Sep 20 01:06:57.495670 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:06:57.495642    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54c03e2d_ff8f_41b0_a090_6c34ed6d034b.slice/crio-f0f62d2d281224a3354fb3ab7960223d0f23219f122fee6a37469a9389c89e2c WatchSource:0}: Error finding container f0f62d2d281224a3354fb3ab7960223d0f23219f122fee6a37469a9389c89e2c: Status 404 returned error can't find the container with id f0f62d2d281224a3354fb3ab7960223d0f23219f122fee6a37469a9389c89e2c
Sep 20 01:06:57.498067 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:57.498037    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:06:57.498159 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:57.498102    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:06:57.498159 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:57.498127    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:06:57.544744 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:57.544712    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb" event={"ID":"54c03e2d-ff8f-41b0-a090-6c34ed6d034b","Type":"ContainerStarted","Data":"f0f62d2d281224a3354fb3ab7960223d0f23219f122fee6a37469a9389c89e2c"}
Sep 20 01:06:58.422660 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:58.422621    2570 patch_prober.go:28] interesting pod/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 20 01:06:58.423146 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:58.422681    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g" podUID="f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 20 01:06:58.554835 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:58.554796    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb" event={"ID":"54c03e2d-ff8f-41b0-a090-6c34ed6d034b","Type":"ContainerStarted","Data":"a152fea93eb77a67f831ebd21c443bdd8c1ca17f010acb4d45bd9b8dff4e5217"}
Sep 20 01:06:58.573851 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:58.573791    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb" podStartSLOduration=2.573769989 podStartE2EDuration="2.573769989s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:06:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:06:58.572767879 +0000 UTC m=+1155.186923820" watchObservedRunningTime="2026-09-20 01:06:58.573769989 +0000 UTC m=+1155.187925888"
Sep 20 01:06:59.197026 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:59.196984    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb"
Sep 20 01:06:59.202643 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:59.202609    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb"
Sep 20 01:06:59.422476 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:59.422440    2570 patch_prober.go:28] interesting pod/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 20 01:06:59.422629 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:59.422501    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g" podUID="f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 20 01:06:59.564609 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:59.564519    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb"
Sep 20 01:06:59.567583 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:06:59.567553    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb"
Sep 20 01:07:00.421925 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:00.421851    2570 patch_prober.go:28] interesting pod/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 20 01:07:00.422085 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:00.421950    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g" podUID="f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 20 01:07:01.422813 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:01.422774    2570 patch_prober.go:28] interesting pod/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 20 01:07:01.423239 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:01.422833    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g" podUID="f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 20 01:07:02.427055 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:02.427019    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g"
Sep 20 01:07:02.427431 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:02.427322    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g"
Sep 20 01:07:02.428114 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:02.428098    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g"
Sep 20 01:07:05.145417 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:05.145371    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-b8cbf1-6cc5bf74f9-gfkt2"]
Sep 20 01:07:05.148674 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:05.148651    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-b8cbf1-6cc5bf74f9-gfkt2"
Sep 20 01:07:05.151032 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:05.151005    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-b8cbf1-dockercfg-cwnss\""
Sep 20 01:07:05.151146 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:05.151047    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-b8cbf1\""
Sep 20 01:07:05.159550 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:05.159529    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-b8cbf1-6cc5bf74f9-gfkt2"]
Sep 20 01:07:05.320092 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:05.320055    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84b35e8f-9fc8-41a2-8c58-f1a43d9a22dc-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-b8cbf1-6cc5bf74f9-gfkt2\" (UID: \"84b35e8f-9fc8-41a2-8c58-f1a43d9a22dc\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-b8cbf1-6cc5bf74f9-gfkt2"
Sep 20 01:07:05.320261 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:05.320129    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rw62\" (UniqueName: \"kubernetes.io/projected/84b35e8f-9fc8-41a2-8c58-f1a43d9a22dc-kube-api-access-8rw62\") pod \"payload-processing-e2e-shared-b-w2-b8cbf1-6cc5bf74f9-gfkt2\" (UID: \"84b35e8f-9fc8-41a2-8c58-f1a43d9a22dc\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-b8cbf1-6cc5bf74f9-gfkt2"
Sep 20 01:07:05.421602 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:05.421528    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rw62\" (UniqueName: \"kubernetes.io/projected/84b35e8f-9fc8-41a2-8c58-f1a43d9a22dc-kube-api-access-8rw62\") pod \"payload-processing-e2e-shared-b-w2-b8cbf1-6cc5bf74f9-gfkt2\" (UID: \"84b35e8f-9fc8-41a2-8c58-f1a43d9a22dc\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-b8cbf1-6cc5bf74f9-gfkt2"
Sep 20 01:07:05.421756 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:05.421654    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84b35e8f-9fc8-41a2-8c58-f1a43d9a22dc-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-b8cbf1-6cc5bf74f9-gfkt2\" (UID: \"84b35e8f-9fc8-41a2-8c58-f1a43d9a22dc\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-b8cbf1-6cc5bf74f9-gfkt2"
Sep 20 01:07:05.422405 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:05.422387    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84b35e8f-9fc8-41a2-8c58-f1a43d9a22dc-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-b8cbf1-6cc5bf74f9-gfkt2\" (UID: \"84b35e8f-9fc8-41a2-8c58-f1a43d9a22dc\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-b8cbf1-6cc5bf74f9-gfkt2"
Sep 20 01:07:05.429097 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:05.429074    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rw62\" (UniqueName: \"kubernetes.io/projected/84b35e8f-9fc8-41a2-8c58-f1a43d9a22dc-kube-api-access-8rw62\") pod \"payload-processing-e2e-shared-b-w2-b8cbf1-6cc5bf74f9-gfkt2\" (UID: \"84b35e8f-9fc8-41a2-8c58-f1a43d9a22dc\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-b8cbf1-6cc5bf74f9-gfkt2"
Sep 20 01:07:05.460619 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:05.460588    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-b8cbf1-6cc5bf74f9-gfkt2"
Sep 20 01:07:05.730246 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:05.730216    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-b8cbf1-6cc5bf74f9-gfkt2"]
Sep 20 01:07:05.731974 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:07:05.731944    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84b35e8f_9fc8_41a2_8c58_f1a43d9a22dc.slice/crio-11d9d1dba6db69fba6f9e8c1462aeee0278afb121cee609733bf727adabc8619 WatchSource:0}: Error finding container 11d9d1dba6db69fba6f9e8c1462aeee0278afb121cee609733bf727adabc8619: Status 404 returned error can't find the container with id 11d9d1dba6db69fba6f9e8c1462aeee0278afb121cee609733bf727adabc8619
Sep 20 01:07:06.610369 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:06.610323    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-b8cbf1-6cc5bf74f9-gfkt2" event={"ID":"84b35e8f-9fc8-41a2-8c58-f1a43d9a22dc","Type":"ContainerStarted","Data":"3e617233ad9789535798de647cf19bf36308d10bf89d030cb8128b91dbf67807"}
Sep 20 01:07:06.610824 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:06.610392    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-b8cbf1-6cc5bf74f9-gfkt2" event={"ID":"84b35e8f-9fc8-41a2-8c58-f1a43d9a22dc","Type":"ContainerStarted","Data":"11d9d1dba6db69fba6f9e8c1462aeee0278afb121cee609733bf727adabc8619"}
Sep 20 01:07:06.610824 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:06.610418    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-b8cbf1-6cc5bf74f9-gfkt2"
Sep 20 01:07:06.627350 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:06.627303    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-b8cbf1-6cc5bf74f9-gfkt2" podStartSLOduration=1.627287798 podStartE2EDuration="1.627287798s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:07:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:07:06.625384653 +0000 UTC m=+1163.239540563" watchObservedRunningTime="2026-09-20 01:07:06.627287798 +0000 UTC m=+1163.241443701"
Sep 20 01:07:17.620078 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:17.620044    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-b8cbf1-6cc5bf74f9-gfkt2"
Sep 20 01:07:35.887758 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:35.887716    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-4e301e/e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q"]
Sep 20 01:07:35.890750 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:35.890727    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q"
Sep 20 01:07:35.893220 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:35.893197    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-4e301e\"/\"kube-root-ca.crt\""
Sep 20 01:07:35.893787 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:35.893765    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-4e301e\"/\"openshift-service-ca.crt\""
Sep 20 01:07:35.894158 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:35.894137    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-4e301e\"/\"e2e-conflict-b-d774ddcf-kserve-self-signed-certs\""
Sep 20 01:07:35.894248 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:35.894147    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-4e301e\"/\"default-dockercfg-xmm6m\""
Sep 20 01:07:35.903336 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:35.903311    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-4e301e/e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q"]
Sep 20 01:07:36.058108 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:36.058075    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sq8q9\" (UniqueName: \"kubernetes.io/projected/847da3da-bb69-4fb0-b05f-b351be6e4609-kube-api-access-sq8q9\") pod \"e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q\" (UID: \"847da3da-bb69-4fb0-b05f-b351be6e4609\") " pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q"
Sep 20 01:07:36.058314 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:36.058124    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/847da3da-bb69-4fb0-b05f-b351be6e4609-dshm\") pod \"e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q\" (UID: \"847da3da-bb69-4fb0-b05f-b351be6e4609\") " pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q"
Sep 20 01:07:36.058314 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:36.058200    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/847da3da-bb69-4fb0-b05f-b351be6e4609-home\") pod \"e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q\" (UID: \"847da3da-bb69-4fb0-b05f-b351be6e4609\") " pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q"
Sep 20 01:07:36.058314 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:36.058257    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/847da3da-bb69-4fb0-b05f-b351be6e4609-tmp-dir\") pod \"e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q\" (UID: \"847da3da-bb69-4fb0-b05f-b351be6e4609\") " pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q"
Sep 20 01:07:36.058503 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:36.058324    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/847da3da-bb69-4fb0-b05f-b351be6e4609-model-cache\") pod \"e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q\" (UID: \"847da3da-bb69-4fb0-b05f-b351be6e4609\") " pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q"
Sep 20 01:07:36.058503 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:36.058391    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/847da3da-bb69-4fb0-b05f-b351be6e4609-tls-certs\") pod \"e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q\" (UID: \"847da3da-bb69-4fb0-b05f-b351be6e4609\") " pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q"
Sep 20 01:07:36.159886 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:36.159783    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/847da3da-bb69-4fb0-b05f-b351be6e4609-tls-certs\") pod \"e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q\" (UID: \"847da3da-bb69-4fb0-b05f-b351be6e4609\") " pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q"
Sep 20 01:07:36.160070 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:36.159893    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sq8q9\" (UniqueName: \"kubernetes.io/projected/847da3da-bb69-4fb0-b05f-b351be6e4609-kube-api-access-sq8q9\") pod \"e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q\" (UID: \"847da3da-bb69-4fb0-b05f-b351be6e4609\") " pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q"
Sep 20 01:07:36.160070 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:36.159937    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/847da3da-bb69-4fb0-b05f-b351be6e4609-dshm\") pod \"e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q\" (UID: \"847da3da-bb69-4fb0-b05f-b351be6e4609\") " pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q"
Sep 20 01:07:36.160070 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:36.159976    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/847da3da-bb69-4fb0-b05f-b351be6e4609-home\") pod \"e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q\" (UID: \"847da3da-bb69-4fb0-b05f-b351be6e4609\") " pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q"
Sep 20 01:07:36.160070 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:36.160017    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/847da3da-bb69-4fb0-b05f-b351be6e4609-tmp-dir\") pod \"e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q\" (UID: \"847da3da-bb69-4fb0-b05f-b351be6e4609\") " pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q"
Sep 20 01:07:36.160070 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:36.160052    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/847da3da-bb69-4fb0-b05f-b351be6e4609-model-cache\") pod \"e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q\" (UID: \"847da3da-bb69-4fb0-b05f-b351be6e4609\") " pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q"
Sep 20 01:07:36.160473 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:36.160443    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/847da3da-bb69-4fb0-b05f-b351be6e4609-home\") pod \"e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q\" (UID: \"847da3da-bb69-4fb0-b05f-b351be6e4609\") " pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q"
Sep 20 01:07:36.160787 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:36.160493    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/847da3da-bb69-4fb0-b05f-b351be6e4609-tmp-dir\") pod \"e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q\" (UID: \"847da3da-bb69-4fb0-b05f-b351be6e4609\") " pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q"
Sep 20 01:07:36.160787 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:36.160526    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/847da3da-bb69-4fb0-b05f-b351be6e4609-model-cache\") pod \"e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q\" (UID: \"847da3da-bb69-4fb0-b05f-b351be6e4609\") " pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q"
Sep 20 01:07:36.162437 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:36.162412    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/847da3da-bb69-4fb0-b05f-b351be6e4609-dshm\") pod \"e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q\" (UID: \"847da3da-bb69-4fb0-b05f-b351be6e4609\") " pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q"
Sep 20 01:07:36.162572 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:36.162555    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/847da3da-bb69-4fb0-b05f-b351be6e4609-tls-certs\") pod \"e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q\" (UID: \"847da3da-bb69-4fb0-b05f-b351be6e4609\") " pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q"
Sep 20 01:07:36.167111 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:36.167087    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sq8q9\" (UniqueName: \"kubernetes.io/projected/847da3da-bb69-4fb0-b05f-b351be6e4609-kube-api-access-sq8q9\") pod \"e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q\" (UID: \"847da3da-bb69-4fb0-b05f-b351be6e4609\") " pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q"
Sep 20 01:07:36.208355 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:36.208311    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q"
Sep 20 01:07:36.483462 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:36.483419    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-4e301e/e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q"]
Sep 20 01:07:36.486644 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:07:36.486617    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod847da3da_bb69_4fb0_b05f_b351be6e4609.slice/crio-d71bfee95111dbffedee22dbd8f3858611de9173d341bb59e65d24f0aa00d43b WatchSource:0}: Error finding container d71bfee95111dbffedee22dbd8f3858611de9173d341bb59e65d24f0aa00d43b: Status 404 returned error can't find the container with id d71bfee95111dbffedee22dbd8f3858611de9173d341bb59e65d24f0aa00d43b
Sep 20 01:07:36.824914 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:36.824804    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q" event={"ID":"847da3da-bb69-4fb0-b05f-b351be6e4609","Type":"ContainerStarted","Data":"679d1214469d88a4dd8cca125cc6265658e8abba92e546e00adfe7c841a2be2d"}
Sep 20 01:07:36.824914 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:36.824851    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q" event={"ID":"847da3da-bb69-4fb0-b05f-b351be6e4609","Type":"ContainerStarted","Data":"d71bfee95111dbffedee22dbd8f3858611de9173d341bb59e65d24f0aa00d43b"}
Sep 20 01:07:36.826449 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:36.826426    2570 generic.go:356] "Generic (PLEG): container finished" podID="54c03e2d-ff8f-41b0-a090-6c34ed6d034b" containerID="a152fea93eb77a67f831ebd21c443bdd8c1ca17f010acb4d45bd9b8dff4e5217" exitCode=0
Sep 20 01:07:36.826568 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:36.826502    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb" event={"ID":"54c03e2d-ff8f-41b0-a090-6c34ed6d034b","Type":"ContainerDied","Data":"a152fea93eb77a67f831ebd21c443bdd8c1ca17f010acb4d45bd9b8dff4e5217"}
Sep 20 01:07:36.826904 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:36.826888    2570 scope.go:117] "RemoveContainer" containerID="a152fea93eb77a67f831ebd21c443bdd8c1ca17f010acb4d45bd9b8dff4e5217"
Sep 20 01:07:36.828260 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:36.828236    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:07:36.828345 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:36.828301    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:07:36.828345 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:36.828332    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:07:36.839598 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:36.839505    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q" podStartSLOduration=1.8394860469999998 podStartE2EDuration="1.839486047s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:07:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:07:36.839032364 +0000 UTC m=+1193.453188270" watchObservedRunningTime="2026-09-20 01:07:36.839486047 +0000 UTC m=+1193.453641945"
Sep 20 01:07:37.833940 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:37.833897    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb" event={"ID":"54c03e2d-ff8f-41b0-a090-6c34ed6d034b","Type":"ContainerStarted","Data":"a096e5b7c6c97e2845bae3111b1e7cd939aeb5722e544996bfdcf28b0dc56947"}
Sep 20 01:07:38.197028 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:38.196993    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb"
Sep 20 01:07:38.197259 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:38.197237    2570 patch_prober.go:28] interesting pod/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 20 01:07:38.197309 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:38.197291    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb" podUID="54c03e2d-ff8f-41b0-a090-6c34ed6d034b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 20 01:07:38.724087 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:38.723978    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-2fd525-788df86f6f-fvf2s"]
Sep 20 01:07:38.724286 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:38.724213    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-2fd525-788df86f6f-fvf2s" podUID="4970e83f-b770-4bef-a595-f95674094c5b" containerName="payload-processing" containerID="cri-o://e2386244598108dcb7a387f320921031d769ef4b4be426f79353cb8a8d939a72" gracePeriod=30
Sep 20 01:07:38.843698 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:38.843671    2570 generic.go:356] "Generic (PLEG): container finished" podID="4970e83f-b770-4bef-a595-f95674094c5b" containerID="e2386244598108dcb7a387f320921031d769ef4b4be426f79353cb8a8d939a72" exitCode=0
Sep 20 01:07:38.844060 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:38.843751    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-2fd525-788df86f6f-fvf2s" event={"ID":"4970e83f-b770-4bef-a595-f95674094c5b","Type":"ContainerDied","Data":"e2386244598108dcb7a387f320921031d769ef4b4be426f79353cb8a8d939a72"}
Sep 20 01:07:39.019113 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:39.019087    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-2fd525-788df86f6f-fvf2s"
Sep 20 01:07:39.197438 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:39.197393    2570 patch_prober.go:28] interesting pod/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 20 01:07:39.197630 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:39.197471    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb" podUID="54c03e2d-ff8f-41b0-a090-6c34ed6d034b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 20 01:07:39.197704 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:39.197682    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4970e83f-b770-4bef-a595-f95674094c5b-plugins-config-volume\") pod \"4970e83f-b770-4bef-a595-f95674094c5b\" (UID: \"4970e83f-b770-4bef-a595-f95674094c5b\") "
Sep 20 01:07:39.197783 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:39.197769    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ktbd6\" (UniqueName: \"kubernetes.io/projected/4970e83f-b770-4bef-a595-f95674094c5b-kube-api-access-ktbd6\") pod \"4970e83f-b770-4bef-a595-f95674094c5b\" (UID: \"4970e83f-b770-4bef-a595-f95674094c5b\") "
Sep 20 01:07:39.198143 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:39.198119    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4970e83f-b770-4bef-a595-f95674094c5b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4970e83f-b770-4bef-a595-f95674094c5b" (UID: "4970e83f-b770-4bef-a595-f95674094c5b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:07:39.198212 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:39.198196    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4970e83f-b770-4bef-a595-f95674094c5b-plugins-config-volume\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:07:39.200061 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:39.200043    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4970e83f-b770-4bef-a595-f95674094c5b-kube-api-access-ktbd6" (OuterVolumeSpecName: "kube-api-access-ktbd6") pod "4970e83f-b770-4bef-a595-f95674094c5b" (UID: "4970e83f-b770-4bef-a595-f95674094c5b"). InnerVolumeSpecName "kube-api-access-ktbd6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:07:39.299301 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:39.299217    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ktbd6\" (UniqueName: \"kubernetes.io/projected/4970e83f-b770-4bef-a595-f95674094c5b-kube-api-access-ktbd6\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:07:39.854004 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:39.853963    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-2fd525-788df86f6f-fvf2s" event={"ID":"4970e83f-b770-4bef-a595-f95674094c5b","Type":"ContainerDied","Data":"00473addf354a86280e0c60ed70953819b83baf3cf8e2aa703a435a8edbbc3b9"}
Sep 20 01:07:39.854511 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:39.854041    2570 scope.go:117] "RemoveContainer" containerID="e2386244598108dcb7a387f320921031d769ef4b4be426f79353cb8a8d939a72"
Sep 20 01:07:39.854511 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:39.854216    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-2fd525-788df86f6f-fvf2s"
Sep 20 01:07:39.876760 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:39.876725    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-2fd525-788df86f6f-fvf2s"]
Sep 20 01:07:39.880148 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:39.880120    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-2fd525-788df86f6f-fvf2s"]
Sep 20 01:07:40.197673 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:40.197642    2570 patch_prober.go:28] interesting pod/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 20 01:07:40.197884 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:40.197704    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb" podUID="54c03e2d-ff8f-41b0-a090-6c34ed6d034b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 20 01:07:40.238313 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:40.238250    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv"]
Sep 20 01:07:40.239004 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:40.238984    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4970e83f-b770-4bef-a595-f95674094c5b" containerName="payload-processing"
Sep 20 01:07:40.239004 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:40.239004    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="4970e83f-b770-4bef-a595-f95674094c5b" containerName="payload-processing"
Sep 20 01:07:40.239159 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:40.239122    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="4970e83f-b770-4bef-a595-f95674094c5b" containerName="payload-processing"
Sep 20 01:07:40.242348 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:40.242327    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv"
Sep 20 01:07:40.244521 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:40.244499    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-8b864c4f-openshift-default-dockercfg-qnrwj\""
Sep 20 01:07:40.260099 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:40.260070    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv"]
Sep 20 01:07:40.414447 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:40.414417    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee807025-2862-456d-bed4-4f0a48b04cd4-istio-token\") pod \"e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv\" (UID: \"ee807025-2862-456d-bed4-4f0a48b04cd4\") " pod="openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv"
Sep 20 01:07:40.414661 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:40.414645    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee807025-2862-456d-bed4-4f0a48b04cd4-workload-socket\") pod \"e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv\" (UID: \"ee807025-2862-456d-bed4-4f0a48b04cd4\") " pod="openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv"
Sep 20 01:07:40.414739 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:40.414730    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee807025-2862-456d-bed4-4f0a48b04cd4-istio-podinfo\") pod \"e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv\" (UID: \"ee807025-2862-456d-bed4-4f0a48b04cd4\") " pod="openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv"
Sep 20 01:07:40.414828 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:40.414820    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee807025-2862-456d-bed4-4f0a48b04cd4-istio-envoy\") pod \"e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv\" (UID: \"ee807025-2862-456d-bed4-4f0a48b04cd4\") " pod="openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv"
Sep 20 01:07:40.415043 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:40.415023    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee807025-2862-456d-bed4-4f0a48b04cd4-istiod-ca-cert\") pod \"e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv\" (UID: \"ee807025-2862-456d-bed4-4f0a48b04cd4\") " pod="openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv"
Sep 20 01:07:40.415143 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:40.415089    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee807025-2862-456d-bed4-4f0a48b04cd4-workload-certs\") pod \"e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv\" (UID: \"ee807025-2862-456d-bed4-4f0a48b04cd4\") " pod="openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv"
Sep 20 01:07:40.415143 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:40.415136    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee807025-2862-456d-bed4-4f0a48b04cd4-istio-data\") pod \"e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv\" (UID: \"ee807025-2862-456d-bed4-4f0a48b04cd4\") " pod="openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv"
Sep 20 01:07:40.415252 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:40.415210    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee807025-2862-456d-bed4-4f0a48b04cd4-credential-socket\") pod \"e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv\" (UID: \"ee807025-2862-456d-bed4-4f0a48b04cd4\") " pod="openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv"
Sep 20 01:07:40.415311 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:40.415292    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtzqz\" (UniqueName: \"kubernetes.io/projected/ee807025-2862-456d-bed4-4f0a48b04cd4-kube-api-access-dtzqz\") pod \"e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv\" (UID: \"ee807025-2862-456d-bed4-4f0a48b04cd4\") " pod="openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv"
Sep 20 01:07:40.516210 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:40.516112    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtzqz\" (UniqueName: \"kubernetes.io/projected/ee807025-2862-456d-bed4-4f0a48b04cd4-kube-api-access-dtzqz\") pod \"e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv\" (UID: \"ee807025-2862-456d-bed4-4f0a48b04cd4\") " pod="openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv"
Sep 20 01:07:40.516210 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:40.516160    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee807025-2862-456d-bed4-4f0a48b04cd4-istio-token\") pod \"e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv\" (UID: \"ee807025-2862-456d-bed4-4f0a48b04cd4\") " pod="openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv"
Sep 20 01:07:40.516210 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:40.516181    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee807025-2862-456d-bed4-4f0a48b04cd4-workload-socket\") pod \"e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv\" (UID: \"ee807025-2862-456d-bed4-4f0a48b04cd4\") " pod="openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv"
Sep 20 01:07:40.516539 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:40.516295    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee807025-2862-456d-bed4-4f0a48b04cd4-istio-podinfo\") pod \"e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv\" (UID: \"ee807025-2862-456d-bed4-4f0a48b04cd4\") " pod="openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv"
Sep 20 01:07:40.516539 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:40.516367    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee807025-2862-456d-bed4-4f0a48b04cd4-istio-envoy\") pod \"e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv\" (UID: \"ee807025-2862-456d-bed4-4f0a48b04cd4\") " pod="openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv"
Sep 20 01:07:40.516539 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:40.516413    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee807025-2862-456d-bed4-4f0a48b04cd4-istiod-ca-cert\") pod \"e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv\" (UID: \"ee807025-2862-456d-bed4-4f0a48b04cd4\") " pod="openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv"
Sep 20 01:07:40.516539 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:40.516462    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee807025-2862-456d-bed4-4f0a48b04cd4-workload-certs\") pod \"e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv\" (UID: \"ee807025-2862-456d-bed4-4f0a48b04cd4\") " pod="openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv"
Sep 20 01:07:40.516539 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:40.516487    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee807025-2862-456d-bed4-4f0a48b04cd4-workload-socket\") pod \"e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv\" (UID: \"ee807025-2862-456d-bed4-4f0a48b04cd4\") " pod="openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv"
Sep 20 01:07:40.516747 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:40.516550    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee807025-2862-456d-bed4-4f0a48b04cd4-istio-data\") pod \"e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv\" (UID: \"ee807025-2862-456d-bed4-4f0a48b04cd4\") " pod="openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv"
Sep 20 01:07:40.516747 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:40.516619    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee807025-2862-456d-bed4-4f0a48b04cd4-credential-socket\") pod \"e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv\" (UID: \"ee807025-2862-456d-bed4-4f0a48b04cd4\") " pod="openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv"
Sep 20 01:07:40.516846 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:40.516768    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee807025-2862-456d-bed4-4f0a48b04cd4-workload-certs\") pod \"e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv\" (UID: \"ee807025-2862-456d-bed4-4f0a48b04cd4\") " pod="openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv"
Sep 20 01:07:40.517045 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:40.517024    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee807025-2862-456d-bed4-4f0a48b04cd4-credential-socket\") pod \"e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv\" (UID: \"ee807025-2862-456d-bed4-4f0a48b04cd4\") " pod="openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv"
Sep 20 01:07:40.517126 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:40.517108    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee807025-2862-456d-bed4-4f0a48b04cd4-istiod-ca-cert\") pod \"e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv\" (UID: \"ee807025-2862-456d-bed4-4f0a48b04cd4\") " pod="openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv"
Sep 20 01:07:40.517272 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:40.517237    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee807025-2862-456d-bed4-4f0a48b04cd4-istio-data\") pod \"e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv\" (UID: \"ee807025-2862-456d-bed4-4f0a48b04cd4\") " pod="openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv"
Sep 20 01:07:40.518770 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:40.518747    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee807025-2862-456d-bed4-4f0a48b04cd4-istio-envoy\") pod \"e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv\" (UID: \"ee807025-2862-456d-bed4-4f0a48b04cd4\") " pod="openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv"
Sep 20 01:07:40.519020 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:40.519003    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee807025-2862-456d-bed4-4f0a48b04cd4-istio-podinfo\") pod \"e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv\" (UID: \"ee807025-2862-456d-bed4-4f0a48b04cd4\") " pod="openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv"
Sep 20 01:07:40.524111 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:40.524084    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtzqz\" (UniqueName: \"kubernetes.io/projected/ee807025-2862-456d-bed4-4f0a48b04cd4-kube-api-access-dtzqz\") pod \"e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv\" (UID: \"ee807025-2862-456d-bed4-4f0a48b04cd4\") " pod="openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv"
Sep 20 01:07:40.524211 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:40.524149    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee807025-2862-456d-bed4-4f0a48b04cd4-istio-token\") pod \"e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv\" (UID: \"ee807025-2862-456d-bed4-4f0a48b04cd4\") " pod="openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv"
Sep 20 01:07:40.574216 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:40.574177    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv"
Sep 20 01:07:40.859519 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:40.856150    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv"]
Sep 20 01:07:40.867779 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:40.867725    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:07:40.867926 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:40.867817    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:07:40.867926 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:40.867881    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:07:41.197456 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:41.197424    2570 patch_prober.go:28] interesting pod/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 20 01:07:41.197641 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:41.197499    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb" podUID="54c03e2d-ff8f-41b0-a090-6c34ed6d034b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 20 01:07:41.460294 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:41.460198    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4970e83f-b770-4bef-a595-f95674094c5b" path="/var/lib/kubelet/pods/4970e83f-b770-4bef-a595-f95674094c5b/volumes"
Sep 20 01:07:41.879746 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:41.879705    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv" event={"ID":"ee807025-2862-456d-bed4-4f0a48b04cd4","Type":"ContainerStarted","Data":"73c2f9e23da24cfebfaf500d0e824168a21c84915d574e81517ca2818248cfd3"}
Sep 20 01:07:41.880203 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:41.879761    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv" event={"ID":"ee807025-2862-456d-bed4-4f0a48b04cd4","Type":"ContainerStarted","Data":"f0eae557239cf2464eafbf73c54a88c0ddba9644d2c081ef03abb4ecc6b1c045"}
Sep 20 01:07:41.899574 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:41.899515    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv" podStartSLOduration=1.8994971189999998 podStartE2EDuration="1.899497119s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:07:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:07:41.897389463 +0000 UTC m=+1198.511545415" watchObservedRunningTime="2026-09-20 01:07:41.899497119 +0000 UTC m=+1198.513653015"
Sep 20 01:07:42.197232 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:42.197146    2570 patch_prober.go:28] interesting pod/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 20 01:07:42.197232 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:42.197211    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb" podUID="54c03e2d-ff8f-41b0-a090-6c34ed6d034b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 20 01:07:42.577584 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:42.577494    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv"
Sep 20 01:07:42.585981 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:42.585933    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv"
Sep 20 01:07:42.888995 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:42.888960    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv"
Sep 20 01:07:42.889950 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:42.889927    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv"
Sep 20 01:07:43.201926 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:43.201836    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb"
Sep 20 01:07:43.202161 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:43.202142    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb"
Sep 20 01:07:43.202912 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:43.202896    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb"
Sep 20 01:07:45.493424 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:45.493389    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65l6f_bf898d8f-ed0f-4b4e-9a87-8e6167b29481/ovn-acl-logging/0.log"
Sep 20 01:07:45.496940 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:45.496920    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65l6f_bf898d8f-ed0f-4b4e-9a87-8e6167b29481/ovn-acl-logging/0.log"
Sep 20 01:07:45.600877 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:45.600834    2570 scope.go:117] "RemoveContainer" containerID="93a7b9351221c54ef2e6e2ea96feeb677705991f773271dda927bbd09ae82204"
Sep 20 01:07:46.209444 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:46.209411    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q"
Sep 20 01:07:46.209697 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:46.209679    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q"
Sep 20 01:07:46.221967 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:46.221941    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q"
Sep 20 01:07:46.926957 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:46.926931    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q"
Sep 20 01:07:48.368915 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:48.368853    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-8b864c4f-b785877c4-9tkpk"]
Sep 20 01:07:48.372722 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:48.372698    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-8b864c4f-b785877c4-9tkpk"
Sep 20 01:07:48.374629 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:48.374604    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-8b864c4f\""
Sep 20 01:07:48.374743 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:48.374722    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-8b864c4f-dockercfg-smxvc\""
Sep 20 01:07:48.378946 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:48.378920    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-8b864c4f-b785877c4-9tkpk"]
Sep 20 01:07:48.396211 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:48.396179    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b114fffb-f20a-4896-9269-a9f33f7f50d1-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-8b864c4f-b785877c4-9tkpk\" (UID: \"b114fffb-f20a-4896-9269-a9f33f7f50d1\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-8b864c4f-b785877c4-9tkpk"
Sep 20 01:07:48.396493 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:48.396466    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w28zh\" (UniqueName: \"kubernetes.io/projected/b114fffb-f20a-4896-9269-a9f33f7f50d1-kube-api-access-w28zh\") pod \"payload-pre-processing-e2e-mt-8b864c4f-b785877c4-9tkpk\" (UID: \"b114fffb-f20a-4896-9269-a9f33f7f50d1\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-8b864c4f-b785877c4-9tkpk"
Sep 20 01:07:48.498032 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:48.498001    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b114fffb-f20a-4896-9269-a9f33f7f50d1-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-8b864c4f-b785877c4-9tkpk\" (UID: \"b114fffb-f20a-4896-9269-a9f33f7f50d1\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-8b864c4f-b785877c4-9tkpk"
Sep 20 01:07:48.498201 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:48.498044    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w28zh\" (UniqueName: \"kubernetes.io/projected/b114fffb-f20a-4896-9269-a9f33f7f50d1-kube-api-access-w28zh\") pod \"payload-pre-processing-e2e-mt-8b864c4f-b785877c4-9tkpk\" (UID: \"b114fffb-f20a-4896-9269-a9f33f7f50d1\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-8b864c4f-b785877c4-9tkpk"
Sep 20 01:07:48.498665 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:48.498646    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b114fffb-f20a-4896-9269-a9f33f7f50d1-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-8b864c4f-b785877c4-9tkpk\" (UID: \"b114fffb-f20a-4896-9269-a9f33f7f50d1\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-8b864c4f-b785877c4-9tkpk"
Sep 20 01:07:48.505483 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:48.505464    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w28zh\" (UniqueName: \"kubernetes.io/projected/b114fffb-f20a-4896-9269-a9f33f7f50d1-kube-api-access-w28zh\") pod \"payload-pre-processing-e2e-mt-8b864c4f-b785877c4-9tkpk\" (UID: \"b114fffb-f20a-4896-9269-a9f33f7f50d1\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-8b864c4f-b785877c4-9tkpk"
Sep 20 01:07:48.685767 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:48.685683    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-8b864c4f-b785877c4-9tkpk"
Sep 20 01:07:48.957610 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:48.957535    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-8b864c4f-b785877c4-9tkpk"]
Sep 20 01:07:48.960280 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:07:48.960252    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb114fffb_f20a_4896_9269_a9f33f7f50d1.slice/crio-d39c0405e60693633b61e09dd16b8b1d061ed44d4b76980cd303f95f30c0ab90 WatchSource:0}: Error finding container d39c0405e60693633b61e09dd16b8b1d061ed44d4b76980cd303f95f30c0ab90: Status 404 returned error can't find the container with id d39c0405e60693633b61e09dd16b8b1d061ed44d4b76980cd303f95f30c0ab90
Sep 20 01:07:49.934580 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:49.934528    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-8b864c4f-b785877c4-9tkpk" event={"ID":"b114fffb-f20a-4896-9269-a9f33f7f50d1","Type":"ContainerStarted","Data":"03d7b370140017dd5cb18ed040f303391fee49ae183e064e5d646ab7b9ec0d31"}
Sep 20 01:07:49.934998 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:49.934601    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-8b864c4f-b785877c4-9tkpk" event={"ID":"b114fffb-f20a-4896-9269-a9f33f7f50d1","Type":"ContainerStarted","Data":"d39c0405e60693633b61e09dd16b8b1d061ed44d4b76980cd303f95f30c0ab90"}
Sep 20 01:07:49.934998 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:49.934749    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-8b864c4f-b785877c4-9tkpk"
Sep 20 01:07:49.950109 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:49.950055    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-8b864c4f-b785877c4-9tkpk" podStartSLOduration=1.950038629 podStartE2EDuration="1.950038629s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:07:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:07:49.947799534 +0000 UTC m=+1206.561955447" watchObservedRunningTime="2026-09-20 01:07:49.950038629 +0000 UTC m=+1206.564194527"
Sep 20 01:07:54.858353 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:54.858318    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5"]
Sep 20 01:07:54.858743 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:54.858576    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5" podUID="a54c8c28-2e32-42c5-9c96-daccd7c5ec18" containerName="istio-proxy" containerID="cri-o://9c82ffc260ea698ec0f246320d9672cfc7f5eea95497073c24d51994cfe4e616" gracePeriod=30
Sep 20 01:07:57.159102 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:57.159062    2570 patch_prober.go:28] interesting pod/e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 20 01:07:57.159528 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:07:57.159130    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5" podUID="a54c8c28-2e32-42c5-9c96-daccd7c5ec18" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 20 01:08:00.004318 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:00.004286    2570 generic.go:356] "Generic (PLEG): container finished" podID="a54c8c28-2e32-42c5-9c96-daccd7c5ec18" containerID="9c82ffc260ea698ec0f246320d9672cfc7f5eea95497073c24d51994cfe4e616" exitCode=0
Sep 20 01:08:00.004684 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:00.004375    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5" event={"ID":"a54c8c28-2e32-42c5-9c96-daccd7c5ec18","Type":"ContainerDied","Data":"9c82ffc260ea698ec0f246320d9672cfc7f5eea95497073c24d51994cfe4e616"}
Sep 20 01:08:00.121284 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:00.121220    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5"
Sep 20 01:08:00.228073 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:00.228040    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ns2lj\" (UniqueName: \"kubernetes.io/projected/a54c8c28-2e32-42c5-9c96-daccd7c5ec18-kube-api-access-ns2lj\") pod \"a54c8c28-2e32-42c5-9c96-daccd7c5ec18\" (UID: \"a54c8c28-2e32-42c5-9c96-daccd7c5ec18\") "
Sep 20 01:08:00.228259 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:00.228091    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a54c8c28-2e32-42c5-9c96-daccd7c5ec18-istio-envoy\") pod \"a54c8c28-2e32-42c5-9c96-daccd7c5ec18\" (UID: \"a54c8c28-2e32-42c5-9c96-daccd7c5ec18\") "
Sep 20 01:08:00.228259 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:00.228137    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a54c8c28-2e32-42c5-9c96-daccd7c5ec18-istio-data\") pod \"a54c8c28-2e32-42c5-9c96-daccd7c5ec18\" (UID: \"a54c8c28-2e32-42c5-9c96-daccd7c5ec18\") "
Sep 20 01:08:00.228259 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:00.228200    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a54c8c28-2e32-42c5-9c96-daccd7c5ec18-workload-socket\") pod \"a54c8c28-2e32-42c5-9c96-daccd7c5ec18\" (UID: \"a54c8c28-2e32-42c5-9c96-daccd7c5ec18\") "
Sep 20 01:08:00.228259 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:00.228249    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a54c8c28-2e32-42c5-9c96-daccd7c5ec18-workload-certs\") pod \"a54c8c28-2e32-42c5-9c96-daccd7c5ec18\" (UID: \"a54c8c28-2e32-42c5-9c96-daccd7c5ec18\") "
Sep 20 01:08:00.228480 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:00.228276    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a54c8c28-2e32-42c5-9c96-daccd7c5ec18-istiod-ca-cert\") pod \"a54c8c28-2e32-42c5-9c96-daccd7c5ec18\" (UID: \"a54c8c28-2e32-42c5-9c96-daccd7c5ec18\") "
Sep 20 01:08:00.228480 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:00.228319    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a54c8c28-2e32-42c5-9c96-daccd7c5ec18-istio-podinfo\") pod \"a54c8c28-2e32-42c5-9c96-daccd7c5ec18\" (UID: \"a54c8c28-2e32-42c5-9c96-daccd7c5ec18\") "
Sep 20 01:08:00.228480 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:00.228347    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a54c8c28-2e32-42c5-9c96-daccd7c5ec18-istio-token\") pod \"a54c8c28-2e32-42c5-9c96-daccd7c5ec18\" (UID: \"a54c8c28-2e32-42c5-9c96-daccd7c5ec18\") "
Sep 20 01:08:00.228480 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:00.228386    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a54c8c28-2e32-42c5-9c96-daccd7c5ec18-credential-socket\") pod \"a54c8c28-2e32-42c5-9c96-daccd7c5ec18\" (UID: \"a54c8c28-2e32-42c5-9c96-daccd7c5ec18\") "
Sep 20 01:08:00.228683 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:00.228499    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a54c8c28-2e32-42c5-9c96-daccd7c5ec18-istio-data" (OuterVolumeSpecName: "istio-data") pod "a54c8c28-2e32-42c5-9c96-daccd7c5ec18" (UID: "a54c8c28-2e32-42c5-9c96-daccd7c5ec18"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:08:00.228683 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:00.228580    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a54c8c28-2e32-42c5-9c96-daccd7c5ec18-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a54c8c28-2e32-42c5-9c96-daccd7c5ec18" (UID: "a54c8c28-2e32-42c5-9c96-daccd7c5ec18"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:08:00.228817 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:00.228791    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a54c8c28-2e32-42c5-9c96-daccd7c5ec18-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a54c8c28-2e32-42c5-9c96-daccd7c5ec18" (UID: "a54c8c28-2e32-42c5-9c96-daccd7c5ec18"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:08:00.228895 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:00.228812    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a54c8c28-2e32-42c5-9c96-daccd7c5ec18-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a54c8c28-2e32-42c5-9c96-daccd7c5ec18" (UID: "a54c8c28-2e32-42c5-9c96-daccd7c5ec18"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:08:00.229095 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:00.229028    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a54c8c28-2e32-42c5-9c96-daccd7c5ec18-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a54c8c28-2e32-42c5-9c96-daccd7c5ec18" (UID: "a54c8c28-2e32-42c5-9c96-daccd7c5ec18"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:08:00.229095 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:00.229093    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a54c8c28-2e32-42c5-9c96-daccd7c5ec18-istio-data\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:08:00.229440 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:00.229110    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a54c8c28-2e32-42c5-9c96-daccd7c5ec18-workload-socket\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:08:00.229440 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:00.229126    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a54c8c28-2e32-42c5-9c96-daccd7c5ec18-workload-certs\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:08:00.229440 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:00.229139    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a54c8c28-2e32-42c5-9c96-daccd7c5ec18-credential-socket\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:08:00.230683 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:00.230656    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a54c8c28-2e32-42c5-9c96-daccd7c5ec18-kube-api-access-ns2lj" (OuterVolumeSpecName: "kube-api-access-ns2lj") pod "a54c8c28-2e32-42c5-9c96-daccd7c5ec18" (UID: "a54c8c28-2e32-42c5-9c96-daccd7c5ec18"). InnerVolumeSpecName "kube-api-access-ns2lj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:08:00.230683 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:00.230671    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a54c8c28-2e32-42c5-9c96-daccd7c5ec18-istio-token" (OuterVolumeSpecName: "istio-token") pod "a54c8c28-2e32-42c5-9c96-daccd7c5ec18" (UID: "a54c8c28-2e32-42c5-9c96-daccd7c5ec18"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:08:00.230834 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:00.230682    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a54c8c28-2e32-42c5-9c96-daccd7c5ec18-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a54c8c28-2e32-42c5-9c96-daccd7c5ec18" (UID: "a54c8c28-2e32-42c5-9c96-daccd7c5ec18"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:08:00.230912 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:00.230834    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a54c8c28-2e32-42c5-9c96-daccd7c5ec18-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a54c8c28-2e32-42c5-9c96-daccd7c5ec18" (UID: "a54c8c28-2e32-42c5-9c96-daccd7c5ec18"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 20 01:08:00.330180 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:00.330142    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a54c8c28-2e32-42c5-9c96-daccd7c5ec18-istio-envoy\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:08:00.330180 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:00.330175    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a54c8c28-2e32-42c5-9c96-daccd7c5ec18-istiod-ca-cert\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:08:00.330180 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:00.330185    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a54c8c28-2e32-42c5-9c96-daccd7c5ec18-istio-podinfo\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:08:00.330418 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:00.330193    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a54c8c28-2e32-42c5-9c96-daccd7c5ec18-istio-token\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:08:00.330418 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:00.330203    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ns2lj\" (UniqueName: \"kubernetes.io/projected/a54c8c28-2e32-42c5-9c96-daccd7c5ec18-kube-api-access-ns2lj\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:08:00.942451 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:00.942413    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-8b864c4f-b785877c4-9tkpk"
Sep 20 01:08:01.014139 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:01.014107    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5"
Sep 20 01:08:01.014566 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:01.014112    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5" event={"ID":"a54c8c28-2e32-42c5-9c96-daccd7c5ec18","Type":"ContainerDied","Data":"c7e7625200300a662b499247fd6b210748e7a3bd2e4b10d1ffbbfff1eae57415"}
Sep 20 01:08:01.014566 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:01.014287    2570 scope.go:117] "RemoveContainer" containerID="9c82ffc260ea698ec0f246320d9672cfc7f5eea95497073c24d51994cfe4e616"
Sep 20 01:08:01.040696 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:01.040643    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5"]
Sep 20 01:08:01.046998 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:01.046966    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-106d40-openshift-default-7f7c5c78c4-446d5"]
Sep 20 01:08:01.455520 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:01.455485    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a54c8c28-2e32-42c5-9c96-daccd7c5ec18" path="/var/lib/kubelet/pods/a54c8c28-2e32-42c5-9c96-daccd7c5ec18/volumes"
Sep 20 01:08:21.148269 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:21.148185    2570 generic.go:356] "Generic (PLEG): container finished" podID="ee807025-2862-456d-bed4-4f0a48b04cd4" containerID="73c2f9e23da24cfebfaf500d0e824168a21c84915d574e81517ca2818248cfd3" exitCode=0
Sep 20 01:08:21.148657 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:21.148260    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv" event={"ID":"ee807025-2862-456d-bed4-4f0a48b04cd4","Type":"ContainerDied","Data":"73c2f9e23da24cfebfaf500d0e824168a21c84915d574e81517ca2818248cfd3"}
Sep 20 01:08:21.148716 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:21.148701    2570 scope.go:117] "RemoveContainer" containerID="73c2f9e23da24cfebfaf500d0e824168a21c84915d574e81517ca2818248cfd3"
Sep 20 01:08:21.149917 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:21.149886    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:08:21.149980 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:21.149958    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:08:21.150016 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:21.149988    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:08:21.527620 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:21.527531    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl"]
Sep 20 01:08:21.528093 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:21.528047    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl" podUID="008e3f25-a8f0-42f0-a09e-3e4166749faa" containerName="istio-proxy" containerID="cri-o://eceb9b8c29f28bfed823f967e4fd1a9e6c085135350535dd7466c6745cac5551" gracePeriod=30
Sep 20 01:08:22.161130 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:22.161087    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv" event={"ID":"ee807025-2862-456d-bed4-4f0a48b04cd4","Type":"ContainerStarted","Data":"a3810421f72a298881a0ba2efd160eb60068bfbe8474a55a200670d651a5b919"}
Sep 20 01:08:22.574991 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:22.574906    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv"
Sep 20 01:08:22.575182 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:22.575159    2570 patch_prober.go:28] interesting pod/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 20 01:08:22.575234 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:22.575215    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv" podUID="ee807025-2862-456d-bed4-4f0a48b04cd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 20 01:08:23.575606 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:23.575555    2570 patch_prober.go:28] interesting pod/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 20 01:08:23.576046 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:23.575633    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv" podUID="ee807025-2862-456d-bed4-4f0a48b04cd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 20 01:08:24.574621 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:24.574579    2570 patch_prober.go:28] interesting pod/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 20 01:08:24.574808 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:24.574659    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv" podUID="ee807025-2862-456d-bed4-4f0a48b04cd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 20 01:08:25.574788 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:25.574747    2570 patch_prober.go:28] interesting pod/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 20 01:08:25.575233 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:25.574823    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv" podUID="ee807025-2862-456d-bed4-4f0a48b04cd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 20 01:08:26.575421 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:26.575382    2570 patch_prober.go:28] interesting pod/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 20 01:08:26.575913 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:26.575459    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv" podUID="ee807025-2862-456d-bed4-4f0a48b04cd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 20 01:08:26.837210 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:26.837182    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl"
Sep 20 01:08:26.921763 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:26.921729    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xm255\" (UniqueName: \"kubernetes.io/projected/008e3f25-a8f0-42f0-a09e-3e4166749faa-kube-api-access-xm255\") pod \"008e3f25-a8f0-42f0-a09e-3e4166749faa\" (UID: \"008e3f25-a8f0-42f0-a09e-3e4166749faa\") "
Sep 20 01:08:26.921952 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:26.921784    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/008e3f25-a8f0-42f0-a09e-3e4166749faa-workload-socket\") pod \"008e3f25-a8f0-42f0-a09e-3e4166749faa\" (UID: \"008e3f25-a8f0-42f0-a09e-3e4166749faa\") "
Sep 20 01:08:26.921952 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:26.921910    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/008e3f25-a8f0-42f0-a09e-3e4166749faa-istio-token\") pod \"008e3f25-a8f0-42f0-a09e-3e4166749faa\" (UID: \"008e3f25-a8f0-42f0-a09e-3e4166749faa\") "
Sep 20 01:08:26.922081 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:26.921975    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/008e3f25-a8f0-42f0-a09e-3e4166749faa-istio-data\") pod \"008e3f25-a8f0-42f0-a09e-3e4166749faa\" (UID: \"008e3f25-a8f0-42f0-a09e-3e4166749faa\") "
Sep 20 01:08:26.922081 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:26.922021    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/008e3f25-a8f0-42f0-a09e-3e4166749faa-credential-socket\") pod \"008e3f25-a8f0-42f0-a09e-3e4166749faa\" (UID: \"008e3f25-a8f0-42f0-a09e-3e4166749faa\") "
Sep 20 01:08:26.922081 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:26.922051    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/008e3f25-a8f0-42f0-a09e-3e4166749faa-istio-podinfo\") pod \"008e3f25-a8f0-42f0-a09e-3e4166749faa\" (UID: \"008e3f25-a8f0-42f0-a09e-3e4166749faa\") "
Sep 20 01:08:26.922081 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:26.922052    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/008e3f25-a8f0-42f0-a09e-3e4166749faa-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "008e3f25-a8f0-42f0-a09e-3e4166749faa" (UID: "008e3f25-a8f0-42f0-a09e-3e4166749faa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:08:26.922299 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:26.922110    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/008e3f25-a8f0-42f0-a09e-3e4166749faa-workload-certs\") pod \"008e3f25-a8f0-42f0-a09e-3e4166749faa\" (UID: \"008e3f25-a8f0-42f0-a09e-3e4166749faa\") "
Sep 20 01:08:26.922299 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:26.922166    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/008e3f25-a8f0-42f0-a09e-3e4166749faa-istio-envoy\") pod \"008e3f25-a8f0-42f0-a09e-3e4166749faa\" (UID: \"008e3f25-a8f0-42f0-a09e-3e4166749faa\") "
Sep 20 01:08:26.922299 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:26.922204    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/008e3f25-a8f0-42f0-a09e-3e4166749faa-istio-data" (OuterVolumeSpecName: "istio-data") pod "008e3f25-a8f0-42f0-a09e-3e4166749faa" (UID: "008e3f25-a8f0-42f0-a09e-3e4166749faa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:08:26.922299 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:26.922261    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/008e3f25-a8f0-42f0-a09e-3e4166749faa-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "008e3f25-a8f0-42f0-a09e-3e4166749faa" (UID: "008e3f25-a8f0-42f0-a09e-3e4166749faa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:08:26.922299 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:26.922297    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/008e3f25-a8f0-42f0-a09e-3e4166749faa-istiod-ca-cert\") pod \"008e3f25-a8f0-42f0-a09e-3e4166749faa\" (UID: \"008e3f25-a8f0-42f0-a09e-3e4166749faa\") "
Sep 20 01:08:26.922543 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:26.922362    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/008e3f25-a8f0-42f0-a09e-3e4166749faa-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "008e3f25-a8f0-42f0-a09e-3e4166749faa" (UID: "008e3f25-a8f0-42f0-a09e-3e4166749faa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:08:26.922689 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:26.922664    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/008e3f25-a8f0-42f0-a09e-3e4166749faa-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "008e3f25-a8f0-42f0-a09e-3e4166749faa" (UID: "008e3f25-a8f0-42f0-a09e-3e4166749faa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:08:26.922798 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:26.922783    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/008e3f25-a8f0-42f0-a09e-3e4166749faa-istiod-ca-cert\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:08:26.922880 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:26.922805    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/008e3f25-a8f0-42f0-a09e-3e4166749faa-workload-socket\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:08:26.922880 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:26.922820    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/008e3f25-a8f0-42f0-a09e-3e4166749faa-istio-data\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:08:26.922880 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:26.922834    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/008e3f25-a8f0-42f0-a09e-3e4166749faa-credential-socket\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:08:26.922880 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:26.922849    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/008e3f25-a8f0-42f0-a09e-3e4166749faa-workload-certs\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:08:26.924337 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:26.924316    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/008e3f25-a8f0-42f0-a09e-3e4166749faa-kube-api-access-xm255" (OuterVolumeSpecName: "kube-api-access-xm255") pod "008e3f25-a8f0-42f0-a09e-3e4166749faa" (UID: "008e3f25-a8f0-42f0-a09e-3e4166749faa"). InnerVolumeSpecName "kube-api-access-xm255". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:08:26.924654 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:26.924627    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/008e3f25-a8f0-42f0-a09e-3e4166749faa-istio-token" (OuterVolumeSpecName: "istio-token") pod "008e3f25-a8f0-42f0-a09e-3e4166749faa" (UID: "008e3f25-a8f0-42f0-a09e-3e4166749faa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:08:26.924902 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:26.924881    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/008e3f25-a8f0-42f0-a09e-3e4166749faa-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "008e3f25-a8f0-42f0-a09e-3e4166749faa" (UID: "008e3f25-a8f0-42f0-a09e-3e4166749faa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:08:26.924978 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:26.924907    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/008e3f25-a8f0-42f0-a09e-3e4166749faa-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "008e3f25-a8f0-42f0-a09e-3e4166749faa" (UID: "008e3f25-a8f0-42f0-a09e-3e4166749faa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 20 01:08:27.024336 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:27.024294    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xm255\" (UniqueName: \"kubernetes.io/projected/008e3f25-a8f0-42f0-a09e-3e4166749faa-kube-api-access-xm255\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:08:27.024336 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:27.024345    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/008e3f25-a8f0-42f0-a09e-3e4166749faa-istio-token\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:08:27.024555 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:27.024357    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/008e3f25-a8f0-42f0-a09e-3e4166749faa-istio-podinfo\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:08:27.024555 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:27.024366    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/008e3f25-a8f0-42f0-a09e-3e4166749faa-istio-envoy\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:08:27.196712 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:27.196678    2570 generic.go:356] "Generic (PLEG): container finished" podID="008e3f25-a8f0-42f0-a09e-3e4166749faa" containerID="eceb9b8c29f28bfed823f967e4fd1a9e6c085135350535dd7466c6745cac5551" exitCode=0
Sep 20 01:08:27.196984 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:27.196716    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl" event={"ID":"008e3f25-a8f0-42f0-a09e-3e4166749faa","Type":"ContainerDied","Data":"eceb9b8c29f28bfed823f967e4fd1a9e6c085135350535dd7466c6745cac5551"}
Sep 20 01:08:27.196984 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:27.196745    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl"
Sep 20 01:08:27.196984 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:27.196773    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl" event={"ID":"008e3f25-a8f0-42f0-a09e-3e4166749faa","Type":"ContainerDied","Data":"2ff5efddf3b61fe965ad5b6001f26537c1c4a002bf7c005e4440c836b4193960"}
Sep 20 01:08:27.196984 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:27.196795    2570 scope.go:117] "RemoveContainer" containerID="eceb9b8c29f28bfed823f967e4fd1a9e6c085135350535dd7466c6745cac5551"
Sep 20 01:08:27.207722 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:27.207702    2570 scope.go:117] "RemoveContainer" containerID="46d19f3039b7b63a35c21ba233a2ea0570dded53eed83bd551f4c4a6e0b8ddb7"
Sep 20 01:08:27.216975 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:27.216953    2570 scope.go:117] "RemoveContainer" containerID="eceb9b8c29f28bfed823f967e4fd1a9e6c085135350535dd7466c6745cac5551"
Sep 20 01:08:27.217287 ip-10-0-132-108 kubenswrapper[2570]: E0920 01:08:27.217267    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eceb9b8c29f28bfed823f967e4fd1a9e6c085135350535dd7466c6745cac5551\": container with ID starting with eceb9b8c29f28bfed823f967e4fd1a9e6c085135350535dd7466c6745cac5551 not found: ID does not exist" containerID="eceb9b8c29f28bfed823f967e4fd1a9e6c085135350535dd7466c6745cac5551"
Sep 20 01:08:27.217347 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:27.217297    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eceb9b8c29f28bfed823f967e4fd1a9e6c085135350535dd7466c6745cac5551"} err="failed to get container status \"eceb9b8c29f28bfed823f967e4fd1a9e6c085135350535dd7466c6745cac5551\": rpc error: code = NotFound desc = could not find container \"eceb9b8c29f28bfed823f967e4fd1a9e6c085135350535dd7466c6745cac5551\": container with ID starting with eceb9b8c29f28bfed823f967e4fd1a9e6c085135350535dd7466c6745cac5551 not found: ID does not exist"
Sep 20 01:08:27.217347 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:27.217317    2570 scope.go:117] "RemoveContainer" containerID="46d19f3039b7b63a35c21ba233a2ea0570dded53eed83bd551f4c4a6e0b8ddb7"
Sep 20 01:08:27.217584 ip-10-0-132-108 kubenswrapper[2570]: E0920 01:08:27.217558    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46d19f3039b7b63a35c21ba233a2ea0570dded53eed83bd551f4c4a6e0b8ddb7\": container with ID starting with 46d19f3039b7b63a35c21ba233a2ea0570dded53eed83bd551f4c4a6e0b8ddb7 not found: ID does not exist" containerID="46d19f3039b7b63a35c21ba233a2ea0570dded53eed83bd551f4c4a6e0b8ddb7"
Sep 20 01:08:27.217679 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:27.217591    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46d19f3039b7b63a35c21ba233a2ea0570dded53eed83bd551f4c4a6e0b8ddb7"} err="failed to get container status \"46d19f3039b7b63a35c21ba233a2ea0570dded53eed83bd551f4c4a6e0b8ddb7\": rpc error: code = NotFound desc = could not find container \"46d19f3039b7b63a35c21ba233a2ea0570dded53eed83bd551f4c4a6e0b8ddb7\": container with ID starting with 46d19f3039b7b63a35c21ba233a2ea0570dded53eed83bd551f4c4a6e0b8ddb7 not found: ID does not exist"
Sep 20 01:08:27.218913 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:27.218894    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl"]
Sep 20 01:08:27.222405 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:27.222385    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-2fd525-openshift-default-775c6cf69d-lwgwl"]
Sep 20 01:08:27.454996 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:27.454916    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="008e3f25-a8f0-42f0-a09e-3e4166749faa" path="/var/lib/kubelet/pods/008e3f25-a8f0-42f0-a09e-3e4166749faa/volumes"
Sep 20 01:08:27.578914 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:27.578886    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv"
Sep 20 01:08:27.579276 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:27.579177    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv"
Sep 20 01:08:27.579963 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:08:27.579946    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv"
Sep 20 01:09:14.118750 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:14.118717    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc"]
Sep 20 01:09:14.119410 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:14.119355    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a54c8c28-2e32-42c5-9c96-daccd7c5ec18" containerName="istio-proxy"
Sep 20 01:09:14.119410 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:14.119372    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a54c8c28-2e32-42c5-9c96-daccd7c5ec18" containerName="istio-proxy"
Sep 20 01:09:14.119410 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:14.119384    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="008e3f25-a8f0-42f0-a09e-3e4166749faa" containerName="istio-proxy"
Sep 20 01:09:14.119410 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:14.119391    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="008e3f25-a8f0-42f0-a09e-3e4166749faa" containerName="istio-proxy"
Sep 20 01:09:14.119410 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:14.119414    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="008e3f25-a8f0-42f0-a09e-3e4166749faa" containerName="istio-proxy"
Sep 20 01:09:14.119673 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:14.119421    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="008e3f25-a8f0-42f0-a09e-3e4166749faa" containerName="istio-proxy"
Sep 20 01:09:14.119673 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:14.119512    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="008e3f25-a8f0-42f0-a09e-3e4166749faa" containerName="istio-proxy"
Sep 20 01:09:14.119673 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:14.119522    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a54c8c28-2e32-42c5-9c96-daccd7c5ec18" containerName="istio-proxy"
Sep 20 01:09:14.122191 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:14.122171    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc"
Sep 20 01:09:14.124106 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:14.124085    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-4c93ee-openshift-default-dockercfg-t28xz\""
Sep 20 01:09:14.134242 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:14.134216    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc"]
Sep 20 01:09:14.230153 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:14.230107    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2e7f4c4-e022-4015-b4ec-4128df9f52cc-istio-token\") pod \"e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc\" (UID: \"a2e7f4c4-e022-4015-b4ec-4128df9f52cc\") " pod="openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc"
Sep 20 01:09:14.230455 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:14.230435    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2e7f4c4-e022-4015-b4ec-4128df9f52cc-credential-socket\") pod \"e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc\" (UID: \"a2e7f4c4-e022-4015-b4ec-4128df9f52cc\") " pod="openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc"
Sep 20 01:09:14.230570 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:14.230556    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2e7f4c4-e022-4015-b4ec-4128df9f52cc-istio-data\") pod \"e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc\" (UID: \"a2e7f4c4-e022-4015-b4ec-4128df9f52cc\") " pod="openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc"
Sep 20 01:09:14.230756 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:14.230738    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2e7f4c4-e022-4015-b4ec-4128df9f52cc-istiod-ca-cert\") pod \"e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc\" (UID: \"a2e7f4c4-e022-4015-b4ec-4128df9f52cc\") " pod="openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc"
Sep 20 01:09:14.230921 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:14.230902    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2e7f4c4-e022-4015-b4ec-4128df9f52cc-workload-socket\") pod \"e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc\" (UID: \"a2e7f4c4-e022-4015-b4ec-4128df9f52cc\") " pod="openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc"
Sep 20 01:09:14.231056 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:14.231038    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4s7bp\" (UniqueName: \"kubernetes.io/projected/a2e7f4c4-e022-4015-b4ec-4128df9f52cc-kube-api-access-4s7bp\") pod \"e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc\" (UID: \"a2e7f4c4-e022-4015-b4ec-4128df9f52cc\") " pod="openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc"
Sep 20 01:09:14.231246 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:14.231226    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2e7f4c4-e022-4015-b4ec-4128df9f52cc-istio-podinfo\") pod \"e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc\" (UID: \"a2e7f4c4-e022-4015-b4ec-4128df9f52cc\") " pod="openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc"
Sep 20 01:09:14.231434 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:14.231407    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2e7f4c4-e022-4015-b4ec-4128df9f52cc-workload-certs\") pod \"e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc\" (UID: \"a2e7f4c4-e022-4015-b4ec-4128df9f52cc\") " pod="openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc"
Sep 20 01:09:14.231563 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:14.231443    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2e7f4c4-e022-4015-b4ec-4128df9f52cc-istio-envoy\") pod \"e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc\" (UID: \"a2e7f4c4-e022-4015-b4ec-4128df9f52cc\") " pod="openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc"
Sep 20 01:09:14.332662 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:14.332628    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2e7f4c4-e022-4015-b4ec-4128df9f52cc-istio-token\") pod \"e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc\" (UID: \"a2e7f4c4-e022-4015-b4ec-4128df9f52cc\") " pod="openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc"
Sep 20 01:09:14.332662 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:14.332678    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2e7f4c4-e022-4015-b4ec-4128df9f52cc-credential-socket\") pod \"e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc\" (UID: \"a2e7f4c4-e022-4015-b4ec-4128df9f52cc\") " pod="openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc"
Sep 20 01:09:14.333006 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:14.332697    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2e7f4c4-e022-4015-b4ec-4128df9f52cc-istio-data\") pod \"e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc\" (UID: \"a2e7f4c4-e022-4015-b4ec-4128df9f52cc\") " pod="openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc"
Sep 20 01:09:14.333006 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:14.332746    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2e7f4c4-e022-4015-b4ec-4128df9f52cc-istiod-ca-cert\") pod \"e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc\" (UID: \"a2e7f4c4-e022-4015-b4ec-4128df9f52cc\") " pod="openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc"
Sep 20 01:09:14.333006 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:14.332769    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2e7f4c4-e022-4015-b4ec-4128df9f52cc-workload-socket\") pod \"e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc\" (UID: \"a2e7f4c4-e022-4015-b4ec-4128df9f52cc\") " pod="openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc"
Sep 20 01:09:14.333006 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:14.332792    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4s7bp\" (UniqueName: \"kubernetes.io/projected/a2e7f4c4-e022-4015-b4ec-4128df9f52cc-kube-api-access-4s7bp\") pod \"e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc\" (UID: \"a2e7f4c4-e022-4015-b4ec-4128df9f52cc\") " pod="openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc"
Sep 20 01:09:14.333006 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:14.332934    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2e7f4c4-e022-4015-b4ec-4128df9f52cc-istio-podinfo\") pod \"e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc\" (UID: \"a2e7f4c4-e022-4015-b4ec-4128df9f52cc\") " pod="openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc"
Sep 20 01:09:14.333006 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:14.333004    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2e7f4c4-e022-4015-b4ec-4128df9f52cc-workload-certs\") pod \"e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc\" (UID: \"a2e7f4c4-e022-4015-b4ec-4128df9f52cc\") " pod="openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc"
Sep 20 01:09:14.333337 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:14.333039    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2e7f4c4-e022-4015-b4ec-4128df9f52cc-istio-envoy\") pod \"e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc\" (UID: \"a2e7f4c4-e022-4015-b4ec-4128df9f52cc\") " pod="openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc"
Sep 20 01:09:14.333337 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:14.333195    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2e7f4c4-e022-4015-b4ec-4128df9f52cc-istio-data\") pod \"e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc\" (UID: \"a2e7f4c4-e022-4015-b4ec-4128df9f52cc\") " pod="openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc"
Sep 20 01:09:14.333337 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:14.333232    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2e7f4c4-e022-4015-b4ec-4128df9f52cc-workload-socket\") pod \"e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc\" (UID: \"a2e7f4c4-e022-4015-b4ec-4128df9f52cc\") " pod="openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc"
Sep 20 01:09:14.333507 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:14.333440    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2e7f4c4-e022-4015-b4ec-4128df9f52cc-workload-certs\") pod \"e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc\" (UID: \"a2e7f4c4-e022-4015-b4ec-4128df9f52cc\") " pod="openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc"
Sep 20 01:09:14.333604 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:14.333585    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2e7f4c4-e022-4015-b4ec-4128df9f52cc-istiod-ca-cert\") pod \"e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc\" (UID: \"a2e7f4c4-e022-4015-b4ec-4128df9f52cc\") " pod="openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc"
Sep 20 01:09:14.333671 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:14.333584    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2e7f4c4-e022-4015-b4ec-4128df9f52cc-credential-socket\") pod \"e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc\" (UID: \"a2e7f4c4-e022-4015-b4ec-4128df9f52cc\") " pod="openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc"
Sep 20 01:09:14.335744 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:14.335722    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2e7f4c4-e022-4015-b4ec-4128df9f52cc-istio-envoy\") pod \"e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc\" (UID: \"a2e7f4c4-e022-4015-b4ec-4128df9f52cc\") " pod="openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc"
Sep 20 01:09:14.336220 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:14.336193    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2e7f4c4-e022-4015-b4ec-4128df9f52cc-istio-podinfo\") pod \"e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc\" (UID: \"a2e7f4c4-e022-4015-b4ec-4128df9f52cc\") " pod="openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc"
Sep 20 01:09:14.343501 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:14.343470    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2e7f4c4-e022-4015-b4ec-4128df9f52cc-istio-token\") pod \"e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc\" (UID: \"a2e7f4c4-e022-4015-b4ec-4128df9f52cc\") " pod="openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc"
Sep 20 01:09:14.343631 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:14.343613    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4s7bp\" (UniqueName: \"kubernetes.io/projected/a2e7f4c4-e022-4015-b4ec-4128df9f52cc-kube-api-access-4s7bp\") pod \"e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc\" (UID: \"a2e7f4c4-e022-4015-b4ec-4128df9f52cc\") " pod="openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc"
Sep 20 01:09:14.433847 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:14.433757    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc"
Sep 20 01:09:14.711002 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:14.710974    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc"]
Sep 20 01:09:14.712549 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:09:14.712512    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2e7f4c4_e022_4015_b4ec_4128df9f52cc.slice/crio-da88c5bd3fe147bb63234020d0c4008a475a7d5364cf8d7342fe5687cb062d14 WatchSource:0}: Error finding container da88c5bd3fe147bb63234020d0c4008a475a7d5364cf8d7342fe5687cb062d14: Status 404 returned error can't find the container with id da88c5bd3fe147bb63234020d0c4008a475a7d5364cf8d7342fe5687cb062d14
Sep 20 01:09:14.714897 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:14.714848    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:09:14.714973 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:14.714929    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:09:14.714973 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:14.714957    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:09:15.485459 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:15.485421    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc" event={"ID":"a2e7f4c4-e022-4015-b4ec-4128df9f52cc","Type":"ContainerStarted","Data":"9321b6d2ebff8e409ab5b99a2cd0d772c4559fff1e57a90cd734442a041c2f3f"}
Sep 20 01:09:15.485920 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:15.485472    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc" event={"ID":"a2e7f4c4-e022-4015-b4ec-4128df9f52cc","Type":"ContainerStarted","Data":"da88c5bd3fe147bb63234020d0c4008a475a7d5364cf8d7342fe5687cb062d14"}
Sep 20 01:09:15.505851 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:15.505806    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc" podStartSLOduration=1.5057903179999998 podStartE2EDuration="1.505790318s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:09:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:09:15.503095202 +0000 UTC m=+1292.117251119" watchObservedRunningTime="2026-09-20 01:09:15.505790318 +0000 UTC m=+1292.119946214"
Sep 20 01:09:16.434433 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:16.434400    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc"
Sep 20 01:09:16.439563 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:16.439538    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc"
Sep 20 01:09:16.490824 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:16.490792    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc"
Sep 20 01:09:16.491807 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:16.491788    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc"
Sep 20 01:09:29.280055 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:29.280016    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-4e301e/e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q"]
Sep 20 01:09:44.300905 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:44.300832    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q" podUID="847da3da-bb69-4fb0-b05f-b351be6e4609" containerName="main" containerID="cri-o://679d1214469d88a4dd8cca125cc6265658e8abba92e546e00adfe7c841a2be2d" gracePeriod=45
Sep 20 01:09:44.575848 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:44.575819    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q"
Sep 20 01:09:44.667827 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:44.667792    2570 generic.go:356] "Generic (PLEG): container finished" podID="847da3da-bb69-4fb0-b05f-b351be6e4609" containerID="679d1214469d88a4dd8cca125cc6265658e8abba92e546e00adfe7c841a2be2d" exitCode=0
Sep 20 01:09:44.668013 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:44.667834    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q"
Sep 20 01:09:44.668013 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:44.667882    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q" event={"ID":"847da3da-bb69-4fb0-b05f-b351be6e4609","Type":"ContainerDied","Data":"679d1214469d88a4dd8cca125cc6265658e8abba92e546e00adfe7c841a2be2d"}
Sep 20 01:09:44.668013 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:44.667937    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-4e301e/e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q" event={"ID":"847da3da-bb69-4fb0-b05f-b351be6e4609","Type":"ContainerDied","Data":"d71bfee95111dbffedee22dbd8f3858611de9173d341bb59e65d24f0aa00d43b"}
Sep 20 01:09:44.668013 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:44.667960    2570 scope.go:117] "RemoveContainer" containerID="679d1214469d88a4dd8cca125cc6265658e8abba92e546e00adfe7c841a2be2d"
Sep 20 01:09:44.687560 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:44.687540    2570 scope.go:117] "RemoveContainer" containerID="679d1214469d88a4dd8cca125cc6265658e8abba92e546e00adfe7c841a2be2d"
Sep 20 01:09:44.687891 ip-10-0-132-108 kubenswrapper[2570]: E0920 01:09:44.687854    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"679d1214469d88a4dd8cca125cc6265658e8abba92e546e00adfe7c841a2be2d\": container with ID starting with 679d1214469d88a4dd8cca125cc6265658e8abba92e546e00adfe7c841a2be2d not found: ID does not exist" containerID="679d1214469d88a4dd8cca125cc6265658e8abba92e546e00adfe7c841a2be2d"
Sep 20 01:09:44.687984 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:44.687903    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"679d1214469d88a4dd8cca125cc6265658e8abba92e546e00adfe7c841a2be2d"} err="failed to get container status \"679d1214469d88a4dd8cca125cc6265658e8abba92e546e00adfe7c841a2be2d\": rpc error: code = NotFound desc = could not find container \"679d1214469d88a4dd8cca125cc6265658e8abba92e546e00adfe7c841a2be2d\": container with ID starting with 679d1214469d88a4dd8cca125cc6265658e8abba92e546e00adfe7c841a2be2d not found: ID does not exist"
Sep 20 01:09:44.691714 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:44.691696    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/847da3da-bb69-4fb0-b05f-b351be6e4609-tmp-dir\") pod \"847da3da-bb69-4fb0-b05f-b351be6e4609\" (UID: \"847da3da-bb69-4fb0-b05f-b351be6e4609\") "
Sep 20 01:09:44.691813 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:44.691728    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/847da3da-bb69-4fb0-b05f-b351be6e4609-home\") pod \"847da3da-bb69-4fb0-b05f-b351be6e4609\" (UID: \"847da3da-bb69-4fb0-b05f-b351be6e4609\") "
Sep 20 01:09:44.691813 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:44.691776    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/847da3da-bb69-4fb0-b05f-b351be6e4609-tls-certs\") pod \"847da3da-bb69-4fb0-b05f-b351be6e4609\" (UID: \"847da3da-bb69-4fb0-b05f-b351be6e4609\") "
Sep 20 01:09:44.691959 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:44.691829    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sq8q9\" (UniqueName: \"kubernetes.io/projected/847da3da-bb69-4fb0-b05f-b351be6e4609-kube-api-access-sq8q9\") pod \"847da3da-bb69-4fb0-b05f-b351be6e4609\" (UID: \"847da3da-bb69-4fb0-b05f-b351be6e4609\") "
Sep 20 01:09:44.691959 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:44.691878    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/847da3da-bb69-4fb0-b05f-b351be6e4609-dshm\") pod \"847da3da-bb69-4fb0-b05f-b351be6e4609\" (UID: \"847da3da-bb69-4fb0-b05f-b351be6e4609\") "
Sep 20 01:09:44.691959 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:44.691916    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/847da3da-bb69-4fb0-b05f-b351be6e4609-model-cache\") pod \"847da3da-bb69-4fb0-b05f-b351be6e4609\" (UID: \"847da3da-bb69-4fb0-b05f-b351be6e4609\") "
Sep 20 01:09:44.692155 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:44.692127    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/847da3da-bb69-4fb0-b05f-b351be6e4609-home" (OuterVolumeSpecName: "home") pod "847da3da-bb69-4fb0-b05f-b351be6e4609" (UID: "847da3da-bb69-4fb0-b05f-b351be6e4609"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:09:44.692247 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:44.692224    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/847da3da-bb69-4fb0-b05f-b351be6e4609-model-cache" (OuterVolumeSpecName: "model-cache") pod "847da3da-bb69-4fb0-b05f-b351be6e4609" (UID: "847da3da-bb69-4fb0-b05f-b351be6e4609"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:09:44.692419 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:44.692400    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/847da3da-bb69-4fb0-b05f-b351be6e4609-home\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:09:44.692606 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:44.692423    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/847da3da-bb69-4fb0-b05f-b351be6e4609-model-cache\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:09:44.692606 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:44.692008    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/847da3da-bb69-4fb0-b05f-b351be6e4609-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "847da3da-bb69-4fb0-b05f-b351be6e4609" (UID: "847da3da-bb69-4fb0-b05f-b351be6e4609"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:09:44.694244 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:44.694219    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/847da3da-bb69-4fb0-b05f-b351be6e4609-kube-api-access-sq8q9" (OuterVolumeSpecName: "kube-api-access-sq8q9") pod "847da3da-bb69-4fb0-b05f-b351be6e4609" (UID: "847da3da-bb69-4fb0-b05f-b351be6e4609"). InnerVolumeSpecName "kube-api-access-sq8q9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:09:44.694346 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:44.694290    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/847da3da-bb69-4fb0-b05f-b351be6e4609-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "847da3da-bb69-4fb0-b05f-b351be6e4609" (UID: "847da3da-bb69-4fb0-b05f-b351be6e4609"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:09:44.694346 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:44.694314    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/847da3da-bb69-4fb0-b05f-b351be6e4609-dshm" (OuterVolumeSpecName: "dshm") pod "847da3da-bb69-4fb0-b05f-b351be6e4609" (UID: "847da3da-bb69-4fb0-b05f-b351be6e4609"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:09:44.793178 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:44.793148    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/847da3da-bb69-4fb0-b05f-b351be6e4609-tmp-dir\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:09:44.793178 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:44.793175    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/847da3da-bb69-4fb0-b05f-b351be6e4609-tls-certs\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:09:44.793178 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:44.793185    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sq8q9\" (UniqueName: \"kubernetes.io/projected/847da3da-bb69-4fb0-b05f-b351be6e4609-kube-api-access-sq8q9\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:09:44.793391 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:44.793193    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/847da3da-bb69-4fb0-b05f-b351be6e4609-dshm\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:09:44.991243 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:44.991216    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-4e301e/e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q"]
Sep 20 01:09:44.994824 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:44.994793    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-4e301e/e2e-conflict-b-d774ddcf-kserve-6b6df8665d-94l7q"]
Sep 20 01:09:45.455260 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:45.455227    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="847da3da-bb69-4fb0-b05f-b351be6e4609" path="/var/lib/kubelet/pods/847da3da-bb69-4fb0-b05f-b351be6e4609/volumes"
Sep 20 01:09:45.643044 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:45.643008    2570 scope.go:117] "RemoveContainer" containerID="9047f04d76c8892dcdaf0702654ceffc531109045087c93b4eaa1a08c8a3d8e5"
Sep 20 01:09:45.654384 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:45.654360    2570 scope.go:117] "RemoveContainer" containerID="72ee9b872f4a0918a5aea651b0155fd8b513537787b9164b138f1617cbd01074"
Sep 20 01:09:45.663404 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:45.663375    2570 scope.go:117] "RemoveContainer" containerID="bd56d14e238f29a0b2eb77ef870084c019b278b4f75f893062f1be5d1a6beb23"
Sep 20 01:09:47.532031 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:47.531987    2570 patch_prober.go:28] interesting pod/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 20 01:09:47.532440 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:47.532057    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc" podUID="a2e7f4c4-e022-4015-b4ec-4128df9f52cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 20 01:09:48.696198 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:48.696159    2570 generic.go:356] "Generic (PLEG): container finished" podID="a2e7f4c4-e022-4015-b4ec-4128df9f52cc" containerID="9321b6d2ebff8e409ab5b99a2cd0d772c4559fff1e57a90cd734442a041c2f3f" exitCode=0
Sep 20 01:09:48.696640 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:48.696231    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc" event={"ID":"a2e7f4c4-e022-4015-b4ec-4128df9f52cc","Type":"ContainerDied","Data":"9321b6d2ebff8e409ab5b99a2cd0d772c4559fff1e57a90cd734442a041c2f3f"}
Sep 20 01:09:48.696687 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:48.696656    2570 scope.go:117] "RemoveContainer" containerID="9321b6d2ebff8e409ab5b99a2cd0d772c4559fff1e57a90cd734442a041c2f3f"
Sep 20 01:09:48.697909 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:48.697854    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:09:48.697996 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:48.697952    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:09:48.697996 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:48.697986    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:09:49.704187 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:49.704153    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc" event={"ID":"a2e7f4c4-e022-4015-b4ec-4128df9f52cc","Type":"ContainerStarted","Data":"2c87ce667de343f87a6bfd0104de29ab92c90683c7aa4539e556272ef8e0c65f"}
Sep 20 01:09:50.434631 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:50.434591    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc"
Sep 20 01:09:50.434850 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:50.434824    2570 patch_prober.go:28] interesting pod/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 20 01:09:50.434985 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:50.434960    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc" podUID="a2e7f4c4-e022-4015-b4ec-4128df9f52cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 20 01:09:51.434884 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:51.434831    2570 patch_prober.go:28] interesting pod/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 20 01:09:51.435275 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:51.434914    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc" podUID="a2e7f4c4-e022-4015-b4ec-4128df9f52cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 20 01:09:52.299052 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:52.299011    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-4e301e/distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww"]
Sep 20 01:09:52.299658 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:52.299637    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="847da3da-bb69-4fb0-b05f-b351be6e4609" containerName="main"
Sep 20 01:09:52.299727 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:52.299661    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="847da3da-bb69-4fb0-b05f-b351be6e4609" containerName="main"
Sep 20 01:09:52.299765 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:52.299739    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="847da3da-bb69-4fb0-b05f-b351be6e4609" containerName="main"
Sep 20 01:09:52.299765 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:52.299749    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="008e3f25-a8f0-42f0-a09e-3e4166749faa" containerName="istio-proxy"
Sep 20 01:09:52.308162 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:52.308134    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-4e301e/distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww"
Sep 20 01:09:52.311148 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:52.311123    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-4e301e\"/\"default-dockercfg-xmm6m\""
Sep 20 01:09:52.311362 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:52.311345    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-4e301e\"/\"kube-root-ca.crt\""
Sep 20 01:09:52.311426 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:52.311367    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-4e301e\"/\"distinct-w4-4e301e-kserve-self-signed-certs\""
Sep 20 01:09:52.311820 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:52.311799    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-4e301e\"/\"openshift-service-ca.crt\""
Sep 20 01:09:52.311975 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:52.311953    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-4e301e/distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww"]
Sep 20 01:09:52.376742 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:52.376645    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/17923150-25df-45ab-aec2-c19fe6781323-dshm\") pod \"distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww\" (UID: \"17923150-25df-45ab-aec2-c19fe6781323\") " pod="e2e-models-e2e-worker-w4-4e301e/distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww"
Sep 20 01:09:52.376965 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:52.376745    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gssr\" (UniqueName: \"kubernetes.io/projected/17923150-25df-45ab-aec2-c19fe6781323-kube-api-access-6gssr\") pod \"distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww\" (UID: \"17923150-25df-45ab-aec2-c19fe6781323\") " pod="e2e-models-e2e-worker-w4-4e301e/distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww"
Sep 20 01:09:52.376965 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:52.376776    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17923150-25df-45ab-aec2-c19fe6781323-tmp-dir\") pod \"distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww\" (UID: \"17923150-25df-45ab-aec2-c19fe6781323\") " pod="e2e-models-e2e-worker-w4-4e301e/distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww"
Sep 20 01:09:52.376965 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:52.376824    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17923150-25df-45ab-aec2-c19fe6781323-tls-certs\") pod \"distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww\" (UID: \"17923150-25df-45ab-aec2-c19fe6781323\") " pod="e2e-models-e2e-worker-w4-4e301e/distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww"
Sep 20 01:09:52.376965 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:52.376896    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17923150-25df-45ab-aec2-c19fe6781323-model-cache\") pod \"distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww\" (UID: \"17923150-25df-45ab-aec2-c19fe6781323\") " pod="e2e-models-e2e-worker-w4-4e301e/distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww"
Sep 20 01:09:52.377196 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:52.376956    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/17923150-25df-45ab-aec2-c19fe6781323-home\") pod \"distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww\" (UID: \"17923150-25df-45ab-aec2-c19fe6781323\") " pod="e2e-models-e2e-worker-w4-4e301e/distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww"
Sep 20 01:09:52.434850 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:52.434807    2570 patch_prober.go:28] interesting pod/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 20 01:09:52.435045 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:52.434900    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc" podUID="a2e7f4c4-e022-4015-b4ec-4128df9f52cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 20 01:09:52.478573 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:52.478528    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gssr\" (UniqueName: \"kubernetes.io/projected/17923150-25df-45ab-aec2-c19fe6781323-kube-api-access-6gssr\") pod \"distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww\" (UID: \"17923150-25df-45ab-aec2-c19fe6781323\") " pod="e2e-models-e2e-worker-w4-4e301e/distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww"
Sep 20 01:09:52.478573 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:52.478576    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17923150-25df-45ab-aec2-c19fe6781323-tmp-dir\") pod \"distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww\" (UID: \"17923150-25df-45ab-aec2-c19fe6781323\") " pod="e2e-models-e2e-worker-w4-4e301e/distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww"
Sep 20 01:09:52.478840 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:52.478618    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17923150-25df-45ab-aec2-c19fe6781323-tls-certs\") pod \"distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww\" (UID: \"17923150-25df-45ab-aec2-c19fe6781323\") " pod="e2e-models-e2e-worker-w4-4e301e/distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww"
Sep 20 01:09:52.478840 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:52.478649    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17923150-25df-45ab-aec2-c19fe6781323-model-cache\") pod \"distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww\" (UID: \"17923150-25df-45ab-aec2-c19fe6781323\") " pod="e2e-models-e2e-worker-w4-4e301e/distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww"
Sep 20 01:09:52.478840 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:52.478702    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/17923150-25df-45ab-aec2-c19fe6781323-home\") pod \"distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww\" (UID: \"17923150-25df-45ab-aec2-c19fe6781323\") " pod="e2e-models-e2e-worker-w4-4e301e/distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww"
Sep 20 01:09:52.479037 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:52.478873    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/17923150-25df-45ab-aec2-c19fe6781323-dshm\") pod \"distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww\" (UID: \"17923150-25df-45ab-aec2-c19fe6781323\") " pod="e2e-models-e2e-worker-w4-4e301e/distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww"
Sep 20 01:09:52.479098 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:52.479067    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17923150-25df-45ab-aec2-c19fe6781323-tmp-dir\") pod \"distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww\" (UID: \"17923150-25df-45ab-aec2-c19fe6781323\") " pod="e2e-models-e2e-worker-w4-4e301e/distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww"
Sep 20 01:09:52.479156 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:52.479132    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17923150-25df-45ab-aec2-c19fe6781323-model-cache\") pod \"distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww\" (UID: \"17923150-25df-45ab-aec2-c19fe6781323\") " pod="e2e-models-e2e-worker-w4-4e301e/distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww"
Sep 20 01:09:52.479214 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:52.479187    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/17923150-25df-45ab-aec2-c19fe6781323-home\") pod \"distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww\" (UID: \"17923150-25df-45ab-aec2-c19fe6781323\") " pod="e2e-models-e2e-worker-w4-4e301e/distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww"
Sep 20 01:09:52.481311 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:52.481288    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/17923150-25df-45ab-aec2-c19fe6781323-dshm\") pod \"distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww\" (UID: \"17923150-25df-45ab-aec2-c19fe6781323\") " pod="e2e-models-e2e-worker-w4-4e301e/distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww"
Sep 20 01:09:52.481492 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:52.481475    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17923150-25df-45ab-aec2-c19fe6781323-tls-certs\") pod \"distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww\" (UID: \"17923150-25df-45ab-aec2-c19fe6781323\") " pod="e2e-models-e2e-worker-w4-4e301e/distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww"
Sep 20 01:09:52.485504 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:52.485482    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gssr\" (UniqueName: \"kubernetes.io/projected/17923150-25df-45ab-aec2-c19fe6781323-kube-api-access-6gssr\") pod \"distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww\" (UID: \"17923150-25df-45ab-aec2-c19fe6781323\") " pod="e2e-models-e2e-worker-w4-4e301e/distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww"
Sep 20 01:09:52.619252 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:52.619216    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-4e301e/distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww"
Sep 20 01:09:52.911512 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:52.911423    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-4e301e/distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww"]
Sep 20 01:09:52.914373 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:09:52.914339    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod17923150_25df_45ab_aec2_c19fe6781323.slice/crio-d82f32e60ad310da0d32087ab78299416b89d37562420206de21ca57ae0fe53f WatchSource:0}: Error finding container d82f32e60ad310da0d32087ab78299416b89d37562420206de21ca57ae0fe53f: Status 404 returned error can't find the container with id d82f32e60ad310da0d32087ab78299416b89d37562420206de21ca57ae0fe53f
Sep 20 01:09:53.435111 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:53.435069    2570 patch_prober.go:28] interesting pod/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 20 01:09:53.435505 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:53.435130    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc" podUID="a2e7f4c4-e022-4015-b4ec-4128df9f52cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 20 01:09:53.731047 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:53.730958    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-4e301e/distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww" event={"ID":"17923150-25df-45ab-aec2-c19fe6781323","Type":"ContainerStarted","Data":"71d800bc139d2a8d72ed2406342439600bc2994f9eb33e8a6c931299e1f80e27"}
Sep 20 01:09:53.731047 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:53.731001    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-4e301e/distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww" event={"ID":"17923150-25df-45ab-aec2-c19fe6781323","Type":"ContainerStarted","Data":"d82f32e60ad310da0d32087ab78299416b89d37562420206de21ca57ae0fe53f"}
Sep 20 01:09:53.749012 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:53.748947    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-4e301e/distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww" podStartSLOduration=1.7489276249999999 podStartE2EDuration="1.748927625s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:09:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:09:53.745821274 +0000 UTC m=+1330.359977204" watchObservedRunningTime="2026-09-20 01:09:53.748927625 +0000 UTC m=+1330.363083525"
Sep 20 01:09:54.434916 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:54.434851    2570 patch_prober.go:28] interesting pod/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 20 01:09:54.435079 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:54.434935    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc" podUID="a2e7f4c4-e022-4015-b4ec-4128df9f52cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 20 01:09:55.438176 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:55.438141    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc"
Sep 20 01:09:55.438590 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:55.438486    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc"
Sep 20 01:09:55.439117 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:09:55.439095    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc"
Sep 20 01:10:02.619830 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:10:02.619737    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-4e301e/distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww"
Sep 20 01:10:02.620778 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:10:02.620759    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-4e301e/distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww"
Sep 20 01:10:02.637387 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:10:02.637356    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-4e301e/distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww"
Sep 20 01:10:02.794145 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:10:02.794113    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-4e301e/distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww"
Sep 20 01:10:21.310097 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:10:21.310047    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-8b864c4f-b785877c4-9tkpk"]
Sep 20 01:10:21.310701 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:10:21.310374    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-8b864c4f-b785877c4-9tkpk" podUID="b114fffb-f20a-4896-9269-a9f33f7f50d1" containerName="payload-pre-processing" containerID="cri-o://03d7b370140017dd5cb18ed040f303391fee49ae183e064e5d646ab7b9ec0d31" gracePeriod=30
Sep 20 01:10:21.601031 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:10:21.601000    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-8b864c4f-b785877c4-9tkpk"
Sep 20 01:10:21.683389 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:10:21.683354    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w28zh\" (UniqueName: \"kubernetes.io/projected/b114fffb-f20a-4896-9269-a9f33f7f50d1-kube-api-access-w28zh\") pod \"b114fffb-f20a-4896-9269-a9f33f7f50d1\" (UID: \"b114fffb-f20a-4896-9269-a9f33f7f50d1\") "
Sep 20 01:10:21.683571 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:10:21.683482    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b114fffb-f20a-4896-9269-a9f33f7f50d1-plugins-config-volume\") pod \"b114fffb-f20a-4896-9269-a9f33f7f50d1\" (UID: \"b114fffb-f20a-4896-9269-a9f33f7f50d1\") "
Sep 20 01:10:21.683875 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:10:21.683833    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b114fffb-f20a-4896-9269-a9f33f7f50d1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b114fffb-f20a-4896-9269-a9f33f7f50d1" (UID: "b114fffb-f20a-4896-9269-a9f33f7f50d1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:10:21.685693 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:10:21.685663    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b114fffb-f20a-4896-9269-a9f33f7f50d1-kube-api-access-w28zh" (OuterVolumeSpecName: "kube-api-access-w28zh") pod "b114fffb-f20a-4896-9269-a9f33f7f50d1" (UID: "b114fffb-f20a-4896-9269-a9f33f7f50d1"). InnerVolumeSpecName "kube-api-access-w28zh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:10:21.784768 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:10:21.784733    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b114fffb-f20a-4896-9269-a9f33f7f50d1-plugins-config-volume\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:10:21.784768 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:10:21.784762    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w28zh\" (UniqueName: \"kubernetes.io/projected/b114fffb-f20a-4896-9269-a9f33f7f50d1-kube-api-access-w28zh\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:10:21.891088 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:10:21.891045    2570 generic.go:356] "Generic (PLEG): container finished" podID="b114fffb-f20a-4896-9269-a9f33f7f50d1" containerID="03d7b370140017dd5cb18ed040f303391fee49ae183e064e5d646ab7b9ec0d31" exitCode=0
Sep 20 01:10:21.891319 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:10:21.891123    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-8b864c4f-b785877c4-9tkpk"
Sep 20 01:10:21.891319 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:10:21.891177    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-8b864c4f-b785877c4-9tkpk" event={"ID":"b114fffb-f20a-4896-9269-a9f33f7f50d1","Type":"ContainerDied","Data":"03d7b370140017dd5cb18ed040f303391fee49ae183e064e5d646ab7b9ec0d31"}
Sep 20 01:10:21.891319 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:10:21.891244    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-8b864c4f-b785877c4-9tkpk" event={"ID":"b114fffb-f20a-4896-9269-a9f33f7f50d1","Type":"ContainerDied","Data":"d39c0405e60693633b61e09dd16b8b1d061ed44d4b76980cd303f95f30c0ab90"}
Sep 20 01:10:21.891319 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:10:21.891275    2570 scope.go:117] "RemoveContainer" containerID="03d7b370140017dd5cb18ed040f303391fee49ae183e064e5d646ab7b9ec0d31"
Sep 20 01:10:21.901032 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:10:21.901012    2570 scope.go:117] "RemoveContainer" containerID="03d7b370140017dd5cb18ed040f303391fee49ae183e064e5d646ab7b9ec0d31"
Sep 20 01:10:21.901338 ip-10-0-132-108 kubenswrapper[2570]: E0920 01:10:21.901318    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03d7b370140017dd5cb18ed040f303391fee49ae183e064e5d646ab7b9ec0d31\": container with ID starting with 03d7b370140017dd5cb18ed040f303391fee49ae183e064e5d646ab7b9ec0d31 not found: ID does not exist" containerID="03d7b370140017dd5cb18ed040f303391fee49ae183e064e5d646ab7b9ec0d31"
Sep 20 01:10:21.901384 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:10:21.901347    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03d7b370140017dd5cb18ed040f303391fee49ae183e064e5d646ab7b9ec0d31"} err="failed to get container status \"03d7b370140017dd5cb18ed040f303391fee49ae183e064e5d646ab7b9ec0d31\": rpc error: code = NotFound desc = could not find container \"03d7b370140017dd5cb18ed040f303391fee49ae183e064e5d646ab7b9ec0d31\": container with ID starting with 03d7b370140017dd5cb18ed040f303391fee49ae183e064e5d646ab7b9ec0d31 not found: ID does not exist"
Sep 20 01:10:21.923576 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:10:21.923544    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-8b864c4f-b785877c4-9tkpk"]
Sep 20 01:10:21.937568 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:10:21.937544    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-8b864c4f-b785877c4-9tkpk"]
Sep 20 01:10:23.454235 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:10:23.454200    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b114fffb-f20a-4896-9269-a9f33f7f50d1" path="/var/lib/kubelet/pods/b114fffb-f20a-4896-9269-a9f33f7f50d1/volumes"
Sep 20 01:11:12.635070 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:11:12.635038    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv"]
Sep 20 01:11:12.635658 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:11:12.635334    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv" podUID="ee807025-2862-456d-bed4-4f0a48b04cd4" containerName="istio-proxy" containerID="cri-o://a3810421f72a298881a0ba2efd160eb60068bfbe8474a55a200670d651a5b919" gracePeriod=30
Sep 20 01:11:17.898772 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:11:17.898748    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv"
Sep 20 01:11:17.990820 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:11:17.990726    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dtzqz\" (UniqueName: \"kubernetes.io/projected/ee807025-2862-456d-bed4-4f0a48b04cd4-kube-api-access-dtzqz\") pod \"ee807025-2862-456d-bed4-4f0a48b04cd4\" (UID: \"ee807025-2862-456d-bed4-4f0a48b04cd4\") "
Sep 20 01:11:17.990990 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:11:17.990830    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee807025-2862-456d-bed4-4f0a48b04cd4-istio-data\") pod \"ee807025-2862-456d-bed4-4f0a48b04cd4\" (UID: \"ee807025-2862-456d-bed4-4f0a48b04cd4\") "
Sep 20 01:11:17.990990 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:11:17.990854    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee807025-2862-456d-bed4-4f0a48b04cd4-istio-podinfo\") pod \"ee807025-2862-456d-bed4-4f0a48b04cd4\" (UID: \"ee807025-2862-456d-bed4-4f0a48b04cd4\") "
Sep 20 01:11:17.990990 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:11:17.990936    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee807025-2862-456d-bed4-4f0a48b04cd4-istiod-ca-cert\") pod \"ee807025-2862-456d-bed4-4f0a48b04cd4\" (UID: \"ee807025-2862-456d-bed4-4f0a48b04cd4\") "
Sep 20 01:11:17.990990 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:11:17.990970    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee807025-2862-456d-bed4-4f0a48b04cd4-credential-socket\") pod \"ee807025-2862-456d-bed4-4f0a48b04cd4\" (UID: \"ee807025-2862-456d-bed4-4f0a48b04cd4\") "
Sep 20 01:11:17.991197 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:11:17.990991    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee807025-2862-456d-bed4-4f0a48b04cd4-istio-token\") pod \"ee807025-2862-456d-bed4-4f0a48b04cd4\" (UID: \"ee807025-2862-456d-bed4-4f0a48b04cd4\") "
Sep 20 01:11:17.991197 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:11:17.991032    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee807025-2862-456d-bed4-4f0a48b04cd4-istio-envoy\") pod \"ee807025-2862-456d-bed4-4f0a48b04cd4\" (UID: \"ee807025-2862-456d-bed4-4f0a48b04cd4\") "
Sep 20 01:11:17.991197 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:11:17.991067    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee807025-2862-456d-bed4-4f0a48b04cd4-workload-certs\") pod \"ee807025-2862-456d-bed4-4f0a48b04cd4\" (UID: \"ee807025-2862-456d-bed4-4f0a48b04cd4\") "
Sep 20 01:11:17.991197 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:11:17.991107    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee807025-2862-456d-bed4-4f0a48b04cd4-workload-socket\") pod \"ee807025-2862-456d-bed4-4f0a48b04cd4\" (UID: \"ee807025-2862-456d-bed4-4f0a48b04cd4\") "
Sep 20 01:11:17.991197 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:11:17.991143    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee807025-2862-456d-bed4-4f0a48b04cd4-istio-data" (OuterVolumeSpecName: "istio-data") pod "ee807025-2862-456d-bed4-4f0a48b04cd4" (UID: "ee807025-2862-456d-bed4-4f0a48b04cd4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:11:17.991473 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:11:17.991230    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee807025-2862-456d-bed4-4f0a48b04cd4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ee807025-2862-456d-bed4-4f0a48b04cd4" (UID: "ee807025-2862-456d-bed4-4f0a48b04cd4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:11:17.991473 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:11:17.991387    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee807025-2862-456d-bed4-4f0a48b04cd4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ee807025-2862-456d-bed4-4f0a48b04cd4" (UID: "ee807025-2862-456d-bed4-4f0a48b04cd4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:11:17.991473 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:11:17.991398    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee807025-2862-456d-bed4-4f0a48b04cd4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ee807025-2862-456d-bed4-4f0a48b04cd4" (UID: "ee807025-2862-456d-bed4-4f0a48b04cd4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:11:17.991635 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:11:17.991496    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ee807025-2862-456d-bed4-4f0a48b04cd4-istiod-ca-cert\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:11:17.991635 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:11:17.991508    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee807025-2862-456d-bed4-4f0a48b04cd4-credential-socket\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:11:17.991635 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:11:17.991517    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ee807025-2862-456d-bed4-4f0a48b04cd4-workload-certs\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:11:17.991635 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:11:17.991525    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ee807025-2862-456d-bed4-4f0a48b04cd4-istio-data\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:11:17.991635 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:11:17.991541    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee807025-2862-456d-bed4-4f0a48b04cd4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ee807025-2862-456d-bed4-4f0a48b04cd4" (UID: "ee807025-2862-456d-bed4-4f0a48b04cd4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:11:17.993190 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:11:17.993161    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee807025-2862-456d-bed4-4f0a48b04cd4-kube-api-access-dtzqz" (OuterVolumeSpecName: "kube-api-access-dtzqz") pod "ee807025-2862-456d-bed4-4f0a48b04cd4" (UID: "ee807025-2862-456d-bed4-4f0a48b04cd4"). InnerVolumeSpecName "kube-api-access-dtzqz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:11:17.993296 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:11:17.993188    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ee807025-2862-456d-bed4-4f0a48b04cd4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ee807025-2862-456d-bed4-4f0a48b04cd4" (UID: "ee807025-2862-456d-bed4-4f0a48b04cd4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 20 01:11:17.993802 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:11:17.993777    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee807025-2862-456d-bed4-4f0a48b04cd4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ee807025-2862-456d-bed4-4f0a48b04cd4" (UID: "ee807025-2862-456d-bed4-4f0a48b04cd4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:11:17.993802 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:11:17.993789    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee807025-2862-456d-bed4-4f0a48b04cd4-istio-token" (OuterVolumeSpecName: "istio-token") pod "ee807025-2862-456d-bed4-4f0a48b04cd4" (UID: "ee807025-2862-456d-bed4-4f0a48b04cd4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:11:18.093021 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:11:18.092977    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ee807025-2862-456d-bed4-4f0a48b04cd4-istio-podinfo\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:11:18.093021 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:11:18.093011    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ee807025-2862-456d-bed4-4f0a48b04cd4-istio-token\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:11:18.093021 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:11:18.093026    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ee807025-2862-456d-bed4-4f0a48b04cd4-istio-envoy\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:11:18.093269 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:11:18.093037    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ee807025-2862-456d-bed4-4f0a48b04cd4-workload-socket\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:11:18.093269 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:11:18.093050    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtzqz\" (UniqueName: \"kubernetes.io/projected/ee807025-2862-456d-bed4-4f0a48b04cd4-kube-api-access-dtzqz\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:11:18.204682 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:11:18.204642    2570 generic.go:356] "Generic (PLEG): container finished" podID="ee807025-2862-456d-bed4-4f0a48b04cd4" containerID="a3810421f72a298881a0ba2efd160eb60068bfbe8474a55a200670d651a5b919" exitCode=0
Sep 20 01:11:18.204919 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:11:18.204696    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv" event={"ID":"ee807025-2862-456d-bed4-4f0a48b04cd4","Type":"ContainerDied","Data":"a3810421f72a298881a0ba2efd160eb60068bfbe8474a55a200670d651a5b919"}
Sep 20 01:11:18.204919 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:11:18.204721    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv"
Sep 20 01:11:18.204919 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:11:18.204774    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv" event={"ID":"ee807025-2862-456d-bed4-4f0a48b04cd4","Type":"ContainerDied","Data":"f0eae557239cf2464eafbf73c54a88c0ddba9644d2c081ef03abb4ecc6b1c045"}
Sep 20 01:11:18.204919 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:11:18.204797    2570 scope.go:117] "RemoveContainer" containerID="a3810421f72a298881a0ba2efd160eb60068bfbe8474a55a200670d651a5b919"
Sep 20 01:11:18.217339 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:11:18.217305    2570 scope.go:117] "RemoveContainer" containerID="73c2f9e23da24cfebfaf500d0e824168a21c84915d574e81517ca2818248cfd3"
Sep 20 01:11:18.226283 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:11:18.226263    2570 scope.go:117] "RemoveContainer" containerID="a3810421f72a298881a0ba2efd160eb60068bfbe8474a55a200670d651a5b919"
Sep 20 01:11:18.226584 ip-10-0-132-108 kubenswrapper[2570]: E0920 01:11:18.226565    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3810421f72a298881a0ba2efd160eb60068bfbe8474a55a200670d651a5b919\": container with ID starting with a3810421f72a298881a0ba2efd160eb60068bfbe8474a55a200670d651a5b919 not found: ID does not exist" containerID="a3810421f72a298881a0ba2efd160eb60068bfbe8474a55a200670d651a5b919"
Sep 20 01:11:18.226632 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:11:18.226593    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3810421f72a298881a0ba2efd160eb60068bfbe8474a55a200670d651a5b919"} err="failed to get container status \"a3810421f72a298881a0ba2efd160eb60068bfbe8474a55a200670d651a5b919\": rpc error: code = NotFound desc = could not find container \"a3810421f72a298881a0ba2efd160eb60068bfbe8474a55a200670d651a5b919\": container with ID starting with a3810421f72a298881a0ba2efd160eb60068bfbe8474a55a200670d651a5b919 not found: ID does not exist"
Sep 20 01:11:18.226632 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:11:18.226611    2570 scope.go:117] "RemoveContainer" containerID="73c2f9e23da24cfebfaf500d0e824168a21c84915d574e81517ca2818248cfd3"
Sep 20 01:11:18.226900 ip-10-0-132-108 kubenswrapper[2570]: E0920 01:11:18.226878    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73c2f9e23da24cfebfaf500d0e824168a21c84915d574e81517ca2818248cfd3\": container with ID starting with 73c2f9e23da24cfebfaf500d0e824168a21c84915d574e81517ca2818248cfd3 not found: ID does not exist" containerID="73c2f9e23da24cfebfaf500d0e824168a21c84915d574e81517ca2818248cfd3"
Sep 20 01:11:18.226964 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:11:18.226909    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73c2f9e23da24cfebfaf500d0e824168a21c84915d574e81517ca2818248cfd3"} err="failed to get container status \"73c2f9e23da24cfebfaf500d0e824168a21c84915d574e81517ca2818248cfd3\": rpc error: code = NotFound desc = could not find container \"73c2f9e23da24cfebfaf500d0e824168a21c84915d574e81517ca2818248cfd3\": container with ID starting with 73c2f9e23da24cfebfaf500d0e824168a21c84915d574e81517ca2818248cfd3 not found: ID does not exist"
Sep 20 01:11:18.228034 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:11:18.228013    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv"]
Sep 20 01:11:18.230588 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:11:18.230568    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-8b864c4f-openshift-default-6df8c5ff64-fmbnv"]
Sep 20 01:11:19.454357 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:11:19.454315    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee807025-2862-456d-bed4-4f0a48b04cd4" path="/var/lib/kubelet/pods/ee807025-2862-456d-bed4-4f0a48b04cd4/volumes"
Sep 20 01:12:06.374198 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:06.374163    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp"]
Sep 20 01:12:06.374952 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:06.374933    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee807025-2862-456d-bed4-4f0a48b04cd4" containerName="istio-proxy"
Sep 20 01:12:06.375004 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:06.374955    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee807025-2862-456d-bed4-4f0a48b04cd4" containerName="istio-proxy"
Sep 20 01:12:06.375040 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:06.375018    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b114fffb-f20a-4896-9269-a9f33f7f50d1" containerName="payload-pre-processing"
Sep 20 01:12:06.375040 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:06.375028    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b114fffb-f20a-4896-9269-a9f33f7f50d1" containerName="payload-pre-processing"
Sep 20 01:12:06.375154 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:06.375143    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee807025-2862-456d-bed4-4f0a48b04cd4" containerName="istio-proxy"
Sep 20 01:12:06.375191 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:06.375159    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee807025-2862-456d-bed4-4f0a48b04cd4" containerName="istio-proxy"
Sep 20 01:12:06.375191 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:06.375172    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="b114fffb-f20a-4896-9269-a9f33f7f50d1" containerName="payload-pre-processing"
Sep 20 01:12:06.378679 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:06.378656    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp"
Sep 20 01:12:06.380974 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:06.380950    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-a5f8d9-openshift-default-dockercfg-bk7z7\""
Sep 20 01:12:06.387910 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:06.387888    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp"]
Sep 20 01:12:06.500527 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:06.500484    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56399c9a-8dde-4f11-83eb-aba87da25ec6-istiod-ca-cert\") pod \"e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp\" (UID: \"56399c9a-8dde-4f11-83eb-aba87da25ec6\") " pod="openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp"
Sep 20 01:12:06.500743 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:06.500560    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56399c9a-8dde-4f11-83eb-aba87da25ec6-istio-data\") pod \"e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp\" (UID: \"56399c9a-8dde-4f11-83eb-aba87da25ec6\") " pod="openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp"
Sep 20 01:12:06.500743 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:06.500631    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56399c9a-8dde-4f11-83eb-aba87da25ec6-credential-socket\") pod \"e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp\" (UID: \"56399c9a-8dde-4f11-83eb-aba87da25ec6\") " pod="openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp"
Sep 20 01:12:06.500743 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:06.500657    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56399c9a-8dde-4f11-83eb-aba87da25ec6-istio-podinfo\") pod \"e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp\" (UID: \"56399c9a-8dde-4f11-83eb-aba87da25ec6\") " pod="openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp"
Sep 20 01:12:06.500743 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:06.500691    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lzxq\" (UniqueName: \"kubernetes.io/projected/56399c9a-8dde-4f11-83eb-aba87da25ec6-kube-api-access-2lzxq\") pod \"e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp\" (UID: \"56399c9a-8dde-4f11-83eb-aba87da25ec6\") " pod="openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp"
Sep 20 01:12:06.501012 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:06.500742    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56399c9a-8dde-4f11-83eb-aba87da25ec6-istio-envoy\") pod \"e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp\" (UID: \"56399c9a-8dde-4f11-83eb-aba87da25ec6\") " pod="openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp"
Sep 20 01:12:06.501012 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:06.500790    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56399c9a-8dde-4f11-83eb-aba87da25ec6-workload-socket\") pod \"e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp\" (UID: \"56399c9a-8dde-4f11-83eb-aba87da25ec6\") " pod="openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp"
Sep 20 01:12:06.501012 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:06.500930    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56399c9a-8dde-4f11-83eb-aba87da25ec6-istio-token\") pod \"e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp\" (UID: \"56399c9a-8dde-4f11-83eb-aba87da25ec6\") " pod="openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp"
Sep 20 01:12:06.501012 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:06.500965    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56399c9a-8dde-4f11-83eb-aba87da25ec6-workload-certs\") pod \"e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp\" (UID: \"56399c9a-8dde-4f11-83eb-aba87da25ec6\") " pod="openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp"
Sep 20 01:12:06.602214 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:06.602179    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56399c9a-8dde-4f11-83eb-aba87da25ec6-istio-token\") pod \"e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp\" (UID: \"56399c9a-8dde-4f11-83eb-aba87da25ec6\") " pod="openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp"
Sep 20 01:12:06.602214 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:06.602216    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56399c9a-8dde-4f11-83eb-aba87da25ec6-workload-certs\") pod \"e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp\" (UID: \"56399c9a-8dde-4f11-83eb-aba87da25ec6\") " pod="openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp"
Sep 20 01:12:06.602470 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:06.602250    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56399c9a-8dde-4f11-83eb-aba87da25ec6-istiod-ca-cert\") pod \"e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp\" (UID: \"56399c9a-8dde-4f11-83eb-aba87da25ec6\") " pod="openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp"
Sep 20 01:12:06.602470 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:06.602273    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56399c9a-8dde-4f11-83eb-aba87da25ec6-istio-data\") pod \"e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp\" (UID: \"56399c9a-8dde-4f11-83eb-aba87da25ec6\") " pod="openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp"
Sep 20 01:12:06.602470 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:06.602310    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56399c9a-8dde-4f11-83eb-aba87da25ec6-credential-socket\") pod \"e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp\" (UID: \"56399c9a-8dde-4f11-83eb-aba87da25ec6\") " pod="openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp"
Sep 20 01:12:06.602470 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:06.602425    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56399c9a-8dde-4f11-83eb-aba87da25ec6-istio-podinfo\") pod \"e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp\" (UID: \"56399c9a-8dde-4f11-83eb-aba87da25ec6\") " pod="openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp"
Sep 20 01:12:06.602470 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:06.602460    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lzxq\" (UniqueName: \"kubernetes.io/projected/56399c9a-8dde-4f11-83eb-aba87da25ec6-kube-api-access-2lzxq\") pod \"e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp\" (UID: \"56399c9a-8dde-4f11-83eb-aba87da25ec6\") " pod="openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp"
Sep 20 01:12:06.602829 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:06.602504    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56399c9a-8dde-4f11-83eb-aba87da25ec6-istio-envoy\") pod \"e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp\" (UID: \"56399c9a-8dde-4f11-83eb-aba87da25ec6\") " pod="openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp"
Sep 20 01:12:06.602829 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:06.602550    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56399c9a-8dde-4f11-83eb-aba87da25ec6-workload-socket\") pod \"e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp\" (UID: \"56399c9a-8dde-4f11-83eb-aba87da25ec6\") " pod="openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp"
Sep 20 01:12:06.602829 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:06.602625    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56399c9a-8dde-4f11-83eb-aba87da25ec6-workload-certs\") pod \"e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp\" (UID: \"56399c9a-8dde-4f11-83eb-aba87da25ec6\") " pod="openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp"
Sep 20 01:12:06.602829 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:06.602674    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56399c9a-8dde-4f11-83eb-aba87da25ec6-credential-socket\") pod \"e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp\" (UID: \"56399c9a-8dde-4f11-83eb-aba87da25ec6\") " pod="openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp"
Sep 20 01:12:06.602829 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:06.602724    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56399c9a-8dde-4f11-83eb-aba87da25ec6-istio-data\") pod \"e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp\" (UID: \"56399c9a-8dde-4f11-83eb-aba87da25ec6\") " pod="openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp"
Sep 20 01:12:06.603184 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:06.603160    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56399c9a-8dde-4f11-83eb-aba87da25ec6-workload-socket\") pod \"e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp\" (UID: \"56399c9a-8dde-4f11-83eb-aba87da25ec6\") " pod="openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp"
Sep 20 01:12:06.603434 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:06.603399    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56399c9a-8dde-4f11-83eb-aba87da25ec6-istiod-ca-cert\") pod \"e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp\" (UID: \"56399c9a-8dde-4f11-83eb-aba87da25ec6\") " pod="openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp"
Sep 20 01:12:06.604961 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:06.604942    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56399c9a-8dde-4f11-83eb-aba87da25ec6-istio-envoy\") pod \"e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp\" (UID: \"56399c9a-8dde-4f11-83eb-aba87da25ec6\") " pod="openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp"
Sep 20 01:12:06.605252 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:06.605235    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56399c9a-8dde-4f11-83eb-aba87da25ec6-istio-podinfo\") pod \"e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp\" (UID: \"56399c9a-8dde-4f11-83eb-aba87da25ec6\") " pod="openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp"
Sep 20 01:12:06.609599 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:06.609574    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56399c9a-8dde-4f11-83eb-aba87da25ec6-istio-token\") pod \"e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp\" (UID: \"56399c9a-8dde-4f11-83eb-aba87da25ec6\") " pod="openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp"
Sep 20 01:12:06.609704 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:06.609660    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lzxq\" (UniqueName: \"kubernetes.io/projected/56399c9a-8dde-4f11-83eb-aba87da25ec6-kube-api-access-2lzxq\") pod \"e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp\" (UID: \"56399c9a-8dde-4f11-83eb-aba87da25ec6\") " pod="openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp"
Sep 20 01:12:06.691801 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:06.691717    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp"
Sep 20 01:12:06.976293 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:06.976267    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp"]
Sep 20 01:12:06.978088 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:12:06.978055    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56399c9a_8dde_4f11_83eb_aba87da25ec6.slice/crio-f5479eef4ccac83ea3b66bca74de99c986950bf6aa3334a4dcde21a5581301c0 WatchSource:0}: Error finding container f5479eef4ccac83ea3b66bca74de99c986950bf6aa3334a4dcde21a5581301c0: Status 404 returned error can't find the container with id f5479eef4ccac83ea3b66bca74de99c986950bf6aa3334a4dcde21a5581301c0
Sep 20 01:12:06.980489 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:06.980458    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:12:06.980618 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:06.980544    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:12:06.980618 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:06.980571    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:12:07.489940 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:07.489898    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp" event={"ID":"56399c9a-8dde-4f11-83eb-aba87da25ec6","Type":"ContainerStarted","Data":"7183acd0c5d18e23ddb9e89870379bf1f96647bd0a1602a9c8cafd66896c3f16"}
Sep 20 01:12:07.490411 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:07.489954    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp" event={"ID":"56399c9a-8dde-4f11-83eb-aba87da25ec6","Type":"ContainerStarted","Data":"f5479eef4ccac83ea3b66bca74de99c986950bf6aa3334a4dcde21a5581301c0"}
Sep 20 01:12:07.509514 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:07.509462    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp" podStartSLOduration=1.509445619 podStartE2EDuration="1.509445619s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:12:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:12:07.506127838 +0000 UTC m=+1464.120283748" watchObservedRunningTime="2026-09-20 01:12:07.509445619 +0000 UTC m=+1464.123601516"
Sep 20 01:12:07.692833 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:07.692795    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp"
Sep 20 01:12:08.697664 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:08.697636    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp"
Sep 20 01:12:09.502115 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:09.502077    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp"
Sep 20 01:12:09.502995 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:09.502977    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp"
Sep 20 01:12:15.107493 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:15.107458    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-a5f8d9-57774b9766-qlgrw"]
Sep 20 01:12:15.107945 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:15.107931    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee807025-2862-456d-bed4-4f0a48b04cd4" containerName="istio-proxy"
Sep 20 01:12:15.107997 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:15.107946    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee807025-2862-456d-bed4-4f0a48b04cd4" containerName="istio-proxy"
Sep 20 01:12:15.111333 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:15.111317    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a5f8d9-57774b9766-qlgrw"
Sep 20 01:12:15.113273 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:15.113250    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-a5f8d9\""
Sep 20 01:12:15.119749 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:15.119724    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-a5f8d9-57774b9766-qlgrw"]
Sep 20 01:12:15.144801 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:15.144762    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a5f8d9-5c477b6f89-jn9b8"]
Sep 20 01:12:15.148543 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:15.148526    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-a5f8d9-5c477b6f89-jn9b8"
Sep 20 01:12:15.150455 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:15.150433    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-a5f8d9-dockercfg-blcwl\""
Sep 20 01:12:15.158734 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:15.158711    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a5f8d9-5c477b6f89-jn9b8"]
Sep 20 01:12:15.187770 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:15.187734    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4982\" (UniqueName: \"kubernetes.io/projected/213a44d7-d486-4c3e-b08a-2c32273bb471-kube-api-access-w4982\") pod \"payload-pre-processing-e2e-api-a-a5f8d9-57774b9766-qlgrw\" (UID: \"213a44d7-d486-4c3e-b08a-2c32273bb471\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-a5f8d9-57774b9766-qlgrw"
Sep 20 01:12:15.187952 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:15.187841    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e2125bf-d79d-485d-8148-8479d023c585-plugins-config-volume\") pod \"payload-processing-e2e-api-a-a5f8d9-5c477b6f89-jn9b8\" (UID: \"8e2125bf-d79d-485d-8148-8479d023c585\") " pod="openshift-ingress/payload-processing-e2e-api-a-a5f8d9-5c477b6f89-jn9b8"
Sep 20 01:12:15.187952 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:15.187901    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2m2dt\" (UniqueName: \"kubernetes.io/projected/8e2125bf-d79d-485d-8148-8479d023c585-kube-api-access-2m2dt\") pod \"payload-processing-e2e-api-a-a5f8d9-5c477b6f89-jn9b8\" (UID: \"8e2125bf-d79d-485d-8148-8479d023c585\") " pod="openshift-ingress/payload-processing-e2e-api-a-a5f8d9-5c477b6f89-jn9b8"
Sep 20 01:12:15.187952 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:15.187942    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/213a44d7-d486-4c3e-b08a-2c32273bb471-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-a5f8d9-57774b9766-qlgrw\" (UID: \"213a44d7-d486-4c3e-b08a-2c32273bb471\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-a5f8d9-57774b9766-qlgrw"
Sep 20 01:12:15.289326 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:15.289277    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e2125bf-d79d-485d-8148-8479d023c585-plugins-config-volume\") pod \"payload-processing-e2e-api-a-a5f8d9-5c477b6f89-jn9b8\" (UID: \"8e2125bf-d79d-485d-8148-8479d023c585\") " pod="openshift-ingress/payload-processing-e2e-api-a-a5f8d9-5c477b6f89-jn9b8"
Sep 20 01:12:15.289619 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:15.289581    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m2dt\" (UniqueName: \"kubernetes.io/projected/8e2125bf-d79d-485d-8148-8479d023c585-kube-api-access-2m2dt\") pod \"payload-processing-e2e-api-a-a5f8d9-5c477b6f89-jn9b8\" (UID: \"8e2125bf-d79d-485d-8148-8479d023c585\") " pod="openshift-ingress/payload-processing-e2e-api-a-a5f8d9-5c477b6f89-jn9b8"
Sep 20 01:12:15.289752 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:15.289668    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/213a44d7-d486-4c3e-b08a-2c32273bb471-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-a5f8d9-57774b9766-qlgrw\" (UID: \"213a44d7-d486-4c3e-b08a-2c32273bb471\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-a5f8d9-57774b9766-qlgrw"
Sep 20 01:12:15.289899 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:15.289818    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4982\" (UniqueName: \"kubernetes.io/projected/213a44d7-d486-4c3e-b08a-2c32273bb471-kube-api-access-w4982\") pod \"payload-pre-processing-e2e-api-a-a5f8d9-57774b9766-qlgrw\" (UID: \"213a44d7-d486-4c3e-b08a-2c32273bb471\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-a5f8d9-57774b9766-qlgrw"
Sep 20 01:12:15.290206 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:15.290171    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e2125bf-d79d-485d-8148-8479d023c585-plugins-config-volume\") pod \"payload-processing-e2e-api-a-a5f8d9-5c477b6f89-jn9b8\" (UID: \"8e2125bf-d79d-485d-8148-8479d023c585\") " pod="openshift-ingress/payload-processing-e2e-api-a-a5f8d9-5c477b6f89-jn9b8"
Sep 20 01:12:15.290514 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:15.290494    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/213a44d7-d486-4c3e-b08a-2c32273bb471-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-a5f8d9-57774b9766-qlgrw\" (UID: \"213a44d7-d486-4c3e-b08a-2c32273bb471\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-a5f8d9-57774b9766-qlgrw"
Sep 20 01:12:15.299963 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:15.299939    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4982\" (UniqueName: \"kubernetes.io/projected/213a44d7-d486-4c3e-b08a-2c32273bb471-kube-api-access-w4982\") pod \"payload-pre-processing-e2e-api-a-a5f8d9-57774b9766-qlgrw\" (UID: \"213a44d7-d486-4c3e-b08a-2c32273bb471\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-a5f8d9-57774b9766-qlgrw"
Sep 20 01:12:15.300998 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:15.300978    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2m2dt\" (UniqueName: \"kubernetes.io/projected/8e2125bf-d79d-485d-8148-8479d023c585-kube-api-access-2m2dt\") pod \"payload-processing-e2e-api-a-a5f8d9-5c477b6f89-jn9b8\" (UID: \"8e2125bf-d79d-485d-8148-8479d023c585\") " pod="openshift-ingress/payload-processing-e2e-api-a-a5f8d9-5c477b6f89-jn9b8"
Sep 20 01:12:15.424486 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:15.424449    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a5f8d9-57774b9766-qlgrw"
Sep 20 01:12:15.460040 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:15.460007    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-a5f8d9-5c477b6f89-jn9b8"
Sep 20 01:12:15.699923 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:15.699895    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-a5f8d9-57774b9766-qlgrw"]
Sep 20 01:12:15.701305 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:12:15.701279    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod213a44d7_d486_4c3e_b08a_2c32273bb471.slice/crio-9ef48f007637bb1a20995021168ff9ff9bf25c5b208f2ecfa2bb4cf3e2f57c5f WatchSource:0}: Error finding container 9ef48f007637bb1a20995021168ff9ff9bf25c5b208f2ecfa2bb4cf3e2f57c5f: Status 404 returned error can't find the container with id 9ef48f007637bb1a20995021168ff9ff9bf25c5b208f2ecfa2bb4cf3e2f57c5f
Sep 20 01:12:15.743699 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:15.743674    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a5f8d9-5c477b6f89-jn9b8"]
Sep 20 01:12:15.746132 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:12:15.746111    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e2125bf_d79d_485d_8148_8479d023c585.slice/crio-c6a32148b4e05de113c83ba27860846c9e62c3d391853e55ec9f55e0f9b1b2b0 WatchSource:0}: Error finding container c6a32148b4e05de113c83ba27860846c9e62c3d391853e55ec9f55e0f9b1b2b0: Status 404 returned error can't find the container with id c6a32148b4e05de113c83ba27860846c9e62c3d391853e55ec9f55e0f9b1b2b0
Sep 20 01:12:16.546115 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:16.546066    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a5f8d9-57774b9766-qlgrw" event={"ID":"213a44d7-d486-4c3e-b08a-2c32273bb471","Type":"ContainerStarted","Data":"605b6ed3b3656851a961c4a5108a9bed2bab7d8a3f8d914e857c1426e800822c"}
Sep 20 01:12:16.546578 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:16.546166    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a5f8d9-57774b9766-qlgrw"
Sep 20 01:12:16.546578 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:16.546196    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a5f8d9-57774b9766-qlgrw" event={"ID":"213a44d7-d486-4c3e-b08a-2c32273bb471","Type":"ContainerStarted","Data":"9ef48f007637bb1a20995021168ff9ff9bf25c5b208f2ecfa2bb4cf3e2f57c5f"}
Sep 20 01:12:16.547587 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:16.547564    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-a5f8d9-5c477b6f89-jn9b8" event={"ID":"8e2125bf-d79d-485d-8148-8479d023c585","Type":"ContainerStarted","Data":"908551e4957b8c761803d92d24d155a93d96e679a5bb33f705df979150759806"}
Sep 20 01:12:16.547719 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:16.547602    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-a5f8d9-5c477b6f89-jn9b8" event={"ID":"8e2125bf-d79d-485d-8148-8479d023c585","Type":"ContainerStarted","Data":"c6a32148b4e05de113c83ba27860846c9e62c3d391853e55ec9f55e0f9b1b2b0"}
Sep 20 01:12:16.547719 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:16.547627    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-a5f8d9-5c477b6f89-jn9b8"
Sep 20 01:12:16.561934 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:16.561887    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a5f8d9-57774b9766-qlgrw" podStartSLOduration=1.561872513 podStartE2EDuration="1.561872513s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:12:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:12:16.560569585 +0000 UTC m=+1473.174725506" watchObservedRunningTime="2026-09-20 01:12:16.561872513 +0000 UTC m=+1473.176028400"
Sep 20 01:12:16.578274 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:16.578217    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-a5f8d9-5c477b6f89-jn9b8" podStartSLOduration=1.578198758 podStartE2EDuration="1.578198758s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:12:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:12:16.57598274 +0000 UTC m=+1473.190138681" watchObservedRunningTime="2026-09-20 01:12:16.578198758 +0000 UTC m=+1473.192354659"
Sep 20 01:12:27.555019 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:27.554989    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a5f8d9-57774b9766-qlgrw"
Sep 20 01:12:27.555506 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:27.555061    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-a5f8d9-5c477b6f89-jn9b8"
Sep 20 01:12:45.532640 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:45.532613    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65l6f_bf898d8f-ed0f-4b4e-9a87-8e6167b29481/ovn-acl-logging/0.log"
Sep 20 01:12:45.534667 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:45.534644    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65l6f_bf898d8f-ed0f-4b4e-9a87-8e6167b29481/ovn-acl-logging/0.log"
Sep 20 01:12:45.729655 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:45.729622    2570 scope.go:117] "RemoveContainer" containerID="727e15140eaf63f86d1b10a18e10c3778f20dfd284b3822480df71996b21a39d"
Sep 20 01:12:49.762433 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:49.762395    2570 generic.go:356] "Generic (PLEG): container finished" podID="56399c9a-8dde-4f11-83eb-aba87da25ec6" containerID="7183acd0c5d18e23ddb9e89870379bf1f96647bd0a1602a9c8cafd66896c3f16" exitCode=0
Sep 20 01:12:49.762846 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:49.762488    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp" event={"ID":"56399c9a-8dde-4f11-83eb-aba87da25ec6","Type":"ContainerDied","Data":"7183acd0c5d18e23ddb9e89870379bf1f96647bd0a1602a9c8cafd66896c3f16"}
Sep 20 01:12:49.762991 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:49.762974    2570 scope.go:117] "RemoveContainer" containerID="7183acd0c5d18e23ddb9e89870379bf1f96647bd0a1602a9c8cafd66896c3f16"
Sep 20 01:12:49.764367 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:49.764343    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:12:49.764438 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:49.764411    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:12:49.764475 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:49.764445    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:12:49.986700 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:49.986661    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-bc4088-7f5645b65d-qkwz2"]
Sep 20 01:12:49.990360 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:49.990340    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-bc4088-7f5645b65d-qkwz2"
Sep 20 01:12:49.992670 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:49.992640    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-bc4088-dockercfg-25np6\""
Sep 20 01:12:49.992670 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:49.992664    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-bc4088\""
Sep 20 01:12:49.999781 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:49.999759    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-bc4088-7f5645b65d-qkwz2"]
Sep 20 01:12:50.019089 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:50.019015    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-bc4088-85dbcf6b95-nvlwv"]
Sep 20 01:12:50.021732 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:50.021716    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-bc4088-85dbcf6b95-nvlwv"
Sep 20 01:12:50.033387 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:50.033357    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-bc4088-85dbcf6b95-nvlwv"]
Sep 20 01:12:50.063473 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:50.063437    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rp89h\" (UniqueName: \"kubernetes.io/projected/56dbfe16-dc35-44bf-acdd-66218ffff0ee-kube-api-access-rp89h\") pod \"payload-pre-processing-e2e-api-b-bc4088-7f5645b65d-qkwz2\" (UID: \"56dbfe16-dc35-44bf-acdd-66218ffff0ee\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-bc4088-7f5645b65d-qkwz2"
Sep 20 01:12:50.063679 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:50.063556    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/56dbfe16-dc35-44bf-acdd-66218ffff0ee-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-bc4088-7f5645b65d-qkwz2\" (UID: \"56dbfe16-dc35-44bf-acdd-66218ffff0ee\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-bc4088-7f5645b65d-qkwz2"
Sep 20 01:12:50.063679 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:50.063667    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r96d\" (UniqueName: \"kubernetes.io/projected/3c6c38d5-23ca-4a3a-8e8f-8bd575eadce6-kube-api-access-2r96d\") pod \"payload-processing-e2e-api-b-bc4088-85dbcf6b95-nvlwv\" (UID: \"3c6c38d5-23ca-4a3a-8e8f-8bd575eadce6\") " pod="openshift-ingress/payload-processing-e2e-api-b-bc4088-85dbcf6b95-nvlwv"
Sep 20 01:12:50.063814 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:50.063774    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3c6c38d5-23ca-4a3a-8e8f-8bd575eadce6-plugins-config-volume\") pod \"payload-processing-e2e-api-b-bc4088-85dbcf6b95-nvlwv\" (UID: \"3c6c38d5-23ca-4a3a-8e8f-8bd575eadce6\") " pod="openshift-ingress/payload-processing-e2e-api-b-bc4088-85dbcf6b95-nvlwv"
Sep 20 01:12:50.164671 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:50.164637    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rp89h\" (UniqueName: \"kubernetes.io/projected/56dbfe16-dc35-44bf-acdd-66218ffff0ee-kube-api-access-rp89h\") pod \"payload-pre-processing-e2e-api-b-bc4088-7f5645b65d-qkwz2\" (UID: \"56dbfe16-dc35-44bf-acdd-66218ffff0ee\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-bc4088-7f5645b65d-qkwz2"
Sep 20 01:12:50.164992 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:50.164683    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/56dbfe16-dc35-44bf-acdd-66218ffff0ee-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-bc4088-7f5645b65d-qkwz2\" (UID: \"56dbfe16-dc35-44bf-acdd-66218ffff0ee\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-bc4088-7f5645b65d-qkwz2"
Sep 20 01:12:50.164992 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:50.164727    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r96d\" (UniqueName: \"kubernetes.io/projected/3c6c38d5-23ca-4a3a-8e8f-8bd575eadce6-kube-api-access-2r96d\") pod \"payload-processing-e2e-api-b-bc4088-85dbcf6b95-nvlwv\" (UID: \"3c6c38d5-23ca-4a3a-8e8f-8bd575eadce6\") " pod="openshift-ingress/payload-processing-e2e-api-b-bc4088-85dbcf6b95-nvlwv"
Sep 20 01:12:50.164992 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:50.164783    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3c6c38d5-23ca-4a3a-8e8f-8bd575eadce6-plugins-config-volume\") pod \"payload-processing-e2e-api-b-bc4088-85dbcf6b95-nvlwv\" (UID: \"3c6c38d5-23ca-4a3a-8e8f-8bd575eadce6\") " pod="openshift-ingress/payload-processing-e2e-api-b-bc4088-85dbcf6b95-nvlwv"
Sep 20 01:12:50.165662 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:50.165638    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/56dbfe16-dc35-44bf-acdd-66218ffff0ee-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-bc4088-7f5645b65d-qkwz2\" (UID: \"56dbfe16-dc35-44bf-acdd-66218ffff0ee\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-bc4088-7f5645b65d-qkwz2"
Sep 20 01:12:50.165710 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:50.165639    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3c6c38d5-23ca-4a3a-8e8f-8bd575eadce6-plugins-config-volume\") pod \"payload-processing-e2e-api-b-bc4088-85dbcf6b95-nvlwv\" (UID: \"3c6c38d5-23ca-4a3a-8e8f-8bd575eadce6\") " pod="openshift-ingress/payload-processing-e2e-api-b-bc4088-85dbcf6b95-nvlwv"
Sep 20 01:12:50.173625 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:50.173601    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r96d\" (UniqueName: \"kubernetes.io/projected/3c6c38d5-23ca-4a3a-8e8f-8bd575eadce6-kube-api-access-2r96d\") pod \"payload-processing-e2e-api-b-bc4088-85dbcf6b95-nvlwv\" (UID: \"3c6c38d5-23ca-4a3a-8e8f-8bd575eadce6\") " pod="openshift-ingress/payload-processing-e2e-api-b-bc4088-85dbcf6b95-nvlwv"
Sep 20 01:12:50.173786 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:50.173767    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rp89h\" (UniqueName: \"kubernetes.io/projected/56dbfe16-dc35-44bf-acdd-66218ffff0ee-kube-api-access-rp89h\") pod \"payload-pre-processing-e2e-api-b-bc4088-7f5645b65d-qkwz2\" (UID: \"56dbfe16-dc35-44bf-acdd-66218ffff0ee\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-bc4088-7f5645b65d-qkwz2"
Sep 20 01:12:50.303201 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:50.303110    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-bc4088-7f5645b65d-qkwz2"
Sep 20 01:12:50.334355 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:50.334317    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-bc4088-85dbcf6b95-nvlwv"
Sep 20 01:12:50.593325 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:50.593294    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-bc4088-7f5645b65d-qkwz2"]
Sep 20 01:12:50.594799 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:12:50.594775    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56dbfe16_dc35_44bf_acdd_66218ffff0ee.slice/crio-4b3480683dd9398a114190aa37879a82800bf31430f3c5ad06abf9e67872df93 WatchSource:0}: Error finding container 4b3480683dd9398a114190aa37879a82800bf31430f3c5ad06abf9e67872df93: Status 404 returned error can't find the container with id 4b3480683dd9398a114190aa37879a82800bf31430f3c5ad06abf9e67872df93
Sep 20 01:12:50.624681 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:50.624660    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-bc4088-85dbcf6b95-nvlwv"]
Sep 20 01:12:50.632085 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:12:50.632058    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c6c38d5_23ca_4a3a_8e8f_8bd575eadce6.slice/crio-4139e25a7f18d398b20cbfa1e1038e438571c623f32168049324e6a733423bcb WatchSource:0}: Error finding container 4139e25a7f18d398b20cbfa1e1038e438571c623f32168049324e6a733423bcb: Status 404 returned error can't find the container with id 4139e25a7f18d398b20cbfa1e1038e438571c623f32168049324e6a733423bcb
Sep 20 01:12:50.774558 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:50.774511    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-bc4088-85dbcf6b95-nvlwv" event={"ID":"3c6c38d5-23ca-4a3a-8e8f-8bd575eadce6","Type":"ContainerStarted","Data":"dc7c115282b662c9e0f80ee767bdc4b302beac7c315e7810cf9f1bce4a365499"}
Sep 20 01:12:50.775077 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:50.774586    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-bc4088-85dbcf6b95-nvlwv" event={"ID":"3c6c38d5-23ca-4a3a-8e8f-8bd575eadce6","Type":"ContainerStarted","Data":"4139e25a7f18d398b20cbfa1e1038e438571c623f32168049324e6a733423bcb"}
Sep 20 01:12:50.777882 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:50.775439    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-bc4088-85dbcf6b95-nvlwv"
Sep 20 01:12:50.778435 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:50.778406    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-bc4088-7f5645b65d-qkwz2" event={"ID":"56dbfe16-dc35-44bf-acdd-66218ffff0ee","Type":"ContainerStarted","Data":"35c917f8e656f156b7e8aa266b258d028d5afb2c3f3ae0f515b39c5bddc0bb36"}
Sep 20 01:12:50.778520 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:50.778461    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-bc4088-7f5645b65d-qkwz2" event={"ID":"56dbfe16-dc35-44bf-acdd-66218ffff0ee","Type":"ContainerStarted","Data":"4b3480683dd9398a114190aa37879a82800bf31430f3c5ad06abf9e67872df93"}
Sep 20 01:12:50.778842 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:50.778807    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-bc4088-7f5645b65d-qkwz2"
Sep 20 01:12:50.781156 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:50.781130    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp" event={"ID":"56399c9a-8dde-4f11-83eb-aba87da25ec6","Type":"ContainerStarted","Data":"a4fc79d992b4ec34a191971242d8984897f0d8c68ca7257577887915e8643424"}
Sep 20 01:12:50.793622 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:50.793580    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-bc4088-85dbcf6b95-nvlwv" podStartSLOduration=0.793554048 podStartE2EDuration="793.554048ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:12:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:12:50.79222706 +0000 UTC m=+1507.406383001" watchObservedRunningTime="2026-09-20 01:12:50.793554048 +0000 UTC m=+1507.407709945"
Sep 20 01:12:50.826694 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:50.826636    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-bc4088-7f5645b65d-qkwz2" podStartSLOduration=1.82661409 podStartE2EDuration="1.82661409s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:12:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:12:50.823312629 +0000 UTC m=+1507.437468577" watchObservedRunningTime="2026-09-20 01:12:50.82661409 +0000 UTC m=+1507.440769989"
Sep 20 01:12:51.692419 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:51.692379    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp"
Sep 20 01:12:51.693814 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:51.693788    2570 patch_prober.go:28] interesting pod/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Sep 20 01:12:51.693981 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:51.693844    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp" podUID="56399c9a-8dde-4f11-83eb-aba87da25ec6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Sep 20 01:12:52.692532 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:52.692493    2570 patch_prober.go:28] interesting pod/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Sep 20 01:12:52.692958 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:52.692557    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp" podUID="56399c9a-8dde-4f11-83eb-aba87da25ec6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Sep 20 01:12:53.692598 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:53.692561    2570 patch_prober.go:28] interesting pod/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Sep 20 01:12:53.693021 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:53.692620    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp" podUID="56399c9a-8dde-4f11-83eb-aba87da25ec6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Sep 20 01:12:54.502468 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:54.502426    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp"
Sep 20 01:12:54.692202 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:54.692165    2570 patch_prober.go:28] interesting pod/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Sep 20 01:12:54.692405 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:54.692232    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp" podUID="56399c9a-8dde-4f11-83eb-aba87da25ec6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Sep 20 01:12:55.692777 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:55.692736    2570 patch_prober.go:28] interesting pod/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Sep 20 01:12:55.693291 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:55.692802    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp" podUID="56399c9a-8dde-4f11-83eb-aba87da25ec6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Sep 20 01:12:56.696881 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:56.696838    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp"
Sep 20 01:12:56.697853 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:12:56.697833    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp"
Sep 20 01:13:02.796324 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:02.796293    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-bc4088-85dbcf6b95-nvlwv"
Sep 20 01:13:02.796697 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:02.796368    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-bc4088-7f5645b65d-qkwz2"
Sep 20 01:13:32.755049 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:32.755010    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a5f8d9-5c477b6f89-jn9b8"]
Sep 20 01:13:32.755551 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:32.755268    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-a5f8d9-5c477b6f89-jn9b8" podUID="8e2125bf-d79d-485d-8148-8479d023c585" containerName="payload-processing" containerID="cri-o://908551e4957b8c761803d92d24d155a93d96e679a5bb33f705df979150759806" gracePeriod=30
Sep 20 01:13:32.764618 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:32.764300    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-a5f8d9-57774b9766-qlgrw"]
Sep 20 01:13:32.764618 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:32.764525    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a5f8d9-57774b9766-qlgrw" podUID="213a44d7-d486-4c3e-b08a-2c32273bb471" containerName="payload-pre-processing" containerID="cri-o://605b6ed3b3656851a961c4a5108a9bed2bab7d8a3f8d914e857c1426e800822c" gracePeriod=30
Sep 20 01:13:33.057113 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:33.057070    2570 generic.go:356] "Generic (PLEG): container finished" podID="213a44d7-d486-4c3e-b08a-2c32273bb471" containerID="605b6ed3b3656851a961c4a5108a9bed2bab7d8a3f8d914e857c1426e800822c" exitCode=0
Sep 20 01:13:33.057277 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:33.057248    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a5f8d9-57774b9766-qlgrw" event={"ID":"213a44d7-d486-4c3e-b08a-2c32273bb471","Type":"ContainerDied","Data":"605b6ed3b3656851a961c4a5108a9bed2bab7d8a3f8d914e857c1426e800822c"}
Sep 20 01:13:33.059150 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:33.058972    2570 generic.go:356] "Generic (PLEG): container finished" podID="8e2125bf-d79d-485d-8148-8479d023c585" containerID="908551e4957b8c761803d92d24d155a93d96e679a5bb33f705df979150759806" exitCode=0
Sep 20 01:13:33.059150 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:33.059039    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-a5f8d9-5c477b6f89-jn9b8" event={"ID":"8e2125bf-d79d-485d-8148-8479d023c585","Type":"ContainerDied","Data":"908551e4957b8c761803d92d24d155a93d96e679a5bb33f705df979150759806"}
Sep 20 01:13:33.078048 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:33.078022    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-a5f8d9-5c477b6f89-jn9b8"
Sep 20 01:13:33.081721 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:33.081688    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a5f8d9-57774b9766-qlgrw"
Sep 20 01:13:33.146032 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:33.145999    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2m2dt\" (UniqueName: \"kubernetes.io/projected/8e2125bf-d79d-485d-8148-8479d023c585-kube-api-access-2m2dt\") pod \"8e2125bf-d79d-485d-8148-8479d023c585\" (UID: \"8e2125bf-d79d-485d-8148-8479d023c585\") "
Sep 20 01:13:33.146211 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:33.146054    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w4982\" (UniqueName: \"kubernetes.io/projected/213a44d7-d486-4c3e-b08a-2c32273bb471-kube-api-access-w4982\") pod \"213a44d7-d486-4c3e-b08a-2c32273bb471\" (UID: \"213a44d7-d486-4c3e-b08a-2c32273bb471\") "
Sep 20 01:13:33.146211 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:33.146120    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/213a44d7-d486-4c3e-b08a-2c32273bb471-plugins-config-volume\") pod \"213a44d7-d486-4c3e-b08a-2c32273bb471\" (UID: \"213a44d7-d486-4c3e-b08a-2c32273bb471\") "
Sep 20 01:13:33.146211 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:33.146187    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e2125bf-d79d-485d-8148-8479d023c585-plugins-config-volume\") pod \"8e2125bf-d79d-485d-8148-8479d023c585\" (UID: \"8e2125bf-d79d-485d-8148-8479d023c585\") "
Sep 20 01:13:33.146596 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:33.146567    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e2125bf-d79d-485d-8148-8479d023c585-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8e2125bf-d79d-485d-8148-8479d023c585" (UID: "8e2125bf-d79d-485d-8148-8479d023c585"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:13:33.146596 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:33.146573    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/213a44d7-d486-4c3e-b08a-2c32273bb471-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "213a44d7-d486-4c3e-b08a-2c32273bb471" (UID: "213a44d7-d486-4c3e-b08a-2c32273bb471"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:13:33.148394 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:33.148374    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/213a44d7-d486-4c3e-b08a-2c32273bb471-kube-api-access-w4982" (OuterVolumeSpecName: "kube-api-access-w4982") pod "213a44d7-d486-4c3e-b08a-2c32273bb471" (UID: "213a44d7-d486-4c3e-b08a-2c32273bb471"). InnerVolumeSpecName "kube-api-access-w4982". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:13:33.148693 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:33.148674    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e2125bf-d79d-485d-8148-8479d023c585-kube-api-access-2m2dt" (OuterVolumeSpecName: "kube-api-access-2m2dt") pod "8e2125bf-d79d-485d-8148-8479d023c585" (UID: "8e2125bf-d79d-485d-8148-8479d023c585"). InnerVolumeSpecName "kube-api-access-2m2dt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:13:33.248043 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:33.248006    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/213a44d7-d486-4c3e-b08a-2c32273bb471-plugins-config-volume\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:13:33.248043 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:33.248036    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8e2125bf-d79d-485d-8148-8479d023c585-plugins-config-volume\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:13:33.248043 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:33.248045    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2m2dt\" (UniqueName: \"kubernetes.io/projected/8e2125bf-d79d-485d-8148-8479d023c585-kube-api-access-2m2dt\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:13:33.248043 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:33.248054    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4982\" (UniqueName: \"kubernetes.io/projected/213a44d7-d486-4c3e-b08a-2c32273bb471-kube-api-access-w4982\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:13:34.066128 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:34.066027    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a5f8d9-57774b9766-qlgrw"
Sep 20 01:13:34.066128 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:34.066044    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-a5f8d9-57774b9766-qlgrw" event={"ID":"213a44d7-d486-4c3e-b08a-2c32273bb471","Type":"ContainerDied","Data":"9ef48f007637bb1a20995021168ff9ff9bf25c5b208f2ecfa2bb4cf3e2f57c5f"}
Sep 20 01:13:34.066619 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:34.066152    2570 scope.go:117] "RemoveContainer" containerID="605b6ed3b3656851a961c4a5108a9bed2bab7d8a3f8d914e857c1426e800822c"
Sep 20 01:13:34.067680 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:34.067660    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-a5f8d9-5c477b6f89-jn9b8"
Sep 20 01:13:34.067680 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:34.067667    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-a5f8d9-5c477b6f89-jn9b8" event={"ID":"8e2125bf-d79d-485d-8148-8479d023c585","Type":"ContainerDied","Data":"c6a32148b4e05de113c83ba27860846c9e62c3d391853e55ec9f55e0f9b1b2b0"}
Sep 20 01:13:34.077918 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:34.076931    2570 scope.go:117] "RemoveContainer" containerID="908551e4957b8c761803d92d24d155a93d96e679a5bb33f705df979150759806"
Sep 20 01:13:34.084675 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:34.084655    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a5f8d9-5c477b6f89-jn9b8"]
Sep 20 01:13:34.087935 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:34.087918    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-a5f8d9-5c477b6f89-jn9b8"]
Sep 20 01:13:34.097900 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:34.097876    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-a5f8d9-57774b9766-qlgrw"]
Sep 20 01:13:34.103227 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:34.103206    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-a5f8d9-57774b9766-qlgrw"]
Sep 20 01:13:35.454852 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:35.454810    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="213a44d7-d486-4c3e-b08a-2c32273bb471" path="/var/lib/kubelet/pods/213a44d7-d486-4c3e-b08a-2c32273bb471/volumes"
Sep 20 01:13:35.455377 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:35.455360    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e2125bf-d79d-485d-8148-8479d023c585" path="/var/lib/kubelet/pods/8e2125bf-d79d-485d-8148-8479d023c585/volumes"
Sep 20 01:13:39.540165 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:39.540127    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp"]
Sep 20 01:13:39.540641 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:39.540367    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp" podUID="56399c9a-8dde-4f11-83eb-aba87da25ec6" containerName="istio-proxy" containerID="cri-o://a4fc79d992b4ec34a191971242d8984897f0d8c68ca7257577887915e8643424" gracePeriod=30
Sep 20 01:13:39.906909 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:39.906847    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bc4088-49gxl"]
Sep 20 01:13:39.907371 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:39.907357    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="213a44d7-d486-4c3e-b08a-2c32273bb471" containerName="payload-pre-processing"
Sep 20 01:13:39.907426 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:39.907373    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="213a44d7-d486-4c3e-b08a-2c32273bb471" containerName="payload-pre-processing"
Sep 20 01:13:39.907426 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:39.907382    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e2125bf-d79d-485d-8148-8479d023c585" containerName="payload-processing"
Sep 20 01:13:39.907426 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:39.907388    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e2125bf-d79d-485d-8148-8479d023c585" containerName="payload-processing"
Sep 20 01:13:39.907522 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:39.907476    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="213a44d7-d486-4c3e-b08a-2c32273bb471" containerName="payload-pre-processing"
Sep 20 01:13:39.907522 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:39.907486    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e2125bf-d79d-485d-8148-8479d023c585" containerName="payload-processing"
Sep 20 01:13:39.911919 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:39.911900    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bc4088-49gxl"
Sep 20 01:13:39.914375 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:39.914343    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5xngg\""
Sep 20 01:13:39.914521 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:39.914395    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 20 01:13:39.917174 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:39.917146    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bc4088-49gxl"]
Sep 20 01:13:40.026252 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:40.026213    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/96d54c89-e8c0-4d72-bd26-cc859cf46c47-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-bc4088-49gxl\" (UID: \"96d54c89-e8c0-4d72-bd26-cc859cf46c47\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bc4088-49gxl"
Sep 20 01:13:40.127289 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:40.127259    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/96d54c89-e8c0-4d72-bd26-cc859cf46c47-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-bc4088-49gxl\" (UID: \"96d54c89-e8c0-4d72-bd26-cc859cf46c47\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bc4088-49gxl"
Sep 20 01:13:40.127829 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:40.127809    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/96d54c89-e8c0-4d72-bd26-cc859cf46c47-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-bc4088-49gxl\" (UID: \"96d54c89-e8c0-4d72-bd26-cc859cf46c47\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bc4088-49gxl"
Sep 20 01:13:40.227125 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:40.227042    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bc4088-49gxl"
Sep 20 01:13:40.506120 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:40.505396    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bc4088-49gxl"]
Sep 20 01:13:40.509344 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:13:40.509305    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96d54c89_e8c0_4d72_bd26_cc859cf46c47.slice/crio-b1ee47a9e20aafa607e26395e25891973e6788b3d09e8c0b2344a81063e70bae WatchSource:0}: Error finding container b1ee47a9e20aafa607e26395e25891973e6788b3d09e8c0b2344a81063e70bae: Status 404 returned error can't find the container with id b1ee47a9e20aafa607e26395e25891973e6788b3d09e8c0b2344a81063e70bae
Sep 20 01:13:41.114600 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:41.114500    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bc4088-49gxl" event={"ID":"96d54c89-e8c0-4d72-bd26-cc859cf46c47","Type":"ContainerStarted","Data":"a15bb3b3b75d5bc2a045a863589a8426aac09b5b3150b5448b099a615b34c7b2"}
Sep 20 01:13:41.114600 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:41.114561    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bc4088-49gxl" event={"ID":"96d54c89-e8c0-4d72-bd26-cc859cf46c47","Type":"ContainerStarted","Data":"b1ee47a9e20aafa607e26395e25891973e6788b3d09e8c0b2344a81063e70bae"}
Sep 20 01:13:41.129396 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:41.129344    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bc4088-49gxl" podStartSLOduration=2.129327098 podStartE2EDuration="2.129327098s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:13:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:13:41.127534791 +0000 UTC m=+1557.741690688" watchObservedRunningTime="2026-09-20 01:13:41.129327098 +0000 UTC m=+1557.743482996"
Sep 20 01:13:41.700452 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:41.700415    2570 patch_prober.go:28] interesting pod/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 20 01:13:41.700630 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:41.700490    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp" podUID="56399c9a-8dde-4f11-83eb-aba87da25ec6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 20 01:13:42.121941 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:42.121911    2570 generic.go:356] "Generic (PLEG): container finished" podID="96d54c89-e8c0-4d72-bd26-cc859cf46c47" containerID="a15bb3b3b75d5bc2a045a863589a8426aac09b5b3150b5448b099a615b34c7b2" exitCode=0
Sep 20 01:13:42.122350 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:42.122004    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bc4088-49gxl" event={"ID":"96d54c89-e8c0-4d72-bd26-cc859cf46c47","Type":"ContainerDied","Data":"a15bb3b3b75d5bc2a045a863589a8426aac09b5b3150b5448b099a615b34c7b2"}
Sep 20 01:13:43.268845 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:43.268819    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bc4088-49gxl"
Sep 20 01:13:43.360548 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:43.360512    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/96d54c89-e8c0-4d72-bd26-cc859cf46c47-maas-api-service-ca\") pod \"96d54c89-e8c0-4d72-bd26-cc859cf46c47\" (UID: \"96d54c89-e8c0-4d72-bd26-cc859cf46c47\") "
Sep 20 01:13:43.360983 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:43.360958    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96d54c89-e8c0-4d72-bd26-cc859cf46c47-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "96d54c89-e8c0-4d72-bd26-cc859cf46c47" (UID: "96d54c89-e8c0-4d72-bd26-cc859cf46c47"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:13:43.462055 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:43.461999    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/96d54c89-e8c0-4d72-bd26-cc859cf46c47-maas-api-service-ca\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:13:44.134667 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:44.134632    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bc4088-49gxl"
Sep 20 01:13:44.134824 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:44.134683    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bc4088-49gxl" event={"ID":"96d54c89-e8c0-4d72-bd26-cc859cf46c47","Type":"ContainerDied","Data":"b1ee47a9e20aafa607e26395e25891973e6788b3d09e8c0b2344a81063e70bae"}
Sep 20 01:13:44.134824 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:44.134732    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b1ee47a9e20aafa607e26395e25891973e6788b3d09e8c0b2344a81063e70bae"
Sep 20 01:13:44.801882 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:44.801800    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp"
Sep 20 01:13:44.977673 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:44.977632    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56399c9a-8dde-4f11-83eb-aba87da25ec6-credential-socket\") pod \"56399c9a-8dde-4f11-83eb-aba87da25ec6\" (UID: \"56399c9a-8dde-4f11-83eb-aba87da25ec6\") "
Sep 20 01:13:44.977912 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:44.977680    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56399c9a-8dde-4f11-83eb-aba87da25ec6-istio-token\") pod \"56399c9a-8dde-4f11-83eb-aba87da25ec6\" (UID: \"56399c9a-8dde-4f11-83eb-aba87da25ec6\") "
Sep 20 01:13:44.977912 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:44.977726    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56399c9a-8dde-4f11-83eb-aba87da25ec6-workload-certs\") pod \"56399c9a-8dde-4f11-83eb-aba87da25ec6\" (UID: \"56399c9a-8dde-4f11-83eb-aba87da25ec6\") "
Sep 20 01:13:44.977912 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:44.977773    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56399c9a-8dde-4f11-83eb-aba87da25ec6-workload-socket\") pod \"56399c9a-8dde-4f11-83eb-aba87da25ec6\" (UID: \"56399c9a-8dde-4f11-83eb-aba87da25ec6\") "
Sep 20 01:13:44.977912 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:44.977851    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56399c9a-8dde-4f11-83eb-aba87da25ec6-istio-data\") pod \"56399c9a-8dde-4f11-83eb-aba87da25ec6\" (UID: \"56399c9a-8dde-4f11-83eb-aba87da25ec6\") "
Sep 20 01:13:44.978139 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:44.977988    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56399c9a-8dde-4f11-83eb-aba87da25ec6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "56399c9a-8dde-4f11-83eb-aba87da25ec6" (UID: "56399c9a-8dde-4f11-83eb-aba87da25ec6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:13:44.978139 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:44.977928    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56399c9a-8dde-4f11-83eb-aba87da25ec6-istiod-ca-cert\") pod \"56399c9a-8dde-4f11-83eb-aba87da25ec6\" (UID: \"56399c9a-8dde-4f11-83eb-aba87da25ec6\") "
Sep 20 01:13:44.978256 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:44.978163    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56399c9a-8dde-4f11-83eb-aba87da25ec6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "56399c9a-8dde-4f11-83eb-aba87da25ec6" (UID: "56399c9a-8dde-4f11-83eb-aba87da25ec6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:13:44.978256 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:44.978209    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56399c9a-8dde-4f11-83eb-aba87da25ec6-istio-data" (OuterVolumeSpecName: "istio-data") pod "56399c9a-8dde-4f11-83eb-aba87da25ec6" (UID: "56399c9a-8dde-4f11-83eb-aba87da25ec6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:13:44.978366 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:44.978352    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56399c9a-8dde-4f11-83eb-aba87da25ec6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "56399c9a-8dde-4f11-83eb-aba87da25ec6" (UID: "56399c9a-8dde-4f11-83eb-aba87da25ec6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:13:44.978444 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:44.978407    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56399c9a-8dde-4f11-83eb-aba87da25ec6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "56399c9a-8dde-4f11-83eb-aba87da25ec6" (UID: "56399c9a-8dde-4f11-83eb-aba87da25ec6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:13:44.978507 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:44.978461    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2lzxq\" (UniqueName: \"kubernetes.io/projected/56399c9a-8dde-4f11-83eb-aba87da25ec6-kube-api-access-2lzxq\") pod \"56399c9a-8dde-4f11-83eb-aba87da25ec6\" (UID: \"56399c9a-8dde-4f11-83eb-aba87da25ec6\") "
Sep 20 01:13:44.978507 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:44.978494    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56399c9a-8dde-4f11-83eb-aba87da25ec6-istio-podinfo\") pod \"56399c9a-8dde-4f11-83eb-aba87da25ec6\" (UID: \"56399c9a-8dde-4f11-83eb-aba87da25ec6\") "
Sep 20 01:13:44.978606 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:44.978526    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56399c9a-8dde-4f11-83eb-aba87da25ec6-istio-envoy\") pod \"56399c9a-8dde-4f11-83eb-aba87da25ec6\" (UID: \"56399c9a-8dde-4f11-83eb-aba87da25ec6\") "
Sep 20 01:13:44.978974 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:44.978949    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56399c9a-8dde-4f11-83eb-aba87da25ec6-credential-socket\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:13:44.978974 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:44.978976    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56399c9a-8dde-4f11-83eb-aba87da25ec6-workload-certs\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:13:44.979243 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:44.978990    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56399c9a-8dde-4f11-83eb-aba87da25ec6-workload-socket\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:13:44.979243 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:44.979004    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56399c9a-8dde-4f11-83eb-aba87da25ec6-istio-data\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:13:44.979243 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:44.979016    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56399c9a-8dde-4f11-83eb-aba87da25ec6-istiod-ca-cert\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:13:44.980299 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:44.980277    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56399c9a-8dde-4f11-83eb-aba87da25ec6-istio-token" (OuterVolumeSpecName: "istio-token") pod "56399c9a-8dde-4f11-83eb-aba87da25ec6" (UID: "56399c9a-8dde-4f11-83eb-aba87da25ec6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:13:44.980757 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:44.980737    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56399c9a-8dde-4f11-83eb-aba87da25ec6-kube-api-access-2lzxq" (OuterVolumeSpecName: "kube-api-access-2lzxq") pod "56399c9a-8dde-4f11-83eb-aba87da25ec6" (UID: "56399c9a-8dde-4f11-83eb-aba87da25ec6"). InnerVolumeSpecName "kube-api-access-2lzxq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:13:44.981088 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:44.981070    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/56399c9a-8dde-4f11-83eb-aba87da25ec6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "56399c9a-8dde-4f11-83eb-aba87da25ec6" (UID: "56399c9a-8dde-4f11-83eb-aba87da25ec6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 20 01:13:44.981199 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:44.981177    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56399c9a-8dde-4f11-83eb-aba87da25ec6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "56399c9a-8dde-4f11-83eb-aba87da25ec6" (UID: "56399c9a-8dde-4f11-83eb-aba87da25ec6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:13:45.079823 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:45.079743    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2lzxq\" (UniqueName: \"kubernetes.io/projected/56399c9a-8dde-4f11-83eb-aba87da25ec6-kube-api-access-2lzxq\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:13:45.079823 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:45.079770    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56399c9a-8dde-4f11-83eb-aba87da25ec6-istio-podinfo\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:13:45.079823 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:45.079780    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56399c9a-8dde-4f11-83eb-aba87da25ec6-istio-envoy\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:13:45.079823 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:45.079788    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56399c9a-8dde-4f11-83eb-aba87da25ec6-istio-token\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:13:45.145965 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:45.145931    2570 generic.go:356] "Generic (PLEG): container finished" podID="56399c9a-8dde-4f11-83eb-aba87da25ec6" containerID="a4fc79d992b4ec34a191971242d8984897f0d8c68ca7257577887915e8643424" exitCode=0
Sep 20 01:13:45.146186 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:45.146017    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp"
Sep 20 01:13:45.146186 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:45.146014    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp" event={"ID":"56399c9a-8dde-4f11-83eb-aba87da25ec6","Type":"ContainerDied","Data":"a4fc79d992b4ec34a191971242d8984897f0d8c68ca7257577887915e8643424"}
Sep 20 01:13:45.146186 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:45.146151    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp" event={"ID":"56399c9a-8dde-4f11-83eb-aba87da25ec6","Type":"ContainerDied","Data":"f5479eef4ccac83ea3b66bca74de99c986950bf6aa3334a4dcde21a5581301c0"}
Sep 20 01:13:45.146186 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:45.146174    2570 scope.go:117] "RemoveContainer" containerID="a4fc79d992b4ec34a191971242d8984897f0d8c68ca7257577887915e8643424"
Sep 20 01:13:45.156553 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:45.156537    2570 scope.go:117] "RemoveContainer" containerID="7183acd0c5d18e23ddb9e89870379bf1f96647bd0a1602a9c8cafd66896c3f16"
Sep 20 01:13:45.165175 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:45.165160    2570 scope.go:117] "RemoveContainer" containerID="a4fc79d992b4ec34a191971242d8984897f0d8c68ca7257577887915e8643424"
Sep 20 01:13:45.165460 ip-10-0-132-108 kubenswrapper[2570]: E0920 01:13:45.165441    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4fc79d992b4ec34a191971242d8984897f0d8c68ca7257577887915e8643424\": container with ID starting with a4fc79d992b4ec34a191971242d8984897f0d8c68ca7257577887915e8643424 not found: ID does not exist" containerID="a4fc79d992b4ec34a191971242d8984897f0d8c68ca7257577887915e8643424"
Sep 20 01:13:45.165520 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:45.165469    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4fc79d992b4ec34a191971242d8984897f0d8c68ca7257577887915e8643424"} err="failed to get container status \"a4fc79d992b4ec34a191971242d8984897f0d8c68ca7257577887915e8643424\": rpc error: code = NotFound desc = could not find container \"a4fc79d992b4ec34a191971242d8984897f0d8c68ca7257577887915e8643424\": container with ID starting with a4fc79d992b4ec34a191971242d8984897f0d8c68ca7257577887915e8643424 not found: ID does not exist"
Sep 20 01:13:45.165520 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:45.165484    2570 scope.go:117] "RemoveContainer" containerID="7183acd0c5d18e23ddb9e89870379bf1f96647bd0a1602a9c8cafd66896c3f16"
Sep 20 01:13:45.165703 ip-10-0-132-108 kubenswrapper[2570]: E0920 01:13:45.165685    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7183acd0c5d18e23ddb9e89870379bf1f96647bd0a1602a9c8cafd66896c3f16\": container with ID starting with 7183acd0c5d18e23ddb9e89870379bf1f96647bd0a1602a9c8cafd66896c3f16 not found: ID does not exist" containerID="7183acd0c5d18e23ddb9e89870379bf1f96647bd0a1602a9c8cafd66896c3f16"
Sep 20 01:13:45.165767 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:45.165717    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7183acd0c5d18e23ddb9e89870379bf1f96647bd0a1602a9c8cafd66896c3f16"} err="failed to get container status \"7183acd0c5d18e23ddb9e89870379bf1f96647bd0a1602a9c8cafd66896c3f16\": rpc error: code = NotFound desc = could not find container \"7183acd0c5d18e23ddb9e89870379bf1f96647bd0a1602a9c8cafd66896c3f16\": container with ID starting with 7183acd0c5d18e23ddb9e89870379bf1f96647bd0a1602a9c8cafd66896c3f16 not found: ID does not exist"
Sep 20 01:13:45.172845 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:45.172820    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp"]
Sep 20 01:13:45.177195 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:45.177174    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-a5f8d9-openshift-default-7c7bfcdd46-s74gp"]
Sep 20 01:13:45.454592 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:45.454561    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56399c9a-8dde-4f11-83eb-aba87da25ec6" path="/var/lib/kubelet/pods/56399c9a-8dde-4f11-83eb-aba87da25ec6/volumes"
Sep 20 01:13:51.209452 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:51.209419    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-4e301e-sm6tl"]
Sep 20 01:13:51.209899 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:51.209886    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96d54c89-e8c0-4d72-bd26-cc859cf46c47" containerName="revoke-keys"
Sep 20 01:13:51.209899 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:51.209901    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="96d54c89-e8c0-4d72-bd26-cc859cf46c47" containerName="revoke-keys"
Sep 20 01:13:51.209982 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:51.209922    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56399c9a-8dde-4f11-83eb-aba87da25ec6" containerName="istio-proxy"
Sep 20 01:13:51.209982 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:51.209928    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="56399c9a-8dde-4f11-83eb-aba87da25ec6" containerName="istio-proxy"
Sep 20 01:13:51.209982 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:51.209943    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56399c9a-8dde-4f11-83eb-aba87da25ec6" containerName="istio-proxy"
Sep 20 01:13:51.209982 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:51.209949    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="56399c9a-8dde-4f11-83eb-aba87da25ec6" containerName="istio-proxy"
Sep 20 01:13:51.210111 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:51.210014    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="96d54c89-e8c0-4d72-bd26-cc859cf46c47" containerName="revoke-keys"
Sep 20 01:13:51.210111 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:51.210022    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="56399c9a-8dde-4f11-83eb-aba87da25ec6" containerName="istio-proxy"
Sep 20 01:13:51.214902 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:51.214854    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-4e301e-sm6tl"
Sep 20 01:13:51.217115 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:51.217088    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 20 01:13:51.217291 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:51.217091    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5xngg\""
Sep 20 01:13:51.219234 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:51.219211    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-4e301e-sm6tl"]
Sep 20 01:13:51.248938 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:51.248896    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a65fd17-374e-400f-bc39-5ceb6c9b11f8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-4e301e-sm6tl\" (UID: \"3a65fd17-374e-400f-bc39-5ceb6c9b11f8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-4e301e-sm6tl"
Sep 20 01:13:51.350465 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:51.350432    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a65fd17-374e-400f-bc39-5ceb6c9b11f8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-4e301e-sm6tl\" (UID: \"3a65fd17-374e-400f-bc39-5ceb6c9b11f8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-4e301e-sm6tl"
Sep 20 01:13:51.351079 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:51.351057    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a65fd17-374e-400f-bc39-5ceb6c9b11f8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-4e301e-sm6tl\" (UID: \"3a65fd17-374e-400f-bc39-5ceb6c9b11f8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-4e301e-sm6tl"
Sep 20 01:13:51.529750 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:51.529666    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-4e301e-sm6tl"
Sep 20 01:13:51.810533 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:51.810503    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-4e301e-sm6tl"]
Sep 20 01:13:51.812635 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:13:51.812607    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a65fd17_374e_400f_bc39_5ceb6c9b11f8.slice/crio-7e66aec0dacf502789655e71f64ea83f6ba087b243f2f80c094c565ecc11f5f4 WatchSource:0}: Error finding container 7e66aec0dacf502789655e71f64ea83f6ba087b243f2f80c094c565ecc11f5f4: Status 404 returned error can't find the container with id 7e66aec0dacf502789655e71f64ea83f6ba087b243f2f80c094c565ecc11f5f4
Sep 20 01:13:52.187464 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:52.187428    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-4e301e-sm6tl" event={"ID":"3a65fd17-374e-400f-bc39-5ceb6c9b11f8","Type":"ContainerStarted","Data":"2f58f17fd81c2b8b3781ba54da3e66b6617d718ff56e3403c9f65f8a4822f9ee"}
Sep 20 01:13:52.187613 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:52.187491    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-4e301e-sm6tl" event={"ID":"3a65fd17-374e-400f-bc39-5ceb6c9b11f8","Type":"ContainerStarted","Data":"7e66aec0dacf502789655e71f64ea83f6ba087b243f2f80c094c565ecc11f5f4"}
Sep 20 01:13:52.201396 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:52.201348    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-4e301e-sm6tl" podStartSLOduration=1.201332989 podStartE2EDuration="1.201332989s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:13:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:13:52.200531359 +0000 UTC m=+1568.814687303" watchObservedRunningTime="2026-09-20 01:13:52.201332989 +0000 UTC m=+1568.815488886"
Sep 20 01:13:53.194704 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:53.194666    2570 generic.go:356] "Generic (PLEG): container finished" podID="3a65fd17-374e-400f-bc39-5ceb6c9b11f8" containerID="2f58f17fd81c2b8b3781ba54da3e66b6617d718ff56e3403c9f65f8a4822f9ee" exitCode=0
Sep 20 01:13:53.195143 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:53.194743    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-4e301e-sm6tl" event={"ID":"3a65fd17-374e-400f-bc39-5ceb6c9b11f8","Type":"ContainerDied","Data":"2f58f17fd81c2b8b3781ba54da3e66b6617d718ff56e3403c9f65f8a4822f9ee"}
Sep 20 01:13:53.950557 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:53.950520    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-bc4088-85dbcf6b95-nvlwv"]
Sep 20 01:13:53.950882 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:53.950811    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-bc4088-85dbcf6b95-nvlwv" podUID="3c6c38d5-23ca-4a3a-8e8f-8bd575eadce6" containerName="payload-processing" containerID="cri-o://dc7c115282b662c9e0f80ee767bdc4b302beac7c315e7810cf9f1bce4a365499" gracePeriod=30
Sep 20 01:13:53.960229 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:53.960200    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-bc4088-7f5645b65d-qkwz2"]
Sep 20 01:13:53.961440 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:53.960644    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-bc4088-7f5645b65d-qkwz2" podUID="56dbfe16-dc35-44bf-acdd-66218ffff0ee" containerName="payload-pre-processing" containerID="cri-o://35c917f8e656f156b7e8aa266b258d028d5afb2c3f3ae0f515b39c5bddc0bb36" gracePeriod=30
Sep 20 01:13:54.241626 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:54.241590    2570 generic.go:356] "Generic (PLEG): container finished" podID="3c6c38d5-23ca-4a3a-8e8f-8bd575eadce6" containerID="dc7c115282b662c9e0f80ee767bdc4b302beac7c315e7810cf9f1bce4a365499" exitCode=0
Sep 20 01:13:54.242395 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:54.242172    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-bc4088-85dbcf6b95-nvlwv" event={"ID":"3c6c38d5-23ca-4a3a-8e8f-8bd575eadce6","Type":"ContainerDied","Data":"dc7c115282b662c9e0f80ee767bdc4b302beac7c315e7810cf9f1bce4a365499"}
Sep 20 01:13:54.244636 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:54.244342    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-bc4088-85dbcf6b95-nvlwv"
Sep 20 01:13:54.244636 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:54.244538    2570 generic.go:356] "Generic (PLEG): container finished" podID="56dbfe16-dc35-44bf-acdd-66218ffff0ee" containerID="35c917f8e656f156b7e8aa266b258d028d5afb2c3f3ae0f515b39c5bddc0bb36" exitCode=0
Sep 20 01:13:54.244935 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:54.244873    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-bc4088-7f5645b65d-qkwz2" event={"ID":"56dbfe16-dc35-44bf-acdd-66218ffff0ee","Type":"ContainerDied","Data":"35c917f8e656f156b7e8aa266b258d028d5afb2c3f3ae0f515b39c5bddc0bb36"}
Sep 20 01:13:54.291109 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:54.290525    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3c6c38d5-23ca-4a3a-8e8f-8bd575eadce6-plugins-config-volume\") pod \"3c6c38d5-23ca-4a3a-8e8f-8bd575eadce6\" (UID: \"3c6c38d5-23ca-4a3a-8e8f-8bd575eadce6\") "
Sep 20 01:13:54.291109 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:54.290656    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2r96d\" (UniqueName: \"kubernetes.io/projected/3c6c38d5-23ca-4a3a-8e8f-8bd575eadce6-kube-api-access-2r96d\") pod \"3c6c38d5-23ca-4a3a-8e8f-8bd575eadce6\" (UID: \"3c6c38d5-23ca-4a3a-8e8f-8bd575eadce6\") "
Sep 20 01:13:54.291109 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:54.291033    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c6c38d5-23ca-4a3a-8e8f-8bd575eadce6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3c6c38d5-23ca-4a3a-8e8f-8bd575eadce6" (UID: "3c6c38d5-23ca-4a3a-8e8f-8bd575eadce6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:13:54.293985 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:54.293954    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bc4088-49gxl"]
Sep 20 01:13:54.294137 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:54.294078    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c6c38d5-23ca-4a3a-8e8f-8bd575eadce6-kube-api-access-2r96d" (OuterVolumeSpecName: "kube-api-access-2r96d") pod "3c6c38d5-23ca-4a3a-8e8f-8bd575eadce6" (UID: "3c6c38d5-23ca-4a3a-8e8f-8bd575eadce6"). InnerVolumeSpecName "kube-api-access-2r96d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:13:54.297220 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:54.297196    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-bc4088-49gxl"]
Sep 20 01:13:54.302839 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:54.302815    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-bc4088-7f5645b65d-qkwz2"
Sep 20 01:13:54.391457 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:54.391416    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rp89h\" (UniqueName: \"kubernetes.io/projected/56dbfe16-dc35-44bf-acdd-66218ffff0ee-kube-api-access-rp89h\") pod \"56dbfe16-dc35-44bf-acdd-66218ffff0ee\" (UID: \"56dbfe16-dc35-44bf-acdd-66218ffff0ee\") "
Sep 20 01:13:54.391648 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:54.391531    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/56dbfe16-dc35-44bf-acdd-66218ffff0ee-plugins-config-volume\") pod \"56dbfe16-dc35-44bf-acdd-66218ffff0ee\" (UID: \"56dbfe16-dc35-44bf-acdd-66218ffff0ee\") "
Sep 20 01:13:54.391754 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:54.391740    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3c6c38d5-23ca-4a3a-8e8f-8bd575eadce6-plugins-config-volume\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:13:54.391811 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:54.391756    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2r96d\" (UniqueName: \"kubernetes.io/projected/3c6c38d5-23ca-4a3a-8e8f-8bd575eadce6-kube-api-access-2r96d\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:13:54.391905 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:54.391880    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56dbfe16-dc35-44bf-acdd-66218ffff0ee-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "56dbfe16-dc35-44bf-acdd-66218ffff0ee" (UID: "56dbfe16-dc35-44bf-acdd-66218ffff0ee"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:13:54.393610 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:54.393587    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56dbfe16-dc35-44bf-acdd-66218ffff0ee-kube-api-access-rp89h" (OuterVolumeSpecName: "kube-api-access-rp89h") pod "56dbfe16-dc35-44bf-acdd-66218ffff0ee" (UID: "56dbfe16-dc35-44bf-acdd-66218ffff0ee"). InnerVolumeSpecName "kube-api-access-rp89h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:13:54.409126 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:54.409105    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-4e301e-sm6tl"
Sep 20 01:13:54.492596 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:54.492510    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a65fd17-374e-400f-bc39-5ceb6c9b11f8-maas-api-service-ca\") pod \"3a65fd17-374e-400f-bc39-5ceb6c9b11f8\" (UID: \"3a65fd17-374e-400f-bc39-5ceb6c9b11f8\") "
Sep 20 01:13:54.493224 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:54.492938    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a65fd17-374e-400f-bc39-5ceb6c9b11f8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3a65fd17-374e-400f-bc39-5ceb6c9b11f8" (UID: "3a65fd17-374e-400f-bc39-5ceb6c9b11f8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:13:54.493368 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:54.493303    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a65fd17-374e-400f-bc39-5ceb6c9b11f8-maas-api-service-ca\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:13:54.493368 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:54.493321    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/56dbfe16-dc35-44bf-acdd-66218ffff0ee-plugins-config-volume\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:13:54.493368 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:54.493331    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rp89h\" (UniqueName: \"kubernetes.io/projected/56dbfe16-dc35-44bf-acdd-66218ffff0ee-kube-api-access-rp89h\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:13:55.251625 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:55.251530    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-bc4088-85dbcf6b95-nvlwv"
Sep 20 01:13:55.252057 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:55.251527    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-bc4088-85dbcf6b95-nvlwv" event={"ID":"3c6c38d5-23ca-4a3a-8e8f-8bd575eadce6","Type":"ContainerDied","Data":"4139e25a7f18d398b20cbfa1e1038e438571c623f32168049324e6a733423bcb"}
Sep 20 01:13:55.252057 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:55.251675    2570 scope.go:117] "RemoveContainer" containerID="dc7c115282b662c9e0f80ee767bdc4b302beac7c315e7810cf9f1bce4a365499"
Sep 20 01:13:55.253136 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:55.253115    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-bc4088-7f5645b65d-qkwz2"
Sep 20 01:13:55.253136 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:55.253122    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-bc4088-7f5645b65d-qkwz2" event={"ID":"56dbfe16-dc35-44bf-acdd-66218ffff0ee","Type":"ContainerDied","Data":"4b3480683dd9398a114190aa37879a82800bf31430f3c5ad06abf9e67872df93"}
Sep 20 01:13:55.254489 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:55.254471    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-4e301e-sm6tl" event={"ID":"3a65fd17-374e-400f-bc39-5ceb6c9b11f8","Type":"ContainerDied","Data":"7e66aec0dacf502789655e71f64ea83f6ba087b243f2f80c094c565ecc11f5f4"}
Sep 20 01:13:55.254599 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:55.254498    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-4e301e-sm6tl"
Sep 20 01:13:55.254599 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:55.254502    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7e66aec0dacf502789655e71f64ea83f6ba087b243f2f80c094c565ecc11f5f4"
Sep 20 01:13:55.262264 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:55.262246    2570 scope.go:117] "RemoveContainer" containerID="35c917f8e656f156b7e8aa266b258d028d5afb2c3f3ae0f515b39c5bddc0bb36"
Sep 20 01:13:55.290780 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:55.290754    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-bc4088-85dbcf6b95-nvlwv"]
Sep 20 01:13:55.294647 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:55.294628    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-bc4088-85dbcf6b95-nvlwv"]
Sep 20 01:13:55.304559 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:55.304538    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-bc4088-7f5645b65d-qkwz2"]
Sep 20 01:13:55.308671 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:55.308648    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-bc4088-7f5645b65d-qkwz2"]
Sep 20 01:13:55.454854 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:55.454822    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c6c38d5-23ca-4a3a-8e8f-8bd575eadce6" path="/var/lib/kubelet/pods/3c6c38d5-23ca-4a3a-8e8f-8bd575eadce6/volumes"
Sep 20 01:13:55.455275 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:55.455260    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56dbfe16-dc35-44bf-acdd-66218ffff0ee" path="/var/lib/kubelet/pods/56dbfe16-dc35-44bf-acdd-66218ffff0ee/volumes"
Sep 20 01:13:55.455608 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:55.455595    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96d54c89-e8c0-4d72-bd26-cc859cf46c47" path="/var/lib/kubelet/pods/96d54c89-e8c0-4d72-bd26-cc859cf46c47/volumes"
Sep 20 01:13:56.153090 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:13:56.153055    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-4e301e/distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww"]
Sep 20 01:14:01.180329 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:01.180293    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-0766ea-vvq6t"]
Sep 20 01:14:01.180880 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:01.180847    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c6c38d5-23ca-4a3a-8e8f-8bd575eadce6" containerName="payload-processing"
Sep 20 01:14:01.180926 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:01.180881    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c6c38d5-23ca-4a3a-8e8f-8bd575eadce6" containerName="payload-processing"
Sep 20 01:14:01.180926 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:01.180903    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56dbfe16-dc35-44bf-acdd-66218ffff0ee" containerName="payload-pre-processing"
Sep 20 01:14:01.180926 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:01.180909    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="56dbfe16-dc35-44bf-acdd-66218ffff0ee" containerName="payload-pre-processing"
Sep 20 01:14:01.180926 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:01.180914    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a65fd17-374e-400f-bc39-5ceb6c9b11f8" containerName="revoke-keys"
Sep 20 01:14:01.180926 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:01.180919    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a65fd17-374e-400f-bc39-5ceb6c9b11f8" containerName="revoke-keys"
Sep 20 01:14:01.181091 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:01.180996    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="56dbfe16-dc35-44bf-acdd-66218ffff0ee" containerName="payload-pre-processing"
Sep 20 01:14:01.181091 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:01.181004    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c6c38d5-23ca-4a3a-8e8f-8bd575eadce6" containerName="payload-processing"
Sep 20 01:14:01.181091 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:01.181012    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="56399c9a-8dde-4f11-83eb-aba87da25ec6" containerName="istio-proxy"
Sep 20 01:14:01.181091 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:01.181017    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a65fd17-374e-400f-bc39-5ceb6c9b11f8" containerName="revoke-keys"
Sep 20 01:14:01.185664 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:01.185644    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-0766ea-vvq6t"
Sep 20 01:14:01.187843 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:01.187822    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 20 01:14:01.188059 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:01.187889    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5xngg\""
Sep 20 01:14:01.190528 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:01.190489    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-0766ea-vvq6t"]
Sep 20 01:14:01.266233 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:01.266194    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/49c347b3-5c73-49ba-b9b6-49e26d33c49d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-0766ea-vvq6t\" (UID: \"49c347b3-5c73-49ba-b9b6-49e26d33c49d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-0766ea-vvq6t"
Sep 20 01:14:01.367367 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:01.367332    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/49c347b3-5c73-49ba-b9b6-49e26d33c49d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-0766ea-vvq6t\" (UID: \"49c347b3-5c73-49ba-b9b6-49e26d33c49d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-0766ea-vvq6t"
Sep 20 01:14:01.367941 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:01.367920    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/49c347b3-5c73-49ba-b9b6-49e26d33c49d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-0766ea-vvq6t\" (UID: \"49c347b3-5c73-49ba-b9b6-49e26d33c49d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-0766ea-vvq6t"
Sep 20 01:14:01.500541 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:01.500451    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-0766ea-vvq6t"
Sep 20 01:14:01.778464 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:01.778257    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-0766ea-vvq6t"]
Sep 20 01:14:01.781297 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:14:01.781271    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49c347b3_5c73_49ba_b9b6_49e26d33c49d.slice/crio-a0017e34c0e6f19a359ec5e0d41ab1f43ef56f7ea6b0f21e72619abaa8778979 WatchSource:0}: Error finding container a0017e34c0e6f19a359ec5e0d41ab1f43ef56f7ea6b0f21e72619abaa8778979: Status 404 returned error can't find the container with id a0017e34c0e6f19a359ec5e0d41ab1f43ef56f7ea6b0f21e72619abaa8778979
Sep 20 01:14:02.300668 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:02.300635    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-0766ea-vvq6t" event={"ID":"49c347b3-5c73-49ba-b9b6-49e26d33c49d","Type":"ContainerStarted","Data":"eaf58d1a8a0af742d7e489143dff6761c4d6d408f627eca7f3fa76a055387238"}
Sep 20 01:14:02.301072 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:02.300686    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-0766ea-vvq6t" event={"ID":"49c347b3-5c73-49ba-b9b6-49e26d33c49d","Type":"ContainerStarted","Data":"a0017e34c0e6f19a359ec5e0d41ab1f43ef56f7ea6b0f21e72619abaa8778979"}
Sep 20 01:14:02.317388 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:02.317290    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-0766ea-vvq6t" podStartSLOduration=1.317273958 podStartE2EDuration="1.317273958s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:14:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:14:02.314492734 +0000 UTC m=+1578.928648646" watchObservedRunningTime="2026-09-20 01:14:02.317273958 +0000 UTC m=+1578.931429845"
Sep 20 01:14:03.308148 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:03.308116    2570 generic.go:356] "Generic (PLEG): container finished" podID="49c347b3-5c73-49ba-b9b6-49e26d33c49d" containerID="eaf58d1a8a0af742d7e489143dff6761c4d6d408f627eca7f3fa76a055387238" exitCode=0
Sep 20 01:14:03.308539 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:03.308204    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-0766ea-vvq6t" event={"ID":"49c347b3-5c73-49ba-b9b6-49e26d33c49d","Type":"ContainerDied","Data":"eaf58d1a8a0af742d7e489143dff6761c4d6d408f627eca7f3fa76a055387238"}
Sep 20 01:14:04.454812 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:04.454786    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-0766ea-vvq6t"
Sep 20 01:14:04.599010 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:04.598919    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/49c347b3-5c73-49ba-b9b6-49e26d33c49d-maas-api-service-ca\") pod \"49c347b3-5c73-49ba-b9b6-49e26d33c49d\" (UID: \"49c347b3-5c73-49ba-b9b6-49e26d33c49d\") "
Sep 20 01:14:04.599257 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:04.599234    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49c347b3-5c73-49ba-b9b6-49e26d33c49d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "49c347b3-5c73-49ba-b9b6-49e26d33c49d" (UID: "49c347b3-5c73-49ba-b9b6-49e26d33c49d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:14:04.699996 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:04.699960    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/49c347b3-5c73-49ba-b9b6-49e26d33c49d-maas-api-service-ca\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:14:05.321381 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:05.321349    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-0766ea-vvq6t" event={"ID":"49c347b3-5c73-49ba-b9b6-49e26d33c49d","Type":"ContainerDied","Data":"a0017e34c0e6f19a359ec5e0d41ab1f43ef56f7ea6b0f21e72619abaa8778979"}
Sep 20 01:14:05.321381 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:05.321383    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-0766ea-vvq6t"
Sep 20 01:14:05.321596 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:05.321405    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a0017e34c0e6f19a359ec5e0d41ab1f43ef56f7ea6b0f21e72619abaa8778979"
Sep 20 01:14:07.349970 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:07.349931    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-4e301e-779cf8d855-vcx2q"]
Sep 20 01:14:07.350399 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:07.350179    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w4-4e301e-779cf8d855-vcx2q" podUID="9a6b99d7-c704-4470-8dbd-afd2dc4e0be6" containerName="payload-processing" containerID="cri-o://c99ffc2284fc148431fae78a5be085bf6b4d3efc024be5882fe0a94d3163a79e" gracePeriod=30
Sep 20 01:14:07.513338 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:07.513304    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-4e301e-sm6tl"]
Sep 20 01:14:07.516128 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:07.516100    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-4e301e-sm6tl"]
Sep 20 01:14:07.641834 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:07.641806    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-4e301e-779cf8d855-vcx2q"
Sep 20 01:14:07.734250 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:07.734216    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sst4j\" (UniqueName: \"kubernetes.io/projected/9a6b99d7-c704-4470-8dbd-afd2dc4e0be6-kube-api-access-sst4j\") pod \"9a6b99d7-c704-4470-8dbd-afd2dc4e0be6\" (UID: \"9a6b99d7-c704-4470-8dbd-afd2dc4e0be6\") "
Sep 20 01:14:07.734440 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:07.734324    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a6b99d7-c704-4470-8dbd-afd2dc4e0be6-plugins-config-volume\") pod \"9a6b99d7-c704-4470-8dbd-afd2dc4e0be6\" (UID: \"9a6b99d7-c704-4470-8dbd-afd2dc4e0be6\") "
Sep 20 01:14:07.734674 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:07.734651    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a6b99d7-c704-4470-8dbd-afd2dc4e0be6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9a6b99d7-c704-4470-8dbd-afd2dc4e0be6" (UID: "9a6b99d7-c704-4470-8dbd-afd2dc4e0be6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:14:07.736564 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:07.736543    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a6b99d7-c704-4470-8dbd-afd2dc4e0be6-kube-api-access-sst4j" (OuterVolumeSpecName: "kube-api-access-sst4j") pod "9a6b99d7-c704-4470-8dbd-afd2dc4e0be6" (UID: "9a6b99d7-c704-4470-8dbd-afd2dc4e0be6"). InnerVolumeSpecName "kube-api-access-sst4j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:14:07.835370 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:07.835317    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a6b99d7-c704-4470-8dbd-afd2dc4e0be6-plugins-config-volume\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:14:07.835370 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:07.835355    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sst4j\" (UniqueName: \"kubernetes.io/projected/9a6b99d7-c704-4470-8dbd-afd2dc4e0be6-kube-api-access-sst4j\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:14:08.340206 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:08.340169    2570 generic.go:356] "Generic (PLEG): container finished" podID="9a6b99d7-c704-4470-8dbd-afd2dc4e0be6" containerID="c99ffc2284fc148431fae78a5be085bf6b4d3efc024be5882fe0a94d3163a79e" exitCode=0
Sep 20 01:14:08.340417 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:08.340232    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-4e301e-779cf8d855-vcx2q"
Sep 20 01:14:08.340417 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:08.340261    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-4e301e-779cf8d855-vcx2q" event={"ID":"9a6b99d7-c704-4470-8dbd-afd2dc4e0be6","Type":"ContainerDied","Data":"c99ffc2284fc148431fae78a5be085bf6b4d3efc024be5882fe0a94d3163a79e"}
Sep 20 01:14:08.340417 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:08.340353    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-4e301e-779cf8d855-vcx2q" event={"ID":"9a6b99d7-c704-4470-8dbd-afd2dc4e0be6","Type":"ContainerDied","Data":"3ccfd0ccc918d60693a92026e67f80700cdc1e643db4ad644e5242381642755f"}
Sep 20 01:14:08.340417 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:08.340384    2570 scope.go:117] "RemoveContainer" containerID="c99ffc2284fc148431fae78a5be085bf6b4d3efc024be5882fe0a94d3163a79e"
Sep 20 01:14:08.349985 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:08.349954    2570 scope.go:117] "RemoveContainer" containerID="c99ffc2284fc148431fae78a5be085bf6b4d3efc024be5882fe0a94d3163a79e"
Sep 20 01:14:08.350300 ip-10-0-132-108 kubenswrapper[2570]: E0920 01:14:08.350277    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c99ffc2284fc148431fae78a5be085bf6b4d3efc024be5882fe0a94d3163a79e\": container with ID starting with c99ffc2284fc148431fae78a5be085bf6b4d3efc024be5882fe0a94d3163a79e not found: ID does not exist" containerID="c99ffc2284fc148431fae78a5be085bf6b4d3efc024be5882fe0a94d3163a79e"
Sep 20 01:14:08.350354 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:08.350309    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c99ffc2284fc148431fae78a5be085bf6b4d3efc024be5882fe0a94d3163a79e"} err="failed to get container status \"c99ffc2284fc148431fae78a5be085bf6b4d3efc024be5882fe0a94d3163a79e\": rpc error: code = NotFound desc = could not find container \"c99ffc2284fc148431fae78a5be085bf6b4d3efc024be5882fe0a94d3163a79e\": container with ID starting with c99ffc2284fc148431fae78a5be085bf6b4d3efc024be5882fe0a94d3163a79e not found: ID does not exist"
Sep 20 01:14:08.363957 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:08.363929    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-4e301e-779cf8d855-vcx2q"]
Sep 20 01:14:08.369488 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:08.369466    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-4e301e-779cf8d855-vcx2q"]
Sep 20 01:14:08.604482 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:08.604391    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-e2e8bc-58f75785bf-wbzxs"]
Sep 20 01:14:08.604681 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:08.604651    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w0-e2e8bc-58f75785bf-wbzxs" podUID="f5edfb15-d988-4370-8eb6-f27c3628abdc" containerName="payload-processing" containerID="cri-o://1069f503bc5234c12d760f9357805d3dd51cd606aceb1f516f1a5f3346f5db1d" gracePeriod=30
Sep 20 01:14:08.614392 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:08.614356    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-e2e8bc-57f58c8cfd-6dn2t"]
Sep 20 01:14:08.615022 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:08.614599    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-e2e8bc-57f58c8cfd-6dn2t" podUID="17e26ad0-572c-4a3a-972f-21e24f432836" containerName="payload-pre-processing" containerID="cri-o://cfd6721449e789b9e252ce7a98cf7e5672acf729c33ac71e1eff5183288e6c74" gracePeriod=30
Sep 20 01:14:08.897264 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:08.897241    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-e2e8bc-58f75785bf-wbzxs"
Sep 20 01:14:08.900157 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:08.900139    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-e2e8bc-57f58c8cfd-6dn2t"
Sep 20 01:14:09.048176 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:09.048146    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tmhv2\" (UniqueName: \"kubernetes.io/projected/17e26ad0-572c-4a3a-972f-21e24f432836-kube-api-access-tmhv2\") pod \"17e26ad0-572c-4a3a-972f-21e24f432836\" (UID: \"17e26ad0-572c-4a3a-972f-21e24f432836\") "
Sep 20 01:14:09.048362 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:09.048211    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5edfb15-d988-4370-8eb6-f27c3628abdc-plugins-config-volume\") pod \"f5edfb15-d988-4370-8eb6-f27c3628abdc\" (UID: \"f5edfb15-d988-4370-8eb6-f27c3628abdc\") "
Sep 20 01:14:09.048362 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:09.048240    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j4psg\" (UniqueName: \"kubernetes.io/projected/f5edfb15-d988-4370-8eb6-f27c3628abdc-kube-api-access-j4psg\") pod \"f5edfb15-d988-4370-8eb6-f27c3628abdc\" (UID: \"f5edfb15-d988-4370-8eb6-f27c3628abdc\") "
Sep 20 01:14:09.048362 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:09.048308    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17e26ad0-572c-4a3a-972f-21e24f432836-plugins-config-volume\") pod \"17e26ad0-572c-4a3a-972f-21e24f432836\" (UID: \"17e26ad0-572c-4a3a-972f-21e24f432836\") "
Sep 20 01:14:09.048570 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:09.048535    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5edfb15-d988-4370-8eb6-f27c3628abdc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f5edfb15-d988-4370-8eb6-f27c3628abdc" (UID: "f5edfb15-d988-4370-8eb6-f27c3628abdc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:14:09.048735 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:09.048712    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17e26ad0-572c-4a3a-972f-21e24f432836-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "17e26ad0-572c-4a3a-972f-21e24f432836" (UID: "17e26ad0-572c-4a3a-972f-21e24f432836"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:14:09.048735 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:09.048728    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5edfb15-d988-4370-8eb6-f27c3628abdc-plugins-config-volume\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:14:09.050585 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:09.050560    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5edfb15-d988-4370-8eb6-f27c3628abdc-kube-api-access-j4psg" (OuterVolumeSpecName: "kube-api-access-j4psg") pod "f5edfb15-d988-4370-8eb6-f27c3628abdc" (UID: "f5edfb15-d988-4370-8eb6-f27c3628abdc"). InnerVolumeSpecName "kube-api-access-j4psg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:14:09.050654 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:09.050599    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17e26ad0-572c-4a3a-972f-21e24f432836-kube-api-access-tmhv2" (OuterVolumeSpecName: "kube-api-access-tmhv2") pod "17e26ad0-572c-4a3a-972f-21e24f432836" (UID: "17e26ad0-572c-4a3a-972f-21e24f432836"). InnerVolumeSpecName "kube-api-access-tmhv2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:14:09.150128 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:09.150040    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17e26ad0-572c-4a3a-972f-21e24f432836-plugins-config-volume\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:14:09.150128 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:09.150074    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tmhv2\" (UniqueName: \"kubernetes.io/projected/17e26ad0-572c-4a3a-972f-21e24f432836-kube-api-access-tmhv2\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:14:09.150128 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:09.150084    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4psg\" (UniqueName: \"kubernetes.io/projected/f5edfb15-d988-4370-8eb6-f27c3628abdc-kube-api-access-j4psg\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:14:09.347384 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:09.347344    2570 generic.go:356] "Generic (PLEG): container finished" podID="f5edfb15-d988-4370-8eb6-f27c3628abdc" containerID="1069f503bc5234c12d760f9357805d3dd51cd606aceb1f516f1a5f3346f5db1d" exitCode=0
Sep 20 01:14:09.347586 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:09.347402    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-e2e8bc-58f75785bf-wbzxs"
Sep 20 01:14:09.347586 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:09.347427    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-e2e8bc-58f75785bf-wbzxs" event={"ID":"f5edfb15-d988-4370-8eb6-f27c3628abdc","Type":"ContainerDied","Data":"1069f503bc5234c12d760f9357805d3dd51cd606aceb1f516f1a5f3346f5db1d"}
Sep 20 01:14:09.347586 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:09.347489    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-e2e8bc-58f75785bf-wbzxs" event={"ID":"f5edfb15-d988-4370-8eb6-f27c3628abdc","Type":"ContainerDied","Data":"08708ae95258d8837e45c8a2562513eb898a66eac60784c269c9e4c714542134"}
Sep 20 01:14:09.347586 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:09.347526    2570 scope.go:117] "RemoveContainer" containerID="1069f503bc5234c12d760f9357805d3dd51cd606aceb1f516f1a5f3346f5db1d"
Sep 20 01:14:09.350215 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:09.350192    2570 generic.go:356] "Generic (PLEG): container finished" podID="17e26ad0-572c-4a3a-972f-21e24f432836" containerID="cfd6721449e789b9e252ce7a98cf7e5672acf729c33ac71e1eff5183288e6c74" exitCode=0
Sep 20 01:14:09.350608 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:09.350256    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-e2e8bc-57f58c8cfd-6dn2t"
Sep 20 01:14:09.350608 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:09.350279    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-e2e8bc-57f58c8cfd-6dn2t" event={"ID":"17e26ad0-572c-4a3a-972f-21e24f432836","Type":"ContainerDied","Data":"cfd6721449e789b9e252ce7a98cf7e5672acf729c33ac71e1eff5183288e6c74"}
Sep 20 01:14:09.350608 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:09.350325    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-e2e8bc-57f58c8cfd-6dn2t" event={"ID":"17e26ad0-572c-4a3a-972f-21e24f432836","Type":"ContainerDied","Data":"1971ceaa22d45a4cccf9a79754fde5f6d55ef361f978a17a0edbf33fc75a967c"}
Sep 20 01:14:09.358173 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:09.358151    2570 scope.go:117] "RemoveContainer" containerID="1069f503bc5234c12d760f9357805d3dd51cd606aceb1f516f1a5f3346f5db1d"
Sep 20 01:14:09.358491 ip-10-0-132-108 kubenswrapper[2570]: E0920 01:14:09.358467    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1069f503bc5234c12d760f9357805d3dd51cd606aceb1f516f1a5f3346f5db1d\": container with ID starting with 1069f503bc5234c12d760f9357805d3dd51cd606aceb1f516f1a5f3346f5db1d not found: ID does not exist" containerID="1069f503bc5234c12d760f9357805d3dd51cd606aceb1f516f1a5f3346f5db1d"
Sep 20 01:14:09.358593 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:09.358498    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1069f503bc5234c12d760f9357805d3dd51cd606aceb1f516f1a5f3346f5db1d"} err="failed to get container status \"1069f503bc5234c12d760f9357805d3dd51cd606aceb1f516f1a5f3346f5db1d\": rpc error: code = NotFound desc = could not find container \"1069f503bc5234c12d760f9357805d3dd51cd606aceb1f516f1a5f3346f5db1d\": container with ID starting with 1069f503bc5234c12d760f9357805d3dd51cd606aceb1f516f1a5f3346f5db1d not found: ID does not exist"
Sep 20 01:14:09.358593 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:09.358518    2570 scope.go:117] "RemoveContainer" containerID="cfd6721449e789b9e252ce7a98cf7e5672acf729c33ac71e1eff5183288e6c74"
Sep 20 01:14:09.367597 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:09.367574    2570 scope.go:117] "RemoveContainer" containerID="cfd6721449e789b9e252ce7a98cf7e5672acf729c33ac71e1eff5183288e6c74"
Sep 20 01:14:09.368070 ip-10-0-132-108 kubenswrapper[2570]: E0920 01:14:09.368043    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfd6721449e789b9e252ce7a98cf7e5672acf729c33ac71e1eff5183288e6c74\": container with ID starting with cfd6721449e789b9e252ce7a98cf7e5672acf729c33ac71e1eff5183288e6c74 not found: ID does not exist" containerID="cfd6721449e789b9e252ce7a98cf7e5672acf729c33ac71e1eff5183288e6c74"
Sep 20 01:14:09.368160 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:09.368077    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfd6721449e789b9e252ce7a98cf7e5672acf729c33ac71e1eff5183288e6c74"} err="failed to get container status \"cfd6721449e789b9e252ce7a98cf7e5672acf729c33ac71e1eff5183288e6c74\": rpc error: code = NotFound desc = could not find container \"cfd6721449e789b9e252ce7a98cf7e5672acf729c33ac71e1eff5183288e6c74\": container with ID starting with cfd6721449e789b9e252ce7a98cf7e5672acf729c33ac71e1eff5183288e6c74 not found: ID does not exist"
Sep 20 01:14:09.370228 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:09.370207    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-e2e8bc-58f75785bf-wbzxs"]
Sep 20 01:14:09.376009 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:09.375989    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-e2e8bc-58f75785bf-wbzxs"]
Sep 20 01:14:09.386832 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:09.386808    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-e2e8bc-57f58c8cfd-6dn2t"]
Sep 20 01:14:09.390428 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:09.390406    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-e2e8bc-57f58c8cfd-6dn2t"]
Sep 20 01:14:09.456871 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:09.456779    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17e26ad0-572c-4a3a-972f-21e24f432836" path="/var/lib/kubelet/pods/17e26ad0-572c-4a3a-972f-21e24f432836/volumes"
Sep 20 01:14:09.457185 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:09.457170    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a65fd17-374e-400f-bc39-5ceb6c9b11f8" path="/var/lib/kubelet/pods/3a65fd17-374e-400f-bc39-5ceb6c9b11f8/volumes"
Sep 20 01:14:09.457562 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:09.457548    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a6b99d7-c704-4470-8dbd-afd2dc4e0be6" path="/var/lib/kubelet/pods/9a6b99d7-c704-4470-8dbd-afd2dc4e0be6/volumes"
Sep 20 01:14:09.457933 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:09.457921    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5edfb15-d988-4370-8eb6-f27c3628abdc" path="/var/lib/kubelet/pods/f5edfb15-d988-4370-8eb6-f27c3628abdc/volumes"
Sep 20 01:14:11.174319 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:11.174258    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-4e301e/distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww" podUID="17923150-25df-45ab-aec2-c19fe6781323" containerName="main" containerID="cri-o://71d800bc139d2a8d72ed2406342439600bc2994f9eb33e8a6c931299e1f80e27" gracePeriod=45
Sep 20 01:14:11.367744 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:11.367707    2570 generic.go:356] "Generic (PLEG): container finished" podID="17923150-25df-45ab-aec2-c19fe6781323" containerID="71d800bc139d2a8d72ed2406342439600bc2994f9eb33e8a6c931299e1f80e27" exitCode=0
Sep 20 01:14:11.367913 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:11.367742    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-4e301e/distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww" event={"ID":"17923150-25df-45ab-aec2-c19fe6781323","Type":"ContainerDied","Data":"71d800bc139d2a8d72ed2406342439600bc2994f9eb33e8a6c931299e1f80e27"}
Sep 20 01:14:11.437113 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:11.437043    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-4e301e/distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww"
Sep 20 01:14:11.576394 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:11.576360    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6gssr\" (UniqueName: \"kubernetes.io/projected/17923150-25df-45ab-aec2-c19fe6781323-kube-api-access-6gssr\") pod \"17923150-25df-45ab-aec2-c19fe6781323\" (UID: \"17923150-25df-45ab-aec2-c19fe6781323\") "
Sep 20 01:14:11.576599 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:11.576410    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/17923150-25df-45ab-aec2-c19fe6781323-dshm\") pod \"17923150-25df-45ab-aec2-c19fe6781323\" (UID: \"17923150-25df-45ab-aec2-c19fe6781323\") "
Sep 20 01:14:11.576599 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:11.576497    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17923150-25df-45ab-aec2-c19fe6781323-tls-certs\") pod \"17923150-25df-45ab-aec2-c19fe6781323\" (UID: \"17923150-25df-45ab-aec2-c19fe6781323\") "
Sep 20 01:14:11.576599 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:11.576543    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17923150-25df-45ab-aec2-c19fe6781323-tmp-dir\") pod \"17923150-25df-45ab-aec2-c19fe6781323\" (UID: \"17923150-25df-45ab-aec2-c19fe6781323\") "
Sep 20 01:14:11.576599 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:11.576578    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17923150-25df-45ab-aec2-c19fe6781323-model-cache\") pod \"17923150-25df-45ab-aec2-c19fe6781323\" (UID: \"17923150-25df-45ab-aec2-c19fe6781323\") "
Sep 20 01:14:11.576817 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:11.576618    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/17923150-25df-45ab-aec2-c19fe6781323-home\") pod \"17923150-25df-45ab-aec2-c19fe6781323\" (UID: \"17923150-25df-45ab-aec2-c19fe6781323\") "
Sep 20 01:14:11.577109 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:11.577027    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17923150-25df-45ab-aec2-c19fe6781323-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "17923150-25df-45ab-aec2-c19fe6781323" (UID: "17923150-25df-45ab-aec2-c19fe6781323"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:11.577109 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:11.577062    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17923150-25df-45ab-aec2-c19fe6781323-model-cache" (OuterVolumeSpecName: "model-cache") pod "17923150-25df-45ab-aec2-c19fe6781323" (UID: "17923150-25df-45ab-aec2-c19fe6781323"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:11.577109 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:11.577074    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17923150-25df-45ab-aec2-c19fe6781323-home" (OuterVolumeSpecName: "home") pod "17923150-25df-45ab-aec2-c19fe6781323" (UID: "17923150-25df-45ab-aec2-c19fe6781323"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:11.579086 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:11.579048    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17923150-25df-45ab-aec2-c19fe6781323-kube-api-access-6gssr" (OuterVolumeSpecName: "kube-api-access-6gssr") pod "17923150-25df-45ab-aec2-c19fe6781323" (UID: "17923150-25df-45ab-aec2-c19fe6781323"). InnerVolumeSpecName "kube-api-access-6gssr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:14:11.579364 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:11.579341    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17923150-25df-45ab-aec2-c19fe6781323-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "17923150-25df-45ab-aec2-c19fe6781323" (UID: "17923150-25df-45ab-aec2-c19fe6781323"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:14:11.579477 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:11.579415    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17923150-25df-45ab-aec2-c19fe6781323-dshm" (OuterVolumeSpecName: "dshm") pod "17923150-25df-45ab-aec2-c19fe6781323" (UID: "17923150-25df-45ab-aec2-c19fe6781323"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:11.678312 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:11.678257    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17923150-25df-45ab-aec2-c19fe6781323-tmp-dir\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:14:11.678312 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:11.678306    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17923150-25df-45ab-aec2-c19fe6781323-model-cache\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:14:11.678312 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:11.678318    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/17923150-25df-45ab-aec2-c19fe6781323-home\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:14:11.678614 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:11.678331    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6gssr\" (UniqueName: \"kubernetes.io/projected/17923150-25df-45ab-aec2-c19fe6781323-kube-api-access-6gssr\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:14:11.678614 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:11.678344    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/17923150-25df-45ab-aec2-c19fe6781323-dshm\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:14:11.678614 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:11.678354    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17923150-25df-45ab-aec2-c19fe6781323-tls-certs\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:14:12.374805 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:12.374771    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-4e301e/distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww" event={"ID":"17923150-25df-45ab-aec2-c19fe6781323","Type":"ContainerDied","Data":"d82f32e60ad310da0d32087ab78299416b89d37562420206de21ca57ae0fe53f"}
Sep 20 01:14:12.375227 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:12.374820    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-4e301e/distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww"
Sep 20 01:14:12.375227 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:12.374823    2570 scope.go:117] "RemoveContainer" containerID="71d800bc139d2a8d72ed2406342439600bc2994f9eb33e8a6c931299e1f80e27"
Sep 20 01:14:12.396354 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:12.396324    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-4e301e/distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww"]
Sep 20 01:14:12.398372 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:12.398351    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-4e301e/distinct-w4-4e301e-kserve-6675d5f6bf-qw6ww"]
Sep 20 01:14:12.962008 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:12.961972    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-0766ea-74d47477bc-5fb9v"]
Sep 20 01:14:12.963956 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:12.962266    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-0766ea-74d47477bc-5fb9v" podUID="500e2256-a3b0-49d9-a296-7ce728705875" containerName="payload-processing" containerID="cri-o://a441477b656c067e68908b3f7d7bd4cc409735f0e96000b802ee439e16ef8c67" gracePeriod=30
Sep 20 01:14:12.970894 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:12.970809    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-0766ea-895d4469d-cvg9s"]
Sep 20 01:14:12.971075 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:12.971048    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-0766ea-895d4469d-cvg9s" podUID="c88462ad-2257-4514-8971-39e1039481f0" containerName="payload-pre-processing" containerID="cri-o://3af5d85d5295e12085e822b298b3bd2a5af9bb9d00a77a51ac64baf644224f2d" gracePeriod=30
Sep 20 01:14:13.136588 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:13.136541    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-0766ea-vvq6t"]
Sep 20 01:14:13.140097 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:13.140066    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-0766ea-vvq6t"]
Sep 20 01:14:13.246713 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:13.246685    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-0766ea-74d47477bc-5fb9v"
Sep 20 01:14:13.262296 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:13.262271    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-0766ea-895d4469d-cvg9s"
Sep 20 01:14:13.382208 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:13.382177    2570 generic.go:356] "Generic (PLEG): container finished" podID="500e2256-a3b0-49d9-a296-7ce728705875" containerID="a441477b656c067e68908b3f7d7bd4cc409735f0e96000b802ee439e16ef8c67" exitCode=0
Sep 20 01:14:13.382697 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:13.382240    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-0766ea-74d47477bc-5fb9v"
Sep 20 01:14:13.382697 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:13.382292    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-0766ea-74d47477bc-5fb9v" event={"ID":"500e2256-a3b0-49d9-a296-7ce728705875","Type":"ContainerDied","Data":"a441477b656c067e68908b3f7d7bd4cc409735f0e96000b802ee439e16ef8c67"}
Sep 20 01:14:13.382697 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:13.382377    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-0766ea-74d47477bc-5fb9v" event={"ID":"500e2256-a3b0-49d9-a296-7ce728705875","Type":"ContainerDied","Data":"6f0261a12c4454c5a0a9a4a2d55ac8837a50abb74c99fc5d09688336d6a04fbd"}
Sep 20 01:14:13.382697 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:13.382424    2570 scope.go:117] "RemoveContainer" containerID="a441477b656c067e68908b3f7d7bd4cc409735f0e96000b802ee439e16ef8c67"
Sep 20 01:14:13.383923 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:13.383650    2570 generic.go:356] "Generic (PLEG): container finished" podID="c88462ad-2257-4514-8971-39e1039481f0" containerID="3af5d85d5295e12085e822b298b3bd2a5af9bb9d00a77a51ac64baf644224f2d" exitCode=0
Sep 20 01:14:13.383923 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:13.383734    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-0766ea-895d4469d-cvg9s"
Sep 20 01:14:13.383923 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:13.383718    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-0766ea-895d4469d-cvg9s" event={"ID":"c88462ad-2257-4514-8971-39e1039481f0","Type":"ContainerDied","Data":"3af5d85d5295e12085e822b298b3bd2a5af9bb9d00a77a51ac64baf644224f2d"}
Sep 20 01:14:13.383923 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:13.383896    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-0766ea-895d4469d-cvg9s" event={"ID":"c88462ad-2257-4514-8971-39e1039481f0","Type":"ContainerDied","Data":"4fe843631c6afce3f9fcc6f3a5cc4b35d9167ca091938d2d5c80950cff6be4d9"}
Sep 20 01:14:13.392839 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:13.392820    2570 scope.go:117] "RemoveContainer" containerID="a441477b656c067e68908b3f7d7bd4cc409735f0e96000b802ee439e16ef8c67"
Sep 20 01:14:13.393305 ip-10-0-132-108 kubenswrapper[2570]: E0920 01:14:13.393259    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a441477b656c067e68908b3f7d7bd4cc409735f0e96000b802ee439e16ef8c67\": container with ID starting with a441477b656c067e68908b3f7d7bd4cc409735f0e96000b802ee439e16ef8c67 not found: ID does not exist" containerID="a441477b656c067e68908b3f7d7bd4cc409735f0e96000b802ee439e16ef8c67"
Sep 20 01:14:13.393381 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:13.393316    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a441477b656c067e68908b3f7d7bd4cc409735f0e96000b802ee439e16ef8c67"} err="failed to get container status \"a441477b656c067e68908b3f7d7bd4cc409735f0e96000b802ee439e16ef8c67\": rpc error: code = NotFound desc = could not find container \"a441477b656c067e68908b3f7d7bd4cc409735f0e96000b802ee439e16ef8c67\": container with ID starting with a441477b656c067e68908b3f7d7bd4cc409735f0e96000b802ee439e16ef8c67 not found: ID does not exist"
Sep 20 01:14:13.393381 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:13.393336    2570 scope.go:117] "RemoveContainer" containerID="3af5d85d5295e12085e822b298b3bd2a5af9bb9d00a77a51ac64baf644224f2d"
Sep 20 01:14:13.401673 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:13.401652    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6bgh6\" (UniqueName: \"kubernetes.io/projected/500e2256-a3b0-49d9-a296-7ce728705875-kube-api-access-6bgh6\") pod \"500e2256-a3b0-49d9-a296-7ce728705875\" (UID: \"500e2256-a3b0-49d9-a296-7ce728705875\") "
Sep 20 01:14:13.401797 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:13.401721    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lnr8z\" (UniqueName: \"kubernetes.io/projected/c88462ad-2257-4514-8971-39e1039481f0-kube-api-access-lnr8z\") pod \"c88462ad-2257-4514-8971-39e1039481f0\" (UID: \"c88462ad-2257-4514-8971-39e1039481f0\") "
Sep 20 01:14:13.401877 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:13.401837    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/500e2256-a3b0-49d9-a296-7ce728705875-plugins-config-volume\") pod \"500e2256-a3b0-49d9-a296-7ce728705875\" (UID: \"500e2256-a3b0-49d9-a296-7ce728705875\") "
Sep 20 01:14:13.401991 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:13.401963    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c88462ad-2257-4514-8971-39e1039481f0-plugins-config-volume\") pod \"c88462ad-2257-4514-8971-39e1039481f0\" (UID: \"c88462ad-2257-4514-8971-39e1039481f0\") "
Sep 20 01:14:13.402332 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:13.402304    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/500e2256-a3b0-49d9-a296-7ce728705875-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "500e2256-a3b0-49d9-a296-7ce728705875" (UID: "500e2256-a3b0-49d9-a296-7ce728705875"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:14:13.402399 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:13.402342    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c88462ad-2257-4514-8971-39e1039481f0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c88462ad-2257-4514-8971-39e1039481f0" (UID: "c88462ad-2257-4514-8971-39e1039481f0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:14:13.402739 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:13.402714    2570 scope.go:117] "RemoveContainer" containerID="3af5d85d5295e12085e822b298b3bd2a5af9bb9d00a77a51ac64baf644224f2d"
Sep 20 01:14:13.403134 ip-10-0-132-108 kubenswrapper[2570]: E0920 01:14:13.403111    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3af5d85d5295e12085e822b298b3bd2a5af9bb9d00a77a51ac64baf644224f2d\": container with ID starting with 3af5d85d5295e12085e822b298b3bd2a5af9bb9d00a77a51ac64baf644224f2d not found: ID does not exist" containerID="3af5d85d5295e12085e822b298b3bd2a5af9bb9d00a77a51ac64baf644224f2d"
Sep 20 01:14:13.403243 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:13.403140    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3af5d85d5295e12085e822b298b3bd2a5af9bb9d00a77a51ac64baf644224f2d"} err="failed to get container status \"3af5d85d5295e12085e822b298b3bd2a5af9bb9d00a77a51ac64baf644224f2d\": rpc error: code = NotFound desc = could not find container \"3af5d85d5295e12085e822b298b3bd2a5af9bb9d00a77a51ac64baf644224f2d\": container with ID starting with 3af5d85d5295e12085e822b298b3bd2a5af9bb9d00a77a51ac64baf644224f2d not found: ID does not exist"
Sep 20 01:14:13.404019 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:13.403997    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/500e2256-a3b0-49d9-a296-7ce728705875-kube-api-access-6bgh6" (OuterVolumeSpecName: "kube-api-access-6bgh6") pod "500e2256-a3b0-49d9-a296-7ce728705875" (UID: "500e2256-a3b0-49d9-a296-7ce728705875"). InnerVolumeSpecName "kube-api-access-6bgh6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:14:13.404185 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:13.404162    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c88462ad-2257-4514-8971-39e1039481f0-kube-api-access-lnr8z" (OuterVolumeSpecName: "kube-api-access-lnr8z") pod "c88462ad-2257-4514-8971-39e1039481f0" (UID: "c88462ad-2257-4514-8971-39e1039481f0"). InnerVolumeSpecName "kube-api-access-lnr8z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:14:13.455318 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:13.455283    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17923150-25df-45ab-aec2-c19fe6781323" path="/var/lib/kubelet/pods/17923150-25df-45ab-aec2-c19fe6781323/volumes"
Sep 20 01:14:13.455679 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:13.455664    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49c347b3-5c73-49ba-b9b6-49e26d33c49d" path="/var/lib/kubelet/pods/49c347b3-5c73-49ba-b9b6-49e26d33c49d/volumes"
Sep 20 01:14:13.503096 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:13.503059    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6bgh6\" (UniqueName: \"kubernetes.io/projected/500e2256-a3b0-49d9-a296-7ce728705875-kube-api-access-6bgh6\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:14:13.503096 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:13.503090    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lnr8z\" (UniqueName: \"kubernetes.io/projected/c88462ad-2257-4514-8971-39e1039481f0-kube-api-access-lnr8z\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:14:13.503096 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:13.503099    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/500e2256-a3b0-49d9-a296-7ce728705875-plugins-config-volume\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:14:13.503324 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:13.503112    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c88462ad-2257-4514-8971-39e1039481f0-plugins-config-volume\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:14:13.698088 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:13.698050    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-0766ea-74d47477bc-5fb9v"]
Sep 20 01:14:13.702743 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:13.702718    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-0766ea-74d47477bc-5fb9v"]
Sep 20 01:14:13.712112 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:13.712090    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-0766ea-895d4469d-cvg9s"]
Sep 20 01:14:13.715469 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:13.715446    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-0766ea-895d4469d-cvg9s"]
Sep 20 01:14:15.083245 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:15.083198    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw"]
Sep 20 01:14:15.083702 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:15.083465    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw" podUID="3eb309b9-abfa-4b3a-b447-fca1a5421a15" containerName="istio-proxy" containerID="cri-o://fa89e0dc3e02ea5f94537620bdf2dc215345acc715da23fe2b5403aaf4d7f04e" gracePeriod=30
Sep 20 01:14:15.454116 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:15.454084    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="500e2256-a3b0-49d9-a296-7ce728705875" path="/var/lib/kubelet/pods/500e2256-a3b0-49d9-a296-7ce728705875/volumes"
Sep 20 01:14:15.454454 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:15.454442    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c88462ad-2257-4514-8971-39e1039481f0" path="/var/lib/kubelet/pods/c88462ad-2257-4514-8971-39e1039481f0/volumes"
Sep 20 01:14:19.371431 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:19.371392    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g"]
Sep 20 01:14:19.371954 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:19.371600    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g" podUID="f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1" containerName="istio-proxy" containerID="cri-o://02bdf13967271bf8f3acbeca0813ad8f31600f9a159ed069a16f783018ada65a" gracePeriod=30
Sep 20 01:14:19.773185 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:19.773103    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-b8cbf1-svqc8"]
Sep 20 01:14:19.773555 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:19.773542    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5edfb15-d988-4370-8eb6-f27c3628abdc" containerName="payload-processing"
Sep 20 01:14:19.773606 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:19.773557    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5edfb15-d988-4370-8eb6-f27c3628abdc" containerName="payload-processing"
Sep 20 01:14:19.773606 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:19.773574    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c88462ad-2257-4514-8971-39e1039481f0" containerName="payload-pre-processing"
Sep 20 01:14:19.773606 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:19.773580    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c88462ad-2257-4514-8971-39e1039481f0" containerName="payload-pre-processing"
Sep 20 01:14:19.773606 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:19.773590    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a6b99d7-c704-4470-8dbd-afd2dc4e0be6" containerName="payload-processing"
Sep 20 01:14:19.773606 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:19.773596    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a6b99d7-c704-4470-8dbd-afd2dc4e0be6" containerName="payload-processing"
Sep 20 01:14:19.773606 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:19.773604    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="500e2256-a3b0-49d9-a296-7ce728705875" containerName="payload-processing"
Sep 20 01:14:19.773787 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:19.773609    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="500e2256-a3b0-49d9-a296-7ce728705875" containerName="payload-processing"
Sep 20 01:14:19.773787 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:19.773618    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17e26ad0-572c-4a3a-972f-21e24f432836" containerName="payload-pre-processing"
Sep 20 01:14:19.773787 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:19.773623    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="17e26ad0-572c-4a3a-972f-21e24f432836" containerName="payload-pre-processing"
Sep 20 01:14:19.773787 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:19.773631    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17923150-25df-45ab-aec2-c19fe6781323" containerName="main"
Sep 20 01:14:19.773787 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:19.773635    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="17923150-25df-45ab-aec2-c19fe6781323" containerName="main"
Sep 20 01:14:19.773787 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:19.773641    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49c347b3-5c73-49ba-b9b6-49e26d33c49d" containerName="revoke-keys"
Sep 20 01:14:19.773787 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:19.773646    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="49c347b3-5c73-49ba-b9b6-49e26d33c49d" containerName="revoke-keys"
Sep 20 01:14:19.773787 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:19.773707    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a6b99d7-c704-4470-8dbd-afd2dc4e0be6" containerName="payload-processing"
Sep 20 01:14:19.773787 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:19.773714    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="49c347b3-5c73-49ba-b9b6-49e26d33c49d" containerName="revoke-keys"
Sep 20 01:14:19.773787 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:19.773720    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="500e2256-a3b0-49d9-a296-7ce728705875" containerName="payload-processing"
Sep 20 01:14:19.773787 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:19.773727    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c88462ad-2257-4514-8971-39e1039481f0" containerName="payload-pre-processing"
Sep 20 01:14:19.773787 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:19.773733    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5edfb15-d988-4370-8eb6-f27c3628abdc" containerName="payload-processing"
Sep 20 01:14:19.773787 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:19.773740    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="17e26ad0-572c-4a3a-972f-21e24f432836" containerName="payload-pre-processing"
Sep 20 01:14:19.773787 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:19.773746    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="17923150-25df-45ab-aec2-c19fe6781323" containerName="main"
Sep 20 01:14:19.778120 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:19.778103    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-b8cbf1-svqc8"
Sep 20 01:14:19.780155 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:19.780136    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5xngg\""
Sep 20 01:14:19.780263 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:19.780156    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 20 01:14:19.784951 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:19.784927    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-b8cbf1-svqc8"]
Sep 20 01:14:19.869255 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:19.869220    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/211b9855-09ca-49d9-89c0-26231f2a515a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-b8cbf1-svqc8\" (UID: \"211b9855-09ca-49d9-89c0-26231f2a515a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-b8cbf1-svqc8"
Sep 20 01:14:19.970578 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:19.970539    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/211b9855-09ca-49d9-89c0-26231f2a515a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-b8cbf1-svqc8\" (UID: \"211b9855-09ca-49d9-89c0-26231f2a515a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-b8cbf1-svqc8"
Sep 20 01:14:19.971270 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:19.971248    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/211b9855-09ca-49d9-89c0-26231f2a515a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-b8cbf1-svqc8\" (UID: \"211b9855-09ca-49d9-89c0-26231f2a515a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-b8cbf1-svqc8"
Sep 20 01:14:20.090185 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:20.090054    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-b8cbf1-svqc8"
Sep 20 01:14:20.335284 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:20.335258    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw"
Sep 20 01:14:20.361253 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:20.361223    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-b8cbf1-svqc8"]
Sep 20 01:14:20.362654 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:14:20.362628    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod211b9855_09ca_49d9_89c0_26231f2a515a.slice/crio-216a1d33f86dd55edc92bae3dd238687d1a9a4fd8d608b1e623dc7095fb510f6 WatchSource:0}: Error finding container 216a1d33f86dd55edc92bae3dd238687d1a9a4fd8d608b1e623dc7095fb510f6: Status 404 returned error can't find the container with id 216a1d33f86dd55edc92bae3dd238687d1a9a4fd8d608b1e623dc7095fb510f6
Sep 20 01:14:20.373499 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:20.373449    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3eb309b9-abfa-4b3a-b447-fca1a5421a15-istio-token\") pod \"3eb309b9-abfa-4b3a-b447-fca1a5421a15\" (UID: \"3eb309b9-abfa-4b3a-b447-fca1a5421a15\") "
Sep 20 01:14:20.373995 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:20.373518    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3eb309b9-abfa-4b3a-b447-fca1a5421a15-istio-envoy\") pod \"3eb309b9-abfa-4b3a-b447-fca1a5421a15\" (UID: \"3eb309b9-abfa-4b3a-b447-fca1a5421a15\") "
Sep 20 01:14:20.373995 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:20.373575    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rprd4\" (UniqueName: \"kubernetes.io/projected/3eb309b9-abfa-4b3a-b447-fca1a5421a15-kube-api-access-rprd4\") pod \"3eb309b9-abfa-4b3a-b447-fca1a5421a15\" (UID: \"3eb309b9-abfa-4b3a-b447-fca1a5421a15\") "
Sep 20 01:14:20.373995 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:20.373638    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3eb309b9-abfa-4b3a-b447-fca1a5421a15-istio-data\") pod \"3eb309b9-abfa-4b3a-b447-fca1a5421a15\" (UID: \"3eb309b9-abfa-4b3a-b447-fca1a5421a15\") "
Sep 20 01:14:20.374189 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:20.374160    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3eb309b9-abfa-4b3a-b447-fca1a5421a15-istio-data" (OuterVolumeSpecName: "istio-data") pod "3eb309b9-abfa-4b3a-b447-fca1a5421a15" (UID: "3eb309b9-abfa-4b3a-b447-fca1a5421a15"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:20.375946 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:20.375924    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3eb309b9-abfa-4b3a-b447-fca1a5421a15-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3eb309b9-abfa-4b3a-b447-fca1a5421a15" (UID: "3eb309b9-abfa-4b3a-b447-fca1a5421a15"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:20.376399 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:20.376364    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3eb309b9-abfa-4b3a-b447-fca1a5421a15-istio-token" (OuterVolumeSpecName: "istio-token") pod "3eb309b9-abfa-4b3a-b447-fca1a5421a15" (UID: "3eb309b9-abfa-4b3a-b447-fca1a5421a15"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:14:20.376492 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:20.376411    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3eb309b9-abfa-4b3a-b447-fca1a5421a15-kube-api-access-rprd4" (OuterVolumeSpecName: "kube-api-access-rprd4") pod "3eb309b9-abfa-4b3a-b447-fca1a5421a15" (UID: "3eb309b9-abfa-4b3a-b447-fca1a5421a15"). InnerVolumeSpecName "kube-api-access-rprd4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:14:20.426849 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:20.426813    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-b8cbf1-svqc8" event={"ID":"211b9855-09ca-49d9-89c0-26231f2a515a","Type":"ContainerStarted","Data":"216a1d33f86dd55edc92bae3dd238687d1a9a4fd8d608b1e623dc7095fb510f6"}
Sep 20 01:14:20.428622 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:20.428596    2570 generic.go:356] "Generic (PLEG): container finished" podID="3eb309b9-abfa-4b3a-b447-fca1a5421a15" containerID="fa89e0dc3e02ea5f94537620bdf2dc215345acc715da23fe2b5403aaf4d7f04e" exitCode=0
Sep 20 01:14:20.428716 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:20.428651    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw"
Sep 20 01:14:20.428716 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:20.428680    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw" event={"ID":"3eb309b9-abfa-4b3a-b447-fca1a5421a15","Type":"ContainerDied","Data":"fa89e0dc3e02ea5f94537620bdf2dc215345acc715da23fe2b5403aaf4d7f04e"}
Sep 20 01:14:20.428798 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:20.428735    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw" event={"ID":"3eb309b9-abfa-4b3a-b447-fca1a5421a15","Type":"ContainerDied","Data":"847b87f138561c6331e75ab7a1ccb5677a39c0c8f7e7608f032bea10a6428704"}
Sep 20 01:14:20.428798 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:20.428768    2570 scope.go:117] "RemoveContainer" containerID="fa89e0dc3e02ea5f94537620bdf2dc215345acc715da23fe2b5403aaf4d7f04e"
Sep 20 01:14:20.438168 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:20.438150    2570 scope.go:117] "RemoveContainer" containerID="ad34c5365078c43de51caefb9a64dcfbbae8109cc8ec760ca65080699269c286"
Sep 20 01:14:20.446892 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:20.446848    2570 scope.go:117] "RemoveContainer" containerID="fa89e0dc3e02ea5f94537620bdf2dc215345acc715da23fe2b5403aaf4d7f04e"
Sep 20 01:14:20.447241 ip-10-0-132-108 kubenswrapper[2570]: E0920 01:14:20.447209    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa89e0dc3e02ea5f94537620bdf2dc215345acc715da23fe2b5403aaf4d7f04e\": container with ID starting with fa89e0dc3e02ea5f94537620bdf2dc215345acc715da23fe2b5403aaf4d7f04e not found: ID does not exist" containerID="fa89e0dc3e02ea5f94537620bdf2dc215345acc715da23fe2b5403aaf4d7f04e"
Sep 20 01:14:20.447333 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:20.447254    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa89e0dc3e02ea5f94537620bdf2dc215345acc715da23fe2b5403aaf4d7f04e"} err="failed to get container status \"fa89e0dc3e02ea5f94537620bdf2dc215345acc715da23fe2b5403aaf4d7f04e\": rpc error: code = NotFound desc = could not find container \"fa89e0dc3e02ea5f94537620bdf2dc215345acc715da23fe2b5403aaf4d7f04e\": container with ID starting with fa89e0dc3e02ea5f94537620bdf2dc215345acc715da23fe2b5403aaf4d7f04e not found: ID does not exist"
Sep 20 01:14:20.447333 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:20.447279    2570 scope.go:117] "RemoveContainer" containerID="ad34c5365078c43de51caefb9a64dcfbbae8109cc8ec760ca65080699269c286"
Sep 20 01:14:20.447561 ip-10-0-132-108 kubenswrapper[2570]: E0920 01:14:20.447540    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad34c5365078c43de51caefb9a64dcfbbae8109cc8ec760ca65080699269c286\": container with ID starting with ad34c5365078c43de51caefb9a64dcfbbae8109cc8ec760ca65080699269c286 not found: ID does not exist" containerID="ad34c5365078c43de51caefb9a64dcfbbae8109cc8ec760ca65080699269c286"
Sep 20 01:14:20.447621 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:20.447567    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad34c5365078c43de51caefb9a64dcfbbae8109cc8ec760ca65080699269c286"} err="failed to get container status \"ad34c5365078c43de51caefb9a64dcfbbae8109cc8ec760ca65080699269c286\": rpc error: code = NotFound desc = could not find container \"ad34c5365078c43de51caefb9a64dcfbbae8109cc8ec760ca65080699269c286\": container with ID starting with ad34c5365078c43de51caefb9a64dcfbbae8109cc8ec760ca65080699269c286 not found: ID does not exist"
Sep 20 01:14:20.474595 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:20.474569    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3eb309b9-abfa-4b3a-b447-fca1a5421a15-istiod-ca-cert\") pod \"3eb309b9-abfa-4b3a-b447-fca1a5421a15\" (UID: \"3eb309b9-abfa-4b3a-b447-fca1a5421a15\") "
Sep 20 01:14:20.474700 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:20.474628    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3eb309b9-abfa-4b3a-b447-fca1a5421a15-workload-certs\") pod \"3eb309b9-abfa-4b3a-b447-fca1a5421a15\" (UID: \"3eb309b9-abfa-4b3a-b447-fca1a5421a15\") "
Sep 20 01:14:20.474700 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:20.474655    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3eb309b9-abfa-4b3a-b447-fca1a5421a15-istio-podinfo\") pod \"3eb309b9-abfa-4b3a-b447-fca1a5421a15\" (UID: \"3eb309b9-abfa-4b3a-b447-fca1a5421a15\") "
Sep 20 01:14:20.474811 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:20.474795    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3eb309b9-abfa-4b3a-b447-fca1a5421a15-credential-socket\") pod \"3eb309b9-abfa-4b3a-b447-fca1a5421a15\" (UID: \"3eb309b9-abfa-4b3a-b447-fca1a5421a15\") "
Sep 20 01:14:20.474887 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:20.474831    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3eb309b9-abfa-4b3a-b447-fca1a5421a15-workload-socket\") pod \"3eb309b9-abfa-4b3a-b447-fca1a5421a15\" (UID: \"3eb309b9-abfa-4b3a-b447-fca1a5421a15\") "
Sep 20 01:14:20.474887 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:20.474850    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3eb309b9-abfa-4b3a-b447-fca1a5421a15-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3eb309b9-abfa-4b3a-b447-fca1a5421a15" (UID: "3eb309b9-abfa-4b3a-b447-fca1a5421a15"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:14:20.474974 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:20.474919    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3eb309b9-abfa-4b3a-b447-fca1a5421a15-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3eb309b9-abfa-4b3a-b447-fca1a5421a15" (UID: "3eb309b9-abfa-4b3a-b447-fca1a5421a15"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:20.475086 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:20.475045    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3eb309b9-abfa-4b3a-b447-fca1a5421a15-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3eb309b9-abfa-4b3a-b447-fca1a5421a15" (UID: "3eb309b9-abfa-4b3a-b447-fca1a5421a15"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:20.475145 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:20.475102    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3eb309b9-abfa-4b3a-b447-fca1a5421a15-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3eb309b9-abfa-4b3a-b447-fca1a5421a15" (UID: "3eb309b9-abfa-4b3a-b447-fca1a5421a15"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:20.475239 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:20.475219    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3eb309b9-abfa-4b3a-b447-fca1a5421a15-istio-data\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:14:20.475239 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:20.475238    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3eb309b9-abfa-4b3a-b447-fca1a5421a15-istiod-ca-cert\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:14:20.475393 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:20.475248    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3eb309b9-abfa-4b3a-b447-fca1a5421a15-workload-certs\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:14:20.475393 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:20.475261    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3eb309b9-abfa-4b3a-b447-fca1a5421a15-istio-token\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:14:20.475393 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:20.475272    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3eb309b9-abfa-4b3a-b447-fca1a5421a15-istio-envoy\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:14:20.475393 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:20.475295    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rprd4\" (UniqueName: \"kubernetes.io/projected/3eb309b9-abfa-4b3a-b447-fca1a5421a15-kube-api-access-rprd4\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:14:20.475393 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:20.475314    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3eb309b9-abfa-4b3a-b447-fca1a5421a15-credential-socket\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:14:20.475393 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:20.475328    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3eb309b9-abfa-4b3a-b447-fca1a5421a15-workload-socket\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:14:20.476900 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:20.476875    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3eb309b9-abfa-4b3a-b447-fca1a5421a15-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3eb309b9-abfa-4b3a-b447-fca1a5421a15" (UID: "3eb309b9-abfa-4b3a-b447-fca1a5421a15"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 20 01:14:20.575878 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:20.575821    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3eb309b9-abfa-4b3a-b447-fca1a5421a15-istio-podinfo\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:14:20.750468 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:20.750415    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw"]
Sep 20 01:14:20.753114 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:20.753088    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-4e301e-openshift-default-5b6dc88fd8-lc4pw"]
Sep 20 01:14:21.435946 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:21.435905    2570 generic.go:356] "Generic (PLEG): container finished" podID="211b9855-09ca-49d9-89c0-26231f2a515a" containerID="7c651dfc5eb81eda562d5beaba03b88001c5935c038e28c54767814fd101365f" exitCode=0
Sep 20 01:14:21.436381 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:21.436043    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-b8cbf1-svqc8" event={"ID":"211b9855-09ca-49d9-89c0-26231f2a515a","Type":"ContainerDied","Data":"7c651dfc5eb81eda562d5beaba03b88001c5935c038e28c54767814fd101365f"}
Sep 20 01:14:21.454715 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:21.454685    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3eb309b9-abfa-4b3a-b447-fca1a5421a15" path="/var/lib/kubelet/pods/3eb309b9-abfa-4b3a-b447-fca1a5421a15/volumes"
Sep 20 01:14:22.577910 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:22.577886    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-b8cbf1-svqc8"
Sep 20 01:14:22.592106 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:22.592079    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/211b9855-09ca-49d9-89c0-26231f2a515a-maas-api-service-ca\") pod \"211b9855-09ca-49d9-89c0-26231f2a515a\" (UID: \"211b9855-09ca-49d9-89c0-26231f2a515a\") "
Sep 20 01:14:22.592478 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:22.592445    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/211b9855-09ca-49d9-89c0-26231f2a515a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "211b9855-09ca-49d9-89c0-26231f2a515a" (UID: "211b9855-09ca-49d9-89c0-26231f2a515a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:14:22.693100 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:22.693013    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/211b9855-09ca-49d9-89c0-26231f2a515a-maas-api-service-ca\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:14:23.453086 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:23.453054    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-b8cbf1-svqc8"
Sep 20 01:14:23.455819 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:23.455793    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-b8cbf1-svqc8" event={"ID":"211b9855-09ca-49d9-89c0-26231f2a515a","Type":"ContainerDied","Data":"216a1d33f86dd55edc92bae3dd238687d1a9a4fd8d608b1e623dc7095fb510f6"}
Sep 20 01:14:23.455995 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:23.455832    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="216a1d33f86dd55edc92bae3dd238687d1a9a4fd8d608b1e623dc7095fb510f6"
Sep 20 01:14:24.619193 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:24.619172    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g"
Sep 20 01:14:24.708608 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:24.708518    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1-workload-certs\") pod \"f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1\" (UID: \"f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1\") "
Sep 20 01:14:24.708608 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:24.708555    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1-credential-socket\") pod \"f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1\" (UID: \"f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1\") "
Sep 20 01:14:24.708608 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:24.708583    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1-istio-data\") pod \"f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1\" (UID: \"f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1\") "
Sep 20 01:14:24.708921 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:24.708618    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1-workload-socket\") pod \"f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1\" (UID: \"f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1\") "
Sep 20 01:14:24.708921 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:24.708650    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1-istio-token\") pod \"f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1\" (UID: \"f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1\") "
Sep 20 01:14:24.708921 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:24.708664    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1-istiod-ca-cert\") pod \"f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1\" (UID: \"f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1\") "
Sep 20 01:14:24.708921 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:24.708696    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1-istio-envoy\") pod \"f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1\" (UID: \"f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1\") "
Sep 20 01:14:24.708921 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:24.708772    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1" (UID: "f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:24.708921 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:24.708803    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c79ww\" (UniqueName: \"kubernetes.io/projected/f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1-kube-api-access-c79ww\") pod \"f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1\" (UID: \"f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1\") "
Sep 20 01:14:24.708921 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:24.708839    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1" (UID: "f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:24.708921 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:24.708854    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1-istio-podinfo\") pod \"f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1\" (UID: \"f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1\") "
Sep 20 01:14:24.709344 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:24.708996    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1-istio-data" (OuterVolumeSpecName: "istio-data") pod "f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1" (UID: "f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:24.709344 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:24.709108    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1" (UID: "f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:24.709344 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:24.709299    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1" (UID: "f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:14:24.709344 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:24.709307    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1-istio-data\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:14:24.709731 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:24.709353    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1-workload-socket\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:14:24.709731 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:24.709370    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1-workload-certs\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:14:24.709731 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:24.709385    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1-credential-socket\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:14:24.711178 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:24.711154    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1-kube-api-access-c79ww" (OuterVolumeSpecName: "kube-api-access-c79ww") pod "f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1" (UID: "f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1"). InnerVolumeSpecName "kube-api-access-c79ww". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:14:24.711286 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:24.711187    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1" (UID: "f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:24.711286 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:24.711226    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1-istio-token" (OuterVolumeSpecName: "istio-token") pod "f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1" (UID: "f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:14:24.711286 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:24.711230    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1" (UID: "f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 20 01:14:24.810841 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:24.810808    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c79ww\" (UniqueName: \"kubernetes.io/projected/f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1-kube-api-access-c79ww\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:14:24.810841 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:24.810837    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1-istio-podinfo\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:14:24.810841 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:24.810846    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1-istio-token\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:14:24.811097 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:24.810880    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1-istiod-ca-cert\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:14:24.811097 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:24.810893    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1-istio-envoy\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:14:25.465125 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:25.465096    2570 generic.go:356] "Generic (PLEG): container finished" podID="f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1" containerID="02bdf13967271bf8f3acbeca0813ad8f31600f9a159ed069a16f783018ada65a" exitCode=0
Sep 20 01:14:25.465239 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:25.465140    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g"
Sep 20 01:14:25.465239 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:25.465172    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g" event={"ID":"f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1","Type":"ContainerDied","Data":"02bdf13967271bf8f3acbeca0813ad8f31600f9a159ed069a16f783018ada65a"}
Sep 20 01:14:25.465239 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:25.465228    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g" event={"ID":"f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1","Type":"ContainerDied","Data":"df962ba02d41ef8bae6787ca647dd505e085200eecb4604bc0b28ba5ac0a38fd"}
Sep 20 01:14:25.465344 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:25.465258    2570 scope.go:117] "RemoveContainer" containerID="02bdf13967271bf8f3acbeca0813ad8f31600f9a159ed069a16f783018ada65a"
Sep 20 01:14:25.474086 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:25.474067    2570 scope.go:117] "RemoveContainer" containerID="044e168d52048cc08075d273db38d29e59e6207fcc56c603d39c76411acb77e6"
Sep 20 01:14:25.480489 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:25.480468    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g"]
Sep 20 01:14:25.483308 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:25.483288    2570 scope.go:117] "RemoveContainer" containerID="02bdf13967271bf8f3acbeca0813ad8f31600f9a159ed069a16f783018ada65a"
Sep 20 01:14:25.483603 ip-10-0-132-108 kubenswrapper[2570]: E0920 01:14:25.483586    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02bdf13967271bf8f3acbeca0813ad8f31600f9a159ed069a16f783018ada65a\": container with ID starting with 02bdf13967271bf8f3acbeca0813ad8f31600f9a159ed069a16f783018ada65a not found: ID does not exist" containerID="02bdf13967271bf8f3acbeca0813ad8f31600f9a159ed069a16f783018ada65a"
Sep 20 01:14:25.483655 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:25.483612    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02bdf13967271bf8f3acbeca0813ad8f31600f9a159ed069a16f783018ada65a"} err="failed to get container status \"02bdf13967271bf8f3acbeca0813ad8f31600f9a159ed069a16f783018ada65a\": rpc error: code = NotFound desc = could not find container \"02bdf13967271bf8f3acbeca0813ad8f31600f9a159ed069a16f783018ada65a\": container with ID starting with 02bdf13967271bf8f3acbeca0813ad8f31600f9a159ed069a16f783018ada65a not found: ID does not exist"
Sep 20 01:14:25.483655 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:25.483629    2570 scope.go:117] "RemoveContainer" containerID="044e168d52048cc08075d273db38d29e59e6207fcc56c603d39c76411acb77e6"
Sep 20 01:14:25.484376 ip-10-0-132-108 kubenswrapper[2570]: E0920 01:14:25.484346    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"044e168d52048cc08075d273db38d29e59e6207fcc56c603d39c76411acb77e6\": container with ID starting with 044e168d52048cc08075d273db38d29e59e6207fcc56c603d39c76411acb77e6 not found: ID does not exist" containerID="044e168d52048cc08075d273db38d29e59e6207fcc56c603d39c76411acb77e6"
Sep 20 01:14:25.484663 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:25.484607    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"044e168d52048cc08075d273db38d29e59e6207fcc56c603d39c76411acb77e6"} err="failed to get container status \"044e168d52048cc08075d273db38d29e59e6207fcc56c603d39c76411acb77e6\": rpc error: code = NotFound desc = could not find container \"044e168d52048cc08075d273db38d29e59e6207fcc56c603d39c76411acb77e6\": container with ID starting with 044e168d52048cc08075d273db38d29e59e6207fcc56c603d39c76411acb77e6 not found: ID does not exist"
Sep 20 01:14:25.486186 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:25.486162    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-0766ea-openshift-default-78c77bb548-cct5g"]
Sep 20 01:14:27.453648 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:27.453567    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1" path="/var/lib/kubelet/pods/f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1/volumes"
Sep 20 01:14:30.403249 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:30.403216    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-b8cbf1-6cc5bf74f9-gfkt2"]
Sep 20 01:14:30.403694 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:30.403478    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-b8cbf1-6cc5bf74f9-gfkt2" podUID="84b35e8f-9fc8-41a2-8c58-f1a43d9a22dc" containerName="payload-processing" containerID="cri-o://3e617233ad9789535798de647cf19bf36308d10bf89d030cb8128b91dbf67807" gracePeriod=30
Sep 20 01:14:30.566718 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:30.566685    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-b8cbf1-svqc8"]
Sep 20 01:14:30.568505 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:30.568484    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-b8cbf1-svqc8"]
Sep 20 01:14:30.685258 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:30.685228    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-b8cbf1-6cc5bf74f9-gfkt2"
Sep 20 01:14:30.768246 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:30.768217    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8rw62\" (UniqueName: \"kubernetes.io/projected/84b35e8f-9fc8-41a2-8c58-f1a43d9a22dc-kube-api-access-8rw62\") pod \"84b35e8f-9fc8-41a2-8c58-f1a43d9a22dc\" (UID: \"84b35e8f-9fc8-41a2-8c58-f1a43d9a22dc\") "
Sep 20 01:14:30.768434 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:30.768300    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84b35e8f-9fc8-41a2-8c58-f1a43d9a22dc-plugins-config-volume\") pod \"84b35e8f-9fc8-41a2-8c58-f1a43d9a22dc\" (UID: \"84b35e8f-9fc8-41a2-8c58-f1a43d9a22dc\") "
Sep 20 01:14:30.768696 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:30.768674    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84b35e8f-9fc8-41a2-8c58-f1a43d9a22dc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "84b35e8f-9fc8-41a2-8c58-f1a43d9a22dc" (UID: "84b35e8f-9fc8-41a2-8c58-f1a43d9a22dc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:14:30.770367 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:30.770344    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84b35e8f-9fc8-41a2-8c58-f1a43d9a22dc-kube-api-access-8rw62" (OuterVolumeSpecName: "kube-api-access-8rw62") pod "84b35e8f-9fc8-41a2-8c58-f1a43d9a22dc" (UID: "84b35e8f-9fc8-41a2-8c58-f1a43d9a22dc"). InnerVolumeSpecName "kube-api-access-8rw62". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:14:30.869286 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:30.869249    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84b35e8f-9fc8-41a2-8c58-f1a43d9a22dc-plugins-config-volume\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:14:30.869286 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:30.869279    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8rw62\" (UniqueName: \"kubernetes.io/projected/84b35e8f-9fc8-41a2-8c58-f1a43d9a22dc-kube-api-access-8rw62\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:14:31.453134 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:31.453100    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="211b9855-09ca-49d9-89c0-26231f2a515a" path="/var/lib/kubelet/pods/211b9855-09ca-49d9-89c0-26231f2a515a/volumes"
Sep 20 01:14:31.499313 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:31.499281    2570 generic.go:356] "Generic (PLEG): container finished" podID="84b35e8f-9fc8-41a2-8c58-f1a43d9a22dc" containerID="3e617233ad9789535798de647cf19bf36308d10bf89d030cb8128b91dbf67807" exitCode=0
Sep 20 01:14:31.499434 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:31.499336    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-b8cbf1-6cc5bf74f9-gfkt2"
Sep 20 01:14:31.499434 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:31.499350    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-b8cbf1-6cc5bf74f9-gfkt2" event={"ID":"84b35e8f-9fc8-41a2-8c58-f1a43d9a22dc","Type":"ContainerDied","Data":"3e617233ad9789535798de647cf19bf36308d10bf89d030cb8128b91dbf67807"}
Sep 20 01:14:31.499434 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:31.499389    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-b8cbf1-6cc5bf74f9-gfkt2" event={"ID":"84b35e8f-9fc8-41a2-8c58-f1a43d9a22dc","Type":"ContainerDied","Data":"11d9d1dba6db69fba6f9e8c1462aeee0278afb121cee609733bf727adabc8619"}
Sep 20 01:14:31.499434 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:31.499409    2570 scope.go:117] "RemoveContainer" containerID="3e617233ad9789535798de647cf19bf36308d10bf89d030cb8128b91dbf67807"
Sep 20 01:14:31.508299 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:31.508278    2570 scope.go:117] "RemoveContainer" containerID="3e617233ad9789535798de647cf19bf36308d10bf89d030cb8128b91dbf67807"
Sep 20 01:14:31.508592 ip-10-0-132-108 kubenswrapper[2570]: E0920 01:14:31.508572    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e617233ad9789535798de647cf19bf36308d10bf89d030cb8128b91dbf67807\": container with ID starting with 3e617233ad9789535798de647cf19bf36308d10bf89d030cb8128b91dbf67807 not found: ID does not exist" containerID="3e617233ad9789535798de647cf19bf36308d10bf89d030cb8128b91dbf67807"
Sep 20 01:14:31.508648 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:31.508599    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e617233ad9789535798de647cf19bf36308d10bf89d030cb8128b91dbf67807"} err="failed to get container status \"3e617233ad9789535798de647cf19bf36308d10bf89d030cb8128b91dbf67807\": rpc error: code = NotFound desc = could not find container \"3e617233ad9789535798de647cf19bf36308d10bf89d030cb8128b91dbf67807\": container with ID starting with 3e617233ad9789535798de647cf19bf36308d10bf89d030cb8128b91dbf67807 not found: ID does not exist"
Sep 20 01:14:31.519882 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:31.515626    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-b8cbf1-6cc5bf74f9-gfkt2"]
Sep 20 01:14:31.523523 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:31.523499    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-b8cbf1-6cc5bf74f9-gfkt2"]
Sep 20 01:14:33.454389 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:33.454356    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84b35e8f-9fc8-41a2-8c58-f1a43d9a22dc" path="/var/lib/kubelet/pods/84b35e8f-9fc8-41a2-8c58-f1a43d9a22dc/volumes"
Sep 20 01:14:37.091833 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:37.091799    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb"]
Sep 20 01:14:37.092388 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:37.092082    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb" podUID="54c03e2d-ff8f-41b0-a090-6c34ed6d034b" containerName="istio-proxy" containerID="cri-o://a096e5b7c6c97e2845bae3111b1e7cd939aeb5722e544996bfdcf28b0dc56947" gracePeriod=30
Sep 20 01:14:42.346876 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:42.346837    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb"
Sep 20 01:14:42.487945 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:42.487903    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54c03e2d-ff8f-41b0-a090-6c34ed6d034b-istio-podinfo\") pod \"54c03e2d-ff8f-41b0-a090-6c34ed6d034b\" (UID: \"54c03e2d-ff8f-41b0-a090-6c34ed6d034b\") "
Sep 20 01:14:42.488154 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:42.488033    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54c03e2d-ff8f-41b0-a090-6c34ed6d034b-workload-certs\") pod \"54c03e2d-ff8f-41b0-a090-6c34ed6d034b\" (UID: \"54c03e2d-ff8f-41b0-a090-6c34ed6d034b\") "
Sep 20 01:14:42.488154 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:42.488077    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54c03e2d-ff8f-41b0-a090-6c34ed6d034b-istiod-ca-cert\") pod \"54c03e2d-ff8f-41b0-a090-6c34ed6d034b\" (UID: \"54c03e2d-ff8f-41b0-a090-6c34ed6d034b\") "
Sep 20 01:14:42.488154 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:42.488103    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54c03e2d-ff8f-41b0-a090-6c34ed6d034b-istio-token\") pod \"54c03e2d-ff8f-41b0-a090-6c34ed6d034b\" (UID: \"54c03e2d-ff8f-41b0-a090-6c34ed6d034b\") "
Sep 20 01:14:42.488154 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:42.488136    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4dhnr\" (UniqueName: \"kubernetes.io/projected/54c03e2d-ff8f-41b0-a090-6c34ed6d034b-kube-api-access-4dhnr\") pod \"54c03e2d-ff8f-41b0-a090-6c34ed6d034b\" (UID: \"54c03e2d-ff8f-41b0-a090-6c34ed6d034b\") "
Sep 20 01:14:42.488394 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:42.488165    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54c03e2d-ff8f-41b0-a090-6c34ed6d034b-istio-data\") pod \"54c03e2d-ff8f-41b0-a090-6c34ed6d034b\" (UID: \"54c03e2d-ff8f-41b0-a090-6c34ed6d034b\") "
Sep 20 01:14:42.488394 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:42.488212    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54c03e2d-ff8f-41b0-a090-6c34ed6d034b-istio-envoy\") pod \"54c03e2d-ff8f-41b0-a090-6c34ed6d034b\" (UID: \"54c03e2d-ff8f-41b0-a090-6c34ed6d034b\") "
Sep 20 01:14:42.488394 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:42.488248    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54c03e2d-ff8f-41b0-a090-6c34ed6d034b-workload-socket\") pod \"54c03e2d-ff8f-41b0-a090-6c34ed6d034b\" (UID: \"54c03e2d-ff8f-41b0-a090-6c34ed6d034b\") "
Sep 20 01:14:42.488394 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:42.488290    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54c03e2d-ff8f-41b0-a090-6c34ed6d034b-credential-socket\") pod \"54c03e2d-ff8f-41b0-a090-6c34ed6d034b\" (UID: \"54c03e2d-ff8f-41b0-a090-6c34ed6d034b\") "
Sep 20 01:14:42.488394 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:42.488334    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54c03e2d-ff8f-41b0-a090-6c34ed6d034b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "54c03e2d-ff8f-41b0-a090-6c34ed6d034b" (UID: "54c03e2d-ff8f-41b0-a090-6c34ed6d034b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:42.488635 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:42.488553    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54c03e2d-ff8f-41b0-a090-6c34ed6d034b-istio-data" (OuterVolumeSpecName: "istio-data") pod "54c03e2d-ff8f-41b0-a090-6c34ed6d034b" (UID: "54c03e2d-ff8f-41b0-a090-6c34ed6d034b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:42.488635 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:42.488584    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54c03e2d-ff8f-41b0-a090-6c34ed6d034b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "54c03e2d-ff8f-41b0-a090-6c34ed6d034b" (UID: "54c03e2d-ff8f-41b0-a090-6c34ed6d034b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:42.488635 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:42.488629    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54c03e2d-ff8f-41b0-a090-6c34ed6d034b-workload-certs\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:14:42.488780 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:42.488758    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54c03e2d-ff8f-41b0-a090-6c34ed6d034b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "54c03e2d-ff8f-41b0-a090-6c34ed6d034b" (UID: "54c03e2d-ff8f-41b0-a090-6c34ed6d034b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:42.488853 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:42.488649    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54c03e2d-ff8f-41b0-a090-6c34ed6d034b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "54c03e2d-ff8f-41b0-a090-6c34ed6d034b" (UID: "54c03e2d-ff8f-41b0-a090-6c34ed6d034b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:14:42.490351 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:42.490326    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/54c03e2d-ff8f-41b0-a090-6c34ed6d034b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "54c03e2d-ff8f-41b0-a090-6c34ed6d034b" (UID: "54c03e2d-ff8f-41b0-a090-6c34ed6d034b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 20 01:14:42.490606 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:42.490587    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54c03e2d-ff8f-41b0-a090-6c34ed6d034b-istio-token" (OuterVolumeSpecName: "istio-token") pod "54c03e2d-ff8f-41b0-a090-6c34ed6d034b" (UID: "54c03e2d-ff8f-41b0-a090-6c34ed6d034b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:14:42.491089 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:42.491059    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54c03e2d-ff8f-41b0-a090-6c34ed6d034b-kube-api-access-4dhnr" (OuterVolumeSpecName: "kube-api-access-4dhnr") pod "54c03e2d-ff8f-41b0-a090-6c34ed6d034b" (UID: "54c03e2d-ff8f-41b0-a090-6c34ed6d034b"). InnerVolumeSpecName "kube-api-access-4dhnr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:14:42.491089 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:42.491055    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54c03e2d-ff8f-41b0-a090-6c34ed6d034b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "54c03e2d-ff8f-41b0-a090-6c34ed6d034b" (UID: "54c03e2d-ff8f-41b0-a090-6c34ed6d034b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:14:42.560626 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:42.560597    2570 generic.go:356] "Generic (PLEG): container finished" podID="54c03e2d-ff8f-41b0-a090-6c34ed6d034b" containerID="a096e5b7c6c97e2845bae3111b1e7cd939aeb5722e544996bfdcf28b0dc56947" exitCode=0
Sep 20 01:14:42.560823 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:42.560653    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb"
Sep 20 01:14:42.560823 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:42.560679    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb" event={"ID":"54c03e2d-ff8f-41b0-a090-6c34ed6d034b","Type":"ContainerDied","Data":"a096e5b7c6c97e2845bae3111b1e7cd939aeb5722e544996bfdcf28b0dc56947"}
Sep 20 01:14:42.560823 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:42.560743    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb" event={"ID":"54c03e2d-ff8f-41b0-a090-6c34ed6d034b","Type":"ContainerDied","Data":"f0f62d2d281224a3354fb3ab7960223d0f23219f122fee6a37469a9389c89e2c"}
Sep 20 01:14:42.560823 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:42.560775    2570 scope.go:117] "RemoveContainer" containerID="a096e5b7c6c97e2845bae3111b1e7cd939aeb5722e544996bfdcf28b0dc56947"
Sep 20 01:14:42.574578 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:42.574558    2570 scope.go:117] "RemoveContainer" containerID="a152fea93eb77a67f831ebd21c443bdd8c1ca17f010acb4d45bd9b8dff4e5217"
Sep 20 01:14:42.581370 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:42.581348    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb"]
Sep 20 01:14:42.583837 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:42.583820    2570 scope.go:117] "RemoveContainer" containerID="a096e5b7c6c97e2845bae3111b1e7cd939aeb5722e544996bfdcf28b0dc56947"
Sep 20 01:14:42.584162 ip-10-0-132-108 kubenswrapper[2570]: E0920 01:14:42.584142    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a096e5b7c6c97e2845bae3111b1e7cd939aeb5722e544996bfdcf28b0dc56947\": container with ID starting with a096e5b7c6c97e2845bae3111b1e7cd939aeb5722e544996bfdcf28b0dc56947 not found: ID does not exist" containerID="a096e5b7c6c97e2845bae3111b1e7cd939aeb5722e544996bfdcf28b0dc56947"
Sep 20 01:14:42.584228 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:42.584174    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a096e5b7c6c97e2845bae3111b1e7cd939aeb5722e544996bfdcf28b0dc56947"} err="failed to get container status \"a096e5b7c6c97e2845bae3111b1e7cd939aeb5722e544996bfdcf28b0dc56947\": rpc error: code = NotFound desc = could not find container \"a096e5b7c6c97e2845bae3111b1e7cd939aeb5722e544996bfdcf28b0dc56947\": container with ID starting with a096e5b7c6c97e2845bae3111b1e7cd939aeb5722e544996bfdcf28b0dc56947 not found: ID does not exist"
Sep 20 01:14:42.584228 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:42.584196    2570 scope.go:117] "RemoveContainer" containerID="a152fea93eb77a67f831ebd21c443bdd8c1ca17f010acb4d45bd9b8dff4e5217"
Sep 20 01:14:42.584452 ip-10-0-132-108 kubenswrapper[2570]: E0920 01:14:42.584433    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a152fea93eb77a67f831ebd21c443bdd8c1ca17f010acb4d45bd9b8dff4e5217\": container with ID starting with a152fea93eb77a67f831ebd21c443bdd8c1ca17f010acb4d45bd9b8dff4e5217 not found: ID does not exist" containerID="a152fea93eb77a67f831ebd21c443bdd8c1ca17f010acb4d45bd9b8dff4e5217"
Sep 20 01:14:42.584490 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:42.584456    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a152fea93eb77a67f831ebd21c443bdd8c1ca17f010acb4d45bd9b8dff4e5217"} err="failed to get container status \"a152fea93eb77a67f831ebd21c443bdd8c1ca17f010acb4d45bd9b8dff4e5217\": rpc error: code = NotFound desc = could not find container \"a152fea93eb77a67f831ebd21c443bdd8c1ca17f010acb4d45bd9b8dff4e5217\": container with ID starting with a152fea93eb77a67f831ebd21c443bdd8c1ca17f010acb4d45bd9b8dff4e5217 not found: ID does not exist"
Sep 20 01:14:42.585282 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:42.585263    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-b8cbf1-openshift-default-64659bb884-lblvb"]
Sep 20 01:14:42.590017 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:42.589997    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54c03e2d-ff8f-41b0-a090-6c34ed6d034b-istiod-ca-cert\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:14:42.590017 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:42.590017    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54c03e2d-ff8f-41b0-a090-6c34ed6d034b-istio-token\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:14:42.590130 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:42.590026    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4dhnr\" (UniqueName: \"kubernetes.io/projected/54c03e2d-ff8f-41b0-a090-6c34ed6d034b-kube-api-access-4dhnr\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:14:42.590130 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:42.590037    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54c03e2d-ff8f-41b0-a090-6c34ed6d034b-istio-data\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:14:42.590130 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:42.590046    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54c03e2d-ff8f-41b0-a090-6c34ed6d034b-istio-envoy\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:14:42.590130 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:42.590054    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54c03e2d-ff8f-41b0-a090-6c34ed6d034b-workload-socket\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:14:42.590130 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:42.590065    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54c03e2d-ff8f-41b0-a090-6c34ed6d034b-credential-socket\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:14:42.590130 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:42.590076    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54c03e2d-ff8f-41b0-a090-6c34ed6d034b-istio-podinfo\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:14:43.453504 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:14:43.453471    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54c03e2d-ff8f-41b0-a090-6c34ed6d034b" path="/var/lib/kubelet/pods/54c03e2d-ff8f-41b0-a090-6c34ed6d034b/volumes"
Sep 20 01:15:00.129333 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:00.129297    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29831115-p66db"]
Sep 20 01:15:00.130089 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:00.129803    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84b35e8f-9fc8-41a2-8c58-f1a43d9a22dc" containerName="payload-processing"
Sep 20 01:15:00.130089 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:00.129823    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="84b35e8f-9fc8-41a2-8c58-f1a43d9a22dc" containerName="payload-processing"
Sep 20 01:15:00.130089 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:00.129846    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3eb309b9-abfa-4b3a-b447-fca1a5421a15" containerName="istio-proxy"
Sep 20 01:15:00.130089 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:00.129855    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3eb309b9-abfa-4b3a-b447-fca1a5421a15" containerName="istio-proxy"
Sep 20 01:15:00.130089 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:00.129881    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1" containerName="istio-proxy"
Sep 20 01:15:00.130089 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:00.129890    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1" containerName="istio-proxy"
Sep 20 01:15:00.130089 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:00.129911    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="211b9855-09ca-49d9-89c0-26231f2a515a" containerName="revoke-keys"
Sep 20 01:15:00.130089 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:00.129918    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="211b9855-09ca-49d9-89c0-26231f2a515a" containerName="revoke-keys"
Sep 20 01:15:00.130089 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:00.129930    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1" containerName="istio-proxy"
Sep 20 01:15:00.130089 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:00.129938    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1" containerName="istio-proxy"
Sep 20 01:15:00.130089 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:00.129961    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3eb309b9-abfa-4b3a-b447-fca1a5421a15" containerName="istio-proxy"
Sep 20 01:15:00.130089 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:00.129969    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3eb309b9-abfa-4b3a-b447-fca1a5421a15" containerName="istio-proxy"
Sep 20 01:15:00.130089 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:00.129978    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54c03e2d-ff8f-41b0-a090-6c34ed6d034b" containerName="istio-proxy"
Sep 20 01:15:00.130089 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:00.129986    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="54c03e2d-ff8f-41b0-a090-6c34ed6d034b" containerName="istio-proxy"
Sep 20 01:15:00.130089 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:00.129997    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54c03e2d-ff8f-41b0-a090-6c34ed6d034b" containerName="istio-proxy"
Sep 20 01:15:00.130089 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:00.130012    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="54c03e2d-ff8f-41b0-a090-6c34ed6d034b" containerName="istio-proxy"
Sep 20 01:15:00.130983 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:00.130150    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="84b35e8f-9fc8-41a2-8c58-f1a43d9a22dc" containerName="payload-processing"
Sep 20 01:15:00.130983 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:00.130165    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="3eb309b9-abfa-4b3a-b447-fca1a5421a15" containerName="istio-proxy"
Sep 20 01:15:00.130983 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:00.130177    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1" containerName="istio-proxy"
Sep 20 01:15:00.130983 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:00.130186    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7c12ccc-5519-4ac9-a5b6-80bcbbc610e1" containerName="istio-proxy"
Sep 20 01:15:00.130983 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:00.130194    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="211b9855-09ca-49d9-89c0-26231f2a515a" containerName="revoke-keys"
Sep 20 01:15:00.130983 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:00.130203    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="54c03e2d-ff8f-41b0-a090-6c34ed6d034b" containerName="istio-proxy"
Sep 20 01:15:00.130983 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:00.130213    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="54c03e2d-ff8f-41b0-a090-6c34ed6d034b" containerName="istio-proxy"
Sep 20 01:15:00.135146 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:00.135126    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-d1662a-29831115-6rg6j"]
Sep 20 01:15:00.135262 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:00.135241    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29831115-p66db"
Sep 20 01:15:00.135551 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:00.135538    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="3eb309b9-abfa-4b3a-b447-fca1a5421a15" containerName="istio-proxy"
Sep 20 01:15:00.137674 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:00.137653    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5xngg\""
Sep 20 01:15:00.139204 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:00.139182    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-d1662a-29831115-6rg6j"
Sep 20 01:15:00.139598 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:00.139575    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29831115-p66db"]
Sep 20 01:15:00.142341 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:00.142318    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-d1662a-29831115-6rg6j"]
Sep 20 01:15:00.150169 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:00.150149    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29831115-p66db"
Sep 20 01:15:00.156662 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:00.156638    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-d1662a-29831115-6rg6j"
Sep 20 01:15:00.429795 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:00.429772    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-d1662a-29831115-6rg6j"]
Sep 20 01:15:00.432579 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:15:00.432528    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod443e2779_5f89_45f6_ae13_b4ed7487cc20.slice/crio-0c25839c699f8ccdd1463b078dcbec330f87da0b483d794de7ca1e1e45c68271 WatchSource:0}: Error finding container 0c25839c699f8ccdd1463b078dcbec330f87da0b483d794de7ca1e1e45c68271: Status 404 returned error can't find the container with id 0c25839c699f8ccdd1463b078dcbec330f87da0b483d794de7ca1e1e45c68271
Sep 20 01:15:00.433541 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:00.433517    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29831115-p66db"]
Sep 20 01:15:00.435523 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:15:00.435491    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf77705c0_cff0_4f44_b1ee_2ee4568aec1e.slice/crio-1e7cad55cceab880c1ae2fe1af3408494602cac983834621ba7afbc29dd0b5a1 WatchSource:0}: Error finding container 1e7cad55cceab880c1ae2fe1af3408494602cac983834621ba7afbc29dd0b5a1: Status 404 returned error can't find the container with id 1e7cad55cceab880c1ae2fe1af3408494602cac983834621ba7afbc29dd0b5a1
Sep 20 01:15:00.654710 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:00.654671    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29831115-p66db" event={"ID":"f77705c0-cff0-4f44-b1ee-2ee4568aec1e","Type":"ContainerStarted","Data":"1e7cad55cceab880c1ae2fe1af3408494602cac983834621ba7afbc29dd0b5a1"}
Sep 20 01:15:00.655940 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:00.655916    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-d1662a-29831115-6rg6j" event={"ID":"443e2779-5f89-45f6-ae13-b4ed7487cc20","Type":"ContainerStarted","Data":"0c25839c699f8ccdd1463b078dcbec330f87da0b483d794de7ca1e1e45c68271"}
Sep 20 01:15:01.663159 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:01.663126    2570 generic.go:356] "Generic (PLEG): container finished" podID="f77705c0-cff0-4f44-b1ee-2ee4568aec1e" containerID="4fee543cfe19b03d0f62cd61120fcace27d1d761827cd0c95f326ca3eecc2590" exitCode=0
Sep 20 01:15:01.663623 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:01.663209    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29831115-p66db" event={"ID":"f77705c0-cff0-4f44-b1ee-2ee4568aec1e","Type":"ContainerDied","Data":"4fee543cfe19b03d0f62cd61120fcace27d1d761827cd0c95f326ca3eecc2590"}
Sep 20 01:15:01.664819 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:01.664795    2570 generic.go:356] "Generic (PLEG): container finished" podID="443e2779-5f89-45f6-ae13-b4ed7487cc20" containerID="c4da5520a7ddbc6a2a9307f0f2c535d35b4e4a0faddcc03eb4913d281a86392e" exitCode=0
Sep 20 01:15:01.664966 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:01.664894    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-d1662a-29831115-6rg6j" event={"ID":"443e2779-5f89-45f6-ae13-b4ed7487cc20","Type":"ContainerDied","Data":"c4da5520a7ddbc6a2a9307f0f2c535d35b4e4a0faddcc03eb4913d281a86392e"}
Sep 20 01:15:02.802629 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:02.802601    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29831115-p66db"
Sep 20 01:15:02.836807 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:02.836782    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-d1662a-29831115-6rg6j"
Sep 20 01:15:03.676061 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:03.676033    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-d1662a-29831115-6rg6j"
Sep 20 01:15:03.676223 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:03.676028    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-d1662a-29831115-6rg6j" event={"ID":"443e2779-5f89-45f6-ae13-b4ed7487cc20","Type":"ContainerDied","Data":"0c25839c699f8ccdd1463b078dcbec330f87da0b483d794de7ca1e1e45c68271"}
Sep 20 01:15:03.676223 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:03.676176    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0c25839c699f8ccdd1463b078dcbec330f87da0b483d794de7ca1e1e45c68271"
Sep 20 01:15:03.677428 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:03.677395    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29831115-p66db" event={"ID":"f77705c0-cff0-4f44-b1ee-2ee4568aec1e","Type":"ContainerDied","Data":"1e7cad55cceab880c1ae2fe1af3408494602cac983834621ba7afbc29dd0b5a1"}
Sep 20 01:15:03.677578 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:03.677439    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1e7cad55cceab880c1ae2fe1af3408494602cac983834621ba7afbc29dd0b5a1"
Sep 20 01:15:03.677578 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:03.677447    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29831115-p66db"
Sep 20 01:15:18.198201 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:18.198165    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-d1662a/sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7"]
Sep 20 01:15:18.198682 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:18.198560    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="443e2779-5f89-45f6-ae13-b4ed7487cc20" containerName="cleanup"
Sep 20 01:15:18.198682 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:18.198572    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="443e2779-5f89-45f6-ae13-b4ed7487cc20" containerName="cleanup"
Sep 20 01:15:18.198682 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:18.198592    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f77705c0-cff0-4f44-b1ee-2ee4568aec1e" containerName="cleanup"
Sep 20 01:15:18.198682 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:18.198597    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="f77705c0-cff0-4f44-b1ee-2ee4568aec1e" containerName="cleanup"
Sep 20 01:15:18.198682 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:18.198655    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="443e2779-5f89-45f6-ae13-b4ed7487cc20" containerName="cleanup"
Sep 20 01:15:18.198682 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:18.198664    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="f77705c0-cff0-4f44-b1ee-2ee4568aec1e" containerName="cleanup"
Sep 20 01:15:18.201621 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:18.201600    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-d1662a/sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7"
Sep 20 01:15:18.203978 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:18.203952    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-d1662a\"/\"openshift-service-ca.crt\""
Sep 20 01:15:18.204090 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:18.203952    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-d1662a\"/\"kube-root-ca.crt\""
Sep 20 01:15:18.204696 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:18.204673    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-d1662a\"/\"default-dockercfg-kp6ds\""
Sep 20 01:15:18.204802 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:18.204716    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-d1662a\"/\"sub-test-model-d1662a-kserve-self-signed-certs\""
Sep 20 01:15:18.210201 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:18.210073    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-d1662a/sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7"]
Sep 20 01:15:18.328191 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:18.328148    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01d02929-98d4-4b42-b5c4-3631b588a7a3-dshm\") pod \"sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7\" (UID: \"01d02929-98d4-4b42-b5c4-3631b588a7a3\") " pod="ai-tenant-e2e-shared-a-w3-d1662a/sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7"
Sep 20 01:15:18.328191 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:18.328189    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01d02929-98d4-4b42-b5c4-3631b588a7a3-tmp-dir\") pod \"sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7\" (UID: \"01d02929-98d4-4b42-b5c4-3631b588a7a3\") " pod="ai-tenant-e2e-shared-a-w3-d1662a/sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7"
Sep 20 01:15:18.328461 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:18.328220    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01d02929-98d4-4b42-b5c4-3631b588a7a3-home\") pod \"sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7\" (UID: \"01d02929-98d4-4b42-b5c4-3631b588a7a3\") " pod="ai-tenant-e2e-shared-a-w3-d1662a/sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7"
Sep 20 01:15:18.328461 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:18.328288    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01d02929-98d4-4b42-b5c4-3631b588a7a3-tls-certs\") pod \"sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7\" (UID: \"01d02929-98d4-4b42-b5c4-3631b588a7a3\") " pod="ai-tenant-e2e-shared-a-w3-d1662a/sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7"
Sep 20 01:15:18.328461 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:18.328375    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01d02929-98d4-4b42-b5c4-3631b588a7a3-model-cache\") pod \"sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7\" (UID: \"01d02929-98d4-4b42-b5c4-3631b588a7a3\") " pod="ai-tenant-e2e-shared-a-w3-d1662a/sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7"
Sep 20 01:15:18.328461 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:18.328397    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zv8jw\" (UniqueName: \"kubernetes.io/projected/01d02929-98d4-4b42-b5c4-3631b588a7a3-kube-api-access-zv8jw\") pod \"sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7\" (UID: \"01d02929-98d4-4b42-b5c4-3631b588a7a3\") " pod="ai-tenant-e2e-shared-a-w3-d1662a/sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7"
Sep 20 01:15:18.428980 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:18.428944    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01d02929-98d4-4b42-b5c4-3631b588a7a3-model-cache\") pod \"sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7\" (UID: \"01d02929-98d4-4b42-b5c4-3631b588a7a3\") " pod="ai-tenant-e2e-shared-a-w3-d1662a/sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7"
Sep 20 01:15:18.428980 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:18.428999    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zv8jw\" (UniqueName: \"kubernetes.io/projected/01d02929-98d4-4b42-b5c4-3631b588a7a3-kube-api-access-zv8jw\") pod \"sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7\" (UID: \"01d02929-98d4-4b42-b5c4-3631b588a7a3\") " pod="ai-tenant-e2e-shared-a-w3-d1662a/sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7"
Sep 20 01:15:18.429248 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:18.429085    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01d02929-98d4-4b42-b5c4-3631b588a7a3-dshm\") pod \"sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7\" (UID: \"01d02929-98d4-4b42-b5c4-3631b588a7a3\") " pod="ai-tenant-e2e-shared-a-w3-d1662a/sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7"
Sep 20 01:15:18.429248 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:18.429125    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01d02929-98d4-4b42-b5c4-3631b588a7a3-tmp-dir\") pod \"sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7\" (UID: \"01d02929-98d4-4b42-b5c4-3631b588a7a3\") " pod="ai-tenant-e2e-shared-a-w3-d1662a/sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7"
Sep 20 01:15:18.429248 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:18.429160    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01d02929-98d4-4b42-b5c4-3631b588a7a3-home\") pod \"sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7\" (UID: \"01d02929-98d4-4b42-b5c4-3631b588a7a3\") " pod="ai-tenant-e2e-shared-a-w3-d1662a/sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7"
Sep 20 01:15:18.429248 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:18.429194    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01d02929-98d4-4b42-b5c4-3631b588a7a3-tls-certs\") pod \"sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7\" (UID: \"01d02929-98d4-4b42-b5c4-3631b588a7a3\") " pod="ai-tenant-e2e-shared-a-w3-d1662a/sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7"
Sep 20 01:15:18.429570 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:18.429530    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01d02929-98d4-4b42-b5c4-3631b588a7a3-model-cache\") pod \"sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7\" (UID: \"01d02929-98d4-4b42-b5c4-3631b588a7a3\") " pod="ai-tenant-e2e-shared-a-w3-d1662a/sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7"
Sep 20 01:15:18.429834 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:18.429754    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01d02929-98d4-4b42-b5c4-3631b588a7a3-home\") pod \"sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7\" (UID: \"01d02929-98d4-4b42-b5c4-3631b588a7a3\") " pod="ai-tenant-e2e-shared-a-w3-d1662a/sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7"
Sep 20 01:15:18.429834 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:18.429809    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01d02929-98d4-4b42-b5c4-3631b588a7a3-tmp-dir\") pod \"sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7\" (UID: \"01d02929-98d4-4b42-b5c4-3631b588a7a3\") " pod="ai-tenant-e2e-shared-a-w3-d1662a/sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7"
Sep 20 01:15:18.431611 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:18.431591    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01d02929-98d4-4b42-b5c4-3631b588a7a3-dshm\") pod \"sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7\" (UID: \"01d02929-98d4-4b42-b5c4-3631b588a7a3\") " pod="ai-tenant-e2e-shared-a-w3-d1662a/sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7"
Sep 20 01:15:18.431742 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:18.431725    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01d02929-98d4-4b42-b5c4-3631b588a7a3-tls-certs\") pod \"sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7\" (UID: \"01d02929-98d4-4b42-b5c4-3631b588a7a3\") " pod="ai-tenant-e2e-shared-a-w3-d1662a/sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7"
Sep 20 01:15:18.437385 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:18.437352    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zv8jw\" (UniqueName: \"kubernetes.io/projected/01d02929-98d4-4b42-b5c4-3631b588a7a3-kube-api-access-zv8jw\") pod \"sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7\" (UID: \"01d02929-98d4-4b42-b5c4-3631b588a7a3\") " pod="ai-tenant-e2e-shared-a-w3-d1662a/sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7"
Sep 20 01:15:18.514110 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:18.514018    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-d1662a/sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7"
Sep 20 01:15:18.787545 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:18.787516    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-d1662a/sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7"]
Sep 20 01:15:18.789349 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:15:18.789322    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod01d02929_98d4_4b42_b5c4_3631b588a7a3.slice/crio-e5be0af58dc696f17966aaffefee2dffea4b4d3928954541510549b670208a66 WatchSource:0}: Error finding container e5be0af58dc696f17966aaffefee2dffea4b4d3928954541510549b670208a66: Status 404 returned error can't find the container with id e5be0af58dc696f17966aaffefee2dffea4b4d3928954541510549b670208a66
Sep 20 01:15:19.777552 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:19.777509    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-d1662a/sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7" event={"ID":"01d02929-98d4-4b42-b5c4-3631b588a7a3","Type":"ContainerStarted","Data":"427f40e117bdb6afda43046869b35fa742ccd545a03488120fc90f74384ce42c"}
Sep 20 01:15:19.777552 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:19.777556    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-d1662a/sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7" event={"ID":"01d02929-98d4-4b42-b5c4-3631b588a7a3","Type":"ContainerStarted","Data":"e5be0af58dc696f17966aaffefee2dffea4b4d3928954541510549b670208a66"}
Sep 20 01:15:19.792305 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:19.792255    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-d1662a/sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7" podStartSLOduration=1.7922412250000002 podStartE2EDuration="1.792241225s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:15:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:15:19.791248188 +0000 UTC m=+1656.405404108" watchObservedRunningTime="2026-09-20 01:15:19.792241225 +0000 UTC m=+1656.406397122"
Sep 20 01:15:28.514588 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:28.514548    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-d1662a/sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7"
Sep 20 01:15:28.515047 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:28.514622    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-d1662a/sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7"
Sep 20 01:15:28.527124 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:28.527099    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-d1662a/sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7"
Sep 20 01:15:28.837438 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:15:28.837357    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-d1662a/sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7"
Sep 20 01:16:04.985225 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:04.985146    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-4c93ee/sub-test-model-4c93ee-kserve-64475545f7-4cx2r"]
Sep 20 01:16:04.988966 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:04.988933    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-4c93ee/sub-test-model-4c93ee-kserve-64475545f7-4cx2r"
Sep 20 01:16:04.991568 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:04.991541    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-4c93ee\"/\"default-dockercfg-rgm4h\""
Sep 20 01:16:04.991568 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:04.991561    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-4c93ee\"/\"openshift-service-ca.crt\""
Sep 20 01:16:04.991752 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:04.991564    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-4c93ee\"/\"kube-root-ca.crt\""
Sep 20 01:16:04.991752 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:04.991541    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-4c93ee\"/\"sub-test-model-4c93ee-kserve-self-signed-certs\""
Sep 20 01:16:04.996693 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:04.996672    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-4c93ee/sub-test-model-4c93ee-kserve-64475545f7-4cx2r"]
Sep 20 01:16:05.070811 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:05.070779    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51a0c7af-d1c5-44f7-9455-8dc8355b1313-model-cache\") pod \"sub-test-model-4c93ee-kserve-64475545f7-4cx2r\" (UID: \"51a0c7af-d1c5-44f7-9455-8dc8355b1313\") " pod="ai-tenant-e2e-shared-b-w3-4c93ee/sub-test-model-4c93ee-kserve-64475545f7-4cx2r"
Sep 20 01:16:05.070811 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:05.070821    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51a0c7af-d1c5-44f7-9455-8dc8355b1313-tls-certs\") pod \"sub-test-model-4c93ee-kserve-64475545f7-4cx2r\" (UID: \"51a0c7af-d1c5-44f7-9455-8dc8355b1313\") " pod="ai-tenant-e2e-shared-b-w3-4c93ee/sub-test-model-4c93ee-kserve-64475545f7-4cx2r"
Sep 20 01:16:05.071053 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:05.070888    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51a0c7af-d1c5-44f7-9455-8dc8355b1313-home\") pod \"sub-test-model-4c93ee-kserve-64475545f7-4cx2r\" (UID: \"51a0c7af-d1c5-44f7-9455-8dc8355b1313\") " pod="ai-tenant-e2e-shared-b-w3-4c93ee/sub-test-model-4c93ee-kserve-64475545f7-4cx2r"
Sep 20 01:16:05.071053 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:05.070930    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk9wb\" (UniqueName: \"kubernetes.io/projected/51a0c7af-d1c5-44f7-9455-8dc8355b1313-kube-api-access-hk9wb\") pod \"sub-test-model-4c93ee-kserve-64475545f7-4cx2r\" (UID: \"51a0c7af-d1c5-44f7-9455-8dc8355b1313\") " pod="ai-tenant-e2e-shared-b-w3-4c93ee/sub-test-model-4c93ee-kserve-64475545f7-4cx2r"
Sep 20 01:16:05.071053 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:05.070950    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51a0c7af-d1c5-44f7-9455-8dc8355b1313-tmp-dir\") pod \"sub-test-model-4c93ee-kserve-64475545f7-4cx2r\" (UID: \"51a0c7af-d1c5-44f7-9455-8dc8355b1313\") " pod="ai-tenant-e2e-shared-b-w3-4c93ee/sub-test-model-4c93ee-kserve-64475545f7-4cx2r"
Sep 20 01:16:05.071053 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:05.071040    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51a0c7af-d1c5-44f7-9455-8dc8355b1313-dshm\") pod \"sub-test-model-4c93ee-kserve-64475545f7-4cx2r\" (UID: \"51a0c7af-d1c5-44f7-9455-8dc8355b1313\") " pod="ai-tenant-e2e-shared-b-w3-4c93ee/sub-test-model-4c93ee-kserve-64475545f7-4cx2r"
Sep 20 01:16:05.172207 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:05.172173    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51a0c7af-d1c5-44f7-9455-8dc8355b1313-model-cache\") pod \"sub-test-model-4c93ee-kserve-64475545f7-4cx2r\" (UID: \"51a0c7af-d1c5-44f7-9455-8dc8355b1313\") " pod="ai-tenant-e2e-shared-b-w3-4c93ee/sub-test-model-4c93ee-kserve-64475545f7-4cx2r"
Sep 20 01:16:05.172207 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:05.172204    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51a0c7af-d1c5-44f7-9455-8dc8355b1313-tls-certs\") pod \"sub-test-model-4c93ee-kserve-64475545f7-4cx2r\" (UID: \"51a0c7af-d1c5-44f7-9455-8dc8355b1313\") " pod="ai-tenant-e2e-shared-b-w3-4c93ee/sub-test-model-4c93ee-kserve-64475545f7-4cx2r"
Sep 20 01:16:05.172468 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:05.172242    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51a0c7af-d1c5-44f7-9455-8dc8355b1313-home\") pod \"sub-test-model-4c93ee-kserve-64475545f7-4cx2r\" (UID: \"51a0c7af-d1c5-44f7-9455-8dc8355b1313\") " pod="ai-tenant-e2e-shared-b-w3-4c93ee/sub-test-model-4c93ee-kserve-64475545f7-4cx2r"
Sep 20 01:16:05.172468 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:05.172364    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk9wb\" (UniqueName: \"kubernetes.io/projected/51a0c7af-d1c5-44f7-9455-8dc8355b1313-kube-api-access-hk9wb\") pod \"sub-test-model-4c93ee-kserve-64475545f7-4cx2r\" (UID: \"51a0c7af-d1c5-44f7-9455-8dc8355b1313\") " pod="ai-tenant-e2e-shared-b-w3-4c93ee/sub-test-model-4c93ee-kserve-64475545f7-4cx2r"
Sep 20 01:16:05.172468 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:05.172404    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51a0c7af-d1c5-44f7-9455-8dc8355b1313-tmp-dir\") pod \"sub-test-model-4c93ee-kserve-64475545f7-4cx2r\" (UID: \"51a0c7af-d1c5-44f7-9455-8dc8355b1313\") " pod="ai-tenant-e2e-shared-b-w3-4c93ee/sub-test-model-4c93ee-kserve-64475545f7-4cx2r"
Sep 20 01:16:05.172628 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:05.172488    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51a0c7af-d1c5-44f7-9455-8dc8355b1313-dshm\") pod \"sub-test-model-4c93ee-kserve-64475545f7-4cx2r\" (UID: \"51a0c7af-d1c5-44f7-9455-8dc8355b1313\") " pod="ai-tenant-e2e-shared-b-w3-4c93ee/sub-test-model-4c93ee-kserve-64475545f7-4cx2r"
Sep 20 01:16:05.172628 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:05.172521    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51a0c7af-d1c5-44f7-9455-8dc8355b1313-home\") pod \"sub-test-model-4c93ee-kserve-64475545f7-4cx2r\" (UID: \"51a0c7af-d1c5-44f7-9455-8dc8355b1313\") " pod="ai-tenant-e2e-shared-b-w3-4c93ee/sub-test-model-4c93ee-kserve-64475545f7-4cx2r"
Sep 20 01:16:05.172628 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:05.172581    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51a0c7af-d1c5-44f7-9455-8dc8355b1313-model-cache\") pod \"sub-test-model-4c93ee-kserve-64475545f7-4cx2r\" (UID: \"51a0c7af-d1c5-44f7-9455-8dc8355b1313\") " pod="ai-tenant-e2e-shared-b-w3-4c93ee/sub-test-model-4c93ee-kserve-64475545f7-4cx2r"
Sep 20 01:16:05.172753 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:05.172711    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51a0c7af-d1c5-44f7-9455-8dc8355b1313-tmp-dir\") pod \"sub-test-model-4c93ee-kserve-64475545f7-4cx2r\" (UID: \"51a0c7af-d1c5-44f7-9455-8dc8355b1313\") " pod="ai-tenant-e2e-shared-b-w3-4c93ee/sub-test-model-4c93ee-kserve-64475545f7-4cx2r"
Sep 20 01:16:05.174673 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:05.174651    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51a0c7af-d1c5-44f7-9455-8dc8355b1313-dshm\") pod \"sub-test-model-4c93ee-kserve-64475545f7-4cx2r\" (UID: \"51a0c7af-d1c5-44f7-9455-8dc8355b1313\") " pod="ai-tenant-e2e-shared-b-w3-4c93ee/sub-test-model-4c93ee-kserve-64475545f7-4cx2r"
Sep 20 01:16:05.174892 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:05.174848    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51a0c7af-d1c5-44f7-9455-8dc8355b1313-tls-certs\") pod \"sub-test-model-4c93ee-kserve-64475545f7-4cx2r\" (UID: \"51a0c7af-d1c5-44f7-9455-8dc8355b1313\") " pod="ai-tenant-e2e-shared-b-w3-4c93ee/sub-test-model-4c93ee-kserve-64475545f7-4cx2r"
Sep 20 01:16:05.179976 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:05.179953    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk9wb\" (UniqueName: \"kubernetes.io/projected/51a0c7af-d1c5-44f7-9455-8dc8355b1313-kube-api-access-hk9wb\") pod \"sub-test-model-4c93ee-kserve-64475545f7-4cx2r\" (UID: \"51a0c7af-d1c5-44f7-9455-8dc8355b1313\") " pod="ai-tenant-e2e-shared-b-w3-4c93ee/sub-test-model-4c93ee-kserve-64475545f7-4cx2r"
Sep 20 01:16:05.298905 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:05.298791    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-4c93ee/sub-test-model-4c93ee-kserve-64475545f7-4cx2r"
Sep 20 01:16:05.570433 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:05.570409    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-4c93ee/sub-test-model-4c93ee-kserve-64475545f7-4cx2r"]
Sep 20 01:16:05.572641 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:16:05.572614    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod51a0c7af_d1c5_44f7_9455_8dc8355b1313.slice/crio-969502eb8a5ec61ebb2fd33cea66ef9a3e11fee15053d3887d93aac95f39415c WatchSource:0}: Error finding container 969502eb8a5ec61ebb2fd33cea66ef9a3e11fee15053d3887d93aac95f39415c: Status 404 returned error can't find the container with id 969502eb8a5ec61ebb2fd33cea66ef9a3e11fee15053d3887d93aac95f39415c
Sep 20 01:16:06.028816 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:06.028780    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-4c93ee/sub-test-model-4c93ee-kserve-64475545f7-4cx2r" event={"ID":"51a0c7af-d1c5-44f7-9455-8dc8355b1313","Type":"ContainerStarted","Data":"9db5721bbfc14de5575db981d8351a2d56efada6ff8f18ccec8925e6fa5d83cc"}
Sep 20 01:16:06.028816 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:06.028819    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-4c93ee/sub-test-model-4c93ee-kserve-64475545f7-4cx2r" event={"ID":"51a0c7af-d1c5-44f7-9455-8dc8355b1313","Type":"ContainerStarted","Data":"969502eb8a5ec61ebb2fd33cea66ef9a3e11fee15053d3887d93aac95f39415c"}
Sep 20 01:16:06.044844 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:06.044781    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-4c93ee/sub-test-model-4c93ee-kserve-64475545f7-4cx2r" podStartSLOduration=2.044766103 podStartE2EDuration="2.044766103s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:16:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:16:06.042850531 +0000 UTC m=+1702.657006439" watchObservedRunningTime="2026-09-20 01:16:06.044766103 +0000 UTC m=+1702.658921999"
Sep 20 01:16:15.299425 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:15.299390    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-4c93ee/sub-test-model-4c93ee-kserve-64475545f7-4cx2r"
Sep 20 01:16:15.299921 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:15.299450    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-4c93ee/sub-test-model-4c93ee-kserve-64475545f7-4cx2r"
Sep 20 01:16:15.311870 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:15.311839    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-4c93ee/sub-test-model-4c93ee-kserve-64475545f7-4cx2r"
Sep 20 01:16:16.090630 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:16.090597    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-4c93ee/sub-test-model-4c93ee-kserve-64475545f7-4cx2r"
Sep 20 01:16:38.679776 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:38.679744    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-d1662a/sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7"]
Sep 20 01:16:39.808729 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:39.808694    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-4c93ee/sub-test-model-4c93ee-kserve-64475545f7-4cx2r"]
Sep 20 01:16:53.700988 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:53.700945    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-d1662a/sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7" podUID="01d02929-98d4-4b42-b5c4-3631b588a7a3" containerName="main" containerID="cri-o://427f40e117bdb6afda43046869b35fa742ccd545a03488120fc90f74384ce42c" gracePeriod=45
Sep 20 01:16:53.948685 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:53.948654    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-d1662a/sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7"
Sep 20 01:16:54.050061 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:54.049990    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01d02929-98d4-4b42-b5c4-3631b588a7a3-home\") pod \"01d02929-98d4-4b42-b5c4-3631b588a7a3\" (UID: \"01d02929-98d4-4b42-b5c4-3631b588a7a3\") "
Sep 20 01:16:54.050061 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:54.050052    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01d02929-98d4-4b42-b5c4-3631b588a7a3-model-cache\") pod \"01d02929-98d4-4b42-b5c4-3631b588a7a3\" (UID: \"01d02929-98d4-4b42-b5c4-3631b588a7a3\") "
Sep 20 01:16:54.050284 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:54.050094    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01d02929-98d4-4b42-b5c4-3631b588a7a3-tls-certs\") pod \"01d02929-98d4-4b42-b5c4-3631b588a7a3\" (UID: \"01d02929-98d4-4b42-b5c4-3631b588a7a3\") "
Sep 20 01:16:54.050284 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:54.050130    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01d02929-98d4-4b42-b5c4-3631b588a7a3-tmp-dir\") pod \"01d02929-98d4-4b42-b5c4-3631b588a7a3\" (UID: \"01d02929-98d4-4b42-b5c4-3631b588a7a3\") "
Sep 20 01:16:54.050284 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:54.050153    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01d02929-98d4-4b42-b5c4-3631b588a7a3-dshm\") pod \"01d02929-98d4-4b42-b5c4-3631b588a7a3\" (UID: \"01d02929-98d4-4b42-b5c4-3631b588a7a3\") "
Sep 20 01:16:54.050284 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:54.050179    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zv8jw\" (UniqueName: \"kubernetes.io/projected/01d02929-98d4-4b42-b5c4-3631b588a7a3-kube-api-access-zv8jw\") pod \"01d02929-98d4-4b42-b5c4-3631b588a7a3\" (UID: \"01d02929-98d4-4b42-b5c4-3631b588a7a3\") "
Sep 20 01:16:54.050497 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:54.050304    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01d02929-98d4-4b42-b5c4-3631b588a7a3-home" (OuterVolumeSpecName: "home") pod "01d02929-98d4-4b42-b5c4-3631b588a7a3" (UID: "01d02929-98d4-4b42-b5c4-3631b588a7a3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:16:54.050497 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:54.050405    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01d02929-98d4-4b42-b5c4-3631b588a7a3-model-cache" (OuterVolumeSpecName: "model-cache") pod "01d02929-98d4-4b42-b5c4-3631b588a7a3" (UID: "01d02929-98d4-4b42-b5c4-3631b588a7a3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:16:54.050497 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:54.050423    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01d02929-98d4-4b42-b5c4-3631b588a7a3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "01d02929-98d4-4b42-b5c4-3631b588a7a3" (UID: "01d02929-98d4-4b42-b5c4-3631b588a7a3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:16:54.050643 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:54.050548    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01d02929-98d4-4b42-b5c4-3631b588a7a3-tmp-dir\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:16:54.050643 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:54.050567    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01d02929-98d4-4b42-b5c4-3631b588a7a3-home\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:16:54.050643 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:54.050581    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01d02929-98d4-4b42-b5c4-3631b588a7a3-model-cache\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:16:54.052561 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:54.052538    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01d02929-98d4-4b42-b5c4-3631b588a7a3-dshm" (OuterVolumeSpecName: "dshm") pod "01d02929-98d4-4b42-b5c4-3631b588a7a3" (UID: "01d02929-98d4-4b42-b5c4-3631b588a7a3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:16:54.052561 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:54.052549    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01d02929-98d4-4b42-b5c4-3631b588a7a3-kube-api-access-zv8jw" (OuterVolumeSpecName: "kube-api-access-zv8jw") pod "01d02929-98d4-4b42-b5c4-3631b588a7a3" (UID: "01d02929-98d4-4b42-b5c4-3631b588a7a3"). InnerVolumeSpecName "kube-api-access-zv8jw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:16:54.052687 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:54.052606    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01d02929-98d4-4b42-b5c4-3631b588a7a3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "01d02929-98d4-4b42-b5c4-3631b588a7a3" (UID: "01d02929-98d4-4b42-b5c4-3631b588a7a3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:16:54.151269 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:54.151228    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01d02929-98d4-4b42-b5c4-3631b588a7a3-tls-certs\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:16:54.151269 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:54.151259    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01d02929-98d4-4b42-b5c4-3631b588a7a3-dshm\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:16:54.151269 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:54.151269    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zv8jw\" (UniqueName: \"kubernetes.io/projected/01d02929-98d4-4b42-b5c4-3631b588a7a3-kube-api-access-zv8jw\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:16:54.278666 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:54.278627    2570 generic.go:356] "Generic (PLEG): container finished" podID="01d02929-98d4-4b42-b5c4-3631b588a7a3" containerID="427f40e117bdb6afda43046869b35fa742ccd545a03488120fc90f74384ce42c" exitCode=0
Sep 20 01:16:54.278851 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:54.278675    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-d1662a/sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7"
Sep 20 01:16:54.278851 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:54.278705    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-d1662a/sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7" event={"ID":"01d02929-98d4-4b42-b5c4-3631b588a7a3","Type":"ContainerDied","Data":"427f40e117bdb6afda43046869b35fa742ccd545a03488120fc90f74384ce42c"}
Sep 20 01:16:54.278851 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:54.278751    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-d1662a/sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7" event={"ID":"01d02929-98d4-4b42-b5c4-3631b588a7a3","Type":"ContainerDied","Data":"e5be0af58dc696f17966aaffefee2dffea4b4d3928954541510549b670208a66"}
Sep 20 01:16:54.278851 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:54.278768    2570 scope.go:117] "RemoveContainer" containerID="427f40e117bdb6afda43046869b35fa742ccd545a03488120fc90f74384ce42c"
Sep 20 01:16:54.288232 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:54.288213    2570 scope.go:117] "RemoveContainer" containerID="427f40e117bdb6afda43046869b35fa742ccd545a03488120fc90f74384ce42c"
Sep 20 01:16:54.288511 ip-10-0-132-108 kubenswrapper[2570]: E0920 01:16:54.288493    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"427f40e117bdb6afda43046869b35fa742ccd545a03488120fc90f74384ce42c\": container with ID starting with 427f40e117bdb6afda43046869b35fa742ccd545a03488120fc90f74384ce42c not found: ID does not exist" containerID="427f40e117bdb6afda43046869b35fa742ccd545a03488120fc90f74384ce42c"
Sep 20 01:16:54.288570 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:54.288523    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"427f40e117bdb6afda43046869b35fa742ccd545a03488120fc90f74384ce42c"} err="failed to get container status \"427f40e117bdb6afda43046869b35fa742ccd545a03488120fc90f74384ce42c\": rpc error: code = NotFound desc = could not find container \"427f40e117bdb6afda43046869b35fa742ccd545a03488120fc90f74384ce42c\": container with ID starting with 427f40e117bdb6afda43046869b35fa742ccd545a03488120fc90f74384ce42c not found: ID does not exist"
Sep 20 01:16:54.298064 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:54.298039    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-d1662a/sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7"]
Sep 20 01:16:54.299969 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:54.299948    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-d1662a/sub-test-model-d1662a-kserve-75db7c9fbc-vfcv7"]
Sep 20 01:16:54.828986 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:54.828926    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-4c93ee/sub-test-model-4c93ee-kserve-64475545f7-4cx2r" podUID="51a0c7af-d1c5-44f7-9455-8dc8355b1313" containerName="main" containerID="cri-o://9db5721bbfc14de5575db981d8351a2d56efada6ff8f18ccec8925e6fa5d83cc" gracePeriod=45
Sep 20 01:16:55.073172 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:55.073147    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-4c93ee/sub-test-model-4c93ee-kserve-64475545f7-4cx2r"
Sep 20 01:16:55.160749 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:55.160723    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51a0c7af-d1c5-44f7-9455-8dc8355b1313-model-cache\") pod \"51a0c7af-d1c5-44f7-9455-8dc8355b1313\" (UID: \"51a0c7af-d1c5-44f7-9455-8dc8355b1313\") "
Sep 20 01:16:55.160946 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:55.160767    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51a0c7af-d1c5-44f7-9455-8dc8355b1313-tmp-dir\") pod \"51a0c7af-d1c5-44f7-9455-8dc8355b1313\" (UID: \"51a0c7af-d1c5-44f7-9455-8dc8355b1313\") "
Sep 20 01:16:55.160946 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:55.160811    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hk9wb\" (UniqueName: \"kubernetes.io/projected/51a0c7af-d1c5-44f7-9455-8dc8355b1313-kube-api-access-hk9wb\") pod \"51a0c7af-d1c5-44f7-9455-8dc8355b1313\" (UID: \"51a0c7af-d1c5-44f7-9455-8dc8355b1313\") "
Sep 20 01:16:55.160946 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:55.160827    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51a0c7af-d1c5-44f7-9455-8dc8355b1313-dshm\") pod \"51a0c7af-d1c5-44f7-9455-8dc8355b1313\" (UID: \"51a0c7af-d1c5-44f7-9455-8dc8355b1313\") "
Sep 20 01:16:55.160946 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:55.160896    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51a0c7af-d1c5-44f7-9455-8dc8355b1313-tls-certs\") pod \"51a0c7af-d1c5-44f7-9455-8dc8355b1313\" (UID: \"51a0c7af-d1c5-44f7-9455-8dc8355b1313\") "
Sep 20 01:16:55.161163 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:55.160960    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51a0c7af-d1c5-44f7-9455-8dc8355b1313-home\") pod \"51a0c7af-d1c5-44f7-9455-8dc8355b1313\" (UID: \"51a0c7af-d1c5-44f7-9455-8dc8355b1313\") "
Sep 20 01:16:55.161163 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:55.161041    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51a0c7af-d1c5-44f7-9455-8dc8355b1313-model-cache" (OuterVolumeSpecName: "model-cache") pod "51a0c7af-d1c5-44f7-9455-8dc8355b1313" (UID: "51a0c7af-d1c5-44f7-9455-8dc8355b1313"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:16:55.161163 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:55.161074    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51a0c7af-d1c5-44f7-9455-8dc8355b1313-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "51a0c7af-d1c5-44f7-9455-8dc8355b1313" (UID: "51a0c7af-d1c5-44f7-9455-8dc8355b1313"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:16:55.161323 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:55.161241    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51a0c7af-d1c5-44f7-9455-8dc8355b1313-home" (OuterVolumeSpecName: "home") pod "51a0c7af-d1c5-44f7-9455-8dc8355b1313" (UID: "51a0c7af-d1c5-44f7-9455-8dc8355b1313"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:16:55.161323 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:55.161296    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51a0c7af-d1c5-44f7-9455-8dc8355b1313-model-cache\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:16:55.161323 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:55.161310    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51a0c7af-d1c5-44f7-9455-8dc8355b1313-tmp-dir\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:16:55.161323 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:55.161318    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51a0c7af-d1c5-44f7-9455-8dc8355b1313-home\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:16:55.163279 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:55.163257    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51a0c7af-d1c5-44f7-9455-8dc8355b1313-kube-api-access-hk9wb" (OuterVolumeSpecName: "kube-api-access-hk9wb") pod "51a0c7af-d1c5-44f7-9455-8dc8355b1313" (UID: "51a0c7af-d1c5-44f7-9455-8dc8355b1313"). InnerVolumeSpecName "kube-api-access-hk9wb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:16:55.163279 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:55.163274    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51a0c7af-d1c5-44f7-9455-8dc8355b1313-dshm" (OuterVolumeSpecName: "dshm") pod "51a0c7af-d1c5-44f7-9455-8dc8355b1313" (UID: "51a0c7af-d1c5-44f7-9455-8dc8355b1313"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:16:55.163415 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:55.163339    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51a0c7af-d1c5-44f7-9455-8dc8355b1313-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "51a0c7af-d1c5-44f7-9455-8dc8355b1313" (UID: "51a0c7af-d1c5-44f7-9455-8dc8355b1313"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:16:55.262264 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:55.262232    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51a0c7af-d1c5-44f7-9455-8dc8355b1313-tls-certs\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:16:55.262264 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:55.262255    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hk9wb\" (UniqueName: \"kubernetes.io/projected/51a0c7af-d1c5-44f7-9455-8dc8355b1313-kube-api-access-hk9wb\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:16:55.262264 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:55.262265    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51a0c7af-d1c5-44f7-9455-8dc8355b1313-dshm\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:16:55.285944 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:55.285910    2570 generic.go:356] "Generic (PLEG): container finished" podID="51a0c7af-d1c5-44f7-9455-8dc8355b1313" containerID="9db5721bbfc14de5575db981d8351a2d56efada6ff8f18ccec8925e6fa5d83cc" exitCode=0
Sep 20 01:16:55.286092 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:55.285959    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-4c93ee/sub-test-model-4c93ee-kserve-64475545f7-4cx2r"
Sep 20 01:16:55.286092 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:55.285975    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-4c93ee/sub-test-model-4c93ee-kserve-64475545f7-4cx2r" event={"ID":"51a0c7af-d1c5-44f7-9455-8dc8355b1313","Type":"ContainerDied","Data":"9db5721bbfc14de5575db981d8351a2d56efada6ff8f18ccec8925e6fa5d83cc"}
Sep 20 01:16:55.286092 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:55.286014    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-4c93ee/sub-test-model-4c93ee-kserve-64475545f7-4cx2r" event={"ID":"51a0c7af-d1c5-44f7-9455-8dc8355b1313","Type":"ContainerDied","Data":"969502eb8a5ec61ebb2fd33cea66ef9a3e11fee15053d3887d93aac95f39415c"}
Sep 20 01:16:55.286092 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:55.286038    2570 scope.go:117] "RemoveContainer" containerID="9db5721bbfc14de5575db981d8351a2d56efada6ff8f18ccec8925e6fa5d83cc"
Sep 20 01:16:55.295442 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:55.295419    2570 scope.go:117] "RemoveContainer" containerID="9db5721bbfc14de5575db981d8351a2d56efada6ff8f18ccec8925e6fa5d83cc"
Sep 20 01:16:55.295702 ip-10-0-132-108 kubenswrapper[2570]: E0920 01:16:55.295684    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9db5721bbfc14de5575db981d8351a2d56efada6ff8f18ccec8925e6fa5d83cc\": container with ID starting with 9db5721bbfc14de5575db981d8351a2d56efada6ff8f18ccec8925e6fa5d83cc not found: ID does not exist" containerID="9db5721bbfc14de5575db981d8351a2d56efada6ff8f18ccec8925e6fa5d83cc"
Sep 20 01:16:55.295767 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:55.295709    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9db5721bbfc14de5575db981d8351a2d56efada6ff8f18ccec8925e6fa5d83cc"} err="failed to get container status \"9db5721bbfc14de5575db981d8351a2d56efada6ff8f18ccec8925e6fa5d83cc\": rpc error: code = NotFound desc = could not find container \"9db5721bbfc14de5575db981d8351a2d56efada6ff8f18ccec8925e6fa5d83cc\": container with ID starting with 9db5721bbfc14de5575db981d8351a2d56efada6ff8f18ccec8925e6fa5d83cc not found: ID does not exist"
Sep 20 01:16:55.306327 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:55.306306    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-4c93ee/sub-test-model-4c93ee-kserve-64475545f7-4cx2r"]
Sep 20 01:16:55.310058 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:55.310039    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-4c93ee/sub-test-model-4c93ee-kserve-64475545f7-4cx2r"]
Sep 20 01:16:55.454096 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:55.454018    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01d02929-98d4-4b42-b5c4-3631b588a7a3" path="/var/lib/kubelet/pods/01d02929-98d4-4b42-b5c4-3631b588a7a3/volumes"
Sep 20 01:16:55.454399 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:16:55.454386    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51a0c7af-d1c5-44f7-9455-8dc8355b1313" path="/var/lib/kubelet/pods/51a0c7af-d1c5-44f7-9455-8dc8355b1313/volumes"
Sep 20 01:17:20.177434 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:17:20.177399    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-4c93ee/rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr"]
Sep 20 01:17:20.178054 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:17:20.178032    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51a0c7af-d1c5-44f7-9455-8dc8355b1313" containerName="main"
Sep 20 01:17:20.178054 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:17:20.178051    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="51a0c7af-d1c5-44f7-9455-8dc8355b1313" containerName="main"
Sep 20 01:17:20.178188 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:17:20.178081    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01d02929-98d4-4b42-b5c4-3631b588a7a3" containerName="main"
Sep 20 01:17:20.178188 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:17:20.178090    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="01d02929-98d4-4b42-b5c4-3631b588a7a3" containerName="main"
Sep 20 01:17:20.178188 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:17:20.178179    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="01d02929-98d4-4b42-b5c4-3631b588a7a3" containerName="main"
Sep 20 01:17:20.178336 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:17:20.178196    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="51a0c7af-d1c5-44f7-9455-8dc8355b1313" containerName="main"
Sep 20 01:17:20.181288 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:17:20.181268    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-4c93ee/rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr"
Sep 20 01:17:20.184003 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:17:20.183976    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-4c93ee\"/\"default-dockercfg-rgm4h\""
Sep 20 01:17:20.185583 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:17:20.185567    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-4c93ee\"/\"rate-test-model-4c93ee-kserve-self-signed-certs\""
Sep 20 01:17:20.185948 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:17:20.185932    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-4c93ee\"/\"openshift-service-ca.crt\""
Sep 20 01:17:20.186280 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:17:20.186264    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-4c93ee\"/\"kube-root-ca.crt\""
Sep 20 01:17:20.207253 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:17:20.207224    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-4c93ee/rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr"]
Sep 20 01:17:20.296993 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:17:20.296956    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb8b5019-51e6-498b-bf2f-481841ceec38-model-cache\") pod \"rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr\" (UID: \"fb8b5019-51e6-498b-bf2f-481841ceec38\") " pod="ai-tenant-e2e-shared-b-w3-4c93ee/rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr"
Sep 20 01:17:20.296993 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:17:20.296996    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqnn6\" (UniqueName: \"kubernetes.io/projected/fb8b5019-51e6-498b-bf2f-481841ceec38-kube-api-access-qqnn6\") pod \"rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr\" (UID: \"fb8b5019-51e6-498b-bf2f-481841ceec38\") " pod="ai-tenant-e2e-shared-b-w3-4c93ee/rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr"
Sep 20 01:17:20.297271 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:17:20.297026    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb8b5019-51e6-498b-bf2f-481841ceec38-tmp-dir\") pod \"rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr\" (UID: \"fb8b5019-51e6-498b-bf2f-481841ceec38\") " pod="ai-tenant-e2e-shared-b-w3-4c93ee/rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr"
Sep 20 01:17:20.297271 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:17:20.297140    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb8b5019-51e6-498b-bf2f-481841ceec38-dshm\") pod \"rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr\" (UID: \"fb8b5019-51e6-498b-bf2f-481841ceec38\") " pod="ai-tenant-e2e-shared-b-w3-4c93ee/rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr"
Sep 20 01:17:20.297271 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:17:20.297202    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb8b5019-51e6-498b-bf2f-481841ceec38-home\") pod \"rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr\" (UID: \"fb8b5019-51e6-498b-bf2f-481841ceec38\") " pod="ai-tenant-e2e-shared-b-w3-4c93ee/rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr"
Sep 20 01:17:20.297271 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:17:20.297253    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb8b5019-51e6-498b-bf2f-481841ceec38-tls-certs\") pod \"rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr\" (UID: \"fb8b5019-51e6-498b-bf2f-481841ceec38\") " pod="ai-tenant-e2e-shared-b-w3-4c93ee/rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr"
Sep 20 01:17:20.398263 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:17:20.398220    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb8b5019-51e6-498b-bf2f-481841ceec38-dshm\") pod \"rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr\" (UID: \"fb8b5019-51e6-498b-bf2f-481841ceec38\") " pod="ai-tenant-e2e-shared-b-w3-4c93ee/rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr"
Sep 20 01:17:20.398460 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:17:20.398295    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb8b5019-51e6-498b-bf2f-481841ceec38-home\") pod \"rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr\" (UID: \"fb8b5019-51e6-498b-bf2f-481841ceec38\") " pod="ai-tenant-e2e-shared-b-w3-4c93ee/rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr"
Sep 20 01:17:20.398460 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:17:20.398332    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb8b5019-51e6-498b-bf2f-481841ceec38-tls-certs\") pod \"rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr\" (UID: \"fb8b5019-51e6-498b-bf2f-481841ceec38\") " pod="ai-tenant-e2e-shared-b-w3-4c93ee/rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr"
Sep 20 01:17:20.398460 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:17:20.398365    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb8b5019-51e6-498b-bf2f-481841ceec38-model-cache\") pod \"rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr\" (UID: \"fb8b5019-51e6-498b-bf2f-481841ceec38\") " pod="ai-tenant-e2e-shared-b-w3-4c93ee/rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr"
Sep 20 01:17:20.398460 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:17:20.398384    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqnn6\" (UniqueName: \"kubernetes.io/projected/fb8b5019-51e6-498b-bf2f-481841ceec38-kube-api-access-qqnn6\") pod \"rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr\" (UID: \"fb8b5019-51e6-498b-bf2f-481841ceec38\") " pod="ai-tenant-e2e-shared-b-w3-4c93ee/rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr"
Sep 20 01:17:20.398460 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:17:20.398418    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb8b5019-51e6-498b-bf2f-481841ceec38-tmp-dir\") pod \"rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr\" (UID: \"fb8b5019-51e6-498b-bf2f-481841ceec38\") " pod="ai-tenant-e2e-shared-b-w3-4c93ee/rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr"
Sep 20 01:17:20.398752 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:17:20.398735    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb8b5019-51e6-498b-bf2f-481841ceec38-home\") pod \"rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr\" (UID: \"fb8b5019-51e6-498b-bf2f-481841ceec38\") " pod="ai-tenant-e2e-shared-b-w3-4c93ee/rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr"
Sep 20 01:17:20.398804 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:17:20.398770    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb8b5019-51e6-498b-bf2f-481841ceec38-model-cache\") pod \"rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr\" (UID: \"fb8b5019-51e6-498b-bf2f-481841ceec38\") " pod="ai-tenant-e2e-shared-b-w3-4c93ee/rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr"
Sep 20 01:17:20.398804 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:17:20.398784    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb8b5019-51e6-498b-bf2f-481841ceec38-tmp-dir\") pod \"rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr\" (UID: \"fb8b5019-51e6-498b-bf2f-481841ceec38\") " pod="ai-tenant-e2e-shared-b-w3-4c93ee/rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr"
Sep 20 01:17:20.400754 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:17:20.400720    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb8b5019-51e6-498b-bf2f-481841ceec38-dshm\") pod \"rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr\" (UID: \"fb8b5019-51e6-498b-bf2f-481841ceec38\") " pod="ai-tenant-e2e-shared-b-w3-4c93ee/rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr"
Sep 20 01:17:20.401007 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:17:20.400991    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb8b5019-51e6-498b-bf2f-481841ceec38-tls-certs\") pod \"rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr\" (UID: \"fb8b5019-51e6-498b-bf2f-481841ceec38\") " pod="ai-tenant-e2e-shared-b-w3-4c93ee/rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr"
Sep 20 01:17:20.405899 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:17:20.405879    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqnn6\" (UniqueName: \"kubernetes.io/projected/fb8b5019-51e6-498b-bf2f-481841ceec38-kube-api-access-qqnn6\") pod \"rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr\" (UID: \"fb8b5019-51e6-498b-bf2f-481841ceec38\") " pod="ai-tenant-e2e-shared-b-w3-4c93ee/rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr"
Sep 20 01:17:20.490144 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:17:20.490056    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-4c93ee/rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr"
Sep 20 01:17:20.761364 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:17:20.761336    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-4c93ee/rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr"]
Sep 20 01:17:20.763735 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:17:20.763701    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfb8b5019_51e6_498b_bf2f_481841ceec38.slice/crio-4b5d09d4de805df26a7071b34b667d47707448cddd5414a39891910b47ed20b3 WatchSource:0}: Error finding container 4b5d09d4de805df26a7071b34b667d47707448cddd5414a39891910b47ed20b3: Status 404 returned error can't find the container with id 4b5d09d4de805df26a7071b34b667d47707448cddd5414a39891910b47ed20b3
Sep 20 01:17:21.430707 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:17:21.430670    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-4c93ee/rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr" event={"ID":"fb8b5019-51e6-498b-bf2f-481841ceec38","Type":"ContainerStarted","Data":"bdcad42b7c4324affc226d3797a430e82f28298adde00058ecfeffe129b29669"}
Sep 20 01:17:21.430707 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:17:21.430711    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-4c93ee/rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr" event={"ID":"fb8b5019-51e6-498b-bf2f-481841ceec38","Type":"ContainerStarted","Data":"4b5d09d4de805df26a7071b34b667d47707448cddd5414a39891910b47ed20b3"}
Sep 20 01:17:21.449081 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:17:21.449018    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-4c93ee/rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr" podStartSLOduration=1.448996981 podStartE2EDuration="1.448996981s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:17:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:17:21.446242782 +0000 UTC m=+1778.060398699" watchObservedRunningTime="2026-09-20 01:17:21.448996981 +0000 UTC m=+1778.063152879"
Sep 20 01:17:30.490668 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:17:30.490583    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-4c93ee/rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr"
Sep 20 01:17:30.490668 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:17:30.490627    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-4c93ee/rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr"
Sep 20 01:17:30.503174 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:17:30.503147    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-4c93ee/rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr"
Sep 20 01:17:31.497021 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:17:31.496989    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-4c93ee/rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr"
Sep 20 01:17:45.572803 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:17:45.572771    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65l6f_bf898d8f-ed0f-4b4e-9a87-8e6167b29481/ovn-acl-logging/0.log"
Sep 20 01:17:45.573286 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:17:45.572836    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65l6f_bf898d8f-ed0f-4b4e-9a87-8e6167b29481/ovn-acl-logging/0.log"
Sep 20 01:17:59.689221 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:17:59.689181    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-4c93ee/rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr"]
Sep 20 01:18:00.408256 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:00.408225    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f"]
Sep 20 01:18:00.412234 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:00.412211    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f"
Sep 20 01:18:00.414220 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:00.414194    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-e458de-openshift-default-dockercfg-mxddd\""
Sep 20 01:18:00.423754 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:00.423725    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f"]
Sep 20 01:18:00.582359 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:00.582318    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac922f5e-4043-4ce1-acbb-78275fa02dbf-istio-envoy\") pod \"e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f\" (UID: \"ac922f5e-4043-4ce1-acbb-78275fa02dbf\") " pod="openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f"
Sep 20 01:18:00.582572 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:00.582392    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac922f5e-4043-4ce1-acbb-78275fa02dbf-workload-certs\") pod \"e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f\" (UID: \"ac922f5e-4043-4ce1-acbb-78275fa02dbf\") " pod="openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f"
Sep 20 01:18:00.582572 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:00.582428    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac922f5e-4043-4ce1-acbb-78275fa02dbf-istio-data\") pod \"e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f\" (UID: \"ac922f5e-4043-4ce1-acbb-78275fa02dbf\") " pod="openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f"
Sep 20 01:18:00.582572 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:00.582446    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac922f5e-4043-4ce1-acbb-78275fa02dbf-credential-socket\") pod \"e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f\" (UID: \"ac922f5e-4043-4ce1-acbb-78275fa02dbf\") " pod="openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f"
Sep 20 01:18:00.582572 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:00.582543    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac922f5e-4043-4ce1-acbb-78275fa02dbf-istio-podinfo\") pod \"e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f\" (UID: \"ac922f5e-4043-4ce1-acbb-78275fa02dbf\") " pod="openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f"
Sep 20 01:18:00.582807 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:00.582594    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac922f5e-4043-4ce1-acbb-78275fa02dbf-istio-token\") pod \"e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f\" (UID: \"ac922f5e-4043-4ce1-acbb-78275fa02dbf\") " pod="openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f"
Sep 20 01:18:00.582807 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:00.582677    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfk2z\" (UniqueName: \"kubernetes.io/projected/ac922f5e-4043-4ce1-acbb-78275fa02dbf-kube-api-access-zfk2z\") pod \"e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f\" (UID: \"ac922f5e-4043-4ce1-acbb-78275fa02dbf\") " pod="openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f"
Sep 20 01:18:00.582807 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:00.582711    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac922f5e-4043-4ce1-acbb-78275fa02dbf-istiod-ca-cert\") pod \"e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f\" (UID: \"ac922f5e-4043-4ce1-acbb-78275fa02dbf\") " pod="openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f"
Sep 20 01:18:00.582807 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:00.582739    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac922f5e-4043-4ce1-acbb-78275fa02dbf-workload-socket\") pod \"e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f\" (UID: \"ac922f5e-4043-4ce1-acbb-78275fa02dbf\") " pod="openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f"
Sep 20 01:18:00.683768 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:00.683670    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac922f5e-4043-4ce1-acbb-78275fa02dbf-istio-podinfo\") pod \"e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f\" (UID: \"ac922f5e-4043-4ce1-acbb-78275fa02dbf\") " pod="openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f"
Sep 20 01:18:00.683768 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:00.683718    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac922f5e-4043-4ce1-acbb-78275fa02dbf-istio-token\") pod \"e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f\" (UID: \"ac922f5e-4043-4ce1-acbb-78275fa02dbf\") " pod="openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f"
Sep 20 01:18:00.683768 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:00.683751    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfk2z\" (UniqueName: \"kubernetes.io/projected/ac922f5e-4043-4ce1-acbb-78275fa02dbf-kube-api-access-zfk2z\") pod \"e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f\" (UID: \"ac922f5e-4043-4ce1-acbb-78275fa02dbf\") " pod="openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f"
Sep 20 01:18:00.684080 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:00.683772    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac922f5e-4043-4ce1-acbb-78275fa02dbf-istiod-ca-cert\") pod \"e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f\" (UID: \"ac922f5e-4043-4ce1-acbb-78275fa02dbf\") " pod="openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f"
Sep 20 01:18:00.684080 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:00.683795    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac922f5e-4043-4ce1-acbb-78275fa02dbf-workload-socket\") pod \"e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f\" (UID: \"ac922f5e-4043-4ce1-acbb-78275fa02dbf\") " pod="openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f"
Sep 20 01:18:00.684080 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:00.683818    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac922f5e-4043-4ce1-acbb-78275fa02dbf-istio-envoy\") pod \"e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f\" (UID: \"ac922f5e-4043-4ce1-acbb-78275fa02dbf\") " pod="openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f"
Sep 20 01:18:00.684080 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:00.683957    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac922f5e-4043-4ce1-acbb-78275fa02dbf-workload-certs\") pod \"e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f\" (UID: \"ac922f5e-4043-4ce1-acbb-78275fa02dbf\") " pod="openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f"
Sep 20 01:18:00.684080 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:00.684013    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac922f5e-4043-4ce1-acbb-78275fa02dbf-istio-data\") pod \"e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f\" (UID: \"ac922f5e-4043-4ce1-acbb-78275fa02dbf\") " pod="openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f"
Sep 20 01:18:00.684080 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:00.684044    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac922f5e-4043-4ce1-acbb-78275fa02dbf-credential-socket\") pod \"e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f\" (UID: \"ac922f5e-4043-4ce1-acbb-78275fa02dbf\") " pod="openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f"
Sep 20 01:18:00.684411 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:00.684280    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac922f5e-4043-4ce1-acbb-78275fa02dbf-workload-socket\") pod \"e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f\" (UID: \"ac922f5e-4043-4ce1-acbb-78275fa02dbf\") " pod="openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f"
Sep 20 01:18:00.684411 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:00.684360    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac922f5e-4043-4ce1-acbb-78275fa02dbf-credential-socket\") pod \"e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f\" (UID: \"ac922f5e-4043-4ce1-acbb-78275fa02dbf\") " pod="openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f"
Sep 20 01:18:00.684411 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:00.684400    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac922f5e-4043-4ce1-acbb-78275fa02dbf-istio-data\") pod \"e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f\" (UID: \"ac922f5e-4043-4ce1-acbb-78275fa02dbf\") " pod="openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f"
Sep 20 01:18:00.684555 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:00.684454    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac922f5e-4043-4ce1-acbb-78275fa02dbf-workload-certs\") pod \"e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f\" (UID: \"ac922f5e-4043-4ce1-acbb-78275fa02dbf\") " pod="openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f"
Sep 20 01:18:00.684644 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:00.684626    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac922f5e-4043-4ce1-acbb-78275fa02dbf-istiod-ca-cert\") pod \"e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f\" (UID: \"ac922f5e-4043-4ce1-acbb-78275fa02dbf\") " pod="openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f"
Sep 20 01:18:00.686381 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:00.686357    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac922f5e-4043-4ce1-acbb-78275fa02dbf-istio-podinfo\") pod \"e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f\" (UID: \"ac922f5e-4043-4ce1-acbb-78275fa02dbf\") " pod="openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f"
Sep 20 01:18:00.686472 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:00.686365    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac922f5e-4043-4ce1-acbb-78275fa02dbf-istio-envoy\") pod \"e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f\" (UID: \"ac922f5e-4043-4ce1-acbb-78275fa02dbf\") " pod="openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f"
Sep 20 01:18:00.691215 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:00.691198    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac922f5e-4043-4ce1-acbb-78275fa02dbf-istio-token\") pod \"e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f\" (UID: \"ac922f5e-4043-4ce1-acbb-78275fa02dbf\") " pod="openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f"
Sep 20 01:18:00.691512 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:00.691235    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfk2z\" (UniqueName: \"kubernetes.io/projected/ac922f5e-4043-4ce1-acbb-78275fa02dbf-kube-api-access-zfk2z\") pod \"e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f\" (UID: \"ac922f5e-4043-4ce1-acbb-78275fa02dbf\") " pod="openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f"
Sep 20 01:18:00.724611 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:00.724582    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f"
Sep 20 01:18:00.998948 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:00.998918    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f"]
Sep 20 01:18:01.001984 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:18:01.001951    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac922f5e_4043_4ce1_acbb_78275fa02dbf.slice/crio-8ba336552e0b54738618c2e31a7ce53fbc5b2f08171bdaf5e74bfc103fb41e7d WatchSource:0}: Error finding container 8ba336552e0b54738618c2e31a7ce53fbc5b2f08171bdaf5e74bfc103fb41e7d: Status 404 returned error can't find the container with id 8ba336552e0b54738618c2e31a7ce53fbc5b2f08171bdaf5e74bfc103fb41e7d
Sep 20 01:18:01.004241 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:01.004205    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:18:01.004343 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:01.004298    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:18:01.004409 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:01.004352    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:18:01.643521 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:01.643481    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f" event={"ID":"ac922f5e-4043-4ce1-acbb-78275fa02dbf","Type":"ContainerStarted","Data":"d9aaa504b3063354e9ecfdf2b3974a0eb39accb654c8acac52376186a1f78ac2"}
Sep 20 01:18:01.643784 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:01.643544    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f" event={"ID":"ac922f5e-4043-4ce1-acbb-78275fa02dbf","Type":"ContainerStarted","Data":"8ba336552e0b54738618c2e31a7ce53fbc5b2f08171bdaf5e74bfc103fb41e7d"}
Sep 20 01:18:01.662995 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:01.662949    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f" podStartSLOduration=1.662934211 podStartE2EDuration="1.662934211s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:18:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:18:01.661424484 +0000 UTC m=+1818.275580410" watchObservedRunningTime="2026-09-20 01:18:01.662934211 +0000 UTC m=+1818.277090107"
Sep 20 01:18:01.724691 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:01.724643    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f"
Sep 20 01:18:02.731383 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:02.731349    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f"
Sep 20 01:18:03.656300 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:03.656258    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f"
Sep 20 01:18:03.657239 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:03.657216    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f"
Sep 20 01:18:05.873109 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:05.873074    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-e458de-5f6fbd6858-47q58"]
Sep 20 01:18:05.878231 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:05.878213    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e458de-5f6fbd6858-47q58"
Sep 20 01:18:05.880338 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:05.880303    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-e458de-dockercfg-4gpdh\""
Sep 20 01:18:05.880584 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:05.880566    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-e458de\""
Sep 20 01:18:05.884890 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:05.884850    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-e458de-5f6fbd6858-47q58"]
Sep 20 01:18:05.903796 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:05.903765    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-e458de-d45cc4f79-44rx6"]
Sep 20 01:18:05.907922 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:05.907901    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-e458de-d45cc4f79-44rx6"
Sep 20 01:18:05.918828 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:05.918804    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-e458de-d45cc4f79-44rx6"]
Sep 20 01:18:06.038813 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:06.038778    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4q2l4\" (UniqueName: \"kubernetes.io/projected/5b0389c3-771e-4cec-a279-96f4eb954cbe-kube-api-access-4q2l4\") pod \"payload-pre-processing-e2e-ipp-a-e458de-5f6fbd6858-47q58\" (UID: \"5b0389c3-771e-4cec-a279-96f4eb954cbe\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e458de-5f6fbd6858-47q58"
Sep 20 01:18:06.039014 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:06.038846    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/70554b2d-1ec8-4879-8942-61afca657241-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-e458de-d45cc4f79-44rx6\" (UID: \"70554b2d-1ec8-4879-8942-61afca657241\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-e458de-d45cc4f79-44rx6"
Sep 20 01:18:06.039014 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:06.038950    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpb5c\" (UniqueName: \"kubernetes.io/projected/70554b2d-1ec8-4879-8942-61afca657241-kube-api-access-bpb5c\") pod \"payload-processing-e2e-ipp-a-e458de-d45cc4f79-44rx6\" (UID: \"70554b2d-1ec8-4879-8942-61afca657241\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-e458de-d45cc4f79-44rx6"
Sep 20 01:18:06.039014 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:06.038983    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b0389c3-771e-4cec-a279-96f4eb954cbe-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-e458de-5f6fbd6858-47q58\" (UID: \"5b0389c3-771e-4cec-a279-96f4eb954cbe\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e458de-5f6fbd6858-47q58"
Sep 20 01:18:06.140181 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:06.140089    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpb5c\" (UniqueName: \"kubernetes.io/projected/70554b2d-1ec8-4879-8942-61afca657241-kube-api-access-bpb5c\") pod \"payload-processing-e2e-ipp-a-e458de-d45cc4f79-44rx6\" (UID: \"70554b2d-1ec8-4879-8942-61afca657241\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-e458de-d45cc4f79-44rx6"
Sep 20 01:18:06.140181 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:06.140136    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b0389c3-771e-4cec-a279-96f4eb954cbe-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-e458de-5f6fbd6858-47q58\" (UID: \"5b0389c3-771e-4cec-a279-96f4eb954cbe\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e458de-5f6fbd6858-47q58"
Sep 20 01:18:06.140423 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:06.140195    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4q2l4\" (UniqueName: \"kubernetes.io/projected/5b0389c3-771e-4cec-a279-96f4eb954cbe-kube-api-access-4q2l4\") pod \"payload-pre-processing-e2e-ipp-a-e458de-5f6fbd6858-47q58\" (UID: \"5b0389c3-771e-4cec-a279-96f4eb954cbe\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e458de-5f6fbd6858-47q58"
Sep 20 01:18:06.140423 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:06.140251    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/70554b2d-1ec8-4879-8942-61afca657241-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-e458de-d45cc4f79-44rx6\" (UID: \"70554b2d-1ec8-4879-8942-61afca657241\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-e458de-d45cc4f79-44rx6"
Sep 20 01:18:06.140891 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:06.140845    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b0389c3-771e-4cec-a279-96f4eb954cbe-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-e458de-5f6fbd6858-47q58\" (UID: \"5b0389c3-771e-4cec-a279-96f4eb954cbe\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e458de-5f6fbd6858-47q58"
Sep 20 01:18:06.140980 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:06.140963    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/70554b2d-1ec8-4879-8942-61afca657241-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-e458de-d45cc4f79-44rx6\" (UID: \"70554b2d-1ec8-4879-8942-61afca657241\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-e458de-d45cc4f79-44rx6"
Sep 20 01:18:06.148226 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:06.148198    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4q2l4\" (UniqueName: \"kubernetes.io/projected/5b0389c3-771e-4cec-a279-96f4eb954cbe-kube-api-access-4q2l4\") pod \"payload-pre-processing-e2e-ipp-a-e458de-5f6fbd6858-47q58\" (UID: \"5b0389c3-771e-4cec-a279-96f4eb954cbe\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e458de-5f6fbd6858-47q58"
Sep 20 01:18:06.148321 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:06.148196    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpb5c\" (UniqueName: \"kubernetes.io/projected/70554b2d-1ec8-4879-8942-61afca657241-kube-api-access-bpb5c\") pod \"payload-processing-e2e-ipp-a-e458de-d45cc4f79-44rx6\" (UID: \"70554b2d-1ec8-4879-8942-61afca657241\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-e458de-d45cc4f79-44rx6"
Sep 20 01:18:06.192035 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:06.191997    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e458de-5f6fbd6858-47q58"
Sep 20 01:18:06.220240 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:06.220204    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-e458de-d45cc4f79-44rx6"
Sep 20 01:18:06.464726 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:06.464702    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-e458de-5f6fbd6858-47q58"]
Sep 20 01:18:06.466488 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:18:06.466459    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b0389c3_771e_4cec_a279_96f4eb954cbe.slice/crio-0cb170b99b88e006284330473376e2adb5de695fabd52c0116545d702caab3b8 WatchSource:0}: Error finding container 0cb170b99b88e006284330473376e2adb5de695fabd52c0116545d702caab3b8: Status 404 returned error can't find the container with id 0cb170b99b88e006284330473376e2adb5de695fabd52c0116545d702caab3b8
Sep 20 01:18:06.501016 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:06.500988    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-e458de-d45cc4f79-44rx6"]
Sep 20 01:18:06.502530 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:18:06.502506    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70554b2d_1ec8_4879_8942_61afca657241.slice/crio-50e11cfb9e19f8b605cb8d526a7fba275395e26837e28dbd3adc89bcc03d0250 WatchSource:0}: Error finding container 50e11cfb9e19f8b605cb8d526a7fba275395e26837e28dbd3adc89bcc03d0250: Status 404 returned error can't find the container with id 50e11cfb9e19f8b605cb8d526a7fba275395e26837e28dbd3adc89bcc03d0250
Sep 20 01:18:06.676675 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:06.676636    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-e458de-d45cc4f79-44rx6" event={"ID":"70554b2d-1ec8-4879-8942-61afca657241","Type":"ContainerStarted","Data":"826f8ca9c8a5d58eca96d3423d3558a73ac84fd2f8a6add0aa0c9c60f1e3a4b3"}
Sep 20 01:18:06.676911 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:06.676851    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-e458de-d45cc4f79-44rx6"
Sep 20 01:18:06.676988 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:06.676918    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-e458de-d45cc4f79-44rx6" event={"ID":"70554b2d-1ec8-4879-8942-61afca657241","Type":"ContainerStarted","Data":"50e11cfb9e19f8b605cb8d526a7fba275395e26837e28dbd3adc89bcc03d0250"}
Sep 20 01:18:06.678378 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:06.678356    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e458de-5f6fbd6858-47q58" event={"ID":"5b0389c3-771e-4cec-a279-96f4eb954cbe","Type":"ContainerStarted","Data":"1dd426fd406383a412b2cab540130a9e234ba6653c1f4e63604cde080315e775"}
Sep 20 01:18:06.678490 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:06.678398    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e458de-5f6fbd6858-47q58" event={"ID":"5b0389c3-771e-4cec-a279-96f4eb954cbe","Type":"ContainerStarted","Data":"0cb170b99b88e006284330473376e2adb5de695fabd52c0116545d702caab3b8"}
Sep 20 01:18:06.678490 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:06.678439    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e458de-5f6fbd6858-47q58"
Sep 20 01:18:06.694756 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:06.694703    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-e458de-d45cc4f79-44rx6" podStartSLOduration=1.694685249 podStartE2EDuration="1.694685249s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:18:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:18:06.692201992 +0000 UTC m=+1823.306357918" watchObservedRunningTime="2026-09-20 01:18:06.694685249 +0000 UTC m=+1823.308841148"
Sep 20 01:18:14.709224 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:14.709172    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-4c93ee/rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr" podUID="fb8b5019-51e6-498b-bf2f-481841ceec38" containerName="main" containerID="cri-o://bdcad42b7c4324affc226d3797a430e82f28298adde00058ecfeffe129b29669" gracePeriod=45
Sep 20 01:18:14.996345 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:14.996321    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-4c93ee/rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr"
Sep 20 01:18:15.018189 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:15.018133    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e458de-5f6fbd6858-47q58" podStartSLOduration=10.018111497 podStartE2EDuration="10.018111497s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:18:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:18:06.713383073 +0000 UTC m=+1823.327538970" watchObservedRunningTime="2026-09-20 01:18:15.018111497 +0000 UTC m=+1831.632267395"
Sep 20 01:18:15.025665 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:15.025638    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb8b5019-51e6-498b-bf2f-481841ceec38-home\") pod \"fb8b5019-51e6-498b-bf2f-481841ceec38\" (UID: \"fb8b5019-51e6-498b-bf2f-481841ceec38\") "
Sep 20 01:18:15.025802 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:15.025679    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qqnn6\" (UniqueName: \"kubernetes.io/projected/fb8b5019-51e6-498b-bf2f-481841ceec38-kube-api-access-qqnn6\") pod \"fb8b5019-51e6-498b-bf2f-481841ceec38\" (UID: \"fb8b5019-51e6-498b-bf2f-481841ceec38\") "
Sep 20 01:18:15.025802 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:15.025727    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb8b5019-51e6-498b-bf2f-481841ceec38-tmp-dir\") pod \"fb8b5019-51e6-498b-bf2f-481841ceec38\" (UID: \"fb8b5019-51e6-498b-bf2f-481841ceec38\") "
Sep 20 01:18:15.025802 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:15.025760    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb8b5019-51e6-498b-bf2f-481841ceec38-tls-certs\") pod \"fb8b5019-51e6-498b-bf2f-481841ceec38\" (UID: \"fb8b5019-51e6-498b-bf2f-481841ceec38\") "
Sep 20 01:18:15.026002 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:15.025821    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb8b5019-51e6-498b-bf2f-481841ceec38-model-cache\") pod \"fb8b5019-51e6-498b-bf2f-481841ceec38\" (UID: \"fb8b5019-51e6-498b-bf2f-481841ceec38\") "
Sep 20 01:18:15.026002 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:15.025845    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb8b5019-51e6-498b-bf2f-481841ceec38-dshm\") pod \"fb8b5019-51e6-498b-bf2f-481841ceec38\" (UID: \"fb8b5019-51e6-498b-bf2f-481841ceec38\") "
Sep 20 01:18:15.026530 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:15.026507    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb8b5019-51e6-498b-bf2f-481841ceec38-home" (OuterVolumeSpecName: "home") pod "fb8b5019-51e6-498b-bf2f-481841ceec38" (UID: "fb8b5019-51e6-498b-bf2f-481841ceec38"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:18:15.027036 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:15.026986    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb8b5019-51e6-498b-bf2f-481841ceec38-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fb8b5019-51e6-498b-bf2f-481841ceec38" (UID: "fb8b5019-51e6-498b-bf2f-481841ceec38"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:18:15.027256 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:15.027220    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb8b5019-51e6-498b-bf2f-481841ceec38-model-cache" (OuterVolumeSpecName: "model-cache") pod "fb8b5019-51e6-498b-bf2f-481841ceec38" (UID: "fb8b5019-51e6-498b-bf2f-481841ceec38"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:18:15.030539 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:15.030501    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb8b5019-51e6-498b-bf2f-481841ceec38-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fb8b5019-51e6-498b-bf2f-481841ceec38" (UID: "fb8b5019-51e6-498b-bf2f-481841ceec38"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:18:15.031339 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:15.031307    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb8b5019-51e6-498b-bf2f-481841ceec38-dshm" (OuterVolumeSpecName: "dshm") pod "fb8b5019-51e6-498b-bf2f-481841ceec38" (UID: "fb8b5019-51e6-498b-bf2f-481841ceec38"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:18:15.031413 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:15.031332    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb8b5019-51e6-498b-bf2f-481841ceec38-kube-api-access-qqnn6" (OuterVolumeSpecName: "kube-api-access-qqnn6") pod "fb8b5019-51e6-498b-bf2f-481841ceec38" (UID: "fb8b5019-51e6-498b-bf2f-481841ceec38"). InnerVolumeSpecName "kube-api-access-qqnn6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:18:15.127504 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:15.127464    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb8b5019-51e6-498b-bf2f-481841ceec38-home\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:18:15.127504 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:15.127501    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqnn6\" (UniqueName: \"kubernetes.io/projected/fb8b5019-51e6-498b-bf2f-481841ceec38-kube-api-access-qqnn6\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:18:15.127504 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:15.127512    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb8b5019-51e6-498b-bf2f-481841ceec38-tmp-dir\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:18:15.127745 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:15.127521    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb8b5019-51e6-498b-bf2f-481841ceec38-tls-certs\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:18:15.127745 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:15.127530    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb8b5019-51e6-498b-bf2f-481841ceec38-model-cache\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:18:15.127745 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:15.127536    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb8b5019-51e6-498b-bf2f-481841ceec38-dshm\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:18:15.726668 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:15.726582    2570 generic.go:356] "Generic (PLEG): container finished" podID="fb8b5019-51e6-498b-bf2f-481841ceec38" containerID="bdcad42b7c4324affc226d3797a430e82f28298adde00058ecfeffe129b29669" exitCode=0
Sep 20 01:18:15.726668 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:15.726623    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-4c93ee/rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr"
Sep 20 01:18:15.727155 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:15.726671    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-4c93ee/rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr" event={"ID":"fb8b5019-51e6-498b-bf2f-481841ceec38","Type":"ContainerDied","Data":"bdcad42b7c4324affc226d3797a430e82f28298adde00058ecfeffe129b29669"}
Sep 20 01:18:15.727155 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:15.726718    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-4c93ee/rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr" event={"ID":"fb8b5019-51e6-498b-bf2f-481841ceec38","Type":"ContainerDied","Data":"4b5d09d4de805df26a7071b34b667d47707448cddd5414a39891910b47ed20b3"}
Sep 20 01:18:15.727155 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:15.726742    2570 scope.go:117] "RemoveContainer" containerID="bdcad42b7c4324affc226d3797a430e82f28298adde00058ecfeffe129b29669"
Sep 20 01:18:15.736018 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:15.735998    2570 scope.go:117] "RemoveContainer" containerID="bdcad42b7c4324affc226d3797a430e82f28298adde00058ecfeffe129b29669"
Sep 20 01:18:15.736288 ip-10-0-132-108 kubenswrapper[2570]: E0920 01:18:15.736270    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdcad42b7c4324affc226d3797a430e82f28298adde00058ecfeffe129b29669\": container with ID starting with bdcad42b7c4324affc226d3797a430e82f28298adde00058ecfeffe129b29669 not found: ID does not exist" containerID="bdcad42b7c4324affc226d3797a430e82f28298adde00058ecfeffe129b29669"
Sep 20 01:18:15.736335 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:15.736297    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdcad42b7c4324affc226d3797a430e82f28298adde00058ecfeffe129b29669"} err="failed to get container status \"bdcad42b7c4324affc226d3797a430e82f28298adde00058ecfeffe129b29669\": rpc error: code = NotFound desc = could not find container \"bdcad42b7c4324affc226d3797a430e82f28298adde00058ecfeffe129b29669\": container with ID starting with bdcad42b7c4324affc226d3797a430e82f28298adde00058ecfeffe129b29669 not found: ID does not exist"
Sep 20 01:18:15.741443 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:15.741422    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-4c93ee/rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr"]
Sep 20 01:18:15.747516 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:15.747496    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-4c93ee/rate-test-model-4c93ee-kserve-5c9d95fbf5-xc7rr"]
Sep 20 01:18:17.455330 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:17.455297    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb8b5019-51e6-498b-bf2f-481841ceec38" path="/var/lib/kubelet/pods/fb8b5019-51e6-498b-bf2f-481841ceec38/volumes"
Sep 20 01:18:17.685271 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:17.685234    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-e458de-d45cc4f79-44rx6"
Sep 20 01:18:17.685452 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:17.685328    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e458de-5f6fbd6858-47q58"
Sep 20 01:18:18.766518 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:18.766254    2570 patch_prober.go:28] interesting pod/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.86:15021/healthz/ready\": read tcp 10.134.0.2:59312->10.134.0.86:15021: read: connection reset by peer" start-of-body=
Sep 20 01:18:18.766518 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:18.766334    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f" podUID="ac922f5e-4043-4ce1-acbb-78275fa02dbf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.86:15021/healthz/ready\": read tcp 10.134.0.2:59312->10.134.0.86:15021: read: connection reset by peer"
Sep 20 01:18:19.753325 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:19.753290    2570 generic.go:356] "Generic (PLEG): container finished" podID="ac922f5e-4043-4ce1-acbb-78275fa02dbf" containerID="d9aaa504b3063354e9ecfdf2b3974a0eb39accb654c8acac52376186a1f78ac2" exitCode=0
Sep 20 01:18:19.753520 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:19.753360    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f" event={"ID":"ac922f5e-4043-4ce1-acbb-78275fa02dbf","Type":"ContainerDied","Data":"d9aaa504b3063354e9ecfdf2b3974a0eb39accb654c8acac52376186a1f78ac2"}
Sep 20 01:18:19.753872 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:19.753842    2570 scope.go:117] "RemoveContainer" containerID="d9aaa504b3063354e9ecfdf2b3974a0eb39accb654c8acac52376186a1f78ac2"
Sep 20 01:18:19.754961 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:19.754934    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:18:19.755020 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:19.755004    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:18:19.755056 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:19.755034    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:18:20.766160 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:20.766121    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f" event={"ID":"ac922f5e-4043-4ce1-acbb-78275fa02dbf","Type":"ContainerStarted","Data":"aa5aa186bc309504503bbcc624f6f191c1c7bb5b7b3d2b554414e0f5e1a9e386"}
Sep 20 01:18:21.724944 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:21.724907    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f"
Sep 20 01:18:21.725198 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:21.725179    2570 patch_prober.go:28] interesting pod/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused" start-of-body=
Sep 20 01:18:21.725252 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:21.725234    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f" podUID="ac922f5e-4043-4ce1-acbb-78275fa02dbf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused"
Sep 20 01:18:22.726083 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:22.726042    2570 patch_prober.go:28] interesting pod/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused" start-of-body=
Sep 20 01:18:22.726536 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:22.726119    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f" podUID="ac922f5e-4043-4ce1-acbb-78275fa02dbf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused"
Sep 20 01:18:23.726014 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:23.725972    2570 patch_prober.go:28] interesting pod/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused" start-of-body=
Sep 20 01:18:23.726203 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:23.726034    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f" podUID="ac922f5e-4043-4ce1-acbb-78275fa02dbf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused"
Sep 20 01:18:24.725751 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:24.725711    2570 patch_prober.go:28] interesting pod/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused" start-of-body=
Sep 20 01:18:24.725959 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:24.725782    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f" podUID="ac922f5e-4043-4ce1-acbb-78275fa02dbf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused"
Sep 20 01:18:25.725385 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:25.725352    2570 patch_prober.go:28] interesting pod/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused" start-of-body=
Sep 20 01:18:25.725908 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:25.725419    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f" podUID="ac922f5e-4043-4ce1-acbb-78275fa02dbf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.86:15021/healthz/ready\": dial tcp 10.134.0.86:15021: connect: connection refused"
Sep 20 01:18:26.729147 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:26.729115    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f"
Sep 20 01:18:26.729637 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:26.729619    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f"
Sep 20 01:18:26.730207 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:26.730188    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f"
Sep 20 01:18:29.456032 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:29.455998    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v"]
Sep 20 01:18:29.456604 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:29.456582    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb8b5019-51e6-498b-bf2f-481841ceec38" containerName="main"
Sep 20 01:18:29.456690 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:29.456607    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb8b5019-51e6-498b-bf2f-481841ceec38" containerName="main"
Sep 20 01:18:29.456748 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:29.456734    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb8b5019-51e6-498b-bf2f-481841ceec38" containerName="main"
Sep 20 01:18:29.459909 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:29.459887    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v"
Sep 20 01:18:29.461998 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:29.461974    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-63184c-openshift-default-dockercfg-7fwzz\""
Sep 20 01:18:29.465764 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:29.465737    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v"]
Sep 20 01:18:29.563886 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:29.563464    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60cab5cc-452f-4d48-b7f2-150da52fe5d4-istio-data\") pod \"e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v\" (UID: \"60cab5cc-452f-4d48-b7f2-150da52fe5d4\") " pod="openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v"
Sep 20 01:18:29.563886 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:29.563515    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60cab5cc-452f-4d48-b7f2-150da52fe5d4-workload-socket\") pod \"e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v\" (UID: \"60cab5cc-452f-4d48-b7f2-150da52fe5d4\") " pod="openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v"
Sep 20 01:18:29.563886 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:29.563547    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wt2ww\" (UniqueName: \"kubernetes.io/projected/60cab5cc-452f-4d48-b7f2-150da52fe5d4-kube-api-access-wt2ww\") pod \"e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v\" (UID: \"60cab5cc-452f-4d48-b7f2-150da52fe5d4\") " pod="openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v"
Sep 20 01:18:29.563886 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:29.563574    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60cab5cc-452f-4d48-b7f2-150da52fe5d4-istiod-ca-cert\") pod \"e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v\" (UID: \"60cab5cc-452f-4d48-b7f2-150da52fe5d4\") " pod="openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v"
Sep 20 01:18:29.563886 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:29.563640    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60cab5cc-452f-4d48-b7f2-150da52fe5d4-credential-socket\") pod \"e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v\" (UID: \"60cab5cc-452f-4d48-b7f2-150da52fe5d4\") " pod="openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v"
Sep 20 01:18:29.563886 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:29.563666    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60cab5cc-452f-4d48-b7f2-150da52fe5d4-istio-envoy\") pod \"e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v\" (UID: \"60cab5cc-452f-4d48-b7f2-150da52fe5d4\") " pod="openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v"
Sep 20 01:18:29.563886 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:29.563733    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60cab5cc-452f-4d48-b7f2-150da52fe5d4-istio-token\") pod \"e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v\" (UID: \"60cab5cc-452f-4d48-b7f2-150da52fe5d4\") " pod="openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v"
Sep 20 01:18:29.563886 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:29.563799    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60cab5cc-452f-4d48-b7f2-150da52fe5d4-istio-podinfo\") pod \"e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v\" (UID: \"60cab5cc-452f-4d48-b7f2-150da52fe5d4\") " pod="openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v"
Sep 20 01:18:29.563886 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:29.563851    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60cab5cc-452f-4d48-b7f2-150da52fe5d4-workload-certs\") pod \"e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v\" (UID: \"60cab5cc-452f-4d48-b7f2-150da52fe5d4\") " pod="openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v"
Sep 20 01:18:29.665075 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:29.665037    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60cab5cc-452f-4d48-b7f2-150da52fe5d4-istio-token\") pod \"e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v\" (UID: \"60cab5cc-452f-4d48-b7f2-150da52fe5d4\") " pod="openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v"
Sep 20 01:18:29.665291 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:29.665094    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60cab5cc-452f-4d48-b7f2-150da52fe5d4-istio-podinfo\") pod \"e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v\" (UID: \"60cab5cc-452f-4d48-b7f2-150da52fe5d4\") " pod="openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v"
Sep 20 01:18:29.665291 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:29.665116    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60cab5cc-452f-4d48-b7f2-150da52fe5d4-workload-certs\") pod \"e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v\" (UID: \"60cab5cc-452f-4d48-b7f2-150da52fe5d4\") " pod="openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v"
Sep 20 01:18:29.665291 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:29.665162    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60cab5cc-452f-4d48-b7f2-150da52fe5d4-istio-data\") pod \"e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v\" (UID: \"60cab5cc-452f-4d48-b7f2-150da52fe5d4\") " pod="openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v"
Sep 20 01:18:29.665291 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:29.665179    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60cab5cc-452f-4d48-b7f2-150da52fe5d4-workload-socket\") pod \"e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v\" (UID: \"60cab5cc-452f-4d48-b7f2-150da52fe5d4\") " pod="openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v"
Sep 20 01:18:29.665291 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:29.665205    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wt2ww\" (UniqueName: \"kubernetes.io/projected/60cab5cc-452f-4d48-b7f2-150da52fe5d4-kube-api-access-wt2ww\") pod \"e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v\" (UID: \"60cab5cc-452f-4d48-b7f2-150da52fe5d4\") " pod="openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v"
Sep 20 01:18:29.665291 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:29.665229    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60cab5cc-452f-4d48-b7f2-150da52fe5d4-istiod-ca-cert\") pod \"e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v\" (UID: \"60cab5cc-452f-4d48-b7f2-150da52fe5d4\") " pod="openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v"
Sep 20 01:18:29.665291 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:29.665276    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60cab5cc-452f-4d48-b7f2-150da52fe5d4-credential-socket\") pod \"e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v\" (UID: \"60cab5cc-452f-4d48-b7f2-150da52fe5d4\") " pod="openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v"
Sep 20 01:18:29.665707 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:29.665304    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60cab5cc-452f-4d48-b7f2-150da52fe5d4-istio-envoy\") pod \"e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v\" (UID: \"60cab5cc-452f-4d48-b7f2-150da52fe5d4\") " pod="openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v"
Sep 20 01:18:29.665707 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:29.665652    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60cab5cc-452f-4d48-b7f2-150da52fe5d4-istio-data\") pod \"e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v\" (UID: \"60cab5cc-452f-4d48-b7f2-150da52fe5d4\") " pod="openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v"
Sep 20 01:18:29.665818 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:29.665705    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60cab5cc-452f-4d48-b7f2-150da52fe5d4-workload-socket\") pod \"e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v\" (UID: \"60cab5cc-452f-4d48-b7f2-150da52fe5d4\") " pod="openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v"
Sep 20 01:18:29.665818 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:29.665776    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60cab5cc-452f-4d48-b7f2-150da52fe5d4-workload-certs\") pod \"e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v\" (UID: \"60cab5cc-452f-4d48-b7f2-150da52fe5d4\") " pod="openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v"
Sep 20 01:18:29.665818 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:29.665797    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60cab5cc-452f-4d48-b7f2-150da52fe5d4-credential-socket\") pod \"e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v\" (UID: \"60cab5cc-452f-4d48-b7f2-150da52fe5d4\") " pod="openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v"
Sep 20 01:18:29.666086 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:29.666067    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60cab5cc-452f-4d48-b7f2-150da52fe5d4-istiod-ca-cert\") pod \"e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v\" (UID: \"60cab5cc-452f-4d48-b7f2-150da52fe5d4\") " pod="openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v"
Sep 20 01:18:29.667733 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:29.667713    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60cab5cc-452f-4d48-b7f2-150da52fe5d4-istio-podinfo\") pod \"e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v\" (UID: \"60cab5cc-452f-4d48-b7f2-150da52fe5d4\") " pod="openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v"
Sep 20 01:18:29.667833 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:29.667773    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60cab5cc-452f-4d48-b7f2-150da52fe5d4-istio-envoy\") pod \"e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v\" (UID: \"60cab5cc-452f-4d48-b7f2-150da52fe5d4\") " pod="openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v"
Sep 20 01:18:29.674816 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:29.674790    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60cab5cc-452f-4d48-b7f2-150da52fe5d4-istio-token\") pod \"e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v\" (UID: \"60cab5cc-452f-4d48-b7f2-150da52fe5d4\") " pod="openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v"
Sep 20 01:18:29.675137 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:29.675113    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wt2ww\" (UniqueName: \"kubernetes.io/projected/60cab5cc-452f-4d48-b7f2-150da52fe5d4-kube-api-access-wt2ww\") pod \"e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v\" (UID: \"60cab5cc-452f-4d48-b7f2-150da52fe5d4\") " pod="openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v"
Sep 20 01:18:29.772996 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:29.772900    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v"
Sep 20 01:18:30.054655 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:30.054626    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v"]
Sep 20 01:18:30.056362 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:18:30.056330    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60cab5cc_452f_4d48_b7f2_150da52fe5d4.slice/crio-2e01763b9904a4a9a0e098cabcd58d3fbda1f9e48dd25621396a3697ec55b5b7 WatchSource:0}: Error finding container 2e01763b9904a4a9a0e098cabcd58d3fbda1f9e48dd25621396a3697ec55b5b7: Status 404 returned error can't find the container with id 2e01763b9904a4a9a0e098cabcd58d3fbda1f9e48dd25621396a3697ec55b5b7
Sep 20 01:18:30.058767 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:30.058734    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:18:30.058843 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:30.058804    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:18:30.058843 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:30.058833    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:18:30.823672 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:30.823632    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v" event={"ID":"60cab5cc-452f-4d48-b7f2-150da52fe5d4","Type":"ContainerStarted","Data":"ae40c3ca17c0683fe5531ca206a0325d22d83bfef50012a8cf4055196b734284"}
Sep 20 01:18:30.824201 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:30.823700    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v" event={"ID":"60cab5cc-452f-4d48-b7f2-150da52fe5d4","Type":"ContainerStarted","Data":"2e01763b9904a4a9a0e098cabcd58d3fbda1f9e48dd25621396a3697ec55b5b7"}
Sep 20 01:18:30.842480 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:30.842420    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v" podStartSLOduration=1.84240233 podStartE2EDuration="1.84240233s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:18:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:18:30.841295078 +0000 UTC m=+1847.455450976" watchObservedRunningTime="2026-09-20 01:18:30.84240233 +0000 UTC m=+1847.456558227"
Sep 20 01:18:31.773785 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:31.773743    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v"
Sep 20 01:18:31.778952 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:31.778923    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v"
Sep 20 01:18:31.829585 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:31.829552    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v"
Sep 20 01:18:31.830450 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:31.830431    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v"
Sep 20 01:18:35.635833 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:35.635794    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-63184c-85c4f7bdc4-kx74d"]
Sep 20 01:18:35.639830 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:35.639810    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-63184c-85c4f7bdc4-kx74d"
Sep 20 01:18:35.641820 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:35.641796    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-63184c\""
Sep 20 01:18:35.649235 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:35.649212    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-63184c-85c4f7bdc4-kx74d"]
Sep 20 01:18:35.681076 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:35.681044    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-63184c-6595c67fd9-nrmbp"]
Sep 20 01:18:35.684583 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:35.684567    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-63184c-6595c67fd9-nrmbp"
Sep 20 01:18:35.686583 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:35.686559    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-63184c-dockercfg-b7pkj\""
Sep 20 01:18:35.693799 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:35.693771    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-63184c-6595c67fd9-nrmbp"]
Sep 20 01:18:35.727739 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:35.727706    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bebf8304-b611-422a-bb3f-5937c2bf4259-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-63184c-85c4f7bdc4-kx74d\" (UID: \"bebf8304-b611-422a-bb3f-5937c2bf4259\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-63184c-85c4f7bdc4-kx74d"
Sep 20 01:18:35.727977 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:35.727835    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkcdf\" (UniqueName: \"kubernetes.io/projected/bebf8304-b611-422a-bb3f-5937c2bf4259-kube-api-access-mkcdf\") pod \"payload-pre-processing-e2e-ipp-b-63184c-85c4f7bdc4-kx74d\" (UID: \"bebf8304-b611-422a-bb3f-5937c2bf4259\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-63184c-85c4f7bdc4-kx74d"
Sep 20 01:18:35.829233 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:35.829197    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bebf8304-b611-422a-bb3f-5937c2bf4259-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-63184c-85c4f7bdc4-kx74d\" (UID: \"bebf8304-b611-422a-bb3f-5937c2bf4259\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-63184c-85c4f7bdc4-kx74d"
Sep 20 01:18:35.829448 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:35.829274    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc9591f3-7e25-47bd-a06e-82fa0deb2418-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-63184c-6595c67fd9-nrmbp\" (UID: \"cc9591f3-7e25-47bd-a06e-82fa0deb2418\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-63184c-6595c67fd9-nrmbp"
Sep 20 01:18:35.829448 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:35.829306    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkhb7\" (UniqueName: \"kubernetes.io/projected/cc9591f3-7e25-47bd-a06e-82fa0deb2418-kube-api-access-jkhb7\") pod \"payload-processing-e2e-ipp-b-63184c-6595c67fd9-nrmbp\" (UID: \"cc9591f3-7e25-47bd-a06e-82fa0deb2418\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-63184c-6595c67fd9-nrmbp"
Sep 20 01:18:35.829448 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:35.829332    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkcdf\" (UniqueName: \"kubernetes.io/projected/bebf8304-b611-422a-bb3f-5937c2bf4259-kube-api-access-mkcdf\") pod \"payload-pre-processing-e2e-ipp-b-63184c-85c4f7bdc4-kx74d\" (UID: \"bebf8304-b611-422a-bb3f-5937c2bf4259\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-63184c-85c4f7bdc4-kx74d"
Sep 20 01:18:35.829957 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:35.829938    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bebf8304-b611-422a-bb3f-5937c2bf4259-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-63184c-85c4f7bdc4-kx74d\" (UID: \"bebf8304-b611-422a-bb3f-5937c2bf4259\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-63184c-85c4f7bdc4-kx74d"
Sep 20 01:18:35.837643 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:35.837618    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkcdf\" (UniqueName: \"kubernetes.io/projected/bebf8304-b611-422a-bb3f-5937c2bf4259-kube-api-access-mkcdf\") pod \"payload-pre-processing-e2e-ipp-b-63184c-85c4f7bdc4-kx74d\" (UID: \"bebf8304-b611-422a-bb3f-5937c2bf4259\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-63184c-85c4f7bdc4-kx74d"
Sep 20 01:18:35.930681 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:35.930589    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc9591f3-7e25-47bd-a06e-82fa0deb2418-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-63184c-6595c67fd9-nrmbp\" (UID: \"cc9591f3-7e25-47bd-a06e-82fa0deb2418\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-63184c-6595c67fd9-nrmbp"
Sep 20 01:18:35.930681 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:35.930644    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkhb7\" (UniqueName: \"kubernetes.io/projected/cc9591f3-7e25-47bd-a06e-82fa0deb2418-kube-api-access-jkhb7\") pod \"payload-processing-e2e-ipp-b-63184c-6595c67fd9-nrmbp\" (UID: \"cc9591f3-7e25-47bd-a06e-82fa0deb2418\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-63184c-6595c67fd9-nrmbp"
Sep 20 01:18:35.931333 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:35.931312    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc9591f3-7e25-47bd-a06e-82fa0deb2418-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-63184c-6595c67fd9-nrmbp\" (UID: \"cc9591f3-7e25-47bd-a06e-82fa0deb2418\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-63184c-6595c67fd9-nrmbp"
Sep 20 01:18:35.937909 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:35.937884    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkhb7\" (UniqueName: \"kubernetes.io/projected/cc9591f3-7e25-47bd-a06e-82fa0deb2418-kube-api-access-jkhb7\") pod \"payload-processing-e2e-ipp-b-63184c-6595c67fd9-nrmbp\" (UID: \"cc9591f3-7e25-47bd-a06e-82fa0deb2418\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-63184c-6595c67fd9-nrmbp"
Sep 20 01:18:35.951608 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:35.951582    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-63184c-85c4f7bdc4-kx74d"
Sep 20 01:18:35.995269 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:35.995239    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-63184c-6595c67fd9-nrmbp"
Sep 20 01:18:36.227935 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:36.227904    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-63184c-85c4f7bdc4-kx74d"]
Sep 20 01:18:36.229435 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:18:36.229409    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbebf8304_b611_422a_bb3f_5937c2bf4259.slice/crio-83a2b0aa2fdac0f1a1bc961a22cdf2fba13abd0ef89130e9a3e6f5c71eec0595 WatchSource:0}: Error finding container 83a2b0aa2fdac0f1a1bc961a22cdf2fba13abd0ef89130e9a3e6f5c71eec0595: Status 404 returned error can't find the container with id 83a2b0aa2fdac0f1a1bc961a22cdf2fba13abd0ef89130e9a3e6f5c71eec0595
Sep 20 01:18:36.282002 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:36.281969    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-63184c-6595c67fd9-nrmbp"]
Sep 20 01:18:36.284148 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:18:36.284120    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc9591f3_7e25_47bd_a06e_82fa0deb2418.slice/crio-c5386cdda7ccd0b7640f66fb1bf16070206260cdc1b0340f47c168c3cc09ae36 WatchSource:0}: Error finding container c5386cdda7ccd0b7640f66fb1bf16070206260cdc1b0340f47c168c3cc09ae36: Status 404 returned error can't find the container with id c5386cdda7ccd0b7640f66fb1bf16070206260cdc1b0340f47c168c3cc09ae36
Sep 20 01:18:36.860690 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:36.860652    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-63184c-6595c67fd9-nrmbp" event={"ID":"cc9591f3-7e25-47bd-a06e-82fa0deb2418","Type":"ContainerStarted","Data":"7d1cfcdc1e2c36bf06991b6ae59a293f9164b93e2589cff069b9f6adb7fea417"}
Sep 20 01:18:36.861210 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:36.860719    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-63184c-6595c67fd9-nrmbp" event={"ID":"cc9591f3-7e25-47bd-a06e-82fa0deb2418","Type":"ContainerStarted","Data":"c5386cdda7ccd0b7640f66fb1bf16070206260cdc1b0340f47c168c3cc09ae36"}
Sep 20 01:18:36.861210 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:36.860885    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-63184c-6595c67fd9-nrmbp"
Sep 20 01:18:36.862609 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:36.862578    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-63184c-85c4f7bdc4-kx74d" event={"ID":"bebf8304-b611-422a-bb3f-5937c2bf4259","Type":"ContainerStarted","Data":"b1556aa06d9f7ae9deaf40bb02451794d7e6326c7bce459c11c07d8b31ed1d31"}
Sep 20 01:18:36.862760 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:36.862632    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-63184c-85c4f7bdc4-kx74d" event={"ID":"bebf8304-b611-422a-bb3f-5937c2bf4259","Type":"ContainerStarted","Data":"83a2b0aa2fdac0f1a1bc961a22cdf2fba13abd0ef89130e9a3e6f5c71eec0595"}
Sep 20 01:18:36.862760 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:36.862660    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-63184c-85c4f7bdc4-kx74d"
Sep 20 01:18:36.877052 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:36.877005    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-63184c-6595c67fd9-nrmbp" podStartSLOduration=1.8769918159999999 podStartE2EDuration="1.876991816s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:18:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:18:36.875912482 +0000 UTC m=+1853.490068378" watchObservedRunningTime="2026-09-20 01:18:36.876991816 +0000 UTC m=+1853.491147713"
Sep 20 01:18:36.891040 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:36.890987    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-63184c-85c4f7bdc4-kx74d" podStartSLOduration=1.89096981 podStartE2EDuration="1.89096981s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:18:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:18:36.889667903 +0000 UTC m=+1853.503823825" watchObservedRunningTime="2026-09-20 01:18:36.89096981 +0000 UTC m=+1853.505125710"
Sep 20 01:18:47.871289 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:47.871259    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-63184c-6595c67fd9-nrmbp"
Sep 20 01:18:47.871680 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:47.871336    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-63184c-85c4f7bdc4-kx74d"
Sep 20 01:18:51.953029 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:51.952995    2570 generic.go:356] "Generic (PLEG): container finished" podID="60cab5cc-452f-4d48-b7f2-150da52fe5d4" containerID="ae40c3ca17c0683fe5531ca206a0325d22d83bfef50012a8cf4055196b734284" exitCode=0
Sep 20 01:18:51.953447 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:51.953068    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v" event={"ID":"60cab5cc-452f-4d48-b7f2-150da52fe5d4","Type":"ContainerDied","Data":"ae40c3ca17c0683fe5531ca206a0325d22d83bfef50012a8cf4055196b734284"}
Sep 20 01:18:51.953490 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:51.953459    2570 scope.go:117] "RemoveContainer" containerID="ae40c3ca17c0683fe5531ca206a0325d22d83bfef50012a8cf4055196b734284"
Sep 20 01:18:51.954585 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:51.954560    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:18:51.954646 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:51.954634    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:18:51.954682 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:51.954667    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 20 01:18:52.980562 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:52.980524    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v" event={"ID":"60cab5cc-452f-4d48-b7f2-150da52fe5d4","Type":"ContainerStarted","Data":"36baac069308d58473467c1a4a34b461cba826617672fa9523e2b5f941ca5f15"}
Sep 20 01:18:53.773659 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:53.773616    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v"
Sep 20 01:18:53.773932 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:53.773907    2570 patch_prober.go:28] interesting pod/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused" start-of-body=
Sep 20 01:18:53.774032 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:53.773971    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v" podUID="60cab5cc-452f-4d48-b7f2-150da52fe5d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused"
Sep 20 01:18:54.773976 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:54.773932    2570 patch_prober.go:28] interesting pod/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused" start-of-body=
Sep 20 01:18:54.774371 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:54.773994    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v" podUID="60cab5cc-452f-4d48-b7f2-150da52fe5d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused"
Sep 20 01:18:55.774353 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:55.774312    2570 patch_prober.go:28] interesting pod/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused" start-of-body=
Sep 20 01:18:55.774749 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:55.774390    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v" podUID="60cab5cc-452f-4d48-b7f2-150da52fe5d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused"
Sep 20 01:18:56.773616 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:56.773581    2570 patch_prober.go:28] interesting pod/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused" start-of-body=
Sep 20 01:18:56.773886 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:56.773668    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v" podUID="60cab5cc-452f-4d48-b7f2-150da52fe5d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused"
Sep 20 01:18:57.774136 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:57.774098    2570 patch_prober.go:28] interesting pod/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused" start-of-body=
Sep 20 01:18:57.774562 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:57.774170    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v" podUID="60cab5cc-452f-4d48-b7f2-150da52fe5d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.89:15021/healthz/ready\": dial tcp 10.134.0.89:15021: connect: connection refused"
Sep 20 01:18:58.777502 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:58.777471    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v"
Sep 20 01:18:58.777952 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:58.777852    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v"
Sep 20 01:18:58.778573 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:18:58.778552    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v"
Sep 20 01:19:02.676738 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:19:02.676707    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-r26vb_9abb97c7-ec96-4d9f-a385-5b15a95ef793/payload-processing/0.log"
Sep 20 01:19:02.785908 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:19:02.785855    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-63184c-6595c67fd9-nrmbp_cc9591f3-7e25-47bd-a06e-82fa0deb2418/payload-processing/0.log"
Sep 20 01:19:38.812028 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:19:38.811992    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-e458de-d45cc4f79-44rx6_70554b2d-1ec8-4879-8942-61afca657241/payload-processing/0.log"
Sep 20 01:19:38.930488 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:19:38.930451    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-r26vb_9abb97c7-ec96-4d9f-a385-5b15a95ef793/payload-processing/0.log"
Sep 20 01:19:39.040159 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:19:39.040130    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-63184c-6595c67fd9-nrmbp_cc9591f3-7e25-47bd-a06e-82fa0deb2418/payload-processing/0.log"
Sep 20 01:19:39.148847 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:19:39.148822    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-63184c-6595c67fd9-nrmbp_cc9591f3-7e25-47bd-a06e-82fa0deb2418/payload-processing/0.log"
Sep 20 01:19:45.894373 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:19:45.894337    2570 scope.go:117] "RemoveContainer" containerID="a15bb3b3b75d5bc2a045a863589a8426aac09b5b3150b5448b099a615b34c7b2"
Sep 20 01:19:46.603407 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:19:46.603369    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e6d769-5bf494fc74-889mb"]
Sep 20 01:19:46.608446 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:19:46.608426    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e6d769-5bf494fc74-889mb"
Sep 20 01:19:46.610673 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:19:46.610652    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-e6d769\""
Sep 20 01:19:46.610770 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:19:46.610676    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-e6d769-dockercfg-k7vbn\""
Sep 20 01:19:46.615389 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:19:46.615366    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e6d769-5bf494fc74-889mb"]
Sep 20 01:19:46.633791 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:19:46.633766    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-e6d769-58d64b8949-trbhm"]
Sep 20 01:19:46.637269 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:19:46.637250    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e6d769-58d64b8949-trbhm"
Sep 20 01:19:46.649695 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:19:46.649670    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-e6d769-58d64b8949-trbhm"]
Sep 20 01:19:46.725406 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:19:46.725368    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62p69\" (UniqueName: \"kubernetes.io/projected/6519a6be-90fd-4474-ba7e-3e9b60034b9f-kube-api-access-62p69\") pod \"payload-processing-e2e-ipp-cleanup-e6d769-58d64b8949-trbhm\" (UID: \"6519a6be-90fd-4474-ba7e-3e9b60034b9f\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e6d769-58d64b8949-trbhm"
Sep 20 01:19:46.725724 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:19:46.725698    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/487a9d86-4290-4a9f-8204-db4163eb1411-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-e6d769-5bf494fc74-889mb\" (UID: \"487a9d86-4290-4a9f-8204-db4163eb1411\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e6d769-5bf494fc74-889mb"
Sep 20 01:19:46.726029 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:19:46.726011    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6519a6be-90fd-4474-ba7e-3e9b60034b9f-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-e6d769-58d64b8949-trbhm\" (UID: \"6519a6be-90fd-4474-ba7e-3e9b60034b9f\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e6d769-58d64b8949-trbhm"
Sep 20 01:19:46.726297 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:19:46.726281    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw2kk\" (UniqueName: \"kubernetes.io/projected/487a9d86-4290-4a9f-8204-db4163eb1411-kube-api-access-xw2kk\") pod \"payload-pre-processing-e2e-ipp-cleanup-e6d769-5bf494fc74-889mb\" (UID: \"487a9d86-4290-4a9f-8204-db4163eb1411\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e6d769-5bf494fc74-889mb"
Sep 20 01:19:46.827960 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:19:46.827905    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6519a6be-90fd-4474-ba7e-3e9b60034b9f-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-e6d769-58d64b8949-trbhm\" (UID: \"6519a6be-90fd-4474-ba7e-3e9b60034b9f\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e6d769-58d64b8949-trbhm"
Sep 20 01:19:46.828183 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:19:46.828012    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xw2kk\" (UniqueName: \"kubernetes.io/projected/487a9d86-4290-4a9f-8204-db4163eb1411-kube-api-access-xw2kk\") pod \"payload-pre-processing-e2e-ipp-cleanup-e6d769-5bf494fc74-889mb\" (UID: \"487a9d86-4290-4a9f-8204-db4163eb1411\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e6d769-5bf494fc74-889mb"
Sep 20 01:19:46.828183 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:19:46.828062    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62p69\" (UniqueName: \"kubernetes.io/projected/6519a6be-90fd-4474-ba7e-3e9b60034b9f-kube-api-access-62p69\") pod \"payload-processing-e2e-ipp-cleanup-e6d769-58d64b8949-trbhm\" (UID: \"6519a6be-90fd-4474-ba7e-3e9b60034b9f\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e6d769-58d64b8949-trbhm"
Sep 20 01:19:46.828183 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:19:46.828092    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/487a9d86-4290-4a9f-8204-db4163eb1411-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-e6d769-5bf494fc74-889mb\" (UID: \"487a9d86-4290-4a9f-8204-db4163eb1411\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e6d769-5bf494fc74-889mb"
Sep 20 01:19:46.828713 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:19:46.828686    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6519a6be-90fd-4474-ba7e-3e9b60034b9f-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-e6d769-58d64b8949-trbhm\" (UID: \"6519a6be-90fd-4474-ba7e-3e9b60034b9f\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e6d769-58d64b8949-trbhm"
Sep 20 01:19:46.828846 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:19:46.828823    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/487a9d86-4290-4a9f-8204-db4163eb1411-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-e6d769-5bf494fc74-889mb\" (UID: \"487a9d86-4290-4a9f-8204-db4163eb1411\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e6d769-5bf494fc74-889mb"
Sep 20 01:19:46.835481 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:19:46.835448    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62p69\" (UniqueName: \"kubernetes.io/projected/6519a6be-90fd-4474-ba7e-3e9b60034b9f-kube-api-access-62p69\") pod \"payload-processing-e2e-ipp-cleanup-e6d769-58d64b8949-trbhm\" (UID: \"6519a6be-90fd-4474-ba7e-3e9b60034b9f\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e6d769-58d64b8949-trbhm"
Sep 20 01:19:46.835586 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:19:46.835519    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xw2kk\" (UniqueName: \"kubernetes.io/projected/487a9d86-4290-4a9f-8204-db4163eb1411-kube-api-access-xw2kk\") pod \"payload-pre-processing-e2e-ipp-cleanup-e6d769-5bf494fc74-889mb\" (UID: \"487a9d86-4290-4a9f-8204-db4163eb1411\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e6d769-5bf494fc74-889mb"
Sep 20 01:19:46.919689 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:19:46.919652    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e6d769-5bf494fc74-889mb"
Sep 20 01:19:46.947248 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:19:46.947209    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e6d769-58d64b8949-trbhm"
Sep 20 01:19:47.200742 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:19:47.200717    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e6d769-5bf494fc74-889mb"]
Sep 20 01:19:47.202648 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:19:47.202622    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod487a9d86_4290_4a9f_8204_db4163eb1411.slice/crio-5374f9c368a39720f2eb4a0c380f7bc4c0479f11675be7d62cd1345a2b15f4d9 WatchSource:0}: Error finding container 5374f9c368a39720f2eb4a0c380f7bc4c0479f11675be7d62cd1345a2b15f4d9: Status 404 returned error can't find the container with id 5374f9c368a39720f2eb4a0c380f7bc4c0479f11675be7d62cd1345a2b15f4d9
Sep 20 01:19:47.243466 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:19:47.243436    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-e6d769-58d64b8949-trbhm"]
Sep 20 01:19:47.246306 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:19:47.246274    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6519a6be_90fd_4474_ba7e_3e9b60034b9f.slice/crio-356cfb2175099e6a401a0a69275f38a7ab9a6199bd9e9813e87d475764e2f771 WatchSource:0}: Error finding container 356cfb2175099e6a401a0a69275f38a7ab9a6199bd9e9813e87d475764e2f771: Status 404 returned error can't find the container with id 356cfb2175099e6a401a0a69275f38a7ab9a6199bd9e9813e87d475764e2f771
Sep 20 01:19:47.290407 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:19:47.290368    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e6d769-5bf494fc74-889mb" event={"ID":"487a9d86-4290-4a9f-8204-db4163eb1411","Type":"ContainerStarted","Data":"8f9155188c003a1ba8d19b4891e1d54eb862d002094ad0686bb5254ee8ddf2bc"}
Sep 20 01:19:47.290554 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:19:47.290438    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e6d769-5bf494fc74-889mb" event={"ID":"487a9d86-4290-4a9f-8204-db4163eb1411","Type":"ContainerStarted","Data":"5374f9c368a39720f2eb4a0c380f7bc4c0479f11675be7d62cd1345a2b15f4d9"}
Sep 20 01:19:47.290554 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:19:47.290474    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e6d769-5bf494fc74-889mb"
Sep 20 01:19:47.291797 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:19:47.291771    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e6d769-58d64b8949-trbhm" event={"ID":"6519a6be-90fd-4474-ba7e-3e9b60034b9f","Type":"ContainerStarted","Data":"356cfb2175099e6a401a0a69275f38a7ab9a6199bd9e9813e87d475764e2f771"}
Sep 20 01:19:47.309511 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:19:47.309461    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e6d769-5bf494fc74-889mb" podStartSLOduration=1.309444506 podStartE2EDuration="1.309444506s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:19:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:19:47.307115652 +0000 UTC m=+1923.921271595" watchObservedRunningTime="2026-09-20 01:19:47.309444506 +0000 UTC m=+1923.923600443"
Sep 20 01:19:48.298928 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:19:48.298887    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e6d769-58d64b8949-trbhm" event={"ID":"6519a6be-90fd-4474-ba7e-3e9b60034b9f","Type":"ContainerStarted","Data":"ddfebffe3f0acf4878f18e98b242ad4f6bcfc8214b1acbcd78fbff040967f0c7"}
Sep 20 01:19:48.299426 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:19:48.299046    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e6d769-58d64b8949-trbhm"
Sep 20 01:19:48.315186 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:19:48.315138    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e6d769-58d64b8949-trbhm" podStartSLOduration=2.315123499 podStartE2EDuration="2.315123499s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:19:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:19:48.312293965 +0000 UTC m=+1924.926449887" watchObservedRunningTime="2026-09-20 01:19:48.315123499 +0000 UTC m=+1924.929279426"
Sep 20 01:19:58.301880 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:19:58.301832    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e6d769-5bf494fc74-889mb"
Sep 20 01:19:59.306807 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:19:59.306778    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e6d769-58d64b8949-trbhm"
Sep 20 01:20:14.972637 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:14.972598    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-e6d769-58d64b8949-trbhm"]
Sep 20 01:20:14.973147 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:14.972893    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e6d769-58d64b8949-trbhm" podUID="6519a6be-90fd-4474-ba7e-3e9b60034b9f" containerName="payload-processing" containerID="cri-o://ddfebffe3f0acf4878f18e98b242ad4f6bcfc8214b1acbcd78fbff040967f0c7" gracePeriod=30
Sep 20 01:20:14.976529 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:14.976451    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e6d769-5bf494fc74-889mb"]
Sep 20 01:20:14.976725 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:14.976686    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e6d769-5bf494fc74-889mb" podUID="487a9d86-4290-4a9f-8204-db4163eb1411" containerName="payload-pre-processing" containerID="cri-o://8f9155188c003a1ba8d19b4891e1d54eb862d002094ad0686bb5254ee8ddf2bc" gracePeriod=30
Sep 20 01:20:15.285169 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:15.285136    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e6d769-58d64b8949-trbhm"
Sep 20 01:20:15.287959 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:15.287939    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e6d769-5bf494fc74-889mb"
Sep 20 01:20:15.328075 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:15.328045    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/487a9d86-4290-4a9f-8204-db4163eb1411-plugins-config-volume\") pod \"487a9d86-4290-4a9f-8204-db4163eb1411\" (UID: \"487a9d86-4290-4a9f-8204-db4163eb1411\") "
Sep 20 01:20:15.328259 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:15.328130    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xw2kk\" (UniqueName: \"kubernetes.io/projected/487a9d86-4290-4a9f-8204-db4163eb1411-kube-api-access-xw2kk\") pod \"487a9d86-4290-4a9f-8204-db4163eb1411\" (UID: \"487a9d86-4290-4a9f-8204-db4163eb1411\") "
Sep 20 01:20:15.328259 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:15.328213    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62p69\" (UniqueName: \"kubernetes.io/projected/6519a6be-90fd-4474-ba7e-3e9b60034b9f-kube-api-access-62p69\") pod \"6519a6be-90fd-4474-ba7e-3e9b60034b9f\" (UID: \"6519a6be-90fd-4474-ba7e-3e9b60034b9f\") "
Sep 20 01:20:15.328382 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:15.328263    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6519a6be-90fd-4474-ba7e-3e9b60034b9f-plugins-config-volume\") pod \"6519a6be-90fd-4474-ba7e-3e9b60034b9f\" (UID: \"6519a6be-90fd-4474-ba7e-3e9b60034b9f\") "
Sep 20 01:20:15.328703 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:15.328502    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/487a9d86-4290-4a9f-8204-db4163eb1411-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "487a9d86-4290-4a9f-8204-db4163eb1411" (UID: "487a9d86-4290-4a9f-8204-db4163eb1411"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:20:15.328703 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:15.328670    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/487a9d86-4290-4a9f-8204-db4163eb1411-plugins-config-volume\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:20:15.328962 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:15.328933    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6519a6be-90fd-4474-ba7e-3e9b60034b9f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6519a6be-90fd-4474-ba7e-3e9b60034b9f" (UID: "6519a6be-90fd-4474-ba7e-3e9b60034b9f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:20:15.330562 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:15.330539    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/487a9d86-4290-4a9f-8204-db4163eb1411-kube-api-access-xw2kk" (OuterVolumeSpecName: "kube-api-access-xw2kk") pod "487a9d86-4290-4a9f-8204-db4163eb1411" (UID: "487a9d86-4290-4a9f-8204-db4163eb1411"). InnerVolumeSpecName "kube-api-access-xw2kk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:20:15.331161 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:15.331143    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6519a6be-90fd-4474-ba7e-3e9b60034b9f-kube-api-access-62p69" (OuterVolumeSpecName: "kube-api-access-62p69") pod "6519a6be-90fd-4474-ba7e-3e9b60034b9f" (UID: "6519a6be-90fd-4474-ba7e-3e9b60034b9f"). InnerVolumeSpecName "kube-api-access-62p69". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:20:15.429412 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:15.429375    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xw2kk\" (UniqueName: \"kubernetes.io/projected/487a9d86-4290-4a9f-8204-db4163eb1411-kube-api-access-xw2kk\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:20:15.429412 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:15.429406    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62p69\" (UniqueName: \"kubernetes.io/projected/6519a6be-90fd-4474-ba7e-3e9b60034b9f-kube-api-access-62p69\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:20:15.429412 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:15.429416    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6519a6be-90fd-4474-ba7e-3e9b60034b9f-plugins-config-volume\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:20:15.461418 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:15.461384    2570 generic.go:356] "Generic (PLEG): container finished" podID="487a9d86-4290-4a9f-8204-db4163eb1411" containerID="8f9155188c003a1ba8d19b4891e1d54eb862d002094ad0686bb5254ee8ddf2bc" exitCode=0
Sep 20 01:20:15.461597 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:15.461490    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e6d769-5bf494fc74-889mb"
Sep 20 01:20:15.462336 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:15.462312    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e6d769-5bf494fc74-889mb" event={"ID":"487a9d86-4290-4a9f-8204-db4163eb1411","Type":"ContainerDied","Data":"8f9155188c003a1ba8d19b4891e1d54eb862d002094ad0686bb5254ee8ddf2bc"}
Sep 20 01:20:15.462449 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:15.462356    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e6d769-5bf494fc74-889mb" event={"ID":"487a9d86-4290-4a9f-8204-db4163eb1411","Type":"ContainerDied","Data":"5374f9c368a39720f2eb4a0c380f7bc4c0479f11675be7d62cd1345a2b15f4d9"}
Sep 20 01:20:15.462449 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:15.462384    2570 scope.go:117] "RemoveContainer" containerID="8f9155188c003a1ba8d19b4891e1d54eb862d002094ad0686bb5254ee8ddf2bc"
Sep 20 01:20:15.463042 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:15.463018    2570 generic.go:356] "Generic (PLEG): container finished" podID="6519a6be-90fd-4474-ba7e-3e9b60034b9f" containerID="ddfebffe3f0acf4878f18e98b242ad4f6bcfc8214b1acbcd78fbff040967f0c7" exitCode=0
Sep 20 01:20:15.463224 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:15.463048    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e6d769-58d64b8949-trbhm" event={"ID":"6519a6be-90fd-4474-ba7e-3e9b60034b9f","Type":"ContainerDied","Data":"ddfebffe3f0acf4878f18e98b242ad4f6bcfc8214b1acbcd78fbff040967f0c7"}
Sep 20 01:20:15.463347 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:15.463252    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e6d769-58d64b8949-trbhm" event={"ID":"6519a6be-90fd-4474-ba7e-3e9b60034b9f","Type":"ContainerDied","Data":"356cfb2175099e6a401a0a69275f38a7ab9a6199bd9e9813e87d475764e2f771"}
Sep 20 01:20:15.463347 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:15.463081    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e6d769-58d64b8949-trbhm"
Sep 20 01:20:15.473388 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:15.473282    2570 scope.go:117] "RemoveContainer" containerID="8f9155188c003a1ba8d19b4891e1d54eb862d002094ad0686bb5254ee8ddf2bc"
Sep 20 01:20:15.473692 ip-10-0-132-108 kubenswrapper[2570]: E0920 01:20:15.473671    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f9155188c003a1ba8d19b4891e1d54eb862d002094ad0686bb5254ee8ddf2bc\": container with ID starting with 8f9155188c003a1ba8d19b4891e1d54eb862d002094ad0686bb5254ee8ddf2bc not found: ID does not exist" containerID="8f9155188c003a1ba8d19b4891e1d54eb862d002094ad0686bb5254ee8ddf2bc"
Sep 20 01:20:15.473791 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:15.473703    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f9155188c003a1ba8d19b4891e1d54eb862d002094ad0686bb5254ee8ddf2bc"} err="failed to get container status \"8f9155188c003a1ba8d19b4891e1d54eb862d002094ad0686bb5254ee8ddf2bc\": rpc error: code = NotFound desc = could not find container \"8f9155188c003a1ba8d19b4891e1d54eb862d002094ad0686bb5254ee8ddf2bc\": container with ID starting with 8f9155188c003a1ba8d19b4891e1d54eb862d002094ad0686bb5254ee8ddf2bc not found: ID does not exist"
Sep 20 01:20:15.473791 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:15.473724    2570 scope.go:117] "RemoveContainer" containerID="ddfebffe3f0acf4878f18e98b242ad4f6bcfc8214b1acbcd78fbff040967f0c7"
Sep 20 01:20:15.484675 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:15.484656    2570 scope.go:117] "RemoveContainer" containerID="ddfebffe3f0acf4878f18e98b242ad4f6bcfc8214b1acbcd78fbff040967f0c7"
Sep 20 01:20:15.484994 ip-10-0-132-108 kubenswrapper[2570]: E0920 01:20:15.484973    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddfebffe3f0acf4878f18e98b242ad4f6bcfc8214b1acbcd78fbff040967f0c7\": container with ID starting with ddfebffe3f0acf4878f18e98b242ad4f6bcfc8214b1acbcd78fbff040967f0c7 not found: ID does not exist" containerID="ddfebffe3f0acf4878f18e98b242ad4f6bcfc8214b1acbcd78fbff040967f0c7"
Sep 20 01:20:15.485067 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:15.485005    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddfebffe3f0acf4878f18e98b242ad4f6bcfc8214b1acbcd78fbff040967f0c7"} err="failed to get container status \"ddfebffe3f0acf4878f18e98b242ad4f6bcfc8214b1acbcd78fbff040967f0c7\": rpc error: code = NotFound desc = could not find container \"ddfebffe3f0acf4878f18e98b242ad4f6bcfc8214b1acbcd78fbff040967f0c7\": container with ID starting with ddfebffe3f0acf4878f18e98b242ad4f6bcfc8214b1acbcd78fbff040967f0c7 not found: ID does not exist"
Sep 20 01:20:15.492504 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:15.492455    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e6d769-5bf494fc74-889mb"]
Sep 20 01:20:15.498255 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:15.498230    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e6d769-5bf494fc74-889mb"]
Sep 20 01:20:15.511951 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:15.511926    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-e6d769-58d64b8949-trbhm"]
Sep 20 01:20:15.514344 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:15.514323    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-e6d769-58d64b8949-trbhm"]
Sep 20 01:20:17.454028 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:17.453991    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="487a9d86-4290-4a9f-8204-db4163eb1411" path="/var/lib/kubelet/pods/487a9d86-4290-4a9f-8204-db4163eb1411/volumes"
Sep 20 01:20:17.455203 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:17.455180    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6519a6be-90fd-4474-ba7e-3e9b60034b9f" path="/var/lib/kubelet/pods/6519a6be-90fd-4474-ba7e-3e9b60034b9f/volumes"
Sep 20 01:20:25.056469 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:25.056428    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e458de-9ln86"]
Sep 20 01:20:25.056909 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:25.056896    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="487a9d86-4290-4a9f-8204-db4163eb1411" containerName="payload-pre-processing"
Sep 20 01:20:25.056909 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:25.056910    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="487a9d86-4290-4a9f-8204-db4163eb1411" containerName="payload-pre-processing"
Sep 20 01:20:25.056998 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:25.056933    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6519a6be-90fd-4474-ba7e-3e9b60034b9f" containerName="payload-processing"
Sep 20 01:20:25.056998 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:25.056938    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="6519a6be-90fd-4474-ba7e-3e9b60034b9f" containerName="payload-processing"
Sep 20 01:20:25.057062 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:25.057014    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="6519a6be-90fd-4474-ba7e-3e9b60034b9f" containerName="payload-processing"
Sep 20 01:20:25.057062 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:25.057025    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="487a9d86-4290-4a9f-8204-db4163eb1411" containerName="payload-pre-processing"
Sep 20 01:20:25.061589 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:25.061574    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e458de-9ln86"
Sep 20 01:20:25.063961 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:25.063936    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 20 01:20:25.064314 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:25.064011    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5xngg\""
Sep 20 01:20:25.065985 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:25.065961    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e458de-9ln86"]
Sep 20 01:20:25.231784 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:25.231696    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0979a586-9305-471e-be0b-760ec2691903-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-e458de-9ln86\" (UID: \"0979a586-9305-471e-be0b-760ec2691903\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e458de-9ln86"
Sep 20 01:20:25.332975 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:25.332938    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0979a586-9305-471e-be0b-760ec2691903-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-e458de-9ln86\" (UID: \"0979a586-9305-471e-be0b-760ec2691903\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e458de-9ln86"
Sep 20 01:20:25.333565 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:25.333542    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0979a586-9305-471e-be0b-760ec2691903-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-e458de-9ln86\" (UID: \"0979a586-9305-471e-be0b-760ec2691903\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e458de-9ln86"
Sep 20 01:20:25.375901 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:25.375852    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e458de-9ln86"
Sep 20 01:20:25.655259 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:25.655233    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e458de-9ln86"]
Sep 20 01:20:25.657246 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:20:25.657215    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0979a586_9305_471e_be0b_760ec2691903.slice/crio-a2013fd01a2fef575f7fa3016f86e9de5fc4c5bb4b4aa051b93dbf0e285d193b WatchSource:0}: Error finding container a2013fd01a2fef575f7fa3016f86e9de5fc4c5bb4b4aa051b93dbf0e285d193b: Status 404 returned error can't find the container with id a2013fd01a2fef575f7fa3016f86e9de5fc4c5bb4b4aa051b93dbf0e285d193b
Sep 20 01:20:26.529044 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:26.529008    2570 generic.go:356] "Generic (PLEG): container finished" podID="0979a586-9305-471e-be0b-760ec2691903" containerID="98486659d43be5ec78c336f07cfac339d31998631bd37a52d9316de721cc4931" exitCode=0
Sep 20 01:20:26.529472 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:26.529096    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e458de-9ln86" event={"ID":"0979a586-9305-471e-be0b-760ec2691903","Type":"ContainerDied","Data":"98486659d43be5ec78c336f07cfac339d31998631bd37a52d9316de721cc4931"}
Sep 20 01:20:26.529472 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:26.529161    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e458de-9ln86" event={"ID":"0979a586-9305-471e-be0b-760ec2691903","Type":"ContainerStarted","Data":"a2013fd01a2fef575f7fa3016f86e9de5fc4c5bb4b4aa051b93dbf0e285d193b"}
Sep 20 01:20:27.675357 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:27.675333    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e458de-9ln86"
Sep 20 01:20:27.757630 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:27.757600    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0979a586-9305-471e-be0b-760ec2691903-maas-api-service-ca\") pod \"0979a586-9305-471e-be0b-760ec2691903\" (UID: \"0979a586-9305-471e-be0b-760ec2691903\") "
Sep 20 01:20:27.757961 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:27.757938    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0979a586-9305-471e-be0b-760ec2691903-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0979a586-9305-471e-be0b-760ec2691903" (UID: "0979a586-9305-471e-be0b-760ec2691903"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:20:27.858651 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:27.858557    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0979a586-9305-471e-be0b-760ec2691903-maas-api-service-ca\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:20:28.542074 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:28.542050    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e458de-9ln86"
Sep 20 01:20:28.542074 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:28.542056    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e458de-9ln86" event={"ID":"0979a586-9305-471e-be0b-760ec2691903","Type":"ContainerDied","Data":"a2013fd01a2fef575f7fa3016f86e9de5fc4c5bb4b4aa051b93dbf0e285d193b"}
Sep 20 01:20:28.542293 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:28.542101    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a2013fd01a2fef575f7fa3016f86e9de5fc4c5bb4b4aa051b93dbf0e285d193b"
Sep 20 01:20:40.637836 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:40.637795    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-e458de-d45cc4f79-44rx6"]
Sep 20 01:20:40.638493 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:40.638029    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-e458de-d45cc4f79-44rx6" podUID="70554b2d-1ec8-4879-8942-61afca657241" containerName="payload-processing" containerID="cri-o://826f8ca9c8a5d58eca96d3423d3558a73ac84fd2f8a6add0aa0c9c60f1e3a4b3" gracePeriod=30
Sep 20 01:20:40.653850 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:40.653818    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-e458de-5f6fbd6858-47q58"]
Sep 20 01:20:40.654114 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:40.654086    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e458de-5f6fbd6858-47q58" podUID="5b0389c3-771e-4cec-a279-96f4eb954cbe" containerName="payload-pre-processing" containerID="cri-o://1dd426fd406383a412b2cab540130a9e234ba6653c1f4e63604cde080315e775" gracePeriod=30
Sep 20 01:20:40.840957 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:40.840912    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e458de-9ln86"]
Sep 20 01:20:40.843060 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:40.843031    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e458de-9ln86"]
Sep 20 01:20:40.941578 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:40.941554    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-e458de-d45cc4f79-44rx6"
Sep 20 01:20:40.947926 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:40.947906    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e458de-5f6fbd6858-47q58"
Sep 20 01:20:40.990912 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:40.986257    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4q2l4\" (UniqueName: \"kubernetes.io/projected/5b0389c3-771e-4cec-a279-96f4eb954cbe-kube-api-access-4q2l4\") pod \"5b0389c3-771e-4cec-a279-96f4eb954cbe\" (UID: \"5b0389c3-771e-4cec-a279-96f4eb954cbe\") "
Sep 20 01:20:40.990912 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:40.986322    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bpb5c\" (UniqueName: \"kubernetes.io/projected/70554b2d-1ec8-4879-8942-61afca657241-kube-api-access-bpb5c\") pod \"70554b2d-1ec8-4879-8942-61afca657241\" (UID: \"70554b2d-1ec8-4879-8942-61afca657241\") "
Sep 20 01:20:40.990912 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:40.986369    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b0389c3-771e-4cec-a279-96f4eb954cbe-plugins-config-volume\") pod \"5b0389c3-771e-4cec-a279-96f4eb954cbe\" (UID: \"5b0389c3-771e-4cec-a279-96f4eb954cbe\") "
Sep 20 01:20:40.990912 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:40.986512    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/70554b2d-1ec8-4879-8942-61afca657241-plugins-config-volume\") pod \"70554b2d-1ec8-4879-8942-61afca657241\" (UID: \"70554b2d-1ec8-4879-8942-61afca657241\") "
Sep 20 01:20:40.990912 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:40.987287    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70554b2d-1ec8-4879-8942-61afca657241-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "70554b2d-1ec8-4879-8942-61afca657241" (UID: "70554b2d-1ec8-4879-8942-61afca657241"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:20:40.990912 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:40.987700    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b0389c3-771e-4cec-a279-96f4eb954cbe-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5b0389c3-771e-4cec-a279-96f4eb954cbe" (UID: "5b0389c3-771e-4cec-a279-96f4eb954cbe"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:20:40.992935 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:40.992852    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b0389c3-771e-4cec-a279-96f4eb954cbe-kube-api-access-4q2l4" (OuterVolumeSpecName: "kube-api-access-4q2l4") pod "5b0389c3-771e-4cec-a279-96f4eb954cbe" (UID: "5b0389c3-771e-4cec-a279-96f4eb954cbe"). InnerVolumeSpecName "kube-api-access-4q2l4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:20:40.999408 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:40.999338    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70554b2d-1ec8-4879-8942-61afca657241-kube-api-access-bpb5c" (OuterVolumeSpecName: "kube-api-access-bpb5c") pod "70554b2d-1ec8-4879-8942-61afca657241" (UID: "70554b2d-1ec8-4879-8942-61afca657241"). InnerVolumeSpecName "kube-api-access-bpb5c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:20:41.088195 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:41.088155    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4q2l4\" (UniqueName: \"kubernetes.io/projected/5b0389c3-771e-4cec-a279-96f4eb954cbe-kube-api-access-4q2l4\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:20:41.088195 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:41.088187    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bpb5c\" (UniqueName: \"kubernetes.io/projected/70554b2d-1ec8-4879-8942-61afca657241-kube-api-access-bpb5c\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:20:41.088195 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:41.088199    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b0389c3-771e-4cec-a279-96f4eb954cbe-plugins-config-volume\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:20:41.088443 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:41.088211    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/70554b2d-1ec8-4879-8942-61afca657241-plugins-config-volume\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:20:41.461298 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:41.461236    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0979a586-9305-471e-be0b-760ec2691903" path="/var/lib/kubelet/pods/0979a586-9305-471e-be0b-760ec2691903/volumes"
Sep 20 01:20:41.620815 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:41.620784    2570 generic.go:356] "Generic (PLEG): container finished" podID="5b0389c3-771e-4cec-a279-96f4eb954cbe" containerID="1dd426fd406383a412b2cab540130a9e234ba6653c1f4e63604cde080315e775" exitCode=0
Sep 20 01:20:41.621031 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:41.620841    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e458de-5f6fbd6858-47q58"
Sep 20 01:20:41.621031 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:41.620894    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e458de-5f6fbd6858-47q58" event={"ID":"5b0389c3-771e-4cec-a279-96f4eb954cbe","Type":"ContainerDied","Data":"1dd426fd406383a412b2cab540130a9e234ba6653c1f4e63604cde080315e775"}
Sep 20 01:20:41.621031 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:41.620950    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e458de-5f6fbd6858-47q58" event={"ID":"5b0389c3-771e-4cec-a279-96f4eb954cbe","Type":"ContainerDied","Data":"0cb170b99b88e006284330473376e2adb5de695fabd52c0116545d702caab3b8"}
Sep 20 01:20:41.621031 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:41.620985    2570 scope.go:117] "RemoveContainer" containerID="1dd426fd406383a412b2cab540130a9e234ba6653c1f4e63604cde080315e775"
Sep 20 01:20:41.622368 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:41.622344    2570 generic.go:356] "Generic (PLEG): container finished" podID="70554b2d-1ec8-4879-8942-61afca657241" containerID="826f8ca9c8a5d58eca96d3423d3558a73ac84fd2f8a6add0aa0c9c60f1e3a4b3" exitCode=0
Sep 20 01:20:41.622488 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:41.622395    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-e458de-d45cc4f79-44rx6"
Sep 20 01:20:41.622488 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:41.622415    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-e458de-d45cc4f79-44rx6" event={"ID":"70554b2d-1ec8-4879-8942-61afca657241","Type":"ContainerDied","Data":"826f8ca9c8a5d58eca96d3423d3558a73ac84fd2f8a6add0aa0c9c60f1e3a4b3"}
Sep 20 01:20:41.622488 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:41.622456    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-e458de-d45cc4f79-44rx6" event={"ID":"70554b2d-1ec8-4879-8942-61afca657241","Type":"ContainerDied","Data":"50e11cfb9e19f8b605cb8d526a7fba275395e26837e28dbd3adc89bcc03d0250"}
Sep 20 01:20:41.631059 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:41.631035    2570 scope.go:117] "RemoveContainer" containerID="1dd426fd406383a412b2cab540130a9e234ba6653c1f4e63604cde080315e775"
Sep 20 01:20:41.631370 ip-10-0-132-108 kubenswrapper[2570]: E0920 01:20:41.631349    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1dd426fd406383a412b2cab540130a9e234ba6653c1f4e63604cde080315e775\": container with ID starting with 1dd426fd406383a412b2cab540130a9e234ba6653c1f4e63604cde080315e775 not found: ID does not exist" containerID="1dd426fd406383a412b2cab540130a9e234ba6653c1f4e63604cde080315e775"
Sep 20 01:20:41.631422 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:41.631380    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dd426fd406383a412b2cab540130a9e234ba6653c1f4e63604cde080315e775"} err="failed to get container status \"1dd426fd406383a412b2cab540130a9e234ba6653c1f4e63604cde080315e775\": rpc error: code = NotFound desc = could not find container \"1dd426fd406383a412b2cab540130a9e234ba6653c1f4e63604cde080315e775\": container with ID starting with 1dd426fd406383a412b2cab540130a9e234ba6653c1f4e63604cde080315e775 not found: ID does not exist"
Sep 20 01:20:41.631422 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:41.631398    2570 scope.go:117] "RemoveContainer" containerID="826f8ca9c8a5d58eca96d3423d3558a73ac84fd2f8a6add0aa0c9c60f1e3a4b3"
Sep 20 01:20:41.639818 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:41.639794    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-e458de-d45cc4f79-44rx6"]
Sep 20 01:20:41.640350 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:41.640200    2570 scope.go:117] "RemoveContainer" containerID="826f8ca9c8a5d58eca96d3423d3558a73ac84fd2f8a6add0aa0c9c60f1e3a4b3"
Sep 20 01:20:41.640511 ip-10-0-132-108 kubenswrapper[2570]: E0920 01:20:41.640487    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"826f8ca9c8a5d58eca96d3423d3558a73ac84fd2f8a6add0aa0c9c60f1e3a4b3\": container with ID starting with 826f8ca9c8a5d58eca96d3423d3558a73ac84fd2f8a6add0aa0c9c60f1e3a4b3 not found: ID does not exist" containerID="826f8ca9c8a5d58eca96d3423d3558a73ac84fd2f8a6add0aa0c9c60f1e3a4b3"
Sep 20 01:20:41.640593 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:41.640520    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"826f8ca9c8a5d58eca96d3423d3558a73ac84fd2f8a6add0aa0c9c60f1e3a4b3"} err="failed to get container status \"826f8ca9c8a5d58eca96d3423d3558a73ac84fd2f8a6add0aa0c9c60f1e3a4b3\": rpc error: code = NotFound desc = could not find container \"826f8ca9c8a5d58eca96d3423d3558a73ac84fd2f8a6add0aa0c9c60f1e3a4b3\": container with ID starting with 826f8ca9c8a5d58eca96d3423d3558a73ac84fd2f8a6add0aa0c9c60f1e3a4b3 not found: ID does not exist"
Sep 20 01:20:41.643506 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:41.643486    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-e458de-d45cc4f79-44rx6"]
Sep 20 01:20:41.652759 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:41.652736    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-e458de-5f6fbd6858-47q58"]
Sep 20 01:20:41.658267 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:41.658244    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-e458de-5f6fbd6858-47q58"]
Sep 20 01:20:43.454255 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:43.454221    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b0389c3-771e-4cec-a279-96f4eb954cbe" path="/var/lib/kubelet/pods/5b0389c3-771e-4cec-a279-96f4eb954cbe/volumes"
Sep 20 01:20:43.454626 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:43.454582    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70554b2d-1ec8-4879-8942-61afca657241" path="/var/lib/kubelet/pods/70554b2d-1ec8-4879-8942-61afca657241/volumes"
Sep 20 01:20:45.915533 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:45.915499    2570 scope.go:117] "RemoveContainer" containerID="7c651dfc5eb81eda562d5beaba03b88001c5935c038e28c54767814fd101365f"
Sep 20 01:20:45.924086 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:45.924065    2570 scope.go:117] "RemoveContainer" containerID="2f58f17fd81c2b8b3781ba54da3e66b6617d718ff56e3403c9f65f8a4822f9ee"
Sep 20 01:20:45.932186 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:20:45.932164    2570 scope.go:117] "RemoveContainer" containerID="eaf58d1a8a0af742d7e489143dff6761c4d6d408f627eca7f3fa76a055387238"
Sep 20 01:21:28.890983 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:28.890889    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f"]
Sep 20 01:21:28.891479 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:28.891152    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f" podUID="ac922f5e-4043-4ce1-acbb-78275fa02dbf" containerName="istio-proxy" containerID="cri-o://aa5aa186bc309504503bbcc624f6f191c1c7bb5b7b3d2b554414e0f5e1a9e386" gracePeriod=30
Sep 20 01:21:29.359068 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:29.358986    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-63184c-wmgtp"]
Sep 20 01:21:29.359435 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:29.359422    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b0389c3-771e-4cec-a279-96f4eb954cbe" containerName="payload-pre-processing"
Sep 20 01:21:29.359489 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:29.359438    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b0389c3-771e-4cec-a279-96f4eb954cbe" containerName="payload-pre-processing"
Sep 20 01:21:29.359489 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:29.359449    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0979a586-9305-471e-be0b-760ec2691903" containerName="revoke-keys"
Sep 20 01:21:29.359489 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:29.359454    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="0979a586-9305-471e-be0b-760ec2691903" containerName="revoke-keys"
Sep 20 01:21:29.359489 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:29.359463    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70554b2d-1ec8-4879-8942-61afca657241" containerName="payload-processing"
Sep 20 01:21:29.359489 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:29.359469    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="70554b2d-1ec8-4879-8942-61afca657241" containerName="payload-processing"
Sep 20 01:21:29.359644 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:29.359546    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="0979a586-9305-471e-be0b-760ec2691903" containerName="revoke-keys"
Sep 20 01:21:29.359644 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:29.359557    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b0389c3-771e-4cec-a279-96f4eb954cbe" containerName="payload-pre-processing"
Sep 20 01:21:29.359644 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:29.359566    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="70554b2d-1ec8-4879-8942-61afca657241" containerName="payload-processing"
Sep 20 01:21:29.362922 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:29.362903    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-63184c-wmgtp"
Sep 20 01:21:29.365100 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:29.365082    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5xngg\""
Sep 20 01:21:29.365194 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:29.365104    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 20 01:21:29.369034 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:29.369007    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-63184c-wmgtp"]
Sep 20 01:21:29.475459 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:29.475422    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa678f9e-f76e-424f-a6a1-73b5cacb628b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-63184c-wmgtp\" (UID: \"fa678f9e-f76e-424f-a6a1-73b5cacb628b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-63184c-wmgtp"
Sep 20 01:21:29.576941 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:29.576891    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa678f9e-f76e-424f-a6a1-73b5cacb628b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-63184c-wmgtp\" (UID: \"fa678f9e-f76e-424f-a6a1-73b5cacb628b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-63184c-wmgtp"
Sep 20 01:21:29.577509 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:29.577487    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa678f9e-f76e-424f-a6a1-73b5cacb628b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-63184c-wmgtp\" (UID: \"fa678f9e-f76e-424f-a6a1-73b5cacb628b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-63184c-wmgtp"
Sep 20 01:21:29.674599 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:29.674559    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-63184c-wmgtp"
Sep 20 01:21:29.945477 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:29.945451    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-63184c-wmgtp"]
Sep 20 01:21:29.947790 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:21:29.947761    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa678f9e_f76e_424f_a6a1_73b5cacb628b.slice/crio-9a59ddfa28543e56534712c06bdeeda4c8174a4ea275f5aa966f7dfabcde25ec WatchSource:0}: Error finding container 9a59ddfa28543e56534712c06bdeeda4c8174a4ea275f5aa966f7dfabcde25ec: Status 404 returned error can't find the container with id 9a59ddfa28543e56534712c06bdeeda4c8174a4ea275f5aa966f7dfabcde25ec
Sep 20 01:21:30.894826 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:30.894780    2570 generic.go:356] "Generic (PLEG): container finished" podID="fa678f9e-f76e-424f-a6a1-73b5cacb628b" containerID="fdea47dc45a11c7364bd28eb526d20fec006e02413d601420cbf56c7e3a8b043" exitCode=0
Sep 20 01:21:30.895095 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:30.894913    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-63184c-wmgtp" event={"ID":"fa678f9e-f76e-424f-a6a1-73b5cacb628b","Type":"ContainerDied","Data":"fdea47dc45a11c7364bd28eb526d20fec006e02413d601420cbf56c7e3a8b043"}
Sep 20 01:21:30.895095 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:30.894969    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-63184c-wmgtp" event={"ID":"fa678f9e-f76e-424f-a6a1-73b5cacb628b","Type":"ContainerStarted","Data":"9a59ddfa28543e56534712c06bdeeda4c8174a4ea275f5aa966f7dfabcde25ec"}
Sep 20 01:21:32.033583 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:32.033556    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-63184c-wmgtp"
Sep 20 01:21:32.201662 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:32.201565    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa678f9e-f76e-424f-a6a1-73b5cacb628b-maas-api-service-ca\") pod \"fa678f9e-f76e-424f-a6a1-73b5cacb628b\" (UID: \"fa678f9e-f76e-424f-a6a1-73b5cacb628b\") "
Sep 20 01:21:32.201939 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:32.201917    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa678f9e-f76e-424f-a6a1-73b5cacb628b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fa678f9e-f76e-424f-a6a1-73b5cacb628b" (UID: "fa678f9e-f76e-424f-a6a1-73b5cacb628b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:21:32.303010 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:32.302979    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa678f9e-f76e-424f-a6a1-73b5cacb628b-maas-api-service-ca\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:21:32.906528 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:32.906502    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-63184c-wmgtp"
Sep 20 01:21:32.906528 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:32.906517    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-63184c-wmgtp" event={"ID":"fa678f9e-f76e-424f-a6a1-73b5cacb628b","Type":"ContainerDied","Data":"9a59ddfa28543e56534712c06bdeeda4c8174a4ea275f5aa966f7dfabcde25ec"}
Sep 20 01:21:32.906756 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:32.906568    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9a59ddfa28543e56534712c06bdeeda4c8174a4ea275f5aa966f7dfabcde25ec"
Sep 20 01:21:34.142607 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:34.142585    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f"
Sep 20 01:21:34.325219 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:34.325113    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac922f5e-4043-4ce1-acbb-78275fa02dbf-istiod-ca-cert\") pod \"ac922f5e-4043-4ce1-acbb-78275fa02dbf\" (UID: \"ac922f5e-4043-4ce1-acbb-78275fa02dbf\") "
Sep 20 01:21:34.325219 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:34.325158    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac922f5e-4043-4ce1-acbb-78275fa02dbf-workload-socket\") pod \"ac922f5e-4043-4ce1-acbb-78275fa02dbf\" (UID: \"ac922f5e-4043-4ce1-acbb-78275fa02dbf\") "
Sep 20 01:21:34.325219 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:34.325186    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac922f5e-4043-4ce1-acbb-78275fa02dbf-istio-envoy\") pod \"ac922f5e-4043-4ce1-acbb-78275fa02dbf\" (UID: \"ac922f5e-4043-4ce1-acbb-78275fa02dbf\") "
Sep 20 01:21:34.325219 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:34.325221    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac922f5e-4043-4ce1-acbb-78275fa02dbf-credential-socket\") pod \"ac922f5e-4043-4ce1-acbb-78275fa02dbf\" (UID: \"ac922f5e-4043-4ce1-acbb-78275fa02dbf\") "
Sep 20 01:21:34.325594 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:34.325244    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac922f5e-4043-4ce1-acbb-78275fa02dbf-istio-podinfo\") pod \"ac922f5e-4043-4ce1-acbb-78275fa02dbf\" (UID: \"ac922f5e-4043-4ce1-acbb-78275fa02dbf\") "
Sep 20 01:21:34.325594 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:34.325271    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac922f5e-4043-4ce1-acbb-78275fa02dbf-workload-certs\") pod \"ac922f5e-4043-4ce1-acbb-78275fa02dbf\" (UID: \"ac922f5e-4043-4ce1-acbb-78275fa02dbf\") "
Sep 20 01:21:34.325594 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:34.325330    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac922f5e-4043-4ce1-acbb-78275fa02dbf-istio-data\") pod \"ac922f5e-4043-4ce1-acbb-78275fa02dbf\" (UID: \"ac922f5e-4043-4ce1-acbb-78275fa02dbf\") "
Sep 20 01:21:34.325594 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:34.325352    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zfk2z\" (UniqueName: \"kubernetes.io/projected/ac922f5e-4043-4ce1-acbb-78275fa02dbf-kube-api-access-zfk2z\") pod \"ac922f5e-4043-4ce1-acbb-78275fa02dbf\" (UID: \"ac922f5e-4043-4ce1-acbb-78275fa02dbf\") "
Sep 20 01:21:34.325594 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:34.325419    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac922f5e-4043-4ce1-acbb-78275fa02dbf-istio-token\") pod \"ac922f5e-4043-4ce1-acbb-78275fa02dbf\" (UID: \"ac922f5e-4043-4ce1-acbb-78275fa02dbf\") "
Sep 20 01:21:34.325594 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:34.325429    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac922f5e-4043-4ce1-acbb-78275fa02dbf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ac922f5e-4043-4ce1-acbb-78275fa02dbf" (UID: "ac922f5e-4043-4ce1-acbb-78275fa02dbf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:21:34.325925 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:34.325596    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac922f5e-4043-4ce1-acbb-78275fa02dbf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ac922f5e-4043-4ce1-acbb-78275fa02dbf" (UID: "ac922f5e-4043-4ce1-acbb-78275fa02dbf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:21:34.325925 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:34.325652    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac922f5e-4043-4ce1-acbb-78275fa02dbf-istio-data" (OuterVolumeSpecName: "istio-data") pod "ac922f5e-4043-4ce1-acbb-78275fa02dbf" (UID: "ac922f5e-4043-4ce1-acbb-78275fa02dbf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:21:34.325925 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:34.325668    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac922f5e-4043-4ce1-acbb-78275fa02dbf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ac922f5e-4043-4ce1-acbb-78275fa02dbf" (UID: "ac922f5e-4043-4ce1-acbb-78275fa02dbf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:21:34.325925 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:34.325790    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac922f5e-4043-4ce1-acbb-78275fa02dbf-istiod-ca-cert\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:21:34.325925 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:34.325807    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac922f5e-4043-4ce1-acbb-78275fa02dbf-workload-socket\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:21:34.325925 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:34.325816    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac922f5e-4043-4ce1-acbb-78275fa02dbf-credential-socket\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:21:34.325925 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:34.325825    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac922f5e-4043-4ce1-acbb-78275fa02dbf-istio-data\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:21:34.326461 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:34.325958    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac922f5e-4043-4ce1-acbb-78275fa02dbf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ac922f5e-4043-4ce1-acbb-78275fa02dbf" (UID: "ac922f5e-4043-4ce1-acbb-78275fa02dbf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:21:34.327808 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:34.327782    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ac922f5e-4043-4ce1-acbb-78275fa02dbf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ac922f5e-4043-4ce1-acbb-78275fa02dbf" (UID: "ac922f5e-4043-4ce1-acbb-78275fa02dbf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 20 01:21:34.327808 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:34.327793    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac922f5e-4043-4ce1-acbb-78275fa02dbf-istio-token" (OuterVolumeSpecName: "istio-token") pod "ac922f5e-4043-4ce1-acbb-78275fa02dbf" (UID: "ac922f5e-4043-4ce1-acbb-78275fa02dbf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:21:34.327808 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:34.327804    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac922f5e-4043-4ce1-acbb-78275fa02dbf-kube-api-access-zfk2z" (OuterVolumeSpecName: "kube-api-access-zfk2z") pod "ac922f5e-4043-4ce1-acbb-78275fa02dbf" (UID: "ac922f5e-4043-4ce1-acbb-78275fa02dbf"). InnerVolumeSpecName "kube-api-access-zfk2z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:21:34.328019 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:34.327807    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac922f5e-4043-4ce1-acbb-78275fa02dbf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ac922f5e-4043-4ce1-acbb-78275fa02dbf" (UID: "ac922f5e-4043-4ce1-acbb-78275fa02dbf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:21:34.426998 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:34.426951    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac922f5e-4043-4ce1-acbb-78275fa02dbf-istio-podinfo\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:21:34.426998 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:34.426992    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac922f5e-4043-4ce1-acbb-78275fa02dbf-workload-certs\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:21:34.426998 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:34.427003    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zfk2z\" (UniqueName: \"kubernetes.io/projected/ac922f5e-4043-4ce1-acbb-78275fa02dbf-kube-api-access-zfk2z\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:21:34.426998 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:34.427011    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac922f5e-4043-4ce1-acbb-78275fa02dbf-istio-token\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:21:34.427241 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:34.427019    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac922f5e-4043-4ce1-acbb-78275fa02dbf-istio-envoy\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:21:34.919095 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:34.919061    2570 generic.go:356] "Generic (PLEG): container finished" podID="ac922f5e-4043-4ce1-acbb-78275fa02dbf" containerID="aa5aa186bc309504503bbcc624f6f191c1c7bb5b7b3d2b554414e0f5e1a9e386" exitCode=0
Sep 20 01:21:34.919270 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:34.919106    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f" event={"ID":"ac922f5e-4043-4ce1-acbb-78275fa02dbf","Type":"ContainerDied","Data":"aa5aa186bc309504503bbcc624f6f191c1c7bb5b7b3d2b554414e0f5e1a9e386"}
Sep 20 01:21:34.919270 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:34.919145    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f" event={"ID":"ac922f5e-4043-4ce1-acbb-78275fa02dbf","Type":"ContainerDied","Data":"8ba336552e0b54738618c2e31a7ce53fbc5b2f08171bdaf5e74bfc103fb41e7d"}
Sep 20 01:21:34.919270 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:34.919167    2570 scope.go:117] "RemoveContainer" containerID="aa5aa186bc309504503bbcc624f6f191c1c7bb5b7b3d2b554414e0f5e1a9e386"
Sep 20 01:21:34.919270 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:34.919108    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f"
Sep 20 01:21:34.928989 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:34.928967    2570 scope.go:117] "RemoveContainer" containerID="d9aaa504b3063354e9ecfdf2b3974a0eb39accb654c8acac52376186a1f78ac2"
Sep 20 01:21:34.937673 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:34.937639    2570 scope.go:117] "RemoveContainer" containerID="aa5aa186bc309504503bbcc624f6f191c1c7bb5b7b3d2b554414e0f5e1a9e386"
Sep 20 01:21:34.938045 ip-10-0-132-108 kubenswrapper[2570]: E0920 01:21:34.938017    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa5aa186bc309504503bbcc624f6f191c1c7bb5b7b3d2b554414e0f5e1a9e386\": container with ID starting with aa5aa186bc309504503bbcc624f6f191c1c7bb5b7b3d2b554414e0f5e1a9e386 not found: ID does not exist" containerID="aa5aa186bc309504503bbcc624f6f191c1c7bb5b7b3d2b554414e0f5e1a9e386"
Sep 20 01:21:34.938122 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:34.938056    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa5aa186bc309504503bbcc624f6f191c1c7bb5b7b3d2b554414e0f5e1a9e386"} err="failed to get container status \"aa5aa186bc309504503bbcc624f6f191c1c7bb5b7b3d2b554414e0f5e1a9e386\": rpc error: code = NotFound desc = could not find container \"aa5aa186bc309504503bbcc624f6f191c1c7bb5b7b3d2b554414e0f5e1a9e386\": container with ID starting with aa5aa186bc309504503bbcc624f6f191c1c7bb5b7b3d2b554414e0f5e1a9e386 not found: ID does not exist"
Sep 20 01:21:34.938122 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:34.938079    2570 scope.go:117] "RemoveContainer" containerID="d9aaa504b3063354e9ecfdf2b3974a0eb39accb654c8acac52376186a1f78ac2"
Sep 20 01:21:34.938373 ip-10-0-132-108 kubenswrapper[2570]: E0920 01:21:34.938355    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9aaa504b3063354e9ecfdf2b3974a0eb39accb654c8acac52376186a1f78ac2\": container with ID starting with d9aaa504b3063354e9ecfdf2b3974a0eb39accb654c8acac52376186a1f78ac2 not found: ID does not exist" containerID="d9aaa504b3063354e9ecfdf2b3974a0eb39accb654c8acac52376186a1f78ac2"
Sep 20 01:21:34.938433 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:34.938383    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9aaa504b3063354e9ecfdf2b3974a0eb39accb654c8acac52376186a1f78ac2"} err="failed to get container status \"d9aaa504b3063354e9ecfdf2b3974a0eb39accb654c8acac52376186a1f78ac2\": rpc error: code = NotFound desc = could not find container \"d9aaa504b3063354e9ecfdf2b3974a0eb39accb654c8acac52376186a1f78ac2\": container with ID starting with d9aaa504b3063354e9ecfdf2b3974a0eb39accb654c8acac52376186a1f78ac2 not found: ID does not exist"
Sep 20 01:21:34.939757 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:34.939737    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f"]
Sep 20 01:21:34.945935 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:34.945913    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-e458de-openshift-default-75cc59b89b-zkp7f"]
Sep 20 01:21:35.453390 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:35.453359    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac922f5e-4043-4ce1-acbb-78275fa02dbf" path="/var/lib/kubelet/pods/ac922f5e-4043-4ce1-acbb-78275fa02dbf/volumes"
Sep 20 01:21:39.882779 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:39.882749    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-63184c-6595c67fd9-nrmbp"]
Sep 20 01:21:39.883263 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:39.883021    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-63184c-6595c67fd9-nrmbp" podUID="cc9591f3-7e25-47bd-a06e-82fa0deb2418" containerName="payload-processing" containerID="cri-o://7d1cfcdc1e2c36bf06991b6ae59a293f9164b93e2589cff069b9f6adb7fea417" gracePeriod=30
Sep 20 01:21:39.895387 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:39.895360    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-63184c-85c4f7bdc4-kx74d"]
Sep 20 01:21:39.895641 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:39.895598    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-63184c-85c4f7bdc4-kx74d" podUID="bebf8304-b611-422a-bb3f-5937c2bf4259" containerName="payload-pre-processing" containerID="cri-o://b1556aa06d9f7ae9deaf40bb02451794d7e6326c7bce459c11c07d8b31ed1d31" gracePeriod=30
Sep 20 01:21:40.048880 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:40.048816    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-63184c-wmgtp"]
Sep 20 01:21:40.051095 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:40.051069    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-63184c-wmgtp"]
Sep 20 01:21:40.169358 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:40.169325    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-63184c-6595c67fd9-nrmbp"
Sep 20 01:21:40.172354 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:40.172336    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-63184c-85c4f7bdc4-kx74d"
Sep 20 01:21:40.277604 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:40.277567    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc9591f3-7e25-47bd-a06e-82fa0deb2418-plugins-config-volume\") pod \"cc9591f3-7e25-47bd-a06e-82fa0deb2418\" (UID: \"cc9591f3-7e25-47bd-a06e-82fa0deb2418\") "
Sep 20 01:21:40.277779 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:40.277682    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mkcdf\" (UniqueName: \"kubernetes.io/projected/bebf8304-b611-422a-bb3f-5937c2bf4259-kube-api-access-mkcdf\") pod \"bebf8304-b611-422a-bb3f-5937c2bf4259\" (UID: \"bebf8304-b611-422a-bb3f-5937c2bf4259\") "
Sep 20 01:21:40.277779 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:40.277718    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jkhb7\" (UniqueName: \"kubernetes.io/projected/cc9591f3-7e25-47bd-a06e-82fa0deb2418-kube-api-access-jkhb7\") pod \"cc9591f3-7e25-47bd-a06e-82fa0deb2418\" (UID: \"cc9591f3-7e25-47bd-a06e-82fa0deb2418\") "
Sep 20 01:21:40.277779 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:40.277775    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bebf8304-b611-422a-bb3f-5937c2bf4259-plugins-config-volume\") pod \"bebf8304-b611-422a-bb3f-5937c2bf4259\" (UID: \"bebf8304-b611-422a-bb3f-5937c2bf4259\") "
Sep 20 01:21:40.278174 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:40.278058    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc9591f3-7e25-47bd-a06e-82fa0deb2418-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cc9591f3-7e25-47bd-a06e-82fa0deb2418" (UID: "cc9591f3-7e25-47bd-a06e-82fa0deb2418"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:21:40.278261 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:40.278225    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bebf8304-b611-422a-bb3f-5937c2bf4259-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bebf8304-b611-422a-bb3f-5937c2bf4259" (UID: "bebf8304-b611-422a-bb3f-5937c2bf4259"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:21:40.280023 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:40.280001    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc9591f3-7e25-47bd-a06e-82fa0deb2418-kube-api-access-jkhb7" (OuterVolumeSpecName: "kube-api-access-jkhb7") pod "cc9591f3-7e25-47bd-a06e-82fa0deb2418" (UID: "cc9591f3-7e25-47bd-a06e-82fa0deb2418"). InnerVolumeSpecName "kube-api-access-jkhb7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:21:40.280088 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:40.280016    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bebf8304-b611-422a-bb3f-5937c2bf4259-kube-api-access-mkcdf" (OuterVolumeSpecName: "kube-api-access-mkcdf") pod "bebf8304-b611-422a-bb3f-5937c2bf4259" (UID: "bebf8304-b611-422a-bb3f-5937c2bf4259"). InnerVolumeSpecName "kube-api-access-mkcdf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:21:40.379105 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:40.379073    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bebf8304-b611-422a-bb3f-5937c2bf4259-plugins-config-volume\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:21:40.379105 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:40.379103    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc9591f3-7e25-47bd-a06e-82fa0deb2418-plugins-config-volume\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:21:40.379105 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:40.379111    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mkcdf\" (UniqueName: \"kubernetes.io/projected/bebf8304-b611-422a-bb3f-5937c2bf4259-kube-api-access-mkcdf\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:21:40.379350 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:40.379124    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jkhb7\" (UniqueName: \"kubernetes.io/projected/cc9591f3-7e25-47bd-a06e-82fa0deb2418-kube-api-access-jkhb7\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:21:40.954731 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:40.954700    2570 generic.go:356] "Generic (PLEG): container finished" podID="cc9591f3-7e25-47bd-a06e-82fa0deb2418" containerID="7d1cfcdc1e2c36bf06991b6ae59a293f9164b93e2589cff069b9f6adb7fea417" exitCode=0
Sep 20 01:21:40.955247 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:40.954748    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-63184c-6595c67fd9-nrmbp"
Sep 20 01:21:40.955247 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:40.954776    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-63184c-6595c67fd9-nrmbp" event={"ID":"cc9591f3-7e25-47bd-a06e-82fa0deb2418","Type":"ContainerDied","Data":"7d1cfcdc1e2c36bf06991b6ae59a293f9164b93e2589cff069b9f6adb7fea417"}
Sep 20 01:21:40.955247 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:40.954819    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-63184c-6595c67fd9-nrmbp" event={"ID":"cc9591f3-7e25-47bd-a06e-82fa0deb2418","Type":"ContainerDied","Data":"c5386cdda7ccd0b7640f66fb1bf16070206260cdc1b0340f47c168c3cc09ae36"}
Sep 20 01:21:40.955247 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:40.954848    2570 scope.go:117] "RemoveContainer" containerID="7d1cfcdc1e2c36bf06991b6ae59a293f9164b93e2589cff069b9f6adb7fea417"
Sep 20 01:21:40.956404 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:40.956311    2570 generic.go:356] "Generic (PLEG): container finished" podID="bebf8304-b611-422a-bb3f-5937c2bf4259" containerID="b1556aa06d9f7ae9deaf40bb02451794d7e6326c7bce459c11c07d8b31ed1d31" exitCode=0
Sep 20 01:21:40.956404 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:40.956361    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-63184c-85c4f7bdc4-kx74d"
Sep 20 01:21:40.956404 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:40.956401    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-63184c-85c4f7bdc4-kx74d" event={"ID":"bebf8304-b611-422a-bb3f-5937c2bf4259","Type":"ContainerDied","Data":"b1556aa06d9f7ae9deaf40bb02451794d7e6326c7bce459c11c07d8b31ed1d31"}
Sep 20 01:21:40.956404 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:40.956458    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-63184c-85c4f7bdc4-kx74d" event={"ID":"bebf8304-b611-422a-bb3f-5937c2bf4259","Type":"ContainerDied","Data":"83a2b0aa2fdac0f1a1bc961a22cdf2fba13abd0ef89130e9a3e6f5c71eec0595"}
Sep 20 01:21:40.964411 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:40.964117    2570 scope.go:117] "RemoveContainer" containerID="7d1cfcdc1e2c36bf06991b6ae59a293f9164b93e2589cff069b9f6adb7fea417"
Sep 20 01:21:40.964485 ip-10-0-132-108 kubenswrapper[2570]: E0920 01:21:40.964417    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d1cfcdc1e2c36bf06991b6ae59a293f9164b93e2589cff069b9f6adb7fea417\": container with ID starting with 7d1cfcdc1e2c36bf06991b6ae59a293f9164b93e2589cff069b9f6adb7fea417 not found: ID does not exist" containerID="7d1cfcdc1e2c36bf06991b6ae59a293f9164b93e2589cff069b9f6adb7fea417"
Sep 20 01:21:40.964485 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:40.964452    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d1cfcdc1e2c36bf06991b6ae59a293f9164b93e2589cff069b9f6adb7fea417"} err="failed to get container status \"7d1cfcdc1e2c36bf06991b6ae59a293f9164b93e2589cff069b9f6adb7fea417\": rpc error: code = NotFound desc = could not find container \"7d1cfcdc1e2c36bf06991b6ae59a293f9164b93e2589cff069b9f6adb7fea417\": container with ID starting with 7d1cfcdc1e2c36bf06991b6ae59a293f9164b93e2589cff069b9f6adb7fea417 not found: ID does not exist"
Sep 20 01:21:40.964485 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:40.964477    2570 scope.go:117] "RemoveContainer" containerID="b1556aa06d9f7ae9deaf40bb02451794d7e6326c7bce459c11c07d8b31ed1d31"
Sep 20 01:21:40.973472 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:40.973454    2570 scope.go:117] "RemoveContainer" containerID="b1556aa06d9f7ae9deaf40bb02451794d7e6326c7bce459c11c07d8b31ed1d31"
Sep 20 01:21:40.973750 ip-10-0-132-108 kubenswrapper[2570]: E0920 01:21:40.973729    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1556aa06d9f7ae9deaf40bb02451794d7e6326c7bce459c11c07d8b31ed1d31\": container with ID starting with b1556aa06d9f7ae9deaf40bb02451794d7e6326c7bce459c11c07d8b31ed1d31 not found: ID does not exist" containerID="b1556aa06d9f7ae9deaf40bb02451794d7e6326c7bce459c11c07d8b31ed1d31"
Sep 20 01:21:40.973817 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:40.973758    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1556aa06d9f7ae9deaf40bb02451794d7e6326c7bce459c11c07d8b31ed1d31"} err="failed to get container status \"b1556aa06d9f7ae9deaf40bb02451794d7e6326c7bce459c11c07d8b31ed1d31\": rpc error: code = NotFound desc = could not find container \"b1556aa06d9f7ae9deaf40bb02451794d7e6326c7bce459c11c07d8b31ed1d31\": container with ID starting with b1556aa06d9f7ae9deaf40bb02451794d7e6326c7bce459c11c07d8b31ed1d31 not found: ID does not exist"
Sep 20 01:21:40.981567 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:40.981546    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-63184c-6595c67fd9-nrmbp"]
Sep 20 01:21:40.987482 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:40.987461    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-63184c-6595c67fd9-nrmbp"]
Sep 20 01:21:40.996285 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:40.996266    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-63184c-85c4f7bdc4-kx74d"]
Sep 20 01:21:40.999556 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:40.999531    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-63184c-85c4f7bdc4-kx74d"]
Sep 20 01:21:41.459691 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:41.459659    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bebf8304-b611-422a-bb3f-5937c2bf4259" path="/var/lib/kubelet/pods/bebf8304-b611-422a-bb3f-5937c2bf4259/volumes"
Sep 20 01:21:41.460067 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:41.460053    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc9591f3-7e25-47bd-a06e-82fa0deb2418" path="/var/lib/kubelet/pods/cc9591f3-7e25-47bd-a06e-82fa0deb2418/volumes"
Sep 20 01:21:41.460346 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:41.460334    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa678f9e-f76e-424f-a6a1-73b5cacb628b" path="/var/lib/kubelet/pods/fa678f9e-f76e-424f-a6a1-73b5cacb628b/volumes"
Sep 20 01:21:46.636554 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:46.636511    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v"]
Sep 20 01:21:46.984563 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:46.984471    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-d1662a-tbn5k"]
Sep 20 01:21:46.984990 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:46.984971    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac922f5e-4043-4ce1-acbb-78275fa02dbf" containerName="istio-proxy"
Sep 20 01:21:46.985080 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:46.984993    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac922f5e-4043-4ce1-acbb-78275fa02dbf" containerName="istio-proxy"
Sep 20 01:21:46.985080 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:46.985017    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa678f9e-f76e-424f-a6a1-73b5cacb628b" containerName="revoke-keys"
Sep 20 01:21:46.985080 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:46.985025    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa678f9e-f76e-424f-a6a1-73b5cacb628b" containerName="revoke-keys"
Sep 20 01:21:46.985080 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:46.985047    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bebf8304-b611-422a-bb3f-5937c2bf4259" containerName="payload-pre-processing"
Sep 20 01:21:46.985080 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:46.985055    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="bebf8304-b611-422a-bb3f-5937c2bf4259" containerName="payload-pre-processing"
Sep 20 01:21:46.985080 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:46.985067    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc9591f3-7e25-47bd-a06e-82fa0deb2418" containerName="payload-processing"
Sep 20 01:21:46.985080 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:46.985076    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc9591f3-7e25-47bd-a06e-82fa0deb2418" containerName="payload-processing"
Sep 20 01:21:46.985435 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:46.985175    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac922f5e-4043-4ce1-acbb-78275fa02dbf" containerName="istio-proxy"
Sep 20 01:21:46.985435 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:46.985186    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="bebf8304-b611-422a-bb3f-5937c2bf4259" containerName="payload-pre-processing"
Sep 20 01:21:46.985435 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:46.985195    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa678f9e-f76e-424f-a6a1-73b5cacb628b" containerName="revoke-keys"
Sep 20 01:21:46.985435 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:46.985204    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac922f5e-4043-4ce1-acbb-78275fa02dbf" containerName="istio-proxy"
Sep 20 01:21:46.985435 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:46.985215    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc9591f3-7e25-47bd-a06e-82fa0deb2418" containerName="payload-processing"
Sep 20 01:21:46.990366 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:46.990345    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-d1662a-tbn5k"
Sep 20 01:21:46.992940 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:46.992913    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5xngg\""
Sep 20 01:21:46.993079 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:46.992935    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 20 01:21:46.994756 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:46.994730    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-d1662a-tbn5k"]
Sep 20 01:21:46.995571 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:46.995521    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v" podUID="60cab5cc-452f-4d48-b7f2-150da52fe5d4" containerName="istio-proxy" containerID="cri-o://36baac069308d58473467c1a4a34b461cba826617672fa9523e2b5f941ca5f15" gracePeriod=30
Sep 20 01:21:47.045468 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:47.045433    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4558a65e-c075-4688-9c3d-17aa8650d768-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-d1662a-tbn5k\" (UID: \"4558a65e-c075-4688-9c3d-17aa8650d768\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-d1662a-tbn5k"
Sep 20 01:21:47.147001 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:47.146968    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4558a65e-c075-4688-9c3d-17aa8650d768-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-d1662a-tbn5k\" (UID: \"4558a65e-c075-4688-9c3d-17aa8650d768\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-d1662a-tbn5k"
Sep 20 01:21:47.147602 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:47.147579    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4558a65e-c075-4688-9c3d-17aa8650d768-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-d1662a-tbn5k\" (UID: \"4558a65e-c075-4688-9c3d-17aa8650d768\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-d1662a-tbn5k"
Sep 20 01:21:47.303825 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:47.303732    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-d1662a-tbn5k"
Sep 20 01:21:47.573165 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:47.573144    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-d1662a-tbn5k"]
Sep 20 01:21:47.575589 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:21:47.575564    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4558a65e_c075_4688_9c3d_17aa8650d768.slice/crio-003cbd8e018409983b5f3f481cb595fd0d98ac264b9198a2003b0c6c7452e460 WatchSource:0}: Error finding container 003cbd8e018409983b5f3f481cb595fd0d98ac264b9198a2003b0c6c7452e460: Status 404 returned error can't find the container with id 003cbd8e018409983b5f3f481cb595fd0d98ac264b9198a2003b0c6c7452e460
Sep 20 01:21:48.002456 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:48.002416    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-d1662a-tbn5k" event={"ID":"4558a65e-c075-4688-9c3d-17aa8650d768","Type":"ContainerStarted","Data":"e478450ec51b82b8ade8f75bb07ac4597a81064847f0f76d6775f09900fc00c9"}
Sep 20 01:21:48.002839 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:48.002471    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-d1662a-tbn5k" event={"ID":"4558a65e-c075-4688-9c3d-17aa8650d768","Type":"ContainerStarted","Data":"003cbd8e018409983b5f3f481cb595fd0d98ac264b9198a2003b0c6c7452e460"}
Sep 20 01:21:48.018956 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:48.018912    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-d1662a-tbn5k" podStartSLOduration=2.018896437 podStartE2EDuration="2.018896437s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:21:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:21:48.017924314 +0000 UTC m=+2044.632080225" watchObservedRunningTime="2026-09-20 01:21:48.018896437 +0000 UTC m=+2044.633052334"
Sep 20 01:21:49.008681 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:49.008649    2570 generic.go:356] "Generic (PLEG): container finished" podID="4558a65e-c075-4688-9c3d-17aa8650d768" containerID="e478450ec51b82b8ade8f75bb07ac4597a81064847f0f76d6775f09900fc00c9" exitCode=0
Sep 20 01:21:49.009098 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:49.008740    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-d1662a-tbn5k" event={"ID":"4558a65e-c075-4688-9c3d-17aa8650d768","Type":"ContainerDied","Data":"e478450ec51b82b8ade8f75bb07ac4597a81064847f0f76d6775f09900fc00c9"}
Sep 20 01:21:50.142649 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:50.142626    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-d1662a-tbn5k"
Sep 20 01:21:50.276412 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:50.276332    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4558a65e-c075-4688-9c3d-17aa8650d768-maas-api-service-ca\") pod \"4558a65e-c075-4688-9c3d-17aa8650d768\" (UID: \"4558a65e-c075-4688-9c3d-17aa8650d768\") "
Sep 20 01:21:50.276719 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:50.276700    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4558a65e-c075-4688-9c3d-17aa8650d768-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4558a65e-c075-4688-9c3d-17aa8650d768" (UID: "4558a65e-c075-4688-9c3d-17aa8650d768"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:21:50.377570 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:50.377538    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4558a65e-c075-4688-9c3d-17aa8650d768-maas-api-service-ca\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:21:51.019450 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:51.019420    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-d1662a-tbn5k"
Sep 20 01:21:51.019450 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:51.019429    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-d1662a-tbn5k" event={"ID":"4558a65e-c075-4688-9c3d-17aa8650d768","Type":"ContainerDied","Data":"003cbd8e018409983b5f3f481cb595fd0d98ac264b9198a2003b0c6c7452e460"}
Sep 20 01:21:51.019669 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:51.019472    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="003cbd8e018409983b5f3f481cb595fd0d98ac264b9198a2003b0c6c7452e460"
Sep 20 01:21:52.256817 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:52.256759    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v"
Sep 20 01:21:52.397052 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:52.397019    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60cab5cc-452f-4d48-b7f2-150da52fe5d4-istio-data\") pod \"60cab5cc-452f-4d48-b7f2-150da52fe5d4\" (UID: \"60cab5cc-452f-4d48-b7f2-150da52fe5d4\") "
Sep 20 01:21:52.397235 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:52.397078    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60cab5cc-452f-4d48-b7f2-150da52fe5d4-istio-podinfo\") pod \"60cab5cc-452f-4d48-b7f2-150da52fe5d4\" (UID: \"60cab5cc-452f-4d48-b7f2-150da52fe5d4\") "
Sep 20 01:21:52.397235 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:52.397137    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wt2ww\" (UniqueName: \"kubernetes.io/projected/60cab5cc-452f-4d48-b7f2-150da52fe5d4-kube-api-access-wt2ww\") pod \"60cab5cc-452f-4d48-b7f2-150da52fe5d4\" (UID: \"60cab5cc-452f-4d48-b7f2-150da52fe5d4\") "
Sep 20 01:21:52.397235 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:52.397167    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60cab5cc-452f-4d48-b7f2-150da52fe5d4-credential-socket\") pod \"60cab5cc-452f-4d48-b7f2-150da52fe5d4\" (UID: \"60cab5cc-452f-4d48-b7f2-150da52fe5d4\") "
Sep 20 01:21:52.397235 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:52.397194    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60cab5cc-452f-4d48-b7f2-150da52fe5d4-istio-envoy\") pod \"60cab5cc-452f-4d48-b7f2-150da52fe5d4\" (UID: \"60cab5cc-452f-4d48-b7f2-150da52fe5d4\") "
Sep 20 01:21:52.397476 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:52.397249    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60cab5cc-452f-4d48-b7f2-150da52fe5d4-istiod-ca-cert\") pod \"60cab5cc-452f-4d48-b7f2-150da52fe5d4\" (UID: \"60cab5cc-452f-4d48-b7f2-150da52fe5d4\") "
Sep 20 01:21:52.397476 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:52.397297    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60cab5cc-452f-4d48-b7f2-150da52fe5d4-workload-socket\") pod \"60cab5cc-452f-4d48-b7f2-150da52fe5d4\" (UID: \"60cab5cc-452f-4d48-b7f2-150da52fe5d4\") "
Sep 20 01:21:52.397476 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:52.397331    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60cab5cc-452f-4d48-b7f2-150da52fe5d4-istio-data" (OuterVolumeSpecName: "istio-data") pod "60cab5cc-452f-4d48-b7f2-150da52fe5d4" (UID: "60cab5cc-452f-4d48-b7f2-150da52fe5d4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:21:52.397476 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:52.397343    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60cab5cc-452f-4d48-b7f2-150da52fe5d4-workload-certs\") pod \"60cab5cc-452f-4d48-b7f2-150da52fe5d4\" (UID: \"60cab5cc-452f-4d48-b7f2-150da52fe5d4\") "
Sep 20 01:21:52.397476 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:52.397410    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60cab5cc-452f-4d48-b7f2-150da52fe5d4-istio-token\") pod \"60cab5cc-452f-4d48-b7f2-150da52fe5d4\" (UID: \"60cab5cc-452f-4d48-b7f2-150da52fe5d4\") "
Sep 20 01:21:52.397732 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:52.397525    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60cab5cc-452f-4d48-b7f2-150da52fe5d4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "60cab5cc-452f-4d48-b7f2-150da52fe5d4" (UID: "60cab5cc-452f-4d48-b7f2-150da52fe5d4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:21:52.397732 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:52.397674    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60cab5cc-452f-4d48-b7f2-150da52fe5d4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "60cab5cc-452f-4d48-b7f2-150da52fe5d4" (UID: "60cab5cc-452f-4d48-b7f2-150da52fe5d4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:21:52.397732 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:52.397689    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60cab5cc-452f-4d48-b7f2-150da52fe5d4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "60cab5cc-452f-4d48-b7f2-150da52fe5d4" (UID: "60cab5cc-452f-4d48-b7f2-150da52fe5d4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:21:52.397896 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:52.397809    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60cab5cc-452f-4d48-b7f2-150da52fe5d4-credential-socket\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:21:52.397896 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:52.397831    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60cab5cc-452f-4d48-b7f2-150da52fe5d4-workload-socket\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:21:52.397896 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:52.397844    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60cab5cc-452f-4d48-b7f2-150da52fe5d4-workload-certs\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:21:52.397896 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:52.397853    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60cab5cc-452f-4d48-b7f2-150da52fe5d4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "60cab5cc-452f-4d48-b7f2-150da52fe5d4" (UID: "60cab5cc-452f-4d48-b7f2-150da52fe5d4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:21:52.398103 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:52.397892    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60cab5cc-452f-4d48-b7f2-150da52fe5d4-istio-data\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:21:52.399556 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:52.399531    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/60cab5cc-452f-4d48-b7f2-150da52fe5d4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "60cab5cc-452f-4d48-b7f2-150da52fe5d4" (UID: "60cab5cc-452f-4d48-b7f2-150da52fe5d4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 20 01:21:52.399681 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:52.399569    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60cab5cc-452f-4d48-b7f2-150da52fe5d4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "60cab5cc-452f-4d48-b7f2-150da52fe5d4" (UID: "60cab5cc-452f-4d48-b7f2-150da52fe5d4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:21:52.399750 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:52.399730    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60cab5cc-452f-4d48-b7f2-150da52fe5d4-istio-token" (OuterVolumeSpecName: "istio-token") pod "60cab5cc-452f-4d48-b7f2-150da52fe5d4" (UID: "60cab5cc-452f-4d48-b7f2-150da52fe5d4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:21:52.399849 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:52.399834    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60cab5cc-452f-4d48-b7f2-150da52fe5d4-kube-api-access-wt2ww" (OuterVolumeSpecName: "kube-api-access-wt2ww") pod "60cab5cc-452f-4d48-b7f2-150da52fe5d4" (UID: "60cab5cc-452f-4d48-b7f2-150da52fe5d4"). InnerVolumeSpecName "kube-api-access-wt2ww". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:21:52.498408 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:52.498373    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60cab5cc-452f-4d48-b7f2-150da52fe5d4-istio-podinfo\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:21:52.498408 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:52.498406    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wt2ww\" (UniqueName: \"kubernetes.io/projected/60cab5cc-452f-4d48-b7f2-150da52fe5d4-kube-api-access-wt2ww\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:21:52.498655 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:52.498422    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60cab5cc-452f-4d48-b7f2-150da52fe5d4-istio-envoy\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:21:52.498655 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:52.498434    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60cab5cc-452f-4d48-b7f2-150da52fe5d4-istiod-ca-cert\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:21:52.498655 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:52.498446    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60cab5cc-452f-4d48-b7f2-150da52fe5d4-istio-token\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:21:53.030892 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:53.030844    2570 generic.go:356] "Generic (PLEG): container finished" podID="60cab5cc-452f-4d48-b7f2-150da52fe5d4" containerID="36baac069308d58473467c1a4a34b461cba826617672fa9523e2b5f941ca5f15" exitCode=0
Sep 20 01:21:53.031067 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:53.030911    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v"
Sep 20 01:21:53.031067 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:53.030933    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v" event={"ID":"60cab5cc-452f-4d48-b7f2-150da52fe5d4","Type":"ContainerDied","Data":"36baac069308d58473467c1a4a34b461cba826617672fa9523e2b5f941ca5f15"}
Sep 20 01:21:53.031067 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:53.030997    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v" event={"ID":"60cab5cc-452f-4d48-b7f2-150da52fe5d4","Type":"ContainerDied","Data":"2e01763b9904a4a9a0e098cabcd58d3fbda1f9e48dd25621396a3697ec55b5b7"}
Sep 20 01:21:53.031067 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:53.031027    2570 scope.go:117] "RemoveContainer" containerID="36baac069308d58473467c1a4a34b461cba826617672fa9523e2b5f941ca5f15"
Sep 20 01:21:53.044365 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:53.044349    2570 scope.go:117] "RemoveContainer" containerID="ae40c3ca17c0683fe5531ca206a0325d22d83bfef50012a8cf4055196b734284"
Sep 20 01:21:53.052981 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:53.052964    2570 scope.go:117] "RemoveContainer" containerID="36baac069308d58473467c1a4a34b461cba826617672fa9523e2b5f941ca5f15"
Sep 20 01:21:53.053318 ip-10-0-132-108 kubenswrapper[2570]: E0920 01:21:53.053295    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36baac069308d58473467c1a4a34b461cba826617672fa9523e2b5f941ca5f15\": container with ID starting with 36baac069308d58473467c1a4a34b461cba826617672fa9523e2b5f941ca5f15 not found: ID does not exist" containerID="36baac069308d58473467c1a4a34b461cba826617672fa9523e2b5f941ca5f15"
Sep 20 01:21:53.053434 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:53.053327    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36baac069308d58473467c1a4a34b461cba826617672fa9523e2b5f941ca5f15"} err="failed to get container status \"36baac069308d58473467c1a4a34b461cba826617672fa9523e2b5f941ca5f15\": rpc error: code = NotFound desc = could not find container \"36baac069308d58473467c1a4a34b461cba826617672fa9523e2b5f941ca5f15\": container with ID starting with 36baac069308d58473467c1a4a34b461cba826617672fa9523e2b5f941ca5f15 not found: ID does not exist"
Sep 20 01:21:53.053434 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:53.053350    2570 scope.go:117] "RemoveContainer" containerID="ae40c3ca17c0683fe5531ca206a0325d22d83bfef50012a8cf4055196b734284"
Sep 20 01:21:53.054168 ip-10-0-132-108 kubenswrapper[2570]: E0920 01:21:53.053846    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae40c3ca17c0683fe5531ca206a0325d22d83bfef50012a8cf4055196b734284\": container with ID starting with ae40c3ca17c0683fe5531ca206a0325d22d83bfef50012a8cf4055196b734284 not found: ID does not exist" containerID="ae40c3ca17c0683fe5531ca206a0325d22d83bfef50012a8cf4055196b734284"
Sep 20 01:21:53.054168 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:53.053910    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae40c3ca17c0683fe5531ca206a0325d22d83bfef50012a8cf4055196b734284"} err="failed to get container status \"ae40c3ca17c0683fe5531ca206a0325d22d83bfef50012a8cf4055196b734284\": rpc error: code = NotFound desc = could not find container \"ae40c3ca17c0683fe5531ca206a0325d22d83bfef50012a8cf4055196b734284\": container with ID starting with ae40c3ca17c0683fe5531ca206a0325d22d83bfef50012a8cf4055196b734284 not found: ID does not exist"
Sep 20 01:21:53.056092 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:53.056072    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v"]
Sep 20 01:21:53.062804 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:53.062782    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-63184c-openshift-default-5c866788f4-4p94v"]
Sep 20 01:21:53.453304 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:53.453271    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60cab5cc-452f-4d48-b7f2-150da52fe5d4" path="/var/lib/kubelet/pods/60cab5cc-452f-4d48-b7f2-150da52fe5d4/volumes"
Sep 20 01:21:57.486750 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:57.486675    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-d1662a-29831115-6rg6j"]
Sep 20 01:21:57.489299 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:57.489275    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-d1662a-29831115-6rg6j"]
Sep 20 01:21:57.680418 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:57.680386    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-d1662a-tbn5k"]
Sep 20 01:21:57.683115 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:57.683086    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-d1662a-tbn5k"]
Sep 20 01:21:59.454457 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:59.454411    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="443e2779-5f89-45f6-ae13-b4ed7487cc20" path="/var/lib/kubelet/pods/443e2779-5f89-45f6-ae13-b4ed7487cc20/volumes"
Sep 20 01:21:59.454972 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:21:59.454880    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4558a65e-c075-4688-9c3d-17aa8650d768" path="/var/lib/kubelet/pods/4558a65e-c075-4688-9c3d-17aa8650d768/volumes"
Sep 20 01:22:04.397579 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:04.397540    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-4c93ee-gqkhn"]
Sep 20 01:22:04.397997 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:04.397952    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60cab5cc-452f-4d48-b7f2-150da52fe5d4" containerName="istio-proxy"
Sep 20 01:22:04.397997 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:04.397964    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="60cab5cc-452f-4d48-b7f2-150da52fe5d4" containerName="istio-proxy"
Sep 20 01:22:04.397997 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:04.397981    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac922f5e-4043-4ce1-acbb-78275fa02dbf" containerName="istio-proxy"
Sep 20 01:22:04.397997 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:04.397987    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac922f5e-4043-4ce1-acbb-78275fa02dbf" containerName="istio-proxy"
Sep 20 01:22:04.397997 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:04.397997    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4558a65e-c075-4688-9c3d-17aa8650d768" containerName="revoke-keys"
Sep 20 01:22:04.398173 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:04.398002    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="4558a65e-c075-4688-9c3d-17aa8650d768" containerName="revoke-keys"
Sep 20 01:22:04.398173 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:04.398012    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60cab5cc-452f-4d48-b7f2-150da52fe5d4" containerName="istio-proxy"
Sep 20 01:22:04.398173 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:04.398017    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="60cab5cc-452f-4d48-b7f2-150da52fe5d4" containerName="istio-proxy"
Sep 20 01:22:04.398173 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:04.398083    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="4558a65e-c075-4688-9c3d-17aa8650d768" containerName="revoke-keys"
Sep 20 01:22:04.398173 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:04.398090    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="60cab5cc-452f-4d48-b7f2-150da52fe5d4" containerName="istio-proxy"
Sep 20 01:22:04.398173 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:04.398098    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="60cab5cc-452f-4d48-b7f2-150da52fe5d4" containerName="istio-proxy"
Sep 20 01:22:04.401199 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:04.401182    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-4c93ee-gqkhn"
Sep 20 01:22:04.403245 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:04.403223    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 20 01:22:04.403408 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:04.403393    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5xngg\""
Sep 20 01:22:04.408029 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:04.408005    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-4c93ee-gqkhn"]
Sep 20 01:22:04.512256 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:04.512226    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eee1764e-bd4d-4d87-be3a-9f916ce0f06d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-4c93ee-gqkhn\" (UID: \"eee1764e-bd4d-4d87-be3a-9f916ce0f06d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-4c93ee-gqkhn"
Sep 20 01:22:04.613833 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:04.613797    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eee1764e-bd4d-4d87-be3a-9f916ce0f06d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-4c93ee-gqkhn\" (UID: \"eee1764e-bd4d-4d87-be3a-9f916ce0f06d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-4c93ee-gqkhn"
Sep 20 01:22:04.614442 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:04.614420    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eee1764e-bd4d-4d87-be3a-9f916ce0f06d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-4c93ee-gqkhn\" (UID: \"eee1764e-bd4d-4d87-be3a-9f916ce0f06d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-4c93ee-gqkhn"
Sep 20 01:22:04.713299 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:04.713206    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-4c93ee-gqkhn"
Sep 20 01:22:04.982828 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:04.982677    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-4c93ee-gqkhn"]
Sep 20 01:22:04.985888 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:22:04.985828    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeee1764e_bd4d_4d87_be3a_9f916ce0f06d.slice/crio-8beb4a1ab1ac0e25728ef23c1944d57c412834739ca18ef47bb58e7b79bac7f4 WatchSource:0}: Error finding container 8beb4a1ab1ac0e25728ef23c1944d57c412834739ca18ef47bb58e7b79bac7f4: Status 404 returned error can't find the container with id 8beb4a1ab1ac0e25728ef23c1944d57c412834739ca18ef47bb58e7b79bac7f4
Sep 20 01:22:05.093999 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:05.093964    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-4c93ee-gqkhn" event={"ID":"eee1764e-bd4d-4d87-be3a-9f916ce0f06d","Type":"ContainerStarted","Data":"8beb4a1ab1ac0e25728ef23c1944d57c412834739ca18ef47bb58e7b79bac7f4"}
Sep 20 01:22:06.100526 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:06.100445    2570 generic.go:356] "Generic (PLEG): container finished" podID="eee1764e-bd4d-4d87-be3a-9f916ce0f06d" containerID="5f170788a045879e30ebb2cc0872eb83b708215622bc0ca30f85c2485df5a164" exitCode=0
Sep 20 01:22:06.100904 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:06.100529    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-4c93ee-gqkhn" event={"ID":"eee1764e-bd4d-4d87-be3a-9f916ce0f06d","Type":"ContainerDied","Data":"5f170788a045879e30ebb2cc0872eb83b708215622bc0ca30f85c2485df5a164"}
Sep 20 01:22:07.250136 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:07.250107    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-4c93ee-gqkhn"
Sep 20 01:22:07.343290 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:07.343251    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eee1764e-bd4d-4d87-be3a-9f916ce0f06d-maas-api-service-ca\") pod \"eee1764e-bd4d-4d87-be3a-9f916ce0f06d\" (UID: \"eee1764e-bd4d-4d87-be3a-9f916ce0f06d\") "
Sep 20 01:22:07.343632 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:07.343604    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eee1764e-bd4d-4d87-be3a-9f916ce0f06d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "eee1764e-bd4d-4d87-be3a-9f916ce0f06d" (UID: "eee1764e-bd4d-4d87-be3a-9f916ce0f06d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:22:07.444180 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:07.444141    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eee1764e-bd4d-4d87-be3a-9f916ce0f06d-maas-api-service-ca\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:22:08.112393 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:08.112367    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-4c93ee-gqkhn"
Sep 20 01:22:08.112393 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:08.112376    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-4c93ee-gqkhn" event={"ID":"eee1764e-bd4d-4d87-be3a-9f916ce0f06d","Type":"ContainerDied","Data":"8beb4a1ab1ac0e25728ef23c1944d57c412834739ca18ef47bb58e7b79bac7f4"}
Sep 20 01:22:08.112617 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:08.112420    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8beb4a1ab1ac0e25728ef23c1944d57c412834739ca18ef47bb58e7b79bac7f4"
Sep 20 01:22:15.061241 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:15.061187    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-4c93ee-gqkhn"]
Sep 20 01:22:15.062930 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:15.062907    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-4c93ee-gqkhn"]
Sep 20 01:22:15.454893 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:15.454840    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eee1764e-bd4d-4d87-be3a-9f916ce0f06d" path="/var/lib/kubelet/pods/eee1764e-bd4d-4d87-be3a-9f916ce0f06d/volumes"
Sep 20 01:22:21.583657 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:21.583618    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc"]
Sep 20 01:22:21.584133 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:21.583837    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc" podUID="a2e7f4c4-e022-4015-b4ec-4128df9f52cc" containerName="istio-proxy" containerID="cri-o://2c87ce667de343f87a6bfd0104de29ab92c90683c7aa4539e556272ef8e0c65f" gracePeriod=30
Sep 20 01:22:25.441209 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:25.441174    2570 patch_prober.go:28] interesting pod/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 20 01:22:25.441573 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:25.441246    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc" podUID="a2e7f4c4-e022-4015-b4ec-4128df9f52cc" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 20 01:22:26.828067 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:26.828041    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc"
Sep 20 01:22:26.929604 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:26.929567    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2e7f4c4-e022-4015-b4ec-4128df9f52cc-istio-data\") pod \"a2e7f4c4-e022-4015-b4ec-4128df9f52cc\" (UID: \"a2e7f4c4-e022-4015-b4ec-4128df9f52cc\") "
Sep 20 01:22:26.929812 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:26.929636    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2e7f4c4-e022-4015-b4ec-4128df9f52cc-credential-socket\") pod \"a2e7f4c4-e022-4015-b4ec-4128df9f52cc\" (UID: \"a2e7f4c4-e022-4015-b4ec-4128df9f52cc\") "
Sep 20 01:22:26.929812 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:26.929675    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4s7bp\" (UniqueName: \"kubernetes.io/projected/a2e7f4c4-e022-4015-b4ec-4128df9f52cc-kube-api-access-4s7bp\") pod \"a2e7f4c4-e022-4015-b4ec-4128df9f52cc\" (UID: \"a2e7f4c4-e022-4015-b4ec-4128df9f52cc\") "
Sep 20 01:22:26.929812 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:26.929725    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2e7f4c4-e022-4015-b4ec-4128df9f52cc-istio-podinfo\") pod \"a2e7f4c4-e022-4015-b4ec-4128df9f52cc\" (UID: \"a2e7f4c4-e022-4015-b4ec-4128df9f52cc\") "
Sep 20 01:22:26.929812 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:26.929750    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2e7f4c4-e022-4015-b4ec-4128df9f52cc-workload-certs\") pod \"a2e7f4c4-e022-4015-b4ec-4128df9f52cc\" (UID: \"a2e7f4c4-e022-4015-b4ec-4128df9f52cc\") "
Sep 20 01:22:26.929812 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:26.929800    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2e7f4c4-e022-4015-b4ec-4128df9f52cc-istio-envoy\") pod \"a2e7f4c4-e022-4015-b4ec-4128df9f52cc\" (UID: \"a2e7f4c4-e022-4015-b4ec-4128df9f52cc\") "
Sep 20 01:22:26.930165 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:26.929828    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2e7f4c4-e022-4015-b4ec-4128df9f52cc-workload-socket\") pod \"a2e7f4c4-e022-4015-b4ec-4128df9f52cc\" (UID: \"a2e7f4c4-e022-4015-b4ec-4128df9f52cc\") "
Sep 20 01:22:26.930165 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:26.929919    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2e7f4c4-e022-4015-b4ec-4128df9f52cc-istio-token\") pod \"a2e7f4c4-e022-4015-b4ec-4128df9f52cc\" (UID: \"a2e7f4c4-e022-4015-b4ec-4128df9f52cc\") "
Sep 20 01:22:26.930165 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:26.929922    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2e7f4c4-e022-4015-b4ec-4128df9f52cc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a2e7f4c4-e022-4015-b4ec-4128df9f52cc" (UID: "a2e7f4c4-e022-4015-b4ec-4128df9f52cc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:22:26.930165 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:26.929947    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2e7f4c4-e022-4015-b4ec-4128df9f52cc-istiod-ca-cert\") pod \"a2e7f4c4-e022-4015-b4ec-4128df9f52cc\" (UID: \"a2e7f4c4-e022-4015-b4ec-4128df9f52cc\") "
Sep 20 01:22:26.930165 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:26.929948    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2e7f4c4-e022-4015-b4ec-4128df9f52cc-istio-data" (OuterVolumeSpecName: "istio-data") pod "a2e7f4c4-e022-4015-b4ec-4128df9f52cc" (UID: "a2e7f4c4-e022-4015-b4ec-4128df9f52cc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:22:26.930165 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:26.930121    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2e7f4c4-e022-4015-b4ec-4128df9f52cc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a2e7f4c4-e022-4015-b4ec-4128df9f52cc" (UID: "a2e7f4c4-e022-4015-b4ec-4128df9f52cc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:22:26.930466 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:26.930199    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2e7f4c4-e022-4015-b4ec-4128df9f52cc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a2e7f4c4-e022-4015-b4ec-4128df9f52cc" (UID: "a2e7f4c4-e022-4015-b4ec-4128df9f52cc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:22:26.930466 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:26.930323    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2e7f4c4-e022-4015-b4ec-4128df9f52cc-workload-socket\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:22:26.930466 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:26.930342    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a2e7f4c4-e022-4015-b4ec-4128df9f52cc-istio-data\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:22:26.930466 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:26.930357    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a2e7f4c4-e022-4015-b4ec-4128df9f52cc-credential-socket\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:22:26.930466 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:26.930361    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2e7f4c4-e022-4015-b4ec-4128df9f52cc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a2e7f4c4-e022-4015-b4ec-4128df9f52cc" (UID: "a2e7f4c4-e022-4015-b4ec-4128df9f52cc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:22:26.930466 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:26.930372    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a2e7f4c4-e022-4015-b4ec-4128df9f52cc-workload-certs\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:22:26.932187 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:26.932152    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2e7f4c4-e022-4015-b4ec-4128df9f52cc-istio-token" (OuterVolumeSpecName: "istio-token") pod "a2e7f4c4-e022-4015-b4ec-4128df9f52cc" (UID: "a2e7f4c4-e022-4015-b4ec-4128df9f52cc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:22:26.932297 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:26.932195    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2e7f4c4-e022-4015-b4ec-4128df9f52cc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a2e7f4c4-e022-4015-b4ec-4128df9f52cc" (UID: "a2e7f4c4-e022-4015-b4ec-4128df9f52cc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 20 01:22:26.932500 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:26.932473    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a2e7f4c4-e022-4015-b4ec-4128df9f52cc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a2e7f4c4-e022-4015-b4ec-4128df9f52cc" (UID: "a2e7f4c4-e022-4015-b4ec-4128df9f52cc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 20 01:22:26.932500 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:26.932477    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2e7f4c4-e022-4015-b4ec-4128df9f52cc-kube-api-access-4s7bp" (OuterVolumeSpecName: "kube-api-access-4s7bp") pod "a2e7f4c4-e022-4015-b4ec-4128df9f52cc" (UID: "a2e7f4c4-e022-4015-b4ec-4128df9f52cc"). InnerVolumeSpecName "kube-api-access-4s7bp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:22:27.031929 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:27.031889    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a2e7f4c4-e022-4015-b4ec-4128df9f52cc-istio-envoy\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:22:27.031929 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:27.031927    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a2e7f4c4-e022-4015-b4ec-4128df9f52cc-istio-token\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:22:27.031929 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:27.031940    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a2e7f4c4-e022-4015-b4ec-4128df9f52cc-istiod-ca-cert\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:22:27.032170 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:27.031952    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4s7bp\" (UniqueName: \"kubernetes.io/projected/a2e7f4c4-e022-4015-b4ec-4128df9f52cc-kube-api-access-4s7bp\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:22:27.032170 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:27.031965    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a2e7f4c4-e022-4015-b4ec-4128df9f52cc-istio-podinfo\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:22:27.213120 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:27.213025    2570 generic.go:356] "Generic (PLEG): container finished" podID="a2e7f4c4-e022-4015-b4ec-4128df9f52cc" containerID="2c87ce667de343f87a6bfd0104de29ab92c90683c7aa4539e556272ef8e0c65f" exitCode=0
Sep 20 01:22:27.213120 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:27.213068    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc" event={"ID":"a2e7f4c4-e022-4015-b4ec-4128df9f52cc","Type":"ContainerDied","Data":"2c87ce667de343f87a6bfd0104de29ab92c90683c7aa4539e556272ef8e0c65f"}
Sep 20 01:22:27.213120 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:27.213075    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc"
Sep 20 01:22:27.213120 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:27.213112    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc" event={"ID":"a2e7f4c4-e022-4015-b4ec-4128df9f52cc","Type":"ContainerDied","Data":"da88c5bd3fe147bb63234020d0c4008a475a7d5364cf8d7342fe5687cb062d14"}
Sep 20 01:22:27.213415 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:27.213136    2570 scope.go:117] "RemoveContainer" containerID="2c87ce667de343f87a6bfd0104de29ab92c90683c7aa4539e556272ef8e0c65f"
Sep 20 01:22:27.223481 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:27.223463    2570 scope.go:117] "RemoveContainer" containerID="9321b6d2ebff8e409ab5b99a2cd0d772c4559fff1e57a90cd734442a041c2f3f"
Sep 20 01:22:27.231825 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:27.231800    2570 scope.go:117] "RemoveContainer" containerID="2c87ce667de343f87a6bfd0104de29ab92c90683c7aa4539e556272ef8e0c65f"
Sep 20 01:22:27.232639 ip-10-0-132-108 kubenswrapper[2570]: E0920 01:22:27.232195    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c87ce667de343f87a6bfd0104de29ab92c90683c7aa4539e556272ef8e0c65f\": container with ID starting with 2c87ce667de343f87a6bfd0104de29ab92c90683c7aa4539e556272ef8e0c65f not found: ID does not exist" containerID="2c87ce667de343f87a6bfd0104de29ab92c90683c7aa4539e556272ef8e0c65f"
Sep 20 01:22:27.232639 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:27.232237    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c87ce667de343f87a6bfd0104de29ab92c90683c7aa4539e556272ef8e0c65f"} err="failed to get container status \"2c87ce667de343f87a6bfd0104de29ab92c90683c7aa4539e556272ef8e0c65f\": rpc error: code = NotFound desc = could not find container \"2c87ce667de343f87a6bfd0104de29ab92c90683c7aa4539e556272ef8e0c65f\": container with ID starting with 2c87ce667de343f87a6bfd0104de29ab92c90683c7aa4539e556272ef8e0c65f not found: ID does not exist"
Sep 20 01:22:27.232639 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:27.232270    2570 scope.go:117] "RemoveContainer" containerID="9321b6d2ebff8e409ab5b99a2cd0d772c4559fff1e57a90cd734442a041c2f3f"
Sep 20 01:22:27.232826 ip-10-0-132-108 kubenswrapper[2570]: E0920 01:22:27.232760    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9321b6d2ebff8e409ab5b99a2cd0d772c4559fff1e57a90cd734442a041c2f3f\": container with ID starting with 9321b6d2ebff8e409ab5b99a2cd0d772c4559fff1e57a90cd734442a041c2f3f not found: ID does not exist" containerID="9321b6d2ebff8e409ab5b99a2cd0d772c4559fff1e57a90cd734442a041c2f3f"
Sep 20 01:22:27.232826 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:27.232790    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9321b6d2ebff8e409ab5b99a2cd0d772c4559fff1e57a90cd734442a041c2f3f"} err="failed to get container status \"9321b6d2ebff8e409ab5b99a2cd0d772c4559fff1e57a90cd734442a041c2f3f\": rpc error: code = NotFound desc = could not find container \"9321b6d2ebff8e409ab5b99a2cd0d772c4559fff1e57a90cd734442a041c2f3f\": container with ID starting with 9321b6d2ebff8e409ab5b99a2cd0d772c4559fff1e57a90cd734442a041c2f3f not found: ID does not exist"
Sep 20 01:22:27.234838 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:27.234815    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc"]
Sep 20 01:22:27.239769 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:27.239746    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-4c93ee-openshift-default-5c898cc5f6-mdrjc"]
Sep 20 01:22:27.453778 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:27.453743    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2e7f4c4-e022-4015-b4ec-4128df9f52cc" path="/var/lib/kubelet/pods/a2e7f4c4-e022-4015-b4ec-4128df9f52cc/volumes"
Sep 20 01:22:45.604331 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:45.604303    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65l6f_bf898d8f-ed0f-4b4e-9a87-8e6167b29481/ovn-acl-logging/0.log"
Sep 20 01:22:45.606082 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:45.606061    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65l6f_bf898d8f-ed0f-4b4e-9a87-8e6167b29481/ovn-acl-logging/0.log"
Sep 20 01:22:45.994373 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:22:45.994345    2570 scope.go:117] "RemoveContainer" containerID="c4da5520a7ddbc6a2a9307f0f2c535d35b4e4a0faddcc03eb4913d281a86392e"
Sep 20 01:26:46.044717 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:26:46.044683    2570 scope.go:117] "RemoveContainer" containerID="98486659d43be5ec78c336f07cfac339d31998631bd37a52d9316de721cc4931"
Sep 20 01:27:45.637049 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:45.637022    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65l6f_bf898d8f-ed0f-4b4e-9a87-8e6167b29481/ovn-acl-logging/0.log"
Sep 20 01:27:45.638640 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:45.638622    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65l6f_bf898d8f-ed0f-4b4e-9a87-8e6167b29481/ovn-acl-logging/0.log"
Sep 20 01:27:46.064072 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:46.063990    2570 scope.go:117] "RemoveContainer" containerID="fdea47dc45a11c7364bd28eb526d20fec006e02413d601420cbf56c7e3a8b043"
Sep 20 01:27:51.298806 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:51.298770    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6bdc64f446-qnpxf"]
Sep 20 01:27:51.299210 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:51.299192    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eee1764e-bd4d-4d87-be3a-9f916ce0f06d" containerName="revoke-keys"
Sep 20 01:27:51.299210 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:51.299205    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="eee1764e-bd4d-4d87-be3a-9f916ce0f06d" containerName="revoke-keys"
Sep 20 01:27:51.299287 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:51.299223    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2e7f4c4-e022-4015-b4ec-4128df9f52cc" containerName="istio-proxy"
Sep 20 01:27:51.299287 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:51.299228    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2e7f4c4-e022-4015-b4ec-4128df9f52cc" containerName="istio-proxy"
Sep 20 01:27:51.299352 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:51.299293    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="eee1764e-bd4d-4d87-be3a-9f916ce0f06d" containerName="revoke-keys"
Sep 20 01:27:51.299352 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:51.299304    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2e7f4c4-e022-4015-b4ec-4128df9f52cc" containerName="istio-proxy"
Sep 20 01:27:51.299352 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:51.299311    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2e7f4c4-e022-4015-b4ec-4128df9f52cc" containerName="istio-proxy"
Sep 20 01:27:51.303758 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:51.303739    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6bdc64f446-qnpxf"
Sep 20 01:27:51.307462 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:51.307439    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 20 01:27:51.307603 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:51.307467    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 20 01:27:51.307603 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:51.307476    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9mf4b\""
Sep 20 01:27:51.307603 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:51.307496    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 20 01:27:51.308354 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:51.308337    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 20 01:27:51.325834 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:51.325807    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6bdc64f446-qnpxf"]
Sep 20 01:27:51.397848 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:51.397815    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4mvd\" (UniqueName: \"kubernetes.io/projected/9c7e6546-032f-4201-b757-435637369aee-kube-api-access-q4mvd\") pod \"maas-api-6bdc64f446-qnpxf\" (UID: \"9c7e6546-032f-4201-b757-435637369aee\") " pod="odh-ai-gateway-infra/maas-api-6bdc64f446-qnpxf"
Sep 20 01:27:51.398025 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:51.397889    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c7e6546-032f-4201-b757-435637369aee-metrics-certs\") pod \"maas-api-6bdc64f446-qnpxf\" (UID: \"9c7e6546-032f-4201-b757-435637369aee\") " pod="odh-ai-gateway-infra/maas-api-6bdc64f446-qnpxf"
Sep 20 01:27:51.398025 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:51.397956    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c7e6546-032f-4201-b757-435637369aee-maas-api-tls\") pod \"maas-api-6bdc64f446-qnpxf\" (UID: \"9c7e6546-032f-4201-b757-435637369aee\") " pod="odh-ai-gateway-infra/maas-api-6bdc64f446-qnpxf"
Sep 20 01:27:51.398110 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:51.398029    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c7e6546-032f-4201-b757-435637369aee-openshift-service-ca\") pod \"maas-api-6bdc64f446-qnpxf\" (UID: \"9c7e6546-032f-4201-b757-435637369aee\") " pod="odh-ai-gateway-infra/maas-api-6bdc64f446-qnpxf"
Sep 20 01:27:51.498793 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:51.498759    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c7e6546-032f-4201-b757-435637369aee-openshift-service-ca\") pod \"maas-api-6bdc64f446-qnpxf\" (UID: \"9c7e6546-032f-4201-b757-435637369aee\") " pod="odh-ai-gateway-infra/maas-api-6bdc64f446-qnpxf"
Sep 20 01:27:51.499011 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:51.498830    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4mvd\" (UniqueName: \"kubernetes.io/projected/9c7e6546-032f-4201-b757-435637369aee-kube-api-access-q4mvd\") pod \"maas-api-6bdc64f446-qnpxf\" (UID: \"9c7e6546-032f-4201-b757-435637369aee\") " pod="odh-ai-gateway-infra/maas-api-6bdc64f446-qnpxf"
Sep 20 01:27:51.499011 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:51.498911    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c7e6546-032f-4201-b757-435637369aee-metrics-certs\") pod \"maas-api-6bdc64f446-qnpxf\" (UID: \"9c7e6546-032f-4201-b757-435637369aee\") " pod="odh-ai-gateway-infra/maas-api-6bdc64f446-qnpxf"
Sep 20 01:27:51.499011 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:51.498941    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c7e6546-032f-4201-b757-435637369aee-maas-api-tls\") pod \"maas-api-6bdc64f446-qnpxf\" (UID: \"9c7e6546-032f-4201-b757-435637369aee\") " pod="odh-ai-gateway-infra/maas-api-6bdc64f446-qnpxf"
Sep 20 01:27:51.499402 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:51.499381    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c7e6546-032f-4201-b757-435637369aee-openshift-service-ca\") pod \"maas-api-6bdc64f446-qnpxf\" (UID: \"9c7e6546-032f-4201-b757-435637369aee\") " pod="odh-ai-gateway-infra/maas-api-6bdc64f446-qnpxf"
Sep 20 01:27:51.501492 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:51.501464    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c7e6546-032f-4201-b757-435637369aee-metrics-certs\") pod \"maas-api-6bdc64f446-qnpxf\" (UID: \"9c7e6546-032f-4201-b757-435637369aee\") " pod="odh-ai-gateway-infra/maas-api-6bdc64f446-qnpxf"
Sep 20 01:27:51.501583 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:51.501491    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c7e6546-032f-4201-b757-435637369aee-maas-api-tls\") pod \"maas-api-6bdc64f446-qnpxf\" (UID: \"9c7e6546-032f-4201-b757-435637369aee\") " pod="odh-ai-gateway-infra/maas-api-6bdc64f446-qnpxf"
Sep 20 01:27:51.506198 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:51.506174    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4mvd\" (UniqueName: \"kubernetes.io/projected/9c7e6546-032f-4201-b757-435637369aee-kube-api-access-q4mvd\") pod \"maas-api-6bdc64f446-qnpxf\" (UID: \"9c7e6546-032f-4201-b757-435637369aee\") " pod="odh-ai-gateway-infra/maas-api-6bdc64f446-qnpxf"
Sep 20 01:27:51.614133 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:51.614047    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6bdc64f446-qnpxf"
Sep 20 01:27:51.888121 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:51.888093    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6bdc64f446-qnpxf"]
Sep 20 01:27:51.889993 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:27:51.889966    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c7e6546_032f_4201_b757_435637369aee.slice/crio-00b3e5222cd1cef8559e1f730f26229a0dce5f6314475b06b046948e94066722 WatchSource:0}: Error finding container 00b3e5222cd1cef8559e1f730f26229a0dce5f6314475b06b046948e94066722: Status 404 returned error can't find the container with id 00b3e5222cd1cef8559e1f730f26229a0dce5f6314475b06b046948e94066722
Sep 20 01:27:51.891718 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:51.891699    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 20 01:27:52.837394 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:52.837350    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6bdc64f446-qnpxf" event={"ID":"9c7e6546-032f-4201-b757-435637369aee","Type":"ContainerStarted","Data":"00b3e5222cd1cef8559e1f730f26229a0dce5f6314475b06b046948e94066722"}
Sep 20 01:27:54.852163 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:54.852132    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6bdc64f446-qnpxf" event={"ID":"9c7e6546-032f-4201-b757-435637369aee","Type":"ContainerStarted","Data":"d0701de0eefe58894401c9c31afa8ac8fc417c6e26f2464c57cce88a313dcf7f"}
Sep 20 01:27:54.852549 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:54.852195    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6bdc64f446-qnpxf"
Sep 20 01:27:54.869474 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:54.869413    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6bdc64f446-qnpxf" podStartSLOduration=1.640889137 podStartE2EDuration="3.869398454s" totalImagesPullingTime="2.228509317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:27:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:27:54.867002301 +0000 UTC m=+2411.481158204" watchObservedRunningTime="2026-09-20 01:27:54.869398454 +0000 UTC m=+2411.483554352"
Sep 20 01:27:59.139000 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:59.138922    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6bdc64f446-qnpxf"]
Sep 20 01:27:59.139561 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:59.139113    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-6bdc64f446-qnpxf" podUID="9c7e6546-032f-4201-b757-435637369aee" containerName="maas-api" containerID="cri-o://d0701de0eefe58894401c9c31afa8ac8fc417c6e26f2464c57cce88a313dcf7f" gracePeriod=30
Sep 20 01:27:59.144468 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:59.144447    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6bdc64f446-qnpxf"
Sep 20 01:27:59.167947 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:59.167923    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-8469986cd6-sg78w"]
Sep 20 01:27:59.168319 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:59.168306    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2e7f4c4-e022-4015-b4ec-4128df9f52cc" containerName="istio-proxy"
Sep 20 01:27:59.168363 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:59.168321    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2e7f4c4-e022-4015-b4ec-4128df9f52cc" containerName="istio-proxy"
Sep 20 01:27:59.171426 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:59.171409    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8469986cd6-sg78w"
Sep 20 01:27:59.181508 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:59.181480    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-8469986cd6-sg78w"]
Sep 20 01:27:59.262192 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:59.262164    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/540acbb5-789f-4e3f-843e-ad8f3b2f1f9d-maas-api-tls\") pod \"maas-api-8469986cd6-sg78w\" (UID: \"540acbb5-789f-4e3f-843e-ad8f3b2f1f9d\") " pod="odh-ai-gateway-infra/maas-api-8469986cd6-sg78w"
Sep 20 01:27:59.262329 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:59.262265    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/540acbb5-789f-4e3f-843e-ad8f3b2f1f9d-openshift-service-ca\") pod \"maas-api-8469986cd6-sg78w\" (UID: \"540acbb5-789f-4e3f-843e-ad8f3b2f1f9d\") " pod="odh-ai-gateway-infra/maas-api-8469986cd6-sg78w"
Sep 20 01:27:59.262329 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:59.262301    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/540acbb5-789f-4e3f-843e-ad8f3b2f1f9d-metrics-certs\") pod \"maas-api-8469986cd6-sg78w\" (UID: \"540acbb5-789f-4e3f-843e-ad8f3b2f1f9d\") " pod="odh-ai-gateway-infra/maas-api-8469986cd6-sg78w"
Sep 20 01:27:59.262329 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:59.262326    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmpb4\" (UniqueName: \"kubernetes.io/projected/540acbb5-789f-4e3f-843e-ad8f3b2f1f9d-kube-api-access-lmpb4\") pod \"maas-api-8469986cd6-sg78w\" (UID: \"540acbb5-789f-4e3f-843e-ad8f3b2f1f9d\") " pod="odh-ai-gateway-infra/maas-api-8469986cd6-sg78w"
Sep 20 01:27:59.363392 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:59.363360    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/540acbb5-789f-4e3f-843e-ad8f3b2f1f9d-maas-api-tls\") pod \"maas-api-8469986cd6-sg78w\" (UID: \"540acbb5-789f-4e3f-843e-ad8f3b2f1f9d\") " pod="odh-ai-gateway-infra/maas-api-8469986cd6-sg78w"
Sep 20 01:27:59.363546 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:59.363455    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/540acbb5-789f-4e3f-843e-ad8f3b2f1f9d-openshift-service-ca\") pod \"maas-api-8469986cd6-sg78w\" (UID: \"540acbb5-789f-4e3f-843e-ad8f3b2f1f9d\") " pod="odh-ai-gateway-infra/maas-api-8469986cd6-sg78w"
Sep 20 01:27:59.363546 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:59.363491    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/540acbb5-789f-4e3f-843e-ad8f3b2f1f9d-metrics-certs\") pod \"maas-api-8469986cd6-sg78w\" (UID: \"540acbb5-789f-4e3f-843e-ad8f3b2f1f9d\") " pod="odh-ai-gateway-infra/maas-api-8469986cd6-sg78w"
Sep 20 01:27:59.363546 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:59.363529    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmpb4\" (UniqueName: \"kubernetes.io/projected/540acbb5-789f-4e3f-843e-ad8f3b2f1f9d-kube-api-access-lmpb4\") pod \"maas-api-8469986cd6-sg78w\" (UID: \"540acbb5-789f-4e3f-843e-ad8f3b2f1f9d\") " pod="odh-ai-gateway-infra/maas-api-8469986cd6-sg78w"
Sep 20 01:27:59.364291 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:59.364187    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/540acbb5-789f-4e3f-843e-ad8f3b2f1f9d-openshift-service-ca\") pod \"maas-api-8469986cd6-sg78w\" (UID: \"540acbb5-789f-4e3f-843e-ad8f3b2f1f9d\") " pod="odh-ai-gateway-infra/maas-api-8469986cd6-sg78w"
Sep 20 01:27:59.366148 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:59.366128    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/540acbb5-789f-4e3f-843e-ad8f3b2f1f9d-maas-api-tls\") pod \"maas-api-8469986cd6-sg78w\" (UID: \"540acbb5-789f-4e3f-843e-ad8f3b2f1f9d\") " pod="odh-ai-gateway-infra/maas-api-8469986cd6-sg78w"
Sep 20 01:27:59.366809 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:59.366786    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/540acbb5-789f-4e3f-843e-ad8f3b2f1f9d-metrics-certs\") pod \"maas-api-8469986cd6-sg78w\" (UID: \"540acbb5-789f-4e3f-843e-ad8f3b2f1f9d\") " pod="odh-ai-gateway-infra/maas-api-8469986cd6-sg78w"
Sep 20 01:27:59.371375 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:59.371353    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmpb4\" (UniqueName: \"kubernetes.io/projected/540acbb5-789f-4e3f-843e-ad8f3b2f1f9d-kube-api-access-lmpb4\") pod \"maas-api-8469986cd6-sg78w\" (UID: \"540acbb5-789f-4e3f-843e-ad8f3b2f1f9d\") " pod="odh-ai-gateway-infra/maas-api-8469986cd6-sg78w"
Sep 20 01:27:59.392265 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:59.392214    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6bdc64f446-qnpxf"
Sep 20 01:27:59.463782 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:59.463757    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4mvd\" (UniqueName: \"kubernetes.io/projected/9c7e6546-032f-4201-b757-435637369aee-kube-api-access-q4mvd\") pod \"9c7e6546-032f-4201-b757-435637369aee\" (UID: \"9c7e6546-032f-4201-b757-435637369aee\") "
Sep 20 01:27:59.463977 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:59.463811    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c7e6546-032f-4201-b757-435637369aee-maas-api-tls\") pod \"9c7e6546-032f-4201-b757-435637369aee\" (UID: \"9c7e6546-032f-4201-b757-435637369aee\") "
Sep 20 01:27:59.463977 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:59.463841    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c7e6546-032f-4201-b757-435637369aee-openshift-service-ca\") pod \"9c7e6546-032f-4201-b757-435637369aee\" (UID: \"9c7e6546-032f-4201-b757-435637369aee\") "
Sep 20 01:27:59.463977 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:59.463915    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c7e6546-032f-4201-b757-435637369aee-metrics-certs\") pod \"9c7e6546-032f-4201-b757-435637369aee\" (UID: \"9c7e6546-032f-4201-b757-435637369aee\") "
Sep 20 01:27:59.464292 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:59.464244    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c7e6546-032f-4201-b757-435637369aee-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9c7e6546-032f-4201-b757-435637369aee" (UID: "9c7e6546-032f-4201-b757-435637369aee"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 20 01:27:59.466549 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:59.466515    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c7e6546-032f-4201-b757-435637369aee-kube-api-access-q4mvd" (OuterVolumeSpecName: "kube-api-access-q4mvd") pod "9c7e6546-032f-4201-b757-435637369aee" (UID: "9c7e6546-032f-4201-b757-435637369aee"). InnerVolumeSpecName "kube-api-access-q4mvd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 20 01:27:59.466910 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:59.466829    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c7e6546-032f-4201-b757-435637369aee-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9c7e6546-032f-4201-b757-435637369aee" (UID: "9c7e6546-032f-4201-b757-435637369aee"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:27:59.467087 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:59.467063    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c7e6546-032f-4201-b757-435637369aee-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9c7e6546-032f-4201-b757-435637369aee" (UID: "9c7e6546-032f-4201-b757-435637369aee"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 20 01:27:59.536578 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:59.536551    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8469986cd6-sg78w"
Sep 20 01:27:59.564770 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:59.564738    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c7e6546-032f-4201-b757-435637369aee-maas-api-tls\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:27:59.564770 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:59.564771    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c7e6546-032f-4201-b757-435637369aee-openshift-service-ca\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:27:59.564956 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:59.564781    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c7e6546-032f-4201-b757-435637369aee-metrics-certs\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:27:59.564956 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:59.564789    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4mvd\" (UniqueName: \"kubernetes.io/projected/9c7e6546-032f-4201-b757-435637369aee-kube-api-access-q4mvd\") on node \"ip-10-0-132-108.ec2.internal\" DevicePath \"\""
Sep 20 01:27:59.808038 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:59.808016    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-8469986cd6-sg78w"]
Sep 20 01:27:59.810474 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:27:59.810445    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod540acbb5_789f_4e3f_843e_ad8f3b2f1f9d.slice/crio-6e0b3c4702cdb40b6b2b16bf815e750e644b17592d94a64e940a058d98734c2a WatchSource:0}: Error finding container 6e0b3c4702cdb40b6b2b16bf815e750e644b17592d94a64e940a058d98734c2a: Status 404 returned error can't find the container with id 6e0b3c4702cdb40b6b2b16bf815e750e644b17592d94a64e940a058d98734c2a
Sep 20 01:27:59.877700 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:59.877667    2570 generic.go:356] "Generic (PLEG): container finished" podID="9c7e6546-032f-4201-b757-435637369aee" containerID="d0701de0eefe58894401c9c31afa8ac8fc417c6e26f2464c57cce88a313dcf7f" exitCode=0
Sep 20 01:27:59.877901 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:59.877712    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6bdc64f446-qnpxf"
Sep 20 01:27:59.877901 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:59.877757    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6bdc64f446-qnpxf" event={"ID":"9c7e6546-032f-4201-b757-435637369aee","Type":"ContainerDied","Data":"d0701de0eefe58894401c9c31afa8ac8fc417c6e26f2464c57cce88a313dcf7f"}
Sep 20 01:27:59.877901 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:59.877816    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6bdc64f446-qnpxf" event={"ID":"9c7e6546-032f-4201-b757-435637369aee","Type":"ContainerDied","Data":"00b3e5222cd1cef8559e1f730f26229a0dce5f6314475b06b046948e94066722"}
Sep 20 01:27:59.877901 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:59.877846    2570 scope.go:117] "RemoveContainer" containerID="d0701de0eefe58894401c9c31afa8ac8fc417c6e26f2464c57cce88a313dcf7f"
Sep 20 01:27:59.879113 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:59.879092    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8469986cd6-sg78w" event={"ID":"540acbb5-789f-4e3f-843e-ad8f3b2f1f9d","Type":"ContainerStarted","Data":"6e0b3c4702cdb40b6b2b16bf815e750e644b17592d94a64e940a058d98734c2a"}
Sep 20 01:27:59.886659 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:59.886642    2570 scope.go:117] "RemoveContainer" containerID="d0701de0eefe58894401c9c31afa8ac8fc417c6e26f2464c57cce88a313dcf7f"
Sep 20 01:27:59.886956 ip-10-0-132-108 kubenswrapper[2570]: E0920 01:27:59.886930    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0701de0eefe58894401c9c31afa8ac8fc417c6e26f2464c57cce88a313dcf7f\": container with ID starting with d0701de0eefe58894401c9c31afa8ac8fc417c6e26f2464c57cce88a313dcf7f not found: ID does not exist" containerID="d0701de0eefe58894401c9c31afa8ac8fc417c6e26f2464c57cce88a313dcf7f"
Sep 20 01:27:59.887028 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:59.886958    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0701de0eefe58894401c9c31afa8ac8fc417c6e26f2464c57cce88a313dcf7f"} err="failed to get container status \"d0701de0eefe58894401c9c31afa8ac8fc417c6e26f2464c57cce88a313dcf7f\": rpc error: code = NotFound desc = could not find container \"d0701de0eefe58894401c9c31afa8ac8fc417c6e26f2464c57cce88a313dcf7f\": container with ID starting with d0701de0eefe58894401c9c31afa8ac8fc417c6e26f2464c57cce88a313dcf7f not found: ID does not exist"
Sep 20 01:27:59.897451 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:59.897417    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6bdc64f446-qnpxf"]
Sep 20 01:27:59.901285 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:27:59.901263    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-6bdc64f446-qnpxf"]
Sep 20 01:28:00.886133 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:00.886097    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8469986cd6-sg78w" event={"ID":"540acbb5-789f-4e3f-843e-ad8f3b2f1f9d","Type":"ContainerStarted","Data":"1bcf46e7d93377c77f934d4254d2a95614c260cbf4a6328420b45b17ad4d2eae"}
Sep 20 01:28:00.886532 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:00.886229    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-8469986cd6-sg78w"
Sep 20 01:28:00.902960 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:00.902901    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-8469986cd6-sg78w" podStartSLOduration=1.4276642210000001 podStartE2EDuration="1.902852402s" totalImagesPullingTime="475.188181ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-20 01:27:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:28:00.900811829 +0000 UTC m=+2417.514967725" watchObservedRunningTime="2026-09-20 01:28:00.902852402 +0000 UTC m=+2417.517008299"
Sep 20 01:28:01.454224 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:01.454192    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c7e6546-032f-4201-b757-435637369aee" path="/var/lib/kubelet/pods/9c7e6546-032f-4201-b757-435637369aee/volumes"
Sep 20 01:28:06.897079 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:06.897051    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-8469986cd6-sg78w"
Sep 20 01:28:29.630995 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:29.630965    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-z9sjt_5b08a46b-ee88-4021-ab05-fdcb2d511a7e/server/0.log"
Sep 20 01:28:29.751031 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:29.750989    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-hq79w_0ed3197a-8774-4834-804c-f5801f51efc3/manager/0.log"
Sep 20 01:28:29.856812 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:29.856762    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-99bfbc77d-2gx5n_7cf96de0-7b50-4f1c-9b86-a31dd87210d1/manager/0.log"
Sep 20 01:28:29.862129 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:29.862105    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-99bfbc77d-2gx5n_7cf96de0-7b50-4f1c-9b86-a31dd87210d1/copy-manifests/0.log"
Sep 20 01:28:30.550203 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:30.550176    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-8469986cd6-sg78w_540acbb5-789f-4e3f-843e-ad8f3b2f1f9d/maas-api/0.log"
Sep 20 01:28:30.656641 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:30.656604    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29831100-gxjsl_81a7c19b-8482-42e3-a0bf-64fd897c0fc0/cleanup/0.log"
Sep 20 01:28:30.758611 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:30.758581    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29831115-p66db_f77705c0-cff0-4f44-b1ee-2ee4568aec1e/cleanup/0.log"
Sep 20 01:28:32.727844 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:32.727818    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799c5hffd_e3fabcde-10b5-4503-b7f1-fc0904b1447f/istio-proxy/0.log"
Sep 20 01:28:32.842757 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:32.842729    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-mhxvq_236875ba-bff6-4596-b571-d694d3f72371/discovery/0.log"
Sep 20 01:28:33.313609 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:33.313581    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-chm2z_a4d97a9f-f7c2-4261-813d-60ecc6926d65/payload-pre-processing/0.log"
Sep 20 01:28:33.433444 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:33.433410    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-r26vb_9abb97c7-ec96-4d9f-a385-5b15a95ef793/payload-processing/0.log"
Sep 20 01:28:34.008809 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:34.008777    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-f72vk_0b2ebbab-42b7-4b76-a3e6-d93d398bbfce/main/0.log"
Sep 20 01:28:34.331240 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:34.331156    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjxbnr_6cf7874f-4e23-44b2-9da4-0e934c29f2de/main/0.log"
Sep 20 01:28:42.972736 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:42.972670    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9mws2_a588c630-f4a9-49b7-9ff1-1386742f40e3/global-pull-secret-syncer/0.log"
Sep 20 01:28:43.164797 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:43.164761    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-sd6xd_5cf64fad-2d77-43e8-a13d-fb2758010192/konnectivity-agent/0.log"
Sep 20 01:28:43.185991 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:43.185966    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-108.ec2.internal_1556c8746d3b9e131e1e9b890fd41c30/haproxy/0.log"
Sep 20 01:28:46.085379 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:46.085344    2570 scope.go:117] "RemoveContainer" containerID="5f170788a045879e30ebb2cc0872eb83b708215622bc0ca30f85c2485df5a164"
Sep 20 01:28:46.093957 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:46.093934    2570 scope.go:117] "RemoveContainer" containerID="e478450ec51b82b8ade8f75bb07ac4597a81064847f0f76d6775f09900fc00c9"
Sep 20 01:28:49.309403 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:49.309374    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ed29b1c6-f95d-4454-8e6e-4b175bde7d0c/alertmanager/0.log"
Sep 20 01:28:49.336990 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:49.336967    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ed29b1c6-f95d-4454-8e6e-4b175bde7d0c/config-reloader/0.log"
Sep 20 01:28:49.370460 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:49.370439    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ed29b1c6-f95d-4454-8e6e-4b175bde7d0c/kube-rbac-proxy-web/0.log"
Sep 20 01:28:49.390279 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:49.390255    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ed29b1c6-f95d-4454-8e6e-4b175bde7d0c/kube-rbac-proxy/0.log"
Sep 20 01:28:49.412009 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:49.411989    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ed29b1c6-f95d-4454-8e6e-4b175bde7d0c/kube-rbac-proxy-metric/0.log"
Sep 20 01:28:49.433610 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:49.433582    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ed29b1c6-f95d-4454-8e6e-4b175bde7d0c/prom-label-proxy/0.log"
Sep 20 01:28:49.459767 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:49.459753    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ed29b1c6-f95d-4454-8e6e-4b175bde7d0c/init-config-reloader/0.log"
Sep 20 01:28:49.529410 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:49.529381    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-9nmdf_c86586fe-ddbb-4bda-8f1d-51a41f70b978/kube-state-metrics/0.log"
Sep 20 01:28:49.549455 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:49.549423    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-9nmdf_c86586fe-ddbb-4bda-8f1d-51a41f70b978/kube-rbac-proxy-main/0.log"
Sep 20 01:28:49.568583 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:49.568526    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-9nmdf_c86586fe-ddbb-4bda-8f1d-51a41f70b978/kube-rbac-proxy-self/0.log"
Sep 20 01:28:49.594440 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:49.594422    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-68df66cd47-2gps6_937b56ff-1068-4a7c-83f4-549093b1bfc4/metrics-server/0.log"
Sep 20 01:28:49.719777 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:49.719748    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pjrnt_7208e8f8-14b5-4807-9033-030973fc1776/node-exporter/0.log"
Sep 20 01:28:49.743348 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:49.743323    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pjrnt_7208e8f8-14b5-4807-9033-030973fc1776/kube-rbac-proxy/0.log"
Sep 20 01:28:49.763562 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:49.763543    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pjrnt_7208e8f8-14b5-4807-9033-030973fc1776/init-textfile/0.log"
Sep 20 01:28:49.868230 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:49.868180    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-8l78p_b1493406-5ee3-4730-a7b5-fd36f59263d4/kube-rbac-proxy-main/0.log"
Sep 20 01:28:49.892777 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:49.892753    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-8l78p_b1493406-5ee3-4730-a7b5-fd36f59263d4/kube-rbac-proxy-self/0.log"
Sep 20 01:28:49.913852 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:49.913832    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-8l78p_b1493406-5ee3-4730-a7b5-fd36f59263d4/openshift-state-metrics/0.log"
Sep 20 01:28:50.179724 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:50.179644    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-gfrkj_199273a0-d5e1-42fa-94f4-57f2d74b06b6/prometheus-operator/0.log"
Sep 20 01:28:50.209330 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:50.209303    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-gfrkj_199273a0-d5e1-42fa-94f4-57f2d74b06b6/kube-rbac-proxy/0.log"
Sep 20 01:28:50.245071 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:50.245046    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5c6747dc7b-vjkqj_1171b65f-910d-410a-8004-d85fd9ef639c/prometheus-operator-admission-webhook/0.log"
Sep 20 01:28:50.306145 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:50.306115    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7874f84956-6dqrp_a0d4c4e8-4b0c-4618-8903-a0892659b76e/telemeter-client/0.log"
Sep 20 01:28:50.333435 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:50.333404    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7874f84956-6dqrp_a0d4c4e8-4b0c-4618-8903-a0892659b76e/reload/0.log"
Sep 20 01:28:50.357968 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:50.357951    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7874f84956-6dqrp_a0d4c4e8-4b0c-4618-8903-a0892659b76e/kube-rbac-proxy/0.log"
Sep 20 01:28:50.392662 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:50.392638    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85dc985d44-l9zh2_dc4e60f1-1008-4d97-b338-e095aa0b887d/thanos-query/0.log"
Sep 20 01:28:50.418310 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:50.418287    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85dc985d44-l9zh2_dc4e60f1-1008-4d97-b338-e095aa0b887d/kube-rbac-proxy-web/0.log"
Sep 20 01:28:50.437365 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:50.437304    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85dc985d44-l9zh2_dc4e60f1-1008-4d97-b338-e095aa0b887d/kube-rbac-proxy/0.log"
Sep 20 01:28:50.458117 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:50.458101    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85dc985d44-l9zh2_dc4e60f1-1008-4d97-b338-e095aa0b887d/prom-label-proxy/0.log"
Sep 20 01:28:50.479585 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:50.479561    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85dc985d44-l9zh2_dc4e60f1-1008-4d97-b338-e095aa0b887d/kube-rbac-proxy-rules/0.log"
Sep 20 01:28:50.498870 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:50.498849    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85dc985d44-l9zh2_dc4e60f1-1008-4d97-b338-e095aa0b887d/kube-rbac-proxy-metrics/0.log"
Sep 20 01:28:53.301060 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:53.301025    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-84494cccd-snf2k_4d3e0171-e6d1-4270-affb-7cca74ccab53/console/0.log"
Sep 20 01:28:53.328334 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:53.328299    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tjfsx/perf-node-gather-daemonset-s6sqj"]
Sep 20 01:28:53.328685 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:53.328672    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c7e6546-032f-4201-b757-435637369aee" containerName="maas-api"
Sep 20 01:28:53.328731 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:53.328687    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c7e6546-032f-4201-b757-435637369aee" containerName="maas-api"
Sep 20 01:28:53.328767 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:53.328762    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c7e6546-032f-4201-b757-435637369aee" containerName="maas-api"
Sep 20 01:28:53.333386 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:53.333367    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-s6sqj"
Sep 20 01:28:53.335461 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:53.335445    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tjfsx\"/\"openshift-service-ca.crt\""
Sep 20 01:28:53.336039 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:53.336024    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tjfsx\"/\"kube-root-ca.crt\""
Sep 20 01:28:53.336117 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:53.336103    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tjfsx\"/\"default-dockercfg-lzs5j\""
Sep 20 01:28:53.340398 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:53.340368    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tjfsx/perf-node-gather-daemonset-s6sqj"]
Sep 20 01:28:53.466467 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:53.466431    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/60e62f87-a030-4de6-a4fb-d7685a7998c4-podres\") pod \"perf-node-gather-daemonset-s6sqj\" (UID: \"60e62f87-a030-4de6-a4fb-d7685a7998c4\") " pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-s6sqj"
Sep 20 01:28:53.466644 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:53.466475    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/60e62f87-a030-4de6-a4fb-d7685a7998c4-sys\") pod \"perf-node-gather-daemonset-s6sqj\" (UID: \"60e62f87-a030-4de6-a4fb-d7685a7998c4\") " pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-s6sqj"
Sep 20 01:28:53.466644 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:53.466496    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/60e62f87-a030-4de6-a4fb-d7685a7998c4-proc\") pod \"perf-node-gather-daemonset-s6sqj\" (UID: \"60e62f87-a030-4de6-a4fb-d7685a7998c4\") " pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-s6sqj"
Sep 20 01:28:53.466644 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:53.466514    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/60e62f87-a030-4de6-a4fb-d7685a7998c4-lib-modules\") pod \"perf-node-gather-daemonset-s6sqj\" (UID: \"60e62f87-a030-4de6-a4fb-d7685a7998c4\") " pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-s6sqj"
Sep 20 01:28:53.466644 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:53.466580    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rx5b\" (UniqueName: \"kubernetes.io/projected/60e62f87-a030-4de6-a4fb-d7685a7998c4-kube-api-access-6rx5b\") pod \"perf-node-gather-daemonset-s6sqj\" (UID: \"60e62f87-a030-4de6-a4fb-d7685a7998c4\") " pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-s6sqj"
Sep 20 01:28:53.567600 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:53.567515    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/60e62f87-a030-4de6-a4fb-d7685a7998c4-podres\") pod \"perf-node-gather-daemonset-s6sqj\" (UID: \"60e62f87-a030-4de6-a4fb-d7685a7998c4\") " pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-s6sqj"
Sep 20 01:28:53.567600 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:53.567560    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/60e62f87-a030-4de6-a4fb-d7685a7998c4-sys\") pod \"perf-node-gather-daemonset-s6sqj\" (UID: \"60e62f87-a030-4de6-a4fb-d7685a7998c4\") " pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-s6sqj"
Sep 20 01:28:53.567600 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:53.567581    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/60e62f87-a030-4de6-a4fb-d7685a7998c4-proc\") pod \"perf-node-gather-daemonset-s6sqj\" (UID: \"60e62f87-a030-4de6-a4fb-d7685a7998c4\") " pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-s6sqj"
Sep 20 01:28:53.567835 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:53.567610    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/60e62f87-a030-4de6-a4fb-d7685a7998c4-lib-modules\") pod \"perf-node-gather-daemonset-s6sqj\" (UID: \"60e62f87-a030-4de6-a4fb-d7685a7998c4\") " pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-s6sqj"
Sep 20 01:28:53.567835 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:53.567651    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/60e62f87-a030-4de6-a4fb-d7685a7998c4-sys\") pod \"perf-node-gather-daemonset-s6sqj\" (UID: \"60e62f87-a030-4de6-a4fb-d7685a7998c4\") " pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-s6sqj"
Sep 20 01:28:53.567835 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:53.567666    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/60e62f87-a030-4de6-a4fb-d7685a7998c4-proc\") pod \"perf-node-gather-daemonset-s6sqj\" (UID: \"60e62f87-a030-4de6-a4fb-d7685a7998c4\") " pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-s6sqj"
Sep 20 01:28:53.567835 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:53.567681    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/60e62f87-a030-4de6-a4fb-d7685a7998c4-podres\") pod \"perf-node-gather-daemonset-s6sqj\" (UID: \"60e62f87-a030-4de6-a4fb-d7685a7998c4\") " pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-s6sqj"
Sep 20 01:28:53.567835 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:53.567683    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rx5b\" (UniqueName: \"kubernetes.io/projected/60e62f87-a030-4de6-a4fb-d7685a7998c4-kube-api-access-6rx5b\") pod \"perf-node-gather-daemonset-s6sqj\" (UID: \"60e62f87-a030-4de6-a4fb-d7685a7998c4\") " pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-s6sqj"
Sep 20 01:28:53.567835 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:53.567751    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/60e62f87-a030-4de6-a4fb-d7685a7998c4-lib-modules\") pod \"perf-node-gather-daemonset-s6sqj\" (UID: \"60e62f87-a030-4de6-a4fb-d7685a7998c4\") " pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-s6sqj"
Sep 20 01:28:53.574814 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:53.574797    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rx5b\" (UniqueName: \"kubernetes.io/projected/60e62f87-a030-4de6-a4fb-d7685a7998c4-kube-api-access-6rx5b\") pod \"perf-node-gather-daemonset-s6sqj\" (UID: \"60e62f87-a030-4de6-a4fb-d7685a7998c4\") " pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-s6sqj"
Sep 20 01:28:53.644112 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:53.644081    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-s6sqj"
Sep 20 01:28:53.911637 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:53.911611    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tjfsx/perf-node-gather-daemonset-s6sqj"]
Sep 20 01:28:53.914220 ip-10-0-132-108 kubenswrapper[2570]: W0920 01:28:53.914189    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod60e62f87_a030_4de6_a4fb_d7685a7998c4.slice/crio-4350361e6e540757c484dc2a74ae2dae78837ee7bc9a67a4426a0bbdc07d6572 WatchSource:0}: Error finding container 4350361e6e540757c484dc2a74ae2dae78837ee7bc9a67a4426a0bbdc07d6572: Status 404 returned error can't find the container with id 4350361e6e540757c484dc2a74ae2dae78837ee7bc9a67a4426a0bbdc07d6572
Sep 20 01:28:54.163782 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:54.163692    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-s6sqj" event={"ID":"60e62f87-a030-4de6-a4fb-d7685a7998c4","Type":"ContainerStarted","Data":"8491928d5eda68db4b453b13949230010b1f1685a5e308056f07bb7abc8e8401"}
Sep 20 01:28:54.163782 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:54.163746    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-s6sqj" event={"ID":"60e62f87-a030-4de6-a4fb-d7685a7998c4","Type":"ContainerStarted","Data":"4350361e6e540757c484dc2a74ae2dae78837ee7bc9a67a4426a0bbdc07d6572"}
Sep 20 01:28:54.163782 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:54.163766    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-s6sqj"
Sep 20 01:28:54.180403 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:54.180357    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-s6sqj" podStartSLOduration=1.180340007 podStartE2EDuration="1.180340007s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-20 01:28:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-20 01:28:54.179411764 +0000 UTC m=+2470.793567679" watchObservedRunningTime="2026-09-20 01:28:54.180340007 +0000 UTC m=+2470.794495905"
Sep 20 01:28:55.305959 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:55.305929    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qrjb2_7c4722ca-5852-4741-ac72-c7f9e17e4e70/dns/0.log"
Sep 20 01:28:55.324204 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:55.324181    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qrjb2_7c4722ca-5852-4741-ac72-c7f9e17e4e70/kube-rbac-proxy/0.log"
Sep 20 01:28:55.411366 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:55.411341    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7zwqs_a6a07188-d164-4385-8a38-35289b53a7be/dns-node-resolver/0.log"
Sep 20 01:28:56.032688 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:56.032650    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5f7zt_e543f7c5-f70d-49ab-877a-2ff1cf7d30c3/node-ca/0.log"
Sep 20 01:28:56.999446 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:56.999414    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799c5hffd_e3fabcde-10b5-4503-b7f1-fc0904b1447f/istio-proxy/0.log"
Sep 20 01:28:57.419236 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:57.419200    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-mhxvq_236875ba-bff6-4596-b571-d694d3f72371/discovery/0.log"
Sep 20 01:28:57.582714 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:57.582682    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-chm2z_a4d97a9f-f7c2-4261-813d-60ecc6926d65/payload-pre-processing/0.log"
Sep 20 01:28:57.612553 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:57.612529    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-r26vb_9abb97c7-ec96-4d9f-a385-5b15a95ef793/payload-processing/0.log"
Sep 20 01:28:58.523996 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:58.523967    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-chdwt_be4b8837-ac8d-4851-a2c5-40f016b30525/serve-healthcheck-canary/0.log"
Sep 20 01:28:59.154343 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:59.154313    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r6nc6_58c25490-b7ea-4685-b91e-3d9f0c365538/kube-rbac-proxy/0.log"
Sep 20 01:28:59.177430 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:59.177391    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r6nc6_58c25490-b7ea-4685-b91e-3d9f0c365538/exporter/0.log"
Sep 20 01:28:59.197199 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:28:59.197161    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r6nc6_58c25490-b7ea-4685-b91e-3d9f0c365538/extractor/0.log"
Sep 20 01:29:00.179687 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:29:00.179662    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-tjfsx/perf-node-gather-daemonset-s6sqj"
Sep 20 01:29:01.722378 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:29:01.722340    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-z9sjt_5b08a46b-ee88-4021-ab05-fdcb2d511a7e/server/0.log"
Sep 20 01:29:01.805069 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:29:01.805035    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-hq79w_0ed3197a-8774-4834-804c-f5801f51efc3/manager/0.log"
Sep 20 01:29:01.827677 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:29:01.827643    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-99bfbc77d-2gx5n_7cf96de0-7b50-4f1c-9b86-a31dd87210d1/manager/0.log"
Sep 20 01:29:01.847295 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:29:01.847270    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-99bfbc77d-2gx5n_7cf96de0-7b50-4f1c-9b86-a31dd87210d1/copy-manifests/0.log"
Sep 20 01:29:03.240004 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:29:03.239977    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-694bb85cb6-9526l_abc9afb9-c281-4164-b4f2-2ae7e9da1f35/manager/0.log"
Sep 20 01:29:03.750450 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:29:03.750426    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799c5hffd_e3fabcde-10b5-4503-b7f1-fc0904b1447f/istio-proxy/0.log"
Sep 20 01:29:04.172616 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:29:04.172581    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-mhxvq_236875ba-bff6-4596-b571-d694d3f72371/discovery/0.log"
Sep 20 01:29:04.250215 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:29:04.250139    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-chm2z_a4d97a9f-f7c2-4261-813d-60ecc6926d65/payload-pre-processing/0.log"
Sep 20 01:29:04.273960 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:29:04.273935    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-r26vb_9abb97c7-ec96-4d9f-a385-5b15a95ef793/payload-processing/0.log"
Sep 20 01:29:05.910496 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:29:05.910467    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799c5hffd_e3fabcde-10b5-4503-b7f1-fc0904b1447f/istio-proxy/0.log"
Sep 20 01:29:06.337814 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:29:06.337730    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-mhxvq_236875ba-bff6-4596-b571-d694d3f72371/discovery/0.log"
Sep 20 01:29:06.427288 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:29:06.427263    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-chm2z_a4d97a9f-f7c2-4261-813d-60ecc6926d65/payload-pre-processing/0.log"
Sep 20 01:29:06.451053 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:29:06.451032    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-r26vb_9abb97c7-ec96-4d9f-a385-5b15a95ef793/payload-processing/0.log"
Sep 20 01:29:10.072575 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:29:10.072544    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ghfbt_0922c703-f848-4c79-9355-82285e120a06/kube-multus-additional-cni-plugins/0.log"
Sep 20 01:29:10.091285 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:29:10.091263    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ghfbt_0922c703-f848-4c79-9355-82285e120a06/egress-router-binary-copy/0.log"
Sep 20 01:29:10.109464 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:29:10.109419    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ghfbt_0922c703-f848-4c79-9355-82285e120a06/cni-plugins/0.log"
Sep 20 01:29:10.127422 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:29:10.127398    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ghfbt_0922c703-f848-4c79-9355-82285e120a06/bond-cni-plugin/0.log"
Sep 20 01:29:10.148832 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:29:10.148816    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ghfbt_0922c703-f848-4c79-9355-82285e120a06/routeoverride-cni/0.log"
Sep 20 01:29:10.168973 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:29:10.168954    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ghfbt_0922c703-f848-4c79-9355-82285e120a06/whereabouts-cni-bincopy/0.log"
Sep 20 01:29:10.188839 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:29:10.188814    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ghfbt_0922c703-f848-4c79-9355-82285e120a06/whereabouts-cni/0.log"
Sep 20 01:29:10.518218 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:29:10.518188    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-hfwr4_93db881a-91b4-44c0-8725-bc9832172d1b/kube-multus/0.log"
Sep 20 01:29:10.574362 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:29:10.574338    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-94nzn_a0d1f872-b92c-4b72-bdee-a7ac18493d84/network-metrics-daemon/0.log"
Sep 20 01:29:10.589723 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:29:10.589699    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-94nzn_a0d1f872-b92c-4b72-bdee-a7ac18493d84/kube-rbac-proxy/0.log"
Sep 20 01:29:11.462672 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:29:11.462642    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65l6f_bf898d8f-ed0f-4b4e-9a87-8e6167b29481/ovn-controller/0.log"
Sep 20 01:29:11.477728 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:29:11.477707    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65l6f_bf898d8f-ed0f-4b4e-9a87-8e6167b29481/ovn-acl-logging/1.log"
Sep 20 01:29:11.478170 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:29:11.478155    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65l6f_bf898d8f-ed0f-4b4e-9a87-8e6167b29481/ovn-acl-logging/0.log"
Sep 20 01:29:11.493998 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:29:11.493979    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65l6f_bf898d8f-ed0f-4b4e-9a87-8e6167b29481/kube-rbac-proxy-node/0.log"
Sep 20 01:29:11.517654 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:29:11.517637    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65l6f_bf898d8f-ed0f-4b4e-9a87-8e6167b29481/kube-rbac-proxy-ovn-metrics/0.log"
Sep 20 01:29:11.537020 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:29:11.537000    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65l6f_bf898d8f-ed0f-4b4e-9a87-8e6167b29481/northd/0.log"
Sep 20 01:29:11.559049 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:29:11.559027    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65l6f_bf898d8f-ed0f-4b4e-9a87-8e6167b29481/nbdb/0.log"
Sep 20 01:29:11.578650 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:29:11.578630    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65l6f_bf898d8f-ed0f-4b4e-9a87-8e6167b29481/sbdb/0.log"
Sep 20 01:29:11.636841 ip-10-0-132-108 kubenswrapper[2570]: I0920 01:29:11.636817    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65l6f_bf898d8f-ed0f-4b4e-9a87-8e6167b29481/ovnkube-controller/0.log"