Sep 07 03:46:27.190825 ip-10-0-132-4 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 07 03:46:27.190838 ip-10-0-132-4 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 07 03:46:27.190848 ip-10-0-132-4 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 07 03:46:27.191163 ip-10-0-132-4 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 07 03:46:36.565590 ip-10-0-132-4 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 07 03:46:36.565605 ip-10-0-132-4 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 8a63ebccf8dc45b48bc3c62abbc01af8 --
Sep 07 03:48:16.578959 ip-10-0-132-4 systemd[1]: Starting Kubernetes Kubelet...
Sep 07 03:48:17.000894 ip-10-0-132-4 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 07 03:48:17.000894 ip-10-0-132-4 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 07 03:48:17.000894 ip-10-0-132-4 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 07 03:48:17.000894 ip-10-0-132-4 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 07 03:48:17.000894 ip-10-0-132-4 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 07 03:48:17.002051 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.001828    2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 07 03:48:17.006142 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006124    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 03:48:17.006142 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006140    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 03:48:17.006142 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006145    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 03:48:17.006142 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006149    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 03:48:17.006371 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006155    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 03:48:17.006371 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006159    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 03:48:17.006371 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006163    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 03:48:17.006371 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006167    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 03:48:17.006371 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006170    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 03:48:17.006371 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006173    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 03:48:17.006371 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006177    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 03:48:17.006371 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006181    2559 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 03:48:17.006371 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006186    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 03:48:17.006371 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006190    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 03:48:17.006371 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006194    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 03:48:17.006371 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006197    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 03:48:17.006371 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006201    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 03:48:17.006371 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006207    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 03:48:17.006371 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006215    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 03:48:17.006371 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006219    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 03:48:17.006371 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006224    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 03:48:17.006371 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006228    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 03:48:17.006371 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006232    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 03:48:17.007189 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006236    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 03:48:17.007189 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006240    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 03:48:17.007189 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006244    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 03:48:17.007189 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006248    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 03:48:17.007189 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006252    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 03:48:17.007189 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006257    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 03:48:17.007189 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006260    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 03:48:17.007189 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006265    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 03:48:17.007189 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006269    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 03:48:17.007189 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006273    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 03:48:17.007189 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006278    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 03:48:17.007189 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006282    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 03:48:17.007189 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006286    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 03:48:17.007189 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006290    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 03:48:17.007189 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006296    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 03:48:17.007189 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006302    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 03:48:17.007189 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006308    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 03:48:17.007189 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006314    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 03:48:17.007189 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006318    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 03:48:17.007189 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006322    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 03:48:17.007995 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006327    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 03:48:17.007995 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006330    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 03:48:17.007995 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006335    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 03:48:17.007995 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006339    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 03:48:17.007995 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006343    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 03:48:17.007995 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006347    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 03:48:17.007995 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006352    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 03:48:17.007995 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006356    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 03:48:17.007995 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006361    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 03:48:17.007995 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006365    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 03:48:17.007995 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006368    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 03:48:17.007995 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006372    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 03:48:17.007995 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006376    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 03:48:17.007995 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006380    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 03:48:17.007995 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006384    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 03:48:17.007995 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006389    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 03:48:17.007995 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006393    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 03:48:17.007995 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006397    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 03:48:17.007995 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006401    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 03:48:17.007995 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006405    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 03:48:17.008709 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006409    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 03:48:17.008709 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006413    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 03:48:17.008709 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006418    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 03:48:17.008709 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006422    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 03:48:17.008709 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006426    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 03:48:17.008709 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006432    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 03:48:17.008709 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006438    2559 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 03:48:17.008709 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006442    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 03:48:17.008709 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006447    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 03:48:17.008709 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006451    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 03:48:17.008709 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006455    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 03:48:17.008709 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006459    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 03:48:17.008709 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006463    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 03:48:17.008709 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006468    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 03:48:17.008709 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006472    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 03:48:17.008709 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006476    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 03:48:17.008709 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006480    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 03:48:17.008709 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006484    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 03:48:17.008709 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006491    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 03:48:17.009218 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006497    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 03:48:17.009218 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006501    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 03:48:17.009218 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006506    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 03:48:17.009218 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006511    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 03:48:17.009218 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006515    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 03:48:17.009218 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006519    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 03:48:17.009218 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006523    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 03:48:17.009218 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006527    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 03:48:17.009218 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006531    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 03:48:17.009218 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006535    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 03:48:17.009218 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006540    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 03:48:17.009218 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006544    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 03:48:17.009218 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006549    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 03:48:17.009218 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006553    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 03:48:17.009218 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006557    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 03:48:17.009218 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006561    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 03:48:17.009218 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.006565    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 03:48:17.009218 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009158    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 03:48:17.009218 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009171    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 03:48:17.009218 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009174    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 03:48:17.009754 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009177    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 03:48:17.009754 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009180    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 03:48:17.009754 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009183    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 03:48:17.009754 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009186    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 03:48:17.009754 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009188    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 03:48:17.009754 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009191    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 03:48:17.009754 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009195    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 03:48:17.009754 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009198    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 03:48:17.009754 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009200    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 03:48:17.009754 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009203    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 03:48:17.009754 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009206    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 03:48:17.009754 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009208    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 03:48:17.009754 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009211    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 03:48:17.009754 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009215    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 03:48:17.009754 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009219    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 03:48:17.009754 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009222    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 03:48:17.009754 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009225    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 03:48:17.009754 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009228    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 03:48:17.009754 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009231    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 03:48:17.009754 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009234    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 03:48:17.010276 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009236    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 03:48:17.010276 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009239    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 03:48:17.010276 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009243    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 03:48:17.010276 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009248    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 03:48:17.010276 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009250    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 03:48:17.010276 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009254    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 03:48:17.010276 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009257    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 03:48:17.010276 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009260    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 03:48:17.010276 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009262    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 03:48:17.010276 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009265    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 03:48:17.010276 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009268    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 03:48:17.010276 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009271    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 03:48:17.010276 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009275    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 03:48:17.010276 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009278    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 03:48:17.010276 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009281    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 03:48:17.010276 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009285    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 03:48:17.010276 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009288    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 03:48:17.010276 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009290    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 03:48:17.010276 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009293    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 03:48:17.010276 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009296    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 03:48:17.010789 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009298    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 03:48:17.010789 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009301    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 03:48:17.010789 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009304    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 03:48:17.010789 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009306    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 03:48:17.010789 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009309    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 03:48:17.010789 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009311    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 03:48:17.010789 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009314    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 03:48:17.010789 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009316    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 03:48:17.010789 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009319    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 03:48:17.010789 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009322    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 03:48:17.010789 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009325    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 03:48:17.010789 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009327    2559 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 03:48:17.010789 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009330    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 03:48:17.010789 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009332    2559 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 03:48:17.010789 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009335    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 03:48:17.010789 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009337    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 03:48:17.010789 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009340    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 03:48:17.010789 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009342    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 03:48:17.010789 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009345    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 03:48:17.010789 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009347    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 03:48:17.011297 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009350    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 03:48:17.011297 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009352    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 03:48:17.011297 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009355    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 03:48:17.011297 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009357    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 03:48:17.011297 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009361    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 03:48:17.011297 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009364    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 03:48:17.011297 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009367    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 03:48:17.011297 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009370    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 03:48:17.011297 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009373    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 03:48:17.011297 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009376    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 03:48:17.011297 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009379    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 03:48:17.011297 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009382    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 03:48:17.011297 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009384    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 03:48:17.011297 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009387    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 03:48:17.011297 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009389    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 03:48:17.011297 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009392    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 03:48:17.011297 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009394    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 03:48:17.011297 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009397    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 03:48:17.011297 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009399    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 03:48:17.011297 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009402    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 03:48:17.011807 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009406    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 03:48:17.011807 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009408    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 03:48:17.011807 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009411    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 03:48:17.011807 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009413    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 03:48:17.011807 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009416    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 03:48:17.011807 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009418    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 03:48:17.011807 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009421    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 03:48:17.011807 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009423    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 03:48:17.011807 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009426    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 03:48:17.011807 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009429    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 03:48:17.011807 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009432    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 03:48:17.011807 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009434    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 03:48:17.011807 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009437    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 03:48:17.011807 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009440    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 03:48:17.011807 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009442    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 03:48:17.011807 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009446    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 03:48:17.011807 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009826    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 03:48:17.011807 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009832    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 03:48:17.012255 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009835    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 03:48:17.012255 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009838    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 03:48:17.012255 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009840    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 03:48:17.012255 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009843    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 03:48:17.012255 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009846    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 03:48:17.012255 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009848    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 03:48:17.012255 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009851    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 03:48:17.012255 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009854    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 03:48:17.012255 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009856    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 03:48:17.012255 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009859    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 03:48:17.012255 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009861    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 03:48:17.012255 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009864    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 03:48:17.012255 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009866    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 03:48:17.012255 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009869    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 03:48:17.012255 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009872    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 03:48:17.012255 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009875    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 03:48:17.012255 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009878    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 03:48:17.012255 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009880    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 03:48:17.012255 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009883    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 03:48:17.012255 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009885    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 03:48:17.012763 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009888    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 03:48:17.012763 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009891    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 03:48:17.012763 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009894    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 03:48:17.012763 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009897    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 03:48:17.012763 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009900    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 03:48:17.012763 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009902    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 03:48:17.012763 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009905    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 03:48:17.012763 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009908    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 03:48:17.012763 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009910    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 03:48:17.012763 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009913    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 03:48:17.012763 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009917    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 03:48:17.012763 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009920    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 03:48:17.012763 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009923    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 03:48:17.012763 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009926    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 03:48:17.012763 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009929    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 03:48:17.012763 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009932    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 03:48:17.012763 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009935    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 03:48:17.012763 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009938    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 03:48:17.012763 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009940    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 03:48:17.012763 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009943    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 03:48:17.013259 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009946    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 03:48:17.013259 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009949    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 03:48:17.013259 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009951    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 03:48:17.013259 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009954    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 03:48:17.013259 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009956    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 03:48:17.013259 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009959    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 03:48:17.013259 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009961    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 03:48:17.013259 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009964    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 03:48:17.013259 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009967    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 03:48:17.013259 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009969    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 03:48:17.013259 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009972    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 03:48:17.013259 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009974    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 03:48:17.013259 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009977    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 03:48:17.013259 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009980    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 03:48:17.013259 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009984    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 03:48:17.013259 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009988    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 03:48:17.013259 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009991    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 03:48:17.013259 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009994    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 03:48:17.013259 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009996    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 03:48:17.013830 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.009999    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 03:48:17.013830 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010002    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 03:48:17.013830 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010004    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 03:48:17.013830 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010007    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 03:48:17.013830 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010009    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 03:48:17.013830 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010013    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 03:48:17.013830 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010016    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 03:48:17.013830 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010019    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 03:48:17.013830 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010021    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 03:48:17.013830 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010024    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 03:48:17.013830 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010027    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 03:48:17.013830 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010030    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 03:48:17.013830 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010032    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 03:48:17.013830 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010034    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 03:48:17.013830 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010037    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 03:48:17.013830 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010039    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 03:48:17.013830 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010042    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 03:48:17.013830 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010044    2559 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 03:48:17.013830 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010047    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 03:48:17.013830 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010049    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 03:48:17.014334 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010052    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 03:48:17.014334 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010055    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 03:48:17.014334 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010057    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 03:48:17.014334 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010059    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 03:48:17.014334 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010062    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 03:48:17.014334 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010064    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 03:48:17.014334 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010067    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 03:48:17.014334 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010074    2559 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 03:48:17.014334 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010082    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 03:48:17.014334 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010086    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 03:48:17.014334 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010088    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 03:48:17.014334 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010091    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 03:48:17.014334 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010094    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 03:48:17.014334 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010096    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 03:48:17.014334 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010099    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 03:48:17.014334 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010101    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 03:48:17.014334 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010104    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 03:48:17.014334 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010106    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 03:48:17.014334 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010181    2559 flags.go:64] FLAG: --address="0.0.0.0"
Sep 07 03:48:17.014334 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010218    2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 07 03:48:17.014334 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010225    2559 flags.go:64] FLAG: --anonymous-auth="true"
Sep 07 03:48:17.014910 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010230    2559 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 07 03:48:17.014910 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010239    2559 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 07 03:48:17.014910 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010243    2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 07 03:48:17.014910 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010251    2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 07 03:48:17.014910 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010255    2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 07 03:48:17.014910 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010258    2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 07 03:48:17.014910 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010262    2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 07 03:48:17.014910 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010265    2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 07 03:48:17.014910 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010268    2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 07 03:48:17.014910 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010272    2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 07 03:48:17.014910 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010275    2559 flags.go:64] FLAG: --cgroup-root=""
Sep 07 03:48:17.014910 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010277    2559 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 07 03:48:17.014910 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010281    2559 flags.go:64] FLAG: --client-ca-file=""
Sep 07 03:48:17.014910 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010284    2559 flags.go:64] FLAG: --cloud-provider="external"
Sep 07 03:48:17.014910 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010288    2559 flags.go:64] FLAG: --cluster-dns="[]"
Sep 07 03:48:17.014910 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010292    2559 flags.go:64] FLAG: --cluster-domain=""
Sep 07 03:48:17.014910 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010295    2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 07 03:48:17.014910 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010298    2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 07 03:48:17.014910 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010305    2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 07 03:48:17.014910 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010308    2559 flags.go:64] FLAG: --container-log-max-files="5"
Sep 07 03:48:17.014910 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010311    2559 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 07 03:48:17.014910 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010315    2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 07 03:48:17.014910 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010318    2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 07 03:48:17.015460 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010321    2559 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 07 03:48:17.015460 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010324    2559 flags.go:64] FLAG: --contention-profiling="false"
Sep 07 03:48:17.015460 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010328    2559 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 07 03:48:17.015460 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010331    2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 07 03:48:17.015460 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010334    2559 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 07 03:48:17.015460 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010337    2559 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 07 03:48:17.015460 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010341    2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 07 03:48:17.015460 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010344    2559 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 07 03:48:17.015460 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010347    2559 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 07 03:48:17.015460 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010350    2559 flags.go:64] FLAG: --enable-load-reader="false"
Sep 07 03:48:17.015460 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010352    2559 flags.go:64] FLAG: --enable-server="true"
Sep 07 03:48:17.015460 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010355    2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 07 03:48:17.015460 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010360    2559 flags.go:64] FLAG: --event-burst="100"
Sep 07 03:48:17.015460 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010363    2559 flags.go:64] FLAG: --event-qps="50"
Sep 07 03:48:17.015460 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010366    2559 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 07 03:48:17.015460 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010369    2559 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 07 03:48:17.015460 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010372    2559 flags.go:64] FLAG: --eviction-hard=""
Sep 07 03:48:17.015460 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010376    2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 07 03:48:17.015460 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010378    2559 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 07 03:48:17.015460 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010381    2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 07 03:48:17.015460 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010384    2559 flags.go:64] FLAG: --eviction-soft=""
Sep 07 03:48:17.015460 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010387    2559 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 07 03:48:17.015460 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010390    2559 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 07 03:48:17.015460 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010393    2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 07 03:48:17.015460 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010396    2559 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 07 03:48:17.016147 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010399    2559 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 07 03:48:17.016147 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010402    2559 flags.go:64] FLAG: --fail-swap-on="true"
Sep 07 03:48:17.016147 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010407    2559 flags.go:64] FLAG: --feature-gates=""
Sep 07 03:48:17.016147 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010411    2559 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 07 03:48:17.016147 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010414    2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 07 03:48:17.016147 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010417    2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 07 03:48:17.016147 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010420    2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 07 03:48:17.016147 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010423    2559 flags.go:64] FLAG: --healthz-port="10248"
Sep 07 03:48:17.016147 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010426    2559 flags.go:64] FLAG: --help="false"
Sep 07 03:48:17.016147 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010429    2559 flags.go:64] FLAG: --hostname-override="ip-10-0-132-4.ec2.internal"
Sep 07 03:48:17.016147 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010432    2559 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 07 03:48:17.016147 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010435    2559 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 07 03:48:17.016147 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010438    2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 07 03:48:17.016147 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010441    2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 07 03:48:17.016147 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010445    2559 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 07 03:48:17.016147 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010448    2559 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 07 03:48:17.016147 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010451    2559 flags.go:64] FLAG: --image-service-endpoint=""
Sep 07 03:48:17.016147 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010454    2559 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 07 03:48:17.016147 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010457    2559 flags.go:64] FLAG: --kube-api-burst="100"
Sep 07 03:48:17.016147 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010460    2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 07 03:48:17.016147 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010463    2559 flags.go:64] FLAG: --kube-api-qps="50"
Sep 07 03:48:17.016147 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010466    2559 flags.go:64] FLAG: --kube-reserved=""
Sep 07 03:48:17.016147 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010469    2559 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 07 03:48:17.016147 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010472    2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 07 03:48:17.016760 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010475    2559 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 07 03:48:17.016760 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010478    2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 07 03:48:17.016760 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010480    2559 flags.go:64] FLAG: --lock-file=""
Sep 07 03:48:17.016760 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010483    2559 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 07 03:48:17.016760 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010486    2559 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 07 03:48:17.016760 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010489    2559 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 07 03:48:17.016760 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010494    2559 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 07 03:48:17.016760 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010498    2559 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 07 03:48:17.016760 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010500    2559 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 07 03:48:17.016760 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010503    2559 flags.go:64] FLAG: --logging-format="text"
Sep 07 03:48:17.016760 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010509    2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 07 03:48:17.016760 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010513    2559 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 07 03:48:17.016760 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010515    2559 flags.go:64] FLAG: --manifest-url=""
Sep 07 03:48:17.016760 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010518    2559 flags.go:64] FLAG: --manifest-url-header=""
Sep 07 03:48:17.016760 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010523    2559 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 07 03:48:17.016760 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010526    2559 flags.go:64] FLAG: --max-open-files="1000000"
Sep 07 03:48:17.016760 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010530    2559 flags.go:64] FLAG: --max-pods="110"
Sep 07 03:48:17.016760 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010533    2559 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 07 03:48:17.016760 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010536    2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 07 03:48:17.016760 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010539    2559 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 07 03:48:17.016760 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010542    2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 07 03:48:17.016760 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010544    2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 07 03:48:17.016760 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010547    2559 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 07 03:48:17.016760 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010550    2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 07 03:48:17.016760 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010557    2559 flags.go:64] FLAG: --node-status-max-images="50"
Sep 07 03:48:17.017386 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010560    2559 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 07 03:48:17.017386 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010563    2559 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 07 03:48:17.017386 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010566    2559 flags.go:64] FLAG: --pod-cidr=""
Sep 07 03:48:17.017386 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010569    2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 07 03:48:17.017386 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010575    2559 flags.go:64] FLAG: --pod-manifest-path=""
Sep 07 03:48:17.017386 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010578    2559 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 07 03:48:17.017386 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010581    2559 flags.go:64] FLAG: --pods-per-core="0"
Sep 07 03:48:17.017386 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010584    2559 flags.go:64] FLAG: --port="10250"
Sep 07 03:48:17.017386 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010587    2559 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 07 03:48:17.017386 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010590    2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-038866540b4944fce"
Sep 07 03:48:17.017386 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010593    2559 flags.go:64] FLAG: --qos-reserved=""
Sep 07 03:48:17.017386 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010596    2559 flags.go:64] FLAG: --read-only-port="10255"
Sep 07 03:48:17.017386 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010599    2559 flags.go:64] FLAG: --register-node="true"
Sep 07 03:48:17.017386 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010601    2559 flags.go:64] FLAG: --register-with-taints=""
Sep 07 03:48:17.017386 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010605    2559 flags.go:64] FLAG: --registry-burst="10"
Sep 07 03:48:17.017386 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010608    2559 flags.go:64] FLAG: --registry-qps="5"
Sep 07 03:48:17.017386 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010611    2559 flags.go:64] FLAG: --reserved-cpus=""
Sep 07 03:48:17.017386 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010615    2559 flags.go:64] FLAG: --reserved-memory=""
Sep 07 03:48:17.017386 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010635    2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 07 03:48:17.017386 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010638    2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 07 03:48:17.017386 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010641    2559 flags.go:64] FLAG: --rotate-certificates="false"
Sep 07 03:48:17.017386 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010644    2559 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 07 03:48:17.017386 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010647    2559 flags.go:64] FLAG: --runonce="false"
Sep 07 03:48:17.017386 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010650    2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 07 03:48:17.017386 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010653    2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 07 03:48:17.018015 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010656    2559 flags.go:64] FLAG: --seccomp-default="false"
Sep 07 03:48:17.018015 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010659    2559 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 07 03:48:17.018015 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010662    2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 07 03:48:17.018015 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010665    2559 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 07 03:48:17.018015 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010668    2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 07 03:48:17.018015 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010671    2559 flags.go:64] FLAG: --storage-driver-password="root"
Sep 07 03:48:17.018015 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010674    2559 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 07 03:48:17.018015 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010677    2559 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 07 03:48:17.018015 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010680    2559 flags.go:64] FLAG: --storage-driver-user="root"
Sep 07 03:48:17.018015 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010683    2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 07 03:48:17.018015 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010686    2559 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 07 03:48:17.018015 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010689    2559 flags.go:64] FLAG: --system-cgroups=""
Sep 07 03:48:17.018015 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010692    2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 07 03:48:17.018015 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010697    2559 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 07 03:48:17.018015 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010699    2559 flags.go:64] FLAG: --tls-cert-file=""
Sep 07 03:48:17.018015 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010702    2559 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 07 03:48:17.018015 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010706    2559 flags.go:64] FLAG: --tls-min-version=""
Sep 07 03:48:17.018015 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010709    2559 flags.go:64] FLAG: --tls-private-key-file=""
Sep 07 03:48:17.018015 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010712    2559 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 07 03:48:17.018015 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010714    2559 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 07 03:48:17.018015 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010717    2559 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 07 03:48:17.018015 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010720    2559 flags.go:64] FLAG: --v="2"
Sep 07 03:48:17.018015 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010724    2559 flags.go:64] FLAG: --version="false"
Sep 07 03:48:17.018015 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010728    2559 flags.go:64] FLAG: --vmodule=""
Sep 07 03:48:17.018015 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010734    2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 07 03:48:17.018689 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.010739    2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 07 03:48:17.018689 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010845    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 03:48:17.018689 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010849    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 03:48:17.018689 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010853    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 03:48:17.018689 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010857    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 03:48:17.018689 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010861    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 03:48:17.018689 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010864    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 03:48:17.018689 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010867    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 03:48:17.018689 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010869    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 03:48:17.018689 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010872    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 03:48:17.018689 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010875    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 03:48:17.018689 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010877    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 03:48:17.018689 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010880    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 03:48:17.018689 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010883    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 03:48:17.018689 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010885    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 03:48:17.018689 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010888    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 03:48:17.018689 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010890    2559 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 03:48:17.018689 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010893    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 03:48:17.018689 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010895    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 03:48:17.018689 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010898    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 03:48:17.019188 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010900    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 03:48:17.019188 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010903    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 03:48:17.019188 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010905    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 03:48:17.019188 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010908    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 03:48:17.019188 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010910    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 03:48:17.019188 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010913    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 03:48:17.019188 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010915    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 03:48:17.019188 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010918    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 03:48:17.019188 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010920    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 03:48:17.019188 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010923    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 03:48:17.019188 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010925    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 03:48:17.019188 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010931    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 03:48:17.019188 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010936    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 03:48:17.019188 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010939    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 03:48:17.019188 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010942    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 03:48:17.019188 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010945    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 03:48:17.019188 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010947    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 03:48:17.019188 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010950    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 03:48:17.019188 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010953    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 03:48:17.019691 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010956    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 03:48:17.019691 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010958    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 03:48:17.019691 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010961    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 03:48:17.019691 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010964    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 03:48:17.019691 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010966    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 03:48:17.019691 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010969    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 03:48:17.019691 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010971    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 03:48:17.019691 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010974    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 03:48:17.019691 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010976    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 03:48:17.019691 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010979    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 03:48:17.019691 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010981    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 03:48:17.019691 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010984    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 03:48:17.019691 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010986    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 03:48:17.019691 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010989    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 03:48:17.019691 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010991    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 03:48:17.019691 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010994    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 03:48:17.019691 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010996    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 03:48:17.019691 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.010999    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 03:48:17.019691 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.011001    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 03:48:17.019691 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.011004    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 03:48:17.020200 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.011006    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 03:48:17.020200 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.011009    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 03:48:17.020200 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.011011    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 03:48:17.020200 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.011014    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 03:48:17.020200 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.011017    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 03:48:17.020200 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.011021    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 03:48:17.020200 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.011024    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 03:48:17.020200 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.011027    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 03:48:17.020200 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.011029    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 03:48:17.020200 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.011032    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 03:48:17.020200 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.011034    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 03:48:17.020200 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.011037    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 03:48:17.020200 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.011040    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 03:48:17.020200 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.011042    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 03:48:17.020200 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.011044    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 03:48:17.020200 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.011047    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 03:48:17.020200 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.011049    2559 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 03:48:17.020200 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.011052    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 03:48:17.020200 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.011054    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 03:48:17.020200 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.011057    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 03:48:17.020726 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.011059    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 03:48:17.020726 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.011062    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 03:48:17.020726 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.011064    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 03:48:17.020726 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.011067    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 03:48:17.020726 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.011069    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 03:48:17.020726 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.011073    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 03:48:17.020726 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.011077    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 03:48:17.020726 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.011080    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 03:48:17.020726 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.011083    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 03:48:17.020726 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.011085    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 03:48:17.020726 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.011088    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 03:48:17.020726 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.011091    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 03:48:17.020726 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.011094    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 03:48:17.020726 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.011096    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 03:48:17.020726 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.011099    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 03:48:17.020726 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.011101    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 03:48:17.020726 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.011106    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 03:48:17.020726 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.011110    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 03:48:17.020726 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.011113    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 03:48:17.021194 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.011116    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 03:48:17.021194 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.011118    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 03:48:17.021194 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.011997    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 07 03:48:17.021194 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.019613    2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 07 03:48:17.021194 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.019645    2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 07 03:48:17.021194 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.019666    2559 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 07 03:48:17.021194 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.019672    2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 07 03:48:17.021194 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019726    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 03:48:17.021194 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019732    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 03:48:17.021194 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019735    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 03:48:17.021194 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019738    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 03:48:17.021194 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019741    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 03:48:17.021194 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019743    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 03:48:17.021194 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019746    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 03:48:17.021194 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019749    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 03:48:17.021565 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019751    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 03:48:17.021565 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019754    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 03:48:17.021565 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019757    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 03:48:17.021565 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019759    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 03:48:17.021565 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019762    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 03:48:17.021565 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019765    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 03:48:17.021565 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019768    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 03:48:17.021565 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019770    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 03:48:17.021565 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019773    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 03:48:17.021565 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019775    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 03:48:17.021565 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019778    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 03:48:17.021565 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019781    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 03:48:17.021565 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019784    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 03:48:17.021565 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019786    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 03:48:17.021565 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019789    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 03:48:17.021565 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019792    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 03:48:17.021565 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019795    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 03:48:17.021565 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019798    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 03:48:17.021565 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019818    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 03:48:17.021565 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019823    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 03:48:17.022109 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019826    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 03:48:17.022109 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019829    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 03:48:17.022109 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019831    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 03:48:17.022109 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019834    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 03:48:17.022109 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019838    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 03:48:17.022109 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019841    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 03:48:17.022109 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019844    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 03:48:17.022109 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019846    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 03:48:17.022109 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019850    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 03:48:17.022109 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019852    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 03:48:17.022109 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019855    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 03:48:17.022109 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019857    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 03:48:17.022109 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019860    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 03:48:17.022109 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019863    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 03:48:17.022109 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019865    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 03:48:17.022109 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019868    2559 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 03:48:17.022109 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019870    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 03:48:17.022109 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019873    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 03:48:17.022109 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019875    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 03:48:17.022109 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019878    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 03:48:17.022603 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019881    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 03:48:17.022603 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019883    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 03:48:17.022603 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019886    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 03:48:17.022603 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019888    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 03:48:17.022603 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019891    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 03:48:17.022603 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019894    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 03:48:17.022603 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019896    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 03:48:17.022603 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019898    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 03:48:17.022603 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019901    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 03:48:17.022603 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019906    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 03:48:17.022603 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019910    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 03:48:17.022603 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019913    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 03:48:17.022603 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019915    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 03:48:17.022603 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019919    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 03:48:17.022603 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019922    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 03:48:17.022603 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019924    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 03:48:17.022603 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019927    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 03:48:17.022603 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019929    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 03:48:17.022603 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019932    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 03:48:17.022603 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019935    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 03:48:17.023093 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019938    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 03:48:17.023093 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019940    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 03:48:17.023093 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019943    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 03:48:17.023093 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019947    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 03:48:17.023093 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019950    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 03:48:17.023093 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019954    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 03:48:17.023093 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019957    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 03:48:17.023093 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019960    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 03:48:17.023093 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019963    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 03:48:17.023093 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019965    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 03:48:17.023093 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019968    2559 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 03:48:17.023093 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019971    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 03:48:17.023093 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019975    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 03:48:17.023093 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019978    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 03:48:17.023093 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019981    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 03:48:17.023093 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019984    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 03:48:17.023093 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019987    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 03:48:17.023093 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019989    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 03:48:17.023532 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019992    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 03:48:17.023532 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019994    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 03:48:17.023532 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.019997    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 03:48:17.023532 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020000    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 03:48:17.023532 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020003    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 03:48:17.023532 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020006    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 03:48:17.023532 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020009    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 03:48:17.023532 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020012    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 03:48:17.023532 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020015    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 03:48:17.023532 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020018    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 03:48:17.023532 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020021    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 03:48:17.023532 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020023    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 03:48:17.023532 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020026    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 03:48:17.023532 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.020031    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 07 03:48:17.023532 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020143    2559 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 03:48:17.023909 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020148    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 03:48:17.023909 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020151    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 03:48:17.023909 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020153    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 03:48:17.023909 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020157    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 03:48:17.023909 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020160    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 03:48:17.023909 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020162    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 03:48:17.023909 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020165    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 03:48:17.023909 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020167    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 03:48:17.023909 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020170    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 03:48:17.023909 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020172    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 03:48:17.023909 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020175    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 03:48:17.023909 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020177    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 03:48:17.023909 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020180    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 03:48:17.023909 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020182    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 03:48:17.023909 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020185    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 03:48:17.023909 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020187    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 03:48:17.023909 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020190    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 03:48:17.023909 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020192    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 03:48:17.023909 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020195    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 03:48:17.024360 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020197    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 03:48:17.024360 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020200    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 03:48:17.024360 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020202    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 03:48:17.024360 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020205    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 03:48:17.024360 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020208    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 03:48:17.024360 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020211    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 03:48:17.024360 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020214    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 03:48:17.024360 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020217    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 03:48:17.024360 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020220    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 03:48:17.024360 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020223    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 03:48:17.024360 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020226    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 03:48:17.024360 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020229    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 03:48:17.024360 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020232    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 03:48:17.024360 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020234    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 03:48:17.024360 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020237    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 03:48:17.024360 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020239    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 03:48:17.024360 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020242    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 03:48:17.024360 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020245    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 03:48:17.024360 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020247    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 03:48:17.024360 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020249    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 03:48:17.024938 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020252    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 03:48:17.024938 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020255    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 03:48:17.024938 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020257    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 03:48:17.024938 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020260    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 03:48:17.024938 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020262    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 03:48:17.024938 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020265    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 03:48:17.024938 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020268    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 03:48:17.024938 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020270    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 03:48:17.024938 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020273    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 03:48:17.024938 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020275    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 03:48:17.024938 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020277    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 03:48:17.024938 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020280    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 03:48:17.024938 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020282    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 03:48:17.024938 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020285    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 03:48:17.024938 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020287    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 03:48:17.024938 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020290    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 03:48:17.024938 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020297    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 03:48:17.024938 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020301    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 03:48:17.024938 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020304    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 03:48:17.024938 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020308    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 03:48:17.025421 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020311    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 03:48:17.025421 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020314    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 03:48:17.025421 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020317    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 03:48:17.025421 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020320    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 03:48:17.025421 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020322    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 03:48:17.025421 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020326    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 03:48:17.025421 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020329    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 03:48:17.025421 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020332    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 03:48:17.025421 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020335    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 03:48:17.025421 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020338    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 03:48:17.025421 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020340    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 03:48:17.025421 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020343    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 03:48:17.025421 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020346    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 03:48:17.025421 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020349    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 03:48:17.025421 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020352    2559 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 03:48:17.025421 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020355    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 03:48:17.025421 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020358    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 03:48:17.025421 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020360    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 03:48:17.025421 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020363    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 03:48:17.025902 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020366    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 03:48:17.025902 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020368    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 03:48:17.025902 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020371    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 03:48:17.025902 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020373    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 03:48:17.025902 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020376    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 03:48:17.025902 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020378    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 03:48:17.025902 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020381    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 03:48:17.025902 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020383    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 03:48:17.025902 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020386    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 03:48:17.025902 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020388    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 03:48:17.025902 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020391    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 03:48:17.025902 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020394    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 03:48:17.025902 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020396    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 03:48:17.025902 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020399    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 03:48:17.025902 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020402    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 03:48:17.025902 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020404    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 03:48:17.025902 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020407    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 03:48:17.025902 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020409    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 03:48:17.025902 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020411    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 03:48:17.025902 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:17.020414    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 03:48:17.026403 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.020418    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 07 03:48:17.026403 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.020511    2559 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 07 03:48:17.026403 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.023989    2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 07 03:48:17.026403 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.025034    2559 server.go:1019] "Starting client certificate rotation"
Sep 07 03:48:17.026403 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.025139    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 07 03:48:17.026403 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.025201    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 07 03:48:17.028130 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.028115    2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 07 03:48:17.029344 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.029326    2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 07 03:48:17.043439 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.043420    2559 log.go:25] "Validated CRI v1 runtime API"
Sep 07 03:48:17.048845 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.048830    2559 log.go:25] "Validated CRI v1 image API"
Sep 07 03:48:17.049723 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.049704    2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 07 03:48:17.053930 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.053913    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 07 03:48:17.055753 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.055736    2559 fs.go:135] Filesystem UUIDs: map[45c5cc3e-8916-439b-9dce-351ac6cfdd4b:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 7f5a78ef-dc40-4d15-b8fa-3b70bc24d5f3:/dev/nvme0n1p4]
Sep 07 03:48:17.055814 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.055753    2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 07 03:48:17.061835 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.061728    2559 manager.go:216] Machine: {Timestamp:2026-09-07 03:48:17.060301615 +0000 UTC m=+0.372777509 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3105797 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec285d5aa51d2a24707d36cad4436152 SystemUUID:ec285d5a-a51d-2a24-707d-36cad4436152 BootID:8a63ebcc-f8dc-45b4-8bc3-c62abbc01af8 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:81:64:9d:01:9f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:81:64:9d:01:9f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0a:77:6f:a0:17:00 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 07 03:48:17.061835 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.061830    2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 07 03:48:17.061950 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.061938    2559 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 07 03:48:17.065670 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.065648    2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 07 03:48:17.065798 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.065672    2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-4.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 07 03:48:17.066999 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.066989    2559 topology_manager.go:138] "Creating topology manager with none policy"
Sep 07 03:48:17.066999 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.067001    2559 container_manager_linux.go:309] "Creating device plugin manager"
Sep 07 03:48:17.067070 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.067008    2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 07 03:48:17.067824 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.067814    2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 07 03:48:17.069004 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.068994    2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 07 03:48:17.074550 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.074536    2559 state_mem.go:36] "Initialized new in-memory state store"
Sep 07 03:48:17.074677 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.074667    2559 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 07 03:48:17.074713 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.074697    2559 kubelet.go:486] "Attempting to sync node with API server"
Sep 07 03:48:17.074713 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.074707    2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 07 03:48:17.074770 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.074721    2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 07 03:48:17.074770 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.074732    2559 kubelet.go:398] "Adding apiserver pod source"
Sep 07 03:48:17.074770 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.074741    2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 07 03:48:17.075119 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.075100    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 07 03:48:17.075119 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.075120    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 07 03:48:17.078085 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.078062    2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 07 03:48:17.078996 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.078980    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-m67vs"
Sep 07 03:48:17.080909 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.080893    2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 07 03:48:17.080974 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.080923    2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 07 03:48:17.082419 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.082408    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 07 03:48:17.082456 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.082424    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 07 03:48:17.082456 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.082430    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 07 03:48:17.082456 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.082435    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 07 03:48:17.082456 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.082444    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 07 03:48:17.082456 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.082449    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 07 03:48:17.082592 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.082461    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 07 03:48:17.082592 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.082466    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 07 03:48:17.082592 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.082473    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 07 03:48:17.082592 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.082480    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 07 03:48:17.082592 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.082497    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 07 03:48:17.082592 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.082502    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 07 03:48:17.083394 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.083380    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 07 03:48:17.083394 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.083391    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 07 03:48:17.084508 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.084490    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-m67vs"
Sep 07 03:48:17.085459 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.085424    2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-4.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 07 03:48:17.085525 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:17.085471    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-4.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 07 03:48:17.085566 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:17.085513    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 07 03:48:17.087683 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.087670    2559 server.go:1268] "Started kubelet"
Sep 07 03:48:17.087918 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.087890    2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 07 03:48:17.087999 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.087899    2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 07 03:48:17.088122 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.088108    2559 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 07 03:48:17.088525 ip-10-0-132-4 systemd[1]: Started Kubernetes Kubelet.
Sep 07 03:48:17.091167 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.090887    2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 07 03:48:17.091705 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.091692    2559 server.go:310] "Adding debug handlers to kubelet server"
Sep 07 03:48:17.093576 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:17.093554    2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 07 03:48:17.098262 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.098240    2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 07 03:48:17.098262 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.098250    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 07 03:48:17.098408 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:17.098352    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-4.ec2.internal\" not found"
Sep 07 03:48:17.099037 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.099006    2559 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 07 03:48:17.099037 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.099026    2559 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 07 03:48:17.099181 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.099132    2559 reconstruct.go:97] "Volume reconstruction finished"
Sep 07 03:48:17.099181 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.099139    2559 reconciler.go:29] "Reconciler: start to sync state"
Sep 07 03:48:17.099181 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.099169    2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 07 03:48:17.100919 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.100688    2559 factory.go:55] Registering systemd factory
Sep 07 03:48:17.100919 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.100706    2559 factory.go:223] Registration of the systemd container factory successfully
Sep 07 03:48:17.101011 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.100979    2559 factory.go:153] Registering CRI-O factory
Sep 07 03:48:17.101011 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.100992    2559 factory.go:223] Registration of the crio container factory successfully
Sep 07 03:48:17.101091 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.101057    2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 07 03:48:17.101091 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.101081    2559 factory.go:103] Registering Raw factory
Sep 07 03:48:17.101165 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.101097    2559 manager.go:1196] Started watching for new ooms in manager
Sep 07 03:48:17.101530 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.101512    2559 manager.go:349] Starting recovery of all containers
Sep 07 03:48:17.103403 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.103379    2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 03:48:17.106048 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:17.106026    2559 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-132-4.ec2.internal\" not found" node="ip-10-0-132-4.ec2.internal"
Sep 07 03:48:17.113580 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.113564    2559 manager.go:354] Recovery completed
Sep 07 03:48:17.117710 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.117697    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 03:48:17.119271 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.119257    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 03:48:17.119342 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.119285    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 03:48:17.119342 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.119295    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasSufficientPID"
Sep 07 03:48:17.119834 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.119817    2559 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 07 03:48:17.119834 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.119831    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 03:48:17.119967 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.119833    2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 07 03:48:17.119967 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.119926    2559 state_mem.go:36] "Initialized new in-memory state store"
Sep 07 03:48:17.120538 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.120524    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 03:48:17.120589 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.120553    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 03:48:17.120589 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.120567    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasSufficientPID"
Sep 07 03:48:17.122042 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.122030    2559 policy_none.go:49] "None policy: Start"
Sep 07 03:48:17.122094 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.122046    2559 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 07 03:48:17.122094 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.122055    2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 07 03:48:17.123888 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.123877    2559 policy_none.go:47] "Start"
Sep 07 03:48:17.168306 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.168291    2559 manager.go:337] "Starting Device Plugin manager"
Sep 07 03:48:17.180157 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:17.168340    2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 07 03:48:17.180157 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.168353    2559 server.go:87] "Starting device plugin registration server"
Sep 07 03:48:17.180157 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.168598    2559 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 07 03:48:17.180157 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.168610    2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 07 03:48:17.180157 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.168807    2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 07 03:48:17.180157 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.168900    2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 07 03:48:17.180157 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.168909    2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 07 03:48:17.180157 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:17.169274    2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 07 03:48:17.180157 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:17.169314    2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-4.ec2.internal\" not found"
Sep 07 03:48:17.180157 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.169811    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 07 03:48:17.180157 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.172724    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 07 03:48:17.180157 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.172772    2559 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 07 03:48:17.180157 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.172797    2559 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 07 03:48:17.180157 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:17.172849    2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 07 03:48:17.180157 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.175442    2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 03:48:17.269060 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.268981    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 03:48:17.269863 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.269848    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 03:48:17.269951 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.269880    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 03:48:17.269951 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.269894    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasSufficientPID"
Sep 07 03:48:17.269951 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.269923    2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-4.ec2.internal"
Sep 07 03:48:17.272915 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.272899    2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-4.ec2.internal"]
Sep 07 03:48:17.272974 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.272962    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 03:48:17.274395 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.274380    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 03:48:17.274472 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.274407    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 03:48:17.274472 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.274422    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasSufficientPID"
Sep 07 03:48:17.276749 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.276733    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 03:48:17.276909 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.276893    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal"
Sep 07 03:48:17.276909 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.276930    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 03:48:17.277460 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.277442    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 03:48:17.277460 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.277456    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 03:48:17.277588 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.277473    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 03:48:17.277588 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.277487    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasSufficientPID"
Sep 07 03:48:17.277697 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.277477    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 03:48:17.277697 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.277608    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasSufficientPID"
Sep 07 03:48:17.279719 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.279705    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-4.ec2.internal"
Sep 07 03:48:17.279774 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.279729    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 03:48:17.279904 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.279892    2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-4.ec2.internal"
Sep 07 03:48:17.279948 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:17.279909    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-4.ec2.internal\": node \"ip-10-0-132-4.ec2.internal\" not found"
Sep 07 03:48:17.280429 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.280415    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 03:48:17.280493 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.280441    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 03:48:17.280493 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.280456    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeHasSufficientPID"
Sep 07 03:48:17.293174 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:17.293158    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-4.ec2.internal\" not found" node="ip-10-0-132-4.ec2.internal"
Sep 07 03:48:17.297114 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:17.297097    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-4.ec2.internal\" not found" node="ip-10-0-132-4.ec2.internal"
Sep 07 03:48:17.297209 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:17.297143    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-4.ec2.internal\" not found"
Sep 07 03:48:17.397469 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:17.397446    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-4.ec2.internal\" not found"
Sep 07 03:48:17.400738 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.400723    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b9f912e379492bbeba8124cc18d4ac87-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal\" (UID: \"b9f912e379492bbeba8124cc18d4ac87\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal"
Sep 07 03:48:17.400806 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.400745    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9f912e379492bbeba8124cc18d4ac87-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal\" (UID: \"b9f912e379492bbeba8124cc18d4ac87\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal"
Sep 07 03:48:17.400806 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.400763    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/136ee68bc096b03f0cd9fc22ad8e3b3c-config\") pod \"kube-apiserver-proxy-ip-10-0-132-4.ec2.internal\" (UID: \"136ee68bc096b03f0cd9fc22ad8e3b3c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-4.ec2.internal"
Sep 07 03:48:17.498555 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:17.498525    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-4.ec2.internal\" not found"
Sep 07 03:48:17.501798 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.501783    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b9f912e379492bbeba8124cc18d4ac87-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal\" (UID: \"b9f912e379492bbeba8124cc18d4ac87\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal"
Sep 07 03:48:17.501863 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.501805    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9f912e379492bbeba8124cc18d4ac87-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal\" (UID: \"b9f912e379492bbeba8124cc18d4ac87\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal"
Sep 07 03:48:17.501863 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.501829    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/136ee68bc096b03f0cd9fc22ad8e3b3c-config\") pod \"kube-apiserver-proxy-ip-10-0-132-4.ec2.internal\" (UID: \"136ee68bc096b03f0cd9fc22ad8e3b3c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-4.ec2.internal"
Sep 07 03:48:17.501955 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.501869    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/136ee68bc096b03f0cd9fc22ad8e3b3c-config\") pod \"kube-apiserver-proxy-ip-10-0-132-4.ec2.internal\" (UID: \"136ee68bc096b03f0cd9fc22ad8e3b3c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-4.ec2.internal"
Sep 07 03:48:17.501955 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.501897    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9f912e379492bbeba8124cc18d4ac87-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal\" (UID: \"b9f912e379492bbeba8124cc18d4ac87\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal"
Sep 07 03:48:17.501955 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.501907    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b9f912e379492bbeba8124cc18d4ac87-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal\" (UID: \"b9f912e379492bbeba8124cc18d4ac87\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal"
Sep 07 03:48:17.596240 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.596191    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal"
Sep 07 03:48:17.599336 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:17.599320    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-4.ec2.internal\" not found"
Sep 07 03:48:17.602329 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:17.602317    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-4.ec2.internal"
Sep 07 03:48:17.699522 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:17.699498    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-4.ec2.internal\" not found"
Sep 07 03:48:17.799944 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:17.799925    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-4.ec2.internal\" not found"
Sep 07 03:48:17.900328 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:17.900305    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-4.ec2.internal\" not found"
Sep 07 03:48:18.000800 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:18.000778    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-4.ec2.internal\" not found"
Sep 07 03:48:18.025080 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:18.025061    2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 07 03:48:18.025430 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:18.025225    2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 07 03:48:18.025430 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:18.025225    2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 07 03:48:18.090896 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:18.090721    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-06 03:43:17 +0000 UTC" deadline="2028-03-20 05:11:02.829594192 +0000 UTC"
Sep 07 03:48:18.090896 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:18.090894    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13441h22m44.738703741s"
Sep 07 03:48:18.099953 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:18.099934    2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 03:48:18.100911 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:18.100889    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-4.ec2.internal\" not found"
Sep 07 03:48:18.181891 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:18.181859    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9f912e379492bbeba8124cc18d4ac87.slice/crio-05191810b0eb705e679f64428016ed6483a7f3297accd99af643065e1cc28b80 WatchSource:0}: Error finding container 05191810b0eb705e679f64428016ed6483a7f3297accd99af643065e1cc28b80: Status 404 returned error can't find the container with id 05191810b0eb705e679f64428016ed6483a7f3297accd99af643065e1cc28b80
Sep 07 03:48:18.184965 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:18.184947    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 03:48:18.193085 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:18.193063    2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 03:48:18.198954 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:18.198934    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal"
Sep 07 03:48:18.210927 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:18.210911    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 07 03:48:18.212158 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:18.212145    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-4.ec2.internal"
Sep 07 03:48:18.221017 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:18.221001    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 07 03:48:18.843547 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:18.843512    2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 03:48:19.059212 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.058973    2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 03:48:19.075724 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.075681    2559 apiserver.go:52] "Watching apiserver"
Sep 07 03:48:19.083444 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.083420    2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 07 03:48:19.084896 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.084867    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-72b5b","openshift-multus/multus-additional-cni-plugins-g7mf6","openshift-multus/network-metrics-daemon-7rg9j","openshift-network-diagnostics/network-check-target-hvk8h","openshift-network-operator/iptables-alerter-sh9jc","kube-system/konnectivity-agent-jpqvg","openshift-cluster-node-tuning-operator/tuned-9wr6n","openshift-image-registry/node-ca-t7c8n","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal","openshift-multus/multus-9rxpx","openshift-ovn-kubernetes/ovnkube-node-pmq6m","kube-system/global-pull-secret-syncer-tdrdx","kube-system/kube-apiserver-proxy-ip-10-0-132-4.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8jm9"]
Sep 07 03:48:19.087595 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.087568    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9rxpx"
Sep 07 03:48:19.089799 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.089768    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 07 03:48:19.090014 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.089993    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 07 03:48:19.090094 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.090064    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 07 03:48:19.090305 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.090277    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qzxbr\""
Sep 07 03:48:19.090612 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.090586    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 07 03:48:19.092268 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.092245    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.094750 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.094512    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 07 03:48:19.094854 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.094777    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 07 03:48:19.095024 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.095007    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 07 03:48:19.095270 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.095252    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 07 03:48:19.095489 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.095469    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-t2p9j\""
Sep 07 03:48:19.095598 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.095523    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 07 03:48:19.095598 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.095515    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 07 03:48:19.095964 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.095844    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rg9j"
Sep 07 03:48:19.096383 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:19.096330    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rg9j" podUID="64880c7e-cc6b-462f-9d79-b9b6b48d34ca"
Sep 07 03:48:19.097720 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.097643    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8jm9"
Sep 07 03:48:19.099386 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.099363    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 07 03:48:19.099577 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.099557    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 07 03:48:19.099857 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.099836    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 07 03:48:19.100061 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.100043    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-j2hw7\""
Sep 07 03:48:19.100266 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.100248    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 07 03:48:19.101407 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.101238    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sh9jc"
Sep 07 03:48:19.102799 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.102781    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jpqvg"
Sep 07 03:48:19.103577 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.103556    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 07 03:48:19.103809 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.103782    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 07 03:48:19.104076 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.104057    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 07 03:48:19.104777 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.104758    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 07 03:48:19.104993 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.104974    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9hhbp\""
Sep 07 03:48:19.105293 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.105273    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 07 03:48:19.105584 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.105565    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-t7c8n"
Sep 07 03:48:19.106240 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.106219    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qqvgn\""
Sep 07 03:48:19.107668 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.107626    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 07 03:48:19.107792 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.107717    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 07 03:48:19.107981 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.107962    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dwtc8\""
Sep 07 03:48:19.108071 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.108029    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 07 03:48:19.108361 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.108342    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9wr6n"
Sep 07 03:48:19.109346 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.109289    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/02324c56-a65f-4119-89d6-b5d48a9d9609-agent-certs\") pod \"konnectivity-agent-jpqvg\" (UID: \"02324c56-a65f-4119-89d6-b5d48a9d9609\") " pod="kube-system/konnectivity-agent-jpqvg"
Sep 07 03:48:19.109346 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.109336    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9d48a665-e3f4-4f7e-9b28-462f9954f0de-cni-binary-copy\") pod \"multus-9rxpx\" (UID: \"9d48a665-e3f4-4f7e-9b28-462f9954f0de\") " pod="openshift-multus/multus-9rxpx"
Sep 07 03:48:19.109495 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.109374    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/83be5e03-f5e7-4c65-9fba-dcf128db003e-ovn-node-metrics-cert\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.109495 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.109400    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rmvx\" (UniqueName: \"kubernetes.io/projected/83be5e03-f5e7-4c65-9fba-dcf128db003e-kube-api-access-4rmvx\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.109495 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.109434    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6468e5c3-32f3-4466-9722-255ad1443e7e-device-dir\") pod \"aws-ebs-csi-driver-node-g8jm9\" (UID: \"6468e5c3-32f3-4466-9722-255ad1443e7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8jm9"
Sep 07 03:48:19.109495 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.109478    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9d48a665-e3f4-4f7e-9b28-462f9954f0de-host-var-lib-cni-multus\") pod \"multus-9rxpx\" (UID: \"9d48a665-e3f4-4f7e-9b28-462f9954f0de\") " pod="openshift-multus/multus-9rxpx"
Sep 07 03:48:19.109728 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.109505    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/83be5e03-f5e7-4c65-9fba-dcf128db003e-run-systemd\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.109728 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.109529    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/89014237-e2cf-4af2-a1cd-57be201b0001-iptables-alerter-script\") pod \"iptables-alerter-sh9jc\" (UID: \"89014237-e2cf-4af2-a1cd-57be201b0001\") " pod="openshift-network-operator/iptables-alerter-sh9jc"
Sep 07 03:48:19.109728 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.109567    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9d48a665-e3f4-4f7e-9b28-462f9954f0de-multus-socket-dir-parent\") pod \"multus-9rxpx\" (UID: \"9d48a665-e3f4-4f7e-9b28-462f9954f0de\") " pod="openshift-multus/multus-9rxpx"
Sep 07 03:48:19.109728 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.109603    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9d48a665-e3f4-4f7e-9b28-462f9954f0de-host-run-k8s-cni-cncf-io\") pod \"multus-9rxpx\" (UID: \"9d48a665-e3f4-4f7e-9b28-462f9954f0de\") " pod="openshift-multus/multus-9rxpx"
Sep 07 03:48:19.109728 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.109645    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9d48a665-e3f4-4f7e-9b28-462f9954f0de-host-run-netns\") pod \"multus-9rxpx\" (UID: \"9d48a665-e3f4-4f7e-9b28-462f9954f0de\") " pod="openshift-multus/multus-9rxpx"
Sep 07 03:48:19.109728 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.109670    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/83be5e03-f5e7-4c65-9fba-dcf128db003e-env-overrides\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.109728 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.109698    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64880c7e-cc6b-462f-9d79-b9b6b48d34ca-metrics-certs\") pod \"network-metrics-daemon-7rg9j\" (UID: \"64880c7e-cc6b-462f-9d79-b9b6b48d34ca\") " pod="openshift-multus/network-metrics-daemon-7rg9j"
Sep 07 03:48:19.109728 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.109727    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fk7b\" (UniqueName: \"kubernetes.io/projected/64880c7e-cc6b-462f-9d79-b9b6b48d34ca-kube-api-access-7fk7b\") pod \"network-metrics-daemon-7rg9j\" (UID: \"64880c7e-cc6b-462f-9d79-b9b6b48d34ca\") " pod="openshift-multus/network-metrics-daemon-7rg9j"
Sep 07 03:48:19.110171 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.109754    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg8vl\" (UniqueName: \"kubernetes.io/projected/6468e5c3-32f3-4466-9722-255ad1443e7e-kube-api-access-tg8vl\") pod \"aws-ebs-csi-driver-node-g8jm9\" (UID: \"6468e5c3-32f3-4466-9722-255ad1443e7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8jm9"
Sep 07 03:48:19.110171 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.109777    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83be5e03-f5e7-4c65-9fba-dcf128db003e-etc-openvswitch\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.110171 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.109801    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/02324c56-a65f-4119-89d6-b5d48a9d9609-konnectivity-ca\") pod \"konnectivity-agent-jpqvg\" (UID: \"02324c56-a65f-4119-89d6-b5d48a9d9609\") " pod="kube-system/konnectivity-agent-jpqvg"
Sep 07 03:48:19.110171 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.109823    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9d48a665-e3f4-4f7e-9b28-462f9954f0de-multus-cni-dir\") pod \"multus-9rxpx\" (UID: \"9d48a665-e3f4-4f7e-9b28-462f9954f0de\") " pod="openshift-multus/multus-9rxpx"
Sep 07 03:48:19.110171 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.109859    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9d48a665-e3f4-4f7e-9b28-462f9954f0de-multus-conf-dir\") pod \"multus-9rxpx\" (UID: \"9d48a665-e3f4-4f7e-9b28-462f9954f0de\") " pod="openshift-multus/multus-9rxpx"
Sep 07 03:48:19.110171 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.109884    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9d48a665-e3f4-4f7e-9b28-462f9954f0de-multus-daemon-config\") pod \"multus-9rxpx\" (UID: \"9d48a665-e3f4-4f7e-9b28-462f9954f0de\") " pod="openshift-multus/multus-9rxpx"
Sep 07 03:48:19.110171 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.109907    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d48a665-e3f4-4f7e-9b28-462f9954f0de-etc-kubernetes\") pod \"multus-9rxpx\" (UID: \"9d48a665-e3f4-4f7e-9b28-462f9954f0de\") " pod="openshift-multus/multus-9rxpx"
Sep 07 03:48:19.110171 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.109947    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pczd4\" (UniqueName: \"kubernetes.io/projected/9d48a665-e3f4-4f7e-9b28-462f9954f0de-kube-api-access-pczd4\") pod \"multus-9rxpx\" (UID: \"9d48a665-e3f4-4f7e-9b28-462f9954f0de\") " pod="openshift-multus/multus-9rxpx"
Sep 07 03:48:19.110171 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.109972    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/83be5e03-f5e7-4c65-9fba-dcf128db003e-host-run-netns\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.110171 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.110013    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9d48a665-e3f4-4f7e-9b28-462f9954f0de-host-run-multus-certs\") pod \"multus-9rxpx\" (UID: \"9d48a665-e3f4-4f7e-9b28-462f9954f0de\") " pod="openshift-multus/multus-9rxpx"
Sep 07 03:48:19.110171 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.110040    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/83be5e03-f5e7-4c65-9fba-dcf128db003e-host-slash\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.110171 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.110065    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83be5e03-f5e7-4c65-9fba-dcf128db003e-var-lib-openvswitch\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.110171 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.110088    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83be5e03-f5e7-4c65-9fba-dcf128db003e-run-openvswitch\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.110171 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.110111    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/83be5e03-f5e7-4c65-9fba-dcf128db003e-run-ovn\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.110171 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.110134    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/83be5e03-f5e7-4c65-9fba-dcf128db003e-host-cni-netd\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.111051 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.110186    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83be5e03-f5e7-4c65-9fba-dcf128db003e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.111051 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.110224    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/83be5e03-f5e7-4c65-9fba-dcf128db003e-ovnkube-script-lib\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.111051 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.110249    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9d48a665-e3f4-4f7e-9b28-462f9954f0de-hostroot\") pod \"multus-9rxpx\" (UID: \"9d48a665-e3f4-4f7e-9b28-462f9954f0de\") " pod="openshift-multus/multus-9rxpx"
Sep 07 03:48:19.111051 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.110295    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83be5e03-f5e7-4c65-9fba-dcf128db003e-host-run-ovn-kubernetes\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.111051 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.110351    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6468e5c3-32f3-4466-9722-255ad1443e7e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g8jm9\" (UID: \"6468e5c3-32f3-4466-9722-255ad1443e7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8jm9"
Sep 07 03:48:19.111051 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.110390    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6468e5c3-32f3-4466-9722-255ad1443e7e-etc-selinux\") pod \"aws-ebs-csi-driver-node-g8jm9\" (UID: \"6468e5c3-32f3-4466-9722-255ad1443e7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8jm9"
Sep 07 03:48:19.111051 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.110422    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9d48a665-e3f4-4f7e-9b28-462f9954f0de-host-var-lib-cni-bin\") pod \"multus-9rxpx\" (UID: \"9d48a665-e3f4-4f7e-9b28-462f9954f0de\") " pod="openshift-multus/multus-9rxpx"
Sep 07 03:48:19.111051 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.110456    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d48a665-e3f4-4f7e-9b28-462f9954f0de-host-var-lib-kubelet\") pod \"multus-9rxpx\" (UID: \"9d48a665-e3f4-4f7e-9b28-462f9954f0de\") " pod="openshift-multus/multus-9rxpx"
Sep 07 03:48:19.111051 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.110482    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 07 03:48:19.111051 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.110504    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/83be5e03-f5e7-4c65-9fba-dcf128db003e-systemd-units\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.111051 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.110533    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6468e5c3-32f3-4466-9722-255ad1443e7e-socket-dir\") pod \"aws-ebs-csi-driver-node-g8jm9\" (UID: \"6468e5c3-32f3-4466-9722-255ad1443e7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8jm9"
Sep 07 03:48:19.111051 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.110557    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6468e5c3-32f3-4466-9722-255ad1443e7e-registration-dir\") pod \"aws-ebs-csi-driver-node-g8jm9\" (UID: \"6468e5c3-32f3-4466-9722-255ad1443e7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8jm9"
Sep 07 03:48:19.111051 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.110580    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/89014237-e2cf-4af2-a1cd-57be201b0001-host-slash\") pod \"iptables-alerter-sh9jc\" (UID: \"89014237-e2cf-4af2-a1cd-57be201b0001\") " pod="openshift-network-operator/iptables-alerter-sh9jc"
Sep 07 03:48:19.111051 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.110628    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rktr4\" (UniqueName: \"kubernetes.io/projected/89014237-e2cf-4af2-a1cd-57be201b0001-kube-api-access-rktr4\") pod \"iptables-alerter-sh9jc\" (UID: \"89014237-e2cf-4af2-a1cd-57be201b0001\") " pod="openshift-network-operator/iptables-alerter-sh9jc"
Sep 07 03:48:19.111051 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.110654    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9d48a665-e3f4-4f7e-9b28-462f9954f0de-system-cni-dir\") pod \"multus-9rxpx\" (UID: \"9d48a665-e3f4-4f7e-9b28-462f9954f0de\") " pod="openshift-multus/multus-9rxpx"
Sep 07 03:48:19.111051 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.110678    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9d48a665-e3f4-4f7e-9b28-462f9954f0de-cnibin\") pod \"multus-9rxpx\" (UID: \"9d48a665-e3f4-4f7e-9b28-462f9954f0de\") " pod="openshift-multus/multus-9rxpx"
Sep 07 03:48:19.111051 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.110724    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/83be5e03-f5e7-4c65-9fba-dcf128db003e-host-kubelet\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.112019 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.110749    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/83be5e03-f5e7-4c65-9fba-dcf128db003e-node-log\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.112019 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.110772    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/83be5e03-f5e7-4c65-9fba-dcf128db003e-log-socket\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.112019 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.110796    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/83be5e03-f5e7-4c65-9fba-dcf128db003e-host-cni-bin\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.112019 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.110821    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/83be5e03-f5e7-4c65-9fba-dcf128db003e-ovnkube-config\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.112019 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.110845    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6468e5c3-32f3-4466-9722-255ad1443e7e-sys-fs\") pod \"aws-ebs-csi-driver-node-g8jm9\" (UID: \"6468e5c3-32f3-4466-9722-255ad1443e7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8jm9"
Sep 07 03:48:19.112019 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.110243    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8jhzj\""
Sep 07 03:48:19.112019 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.111083    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 07 03:48:19.112019 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.111284    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-72b5b"
Sep 07 03:48:19.113274 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.112957    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 07 03:48:19.113274 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.113092    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 07 03:48:19.113274 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.113265    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-g7mf6"
Sep 07 03:48:19.113274 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.113275    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ts8xw\""
Sep 07 03:48:19.113831 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.113804    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 07 03:48:19.115714 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.115680    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 07 03:48:19.116113 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.116093    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 07 03:48:19.116371 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.116351    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-25jrp\""
Sep 07 03:48:19.116602 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.116582    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdrdx"
Sep 07 03:48:19.116741 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:19.116652    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdrdx" podUID="078e2a74-a77c-42d5-941a-52e2b16a74ed"
Sep 07 03:48:19.118063 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.118042    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvk8h"
Sep 07 03:48:19.118182 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:19.118150    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvk8h" podUID="3ec3c1a7-cf5d-4e83-8497-f2c725850698"
Sep 07 03:48:19.140140 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.140094    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-tnlf9"
Sep 07 03:48:19.148501 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.148478    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-tnlf9"
Sep 07 03:48:19.182078 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.182026    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal" event={"ID":"b9f912e379492bbeba8124cc18d4ac87","Type":"ContainerStarted","Data":"05191810b0eb705e679f64428016ed6483a7f3297accd99af643065e1cc28b80"}
Sep 07 03:48:19.183470 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.183447    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-4.ec2.internal" event={"ID":"136ee68bc096b03f0cd9fc22ad8e3b3c","Type":"ContainerStarted","Data":"77b773becc371813a4ac12123e56b2064d8e4b72f13373b23bba63e3b6f6cee3"}
Sep 07 03:48:19.201061 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.201038    2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 07 03:48:19.211272 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.211246    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg8vl\" (UniqueName: \"kubernetes.io/projected/6468e5c3-32f3-4466-9722-255ad1443e7e-kube-api-access-tg8vl\") pod \"aws-ebs-csi-driver-node-g8jm9\" (UID: \"6468e5c3-32f3-4466-9722-255ad1443e7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8jm9"
Sep 07 03:48:19.211388 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.211291    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9a89adb7-9035-489e-8c69-72a65791ba9d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g7mf6\" (UID: \"9a89adb7-9035-489e-8c69-72a65791ba9d\") " pod="openshift-multus/multus-additional-cni-plugins-g7mf6"
Sep 07 03:48:19.211388 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.211321    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x75xx\" (UniqueName: \"kubernetes.io/projected/9a89adb7-9035-489e-8c69-72a65791ba9d-kube-api-access-x75xx\") pod \"multus-additional-cni-plugins-g7mf6\" (UID: \"9a89adb7-9035-489e-8c69-72a65791ba9d\") " pod="openshift-multus/multus-additional-cni-plugins-g7mf6"
Sep 07 03:48:19.211502 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.211386    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9d48a665-e3f4-4f7e-9b28-462f9954f0de-multus-conf-dir\") pod \"multus-9rxpx\" (UID: \"9d48a665-e3f4-4f7e-9b28-462f9954f0de\") " pod="openshift-multus/multus-9rxpx"
Sep 07 03:48:19.211502 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.211427    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/83be5e03-f5e7-4c65-9fba-dcf128db003e-host-run-netns\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.211502 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.211457    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83be5e03-f5e7-4c65-9fba-dcf128db003e-run-openvswitch\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.211502 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.211484    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/83be5e03-f5e7-4c65-9fba-dcf128db003e-ovnkube-script-lib\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.211736 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.211544    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/83be5e03-f5e7-4c65-9fba-dcf128db003e-host-run-netns\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.211736 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.211554    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83be5e03-f5e7-4c65-9fba-dcf128db003e-run-openvswitch\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.211736 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.211587    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9d48a665-e3f4-4f7e-9b28-462f9954f0de-multus-conf-dir\") pod \"multus-9rxpx\" (UID: \"9d48a665-e3f4-4f7e-9b28-462f9954f0de\") " pod="openshift-multus/multus-9rxpx"
Sep 07 03:48:19.211736 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.211597    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6468e5c3-32f3-4466-9722-255ad1443e7e-socket-dir\") pod \"aws-ebs-csi-driver-node-g8jm9\" (UID: \"6468e5c3-32f3-4466-9722-255ad1443e7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8jm9"
Sep 07 03:48:19.211736 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.211659    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9a89adb7-9035-489e-8c69-72a65791ba9d-cni-binary-copy\") pod \"multus-additional-cni-plugins-g7mf6\" (UID: \"9a89adb7-9035-489e-8c69-72a65791ba9d\") " pod="openshift-multus/multus-additional-cni-plugins-g7mf6"
Sep 07 03:48:19.211736 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.211689    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dfde1640-28bf-4ee0-94b0-62a6d26d04fe-run\") pod \"tuned-9wr6n\" (UID: \"dfde1640-28bf-4ee0-94b0-62a6d26d04fe\") " pod="openshift-cluster-node-tuning-operator/tuned-9wr6n"
Sep 07 03:48:19.211736 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.211720    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9d48a665-e3f4-4f7e-9b28-462f9954f0de-host-run-multus-certs\") pod \"multus-9rxpx\" (UID: \"9d48a665-e3f4-4f7e-9b28-462f9954f0de\") " pod="openshift-multus/multus-9rxpx"
Sep 07 03:48:19.211736 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.211730    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6468e5c3-32f3-4466-9722-255ad1443e7e-socket-dir\") pod \"aws-ebs-csi-driver-node-g8jm9\" (UID: \"6468e5c3-32f3-4466-9722-255ad1443e7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8jm9"
Sep 07 03:48:19.212207 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.211776    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9d48a665-e3f4-4f7e-9b28-462f9954f0de-host-run-multus-certs\") pod \"multus-9rxpx\" (UID: \"9d48a665-e3f4-4f7e-9b28-462f9954f0de\") " pod="openshift-multus/multus-9rxpx"
Sep 07 03:48:19.212207 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.211775    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/83be5e03-f5e7-4c65-9fba-dcf128db003e-run-ovn\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.212207 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.211808    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6468e5c3-32f3-4466-9722-255ad1443e7e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g8jm9\" (UID: \"6468e5c3-32f3-4466-9722-255ad1443e7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8jm9"
Sep 07 03:48:19.212207 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.211814    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/83be5e03-f5e7-4c65-9fba-dcf128db003e-run-ovn\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.212207 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.211833    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9dc17bd6-5586-49ea-a5d8-85860cad426f-hosts-file\") pod \"node-resolver-72b5b\" (UID: \"9dc17bd6-5586-49ea-a5d8-85860cad426f\") " pod="openshift-dns/node-resolver-72b5b"
Sep 07 03:48:19.212207 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.211860    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/078e2a74-a77c-42d5-941a-52e2b16a74ed-original-pull-secret\") pod \"global-pull-secret-syncer-tdrdx\" (UID: \"078e2a74-a77c-42d5-941a-52e2b16a74ed\") " pod="kube-system/global-pull-secret-syncer-tdrdx"
Sep 07 03:48:19.212207 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.211869    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6468e5c3-32f3-4466-9722-255ad1443e7e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g8jm9\" (UID: \"6468e5c3-32f3-4466-9722-255ad1443e7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8jm9"
Sep 07 03:48:19.212207 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.211887    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9d48a665-e3f4-4f7e-9b28-462f9954f0de-hostroot\") pod \"multus-9rxpx\" (UID: \"9d48a665-e3f4-4f7e-9b28-462f9954f0de\") " pod="openshift-multus/multus-9rxpx"
Sep 07 03:48:19.212207 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.211922    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83be5e03-f5e7-4c65-9fba-dcf128db003e-host-run-ovn-kubernetes\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.212207 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.211934    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9d48a665-e3f4-4f7e-9b28-462f9954f0de-hostroot\") pod \"multus-9rxpx\" (UID: \"9d48a665-e3f4-4f7e-9b28-462f9954f0de\") " pod="openshift-multus/multus-9rxpx"
Sep 07 03:48:19.212207 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.211944    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/078e2a74-a77c-42d5-941a-52e2b16a74ed-kubelet-config\") pod \"global-pull-secret-syncer-tdrdx\" (UID: \"078e2a74-a77c-42d5-941a-52e2b16a74ed\") " pod="kube-system/global-pull-secret-syncer-tdrdx"
Sep 07 03:48:19.212207 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.211961    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b0fedcd8-4974-4bf5-af6f-41711c6bbedd-host\") pod \"node-ca-t7c8n\" (UID: \"b0fedcd8-4974-4bf5-af6f-41711c6bbedd\") " pod="openshift-image-registry/node-ca-t7c8n"
Sep 07 03:48:19.212207 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.211977    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83be5e03-f5e7-4c65-9fba-dcf128db003e-host-run-ovn-kubernetes\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.212207 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.211986    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9d48a665-e3f4-4f7e-9b28-462f9954f0de-host-var-lib-cni-bin\") pod \"multus-9rxpx\" (UID: \"9d48a665-e3f4-4f7e-9b28-462f9954f0de\") " pod="openshift-multus/multus-9rxpx"
Sep 07 03:48:19.212207 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.212028    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d48a665-e3f4-4f7e-9b28-462f9954f0de-host-var-lib-kubelet\") pod \"multus-9rxpx\" (UID: \"9d48a665-e3f4-4f7e-9b28-462f9954f0de\") " pod="openshift-multus/multus-9rxpx"
Sep 07 03:48:19.212207 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.212051    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6468e5c3-32f3-4466-9722-255ad1443e7e-registration-dir\") pod \"aws-ebs-csi-driver-node-g8jm9\" (UID: \"6468e5c3-32f3-4466-9722-255ad1443e7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8jm9"
Sep 07 03:48:19.212207 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.212048    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9d48a665-e3f4-4f7e-9b28-462f9954f0de-host-var-lib-cni-bin\") pod \"multus-9rxpx\" (UID: \"9d48a665-e3f4-4f7e-9b28-462f9954f0de\") " pod="openshift-multus/multus-9rxpx"
Sep 07 03:48:19.212919 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.212091    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d48a665-e3f4-4f7e-9b28-462f9954f0de-host-var-lib-kubelet\") pod \"multus-9rxpx\" (UID: \"9d48a665-e3f4-4f7e-9b28-462f9954f0de\") " pod="openshift-multus/multus-9rxpx"
Sep 07 03:48:19.212919 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.212140    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6468e5c3-32f3-4466-9722-255ad1443e7e-registration-dir\") pod \"aws-ebs-csi-driver-node-g8jm9\" (UID: \"6468e5c3-32f3-4466-9722-255ad1443e7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8jm9"
Sep 07 03:48:19.212919 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.212164    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9d48a665-e3f4-4f7e-9b28-462f9954f0de-system-cni-dir\") pod \"multus-9rxpx\" (UID: \"9d48a665-e3f4-4f7e-9b28-462f9954f0de\") " pod="openshift-multus/multus-9rxpx"
Sep 07 03:48:19.212919 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.212199    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9d48a665-e3f4-4f7e-9b28-462f9954f0de-cnibin\") pod \"multus-9rxpx\" (UID: \"9d48a665-e3f4-4f7e-9b28-462f9954f0de\") " pod="openshift-multus/multus-9rxpx"
Sep 07 03:48:19.212919 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.212204    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/83be5e03-f5e7-4c65-9fba-dcf128db003e-ovnkube-script-lib\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.212919 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.212224    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/83be5e03-f5e7-4c65-9fba-dcf128db003e-host-kubelet\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.212919 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.212251    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/83be5e03-f5e7-4c65-9fba-dcf128db003e-log-socket\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.212919 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.212262    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9d48a665-e3f4-4f7e-9b28-462f9954f0de-cnibin\") pod \"multus-9rxpx\" (UID: \"9d48a665-e3f4-4f7e-9b28-462f9954f0de\") " pod="openshift-multus/multus-9rxpx"
Sep 07 03:48:19.212919 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.212276    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/83be5e03-f5e7-4c65-9fba-dcf128db003e-host-cni-bin\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.212919 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.212286    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9d48a665-e3f4-4f7e-9b28-462f9954f0de-system-cni-dir\") pod \"multus-9rxpx\" (UID: \"9d48a665-e3f4-4f7e-9b28-462f9954f0de\") " pod="openshift-multus/multus-9rxpx"
Sep 07 03:48:19.212919 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.212313    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/83be5e03-f5e7-4c65-9fba-dcf128db003e-host-cni-bin\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.212919 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.212314    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/83be5e03-f5e7-4c65-9fba-dcf128db003e-log-socket\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.212919 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.212323    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/83be5e03-f5e7-4c65-9fba-dcf128db003e-host-kubelet\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.212919 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.212313    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/83be5e03-f5e7-4c65-9fba-dcf128db003e-ovnkube-config\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.212919 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.212401    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6468e5c3-32f3-4466-9722-255ad1443e7e-sys-fs\") pod \"aws-ebs-csi-driver-node-g8jm9\" (UID: \"6468e5c3-32f3-4466-9722-255ad1443e7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8jm9"
Sep 07 03:48:19.212919 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.212429    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9dc17bd6-5586-49ea-a5d8-85860cad426f-tmp-dir\") pod \"node-resolver-72b5b\" (UID: \"9dc17bd6-5586-49ea-a5d8-85860cad426f\") " pod="openshift-dns/node-resolver-72b5b"
Sep 07 03:48:19.212919 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.212456    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9d48a665-e3f4-4f7e-9b28-462f9954f0de-cni-binary-copy\") pod \"multus-9rxpx\" (UID: \"9d48a665-e3f4-4f7e-9b28-462f9954f0de\") " pod="openshift-multus/multus-9rxpx"
Sep 07 03:48:19.212919 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.212484    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/83be5e03-f5e7-4c65-9fba-dcf128db003e-ovn-node-metrics-cert\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.213606 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.212497    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6468e5c3-32f3-4466-9722-255ad1443e7e-sys-fs\") pod \"aws-ebs-csi-driver-node-g8jm9\" (UID: \"6468e5c3-32f3-4466-9722-255ad1443e7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8jm9"
Sep 07 03:48:19.213606 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.212510    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rmvx\" (UniqueName: \"kubernetes.io/projected/83be5e03-f5e7-4c65-9fba-dcf128db003e-kube-api-access-4rmvx\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.213606 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.212577    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6468e5c3-32f3-4466-9722-255ad1443e7e-device-dir\") pod \"aws-ebs-csi-driver-node-g8jm9\" (UID: \"6468e5c3-32f3-4466-9722-255ad1443e7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8jm9"
Sep 07 03:48:19.213606 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.212604    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dfde1640-28bf-4ee0-94b0-62a6d26d04fe-etc-systemd\") pod \"tuned-9wr6n\" (UID: \"dfde1640-28bf-4ee0-94b0-62a6d26d04fe\") " pod="openshift-cluster-node-tuning-operator/tuned-9wr6n"
Sep 07 03:48:19.213606 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.212626    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dfde1640-28bf-4ee0-94b0-62a6d26d04fe-tmp\") pod \"tuned-9wr6n\" (UID: \"dfde1640-28bf-4ee0-94b0-62a6d26d04fe\") " pod="openshift-cluster-node-tuning-operator/tuned-9wr6n"
Sep 07 03:48:19.213606 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.212668    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/83be5e03-f5e7-4c65-9fba-dcf128db003e-run-systemd\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.213606 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.212696    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/89014237-e2cf-4af2-a1cd-57be201b0001-iptables-alerter-script\") pod \"iptables-alerter-sh9jc\" (UID: \"89014237-e2cf-4af2-a1cd-57be201b0001\") " pod="openshift-network-operator/iptables-alerter-sh9jc"
Sep 07 03:48:19.213606 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.212722    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dfde1640-28bf-4ee0-94b0-62a6d26d04fe-etc-kubernetes\") pod \"tuned-9wr6n\" (UID: \"dfde1640-28bf-4ee0-94b0-62a6d26d04fe\") " pod="openshift-cluster-node-tuning-operator/tuned-9wr6n"
Sep 07 03:48:19.213606 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.212747    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dfde1640-28bf-4ee0-94b0-62a6d26d04fe-etc-tuned\") pod \"tuned-9wr6n\" (UID: \"dfde1640-28bf-4ee0-94b0-62a6d26d04fe\") " pod="openshift-cluster-node-tuning-operator/tuned-9wr6n"
Sep 07 03:48:19.213606 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.212774    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9d48a665-e3f4-4f7e-9b28-462f9954f0de-host-run-netns\") pod \"multus-9rxpx\" (UID: \"9d48a665-e3f4-4f7e-9b28-462f9954f0de\") " pod="openshift-multus/multus-9rxpx"
Sep 07 03:48:19.213606 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.212801    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/83be5e03-f5e7-4c65-9fba-dcf128db003e-env-overrides\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.213606 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.212826    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64880c7e-cc6b-462f-9d79-b9b6b48d34ca-metrics-certs\") pod \"network-metrics-daemon-7rg9j\" (UID: \"64880c7e-cc6b-462f-9d79-b9b6b48d34ca\") " pod="openshift-multus/network-metrics-daemon-7rg9j"
Sep 07 03:48:19.213606 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.212837    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/83be5e03-f5e7-4c65-9fba-dcf128db003e-ovnkube-config\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.213606 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.212850    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9a89adb7-9035-489e-8c69-72a65791ba9d-cnibin\") pod \"multus-additional-cni-plugins-g7mf6\" (UID: \"9a89adb7-9035-489e-8c69-72a65791ba9d\") " pod="openshift-multus/multus-additional-cni-plugins-g7mf6"
Sep 07 03:48:19.213606 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.212878    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9a89adb7-9035-489e-8c69-72a65791ba9d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g7mf6\" (UID: \"9a89adb7-9035-489e-8c69-72a65791ba9d\") " pod="openshift-multus/multus-additional-cni-plugins-g7mf6"
Sep 07 03:48:19.213606 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.212882    2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 07 03:48:19.213606 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.212923    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83be5e03-f5e7-4c65-9fba-dcf128db003e-etc-openvswitch\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.214350 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.212951    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/02324c56-a65f-4119-89d6-b5d48a9d9609-konnectivity-ca\") pod \"konnectivity-agent-jpqvg\" (UID: \"02324c56-a65f-4119-89d6-b5d48a9d9609\") " pod="kube-system/konnectivity-agent-jpqvg"
Sep 07 03:48:19.214350 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.212976    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9d48a665-e3f4-4f7e-9b28-462f9954f0de-multus-cni-dir\") pod \"multus-9rxpx\" (UID: \"9d48a665-e3f4-4f7e-9b28-462f9954f0de\") " pod="openshift-multus/multus-9rxpx"
Sep 07 03:48:19.214350 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.213001    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9d48a665-e3f4-4f7e-9b28-462f9954f0de-multus-daemon-config\") pod \"multus-9rxpx\" (UID: \"9d48a665-e3f4-4f7e-9b28-462f9954f0de\") " pod="openshift-multus/multus-9rxpx"
Sep 07 03:48:19.214350 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.213036    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9d48a665-e3f4-4f7e-9b28-462f9954f0de-cni-binary-copy\") pod \"multus-9rxpx\" (UID: \"9d48a665-e3f4-4f7e-9b28-462f9954f0de\") " pod="openshift-multus/multus-9rxpx"
Sep 07 03:48:19.214350 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.213031    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d48a665-e3f4-4f7e-9b28-462f9954f0de-etc-kubernetes\") pod \"multus-9rxpx\" (UID: \"9d48a665-e3f4-4f7e-9b28-462f9954f0de\") " pod="openshift-multus/multus-9rxpx"
Sep 07 03:48:19.214350 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.213075    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pczd4\" (UniqueName: \"kubernetes.io/projected/9d48a665-e3f4-4f7e-9b28-462f9954f0de-kube-api-access-pczd4\") pod \"multus-9rxpx\" (UID: \"9d48a665-e3f4-4f7e-9b28-462f9954f0de\") " pod="openshift-multus/multus-9rxpx"
Sep 07 03:48:19.214350 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.213115    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83be5e03-f5e7-4c65-9fba-dcf128db003e-var-lib-openvswitch\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.214350 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.213142    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83be5e03-f5e7-4c65-9fba-dcf128db003e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.214350 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.213168    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/83be5e03-f5e7-4c65-9fba-dcf128db003e-host-slash\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.214350 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.213192    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/83be5e03-f5e7-4c65-9fba-dcf128db003e-host-cni-netd\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.214350 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.213218    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6468e5c3-32f3-4466-9722-255ad1443e7e-etc-selinux\") pod \"aws-ebs-csi-driver-node-g8jm9\" (UID: \"6468e5c3-32f3-4466-9722-255ad1443e7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8jm9"
Sep 07 03:48:19.214350 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.213251    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpm8n\" (UniqueName: \"kubernetes.io/projected/b0fedcd8-4974-4bf5-af6f-41711c6bbedd-kube-api-access-vpm8n\") pod \"node-ca-t7c8n\" (UID: \"b0fedcd8-4974-4bf5-af6f-41711c6bbedd\") " pod="openshift-image-registry/node-ca-t7c8n"
Sep 07 03:48:19.214350 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.213277    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dfde1640-28bf-4ee0-94b0-62a6d26d04fe-etc-modprobe-d\") pod \"tuned-9wr6n\" (UID: \"dfde1640-28bf-4ee0-94b0-62a6d26d04fe\") " pod="openshift-cluster-node-tuning-operator/tuned-9wr6n"
Sep 07 03:48:19.214350 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.213301    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dfde1640-28bf-4ee0-94b0-62a6d26d04fe-var-lib-kubelet\") pod \"tuned-9wr6n\" (UID: \"dfde1640-28bf-4ee0-94b0-62a6d26d04fe\") " pod="openshift-cluster-node-tuning-operator/tuned-9wr6n"
Sep 07 03:48:19.214350 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.213311    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6468e5c3-32f3-4466-9722-255ad1443e7e-device-dir\") pod \"aws-ebs-csi-driver-node-g8jm9\" (UID: \"6468e5c3-32f3-4466-9722-255ad1443e7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8jm9"
Sep 07 03:48:19.214350 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.213327    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjh22\" (UniqueName: \"kubernetes.io/projected/dfde1640-28bf-4ee0-94b0-62a6d26d04fe-kube-api-access-fjh22\") pod \"tuned-9wr6n\" (UID: \"dfde1640-28bf-4ee0-94b0-62a6d26d04fe\") " pod="openshift-cluster-node-tuning-operator/tuned-9wr6n"
Sep 07 03:48:19.214350 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.213341    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/89014237-e2cf-4af2-a1cd-57be201b0001-iptables-alerter-script\") pod \"iptables-alerter-sh9jc\" (UID: \"89014237-e2cf-4af2-a1cd-57be201b0001\") " pod="openshift-network-operator/iptables-alerter-sh9jc"
Sep 07 03:48:19.215101 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.213356    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwwq7\" (UniqueName: \"kubernetes.io/projected/9dc17bd6-5586-49ea-a5d8-85860cad426f-kube-api-access-hwwq7\") pod \"node-resolver-72b5b\" (UID: \"9dc17bd6-5586-49ea-a5d8-85860cad426f\") " pod="openshift-dns/node-resolver-72b5b"
Sep 07 03:48:19.215101 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.213387    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9d48a665-e3f4-4f7e-9b28-462f9954f0de-host-run-netns\") pod \"multus-9rxpx\" (UID: \"9d48a665-e3f4-4f7e-9b28-462f9954f0de\") " pod="openshift-multus/multus-9rxpx"
Sep 07 03:48:19.215101 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.213399    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a89adb7-9035-489e-8c69-72a65791ba9d-system-cni-dir\") pod \"multus-additional-cni-plugins-g7mf6\" (UID: \"9a89adb7-9035-489e-8c69-72a65791ba9d\") " pod="openshift-multus/multus-additional-cni-plugins-g7mf6"
Sep 07 03:48:19.215101 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.213390    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/83be5e03-f5e7-4c65-9fba-dcf128db003e-run-systemd\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.215101 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.213428    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/078e2a74-a77c-42d5-941a-52e2b16a74ed-dbus\") pod \"global-pull-secret-syncer-tdrdx\" (UID: \"078e2a74-a77c-42d5-941a-52e2b16a74ed\") " pod="kube-system/global-pull-secret-syncer-tdrdx"
Sep 07 03:48:19.215101 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.213511    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/83be5e03-f5e7-4c65-9fba-dcf128db003e-host-cni-netd\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.215101 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.213520    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/83be5e03-f5e7-4c65-9fba-dcf128db003e-host-slash\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.215101 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.213561    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83be5e03-f5e7-4c65-9fba-dcf128db003e-etc-openvswitch\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.215101 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.213610    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6468e5c3-32f3-4466-9722-255ad1443e7e-etc-selinux\") pod \"aws-ebs-csi-driver-node-g8jm9\" (UID: \"6468e5c3-32f3-4466-9722-255ad1443e7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8jm9"
Sep 07 03:48:19.215101 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.213678    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9d48a665-e3f4-4f7e-9b28-462f9954f0de-multus-cni-dir\") pod \"multus-9rxpx\" (UID: \"9d48a665-e3f4-4f7e-9b28-462f9954f0de\") " pod="openshift-multus/multus-9rxpx"
Sep 07 03:48:19.215101 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.213735    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/83be5e03-f5e7-4c65-9fba-dcf128db003e-systemd-units\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.215101 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.213755    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/83be5e03-f5e7-4c65-9fba-dcf128db003e-env-overrides\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.215101 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.213765    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/89014237-e2cf-4af2-a1cd-57be201b0001-host-slash\") pod \"iptables-alerter-sh9jc\" (UID: \"89014237-e2cf-4af2-a1cd-57be201b0001\") " pod="openshift-network-operator/iptables-alerter-sh9jc"
Sep 07 03:48:19.215101 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.213791    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rktr4\" (UniqueName: \"kubernetes.io/projected/89014237-e2cf-4af2-a1cd-57be201b0001-kube-api-access-rktr4\") pod \"iptables-alerter-sh9jc\" (UID: \"89014237-e2cf-4af2-a1cd-57be201b0001\") " pod="openshift-network-operator/iptables-alerter-sh9jc"
Sep 07 03:48:19.215101 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.213819    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b0fedcd8-4974-4bf5-af6f-41711c6bbedd-serviceca\") pod \"node-ca-t7c8n\" (UID: \"b0fedcd8-4974-4bf5-af6f-41711c6bbedd\") " pod="openshift-image-registry/node-ca-t7c8n"
Sep 07 03:48:19.215101 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.213846    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dfde1640-28bf-4ee0-94b0-62a6d26d04fe-etc-sysctl-conf\") pod \"tuned-9wr6n\" (UID: \"dfde1640-28bf-4ee0-94b0-62a6d26d04fe\") " pod="openshift-cluster-node-tuning-operator/tuned-9wr6n"
Sep 07 03:48:19.215101 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.213874    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/83be5e03-f5e7-4c65-9fba-dcf128db003e-node-log\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.215997 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.213903    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9a89adb7-9035-489e-8c69-72a65791ba9d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g7mf6\" (UID: \"9a89adb7-9035-489e-8c69-72a65791ba9d\") " pod="openshift-multus/multus-additional-cni-plugins-g7mf6"
Sep 07 03:48:19.215997 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.213954    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/83be5e03-f5e7-4c65-9fba-dcf128db003e-systemd-units\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.215997 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.213992    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/89014237-e2cf-4af2-a1cd-57be201b0001-host-slash\") pod \"iptables-alerter-sh9jc\" (UID: \"89014237-e2cf-4af2-a1cd-57be201b0001\") " pod="openshift-network-operator/iptables-alerter-sh9jc"
Sep 07 03:48:19.215997 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.214036    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/83be5e03-f5e7-4c65-9fba-dcf128db003e-node-log\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.215997 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:19.214072    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 03:48:19.215997 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.214112    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/02324c56-a65f-4119-89d6-b5d48a9d9609-konnectivity-ca\") pod \"konnectivity-agent-jpqvg\" (UID: \"02324c56-a65f-4119-89d6-b5d48a9d9609\") " pod="kube-system/konnectivity-agent-jpqvg"
Sep 07 03:48:19.215997 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:19.214146    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64880c7e-cc6b-462f-9d79-b9b6b48d34ca-metrics-certs podName:64880c7e-cc6b-462f-9d79-b9b6b48d34ca nodeName:}" failed. No retries permitted until 2026-09-07 03:48:19.714123399 +0000 UTC m=+3.026599301 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64880c7e-cc6b-462f-9d79-b9b6b48d34ca-metrics-certs") pod "network-metrics-daemon-7rg9j" (UID: "64880c7e-cc6b-462f-9d79-b9b6b48d34ca") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 03:48:19.215997 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.214072    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/02324c56-a65f-4119-89d6-b5d48a9d9609-agent-certs\") pod \"konnectivity-agent-jpqvg\" (UID: \"02324c56-a65f-4119-89d6-b5d48a9d9609\") " pod="kube-system/konnectivity-agent-jpqvg"
Sep 07 03:48:19.215997 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.214186    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dfde1640-28bf-4ee0-94b0-62a6d26d04fe-etc-sysctl-d\") pod \"tuned-9wr6n\" (UID: \"dfde1640-28bf-4ee0-94b0-62a6d26d04fe\") " pod="openshift-cluster-node-tuning-operator/tuned-9wr6n"
Sep 07 03:48:19.215997 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.214192    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/83be5e03-f5e7-4c65-9fba-dcf128db003e-var-lib-openvswitch\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.215997 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.214215    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dfde1640-28bf-4ee0-94b0-62a6d26d04fe-sys\") pod \"tuned-9wr6n\" (UID: \"dfde1640-28bf-4ee0-94b0-62a6d26d04fe\") " pod="openshift-cluster-node-tuning-operator/tuned-9wr6n"
Sep 07 03:48:19.215997 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.214227    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9d48a665-e3f4-4f7e-9b28-462f9954f0de-multus-daemon-config\") pod \"multus-9rxpx\" (UID: \"9d48a665-e3f4-4f7e-9b28-462f9954f0de\") " pod="openshift-multus/multus-9rxpx"
Sep 07 03:48:19.215997 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.214235    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/83be5e03-f5e7-4c65-9fba-dcf128db003e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.215997 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.214248    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dfde1640-28bf-4ee0-94b0-62a6d26d04fe-host\") pod \"tuned-9wr6n\" (UID: \"dfde1640-28bf-4ee0-94b0-62a6d26d04fe\") " pod="openshift-cluster-node-tuning-operator/tuned-9wr6n"
Sep 07 03:48:19.215997 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.214395    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d48a665-e3f4-4f7e-9b28-462f9954f0de-etc-kubernetes\") pod \"multus-9rxpx\" (UID: \"9d48a665-e3f4-4f7e-9b28-462f9954f0de\") " pod="openshift-multus/multus-9rxpx"
Sep 07 03:48:19.215997 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.214461    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9d48a665-e3f4-4f7e-9b28-462f9954f0de-host-var-lib-cni-multus\") pod \"multus-9rxpx\" (UID: \"9d48a665-e3f4-4f7e-9b28-462f9954f0de\") " pod="openshift-multus/multus-9rxpx"
Sep 07 03:48:19.215997 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.214525    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljc7f\" (UniqueName: \"kubernetes.io/projected/3ec3c1a7-cf5d-4e83-8497-f2c725850698-kube-api-access-ljc7f\") pod \"network-check-target-hvk8h\" (UID: \"3ec3c1a7-cf5d-4e83-8497-f2c725850698\") " pod="openshift-network-diagnostics/network-check-target-hvk8h"
Sep 07 03:48:19.216836 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.214556    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9d48a665-e3f4-4f7e-9b28-462f9954f0de-host-var-lib-cni-multus\") pod \"multus-9rxpx\" (UID: \"9d48a665-e3f4-4f7e-9b28-462f9954f0de\") " pod="openshift-multus/multus-9rxpx"
Sep 07 03:48:19.216836 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.214597    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dfde1640-28bf-4ee0-94b0-62a6d26d04fe-etc-sysconfig\") pod \"tuned-9wr6n\" (UID: \"dfde1640-28bf-4ee0-94b0-62a6d26d04fe\") " pod="openshift-cluster-node-tuning-operator/tuned-9wr6n"
Sep 07 03:48:19.216836 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.214633    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dfde1640-28bf-4ee0-94b0-62a6d26d04fe-lib-modules\") pod \"tuned-9wr6n\" (UID: \"dfde1640-28bf-4ee0-94b0-62a6d26d04fe\") " pod="openshift-cluster-node-tuning-operator/tuned-9wr6n"
Sep 07 03:48:19.216836 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.214663    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9d48a665-e3f4-4f7e-9b28-462f9954f0de-multus-socket-dir-parent\") pod \"multus-9rxpx\" (UID: \"9d48a665-e3f4-4f7e-9b28-462f9954f0de\") " pod="openshift-multus/multus-9rxpx"
Sep 07 03:48:19.216836 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.214691    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9d48a665-e3f4-4f7e-9b28-462f9954f0de-host-run-k8s-cni-cncf-io\") pod \"multus-9rxpx\" (UID: \"9d48a665-e3f4-4f7e-9b28-462f9954f0de\") " pod="openshift-multus/multus-9rxpx"
Sep 07 03:48:19.216836 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.214750    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fk7b\" (UniqueName: \"kubernetes.io/projected/64880c7e-cc6b-462f-9d79-b9b6b48d34ca-kube-api-access-7fk7b\") pod \"network-metrics-daemon-7rg9j\" (UID: \"64880c7e-cc6b-462f-9d79-b9b6b48d34ca\") " pod="openshift-multus/network-metrics-daemon-7rg9j"
Sep 07 03:48:19.216836 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.214818    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9d48a665-e3f4-4f7e-9b28-462f9954f0de-multus-socket-dir-parent\") pod \"multus-9rxpx\" (UID: \"9d48a665-e3f4-4f7e-9b28-462f9954f0de\") " pod="openshift-multus/multus-9rxpx"
Sep 07 03:48:19.216836 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.214872    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9d48a665-e3f4-4f7e-9b28-462f9954f0de-host-run-k8s-cni-cncf-io\") pod \"multus-9rxpx\" (UID: \"9d48a665-e3f4-4f7e-9b28-462f9954f0de\") " pod="openshift-multus/multus-9rxpx"
Sep 07 03:48:19.218090 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.218063    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/83be5e03-f5e7-4c65-9fba-dcf128db003e-ovn-node-metrics-cert\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.218840 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.218797    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/02324c56-a65f-4119-89d6-b5d48a9d9609-agent-certs\") pod \"konnectivity-agent-jpqvg\" (UID: \"02324c56-a65f-4119-89d6-b5d48a9d9609\") " pod="kube-system/konnectivity-agent-jpqvg"
Sep 07 03:48:19.220489 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.220464    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg8vl\" (UniqueName: \"kubernetes.io/projected/6468e5c3-32f3-4466-9722-255ad1443e7e-kube-api-access-tg8vl\") pod \"aws-ebs-csi-driver-node-g8jm9\" (UID: \"6468e5c3-32f3-4466-9722-255ad1443e7e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8jm9"
Sep 07 03:48:19.221505 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.221483    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rmvx\" (UniqueName: \"kubernetes.io/projected/83be5e03-f5e7-4c65-9fba-dcf128db003e-kube-api-access-4rmvx\") pod \"ovnkube-node-pmq6m\" (UID: \"83be5e03-f5e7-4c65-9fba-dcf128db003e\") " pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.225975 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.225952    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rktr4\" (UniqueName: \"kubernetes.io/projected/89014237-e2cf-4af2-a1cd-57be201b0001-kube-api-access-rktr4\") pod \"iptables-alerter-sh9jc\" (UID: \"89014237-e2cf-4af2-a1cd-57be201b0001\") " pod="openshift-network-operator/iptables-alerter-sh9jc"
Sep 07 03:48:19.226434 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.226414    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pczd4\" (UniqueName: \"kubernetes.io/projected/9d48a665-e3f4-4f7e-9b28-462f9954f0de-kube-api-access-pczd4\") pod \"multus-9rxpx\" (UID: \"9d48a665-e3f4-4f7e-9b28-462f9954f0de\") " pod="openshift-multus/multus-9rxpx"
Sep 07 03:48:19.227093 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.227069    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fk7b\" (UniqueName: \"kubernetes.io/projected/64880c7e-cc6b-462f-9d79-b9b6b48d34ca-kube-api-access-7fk7b\") pod \"network-metrics-daemon-7rg9j\" (UID: \"64880c7e-cc6b-462f-9d79-b9b6b48d34ca\") " pod="openshift-multus/network-metrics-daemon-7rg9j"
Sep 07 03:48:19.315086 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.315047    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b0fedcd8-4974-4bf5-af6f-41711c6bbedd-serviceca\") pod \"node-ca-t7c8n\" (UID: \"b0fedcd8-4974-4bf5-af6f-41711c6bbedd\") " pod="openshift-image-registry/node-ca-t7c8n"
Sep 07 03:48:19.315272 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.315094    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dfde1640-28bf-4ee0-94b0-62a6d26d04fe-etc-sysctl-conf\") pod \"tuned-9wr6n\" (UID: \"dfde1640-28bf-4ee0-94b0-62a6d26d04fe\") " pod="openshift-cluster-node-tuning-operator/tuned-9wr6n"
Sep 07 03:48:19.315272 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.315123    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9a89adb7-9035-489e-8c69-72a65791ba9d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g7mf6\" (UID: \"9a89adb7-9035-489e-8c69-72a65791ba9d\") " pod="openshift-multus/multus-additional-cni-plugins-g7mf6"
Sep 07 03:48:19.315272 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.315154    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dfde1640-28bf-4ee0-94b0-62a6d26d04fe-etc-sysctl-d\") pod \"tuned-9wr6n\" (UID: \"dfde1640-28bf-4ee0-94b0-62a6d26d04fe\") " pod="openshift-cluster-node-tuning-operator/tuned-9wr6n"
Sep 07 03:48:19.315272 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.315178    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dfde1640-28bf-4ee0-94b0-62a6d26d04fe-sys\") pod \"tuned-9wr6n\" (UID: \"dfde1640-28bf-4ee0-94b0-62a6d26d04fe\") " pod="openshift-cluster-node-tuning-operator/tuned-9wr6n"
Sep 07 03:48:19.315272 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.315200    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dfde1640-28bf-4ee0-94b0-62a6d26d04fe-host\") pod \"tuned-9wr6n\" (UID: \"dfde1640-28bf-4ee0-94b0-62a6d26d04fe\") " pod="openshift-cluster-node-tuning-operator/tuned-9wr6n"
Sep 07 03:48:19.315272 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.315227    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljc7f\" (UniqueName: \"kubernetes.io/projected/3ec3c1a7-cf5d-4e83-8497-f2c725850698-kube-api-access-ljc7f\") pod \"network-check-target-hvk8h\" (UID: \"3ec3c1a7-cf5d-4e83-8497-f2c725850698\") " pod="openshift-network-diagnostics/network-check-target-hvk8h"
Sep 07 03:48:19.315272 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.315252    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dfde1640-28bf-4ee0-94b0-62a6d26d04fe-etc-sysconfig\") pod \"tuned-9wr6n\" (UID: \"dfde1640-28bf-4ee0-94b0-62a6d26d04fe\") " pod="openshift-cluster-node-tuning-operator/tuned-9wr6n"
Sep 07 03:48:19.315750 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.315269    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dfde1640-28bf-4ee0-94b0-62a6d26d04fe-etc-sysctl-conf\") pod \"tuned-9wr6n\" (UID: \"dfde1640-28bf-4ee0-94b0-62a6d26d04fe\") " pod="openshift-cluster-node-tuning-operator/tuned-9wr6n"
Sep 07 03:48:19.315750 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.315276    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dfde1640-28bf-4ee0-94b0-62a6d26d04fe-lib-modules\") pod \"tuned-9wr6n\" (UID: \"dfde1640-28bf-4ee0-94b0-62a6d26d04fe\") " pod="openshift-cluster-node-tuning-operator/tuned-9wr6n"
Sep 07 03:48:19.315750 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.315321    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dfde1640-28bf-4ee0-94b0-62a6d26d04fe-sys\") pod \"tuned-9wr6n\" (UID: \"dfde1640-28bf-4ee0-94b0-62a6d26d04fe\") " pod="openshift-cluster-node-tuning-operator/tuned-9wr6n"
Sep 07 03:48:19.315750 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.315343    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9a89adb7-9035-489e-8c69-72a65791ba9d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g7mf6\" (UID: \"9a89adb7-9035-489e-8c69-72a65791ba9d\") " pod="openshift-multus/multus-additional-cni-plugins-g7mf6"
Sep 07 03:48:19.315750 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.315321    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dfde1640-28bf-4ee0-94b0-62a6d26d04fe-host\") pod \"tuned-9wr6n\" (UID: \"dfde1640-28bf-4ee0-94b0-62a6d26d04fe\") " pod="openshift-cluster-node-tuning-operator/tuned-9wr6n"
Sep 07 03:48:19.315750 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.315365    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dfde1640-28bf-4ee0-94b0-62a6d26d04fe-etc-sysctl-d\") pod \"tuned-9wr6n\" (UID: \"dfde1640-28bf-4ee0-94b0-62a6d26d04fe\") " pod="openshift-cluster-node-tuning-operator/tuned-9wr6n"
Sep 07 03:48:19.315750 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.315387    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dfde1640-28bf-4ee0-94b0-62a6d26d04fe-lib-modules\") pod \"tuned-9wr6n\" (UID: \"dfde1640-28bf-4ee0-94b0-62a6d26d04fe\") " pod="openshift-cluster-node-tuning-operator/tuned-9wr6n"
Sep 07 03:48:19.315750 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.315390    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dfde1640-28bf-4ee0-94b0-62a6d26d04fe-etc-sysconfig\") pod \"tuned-9wr6n\" (UID: \"dfde1640-28bf-4ee0-94b0-62a6d26d04fe\") " pod="openshift-cluster-node-tuning-operator/tuned-9wr6n"
Sep 07 03:48:19.315750 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.315376    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x75xx\" (UniqueName: \"kubernetes.io/projected/9a89adb7-9035-489e-8c69-72a65791ba9d-kube-api-access-x75xx\") pod \"multus-additional-cni-plugins-g7mf6\" (UID: \"9a89adb7-9035-489e-8c69-72a65791ba9d\") " pod="openshift-multus/multus-additional-cni-plugins-g7mf6"
Sep 07 03:48:19.315750 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.315441    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9a89adb7-9035-489e-8c69-72a65791ba9d-cni-binary-copy\") pod \"multus-additional-cni-plugins-g7mf6\" (UID: \"9a89adb7-9035-489e-8c69-72a65791ba9d\") " pod="openshift-multus/multus-additional-cni-plugins-g7mf6"
Sep 07 03:48:19.315750 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.315468    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dfde1640-28bf-4ee0-94b0-62a6d26d04fe-run\") pod \"tuned-9wr6n\" (UID: \"dfde1640-28bf-4ee0-94b0-62a6d26d04fe\") " pod="openshift-cluster-node-tuning-operator/tuned-9wr6n"
Sep 07 03:48:19.315750 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.315498    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9dc17bd6-5586-49ea-a5d8-85860cad426f-hosts-file\") pod \"node-resolver-72b5b\" (UID: \"9dc17bd6-5586-49ea-a5d8-85860cad426f\") " pod="openshift-dns/node-resolver-72b5b"
Sep 07 03:48:19.315750 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.315527    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/078e2a74-a77c-42d5-941a-52e2b16a74ed-original-pull-secret\") pod \"global-pull-secret-syncer-tdrdx\" (UID: \"078e2a74-a77c-42d5-941a-52e2b16a74ed\") " pod="kube-system/global-pull-secret-syncer-tdrdx"
Sep 07 03:48:19.315750 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.315562    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/078e2a74-a77c-42d5-941a-52e2b16a74ed-kubelet-config\") pod \"global-pull-secret-syncer-tdrdx\" (UID: \"078e2a74-a77c-42d5-941a-52e2b16a74ed\") " pod="kube-system/global-pull-secret-syncer-tdrdx"
Sep 07 03:48:19.315750 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.315577    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dfde1640-28bf-4ee0-94b0-62a6d26d04fe-run\") pod \"tuned-9wr6n\" (UID: \"dfde1640-28bf-4ee0-94b0-62a6d26d04fe\") " pod="openshift-cluster-node-tuning-operator/tuned-9wr6n"
Sep 07 03:48:19.315750 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.315577    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b0fedcd8-4974-4bf5-af6f-41711c6bbedd-serviceca\") pod \"node-ca-t7c8n\" (UID: \"b0fedcd8-4974-4bf5-af6f-41711c6bbedd\") " pod="openshift-image-registry/node-ca-t7c8n"
Sep 07 03:48:19.315750 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.315599    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b0fedcd8-4974-4bf5-af6f-41711c6bbedd-host\") pod \"node-ca-t7c8n\" (UID: \"b0fedcd8-4974-4bf5-af6f-41711c6bbedd\") " pod="openshift-image-registry/node-ca-t7c8n"
Sep 07 03:48:19.315750 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.315649    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9dc17bd6-5586-49ea-a5d8-85860cad426f-tmp-dir\") pod \"node-resolver-72b5b\" (UID: \"9dc17bd6-5586-49ea-a5d8-85860cad426f\") " pod="openshift-dns/node-resolver-72b5b"
Sep 07 03:48:19.316635 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:19.315690    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 03:48:19.316635 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.315702    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dfde1640-28bf-4ee0-94b0-62a6d26d04fe-etc-systemd\") pod \"tuned-9wr6n\" (UID: \"dfde1640-28bf-4ee0-94b0-62a6d26d04fe\") " pod="openshift-cluster-node-tuning-operator/tuned-9wr6n"
Sep 07 03:48:19.316635 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.315707    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9dc17bd6-5586-49ea-a5d8-85860cad426f-hosts-file\") pod \"node-resolver-72b5b\" (UID: \"9dc17bd6-5586-49ea-a5d8-85860cad426f\") " pod="openshift-dns/node-resolver-72b5b"
Sep 07 03:48:19.316635 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.315647    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/078e2a74-a77c-42d5-941a-52e2b16a74ed-kubelet-config\") pod \"global-pull-secret-syncer-tdrdx\" (UID: \"078e2a74-a77c-42d5-941a-52e2b16a74ed\") " pod="kube-system/global-pull-secret-syncer-tdrdx"
Sep 07 03:48:19.316635 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.315747    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dfde1640-28bf-4ee0-94b0-62a6d26d04fe-tmp\") pod \"tuned-9wr6n\" (UID: \"dfde1640-28bf-4ee0-94b0-62a6d26d04fe\") " pod="openshift-cluster-node-tuning-operator/tuned-9wr6n"
Sep 07 03:48:19.316635 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:19.315762    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/078e2a74-a77c-42d5-941a-52e2b16a74ed-original-pull-secret podName:078e2a74-a77c-42d5-941a-52e2b16a74ed nodeName:}" failed. No retries permitted until 2026-09-07 03:48:19.815743894 +0000 UTC m=+3.128219793 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/078e2a74-a77c-42d5-941a-52e2b16a74ed-original-pull-secret") pod "global-pull-secret-syncer-tdrdx" (UID: "078e2a74-a77c-42d5-941a-52e2b16a74ed") : object "kube-system"/"original-pull-secret" not registered
Sep 07 03:48:19.316635 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.315785    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dfde1640-28bf-4ee0-94b0-62a6d26d04fe-etc-systemd\") pod \"tuned-9wr6n\" (UID: \"dfde1640-28bf-4ee0-94b0-62a6d26d04fe\") " pod="openshift-cluster-node-tuning-operator/tuned-9wr6n"
Sep 07 03:48:19.316635 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.315798    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dfde1640-28bf-4ee0-94b0-62a6d26d04fe-etc-kubernetes\") pod \"tuned-9wr6n\" (UID: \"dfde1640-28bf-4ee0-94b0-62a6d26d04fe\") " pod="openshift-cluster-node-tuning-operator/tuned-9wr6n"
Sep 07 03:48:19.316635 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.315830    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dfde1640-28bf-4ee0-94b0-62a6d26d04fe-etc-tuned\") pod \"tuned-9wr6n\" (UID: \"dfde1640-28bf-4ee0-94b0-62a6d26d04fe\") " pod="openshift-cluster-node-tuning-operator/tuned-9wr6n"
Sep 07 03:48:19.316635 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.315687    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b0fedcd8-4974-4bf5-af6f-41711c6bbedd-host\") pod \"node-ca-t7c8n\" (UID: \"b0fedcd8-4974-4bf5-af6f-41711c6bbedd\") " pod="openshift-image-registry/node-ca-t7c8n"
Sep 07 03:48:19.316635 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.315896    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9a89adb7-9035-489e-8c69-72a65791ba9d-cnibin\") pod \"multus-additional-cni-plugins-g7mf6\" (UID: \"9a89adb7-9035-489e-8c69-72a65791ba9d\") " pod="openshift-multus/multus-additional-cni-plugins-g7mf6"
Sep 07 03:48:19.316635 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.315928    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9a89adb7-9035-489e-8c69-72a65791ba9d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g7mf6\" (UID: \"9a89adb7-9035-489e-8c69-72a65791ba9d\") " pod="openshift-multus/multus-additional-cni-plugins-g7mf6"
Sep 07 03:48:19.316635 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.315942    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dfde1640-28bf-4ee0-94b0-62a6d26d04fe-etc-kubernetes\") pod \"tuned-9wr6n\" (UID: \"dfde1640-28bf-4ee0-94b0-62a6d26d04fe\") " pod="openshift-cluster-node-tuning-operator/tuned-9wr6n"
Sep 07 03:48:19.316635 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.315955    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9dc17bd6-5586-49ea-a5d8-85860cad426f-tmp-dir\") pod \"node-resolver-72b5b\" (UID: \"9dc17bd6-5586-49ea-a5d8-85860cad426f\") " pod="openshift-dns/node-resolver-72b5b"
Sep 07 03:48:19.316635 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.315969    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpm8n\" (UniqueName: \"kubernetes.io/projected/b0fedcd8-4974-4bf5-af6f-41711c6bbedd-kube-api-access-vpm8n\") pod \"node-ca-t7c8n\" (UID: \"b0fedcd8-4974-4bf5-af6f-41711c6bbedd\") " pod="openshift-image-registry/node-ca-t7c8n"
Sep 07 03:48:19.316635 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.315990    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9a89adb7-9035-489e-8c69-72a65791ba9d-cnibin\") pod \"multus-additional-cni-plugins-g7mf6\" (UID: \"9a89adb7-9035-489e-8c69-72a65791ba9d\") " pod="openshift-multus/multus-additional-cni-plugins-g7mf6"
Sep 07 03:48:19.316635 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.316016    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dfde1640-28bf-4ee0-94b0-62a6d26d04fe-etc-modprobe-d\") pod \"tuned-9wr6n\" (UID: \"dfde1640-28bf-4ee0-94b0-62a6d26d04fe\") " pod="openshift-cluster-node-tuning-operator/tuned-9wr6n"
Sep 07 03:48:19.317340 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.316032    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dfde1640-28bf-4ee0-94b0-62a6d26d04fe-var-lib-kubelet\") pod \"tuned-9wr6n\" (UID: \"dfde1640-28bf-4ee0-94b0-62a6d26d04fe\") " pod="openshift-cluster-node-tuning-operator/tuned-9wr6n"
Sep 07 03:48:19.317340 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.316095    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjh22\" (UniqueName: \"kubernetes.io/projected/dfde1640-28bf-4ee0-94b0-62a6d26d04fe-kube-api-access-fjh22\") pod \"tuned-9wr6n\" (UID: \"dfde1640-28bf-4ee0-94b0-62a6d26d04fe\") " pod="openshift-cluster-node-tuning-operator/tuned-9wr6n"
Sep 07 03:48:19.317340 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.316122    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwwq7\" (UniqueName: \"kubernetes.io/projected/9dc17bd6-5586-49ea-a5d8-85860cad426f-kube-api-access-hwwq7\") pod \"node-resolver-72b5b\" (UID: \"9dc17bd6-5586-49ea-a5d8-85860cad426f\") " pod="openshift-dns/node-resolver-72b5b"
Sep 07 03:48:19.317340 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.316140    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9a89adb7-9035-489e-8c69-72a65791ba9d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g7mf6\" (UID: \"9a89adb7-9035-489e-8c69-72a65791ba9d\") " pod="openshift-multus/multus-additional-cni-plugins-g7mf6"
Sep 07 03:48:19.317340 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.316148    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a89adb7-9035-489e-8c69-72a65791ba9d-system-cni-dir\") pod \"multus-additional-cni-plugins-g7mf6\" (UID: \"9a89adb7-9035-489e-8c69-72a65791ba9d\") " pod="openshift-multus/multus-additional-cni-plugins-g7mf6"
Sep 07 03:48:19.317340 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.316154    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dfde1640-28bf-4ee0-94b0-62a6d26d04fe-etc-modprobe-d\") pod \"tuned-9wr6n\" (UID: \"dfde1640-28bf-4ee0-94b0-62a6d26d04fe\") " pod="openshift-cluster-node-tuning-operator/tuned-9wr6n"
Sep 07 03:48:19.317340 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.316173    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/078e2a74-a77c-42d5-941a-52e2b16a74ed-dbus\") pod \"global-pull-secret-syncer-tdrdx\" (UID: \"078e2a74-a77c-42d5-941a-52e2b16a74ed\") " pod="kube-system/global-pull-secret-syncer-tdrdx"
Sep 07 03:48:19.317340 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.316193    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dfde1640-28bf-4ee0-94b0-62a6d26d04fe-var-lib-kubelet\") pod \"tuned-9wr6n\" (UID: \"dfde1640-28bf-4ee0-94b0-62a6d26d04fe\") " pod="openshift-cluster-node-tuning-operator/tuned-9wr6n"
Sep 07 03:48:19.317340 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.316213    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a89adb7-9035-489e-8c69-72a65791ba9d-system-cni-dir\") pod \"multus-additional-cni-plugins-g7mf6\" (UID: \"9a89adb7-9035-489e-8c69-72a65791ba9d\") " pod="openshift-multus/multus-additional-cni-plugins-g7mf6"
Sep 07 03:48:19.317340 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.316264    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/078e2a74-a77c-42d5-941a-52e2b16a74ed-dbus\") pod \"global-pull-secret-syncer-tdrdx\" (UID: \"078e2a74-a77c-42d5-941a-52e2b16a74ed\") " pod="kube-system/global-pull-secret-syncer-tdrdx"
Sep 07 03:48:19.317340 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.316780    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9a89adb7-9035-489e-8c69-72a65791ba9d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g7mf6\" (UID: \"9a89adb7-9035-489e-8c69-72a65791ba9d\") " pod="openshift-multus/multus-additional-cni-plugins-g7mf6"
Sep 07 03:48:19.317340 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.316929    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9a89adb7-9035-489e-8c69-72a65791ba9d-cni-binary-copy\") pod \"multus-additional-cni-plugins-g7mf6\" (UID: \"9a89adb7-9035-489e-8c69-72a65791ba9d\") " pod="openshift-multus/multus-additional-cni-plugins-g7mf6"
Sep 07 03:48:19.317340 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.317210    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9a89adb7-9035-489e-8c69-72a65791ba9d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g7mf6\" (UID: \"9a89adb7-9035-489e-8c69-72a65791ba9d\") " pod="openshift-multus/multus-additional-cni-plugins-g7mf6"
Sep 07 03:48:19.318353 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.318331    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dfde1640-28bf-4ee0-94b0-62a6d26d04fe-etc-tuned\") pod \"tuned-9wr6n\" (UID: \"dfde1640-28bf-4ee0-94b0-62a6d26d04fe\") " pod="openshift-cluster-node-tuning-operator/tuned-9wr6n"
Sep 07 03:48:19.318522 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.318503    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dfde1640-28bf-4ee0-94b0-62a6d26d04fe-tmp\") pod \"tuned-9wr6n\" (UID: \"dfde1640-28bf-4ee0-94b0-62a6d26d04fe\") " pod="openshift-cluster-node-tuning-operator/tuned-9wr6n"
Sep 07 03:48:19.321385 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:19.321336    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 03:48:19.321502 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:19.321392    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 03:48:19.321502 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:19.321407    2559 projected.go:196] Error preparing data for projected volume kube-api-access-ljc7f for pod openshift-network-diagnostics/network-check-target-hvk8h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 03:48:19.321502 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:19.321476    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ec3c1a7-cf5d-4e83-8497-f2c725850698-kube-api-access-ljc7f podName:3ec3c1a7-cf5d-4e83-8497-f2c725850698 nodeName:}" failed. No retries permitted until 2026-09-07 03:48:19.821456166 +0000 UTC m=+3.133932047 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ljc7f" (UniqueName: "kubernetes.io/projected/3ec3c1a7-cf5d-4e83-8497-f2c725850698-kube-api-access-ljc7f") pod "network-check-target-hvk8h" (UID: "3ec3c1a7-cf5d-4e83-8497-f2c725850698") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 03:48:19.324262 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.324193    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpm8n\" (UniqueName: \"kubernetes.io/projected/b0fedcd8-4974-4bf5-af6f-41711c6bbedd-kube-api-access-vpm8n\") pod \"node-ca-t7c8n\" (UID: \"b0fedcd8-4974-4bf5-af6f-41711c6bbedd\") " pod="openshift-image-registry/node-ca-t7c8n"
Sep 07 03:48:19.324262 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.324212    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwwq7\" (UniqueName: \"kubernetes.io/projected/9dc17bd6-5586-49ea-a5d8-85860cad426f-kube-api-access-hwwq7\") pod \"node-resolver-72b5b\" (UID: \"9dc17bd6-5586-49ea-a5d8-85860cad426f\") " pod="openshift-dns/node-resolver-72b5b"
Sep 07 03:48:19.324521 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.324500    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x75xx\" (UniqueName: \"kubernetes.io/projected/9a89adb7-9035-489e-8c69-72a65791ba9d-kube-api-access-x75xx\") pod \"multus-additional-cni-plugins-g7mf6\" (UID: \"9a89adb7-9035-489e-8c69-72a65791ba9d\") " pod="openshift-multus/multus-additional-cni-plugins-g7mf6"
Sep 07 03:48:19.325791 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.325772    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjh22\" (UniqueName: \"kubernetes.io/projected/dfde1640-28bf-4ee0-94b0-62a6d26d04fe-kube-api-access-fjh22\") pod \"tuned-9wr6n\" (UID: \"dfde1640-28bf-4ee0-94b0-62a6d26d04fe\") " pod="openshift-cluster-node-tuning-operator/tuned-9wr6n"
Sep 07 03:48:19.408060 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.408026    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9rxpx"
Sep 07 03:48:19.418020 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.417990    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:19.427939 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.427910    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8jm9"
Sep 07 03:48:19.434900 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.434880    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sh9jc"
Sep 07 03:48:19.442931 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.442912    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jpqvg"
Sep 07 03:48:19.455791 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.455768    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-t7c8n"
Sep 07 03:48:19.465565 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.465548    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9wr6n"
Sep 07 03:48:19.475434 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.475412    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-72b5b"
Sep 07 03:48:19.481281 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.481255    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-g7mf6"
Sep 07 03:48:19.719592 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.719497    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64880c7e-cc6b-462f-9d79-b9b6b48d34ca-metrics-certs\") pod \"network-metrics-daemon-7rg9j\" (UID: \"64880c7e-cc6b-462f-9d79-b9b6b48d34ca\") " pod="openshift-multus/network-metrics-daemon-7rg9j"
Sep 07 03:48:19.719800 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:19.719628    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 03:48:19.719800 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:19.719712    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64880c7e-cc6b-462f-9d79-b9b6b48d34ca-metrics-certs podName:64880c7e-cc6b-462f-9d79-b9b6b48d34ca nodeName:}" failed. No retries permitted until 2026-09-07 03:48:20.719693898 +0000 UTC m=+4.032169780 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64880c7e-cc6b-462f-9d79-b9b6b48d34ca-metrics-certs") pod "network-metrics-daemon-7rg9j" (UID: "64880c7e-cc6b-462f-9d79-b9b6b48d34ca") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 03:48:19.820643 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.820589    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/078e2a74-a77c-42d5-941a-52e2b16a74ed-original-pull-secret\") pod \"global-pull-secret-syncer-tdrdx\" (UID: \"078e2a74-a77c-42d5-941a-52e2b16a74ed\") " pod="kube-system/global-pull-secret-syncer-tdrdx"
Sep 07 03:48:19.820820 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:19.820771    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 03:48:19.820877 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:19.820861    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/078e2a74-a77c-42d5-941a-52e2b16a74ed-original-pull-secret podName:078e2a74-a77c-42d5-941a-52e2b16a74ed nodeName:}" failed. No retries permitted until 2026-09-07 03:48:20.820837805 +0000 UTC m=+4.133313697 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/078e2a74-a77c-42d5-941a-52e2b16a74ed-original-pull-secret") pod "global-pull-secret-syncer-tdrdx" (UID: "078e2a74-a77c-42d5-941a-52e2b16a74ed") : object "kube-system"/"original-pull-secret" not registered
Sep 07 03:48:19.920976 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:19.920938    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljc7f\" (UniqueName: \"kubernetes.io/projected/3ec3c1a7-cf5d-4e83-8497-f2c725850698-kube-api-access-ljc7f\") pod \"network-check-target-hvk8h\" (UID: \"3ec3c1a7-cf5d-4e83-8497-f2c725850698\") " pod="openshift-network-diagnostics/network-check-target-hvk8h"
Sep 07 03:48:19.921128 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:19.921106    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 03:48:19.921180 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:19.921130    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 03:48:19.921180 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:19.921141    2559 projected.go:196] Error preparing data for projected volume kube-api-access-ljc7f for pod openshift-network-diagnostics/network-check-target-hvk8h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 03:48:19.921264 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:19.921199    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ec3c1a7-cf5d-4e83-8497-f2c725850698-kube-api-access-ljc7f podName:3ec3c1a7-cf5d-4e83-8497-f2c725850698 nodeName:}" failed. No retries permitted until 2026-09-07 03:48:20.921185262 +0000 UTC m=+4.233661144 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ljc7f" (UniqueName: "kubernetes.io/projected/3ec3c1a7-cf5d-4e83-8497-f2c725850698-kube-api-access-ljc7f") pod "network-check-target-hvk8h" (UID: "3ec3c1a7-cf5d-4e83-8497-f2c725850698") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 03:48:20.151724 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:20.151684    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 03:43:19 +0000 UTC" deadline="2028-05-08 15:53:03.080345908 +0000 UTC"
Sep 07 03:48:20.151724 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:20.151722    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14628h4m42.928629748s"
Sep 07 03:48:20.339891 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:20.339861    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dc17bd6_5586_49ea_a5d8_85860cad426f.slice/crio-8e1aea55f719cc916a26af205f4821a39e444b2fd8f47ea84170f99070bd230f WatchSource:0}: Error finding container 8e1aea55f719cc916a26af205f4821a39e444b2fd8f47ea84170f99070bd230f: Status 404 returned error can't find the container with id 8e1aea55f719cc916a26af205f4821a39e444b2fd8f47ea84170f99070bd230f
Sep 07 03:48:20.360718 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:20.360692    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02324c56_a65f_4119_89d6_b5d48a9d9609.slice/crio-2c3cfbdff35586452f90714f1db7105741494aa6c80f127469f4882f5ddd0584 WatchSource:0}: Error finding container 2c3cfbdff35586452f90714f1db7105741494aa6c80f127469f4882f5ddd0584: Status 404 returned error can't find the container with id 2c3cfbdff35586452f90714f1db7105741494aa6c80f127469f4882f5ddd0584
Sep 07 03:48:20.361722 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:20.361687    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83be5e03_f5e7_4c65_9fba_dcf128db003e.slice/crio-d460b98269ba9d31007e7cf467315ae1527dd4895fb4bb7b2bc826eb120512db WatchSource:0}: Error finding container d460b98269ba9d31007e7cf467315ae1527dd4895fb4bb7b2bc826eb120512db: Status 404 returned error can't find the container with id d460b98269ba9d31007e7cf467315ae1527dd4895fb4bb7b2bc826eb120512db
Sep 07 03:48:20.362385 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:20.362355    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6468e5c3_32f3_4466_9722_255ad1443e7e.slice/crio-fadab6737237d48da7cae941ea613ce72589e86cc5bbcbbed74c4adb0660e2f7 WatchSource:0}: Error finding container fadab6737237d48da7cae941ea613ce72589e86cc5bbcbbed74c4adb0660e2f7: Status 404 returned error can't find the container with id fadab6737237d48da7cae941ea613ce72589e86cc5bbcbbed74c4adb0660e2f7
Sep 07 03:48:20.366105 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:20.366080    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d48a665_e3f4_4f7e_9b28_462f9954f0de.slice/crio-7fb9a7d32130fe59f5308a2b9805c06ebafa1b2c5f461b6b8710996647baffe1 WatchSource:0}: Error finding container 7fb9a7d32130fe59f5308a2b9805c06ebafa1b2c5f461b6b8710996647baffe1: Status 404 returned error can't find the container with id 7fb9a7d32130fe59f5308a2b9805c06ebafa1b2c5f461b6b8710996647baffe1
Sep 07 03:48:20.367213 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:20.367192    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a89adb7_9035_489e_8c69_72a65791ba9d.slice/crio-c72d1b22f084971c91afec37c541b2942316089589aff42e3e3936a9e0b3b511 WatchSource:0}: Error finding container c72d1b22f084971c91afec37c541b2942316089589aff42e3e3936a9e0b3b511: Status 404 returned error can't find the container with id c72d1b22f084971c91afec37c541b2942316089589aff42e3e3936a9e0b3b511
Sep 07 03:48:20.372588 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:20.372569    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89014237_e2cf_4af2_a1cd_57be201b0001.slice/crio-53d61e9b0d1a1ca0ad9aef3360ca5c0c62d0f6fa6c47e800a49837af3b24f339 WatchSource:0}: Error finding container 53d61e9b0d1a1ca0ad9aef3360ca5c0c62d0f6fa6c47e800a49837af3b24f339: Status 404 returned error can't find the container with id 53d61e9b0d1a1ca0ad9aef3360ca5c0c62d0f6fa6c47e800a49837af3b24f339
Sep 07 03:48:20.373797 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:20.373748    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0fedcd8_4974_4bf5_af6f_41711c6bbedd.slice/crio-611f128becf3a3d53ab0048ee44d19c06ea4c2708051def52b510682571f7077 WatchSource:0}: Error finding container 611f128becf3a3d53ab0048ee44d19c06ea4c2708051def52b510682571f7077: Status 404 returned error can't find the container with id 611f128becf3a3d53ab0048ee44d19c06ea4c2708051def52b510682571f7077
Sep 07 03:48:20.375122 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:48:20.375097    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfde1640_28bf_4ee0_94b0_62a6d26d04fe.slice/crio-ef5c648528fd31cd8c53fbfe4967bac8630275dc18df8c510975cb1d9625eaf7 WatchSource:0}: Error finding container ef5c648528fd31cd8c53fbfe4967bac8630275dc18df8c510975cb1d9625eaf7: Status 404 returned error can't find the container with id ef5c648528fd31cd8c53fbfe4967bac8630275dc18df8c510975cb1d9625eaf7
Sep 07 03:48:20.727270 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:20.727241    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64880c7e-cc6b-462f-9d79-b9b6b48d34ca-metrics-certs\") pod \"network-metrics-daemon-7rg9j\" (UID: \"64880c7e-cc6b-462f-9d79-b9b6b48d34ca\") " pod="openshift-multus/network-metrics-daemon-7rg9j"
Sep 07 03:48:20.727419 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:20.727399    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 03:48:20.727480 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:20.727469    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64880c7e-cc6b-462f-9d79-b9b6b48d34ca-metrics-certs podName:64880c7e-cc6b-462f-9d79-b9b6b48d34ca nodeName:}" failed. No retries permitted until 2026-09-07 03:48:22.727448749 +0000 UTC m=+6.039924632 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64880c7e-cc6b-462f-9d79-b9b6b48d34ca-metrics-certs") pod "network-metrics-daemon-7rg9j" (UID: "64880c7e-cc6b-462f-9d79-b9b6b48d34ca") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 03:48:20.828316 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:20.828267    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/078e2a74-a77c-42d5-941a-52e2b16a74ed-original-pull-secret\") pod \"global-pull-secret-syncer-tdrdx\" (UID: \"078e2a74-a77c-42d5-941a-52e2b16a74ed\") " pod="kube-system/global-pull-secret-syncer-tdrdx"
Sep 07 03:48:20.828498 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:20.828427    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 03:48:20.828570 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:20.828500    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/078e2a74-a77c-42d5-941a-52e2b16a74ed-original-pull-secret podName:078e2a74-a77c-42d5-941a-52e2b16a74ed nodeName:}" failed. No retries permitted until 2026-09-07 03:48:22.828477984 +0000 UTC m=+6.140953870 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/078e2a74-a77c-42d5-941a-52e2b16a74ed-original-pull-secret") pod "global-pull-secret-syncer-tdrdx" (UID: "078e2a74-a77c-42d5-941a-52e2b16a74ed") : object "kube-system"/"original-pull-secret" not registered
Sep 07 03:48:20.929251 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:20.929161    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljc7f\" (UniqueName: \"kubernetes.io/projected/3ec3c1a7-cf5d-4e83-8497-f2c725850698-kube-api-access-ljc7f\") pod \"network-check-target-hvk8h\" (UID: \"3ec3c1a7-cf5d-4e83-8497-f2c725850698\") " pod="openshift-network-diagnostics/network-check-target-hvk8h"
Sep 07 03:48:20.929445 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:20.929426    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 03:48:20.929515 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:20.929455    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 03:48:20.929515 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:20.929470    2559 projected.go:196] Error preparing data for projected volume kube-api-access-ljc7f for pod openshift-network-diagnostics/network-check-target-hvk8h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 03:48:20.929628 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:20.929539    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ec3c1a7-cf5d-4e83-8497-f2c725850698-kube-api-access-ljc7f podName:3ec3c1a7-cf5d-4e83-8497-f2c725850698 nodeName:}" failed. No retries permitted until 2026-09-07 03:48:22.929517871 +0000 UTC m=+6.241993767 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ljc7f" (UniqueName: "kubernetes.io/projected/3ec3c1a7-cf5d-4e83-8497-f2c725850698-kube-api-access-ljc7f") pod "network-check-target-hvk8h" (UID: "3ec3c1a7-cf5d-4e83-8497-f2c725850698") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 03:48:21.152978 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:21.152868    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 03:43:19 +0000 UTC" deadline="2028-05-28 16:55:31.049571546 +0000 UTC"
Sep 07 03:48:21.152978 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:21.152941    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15109h7m9.89663506s"
Sep 07 03:48:21.175619 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:21.174823    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rg9j"
Sep 07 03:48:21.175619 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:21.174992    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rg9j" podUID="64880c7e-cc6b-462f-9d79-b9b6b48d34ca"
Sep 07 03:48:21.175619 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:21.175438    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdrdx"
Sep 07 03:48:21.175619 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:21.175544    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdrdx" podUID="078e2a74-a77c-42d5-941a-52e2b16a74ed"
Sep 07 03:48:21.176188 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:21.176043    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvk8h"
Sep 07 03:48:21.176188 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:21.176140    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvk8h" podUID="3ec3c1a7-cf5d-4e83-8497-f2c725850698"
Sep 07 03:48:21.200184 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:21.200065    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-4.ec2.internal" event={"ID":"136ee68bc096b03f0cd9fc22ad8e3b3c","Type":"ContainerStarted","Data":"b885dea11f6156847e46f46778be87160db54a5ab1c502d6f0d90fee3a695a9e"}
Sep 07 03:48:21.204520 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:21.204492    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9wr6n" event={"ID":"dfde1640-28bf-4ee0-94b0-62a6d26d04fe","Type":"ContainerStarted","Data":"ef5c648528fd31cd8c53fbfe4967bac8630275dc18df8c510975cb1d9625eaf7"}
Sep 07 03:48:21.211305 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:21.211239    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sh9jc" event={"ID":"89014237-e2cf-4af2-a1cd-57be201b0001","Type":"ContainerStarted","Data":"53d61e9b0d1a1ca0ad9aef3360ca5c0c62d0f6fa6c47e800a49837af3b24f339"}
Sep 07 03:48:21.216061 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:21.214828    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-4.ec2.internal" podStartSLOduration=3.214811462 podStartE2EDuration="3.214811462s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 03:48:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:48:21.214428573 +0000 UTC m=+4.526904482" watchObservedRunningTime="2026-09-07 03:48:21.214811462 +0000 UTC m=+4.527287375"
Sep 07 03:48:21.221403 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:21.221339    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-t7c8n" event={"ID":"b0fedcd8-4974-4bf5-af6f-41711c6bbedd","Type":"ContainerStarted","Data":"611f128becf3a3d53ab0048ee44d19c06ea4c2708051def52b510682571f7077"}
Sep 07 03:48:21.233732 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:21.233068    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9rxpx" event={"ID":"9d48a665-e3f4-4f7e-9b28-462f9954f0de","Type":"ContainerStarted","Data":"7fb9a7d32130fe59f5308a2b9805c06ebafa1b2c5f461b6b8710996647baffe1"}
Sep 07 03:48:21.239364 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:21.239337    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8jm9" event={"ID":"6468e5c3-32f3-4466-9722-255ad1443e7e","Type":"ContainerStarted","Data":"fadab6737237d48da7cae941ea613ce72589e86cc5bbcbbed74c4adb0660e2f7"}
Sep 07 03:48:21.254126 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:21.254014    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m" event={"ID":"83be5e03-f5e7-4c65-9fba-dcf128db003e","Type":"ContainerStarted","Data":"d460b98269ba9d31007e7cf467315ae1527dd4895fb4bb7b2bc826eb120512db"}
Sep 07 03:48:21.266428 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:21.266394    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jpqvg" event={"ID":"02324c56-a65f-4119-89d6-b5d48a9d9609","Type":"ContainerStarted","Data":"2c3cfbdff35586452f90714f1db7105741494aa6c80f127469f4882f5ddd0584"}
Sep 07 03:48:21.272347 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:21.271678    2559 generic.go:356] "Generic (PLEG): container finished" podID="b9f912e379492bbeba8124cc18d4ac87" containerID="34b1a27a67c6bb55afcac53302fe13b47556fe4036a492567a068191298ae706" exitCode=0
Sep 07 03:48:21.272347 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:21.271792    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal" event={"ID":"b9f912e379492bbeba8124cc18d4ac87","Type":"ContainerDied","Data":"34b1a27a67c6bb55afcac53302fe13b47556fe4036a492567a068191298ae706"}
Sep 07 03:48:21.283992 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:21.283915    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g7mf6" event={"ID":"9a89adb7-9035-489e-8c69-72a65791ba9d","Type":"ContainerStarted","Data":"c72d1b22f084971c91afec37c541b2942316089589aff42e3e3936a9e0b3b511"}
Sep 07 03:48:21.288944 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:21.288889    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-72b5b" event={"ID":"9dc17bd6-5586-49ea-a5d8-85860cad426f","Type":"ContainerStarted","Data":"8e1aea55f719cc916a26af205f4821a39e444b2fd8f47ea84170f99070bd230f"}
Sep 07 03:48:22.329525 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:22.329127    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal" event={"ID":"b9f912e379492bbeba8124cc18d4ac87","Type":"ContainerStarted","Data":"43fa39cb1fbe1e9e1dfcf8e30af38ee75117b5a3b13ed52199a6a92c283a27d8"}
Sep 07 03:48:22.746406 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:22.745768    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64880c7e-cc6b-462f-9d79-b9b6b48d34ca-metrics-certs\") pod \"network-metrics-daemon-7rg9j\" (UID: \"64880c7e-cc6b-462f-9d79-b9b6b48d34ca\") " pod="openshift-multus/network-metrics-daemon-7rg9j"
Sep 07 03:48:22.746406 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:22.745943    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 03:48:22.746406 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:22.746011    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64880c7e-cc6b-462f-9d79-b9b6b48d34ca-metrics-certs podName:64880c7e-cc6b-462f-9d79-b9b6b48d34ca nodeName:}" failed. No retries permitted until 2026-09-07 03:48:26.74599033 +0000 UTC m=+10.058466227 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64880c7e-cc6b-462f-9d79-b9b6b48d34ca-metrics-certs") pod "network-metrics-daemon-7rg9j" (UID: "64880c7e-cc6b-462f-9d79-b9b6b48d34ca") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 03:48:22.847863 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:22.847159    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/078e2a74-a77c-42d5-941a-52e2b16a74ed-original-pull-secret\") pod \"global-pull-secret-syncer-tdrdx\" (UID: \"078e2a74-a77c-42d5-941a-52e2b16a74ed\") " pod="kube-system/global-pull-secret-syncer-tdrdx"
Sep 07 03:48:22.847863 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:22.847367    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 03:48:22.847863 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:22.847444    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/078e2a74-a77c-42d5-941a-52e2b16a74ed-original-pull-secret podName:078e2a74-a77c-42d5-941a-52e2b16a74ed nodeName:}" failed. No retries permitted until 2026-09-07 03:48:26.847422056 +0000 UTC m=+10.159897942 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/078e2a74-a77c-42d5-941a-52e2b16a74ed-original-pull-secret") pod "global-pull-secret-syncer-tdrdx" (UID: "078e2a74-a77c-42d5-941a-52e2b16a74ed") : object "kube-system"/"original-pull-secret" not registered
Sep 07 03:48:22.948331 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:22.948286    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljc7f\" (UniqueName: \"kubernetes.io/projected/3ec3c1a7-cf5d-4e83-8497-f2c725850698-kube-api-access-ljc7f\") pod \"network-check-target-hvk8h\" (UID: \"3ec3c1a7-cf5d-4e83-8497-f2c725850698\") " pod="openshift-network-diagnostics/network-check-target-hvk8h"
Sep 07 03:48:22.948528 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:22.948508    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 03:48:22.948611 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:22.948536    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 03:48:22.948611 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:22.948549    2559 projected.go:196] Error preparing data for projected volume kube-api-access-ljc7f for pod openshift-network-diagnostics/network-check-target-hvk8h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 03:48:22.948746 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:22.948616    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ec3c1a7-cf5d-4e83-8497-f2c725850698-kube-api-access-ljc7f podName:3ec3c1a7-cf5d-4e83-8497-f2c725850698 nodeName:}" failed. No retries permitted until 2026-09-07 03:48:26.948594193 +0000 UTC m=+10.261070078 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ljc7f" (UniqueName: "kubernetes.io/projected/3ec3c1a7-cf5d-4e83-8497-f2c725850698-kube-api-access-ljc7f") pod "network-check-target-hvk8h" (UID: "3ec3c1a7-cf5d-4e83-8497-f2c725850698") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 03:48:23.177012 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:23.176605    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdrdx"
Sep 07 03:48:23.177012 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:23.176775    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdrdx" podUID="078e2a74-a77c-42d5-941a-52e2b16a74ed"
Sep 07 03:48:23.177012 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:23.176783    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvk8h"
Sep 07 03:48:23.177012 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:23.176875    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvk8h" podUID="3ec3c1a7-cf5d-4e83-8497-f2c725850698"
Sep 07 03:48:23.177012 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:23.176898    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rg9j"
Sep 07 03:48:23.177012 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:23.176980    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rg9j" podUID="64880c7e-cc6b-462f-9d79-b9b6b48d34ca"
Sep 07 03:48:25.176123 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:25.175573    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdrdx"
Sep 07 03:48:25.176123 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:25.175730    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rg9j"
Sep 07 03:48:25.176123 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:25.175735    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdrdx" podUID="078e2a74-a77c-42d5-941a-52e2b16a74ed"
Sep 07 03:48:25.176123 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:25.175840    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rg9j" podUID="64880c7e-cc6b-462f-9d79-b9b6b48d34ca"
Sep 07 03:48:25.176123 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:25.175875    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvk8h"
Sep 07 03:48:25.176123 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:25.175925    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvk8h" podUID="3ec3c1a7-cf5d-4e83-8497-f2c725850698"
Sep 07 03:48:26.781042 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:26.781008    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64880c7e-cc6b-462f-9d79-b9b6b48d34ca-metrics-certs\") pod \"network-metrics-daemon-7rg9j\" (UID: \"64880c7e-cc6b-462f-9d79-b9b6b48d34ca\") " pod="openshift-multus/network-metrics-daemon-7rg9j"
Sep 07 03:48:26.781510 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:26.781151    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 03:48:26.781510 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:26.781222    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64880c7e-cc6b-462f-9d79-b9b6b48d34ca-metrics-certs podName:64880c7e-cc6b-462f-9d79-b9b6b48d34ca nodeName:}" failed. No retries permitted until 2026-09-07 03:48:34.781202179 +0000 UTC m=+18.093678081 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64880c7e-cc6b-462f-9d79-b9b6b48d34ca-metrics-certs") pod "network-metrics-daemon-7rg9j" (UID: "64880c7e-cc6b-462f-9d79-b9b6b48d34ca") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 03:48:26.881470 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:26.881434    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/078e2a74-a77c-42d5-941a-52e2b16a74ed-original-pull-secret\") pod \"global-pull-secret-syncer-tdrdx\" (UID: \"078e2a74-a77c-42d5-941a-52e2b16a74ed\") " pod="kube-system/global-pull-secret-syncer-tdrdx"
Sep 07 03:48:26.881648 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:26.881606    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 03:48:26.881724 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:26.881672    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/078e2a74-a77c-42d5-941a-52e2b16a74ed-original-pull-secret podName:078e2a74-a77c-42d5-941a-52e2b16a74ed nodeName:}" failed. No retries permitted until 2026-09-07 03:48:34.881655885 +0000 UTC m=+18.194131766 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/078e2a74-a77c-42d5-941a-52e2b16a74ed-original-pull-secret") pod "global-pull-secret-syncer-tdrdx" (UID: "078e2a74-a77c-42d5-941a-52e2b16a74ed") : object "kube-system"/"original-pull-secret" not registered
Sep 07 03:48:26.982035 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:26.981996    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljc7f\" (UniqueName: \"kubernetes.io/projected/3ec3c1a7-cf5d-4e83-8497-f2c725850698-kube-api-access-ljc7f\") pod \"network-check-target-hvk8h\" (UID: \"3ec3c1a7-cf5d-4e83-8497-f2c725850698\") " pod="openshift-network-diagnostics/network-check-target-hvk8h"
Sep 07 03:48:26.982247 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:26.982222    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 03:48:26.982247 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:26.982255    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 03:48:26.982406 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:26.982268    2559 projected.go:196] Error preparing data for projected volume kube-api-access-ljc7f for pod openshift-network-diagnostics/network-check-target-hvk8h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 03:48:26.982406 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:26.982328    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ec3c1a7-cf5d-4e83-8497-f2c725850698-kube-api-access-ljc7f podName:3ec3c1a7-cf5d-4e83-8497-f2c725850698 nodeName:}" failed. No retries permitted until 2026-09-07 03:48:34.982308974 +0000 UTC m=+18.294784859 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ljc7f" (UniqueName: "kubernetes.io/projected/3ec3c1a7-cf5d-4e83-8497-f2c725850698-kube-api-access-ljc7f") pod "network-check-target-hvk8h" (UID: "3ec3c1a7-cf5d-4e83-8497-f2c725850698") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 03:48:27.173279 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:27.173246    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rg9j"
Sep 07 03:48:27.173442 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:27.173369    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rg9j" podUID="64880c7e-cc6b-462f-9d79-b9b6b48d34ca"
Sep 07 03:48:27.173442 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:27.173429    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdrdx"
Sep 07 03:48:27.180171 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:27.180135    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdrdx" podUID="078e2a74-a77c-42d5-941a-52e2b16a74ed"
Sep 07 03:48:27.180701 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:27.180680    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvk8h"
Sep 07 03:48:27.180813 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:27.180793    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvk8h" podUID="3ec3c1a7-cf5d-4e83-8497-f2c725850698"
Sep 07 03:48:29.173752 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:29.173724    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rg9j"
Sep 07 03:48:29.174218 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:29.173863    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rg9j" podUID="64880c7e-cc6b-462f-9d79-b9b6b48d34ca"
Sep 07 03:48:29.174218 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:29.174035    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdrdx"
Sep 07 03:48:29.174218 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:29.174120    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdrdx" podUID="078e2a74-a77c-42d5-941a-52e2b16a74ed"
Sep 07 03:48:29.174218 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:29.174157    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvk8h"
Sep 07 03:48:29.174423 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:29.174229    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvk8h" podUID="3ec3c1a7-cf5d-4e83-8497-f2c725850698"
Sep 07 03:48:31.173844 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:31.173810    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdrdx"
Sep 07 03:48:31.173844 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:31.173829    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rg9j"
Sep 07 03:48:31.174223 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:31.173830    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvk8h"
Sep 07 03:48:31.174223 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:31.173910    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdrdx" podUID="078e2a74-a77c-42d5-941a-52e2b16a74ed"
Sep 07 03:48:31.174223 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:31.174018    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rg9j" podUID="64880c7e-cc6b-462f-9d79-b9b6b48d34ca"
Sep 07 03:48:31.174223 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:31.174104    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvk8h" podUID="3ec3c1a7-cf5d-4e83-8497-f2c725850698"
Sep 07 03:48:33.173856 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:33.173814    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdrdx"
Sep 07 03:48:33.174300 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:33.173870    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rg9j"
Sep 07 03:48:33.174300 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:33.173820    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvk8h"
Sep 07 03:48:33.174300 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:33.173946    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdrdx" podUID="078e2a74-a77c-42d5-941a-52e2b16a74ed"
Sep 07 03:48:33.174300 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:33.174026    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvk8h" podUID="3ec3c1a7-cf5d-4e83-8497-f2c725850698"
Sep 07 03:48:33.174300 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:33.174130    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rg9j" podUID="64880c7e-cc6b-462f-9d79-b9b6b48d34ca"
Sep 07 03:48:34.839652 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:34.839600    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64880c7e-cc6b-462f-9d79-b9b6b48d34ca-metrics-certs\") pod \"network-metrics-daemon-7rg9j\" (UID: \"64880c7e-cc6b-462f-9d79-b9b6b48d34ca\") " pod="openshift-multus/network-metrics-daemon-7rg9j"
Sep 07 03:48:34.840129 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:34.839745    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 03:48:34.840129 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:34.839838    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64880c7e-cc6b-462f-9d79-b9b6b48d34ca-metrics-certs podName:64880c7e-cc6b-462f-9d79-b9b6b48d34ca nodeName:}" failed. No retries permitted until 2026-09-07 03:48:50.839820335 +0000 UTC m=+34.152296236 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64880c7e-cc6b-462f-9d79-b9b6b48d34ca-metrics-certs") pod "network-metrics-daemon-7rg9j" (UID: "64880c7e-cc6b-462f-9d79-b9b6b48d34ca") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 03:48:34.940736 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:34.940696    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/078e2a74-a77c-42d5-941a-52e2b16a74ed-original-pull-secret\") pod \"global-pull-secret-syncer-tdrdx\" (UID: \"078e2a74-a77c-42d5-941a-52e2b16a74ed\") " pod="kube-system/global-pull-secret-syncer-tdrdx"
Sep 07 03:48:34.940895 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:34.940846    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 03:48:34.940943 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:34.940912    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/078e2a74-a77c-42d5-941a-52e2b16a74ed-original-pull-secret podName:078e2a74-a77c-42d5-941a-52e2b16a74ed nodeName:}" failed. No retries permitted until 2026-09-07 03:48:50.94089599 +0000 UTC m=+34.253371871 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/078e2a74-a77c-42d5-941a-52e2b16a74ed-original-pull-secret") pod "global-pull-secret-syncer-tdrdx" (UID: "078e2a74-a77c-42d5-941a-52e2b16a74ed") : object "kube-system"/"original-pull-secret" not registered
Sep 07 03:48:35.041598 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:35.041565    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljc7f\" (UniqueName: \"kubernetes.io/projected/3ec3c1a7-cf5d-4e83-8497-f2c725850698-kube-api-access-ljc7f\") pod \"network-check-target-hvk8h\" (UID: \"3ec3c1a7-cf5d-4e83-8497-f2c725850698\") " pod="openshift-network-diagnostics/network-check-target-hvk8h"
Sep 07 03:48:35.041741 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:35.041691    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 03:48:35.041741 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:35.041705    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 03:48:35.041741 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:35.041714    2559 projected.go:196] Error preparing data for projected volume kube-api-access-ljc7f for pod openshift-network-diagnostics/network-check-target-hvk8h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 03:48:35.041837 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:35.041761    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ec3c1a7-cf5d-4e83-8497-f2c725850698-kube-api-access-ljc7f podName:3ec3c1a7-cf5d-4e83-8497-f2c725850698 nodeName:}" failed. No retries permitted until 2026-09-07 03:48:51.041745218 +0000 UTC m=+34.354221099 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ljc7f" (UniqueName: "kubernetes.io/projected/3ec3c1a7-cf5d-4e83-8497-f2c725850698-kube-api-access-ljc7f") pod "network-check-target-hvk8h" (UID: "3ec3c1a7-cf5d-4e83-8497-f2c725850698") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 03:48:35.174027 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:35.173997    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdrdx"
Sep 07 03:48:35.174027 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:35.174011    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvk8h"
Sep 07 03:48:35.174204 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:35.174091    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdrdx" podUID="078e2a74-a77c-42d5-941a-52e2b16a74ed"
Sep 07 03:48:35.174265 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:35.174193    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvk8h" podUID="3ec3c1a7-cf5d-4e83-8497-f2c725850698"
Sep 07 03:48:35.174265 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:35.174253    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rg9j"
Sep 07 03:48:35.174368 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:35.174352    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rg9j" podUID="64880c7e-cc6b-462f-9d79-b9b6b48d34ca"
Sep 07 03:48:37.173703 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:37.173666    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvk8h"
Sep 07 03:48:37.174139 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:37.173772    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvk8h" podUID="3ec3c1a7-cf5d-4e83-8497-f2c725850698"
Sep 07 03:48:37.174139 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:37.173797    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdrdx"
Sep 07 03:48:37.174139 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:37.173899    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdrdx" podUID="078e2a74-a77c-42d5-941a-52e2b16a74ed"
Sep 07 03:48:37.174139 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:37.173958    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rg9j"
Sep 07 03:48:37.174139 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:37.174033    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rg9j" podUID="64880c7e-cc6b-462f-9d79-b9b6b48d34ca"
Sep 07 03:48:39.174362 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:39.174037    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdrdx"
Sep 07 03:48:39.175088 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:39.174050    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvk8h"
Sep 07 03:48:39.175088 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:39.174443    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdrdx" podUID="078e2a74-a77c-42d5-941a-52e2b16a74ed"
Sep 07 03:48:39.175088 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:39.174494    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvk8h" podUID="3ec3c1a7-cf5d-4e83-8497-f2c725850698"
Sep 07 03:48:39.175088 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:39.174115    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rg9j"
Sep 07 03:48:39.175088 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:39.174639    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rg9j" podUID="64880c7e-cc6b-462f-9d79-b9b6b48d34ca"
Sep 07 03:48:39.365970 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:39.365935    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9wr6n" event={"ID":"dfde1640-28bf-4ee0-94b0-62a6d26d04fe","Type":"ContainerStarted","Data":"74123a77c0298b01f86e5566da907243eff74a49efec66f23f8355669bf4a0c2"}
Sep 07 03:48:39.367758 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:39.367699    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-t7c8n" event={"ID":"b0fedcd8-4974-4bf5-af6f-41711c6bbedd","Type":"ContainerStarted","Data":"4055a627dbf3a72b88fd6de8ad39d13269f8e75225190e8a5c05976e88f771de"}
Sep 07 03:48:39.369475 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:39.369447    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9rxpx" event={"ID":"9d48a665-e3f4-4f7e-9b28-462f9954f0de","Type":"ContainerStarted","Data":"69805f6e2c3cfad8e09d714b62284b0897b6197f4d7c135b8061b3de21198ed8"}
Sep 07 03:48:39.371120 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:39.371094    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8jm9" event={"ID":"6468e5c3-32f3-4466-9722-255ad1443e7e","Type":"ContainerStarted","Data":"e32c961758735d339d0bff9d5e1fa618396fba9c09f7c0beb5f627747c0c349e"}
Sep 07 03:48:39.374604 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:39.374575    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m" event={"ID":"83be5e03-f5e7-4c65-9fba-dcf128db003e","Type":"ContainerStarted","Data":"3440fe1bb354f9af3d2f7c0ac6bc39d13d8c3c4b75cedf1d4bee13969d285142"}
Sep 07 03:48:39.374728 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:39.374659    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m" event={"ID":"83be5e03-f5e7-4c65-9fba-dcf128db003e","Type":"ContainerStarted","Data":"7fea8a5eafc46af99093556a205e1363418e62713b3fa566b1b0a52f8715ffb2"}
Sep 07 03:48:39.374728 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:39.374696    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m" event={"ID":"83be5e03-f5e7-4c65-9fba-dcf128db003e","Type":"ContainerStarted","Data":"4639289e419f86c9527196986904b3d4789db89fab1ffd303630435a74f99b72"}
Sep 07 03:48:39.374838 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:39.374740    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m" event={"ID":"83be5e03-f5e7-4c65-9fba-dcf128db003e","Type":"ContainerStarted","Data":"776d961ad224ed988b718680f19da57252f549e9be6f398400774574e6927fb6"}
Sep 07 03:48:39.374838 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:39.374791    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m" event={"ID":"83be5e03-f5e7-4c65-9fba-dcf128db003e","Type":"ContainerStarted","Data":"aea8f4fb51c612add72a8f6c5ab18f1cfc52402908e1e525657aefd100c2a49e"}
Sep 07 03:48:39.374934 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:39.374838    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m" event={"ID":"83be5e03-f5e7-4c65-9fba-dcf128db003e","Type":"ContainerStarted","Data":"45901fed2e7d8c6d97a86bb0410894f113046fc6022e81564c1643104c4c7d86"}
Sep 07 03:48:39.376257 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:39.376234    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jpqvg" event={"ID":"02324c56-a65f-4119-89d6-b5d48a9d9609","Type":"ContainerStarted","Data":"bf82909d975a26dd892948dc00dfb44f05d88507c4c9a6cb2e760558874d01c6"}
Sep 07 03:48:39.377986 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:39.377963    2559 generic.go:356] "Generic (PLEG): container finished" podID="9a89adb7-9035-489e-8c69-72a65791ba9d" containerID="22946a2698630cca8b98fb682aa7ecb567824e42e8aa639fbecd6bd40a71da91" exitCode=0
Sep 07 03:48:39.378088 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:39.378043    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g7mf6" event={"ID":"9a89adb7-9035-489e-8c69-72a65791ba9d","Type":"ContainerDied","Data":"22946a2698630cca8b98fb682aa7ecb567824e42e8aa639fbecd6bd40a71da91"}
Sep 07 03:48:39.379746 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:39.379724    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-72b5b" event={"ID":"9dc17bd6-5586-49ea-a5d8-85860cad426f","Type":"ContainerStarted","Data":"20af722c9cca3e84ab2d90fec3565c58089f590bbc5892906d9a28e7a35457b1"}
Sep 07 03:48:39.382074 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:39.382035    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9wr6n" podStartSLOduration=4.163344631 podStartE2EDuration="22.38202306s" totalImagesPullingTime="18.218678429s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 03:48:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:48:39.381346327 +0000 UTC m=+22.693822230" watchObservedRunningTime="2026-09-07 03:48:39.38202306 +0000 UTC m=+22.694498985"
Sep 07 03:48:39.382195 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:39.382173    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-4.ec2.internal" podStartSLOduration=21.382167366 podStartE2EDuration="21.382167366s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 03:48:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:48:22.346801378 +0000 UTC m=+5.659277285" watchObservedRunningTime="2026-09-07 03:48:39.382167366 +0000 UTC m=+22.694643269"
Sep 07 03:48:39.393792 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:39.393755    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-72b5b" podStartSLOduration=4.157807365 podStartE2EDuration="22.393743225s" totalImagesPullingTime="18.23593586s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 03:48:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:48:39.393346054 +0000 UTC m=+22.705821955" watchObservedRunningTime="2026-09-07 03:48:39.393743225 +0000 UTC m=+22.706219127"
Sep 07 03:48:39.425820 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:39.425772    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-9rxpx" podStartSLOduration=4.140414156 podStartE2EDuration="22.425754688s" totalImagesPullingTime="18.285340532s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 03:48:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:48:39.425025855 +0000 UTC m=+22.737501758" watchObservedRunningTime="2026-09-07 03:48:39.425754688 +0000 UTC m=+22.738230590"
Sep 07 03:48:39.451033 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:39.450993    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jpqvg" podStartSLOduration=4.218483588 podStartE2EDuration="22.450979957s" totalImagesPullingTime="18.232496369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 03:48:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:48:39.450823842 +0000 UTC m=+22.763299741" watchObservedRunningTime="2026-09-07 03:48:39.450979957 +0000 UTC m=+22.763455881"
Sep 07 03:48:39.451148 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:39.451122    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-t7c8n" podStartSLOduration=4.231983935 podStartE2EDuration="22.45111628s" totalImagesPullingTime="18.219132345s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 03:48:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:48:39.437780466 +0000 UTC m=+22.750256371" watchObservedRunningTime="2026-09-07 03:48:39.45111628 +0000 UTC m=+22.763592181"
Sep 07 03:48:40.139580 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:40.139554    2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 07 03:48:40.186124 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:40.186032    2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-07T03:48:40.139576871Z","UUID":"797f7613-8c3d-459e-9689-84de4a7c71a1","Handler":null,"Name":"","Endpoint":""}
Sep 07 03:48:40.187682 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:40.187664    2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 07 03:48:40.187780 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:40.187692    2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 07 03:48:40.384271 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:40.384235    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sh9jc" event={"ID":"89014237-e2cf-4af2-a1cd-57be201b0001","Type":"ContainerStarted","Data":"b24c934b2a02092424a34e21d6abbd0f17eb79b678cdc7ff209ec0077c3fad6b"}
Sep 07 03:48:40.386703 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:40.386655    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8jm9" event={"ID":"6468e5c3-32f3-4466-9722-255ad1443e7e","Type":"ContainerStarted","Data":"fdaab61eca8177a82cb3abed21a99ad9d050e63153462cf1f754e9869d5814de"}
Sep 07 03:48:40.397689 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:40.397647    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-sh9jc" podStartSLOduration=5.173815221 podStartE2EDuration="23.397610811s" totalImagesPullingTime="18.22379559s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 03:48:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:48:40.39735163 +0000 UTC m=+23.709827532" watchObservedRunningTime="2026-09-07 03:48:40.397610811 +0000 UTC m=+23.710086739"
Sep 07 03:48:41.173546 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:41.173470    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdrdx"
Sep 07 03:48:41.173546 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:41.173508    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rg9j"
Sep 07 03:48:41.173782 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:41.173598    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdrdx" podUID="078e2a74-a77c-42d5-941a-52e2b16a74ed"
Sep 07 03:48:41.173965 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:41.173939    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvk8h"
Sep 07 03:48:41.174080 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:41.174060    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvk8h" podUID="3ec3c1a7-cf5d-4e83-8497-f2c725850698"
Sep 07 03:48:41.174172 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:41.174143    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rg9j" podUID="64880c7e-cc6b-462f-9d79-b9b6b48d34ca"
Sep 07 03:48:41.391496 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:41.391467    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8jm9" event={"ID":"6468e5c3-32f3-4466-9722-255ad1443e7e","Type":"ContainerStarted","Data":"001442df5400c1864efc839e673dc53ed6b1c6a967937dbb01b7f42af43beea2"}
Sep 07 03:48:41.395569 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:41.395538    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m" event={"ID":"83be5e03-f5e7-4c65-9fba-dcf128db003e","Type":"ContainerStarted","Data":"2fab7b568c7e395f9370a8cf374941bbf23b366dec088e8f7e99b77cd2a629de"}
Sep 07 03:48:41.411071 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:41.410938    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8jm9" podStartSLOduration=3.898281898 podStartE2EDuration="24.410919155s" totalImagesPullingTime="20.512637257s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 03:48:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:48:41.410178762 +0000 UTC m=+24.722654665" watchObservedRunningTime="2026-09-07 03:48:41.410919155 +0000 UTC m=+24.723395059"
Sep 07 03:48:43.173466 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:43.173424    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdrdx"
Sep 07 03:48:43.173973 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:43.173424    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvk8h"
Sep 07 03:48:43.173973 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:43.173582    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rg9j"
Sep 07 03:48:43.173973 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:43.173579    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdrdx" podUID="078e2a74-a77c-42d5-941a-52e2b16a74ed"
Sep 07 03:48:43.173973 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:43.173692    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvk8h" podUID="3ec3c1a7-cf5d-4e83-8497-f2c725850698"
Sep 07 03:48:43.173973 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:43.173775    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rg9j" podUID="64880c7e-cc6b-462f-9d79-b9b6b48d34ca"
Sep 07 03:48:43.339360 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:43.339329    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jpqvg"
Sep 07 03:48:43.339947 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:43.339921    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jpqvg"
Sep 07 03:48:43.400441 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:43.400416    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jpqvg"
Sep 07 03:48:43.400950 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:43.400928    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jpqvg"
Sep 07 03:48:44.406276 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:44.406041    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m" event={"ID":"83be5e03-f5e7-4c65-9fba-dcf128db003e","Type":"ContainerStarted","Data":"c9fb7c8aced3c872b902c1905f83cf51a12022b237318cacf085c44eb9986d79"}
Sep 07 03:48:44.407084 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:44.406344    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:44.407084 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:44.406399    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:44.408256 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:44.408232    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g7mf6" event={"ID":"9a89adb7-9035-489e-8c69-72a65791ba9d","Type":"ContainerStarted","Data":"065a3a9d755fab1eb3cf203e81abb68a09d9489759fe75e8b2e96f71b4f36ab1"}
Sep 07 03:48:44.421283 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:44.421234    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:44.432231 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:44.432193    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m" podStartSLOduration=9.12733954 podStartE2EDuration="27.432180298s" totalImagesPullingTime="18.304840758s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 03:48:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:48:44.431852146 +0000 UTC m=+27.744328048" watchObservedRunningTime="2026-09-07 03:48:44.432180298 +0000 UTC m=+27.744656209"
Sep 07 03:48:45.173521 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:45.173490    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rg9j"
Sep 07 03:48:45.173816 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:45.173500    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdrdx"
Sep 07 03:48:45.173816 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:45.173592    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rg9j" podUID="64880c7e-cc6b-462f-9d79-b9b6b48d34ca"
Sep 07 03:48:45.173816 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:45.173686    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdrdx" podUID="078e2a74-a77c-42d5-941a-52e2b16a74ed"
Sep 07 03:48:45.173816 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:45.173751    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvk8h"
Sep 07 03:48:45.173985 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:45.173835    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvk8h" podUID="3ec3c1a7-cf5d-4e83-8497-f2c725850698"
Sep 07 03:48:45.412045 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:45.412010    2559 generic.go:356] "Generic (PLEG): container finished" podID="9a89adb7-9035-489e-8c69-72a65791ba9d" containerID="065a3a9d755fab1eb3cf203e81abb68a09d9489759fe75e8b2e96f71b4f36ab1" exitCode=0
Sep 07 03:48:45.412416 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:45.412083    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g7mf6" event={"ID":"9a89adb7-9035-489e-8c69-72a65791ba9d","Type":"ContainerDied","Data":"065a3a9d755fab1eb3cf203e81abb68a09d9489759fe75e8b2e96f71b4f36ab1"}
Sep 07 03:48:45.412567 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:45.412540    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:45.426791 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:45.426723    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:48:45.999322 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:45.999293    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7rg9j"]
Sep 07 03:48:45.999511 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:45.999406    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rg9j"
Sep 07 03:48:45.999564 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:45.999534    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rg9j" podUID="64880c7e-cc6b-462f-9d79-b9b6b48d34ca"
Sep 07 03:48:45.999998 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:45.999973    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tdrdx"]
Sep 07 03:48:46.000119 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:46.000063    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdrdx"
Sep 07 03:48:46.000180 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:46.000160    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdrdx" podUID="078e2a74-a77c-42d5-941a-52e2b16a74ed"
Sep 07 03:48:46.010318 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:46.010265    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hvk8h"]
Sep 07 03:48:46.010398 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:46.010328    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvk8h"
Sep 07 03:48:46.010398 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:46.010384    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvk8h" podUID="3ec3c1a7-cf5d-4e83-8497-f2c725850698"
Sep 07 03:48:46.416456 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:46.416419    2559 generic.go:356] "Generic (PLEG): container finished" podID="9a89adb7-9035-489e-8c69-72a65791ba9d" containerID="9e20789b6721697449f2600f1ab770a43723845333a8919ced74c2d5d94c2b4f" exitCode=0
Sep 07 03:48:46.416897 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:46.416509    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g7mf6" event={"ID":"9a89adb7-9035-489e-8c69-72a65791ba9d","Type":"ContainerDied","Data":"9e20789b6721697449f2600f1ab770a43723845333a8919ced74c2d5d94c2b4f"}
Sep 07 03:48:47.175184 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:47.175155    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdrdx"
Sep 07 03:48:47.175339 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:47.175266    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdrdx" podUID="078e2a74-a77c-42d5-941a-52e2b16a74ed"
Sep 07 03:48:47.175339 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:47.175324    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvk8h"
Sep 07 03:48:47.175454 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:47.175432    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvk8h" podUID="3ec3c1a7-cf5d-4e83-8497-f2c725850698"
Sep 07 03:48:47.421361 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:47.421325    2559 generic.go:356] "Generic (PLEG): container finished" podID="9a89adb7-9035-489e-8c69-72a65791ba9d" containerID="0b5eded57e54eae880cefd5cc1a596002b54810bf29da7bae057873800946186" exitCode=0
Sep 07 03:48:47.423009 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:47.422973    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g7mf6" event={"ID":"9a89adb7-9035-489e-8c69-72a65791ba9d","Type":"ContainerDied","Data":"0b5eded57e54eae880cefd5cc1a596002b54810bf29da7bae057873800946186"}
Sep 07 03:48:48.173920 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:48.173710    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rg9j"
Sep 07 03:48:48.174104 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:48.174038    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rg9j" podUID="64880c7e-cc6b-462f-9d79-b9b6b48d34ca"
Sep 07 03:48:48.606066 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:48.606031    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-72b5b_9dc17bd6-5586-49ea-a5d8-85860cad426f/dns-node-resolver/0.log"
Sep 07 03:48:49.173260 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:49.173225    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdrdx"
Sep 07 03:48:49.173425 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:49.173329    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdrdx" podUID="078e2a74-a77c-42d5-941a-52e2b16a74ed"
Sep 07 03:48:49.173425 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:49.173400    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvk8h"
Sep 07 03:48:49.173509 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:49.173494    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvk8h" podUID="3ec3c1a7-cf5d-4e83-8497-f2c725850698"
Sep 07 03:48:49.589333 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:49.589254    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-t7c8n_b0fedcd8-4974-4bf5-af6f-41711c6bbedd/node-ca/0.log"
Sep 07 03:48:50.173486 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:50.173452    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rg9j"
Sep 07 03:48:50.173922 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:50.173595    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rg9j" podUID="64880c7e-cc6b-462f-9d79-b9b6b48d34ca"
Sep 07 03:48:50.856788 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:50.856756    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64880c7e-cc6b-462f-9d79-b9b6b48d34ca-metrics-certs\") pod \"network-metrics-daemon-7rg9j\" (UID: \"64880c7e-cc6b-462f-9d79-b9b6b48d34ca\") " pod="openshift-multus/network-metrics-daemon-7rg9j"
Sep 07 03:48:50.857004 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:50.856895    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 03:48:50.857004 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:50.856957    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64880c7e-cc6b-462f-9d79-b9b6b48d34ca-metrics-certs podName:64880c7e-cc6b-462f-9d79-b9b6b48d34ca nodeName:}" failed. No retries permitted until 2026-09-07 03:49:22.856941448 +0000 UTC m=+66.169417329 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/64880c7e-cc6b-462f-9d79-b9b6b48d34ca-metrics-certs") pod "network-metrics-daemon-7rg9j" (UID: "64880c7e-cc6b-462f-9d79-b9b6b48d34ca") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 03:48:50.958073 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:50.958028    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/078e2a74-a77c-42d5-941a-52e2b16a74ed-original-pull-secret\") pod \"global-pull-secret-syncer-tdrdx\" (UID: \"078e2a74-a77c-42d5-941a-52e2b16a74ed\") " pod="kube-system/global-pull-secret-syncer-tdrdx"
Sep 07 03:48:50.958251 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:50.958232    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 03:48:50.958325 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:50.958318    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/078e2a74-a77c-42d5-941a-52e2b16a74ed-original-pull-secret podName:078e2a74-a77c-42d5-941a-52e2b16a74ed nodeName:}" failed. No retries permitted until 2026-09-07 03:49:22.958296132 +0000 UTC m=+66.270772019 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/078e2a74-a77c-42d5-941a-52e2b16a74ed-original-pull-secret") pod "global-pull-secret-syncer-tdrdx" (UID: "078e2a74-a77c-42d5-941a-52e2b16a74ed") : object "kube-system"/"original-pull-secret" not registered
Sep 07 03:48:51.059400 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:51.059366    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljc7f\" (UniqueName: \"kubernetes.io/projected/3ec3c1a7-cf5d-4e83-8497-f2c725850698-kube-api-access-ljc7f\") pod \"network-check-target-hvk8h\" (UID: \"3ec3c1a7-cf5d-4e83-8497-f2c725850698\") " pod="openshift-network-diagnostics/network-check-target-hvk8h"
Sep 07 03:48:51.059574 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:51.059548    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 03:48:51.059574 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:51.059571    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 03:48:51.059713 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:51.059583    2559 projected.go:196] Error preparing data for projected volume kube-api-access-ljc7f for pod openshift-network-diagnostics/network-check-target-hvk8h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 03:48:51.059713 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:51.059665    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ec3c1a7-cf5d-4e83-8497-f2c725850698-kube-api-access-ljc7f podName:3ec3c1a7-cf5d-4e83-8497-f2c725850698 nodeName:}" failed. No retries permitted until 2026-09-07 03:49:23.059644523 +0000 UTC m=+66.372120433 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ljc7f" (UniqueName: "kubernetes.io/projected/3ec3c1a7-cf5d-4e83-8497-f2c725850698-kube-api-access-ljc7f") pod "network-check-target-hvk8h" (UID: "3ec3c1a7-cf5d-4e83-8497-f2c725850698") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 03:48:51.173349 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:51.173318    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdrdx"
Sep 07 03:48:51.173513 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:51.173325    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvk8h"
Sep 07 03:48:51.173513 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:51.173462    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdrdx" podUID="078e2a74-a77c-42d5-941a-52e2b16a74ed"
Sep 07 03:48:51.173513 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:48:51.173506    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvk8h" podUID="3ec3c1a7-cf5d-4e83-8497-f2c725850698"
Sep 07 03:48:51.516877 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:51.516849    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-4.ec2.internal" event="NodeReady"
Sep 07 03:48:51.517028 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:51.516986    2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 07 03:48:52.173850 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:52.173816    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rg9j"
Sep 07 03:48:52.176693 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:52.176660    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 07 03:48:52.176831 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:52.176701    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-25ldn\""
Sep 07 03:48:52.434878 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:52.434855    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g7mf6" event={"ID":"9a89adb7-9035-489e-8c69-72a65791ba9d","Type":"ContainerStarted","Data":"013db0d1d50797f2eb0f7aed8e679462db1b825ca65d8dc2a84e963377bc57d6"}
Sep 07 03:48:53.173580 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:53.173546    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdrdx"
Sep 07 03:48:53.173768 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:53.173748    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvk8h"
Sep 07 03:48:53.175875 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:53.175853    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 07 03:48:53.175875 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:53.175862    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 07 03:48:53.179086 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:53.176756    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 07 03:48:53.179086 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:53.177187    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wrs9m\""
Sep 07 03:48:53.440152 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:53.440073    2559 generic.go:356] "Generic (PLEG): container finished" podID="9a89adb7-9035-489e-8c69-72a65791ba9d" containerID="013db0d1d50797f2eb0f7aed8e679462db1b825ca65d8dc2a84e963377bc57d6" exitCode=0
Sep 07 03:48:53.440152 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:53.440110    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g7mf6" event={"ID":"9a89adb7-9035-489e-8c69-72a65791ba9d","Type":"ContainerDied","Data":"013db0d1d50797f2eb0f7aed8e679462db1b825ca65d8dc2a84e963377bc57d6"}
Sep 07 03:48:54.447484 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:54.447451    2559 generic.go:356] "Generic (PLEG): container finished" podID="9a89adb7-9035-489e-8c69-72a65791ba9d" containerID="c6f184954613c5ab000b365d33de97c21d6af7005e03f06560215993951f69f2" exitCode=0
Sep 07 03:48:54.447949 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:54.447507    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g7mf6" event={"ID":"9a89adb7-9035-489e-8c69-72a65791ba9d","Type":"ContainerDied","Data":"c6f184954613c5ab000b365d33de97c21d6af7005e03f06560215993951f69f2"}
Sep 07 03:48:55.453514 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:55.453479    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g7mf6" event={"ID":"9a89adb7-9035-489e-8c69-72a65791ba9d","Type":"ContainerStarted","Data":"316f86adee45abb854fdc53ae237c16619fb17f5888ab13706202ad442dbd8c1"}
Sep 07 03:48:55.471893 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:48:55.471848    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-g7mf6" podStartSLOduration=7.998250914 podStartE2EDuration="37.471831418s" totalImagesPullingTime="29.473580504s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 03:48:18 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:48:55.471163132 +0000 UTC m=+38.783639035" watchObservedRunningTime="2026-09-07 03:48:55.471831418 +0000 UTC m=+38.784307321"
Sep 07 03:49:09.640868 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.640833    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6bc8b58db7-8h557"]
Sep 07 03:49:09.642639 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.642604    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bc8b58db7-8h557"
Sep 07 03:49:09.644477 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.644453    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 07 03:49:09.644734 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.644719    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 07 03:49:09.644815 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.644798    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 07 03:49:09.645299 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.645286    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-njlgh\""
Sep 07 03:49:09.652396 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.652378    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 07 03:49:09.660512 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.660492    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bc8b58db7-8h557"]
Sep 07 03:49:09.699740 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.699716    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pqkmf"]
Sep 07 03:49:09.701414 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.701399    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pqkmf"
Sep 07 03:49:09.703372 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.703354    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 07 03:49:09.703468 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.703404    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-n9q8q\""
Sep 07 03:49:09.703468 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.703401    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 07 03:49:09.706263 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.706243    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7jwg7"]
Sep 07 03:49:09.709043 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.708384    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7jwg7"
Sep 07 03:49:09.711360 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.711344    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-b5xmc\""
Sep 07 03:49:09.712122 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.712105    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 07 03:49:09.712122 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.712115    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 07 03:49:09.712260 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.712201    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 07 03:49:09.715856 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.715837    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pqkmf"]
Sep 07 03:49:09.723598 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.723577    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7jwg7"]
Sep 07 03:49:09.728477 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.728457    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6jk9k"]
Sep 07 03:49:09.730200 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.730186    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6jk9k"
Sep 07 03:49:09.732782 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.732757    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 07 03:49:09.732869 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.732811    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 07 03:49:09.733044 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.733032    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 07 03:49:09.733094 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.733066    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 07 03:49:09.733514 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.733500    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7k4qm\""
Sep 07 03:49:09.744906 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.744823    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6jk9k"]
Sep 07 03:49:09.783457 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.783427    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/402c56f5-8cd6-4a03-a33f-85d0edb2ae3e-metrics-tls\") pod \"dns-default-pqkmf\" (UID: \"402c56f5-8cd6-4a03-a33f-85d0edb2ae3e\") " pod="openshift-dns/dns-default-pqkmf"
Sep 07 03:49:09.783562 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.783470    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md8pv\" (UniqueName: \"kubernetes.io/projected/ac541457-397f-4ea3-9c7a-2256f9ec8ffb-kube-api-access-md8pv\") pod \"ingress-canary-7jwg7\" (UID: \"ac541457-397f-4ea3-9c7a-2256f9ec8ffb\") " pod="openshift-ingress-canary/ingress-canary-7jwg7"
Sep 07 03:49:09.783562 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.783495    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82e20ff0-6f2f-44ff-8c2e-93c79ee0893e-trusted-ca\") pod \"image-registry-6bc8b58db7-8h557\" (UID: \"82e20ff0-6f2f-44ff-8c2e-93c79ee0893e\") " pod="openshift-image-registry/image-registry-6bc8b58db7-8h557"
Sep 07 03:49:09.783678 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.783556    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82e20ff0-6f2f-44ff-8c2e-93c79ee0893e-bound-sa-token\") pod \"image-registry-6bc8b58db7-8h557\" (UID: \"82e20ff0-6f2f-44ff-8c2e-93c79ee0893e\") " pod="openshift-image-registry/image-registry-6bc8b58db7-8h557"
Sep 07 03:49:09.783678 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.783595    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/82e20ff0-6f2f-44ff-8c2e-93c79ee0893e-installation-pull-secrets\") pod \"image-registry-6bc8b58db7-8h557\" (UID: \"82e20ff0-6f2f-44ff-8c2e-93c79ee0893e\") " pod="openshift-image-registry/image-registry-6bc8b58db7-8h557"
Sep 07 03:49:09.783678 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.783640    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/402c56f5-8cd6-4a03-a33f-85d0edb2ae3e-tmp-dir\") pod \"dns-default-pqkmf\" (UID: \"402c56f5-8cd6-4a03-a33f-85d0edb2ae3e\") " pod="openshift-dns/dns-default-pqkmf"
Sep 07 03:49:09.783678 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.783662    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/402c56f5-8cd6-4a03-a33f-85d0edb2ae3e-config-volume\") pod \"dns-default-pqkmf\" (UID: \"402c56f5-8cd6-4a03-a33f-85d0edb2ae3e\") " pod="openshift-dns/dns-default-pqkmf"
Sep 07 03:49:09.783678 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.783676    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wcz8\" (UniqueName: \"kubernetes.io/projected/402c56f5-8cd6-4a03-a33f-85d0edb2ae3e-kube-api-access-9wcz8\") pod \"dns-default-pqkmf\" (UID: \"402c56f5-8cd6-4a03-a33f-85d0edb2ae3e\") " pod="openshift-dns/dns-default-pqkmf"
Sep 07 03:49:09.783876 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.783692    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/82e20ff0-6f2f-44ff-8c2e-93c79ee0893e-registry-certificates\") pod \"image-registry-6bc8b58db7-8h557\" (UID: \"82e20ff0-6f2f-44ff-8c2e-93c79ee0893e\") " pod="openshift-image-registry/image-registry-6bc8b58db7-8h557"
Sep 07 03:49:09.783876 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.783710    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdhrw\" (UniqueName: \"kubernetes.io/projected/82e20ff0-6f2f-44ff-8c2e-93c79ee0893e-kube-api-access-cdhrw\") pod \"image-registry-6bc8b58db7-8h557\" (UID: \"82e20ff0-6f2f-44ff-8c2e-93c79ee0893e\") " pod="openshift-image-registry/image-registry-6bc8b58db7-8h557"
Sep 07 03:49:09.783876 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.783764    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac541457-397f-4ea3-9c7a-2256f9ec8ffb-cert\") pod \"ingress-canary-7jwg7\" (UID: \"ac541457-397f-4ea3-9c7a-2256f9ec8ffb\") " pod="openshift-ingress-canary/ingress-canary-7jwg7"
Sep 07 03:49:09.783876 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.783787    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/82e20ff0-6f2f-44ff-8c2e-93c79ee0893e-ca-trust-extracted\") pod \"image-registry-6bc8b58db7-8h557\" (UID: \"82e20ff0-6f2f-44ff-8c2e-93c79ee0893e\") " pod="openshift-image-registry/image-registry-6bc8b58db7-8h557"
Sep 07 03:49:09.783876 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.783850    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82e20ff0-6f2f-44ff-8c2e-93c79ee0893e-registry-tls\") pod \"image-registry-6bc8b58db7-8h557\" (UID: \"82e20ff0-6f2f-44ff-8c2e-93c79ee0893e\") " pod="openshift-image-registry/image-registry-6bc8b58db7-8h557"
Sep 07 03:49:09.784055 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.783895    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/82e20ff0-6f2f-44ff-8c2e-93c79ee0893e-image-registry-private-configuration\") pod \"image-registry-6bc8b58db7-8h557\" (UID: \"82e20ff0-6f2f-44ff-8c2e-93c79ee0893e\") " pod="openshift-image-registry/image-registry-6bc8b58db7-8h557"
Sep 07 03:49:09.884605 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.884574    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac541457-397f-4ea3-9c7a-2256f9ec8ffb-cert\") pod \"ingress-canary-7jwg7\" (UID: \"ac541457-397f-4ea3-9c7a-2256f9ec8ffb\") " pod="openshift-ingress-canary/ingress-canary-7jwg7"
Sep 07 03:49:09.884798 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.884612    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/82e20ff0-6f2f-44ff-8c2e-93c79ee0893e-ca-trust-extracted\") pod \"image-registry-6bc8b58db7-8h557\" (UID: \"82e20ff0-6f2f-44ff-8c2e-93c79ee0893e\") " pod="openshift-image-registry/image-registry-6bc8b58db7-8h557"
Sep 07 03:49:09.884798 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.884663    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82e20ff0-6f2f-44ff-8c2e-93c79ee0893e-registry-tls\") pod \"image-registry-6bc8b58db7-8h557\" (UID: \"82e20ff0-6f2f-44ff-8c2e-93c79ee0893e\") " pod="openshift-image-registry/image-registry-6bc8b58db7-8h557"
Sep 07 03:49:09.884798 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.884697    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/82e20ff0-6f2f-44ff-8c2e-93c79ee0893e-image-registry-private-configuration\") pod \"image-registry-6bc8b58db7-8h557\" (UID: \"82e20ff0-6f2f-44ff-8c2e-93c79ee0893e\") " pod="openshift-image-registry/image-registry-6bc8b58db7-8h557"
Sep 07 03:49:09.884798 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.884728    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cf07a827-6264-48a3-958c-c4102ba7ee5e-crio-socket\") pod \"insights-runtime-extractor-6jk9k\" (UID: \"cf07a827-6264-48a3-958c-c4102ba7ee5e\") " pod="openshift-insights/insights-runtime-extractor-6jk9k"
Sep 07 03:49:09.884798 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.884752    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t79fl\" (UniqueName: \"kubernetes.io/projected/cf07a827-6264-48a3-958c-c4102ba7ee5e-kube-api-access-t79fl\") pod \"insights-runtime-extractor-6jk9k\" (UID: \"cf07a827-6264-48a3-958c-c4102ba7ee5e\") " pod="openshift-insights/insights-runtime-extractor-6jk9k"
Sep 07 03:49:09.884798 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.884786    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/402c56f5-8cd6-4a03-a33f-85d0edb2ae3e-metrics-tls\") pod \"dns-default-pqkmf\" (UID: \"402c56f5-8cd6-4a03-a33f-85d0edb2ae3e\") " pod="openshift-dns/dns-default-pqkmf"
Sep 07 03:49:09.885106 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.884820    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md8pv\" (UniqueName: \"kubernetes.io/projected/ac541457-397f-4ea3-9c7a-2256f9ec8ffb-kube-api-access-md8pv\") pod \"ingress-canary-7jwg7\" (UID: \"ac541457-397f-4ea3-9c7a-2256f9ec8ffb\") " pod="openshift-ingress-canary/ingress-canary-7jwg7"
Sep 07 03:49:09.885106 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.884843    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82e20ff0-6f2f-44ff-8c2e-93c79ee0893e-trusted-ca\") pod \"image-registry-6bc8b58db7-8h557\" (UID: \"82e20ff0-6f2f-44ff-8c2e-93c79ee0893e\") " pod="openshift-image-registry/image-registry-6bc8b58db7-8h557"
Sep 07 03:49:09.885106 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.884870    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82e20ff0-6f2f-44ff-8c2e-93c79ee0893e-bound-sa-token\") pod \"image-registry-6bc8b58db7-8h557\" (UID: \"82e20ff0-6f2f-44ff-8c2e-93c79ee0893e\") " pod="openshift-image-registry/image-registry-6bc8b58db7-8h557"
Sep 07 03:49:09.885106 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.884897    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf07a827-6264-48a3-958c-c4102ba7ee5e-data-volume\") pod \"insights-runtime-extractor-6jk9k\" (UID: \"cf07a827-6264-48a3-958c-c4102ba7ee5e\") " pod="openshift-insights/insights-runtime-extractor-6jk9k"
Sep 07 03:49:09.885106 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.884940    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/82e20ff0-6f2f-44ff-8c2e-93c79ee0893e-installation-pull-secrets\") pod \"image-registry-6bc8b58db7-8h557\" (UID: \"82e20ff0-6f2f-44ff-8c2e-93c79ee0893e\") " pod="openshift-image-registry/image-registry-6bc8b58db7-8h557"
Sep 07 03:49:09.885106 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.884977    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/402c56f5-8cd6-4a03-a33f-85d0edb2ae3e-tmp-dir\") pod \"dns-default-pqkmf\" (UID: \"402c56f5-8cd6-4a03-a33f-85d0edb2ae3e\") " pod="openshift-dns/dns-default-pqkmf"
Sep 07 03:49:09.885106 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.885007    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/402c56f5-8cd6-4a03-a33f-85d0edb2ae3e-config-volume\") pod \"dns-default-pqkmf\" (UID: \"402c56f5-8cd6-4a03-a33f-85d0edb2ae3e\") " pod="openshift-dns/dns-default-pqkmf"
Sep 07 03:49:09.885106 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.885032    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wcz8\" (UniqueName: \"kubernetes.io/projected/402c56f5-8cd6-4a03-a33f-85d0edb2ae3e-kube-api-access-9wcz8\") pod \"dns-default-pqkmf\" (UID: \"402c56f5-8cd6-4a03-a33f-85d0edb2ae3e\") " pod="openshift-dns/dns-default-pqkmf"
Sep 07 03:49:09.885106 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.885056    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cf07a827-6264-48a3-958c-c4102ba7ee5e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6jk9k\" (UID: \"cf07a827-6264-48a3-958c-c4102ba7ee5e\") " pod="openshift-insights/insights-runtime-extractor-6jk9k"
Sep 07 03:49:09.885106 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.885070    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/82e20ff0-6f2f-44ff-8c2e-93c79ee0893e-ca-trust-extracted\") pod \"image-registry-6bc8b58db7-8h557\" (UID: \"82e20ff0-6f2f-44ff-8c2e-93c79ee0893e\") " pod="openshift-image-registry/image-registry-6bc8b58db7-8h557"
Sep 07 03:49:09.885106 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.885082    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/82e20ff0-6f2f-44ff-8c2e-93c79ee0893e-registry-certificates\") pod \"image-registry-6bc8b58db7-8h557\" (UID: \"82e20ff0-6f2f-44ff-8c2e-93c79ee0893e\") " pod="openshift-image-registry/image-registry-6bc8b58db7-8h557"
Sep 07 03:49:09.885106 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.885108    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdhrw\" (UniqueName: \"kubernetes.io/projected/82e20ff0-6f2f-44ff-8c2e-93c79ee0893e-kube-api-access-cdhrw\") pod \"image-registry-6bc8b58db7-8h557\" (UID: \"82e20ff0-6f2f-44ff-8c2e-93c79ee0893e\") " pod="openshift-image-registry/image-registry-6bc8b58db7-8h557"
Sep 07 03:49:09.885700 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.885133    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cf07a827-6264-48a3-958c-c4102ba7ee5e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6jk9k\" (UID: \"cf07a827-6264-48a3-958c-c4102ba7ee5e\") " pod="openshift-insights/insights-runtime-extractor-6jk9k"
Sep 07 03:49:09.885700 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.885588    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/402c56f5-8cd6-4a03-a33f-85d0edb2ae3e-tmp-dir\") pod \"dns-default-pqkmf\" (UID: \"402c56f5-8cd6-4a03-a33f-85d0edb2ae3e\") " pod="openshift-dns/dns-default-pqkmf"
Sep 07 03:49:09.886241 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.886102    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/402c56f5-8cd6-4a03-a33f-85d0edb2ae3e-config-volume\") pod \"dns-default-pqkmf\" (UID: \"402c56f5-8cd6-4a03-a33f-85d0edb2ae3e\") " pod="openshift-dns/dns-default-pqkmf"
Sep 07 03:49:09.886241 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.886175    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/82e20ff0-6f2f-44ff-8c2e-93c79ee0893e-registry-certificates\") pod \"image-registry-6bc8b58db7-8h557\" (UID: \"82e20ff0-6f2f-44ff-8c2e-93c79ee0893e\") " pod="openshift-image-registry/image-registry-6bc8b58db7-8h557"
Sep 07 03:49:09.886540 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.886518    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82e20ff0-6f2f-44ff-8c2e-93c79ee0893e-trusted-ca\") pod \"image-registry-6bc8b58db7-8h557\" (UID: \"82e20ff0-6f2f-44ff-8c2e-93c79ee0893e\") " pod="openshift-image-registry/image-registry-6bc8b58db7-8h557"
Sep 07 03:49:09.889082 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.889057    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/82e20ff0-6f2f-44ff-8c2e-93c79ee0893e-installation-pull-secrets\") pod \"image-registry-6bc8b58db7-8h557\" (UID: \"82e20ff0-6f2f-44ff-8c2e-93c79ee0893e\") " pod="openshift-image-registry/image-registry-6bc8b58db7-8h557"
Sep 07 03:49:09.889188 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.889093    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ac541457-397f-4ea3-9c7a-2256f9ec8ffb-cert\") pod \"ingress-canary-7jwg7\" (UID: \"ac541457-397f-4ea3-9c7a-2256f9ec8ffb\") " pod="openshift-ingress-canary/ingress-canary-7jwg7"
Sep 07 03:49:09.889188 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.889115    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/82e20ff0-6f2f-44ff-8c2e-93c79ee0893e-registry-tls\") pod \"image-registry-6bc8b58db7-8h557\" (UID: \"82e20ff0-6f2f-44ff-8c2e-93c79ee0893e\") " pod="openshift-image-registry/image-registry-6bc8b58db7-8h557"
Sep 07 03:49:09.889188 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.889069    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/402c56f5-8cd6-4a03-a33f-85d0edb2ae3e-metrics-tls\") pod \"dns-default-pqkmf\" (UID: \"402c56f5-8cd6-4a03-a33f-85d0edb2ae3e\") " pod="openshift-dns/dns-default-pqkmf"
Sep 07 03:49:09.889188 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.889149    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/82e20ff0-6f2f-44ff-8c2e-93c79ee0893e-image-registry-private-configuration\") pod \"image-registry-6bc8b58db7-8h557\" (UID: \"82e20ff0-6f2f-44ff-8c2e-93c79ee0893e\") " pod="openshift-image-registry/image-registry-6bc8b58db7-8h557"
Sep 07 03:49:09.892912 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.892862    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/82e20ff0-6f2f-44ff-8c2e-93c79ee0893e-bound-sa-token\") pod \"image-registry-6bc8b58db7-8h557\" (UID: \"82e20ff0-6f2f-44ff-8c2e-93c79ee0893e\") " pod="openshift-image-registry/image-registry-6bc8b58db7-8h557"
Sep 07 03:49:09.893264 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.893242    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-md8pv\" (UniqueName: \"kubernetes.io/projected/ac541457-397f-4ea3-9c7a-2256f9ec8ffb-kube-api-access-md8pv\") pod \"ingress-canary-7jwg7\" (UID: \"ac541457-397f-4ea3-9c7a-2256f9ec8ffb\") " pod="openshift-ingress-canary/ingress-canary-7jwg7"
Sep 07 03:49:09.893597 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.893581    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wcz8\" (UniqueName: \"kubernetes.io/projected/402c56f5-8cd6-4a03-a33f-85d0edb2ae3e-kube-api-access-9wcz8\") pod \"dns-default-pqkmf\" (UID: \"402c56f5-8cd6-4a03-a33f-85d0edb2ae3e\") " pod="openshift-dns/dns-default-pqkmf"
Sep 07 03:49:09.894468 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.894453    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdhrw\" (UniqueName: \"kubernetes.io/projected/82e20ff0-6f2f-44ff-8c2e-93c79ee0893e-kube-api-access-cdhrw\") pod \"image-registry-6bc8b58db7-8h557\" (UID: \"82e20ff0-6f2f-44ff-8c2e-93c79ee0893e\") " pod="openshift-image-registry/image-registry-6bc8b58db7-8h557"
Sep 07 03:49:09.951669 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.951610    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bc8b58db7-8h557"
Sep 07 03:49:09.986402 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.986360    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cf07a827-6264-48a3-958c-c4102ba7ee5e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6jk9k\" (UID: \"cf07a827-6264-48a3-958c-c4102ba7ee5e\") " pod="openshift-insights/insights-runtime-extractor-6jk9k"
Sep 07 03:49:09.986402 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.986394    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cf07a827-6264-48a3-958c-c4102ba7ee5e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6jk9k\" (UID: \"cf07a827-6264-48a3-958c-c4102ba7ee5e\") " pod="openshift-insights/insights-runtime-extractor-6jk9k"
Sep 07 03:49:09.986609 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.986436    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cf07a827-6264-48a3-958c-c4102ba7ee5e-crio-socket\") pod \"insights-runtime-extractor-6jk9k\" (UID: \"cf07a827-6264-48a3-958c-c4102ba7ee5e\") " pod="openshift-insights/insights-runtime-extractor-6jk9k"
Sep 07 03:49:09.986609 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.986451    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t79fl\" (UniqueName: \"kubernetes.io/projected/cf07a827-6264-48a3-958c-c4102ba7ee5e-kube-api-access-t79fl\") pod \"insights-runtime-extractor-6jk9k\" (UID: \"cf07a827-6264-48a3-958c-c4102ba7ee5e\") " pod="openshift-insights/insights-runtime-extractor-6jk9k"
Sep 07 03:49:09.986609 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.986475    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf07a827-6264-48a3-958c-c4102ba7ee5e-data-volume\") pod \"insights-runtime-extractor-6jk9k\" (UID: \"cf07a827-6264-48a3-958c-c4102ba7ee5e\") " pod="openshift-insights/insights-runtime-extractor-6jk9k"
Sep 07 03:49:09.986609 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.986550    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cf07a827-6264-48a3-958c-c4102ba7ee5e-crio-socket\") pod \"insights-runtime-extractor-6jk9k\" (UID: \"cf07a827-6264-48a3-958c-c4102ba7ee5e\") " pod="openshift-insights/insights-runtime-extractor-6jk9k"
Sep 07 03:49:09.986845 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.986824    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf07a827-6264-48a3-958c-c4102ba7ee5e-data-volume\") pod \"insights-runtime-extractor-6jk9k\" (UID: \"cf07a827-6264-48a3-958c-c4102ba7ee5e\") " pod="openshift-insights/insights-runtime-extractor-6jk9k"
Sep 07 03:49:09.986999 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.986982    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cf07a827-6264-48a3-958c-c4102ba7ee5e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6jk9k\" (UID: \"cf07a827-6264-48a3-958c-c4102ba7ee5e\") " pod="openshift-insights/insights-runtime-extractor-6jk9k"
Sep 07 03:49:09.989180 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:09.989153    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cf07a827-6264-48a3-958c-c4102ba7ee5e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6jk9k\" (UID: \"cf07a827-6264-48a3-958c-c4102ba7ee5e\") " pod="openshift-insights/insights-runtime-extractor-6jk9k"
Sep 07 03:49:10.005991 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:10.005964    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t79fl\" (UniqueName: \"kubernetes.io/projected/cf07a827-6264-48a3-958c-c4102ba7ee5e-kube-api-access-t79fl\") pod \"insights-runtime-extractor-6jk9k\" (UID: \"cf07a827-6264-48a3-958c-c4102ba7ee5e\") " pod="openshift-insights/insights-runtime-extractor-6jk9k"
Sep 07 03:49:10.012952 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:10.012929    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pqkmf"
Sep 07 03:49:10.020240 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:10.020217    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7jwg7"
Sep 07 03:49:10.038473 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:10.038446    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6jk9k"
Sep 07 03:49:10.232785 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:10.232693    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bc8b58db7-8h557"]
Sep 07 03:49:10.235689 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:49:10.235664    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82e20ff0_6f2f_44ff_8c2e_93c79ee0893e.slice/crio-15462aa609a2747bd2e0c4230340a36017da6f33b039b50e2eeae7431badc861 WatchSource:0}: Error finding container 15462aa609a2747bd2e0c4230340a36017da6f33b039b50e2eeae7431badc861: Status 404 returned error can't find the container with id 15462aa609a2747bd2e0c4230340a36017da6f33b039b50e2eeae7431badc861
Sep 07 03:49:10.287911 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:10.287882    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pqkmf"]
Sep 07 03:49:10.290657 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:49:10.290603    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod402c56f5_8cd6_4a03_a33f_85d0edb2ae3e.slice/crio-34243889a2d311df841231e8c488c4306795b5eb114341adb186d9d64bbc6294 WatchSource:0}: Error finding container 34243889a2d311df841231e8c488c4306795b5eb114341adb186d9d64bbc6294: Status 404 returned error can't find the container with id 34243889a2d311df841231e8c488c4306795b5eb114341adb186d9d64bbc6294
Sep 07 03:49:10.311044 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:10.311020    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7jwg7"]
Sep 07 03:49:10.314006 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:49:10.313815    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac541457_397f_4ea3_9c7a_2256f9ec8ffb.slice/crio-0cbad65aa94e0a8b48838fca4688c17672297922917ec4fe90ec5232a43e3b84 WatchSource:0}: Error finding container 0cbad65aa94e0a8b48838fca4688c17672297922917ec4fe90ec5232a43e3b84: Status 404 returned error can't find the container with id 0cbad65aa94e0a8b48838fca4688c17672297922917ec4fe90ec5232a43e3b84
Sep 07 03:49:10.314495 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:10.314473    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6jk9k"]
Sep 07 03:49:10.317413 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:49:10.317390    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf07a827_6264_48a3_958c_c4102ba7ee5e.slice/crio-e9b506c3196c5f5c04523b53d22e65aef5d51350bac531b5a270beb0e7786290 WatchSource:0}: Error finding container e9b506c3196c5f5c04523b53d22e65aef5d51350bac531b5a270beb0e7786290: Status 404 returned error can't find the container with id e9b506c3196c5f5c04523b53d22e65aef5d51350bac531b5a270beb0e7786290
Sep 07 03:49:10.489090 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:10.488989    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pqkmf" event={"ID":"402c56f5-8cd6-4a03-a33f-85d0edb2ae3e","Type":"ContainerStarted","Data":"34243889a2d311df841231e8c488c4306795b5eb114341adb186d9d64bbc6294"}
Sep 07 03:49:10.490261 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:10.490238    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7jwg7" event={"ID":"ac541457-397f-4ea3-9c7a-2256f9ec8ffb","Type":"ContainerStarted","Data":"0cbad65aa94e0a8b48838fca4688c17672297922917ec4fe90ec5232a43e3b84"}
Sep 07 03:49:10.491785 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:10.491758    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bc8b58db7-8h557" event={"ID":"82e20ff0-6f2f-44ff-8c2e-93c79ee0893e","Type":"ContainerStarted","Data":"151eb971a09391809b2dd91736ee7607fee8e6c37a8648924db5a8c85645ee9d"}
Sep 07 03:49:10.491875 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:10.491802    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bc8b58db7-8h557" event={"ID":"82e20ff0-6f2f-44ff-8c2e-93c79ee0893e","Type":"ContainerStarted","Data":"15462aa609a2747bd2e0c4230340a36017da6f33b039b50e2eeae7431badc861"}
Sep 07 03:49:10.491953 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:10.491880    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6bc8b58db7-8h557"
Sep 07 03:49:10.493269 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:10.493250    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6jk9k" event={"ID":"cf07a827-6264-48a3-958c-c4102ba7ee5e","Type":"ContainerStarted","Data":"99fdcb2ae3c15cb2c1490e683f464d103501d245098cfafddf4af357aba0a4b0"}
Sep 07 03:49:10.493357 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:10.493286    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6jk9k" event={"ID":"cf07a827-6264-48a3-958c-c4102ba7ee5e","Type":"ContainerStarted","Data":"e9b506c3196c5f5c04523b53d22e65aef5d51350bac531b5a270beb0e7786290"}
Sep 07 03:49:11.499253 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:11.499212    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6jk9k" event={"ID":"cf07a827-6264-48a3-958c-c4102ba7ee5e","Type":"ContainerStarted","Data":"39bc13ccf4a7b71aa670338f7bab73629f1699464d77f80486d3aead8839077f"}
Sep 07 03:49:12.504954 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:12.504912    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pqkmf" event={"ID":"402c56f5-8cd6-4a03-a33f-85d0edb2ae3e","Type":"ContainerStarted","Data":"ddf0b05c601140fc616141c5f1d0a38adcb2739791ad9f8aee0da647b00276b9"}
Sep 07 03:49:12.505473 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:12.504979    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pqkmf" event={"ID":"402c56f5-8cd6-4a03-a33f-85d0edb2ae3e","Type":"ContainerStarted","Data":"6f3290ce9512fcf0cbf3e4ddb57e455cd210fdd5e90d24a85460060f7f1ced9f"}
Sep 07 03:49:12.505473 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:12.505064    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pqkmf"
Sep 07 03:49:12.522403 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:12.522345    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6bc8b58db7-8h557" podStartSLOduration=3.522331127 podStartE2EDuration="3.522331127s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 03:49:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:49:10.515294406 +0000 UTC m=+53.827770310" watchObservedRunningTime="2026-09-07 03:49:12.522331127 +0000 UTC m=+55.834807026"
Sep 07 03:49:12.522834 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:12.522762    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-pqkmf" podStartSLOduration=1.96720421 podStartE2EDuration="3.522750783s" totalImagesPullingTime="1.555546573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 03:49:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:49:12.522154653 +0000 UTC m=+55.834630558" watchObservedRunningTime="2026-09-07 03:49:12.522750783 +0000 UTC m=+55.835226687"
Sep 07 03:49:13.509741 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:13.509651    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7jwg7" event={"ID":"ac541457-397f-4ea3-9c7a-2256f9ec8ffb","Type":"ContainerStarted","Data":"7120aa67cdc2a24ec90b32a52b1aad9f6b83587bcb736826172c84ffad3bd611"}
Sep 07 03:49:13.511847 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:13.511814    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6jk9k" event={"ID":"cf07a827-6264-48a3-958c-c4102ba7ee5e","Type":"ContainerStarted","Data":"72540b1283017dda2d68d79f65850249fd51e381ac994190a490d4d70199e6a2"}
Sep 07 03:49:13.524100 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:13.524051    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7jwg7" podStartSLOduration=1.693546133 podStartE2EDuration="4.52403227s" totalImagesPullingTime="2.830486137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 03:49:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:49:13.523457382 +0000 UTC m=+56.835933285" watchObservedRunningTime="2026-09-07 03:49:13.52403227 +0000 UTC m=+56.836508173"
Sep 07 03:49:13.538629 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:13.538572    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6jk9k" podStartSLOduration=1.824858947 podStartE2EDuration="4.538559215s" totalImagesPullingTime="2.713700268s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 03:49:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:49:13.538087618 +0000 UTC m=+56.850563541" watchObservedRunningTime="2026-09-07 03:49:13.538559215 +0000 UTC m=+56.851035117"
Sep 07 03:49:17.432950 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:17.432908    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pmq6m"
Sep 07 03:49:22.513560 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:22.513529    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pqkmf"
Sep 07 03:49:22.875722 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:22.875692    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64880c7e-cc6b-462f-9d79-b9b6b48d34ca-metrics-certs\") pod \"network-metrics-daemon-7rg9j\" (UID: \"64880c7e-cc6b-462f-9d79-b9b6b48d34ca\") " pod="openshift-multus/network-metrics-daemon-7rg9j"
Sep 07 03:49:22.878122 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:22.878093    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 07 03:49:22.888054 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:22.888029    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64880c7e-cc6b-462f-9d79-b9b6b48d34ca-metrics-certs\") pod \"network-metrics-daemon-7rg9j\" (UID: \"64880c7e-cc6b-462f-9d79-b9b6b48d34ca\") " pod="openshift-multus/network-metrics-daemon-7rg9j"
Sep 07 03:49:22.976432 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:22.976405    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/078e2a74-a77c-42d5-941a-52e2b16a74ed-original-pull-secret\") pod \"global-pull-secret-syncer-tdrdx\" (UID: \"078e2a74-a77c-42d5-941a-52e2b16a74ed\") " pod="kube-system/global-pull-secret-syncer-tdrdx"
Sep 07 03:49:22.978590 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:22.978573    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 07 03:49:22.989199 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:22.989175    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/078e2a74-a77c-42d5-941a-52e2b16a74ed-original-pull-secret\") pod \"global-pull-secret-syncer-tdrdx\" (UID: \"078e2a74-a77c-42d5-941a-52e2b16a74ed\") " pod="kube-system/global-pull-secret-syncer-tdrdx"
Sep 07 03:49:23.077281 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:23.077242    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljc7f\" (UniqueName: \"kubernetes.io/projected/3ec3c1a7-cf5d-4e83-8497-f2c725850698-kube-api-access-ljc7f\") pod \"network-check-target-hvk8h\" (UID: \"3ec3c1a7-cf5d-4e83-8497-f2c725850698\") " pod="openshift-network-diagnostics/network-check-target-hvk8h"
Sep 07 03:49:23.079546 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:23.079530    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 07 03:49:23.084756 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:23.084740    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-25ldn\""
Sep 07 03:49:23.089691 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:23.089674    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 07 03:49:23.094138 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:23.094122    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rg9j"
Sep 07 03:49:23.100961 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:23.100942    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljc7f\" (UniqueName: \"kubernetes.io/projected/3ec3c1a7-cf5d-4e83-8497-f2c725850698-kube-api-access-ljc7f\") pod \"network-check-target-hvk8h\" (UID: \"3ec3c1a7-cf5d-4e83-8497-f2c725850698\") " pod="openshift-network-diagnostics/network-check-target-hvk8h"
Sep 07 03:49:23.186150 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:23.186126    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdrdx"
Sep 07 03:49:23.195852 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:23.195818    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wrs9m\""
Sep 07 03:49:23.200882 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:23.200862    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvk8h"
Sep 07 03:49:23.357347 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:23.357317    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7rg9j"]
Sep 07 03:49:23.360780 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:49:23.360752    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64880c7e_cc6b_462f_9d79_b9b6b48d34ca.slice/crio-4a41509f9c81e0cc094b84e43cc9b2c96797ec2e1cab9a3f80b608e3fbcd0633 WatchSource:0}: Error finding container 4a41509f9c81e0cc094b84e43cc9b2c96797ec2e1cab9a3f80b608e3fbcd0633: Status 404 returned error can't find the container with id 4a41509f9c81e0cc094b84e43cc9b2c96797ec2e1cab9a3f80b608e3fbcd0633
Sep 07 03:49:23.450681 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:23.450574    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tdrdx"]
Sep 07 03:49:23.453885 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:49:23.453861    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod078e2a74_a77c_42d5_941a_52e2b16a74ed.slice/crio-a37e2dc6a1633506038990aec3c38b720fa738fc3a69cea0a393f9124fb34e10 WatchSource:0}: Error finding container a37e2dc6a1633506038990aec3c38b720fa738fc3a69cea0a393f9124fb34e10: Status 404 returned error can't find the container with id a37e2dc6a1633506038990aec3c38b720fa738fc3a69cea0a393f9124fb34e10
Sep 07 03:49:23.471235 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:23.471214    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hvk8h"]
Sep 07 03:49:23.474649 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:49:23.474611    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ec3c1a7_cf5d_4e83_8497_f2c725850698.slice/crio-31ce71e393132dbabe7af5e3908b8f1ec7e9fdc63701c4acbec378755d8569d0 WatchSource:0}: Error finding container 31ce71e393132dbabe7af5e3908b8f1ec7e9fdc63701c4acbec378755d8569d0: Status 404 returned error can't find the container with id 31ce71e393132dbabe7af5e3908b8f1ec7e9fdc63701c4acbec378755d8569d0
Sep 07 03:49:23.546017 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:23.545990    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hvk8h" event={"ID":"3ec3c1a7-cf5d-4e83-8497-f2c725850698","Type":"ContainerStarted","Data":"31ce71e393132dbabe7af5e3908b8f1ec7e9fdc63701c4acbec378755d8569d0"}
Sep 07 03:49:23.547270 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:23.547229    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tdrdx" event={"ID":"078e2a74-a77c-42d5-941a-52e2b16a74ed","Type":"ContainerStarted","Data":"a37e2dc6a1633506038990aec3c38b720fa738fc3a69cea0a393f9124fb34e10"}
Sep 07 03:49:23.549138 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:23.549044    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7rg9j" event={"ID":"64880c7e-cc6b-462f-9d79-b9b6b48d34ca","Type":"ContainerStarted","Data":"4a41509f9c81e0cc094b84e43cc9b2c96797ec2e1cab9a3f80b608e3fbcd0633"}
Sep 07 03:49:24.556108 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:24.556071    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7rg9j" event={"ID":"64880c7e-cc6b-462f-9d79-b9b6b48d34ca","Type":"ContainerStarted","Data":"ae1b2c4bc00b94adaca03b35bdc76f9db9781b5cf1df4eb84cea1620a32dd7f4"}
Sep 07 03:49:24.556475 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:24.556136    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7rg9j" event={"ID":"64880c7e-cc6b-462f-9d79-b9b6b48d34ca","Type":"ContainerStarted","Data":"e07d0cbbd961b62f2dc5eee4b3b938bf377d1e963ed0d2e8b20ca68bae7d1fce"}
Sep 07 03:49:24.570500 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:24.570370    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7rg9j" podStartSLOduration=66.621091351 podStartE2EDuration="1m7.570350789s" totalImagesPullingTime="949.259438ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 03:48:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:49:24.569578171 +0000 UTC m=+67.882054074" watchObservedRunningTime="2026-09-07 03:49:24.570350789 +0000 UTC m=+67.882826696"
Sep 07 03:49:26.189061 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:26.189026    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5dd7677cd4-phv45"]
Sep 07 03:49:26.190895 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:26.190869    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dd7677cd4-phv45"
Sep 07 03:49:26.192993 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:26.192961    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 07 03:49:26.192993 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:26.192969    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hlg4v\""
Sep 07 03:49:26.193762 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:26.193743    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 07 03:49:26.193762 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:26.193759    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 07 03:49:26.193940 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:26.193768    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 07 03:49:26.194045 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:26.194024    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 07 03:49:26.194218 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:26.194195    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 07 03:49:26.194316 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:26.194219    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 07 03:49:26.203579 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:26.203557    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5dd7677cd4-phv45"]
Sep 07 03:49:26.299799 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:26.299767    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2cd0e730-85b4-4317-936a-2c07ca36ac77-console-oauth-config\") pod \"console-5dd7677cd4-phv45\" (UID: \"2cd0e730-85b4-4317-936a-2c07ca36ac77\") " pod="openshift-console/console-5dd7677cd4-phv45"
Sep 07 03:49:26.299991 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:26.299809    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2cd0e730-85b4-4317-936a-2c07ca36ac77-console-config\") pod \"console-5dd7677cd4-phv45\" (UID: \"2cd0e730-85b4-4317-936a-2c07ca36ac77\") " pod="openshift-console/console-5dd7677cd4-phv45"
Sep 07 03:49:26.299991 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:26.299891    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvlpw\" (UniqueName: \"kubernetes.io/projected/2cd0e730-85b4-4317-936a-2c07ca36ac77-kube-api-access-vvlpw\") pod \"console-5dd7677cd4-phv45\" (UID: \"2cd0e730-85b4-4317-936a-2c07ca36ac77\") " pod="openshift-console/console-5dd7677cd4-phv45"
Sep 07 03:49:26.299991 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:26.299942    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2cd0e730-85b4-4317-936a-2c07ca36ac77-oauth-serving-cert\") pod \"console-5dd7677cd4-phv45\" (UID: \"2cd0e730-85b4-4317-936a-2c07ca36ac77\") " pod="openshift-console/console-5dd7677cd4-phv45"
Sep 07 03:49:26.299991 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:26.299982    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2cd0e730-85b4-4317-936a-2c07ca36ac77-service-ca\") pod \"console-5dd7677cd4-phv45\" (UID: \"2cd0e730-85b4-4317-936a-2c07ca36ac77\") " pod="openshift-console/console-5dd7677cd4-phv45"
Sep 07 03:49:26.300131 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:26.300006    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2cd0e730-85b4-4317-936a-2c07ca36ac77-console-serving-cert\") pod \"console-5dd7677cd4-phv45\" (UID: \"2cd0e730-85b4-4317-936a-2c07ca36ac77\") " pod="openshift-console/console-5dd7677cd4-phv45"
Sep 07 03:49:26.400716 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:26.400680    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2cd0e730-85b4-4317-936a-2c07ca36ac77-console-oauth-config\") pod \"console-5dd7677cd4-phv45\" (UID: \"2cd0e730-85b4-4317-936a-2c07ca36ac77\") " pod="openshift-console/console-5dd7677cd4-phv45"
Sep 07 03:49:26.400716 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:26.400724    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2cd0e730-85b4-4317-936a-2c07ca36ac77-console-config\") pod \"console-5dd7677cd4-phv45\" (UID: \"2cd0e730-85b4-4317-936a-2c07ca36ac77\") " pod="openshift-console/console-5dd7677cd4-phv45"
Sep 07 03:49:26.400978 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:26.400770    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvlpw\" (UniqueName: \"kubernetes.io/projected/2cd0e730-85b4-4317-936a-2c07ca36ac77-kube-api-access-vvlpw\") pod \"console-5dd7677cd4-phv45\" (UID: \"2cd0e730-85b4-4317-936a-2c07ca36ac77\") " pod="openshift-console/console-5dd7677cd4-phv45"
Sep 07 03:49:26.400978 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:26.400923    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2cd0e730-85b4-4317-936a-2c07ca36ac77-oauth-serving-cert\") pod \"console-5dd7677cd4-phv45\" (UID: \"2cd0e730-85b4-4317-936a-2c07ca36ac77\") " pod="openshift-console/console-5dd7677cd4-phv45"
Sep 07 03:49:26.401079 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:26.400994    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2cd0e730-85b4-4317-936a-2c07ca36ac77-service-ca\") pod \"console-5dd7677cd4-phv45\" (UID: \"2cd0e730-85b4-4317-936a-2c07ca36ac77\") " pod="openshift-console/console-5dd7677cd4-phv45"
Sep 07 03:49:26.401079 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:26.401022    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2cd0e730-85b4-4317-936a-2c07ca36ac77-console-serving-cert\") pod \"console-5dd7677cd4-phv45\" (UID: \"2cd0e730-85b4-4317-936a-2c07ca36ac77\") " pod="openshift-console/console-5dd7677cd4-phv45"
Sep 07 03:49:26.401676 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:26.401639    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2cd0e730-85b4-4317-936a-2c07ca36ac77-console-config\") pod \"console-5dd7677cd4-phv45\" (UID: \"2cd0e730-85b4-4317-936a-2c07ca36ac77\") " pod="openshift-console/console-5dd7677cd4-phv45"
Sep 07 03:49:26.401822 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:26.401746    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2cd0e730-85b4-4317-936a-2c07ca36ac77-service-ca\") pod \"console-5dd7677cd4-phv45\" (UID: \"2cd0e730-85b4-4317-936a-2c07ca36ac77\") " pod="openshift-console/console-5dd7677cd4-phv45"
Sep 07 03:49:26.401879 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:26.401850    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2cd0e730-85b4-4317-936a-2c07ca36ac77-oauth-serving-cert\") pod \"console-5dd7677cd4-phv45\" (UID: \"2cd0e730-85b4-4317-936a-2c07ca36ac77\") " pod="openshift-console/console-5dd7677cd4-phv45"
Sep 07 03:49:26.403796 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:26.403771    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2cd0e730-85b4-4317-936a-2c07ca36ac77-console-oauth-config\") pod \"console-5dd7677cd4-phv45\" (UID: \"2cd0e730-85b4-4317-936a-2c07ca36ac77\") " pod="openshift-console/console-5dd7677cd4-phv45"
Sep 07 03:49:26.404284 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:26.404262    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2cd0e730-85b4-4317-936a-2c07ca36ac77-console-serving-cert\") pod \"console-5dd7677cd4-phv45\" (UID: \"2cd0e730-85b4-4317-936a-2c07ca36ac77\") " pod="openshift-console/console-5dd7677cd4-phv45"
Sep 07 03:49:26.410775 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:26.410751    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvlpw\" (UniqueName: \"kubernetes.io/projected/2cd0e730-85b4-4317-936a-2c07ca36ac77-kube-api-access-vvlpw\") pod \"console-5dd7677cd4-phv45\" (UID: \"2cd0e730-85b4-4317-936a-2c07ca36ac77\") " pod="openshift-console/console-5dd7677cd4-phv45"
Sep 07 03:49:26.500815 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:26.500740    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dd7677cd4-phv45"
Sep 07 03:49:27.643058 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:27.643025    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rj8z9"]
Sep 07 03:49:27.645232 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:27.645206    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rj8z9"
Sep 07 03:49:27.648483 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:27.648375    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 07 03:49:27.648483 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:27.648381    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 07 03:49:27.648679 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:27.648604    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 07 03:49:27.648679 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:27.648604    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 07 03:49:27.648679 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:27.648658    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qtb9h\""
Sep 07 03:49:27.649048 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:27.649025    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 07 03:49:27.649181 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:27.649082    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 07 03:49:27.811290 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:27.811251    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/81013bd8-76f9-48a7-8486-49319e60f602-root\") pod \"node-exporter-rj8z9\" (UID: \"81013bd8-76f9-48a7-8486-49319e60f602\") " pod="openshift-monitoring/node-exporter-rj8z9"
Sep 07 03:49:27.811526 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:27.811301    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81013bd8-76f9-48a7-8486-49319e60f602-metrics-client-ca\") pod \"node-exporter-rj8z9\" (UID: \"81013bd8-76f9-48a7-8486-49319e60f602\") " pod="openshift-monitoring/node-exporter-rj8z9"
Sep 07 03:49:27.811526 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:27.811378    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/81013bd8-76f9-48a7-8486-49319e60f602-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rj8z9\" (UID: \"81013bd8-76f9-48a7-8486-49319e60f602\") " pod="openshift-monitoring/node-exporter-rj8z9"
Sep 07 03:49:27.811526 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:27.811447    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81013bd8-76f9-48a7-8486-49319e60f602-sys\") pod \"node-exporter-rj8z9\" (UID: \"81013bd8-76f9-48a7-8486-49319e60f602\") " pod="openshift-monitoring/node-exporter-rj8z9"
Sep 07 03:49:27.811526 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:27.811483    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/81013bd8-76f9-48a7-8486-49319e60f602-node-exporter-accelerators-collector-config\") pod \"node-exporter-rj8z9\" (UID: \"81013bd8-76f9-48a7-8486-49319e60f602\") " pod="openshift-monitoring/node-exporter-rj8z9"
Sep 07 03:49:27.811782 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:27.811539    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrl6m\" (UniqueName: \"kubernetes.io/projected/81013bd8-76f9-48a7-8486-49319e60f602-kube-api-access-wrl6m\") pod \"node-exporter-rj8z9\" (UID: \"81013bd8-76f9-48a7-8486-49319e60f602\") " pod="openshift-monitoring/node-exporter-rj8z9"
Sep 07 03:49:27.811782 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:27.811587    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/81013bd8-76f9-48a7-8486-49319e60f602-node-exporter-tls\") pod \"node-exporter-rj8z9\" (UID: \"81013bd8-76f9-48a7-8486-49319e60f602\") " pod="openshift-monitoring/node-exporter-rj8z9"
Sep 07 03:49:27.811782 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:27.811639    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/81013bd8-76f9-48a7-8486-49319e60f602-node-exporter-wtmp\") pod \"node-exporter-rj8z9\" (UID: \"81013bd8-76f9-48a7-8486-49319e60f602\") " pod="openshift-monitoring/node-exporter-rj8z9"
Sep 07 03:49:27.811782 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:27.811721    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/81013bd8-76f9-48a7-8486-49319e60f602-node-exporter-textfile\") pod \"node-exporter-rj8z9\" (UID: \"81013bd8-76f9-48a7-8486-49319e60f602\") " pod="openshift-monitoring/node-exporter-rj8z9"
Sep 07 03:49:27.913006 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:27.912970    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81013bd8-76f9-48a7-8486-49319e60f602-sys\") pod \"node-exporter-rj8z9\" (UID: \"81013bd8-76f9-48a7-8486-49319e60f602\") " pod="openshift-monitoring/node-exporter-rj8z9"
Sep 07 03:49:27.913125 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:27.913025    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/81013bd8-76f9-48a7-8486-49319e60f602-node-exporter-accelerators-collector-config\") pod \"node-exporter-rj8z9\" (UID: \"81013bd8-76f9-48a7-8486-49319e60f602\") " pod="openshift-monitoring/node-exporter-rj8z9"
Sep 07 03:49:27.913125 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:27.913051    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrl6m\" (UniqueName: \"kubernetes.io/projected/81013bd8-76f9-48a7-8486-49319e60f602-kube-api-access-wrl6m\") pod \"node-exporter-rj8z9\" (UID: \"81013bd8-76f9-48a7-8486-49319e60f602\") " pod="openshift-monitoring/node-exporter-rj8z9"
Sep 07 03:49:27.913125 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:27.913076    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/81013bd8-76f9-48a7-8486-49319e60f602-node-exporter-tls\") pod \"node-exporter-rj8z9\" (UID: \"81013bd8-76f9-48a7-8486-49319e60f602\") " pod="openshift-monitoring/node-exporter-rj8z9"
Sep 07 03:49:27.913125 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:27.913097    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/81013bd8-76f9-48a7-8486-49319e60f602-node-exporter-wtmp\") pod \"node-exporter-rj8z9\" (UID: \"81013bd8-76f9-48a7-8486-49319e60f602\") " pod="openshift-monitoring/node-exporter-rj8z9"
Sep 07 03:49:27.913332 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:27.913176    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/81013bd8-76f9-48a7-8486-49319e60f602-node-exporter-textfile\") pod \"node-exporter-rj8z9\" (UID: \"81013bd8-76f9-48a7-8486-49319e60f602\") " pod="openshift-monitoring/node-exporter-rj8z9"
Sep 07 03:49:27.913332 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:27.913218    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/81013bd8-76f9-48a7-8486-49319e60f602-root\") pod \"node-exporter-rj8z9\" (UID: \"81013bd8-76f9-48a7-8486-49319e60f602\") " pod="openshift-monitoring/node-exporter-rj8z9"
Sep 07 03:49:27.913332 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:27.913251    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81013bd8-76f9-48a7-8486-49319e60f602-metrics-client-ca\") pod \"node-exporter-rj8z9\" (UID: \"81013bd8-76f9-48a7-8486-49319e60f602\") " pod="openshift-monitoring/node-exporter-rj8z9"
Sep 07 03:49:27.913332 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:27.913284    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/81013bd8-76f9-48a7-8486-49319e60f602-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rj8z9\" (UID: \"81013bd8-76f9-48a7-8486-49319e60f602\") " pod="openshift-monitoring/node-exporter-rj8z9"
Sep 07 03:49:27.916049 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:49:27.913885    2559 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 07 03:49:27.916049 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:49:27.913971    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81013bd8-76f9-48a7-8486-49319e60f602-node-exporter-tls podName:81013bd8-76f9-48a7-8486-49319e60f602 nodeName:}" failed. No retries permitted until 2026-09-07 03:49:28.413942249 +0000 UTC m=+71.726418141 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/81013bd8-76f9-48a7-8486-49319e60f602-node-exporter-tls") pod "node-exporter-rj8z9" (UID: "81013bd8-76f9-48a7-8486-49319e60f602") : secret "node-exporter-tls" not found
Sep 07 03:49:27.916049 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:27.914244    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81013bd8-76f9-48a7-8486-49319e60f602-sys\") pod \"node-exporter-rj8z9\" (UID: \"81013bd8-76f9-48a7-8486-49319e60f602\") " pod="openshift-monitoring/node-exporter-rj8z9"
Sep 07 03:49:27.916049 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:27.914833    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/81013bd8-76f9-48a7-8486-49319e60f602-node-exporter-accelerators-collector-config\") pod \"node-exporter-rj8z9\" (UID: \"81013bd8-76f9-48a7-8486-49319e60f602\") " pod="openshift-monitoring/node-exporter-rj8z9"
Sep 07 03:49:27.916049 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:27.915366    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/81013bd8-76f9-48a7-8486-49319e60f602-node-exporter-textfile\") pod \"node-exporter-rj8z9\" (UID: \"81013bd8-76f9-48a7-8486-49319e60f602\") " pod="openshift-monitoring/node-exporter-rj8z9"
Sep 07 03:49:27.916049 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:27.915509    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/81013bd8-76f9-48a7-8486-49319e60f602-node-exporter-wtmp\") pod \"node-exporter-rj8z9\" (UID: \"81013bd8-76f9-48a7-8486-49319e60f602\") " pod="openshift-monitoring/node-exporter-rj8z9"
Sep 07 03:49:27.916049 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:27.915560    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/81013bd8-76f9-48a7-8486-49319e60f602-root\") pod \"node-exporter-rj8z9\" (UID: \"81013bd8-76f9-48a7-8486-49319e60f602\") " pod="openshift-monitoring/node-exporter-rj8z9"
Sep 07 03:49:27.916463 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:27.916059    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81013bd8-76f9-48a7-8486-49319e60f602-metrics-client-ca\") pod \"node-exporter-rj8z9\" (UID: \"81013bd8-76f9-48a7-8486-49319e60f602\") " pod="openshift-monitoring/node-exporter-rj8z9"
Sep 07 03:49:27.916463 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:27.916388    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/81013bd8-76f9-48a7-8486-49319e60f602-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rj8z9\" (UID: \"81013bd8-76f9-48a7-8486-49319e60f602\") " pod="openshift-monitoring/node-exporter-rj8z9"
Sep 07 03:49:27.924851 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:27.924435    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrl6m\" (UniqueName: \"kubernetes.io/projected/81013bd8-76f9-48a7-8486-49319e60f602-kube-api-access-wrl6m\") pod \"node-exporter-rj8z9\" (UID: \"81013bd8-76f9-48a7-8486-49319e60f602\") " pod="openshift-monitoring/node-exporter-rj8z9"
Sep 07 03:49:28.157651 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.157543    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5dd7677cd4-phv45"]
Sep 07 03:49:28.160896 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:49:28.160874    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cd0e730_85b4_4317_936a_2c07ca36ac77.slice/crio-45aaad70c91fe787d54042173c2199d5693caa25011736c7968a333aa3722aad WatchSource:0}: Error finding container 45aaad70c91fe787d54042173c2199d5693caa25011736c7968a333aa3722aad: Status 404 returned error can't find the container with id 45aaad70c91fe787d54042173c2199d5693caa25011736c7968a333aa3722aad
Sep 07 03:49:28.416851 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.416769    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/81013bd8-76f9-48a7-8486-49319e60f602-node-exporter-tls\") pod \"node-exporter-rj8z9\" (UID: \"81013bd8-76f9-48a7-8486-49319e60f602\") " pod="openshift-monitoring/node-exporter-rj8z9"
Sep 07 03:49:28.418964 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.418942    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/81013bd8-76f9-48a7-8486-49319e60f602-node-exporter-tls\") pod \"node-exporter-rj8z9\" (UID: \"81013bd8-76f9-48a7-8486-49319e60f602\") " pod="openshift-monitoring/node-exporter-rj8z9"
Sep 07 03:49:28.556429 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.556397    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rj8z9"
Sep 07 03:49:28.566744 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:49:28.566719    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81013bd8_76f9_48a7_8486_49319e60f602.slice/crio-4a39be7cce56c669febc1beba6818bfb332ad47c4df5e5980ef81dc778be8d74 WatchSource:0}: Error finding container 4a39be7cce56c669febc1beba6818bfb332ad47c4df5e5980ef81dc778be8d74: Status 404 returned error can't find the container with id 4a39be7cce56c669febc1beba6818bfb332ad47c4df5e5980ef81dc778be8d74
Sep 07 03:49:28.576587 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.576538    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hvk8h" event={"ID":"3ec3c1a7-cf5d-4e83-8497-f2c725850698","Type":"ContainerStarted","Data":"42f25de86683326bf18649308d8071c5c76e0a11773718a9cb0e3296019d1ac6"}
Sep 07 03:49:28.576701 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.576677    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hvk8h"
Sep 07 03:49:28.578157 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.578133    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tdrdx" event={"ID":"078e2a74-a77c-42d5-941a-52e2b16a74ed","Type":"ContainerStarted","Data":"74b5a21b057961e325513e2586f31c2e3bdf4636299079e190000ff38e8ed213"}
Sep 07 03:49:28.579261 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.579241    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rj8z9" event={"ID":"81013bd8-76f9-48a7-8486-49319e60f602","Type":"ContainerStarted","Data":"4a39be7cce56c669febc1beba6818bfb332ad47c4df5e5980ef81dc778be8d74"}
Sep 07 03:49:28.580429 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.580412    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dd7677cd4-phv45" event={"ID":"2cd0e730-85b4-4317-936a-2c07ca36ac77","Type":"ContainerStarted","Data":"45aaad70c91fe787d54042173c2199d5693caa25011736c7968a333aa3722aad"}
Sep 07 03:49:28.593596 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.593553    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hvk8h" podStartSLOduration=66.182401011 podStartE2EDuration="1m10.59354111s" totalImagesPullingTime="4.411140099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 03:48:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:49:28.592186115 +0000 UTC m=+71.904662009" watchObservedRunningTime="2026-09-07 03:49:28.59354111 +0000 UTC m=+71.906017011"
Sep 07 03:49:28.715154 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.715032    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tdrdx" podStartSLOduration=66.280614283 podStartE2EDuration="1m10.715013596s" totalImagesPullingTime="4.434399313s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 03:48:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:49:28.612162639 +0000 UTC m=+71.924638540" watchObservedRunningTime="2026-09-07 03:49:28.715013596 +0000 UTC m=+72.027489503"
Sep 07 03:49:28.715594 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.715577    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 07 03:49:28.719006 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.718985    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:49:28.726104 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.726083    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 07 03:49:28.726701 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.726105    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 07 03:49:28.728475 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.726816    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-dgdgq\""
Sep 07 03:49:28.728475 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.726129    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 07 03:49:28.728475 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.727386    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 07 03:49:28.728475 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.728123    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 07 03:49:28.728475 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.728342    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 07 03:49:28.728795 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.728507    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 07 03:49:28.730680 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.729362    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 07 03:49:28.732930 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.732843    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 07 03:49:28.744612 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.744590    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 07 03:49:28.819597 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.819568    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/27ced0c4-a27d-4c48-96e2-da962483e808-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"27ced0c4-a27d-4c48-96e2-da962483e808\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:49:28.819775 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.819608    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/27ced0c4-a27d-4c48-96e2-da962483e808-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"27ced0c4-a27d-4c48-96e2-da962483e808\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:49:28.819775 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.819647    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lrgs\" (UniqueName: \"kubernetes.io/projected/27ced0c4-a27d-4c48-96e2-da962483e808-kube-api-access-9lrgs\") pod \"alertmanager-main-0\" (UID: \"27ced0c4-a27d-4c48-96e2-da962483e808\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:49:28.819775 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.819689    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/27ced0c4-a27d-4c48-96e2-da962483e808-tls-assets\") pod \"alertmanager-main-0\" (UID: \"27ced0c4-a27d-4c48-96e2-da962483e808\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:49:28.819775 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.819709    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/27ced0c4-a27d-4c48-96e2-da962483e808-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"27ced0c4-a27d-4c48-96e2-da962483e808\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:49:28.819775 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.819734    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27ced0c4-a27d-4c48-96e2-da962483e808-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"27ced0c4-a27d-4c48-96e2-da962483e808\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:49:28.819990 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.819808    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/27ced0c4-a27d-4c48-96e2-da962483e808-config-out\") pod \"alertmanager-main-0\" (UID: \"27ced0c4-a27d-4c48-96e2-da962483e808\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:49:28.819990 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.819830    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/27ced0c4-a27d-4c48-96e2-da962483e808-config-volume\") pod \"alertmanager-main-0\" (UID: \"27ced0c4-a27d-4c48-96e2-da962483e808\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:49:28.819990 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.819844    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/27ced0c4-a27d-4c48-96e2-da962483e808-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"27ced0c4-a27d-4c48-96e2-da962483e808\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:49:28.819990 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.819861    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/27ced0c4-a27d-4c48-96e2-da962483e808-web-config\") pod \"alertmanager-main-0\" (UID: \"27ced0c4-a27d-4c48-96e2-da962483e808\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:49:28.819990 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.819876    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/27ced0c4-a27d-4c48-96e2-da962483e808-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"27ced0c4-a27d-4c48-96e2-da962483e808\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:49:28.820171 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.819981    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27ced0c4-a27d-4c48-96e2-da962483e808-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"27ced0c4-a27d-4c48-96e2-da962483e808\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:49:28.820171 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.820064    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/27ced0c4-a27d-4c48-96e2-da962483e808-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"27ced0c4-a27d-4c48-96e2-da962483e808\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:49:28.920744 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.920704    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/27ced0c4-a27d-4c48-96e2-da962483e808-config-out\") pod \"alertmanager-main-0\" (UID: \"27ced0c4-a27d-4c48-96e2-da962483e808\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:49:28.920744 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.920742    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/27ced0c4-a27d-4c48-96e2-da962483e808-config-volume\") pod \"alertmanager-main-0\" (UID: \"27ced0c4-a27d-4c48-96e2-da962483e808\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:49:28.920960 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.920758    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/27ced0c4-a27d-4c48-96e2-da962483e808-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"27ced0c4-a27d-4c48-96e2-da962483e808\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:49:28.920960 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.920782    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/27ced0c4-a27d-4c48-96e2-da962483e808-web-config\") pod \"alertmanager-main-0\" (UID: \"27ced0c4-a27d-4c48-96e2-da962483e808\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:49:28.920960 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.920807    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/27ced0c4-a27d-4c48-96e2-da962483e808-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"27ced0c4-a27d-4c48-96e2-da962483e808\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:49:28.920960 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.920837    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27ced0c4-a27d-4c48-96e2-da962483e808-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"27ced0c4-a27d-4c48-96e2-da962483e808\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:49:28.920960 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.920867    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/27ced0c4-a27d-4c48-96e2-da962483e808-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"27ced0c4-a27d-4c48-96e2-da962483e808\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:49:28.920960 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.920903    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/27ced0c4-a27d-4c48-96e2-da962483e808-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"27ced0c4-a27d-4c48-96e2-da962483e808\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:49:28.920960 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.920942    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/27ced0c4-a27d-4c48-96e2-da962483e808-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"27ced0c4-a27d-4c48-96e2-da962483e808\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:49:28.921309 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.920968    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lrgs\" (UniqueName: \"kubernetes.io/projected/27ced0c4-a27d-4c48-96e2-da962483e808-kube-api-access-9lrgs\") pod \"alertmanager-main-0\" (UID: \"27ced0c4-a27d-4c48-96e2-da962483e808\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:49:28.921309 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.920999    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/27ced0c4-a27d-4c48-96e2-da962483e808-tls-assets\") pod \"alertmanager-main-0\" (UID: \"27ced0c4-a27d-4c48-96e2-da962483e808\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:49:28.921309 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.921023    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/27ced0c4-a27d-4c48-96e2-da962483e808-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"27ced0c4-a27d-4c48-96e2-da962483e808\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:49:28.921309 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.921055    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27ced0c4-a27d-4c48-96e2-da962483e808-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"27ced0c4-a27d-4c48-96e2-da962483e808\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:49:28.921309 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.921156    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/27ced0c4-a27d-4c48-96e2-da962483e808-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"27ced0c4-a27d-4c48-96e2-da962483e808\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:49:28.923150 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.921875    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27ced0c4-a27d-4c48-96e2-da962483e808-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"27ced0c4-a27d-4c48-96e2-da962483e808\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:49:28.923150 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.923101    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27ced0c4-a27d-4c48-96e2-da962483e808-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"27ced0c4-a27d-4c48-96e2-da962483e808\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:49:28.924277 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.924251    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/27ced0c4-a27d-4c48-96e2-da962483e808-tls-assets\") pod \"alertmanager-main-0\" (UID: \"27ced0c4-a27d-4c48-96e2-da962483e808\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:49:28.924376 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.924322    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/27ced0c4-a27d-4c48-96e2-da962483e808-config-out\") pod \"alertmanager-main-0\" (UID: \"27ced0c4-a27d-4c48-96e2-da962483e808\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:49:28.924650 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.924608    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/27ced0c4-a27d-4c48-96e2-da962483e808-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"27ced0c4-a27d-4c48-96e2-da962483e808\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:49:28.925792 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.925403    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/27ced0c4-a27d-4c48-96e2-da962483e808-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"27ced0c4-a27d-4c48-96e2-da962483e808\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:49:28.925792 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.925760    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/27ced0c4-a27d-4c48-96e2-da962483e808-config-volume\") pod \"alertmanager-main-0\" (UID: \"27ced0c4-a27d-4c48-96e2-da962483e808\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:49:28.926168 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.926146    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/27ced0c4-a27d-4c48-96e2-da962483e808-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"27ced0c4-a27d-4c48-96e2-da962483e808\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:49:28.926421 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.926394    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/27ced0c4-a27d-4c48-96e2-da962483e808-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"27ced0c4-a27d-4c48-96e2-da962483e808\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:49:28.926605 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.926582    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/27ced0c4-a27d-4c48-96e2-da962483e808-web-config\") pod \"alertmanager-main-0\" (UID: \"27ced0c4-a27d-4c48-96e2-da962483e808\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:49:28.928761 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.928721    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/27ced0c4-a27d-4c48-96e2-da962483e808-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"27ced0c4-a27d-4c48-96e2-da962483e808\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:49:28.934377 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:28.934353    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lrgs\" (UniqueName: \"kubernetes.io/projected/27ced0c4-a27d-4c48-96e2-da962483e808-kube-api-access-9lrgs\") pod \"alertmanager-main-0\" (UID: \"27ced0c4-a27d-4c48-96e2-da962483e808\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:49:29.034337 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:29.034261    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:49:29.323145 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:29.323052    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 07 03:49:29.453899 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:49:29.453861    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27ced0c4_a27d_4c48_96e2_da962483e808.slice/crio-5d527d7698d31624dac532dda57d0d2913f1bb3b46b6a99172526efd11078087 WatchSource:0}: Error finding container 5d527d7698d31624dac532dda57d0d2913f1bb3b46b6a99172526efd11078087: Status 404 returned error can't find the container with id 5d527d7698d31624dac532dda57d0d2913f1bb3b46b6a99172526efd11078087
Sep 07 03:49:29.586690 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:29.586653    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rj8z9" event={"ID":"81013bd8-76f9-48a7-8486-49319e60f602","Type":"ContainerStarted","Data":"1f02bbe5197f28b0ad6435ea3cc6b8c033332f96470cd98ed637b1cef82b8b95"}
Sep 07 03:49:29.588263 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:29.588232    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"27ced0c4-a27d-4c48-96e2-da962483e808","Type":"ContainerStarted","Data":"5d527d7698d31624dac532dda57d0d2913f1bb3b46b6a99172526efd11078087"}
Sep 07 03:49:29.958412 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:29.958355    2559 patch_prober.go:28] interesting pod/image-registry-6bc8b58db7-8h557 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 07 03:49:29.958908 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:29.958460    2559 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6bc8b58db7-8h557" podUID="82e20ff0-6f2f-44ff-8c2e-93c79ee0893e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 07 03:49:30.594671 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:30.594611    2559 generic.go:356] "Generic (PLEG): container finished" podID="81013bd8-76f9-48a7-8486-49319e60f602" containerID="1f02bbe5197f28b0ad6435ea3cc6b8c033332f96470cd98ed637b1cef82b8b95" exitCode=0
Sep 07 03:49:30.594671 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:30.594664    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rj8z9" event={"ID":"81013bd8-76f9-48a7-8486-49319e60f602","Type":"ContainerDied","Data":"1f02bbe5197f28b0ad6435ea3cc6b8c033332f96470cd98ed637b1cef82b8b95"}
Sep 07 03:49:31.503805 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:31.503781    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6bc8b58db7-8h557"
Sep 07 03:49:31.600704 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:31.600608    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rj8z9" event={"ID":"81013bd8-76f9-48a7-8486-49319e60f602","Type":"ContainerStarted","Data":"28d6074c42f8719e4a1308b9932390c8f8f309278021316c89cc564890efd0d0"}
Sep 07 03:49:31.600849 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:31.600706    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rj8z9" event={"ID":"81013bd8-76f9-48a7-8486-49319e60f602","Type":"ContainerStarted","Data":"ad3582d3d04ef574b81a2b7e188ce45ea56d133cb4c73daab9daf19f2e813e8e"}
Sep 07 03:49:31.602196 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:31.602169    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dd7677cd4-phv45" event={"ID":"2cd0e730-85b4-4317-936a-2c07ca36ac77","Type":"ContainerStarted","Data":"a742cbc73f62a3c7f6d7ade9180c4ec35122a35ef707a2b971e431d8f058cd77"}
Sep 07 03:49:31.603827 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:31.603805    2559 generic.go:356] "Generic (PLEG): container finished" podID="27ced0c4-a27d-4c48-96e2-da962483e808" containerID="0ec5c435635608b832f2402c0a2ad59eab38cac40a0dc0cf7f115fbd580411ed" exitCode=0
Sep 07 03:49:31.603910 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:31.603844    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"27ced0c4-a27d-4c48-96e2-da962483e808","Type":"ContainerDied","Data":"0ec5c435635608b832f2402c0a2ad59eab38cac40a0dc0cf7f115fbd580411ed"}
Sep 07 03:49:31.620128 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:31.620083    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rj8z9" podStartSLOduration=3.616589092 podStartE2EDuration="4.620068312s" totalImagesPullingTime="931.24803ms" totalInitContainerRuntime="72.23119ms" isStatefulPod=true podCreationTimestamp="2026-09-07 03:49:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:49:31.619000193 +0000 UTC m=+74.931476097" watchObservedRunningTime="2026-09-07 03:49:31.620068312 +0000 UTC m=+74.932544213"
Sep 07 03:49:31.638347 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:31.638307    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5dd7677cd4-phv45" podStartSLOduration=2.45717194 podStartE2EDuration="5.638292061s" totalImagesPullingTime="3.181120121s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 03:49:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:49:31.638187727 +0000 UTC m=+74.950663652" watchObservedRunningTime="2026-09-07 03:49:31.638292061 +0000 UTC m=+74.950767966"
Sep 07 03:49:32.140816 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.140783    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-777967499f-zrndh"]
Sep 07 03:49:32.143990 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.143969    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-777967499f-zrndh"
Sep 07 03:49:32.148368 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.148337    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/542e46e8-e669-45c2-85d2-d0e3511e474e-metrics-server-audit-profiles\") pod \"metrics-server-777967499f-zrndh\" (UID: \"542e46e8-e669-45c2-85d2-d0e3511e474e\") " pod="openshift-monitoring/metrics-server-777967499f-zrndh"
Sep 07 03:49:32.148482 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.148409    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/542e46e8-e669-45c2-85d2-d0e3511e474e-client-ca-bundle\") pod \"metrics-server-777967499f-zrndh\" (UID: \"542e46e8-e669-45c2-85d2-d0e3511e474e\") " pod="openshift-monitoring/metrics-server-777967499f-zrndh"
Sep 07 03:49:32.148482 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.148461    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/542e46e8-e669-45c2-85d2-d0e3511e474e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-777967499f-zrndh\" (UID: \"542e46e8-e669-45c2-85d2-d0e3511e474e\") " pod="openshift-monitoring/metrics-server-777967499f-zrndh"
Sep 07 03:49:32.148591 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.148482    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/542e46e8-e669-45c2-85d2-d0e3511e474e-secret-metrics-server-tls\") pod \"metrics-server-777967499f-zrndh\" (UID: \"542e46e8-e669-45c2-85d2-d0e3511e474e\") " pod="openshift-monitoring/metrics-server-777967499f-zrndh"
Sep 07 03:49:32.148591 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.148508    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qrxh\" (UniqueName: \"kubernetes.io/projected/542e46e8-e669-45c2-85d2-d0e3511e474e-kube-api-access-5qrxh\") pod \"metrics-server-777967499f-zrndh\" (UID: \"542e46e8-e669-45c2-85d2-d0e3511e474e\") " pod="openshift-monitoring/metrics-server-777967499f-zrndh"
Sep 07 03:49:32.148591 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.148528    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/542e46e8-e669-45c2-85d2-d0e3511e474e-secret-metrics-server-client-certs\") pod \"metrics-server-777967499f-zrndh\" (UID: \"542e46e8-e669-45c2-85d2-d0e3511e474e\") " pod="openshift-monitoring/metrics-server-777967499f-zrndh"
Sep 07 03:49:32.148591 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.148555    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/542e46e8-e669-45c2-85d2-d0e3511e474e-audit-log\") pod \"metrics-server-777967499f-zrndh\" (UID: \"542e46e8-e669-45c2-85d2-d0e3511e474e\") " pod="openshift-monitoring/metrics-server-777967499f-zrndh"
Sep 07 03:49:32.149438 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.149412    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-q86wn\""
Sep 07 03:49:32.149591 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.149439    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 07 03:49:32.149735 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.149713    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 07 03:49:32.149838 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.149749    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 07 03:49:32.149838 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.149771    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 07 03:49:32.149838 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.149806    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-93ofcftmd33le\""
Sep 07 03:49:32.159596 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.159576    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-777967499f-zrndh"]
Sep 07 03:49:32.248990 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.248958    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/542e46e8-e669-45c2-85d2-d0e3511e474e-client-ca-bundle\") pod \"metrics-server-777967499f-zrndh\" (UID: \"542e46e8-e669-45c2-85d2-d0e3511e474e\") " pod="openshift-monitoring/metrics-server-777967499f-zrndh"
Sep 07 03:49:32.248990 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.248991    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/542e46e8-e669-45c2-85d2-d0e3511e474e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-777967499f-zrndh\" (UID: \"542e46e8-e669-45c2-85d2-d0e3511e474e\") " pod="openshift-monitoring/metrics-server-777967499f-zrndh"
Sep 07 03:49:32.249176 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.249010    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/542e46e8-e669-45c2-85d2-d0e3511e474e-secret-metrics-server-tls\") pod \"metrics-server-777967499f-zrndh\" (UID: \"542e46e8-e669-45c2-85d2-d0e3511e474e\") " pod="openshift-monitoring/metrics-server-777967499f-zrndh"
Sep 07 03:49:32.249176 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.249130    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qrxh\" (UniqueName: \"kubernetes.io/projected/542e46e8-e669-45c2-85d2-d0e3511e474e-kube-api-access-5qrxh\") pod \"metrics-server-777967499f-zrndh\" (UID: \"542e46e8-e669-45c2-85d2-d0e3511e474e\") " pod="openshift-monitoring/metrics-server-777967499f-zrndh"
Sep 07 03:49:32.249245 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.249181    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/542e46e8-e669-45c2-85d2-d0e3511e474e-secret-metrics-server-client-certs\") pod \"metrics-server-777967499f-zrndh\" (UID: \"542e46e8-e669-45c2-85d2-d0e3511e474e\") " pod="openshift-monitoring/metrics-server-777967499f-zrndh"
Sep 07 03:49:32.249245 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.249214    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/542e46e8-e669-45c2-85d2-d0e3511e474e-audit-log\") pod \"metrics-server-777967499f-zrndh\" (UID: \"542e46e8-e669-45c2-85d2-d0e3511e474e\") " pod="openshift-monitoring/metrics-server-777967499f-zrndh"
Sep 07 03:49:32.249316 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.249286    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/542e46e8-e669-45c2-85d2-d0e3511e474e-metrics-server-audit-profiles\") pod \"metrics-server-777967499f-zrndh\" (UID: \"542e46e8-e669-45c2-85d2-d0e3511e474e\") " pod="openshift-monitoring/metrics-server-777967499f-zrndh"
Sep 07 03:49:32.249746 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.249719    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/542e46e8-e669-45c2-85d2-d0e3511e474e-audit-log\") pod \"metrics-server-777967499f-zrndh\" (UID: \"542e46e8-e669-45c2-85d2-d0e3511e474e\") " pod="openshift-monitoring/metrics-server-777967499f-zrndh"
Sep 07 03:49:32.250005 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.249982    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/542e46e8-e669-45c2-85d2-d0e3511e474e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-777967499f-zrndh\" (UID: \"542e46e8-e669-45c2-85d2-d0e3511e474e\") " pod="openshift-monitoring/metrics-server-777967499f-zrndh"
Sep 07 03:49:32.250181 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.250162    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/542e46e8-e669-45c2-85d2-d0e3511e474e-metrics-server-audit-profiles\") pod \"metrics-server-777967499f-zrndh\" (UID: \"542e46e8-e669-45c2-85d2-d0e3511e474e\") " pod="openshift-monitoring/metrics-server-777967499f-zrndh"
Sep 07 03:49:32.251508 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.251475    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/542e46e8-e669-45c2-85d2-d0e3511e474e-secret-metrics-server-tls\") pod \"metrics-server-777967499f-zrndh\" (UID: \"542e46e8-e669-45c2-85d2-d0e3511e474e\") " pod="openshift-monitoring/metrics-server-777967499f-zrndh"
Sep 07 03:49:32.251655 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.251555    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/542e46e8-e669-45c2-85d2-d0e3511e474e-secret-metrics-server-client-certs\") pod \"metrics-server-777967499f-zrndh\" (UID: \"542e46e8-e669-45c2-85d2-d0e3511e474e\") " pod="openshift-monitoring/metrics-server-777967499f-zrndh"
Sep 07 03:49:32.251721 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.251650    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/542e46e8-e669-45c2-85d2-d0e3511e474e-client-ca-bundle\") pod \"metrics-server-777967499f-zrndh\" (UID: \"542e46e8-e669-45c2-85d2-d0e3511e474e\") " pod="openshift-monitoring/metrics-server-777967499f-zrndh"
Sep 07 03:49:32.257745 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.257726    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qrxh\" (UniqueName: \"kubernetes.io/projected/542e46e8-e669-45c2-85d2-d0e3511e474e-kube-api-access-5qrxh\") pod \"metrics-server-777967499f-zrndh\" (UID: \"542e46e8-e669-45c2-85d2-d0e3511e474e\") " pod="openshift-monitoring/metrics-server-777967499f-zrndh"
Sep 07 03:49:32.381236 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.381203    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-cktwr"]
Sep 07 03:49:32.385515 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.385488    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-cktwr"
Sep 07 03:49:32.387434 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.387411    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 07 03:49:32.387566 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.387510    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-h6s6w\""
Sep 07 03:49:32.394569 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.394542    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-cktwr"]
Sep 07 03:49:32.450763 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.450723    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8e82e8af-59f5-41a0-8f77-0fc26d1d9ff7-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-cktwr\" (UID: \"8e82e8af-59f5-41a0-8f77-0fc26d1d9ff7\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-cktwr"
Sep 07 03:49:32.450925 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.450805    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gdbl\" (UniqueName: \"kubernetes.io/projected/8e82e8af-59f5-41a0-8f77-0fc26d1d9ff7-kube-api-access-2gdbl\") pod \"monitoring-plugin-85bbbbbf4-cktwr\" (UID: \"8e82e8af-59f5-41a0-8f77-0fc26d1d9ff7\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-cktwr"
Sep 07 03:49:32.454697 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.454671    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-777967499f-zrndh"
Sep 07 03:49:32.551699 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.551662    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8e82e8af-59f5-41a0-8f77-0fc26d1d9ff7-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-cktwr\" (UID: \"8e82e8af-59f5-41a0-8f77-0fc26d1d9ff7\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-cktwr"
Sep 07 03:49:32.552147 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.551718    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gdbl\" (UniqueName: \"kubernetes.io/projected/8e82e8af-59f5-41a0-8f77-0fc26d1d9ff7-kube-api-access-2gdbl\") pod \"monitoring-plugin-85bbbbbf4-cktwr\" (UID: \"8e82e8af-59f5-41a0-8f77-0fc26d1d9ff7\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-cktwr"
Sep 07 03:49:32.552147 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:49:32.551822    2559 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Sep 07 03:49:32.552147 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:49:32.551901    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e82e8af-59f5-41a0-8f77-0fc26d1d9ff7-monitoring-plugin-cert podName:8e82e8af-59f5-41a0-8f77-0fc26d1d9ff7 nodeName:}" failed. No retries permitted until 2026-09-07 03:49:33.051881435 +0000 UTC m=+76.364357334 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/8e82e8af-59f5-41a0-8f77-0fc26d1d9ff7-monitoring-plugin-cert") pod "monitoring-plugin-85bbbbbf4-cktwr" (UID: "8e82e8af-59f5-41a0-8f77-0fc26d1d9ff7") : secret "monitoring-plugin-cert" not found
Sep 07 03:49:32.561961 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.561932    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gdbl\" (UniqueName: \"kubernetes.io/projected/8e82e8af-59f5-41a0-8f77-0fc26d1d9ff7-kube-api-access-2gdbl\") pod \"monitoring-plugin-85bbbbbf4-cktwr\" (UID: \"8e82e8af-59f5-41a0-8f77-0fc26d1d9ff7\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-cktwr"
Sep 07 03:49:32.855764 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.855740    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-69dc9c6899-lmtrw"]
Sep 07 03:49:32.863108 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.863086    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-69dc9c6899-lmtrw"
Sep 07 03:49:32.865312 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.865292    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 07 03:49:32.865414 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.865314    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 07 03:49:32.865414 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.865335    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 07 03:49:32.865508 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.865441    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-ll2gc\""
Sep 07 03:49:32.865710 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.865691    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 07 03:49:32.865758 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.865690    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 07 03:49:32.871675 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.871654    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 07 03:49:32.874525 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.874502    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-69dc9c6899-lmtrw"]
Sep 07 03:49:32.955190 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.955160    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4bf3ca4a-32ee-45c6-9545-15598acc616d-federate-client-tls\") pod \"telemeter-client-69dc9c6899-lmtrw\" (UID: \"4bf3ca4a-32ee-45c6-9545-15598acc616d\") " pod="openshift-monitoring/telemeter-client-69dc9c6899-lmtrw"
Sep 07 03:49:32.955302 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.955211    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bf3ca4a-32ee-45c6-9545-15598acc616d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-69dc9c6899-lmtrw\" (UID: \"4bf3ca4a-32ee-45c6-9545-15598acc616d\") " pod="openshift-monitoring/telemeter-client-69dc9c6899-lmtrw"
Sep 07 03:49:32.955366 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.955305    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bf3ca4a-32ee-45c6-9545-15598acc616d-serving-certs-ca-bundle\") pod \"telemeter-client-69dc9c6899-lmtrw\" (UID: \"4bf3ca4a-32ee-45c6-9545-15598acc616d\") " pod="openshift-monitoring/telemeter-client-69dc9c6899-lmtrw"
Sep 07 03:49:32.955366 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.955343    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4bf3ca4a-32ee-45c6-9545-15598acc616d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-69dc9c6899-lmtrw\" (UID: \"4bf3ca4a-32ee-45c6-9545-15598acc616d\") " pod="openshift-monitoring/telemeter-client-69dc9c6899-lmtrw"
Sep 07 03:49:32.955471 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.955397    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4bf3ca4a-32ee-45c6-9545-15598acc616d-secret-telemeter-client\") pod \"telemeter-client-69dc9c6899-lmtrw\" (UID: \"4bf3ca4a-32ee-45c6-9545-15598acc616d\") " pod="openshift-monitoring/telemeter-client-69dc9c6899-lmtrw"
Sep 07 03:49:32.955471 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.955425    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4bf3ca4a-32ee-45c6-9545-15598acc616d-metrics-client-ca\") pod \"telemeter-client-69dc9c6899-lmtrw\" (UID: \"4bf3ca4a-32ee-45c6-9545-15598acc616d\") " pod="openshift-monitoring/telemeter-client-69dc9c6899-lmtrw"
Sep 07 03:49:32.955471 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.955463    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgxnk\" (UniqueName: \"kubernetes.io/projected/4bf3ca4a-32ee-45c6-9545-15598acc616d-kube-api-access-cgxnk\") pod \"telemeter-client-69dc9c6899-lmtrw\" (UID: \"4bf3ca4a-32ee-45c6-9545-15598acc616d\") " pod="openshift-monitoring/telemeter-client-69dc9c6899-lmtrw"
Sep 07 03:49:32.955634 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:32.955520    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4bf3ca4a-32ee-45c6-9545-15598acc616d-telemeter-client-tls\") pod \"telemeter-client-69dc9c6899-lmtrw\" (UID: \"4bf3ca4a-32ee-45c6-9545-15598acc616d\") " pod="openshift-monitoring/telemeter-client-69dc9c6899-lmtrw"
Sep 07 03:49:33.042958 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:33.042933    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-777967499f-zrndh"]
Sep 07 03:49:33.044967 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:49:33.044936    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod542e46e8_e669_45c2_85d2_d0e3511e474e.slice/crio-aecfcabc8d7841a69b6ff9029afd529c73f3db5852120342d25cf0234018df3a WatchSource:0}: Error finding container aecfcabc8d7841a69b6ff9029afd529c73f3db5852120342d25cf0234018df3a: Status 404 returned error can't find the container with id aecfcabc8d7841a69b6ff9029afd529c73f3db5852120342d25cf0234018df3a
Sep 07 03:49:33.056125 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:33.056101    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4bf3ca4a-32ee-45c6-9545-15598acc616d-federate-client-tls\") pod \"telemeter-client-69dc9c6899-lmtrw\" (UID: \"4bf3ca4a-32ee-45c6-9545-15598acc616d\") " pod="openshift-monitoring/telemeter-client-69dc9c6899-lmtrw"
Sep 07 03:49:33.056194 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:33.056135    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bf3ca4a-32ee-45c6-9545-15598acc616d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-69dc9c6899-lmtrw\" (UID: \"4bf3ca4a-32ee-45c6-9545-15598acc616d\") " pod="openshift-monitoring/telemeter-client-69dc9c6899-lmtrw"
Sep 07 03:49:33.056194 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:33.056163    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8e82e8af-59f5-41a0-8f77-0fc26d1d9ff7-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-cktwr\" (UID: \"8e82e8af-59f5-41a0-8f77-0fc26d1d9ff7\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-cktwr"
Sep 07 03:49:33.056194 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:33.056182    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bf3ca4a-32ee-45c6-9545-15598acc616d-serving-certs-ca-bundle\") pod \"telemeter-client-69dc9c6899-lmtrw\" (UID: \"4bf3ca4a-32ee-45c6-9545-15598acc616d\") " pod="openshift-monitoring/telemeter-client-69dc9c6899-lmtrw"
Sep 07 03:49:33.056366 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:33.056207    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4bf3ca4a-32ee-45c6-9545-15598acc616d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-69dc9c6899-lmtrw\" (UID: \"4bf3ca4a-32ee-45c6-9545-15598acc616d\") " pod="openshift-monitoring/telemeter-client-69dc9c6899-lmtrw"
Sep 07 03:49:33.056366 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:33.056249    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4bf3ca4a-32ee-45c6-9545-15598acc616d-secret-telemeter-client\") pod \"telemeter-client-69dc9c6899-lmtrw\" (UID: \"4bf3ca4a-32ee-45c6-9545-15598acc616d\") " pod="openshift-monitoring/telemeter-client-69dc9c6899-lmtrw"
Sep 07 03:49:33.056366 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:33.056274    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4bf3ca4a-32ee-45c6-9545-15598acc616d-metrics-client-ca\") pod \"telemeter-client-69dc9c6899-lmtrw\" (UID: \"4bf3ca4a-32ee-45c6-9545-15598acc616d\") " pod="openshift-monitoring/telemeter-client-69dc9c6899-lmtrw"
Sep 07 03:49:33.056366 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:33.056313    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgxnk\" (UniqueName: \"kubernetes.io/projected/4bf3ca4a-32ee-45c6-9545-15598acc616d-kube-api-access-cgxnk\") pod \"telemeter-client-69dc9c6899-lmtrw\" (UID: \"4bf3ca4a-32ee-45c6-9545-15598acc616d\") " pod="openshift-monitoring/telemeter-client-69dc9c6899-lmtrw"
Sep 07 03:49:33.056557 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:33.056369    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4bf3ca4a-32ee-45c6-9545-15598acc616d-telemeter-client-tls\") pod \"telemeter-client-69dc9c6899-lmtrw\" (UID: \"4bf3ca4a-32ee-45c6-9545-15598acc616d\") " pod="openshift-monitoring/telemeter-client-69dc9c6899-lmtrw"
Sep 07 03:49:33.057124 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:33.057098    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bf3ca4a-32ee-45c6-9545-15598acc616d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-69dc9c6899-lmtrw\" (UID: \"4bf3ca4a-32ee-45c6-9545-15598acc616d\") " pod="openshift-monitoring/telemeter-client-69dc9c6899-lmtrw"
Sep 07 03:49:33.057647 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:33.057338    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bf3ca4a-32ee-45c6-9545-15598acc616d-serving-certs-ca-bundle\") pod \"telemeter-client-69dc9c6899-lmtrw\" (UID: \"4bf3ca4a-32ee-45c6-9545-15598acc616d\") " pod="openshift-monitoring/telemeter-client-69dc9c6899-lmtrw"
Sep 07 03:49:33.058050 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:33.058022    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4bf3ca4a-32ee-45c6-9545-15598acc616d-metrics-client-ca\") pod \"telemeter-client-69dc9c6899-lmtrw\" (UID: \"4bf3ca4a-32ee-45c6-9545-15598acc616d\") " pod="openshift-monitoring/telemeter-client-69dc9c6899-lmtrw"
Sep 07 03:49:33.059856 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:33.059421    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4bf3ca4a-32ee-45c6-9545-15598acc616d-secret-telemeter-client\") pod \"telemeter-client-69dc9c6899-lmtrw\" (UID: \"4bf3ca4a-32ee-45c6-9545-15598acc616d\") " pod="openshift-monitoring/telemeter-client-69dc9c6899-lmtrw"
Sep 07 03:49:33.059856 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:33.059549    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4bf3ca4a-32ee-45c6-9545-15598acc616d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-69dc9c6899-lmtrw\" (UID: \"4bf3ca4a-32ee-45c6-9545-15598acc616d\") " pod="openshift-monitoring/telemeter-client-69dc9c6899-lmtrw"
Sep 07 03:49:33.059856 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:33.059794    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8e82e8af-59f5-41a0-8f77-0fc26d1d9ff7-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-cktwr\" (UID: \"8e82e8af-59f5-41a0-8f77-0fc26d1d9ff7\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-cktwr"
Sep 07 03:49:33.060164 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:33.060138    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4bf3ca4a-32ee-45c6-9545-15598acc616d-telemeter-client-tls\") pod \"telemeter-client-69dc9c6899-lmtrw\" (UID: \"4bf3ca4a-32ee-45c6-9545-15598acc616d\") " pod="openshift-monitoring/telemeter-client-69dc9c6899-lmtrw"
Sep 07 03:49:33.060653 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:33.060612    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4bf3ca4a-32ee-45c6-9545-15598acc616d-federate-client-tls\") pod \"telemeter-client-69dc9c6899-lmtrw\" (UID: \"4bf3ca4a-32ee-45c6-9545-15598acc616d\") " pod="openshift-monitoring/telemeter-client-69dc9c6899-lmtrw"
Sep 07 03:49:33.064659 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:33.064641    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgxnk\" (UniqueName: \"kubernetes.io/projected/4bf3ca4a-32ee-45c6-9545-15598acc616d-kube-api-access-cgxnk\") pod \"telemeter-client-69dc9c6899-lmtrw\" (UID: \"4bf3ca4a-32ee-45c6-9545-15598acc616d\") " pod="openshift-monitoring/telemeter-client-69dc9c6899-lmtrw"
Sep 07 03:49:33.180279 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:33.180251    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-69dc9c6899-lmtrw"
Sep 07 03:49:33.296209 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:33.296135    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-cktwr"
Sep 07 03:49:33.448297 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:33.448259    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-69dc9c6899-lmtrw"]
Sep 07 03:49:33.450787 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:49:33.450761    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bf3ca4a_32ee_45c6_9545_15598acc616d.slice/crio-1ef32bce8bd08a14eccef0103f1cf27024df0b22c3438c40b97b28af117c3b7a WatchSource:0}: Error finding container 1ef32bce8bd08a14eccef0103f1cf27024df0b22c3438c40b97b28af117c3b7a: Status 404 returned error can't find the container with id 1ef32bce8bd08a14eccef0103f1cf27024df0b22c3438c40b97b28af117c3b7a
Sep 07 03:49:33.561188 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:33.561085    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-cktwr"]
Sep 07 03:49:33.565150 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:49:33.565119    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e82e8af_59f5_41a0_8f77_0fc26d1d9ff7.slice/crio-0cac279782a65cadd5c7258f0f778f1900ec71391e3e62af13dca50b7af00289 WatchSource:0}: Error finding container 0cac279782a65cadd5c7258f0f778f1900ec71391e3e62af13dca50b7af00289: Status 404 returned error can't find the container with id 0cac279782a65cadd5c7258f0f778f1900ec71391e3e62af13dca50b7af00289
Sep 07 03:49:33.619016 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:33.618764    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"27ced0c4-a27d-4c48-96e2-da962483e808","Type":"ContainerStarted","Data":"e9886a97fcf07831c2d064cd1fba51068fe387722205470a983bc5557f513a38"}
Sep 07 03:49:33.619016 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:33.618855    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"27ced0c4-a27d-4c48-96e2-da962483e808","Type":"ContainerStarted","Data":"d1e39266e262769ba49d6f04a061bc8e9fa06f872a9d201c19d8b293c2e9d999"}
Sep 07 03:49:33.619016 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:33.618899    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"27ced0c4-a27d-4c48-96e2-da962483e808","Type":"ContainerStarted","Data":"74246e593123da33c1276754ae6a8d589d1f7864aa57a7117e55784121acb92a"}
Sep 07 03:49:33.619016 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:33.618940    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"27ced0c4-a27d-4c48-96e2-da962483e808","Type":"ContainerStarted","Data":"c1f8dfe1a37c7772cfaa9c476a267f9534e8085ffc349d7aea2e19ab25966226"}
Sep 07 03:49:33.619016 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:33.618971    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"27ced0c4-a27d-4c48-96e2-da962483e808","Type":"ContainerStarted","Data":"c948b440e6bfc342d24f8b392f22da3492ba977a73c11d1ada5d572ed42e3f6a"}
Sep 07 03:49:33.620668 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:33.620593    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-777967499f-zrndh" event={"ID":"542e46e8-e669-45c2-85d2-d0e3511e474e","Type":"ContainerStarted","Data":"aecfcabc8d7841a69b6ff9029afd529c73f3db5852120342d25cf0234018df3a"}
Sep 07 03:49:33.622735 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:33.622707    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-cktwr" event={"ID":"8e82e8af-59f5-41a0-8f77-0fc26d1d9ff7","Type":"ContainerStarted","Data":"0cac279782a65cadd5c7258f0f778f1900ec71391e3e62af13dca50b7af00289"}
Sep 07 03:49:33.624172 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:33.624148    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-69dc9c6899-lmtrw" event={"ID":"4bf3ca4a-32ee-45c6-9545-15598acc616d","Type":"ContainerStarted","Data":"1ef32bce8bd08a14eccef0103f1cf27024df0b22c3438c40b97b28af117c3b7a"}
Sep 07 03:49:34.637238 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:34.637101    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"27ced0c4-a27d-4c48-96e2-da962483e808","Type":"ContainerStarted","Data":"4edeb67a3445bb44f52e9355ba7d2fe855a050dd7c36d5f6072db2e42c5ec23c"}
Sep 07 03:49:34.639908 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:34.639662    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-777967499f-zrndh" event={"ID":"542e46e8-e669-45c2-85d2-d0e3511e474e","Type":"ContainerStarted","Data":"935bb412088f4b75515de52de23568d4cc158e1c3240ff9fc1ec6f225a09b2fb"}
Sep 07 03:49:34.663066 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:34.662962    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.792663396 podStartE2EDuration="6.662941995s" totalImagesPullingTime="3.850587412s" totalInitContainerRuntime="19.691187ms" isStatefulPod=false podCreationTimestamp="2026-09-07 03:49:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:49:34.661304322 +0000 UTC m=+77.973780247" watchObservedRunningTime="2026-09-07 03:49:34.662941995 +0000 UTC m=+77.975417898"
Sep 07 03:49:34.681754 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:34.681708    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-777967499f-zrndh" podStartSLOduration=1.289766495 podStartE2EDuration="2.681692043s" totalImagesPullingTime="1.391925548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 03:49:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:49:34.679669804 +0000 UTC m=+77.992145731" watchObservedRunningTime="2026-09-07 03:49:34.681692043 +0000 UTC m=+77.994167945"
Sep 07 03:49:34.861276 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:34.861238    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54cbb46fdd-l4pbm"]
Sep 07 03:49:34.864819 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:34.864796    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54cbb46fdd-l4pbm"
Sep 07 03:49:34.871904 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:34.871880    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 07 03:49:34.872203 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:34.872180    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0a9263c2-a5c6-49db-8c08-c47a7b1846b6-oauth-serving-cert\") pod \"console-54cbb46fdd-l4pbm\" (UID: \"0a9263c2-a5c6-49db-8c08-c47a7b1846b6\") " pod="openshift-console/console-54cbb46fdd-l4pbm"
Sep 07 03:49:34.872286 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:34.872256    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0a9263c2-a5c6-49db-8c08-c47a7b1846b6-console-oauth-config\") pod \"console-54cbb46fdd-l4pbm\" (UID: \"0a9263c2-a5c6-49db-8c08-c47a7b1846b6\") " pod="openshift-console/console-54cbb46fdd-l4pbm"
Sep 07 03:49:34.872344 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:34.872303    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0a9263c2-a5c6-49db-8c08-c47a7b1846b6-console-serving-cert\") pod \"console-54cbb46fdd-l4pbm\" (UID: \"0a9263c2-a5c6-49db-8c08-c47a7b1846b6\") " pod="openshift-console/console-54cbb46fdd-l4pbm"
Sep 07 03:49:34.872397 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:34.872329    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0a9263c2-a5c6-49db-8c08-c47a7b1846b6-console-config\") pod \"console-54cbb46fdd-l4pbm\" (UID: \"0a9263c2-a5c6-49db-8c08-c47a7b1846b6\") " pod="openshift-console/console-54cbb46fdd-l4pbm"
Sep 07 03:49:34.872397 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:34.872379    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a9263c2-a5c6-49db-8c08-c47a7b1846b6-trusted-ca-bundle\") pod \"console-54cbb46fdd-l4pbm\" (UID: \"0a9263c2-a5c6-49db-8c08-c47a7b1846b6\") " pod="openshift-console/console-54cbb46fdd-l4pbm"
Sep 07 03:49:34.872511 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:34.872404    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ltbq\" (UniqueName: \"kubernetes.io/projected/0a9263c2-a5c6-49db-8c08-c47a7b1846b6-kube-api-access-8ltbq\") pod \"console-54cbb46fdd-l4pbm\" (UID: \"0a9263c2-a5c6-49db-8c08-c47a7b1846b6\") " pod="openshift-console/console-54cbb46fdd-l4pbm"
Sep 07 03:49:34.872511 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:34.872435    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0a9263c2-a5c6-49db-8c08-c47a7b1846b6-service-ca\") pod \"console-54cbb46fdd-l4pbm\" (UID: \"0a9263c2-a5c6-49db-8c08-c47a7b1846b6\") " pod="openshift-console/console-54cbb46fdd-l4pbm"
Sep 07 03:49:34.875093 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:34.875071    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54cbb46fdd-l4pbm"]
Sep 07 03:49:34.973824 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:34.973780    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0a9263c2-a5c6-49db-8c08-c47a7b1846b6-console-serving-cert\") pod \"console-54cbb46fdd-l4pbm\" (UID: \"0a9263c2-a5c6-49db-8c08-c47a7b1846b6\") " pod="openshift-console/console-54cbb46fdd-l4pbm"
Sep 07 03:49:34.973984 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:34.973842    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0a9263c2-a5c6-49db-8c08-c47a7b1846b6-console-config\") pod \"console-54cbb46fdd-l4pbm\" (UID: \"0a9263c2-a5c6-49db-8c08-c47a7b1846b6\") " pod="openshift-console/console-54cbb46fdd-l4pbm"
Sep 07 03:49:34.973984 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:34.973867    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a9263c2-a5c6-49db-8c08-c47a7b1846b6-trusted-ca-bundle\") pod \"console-54cbb46fdd-l4pbm\" (UID: \"0a9263c2-a5c6-49db-8c08-c47a7b1846b6\") " pod="openshift-console/console-54cbb46fdd-l4pbm"
Sep 07 03:49:34.973984 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:34.973894    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ltbq\" (UniqueName: \"kubernetes.io/projected/0a9263c2-a5c6-49db-8c08-c47a7b1846b6-kube-api-access-8ltbq\") pod \"console-54cbb46fdd-l4pbm\" (UID: \"0a9263c2-a5c6-49db-8c08-c47a7b1846b6\") " pod="openshift-console/console-54cbb46fdd-l4pbm"
Sep 07 03:49:34.973984 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:34.973927    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0a9263c2-a5c6-49db-8c08-c47a7b1846b6-service-ca\") pod \"console-54cbb46fdd-l4pbm\" (UID: \"0a9263c2-a5c6-49db-8c08-c47a7b1846b6\") " pod="openshift-console/console-54cbb46fdd-l4pbm"
Sep 07 03:49:34.973984 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:34.973950    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0a9263c2-a5c6-49db-8c08-c47a7b1846b6-oauth-serving-cert\") pod \"console-54cbb46fdd-l4pbm\" (UID: \"0a9263c2-a5c6-49db-8c08-c47a7b1846b6\") " pod="openshift-console/console-54cbb46fdd-l4pbm"
Sep 07 03:49:34.974230 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:34.974013    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0a9263c2-a5c6-49db-8c08-c47a7b1846b6-console-oauth-config\") pod \"console-54cbb46fdd-l4pbm\" (UID: \"0a9263c2-a5c6-49db-8c08-c47a7b1846b6\") " pod="openshift-console/console-54cbb46fdd-l4pbm"
Sep 07 03:49:34.974744 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:34.974700    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0a9263c2-a5c6-49db-8c08-c47a7b1846b6-console-config\") pod \"console-54cbb46fdd-l4pbm\" (UID: \"0a9263c2-a5c6-49db-8c08-c47a7b1846b6\") " pod="openshift-console/console-54cbb46fdd-l4pbm"
Sep 07 03:49:34.975252 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:34.975196    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a9263c2-a5c6-49db-8c08-c47a7b1846b6-trusted-ca-bundle\") pod \"console-54cbb46fdd-l4pbm\" (UID: \"0a9263c2-a5c6-49db-8c08-c47a7b1846b6\") " pod="openshift-console/console-54cbb46fdd-l4pbm"
Sep 07 03:49:34.975673 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:34.975604    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0a9263c2-a5c6-49db-8c08-c47a7b1846b6-oauth-serving-cert\") pod \"console-54cbb46fdd-l4pbm\" (UID: \"0a9263c2-a5c6-49db-8c08-c47a7b1846b6\") " pod="openshift-console/console-54cbb46fdd-l4pbm"
Sep 07 03:49:34.976016 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:34.975978    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0a9263c2-a5c6-49db-8c08-c47a7b1846b6-service-ca\") pod \"console-54cbb46fdd-l4pbm\" (UID: \"0a9263c2-a5c6-49db-8c08-c47a7b1846b6\") " pod="openshift-console/console-54cbb46fdd-l4pbm"
Sep 07 03:49:34.976978 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:34.976957    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0a9263c2-a5c6-49db-8c08-c47a7b1846b6-console-serving-cert\") pod \"console-54cbb46fdd-l4pbm\" (UID: \"0a9263c2-a5c6-49db-8c08-c47a7b1846b6\") " pod="openshift-console/console-54cbb46fdd-l4pbm"
Sep 07 03:49:34.978685 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:34.978657    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0a9263c2-a5c6-49db-8c08-c47a7b1846b6-console-oauth-config\") pod \"console-54cbb46fdd-l4pbm\" (UID: \"0a9263c2-a5c6-49db-8c08-c47a7b1846b6\") " pod="openshift-console/console-54cbb46fdd-l4pbm"
Sep 07 03:49:34.983643 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:34.983580    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ltbq\" (UniqueName: \"kubernetes.io/projected/0a9263c2-a5c6-49db-8c08-c47a7b1846b6-kube-api-access-8ltbq\") pod \"console-54cbb46fdd-l4pbm\" (UID: \"0a9263c2-a5c6-49db-8c08-c47a7b1846b6\") " pod="openshift-console/console-54cbb46fdd-l4pbm"
Sep 07 03:49:35.176458 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:35.176370    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54cbb46fdd-l4pbm"
Sep 07 03:49:35.848718 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:35.848647    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54cbb46fdd-l4pbm"]
Sep 07 03:49:35.851231 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:49:35.851201    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a9263c2_a5c6_49db_8c08_c47a7b1846b6.slice/crio-31fc1191f36a2313f8250f840c960e4ec9412f2f914f4f367dda41fb3455cc3b WatchSource:0}: Error finding container 31fc1191f36a2313f8250f840c960e4ec9412f2f914f4f367dda41fb3455cc3b: Status 404 returned error can't find the container with id 31fc1191f36a2313f8250f840c960e4ec9412f2f914f4f367dda41fb3455cc3b
Sep 07 03:49:36.501335 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:36.501240    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5dd7677cd4-phv45"
Sep 07 03:49:36.501506 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:36.501382    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5dd7677cd4-phv45"
Sep 07 03:49:36.506062 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:36.506041    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5dd7677cd4-phv45"
Sep 07 03:49:36.650560 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:36.650521    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-cktwr" event={"ID":"8e82e8af-59f5-41a0-8f77-0fc26d1d9ff7","Type":"ContainerStarted","Data":"a2857267b395815b6177b85e8f3e3fa758a5a11b2f2af20707477081047744f2"}
Sep 07 03:49:36.650763 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:36.650735    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-cktwr"
Sep 07 03:49:36.652928 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:36.652904    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-69dc9c6899-lmtrw" event={"ID":"4bf3ca4a-32ee-45c6-9545-15598acc616d","Type":"ContainerStarted","Data":"0594d0b186216a93ec82fbf63b9c21959e6353943bde542ddc9792f1cb832d2f"}
Sep 07 03:49:36.653027 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:36.652954    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-69dc9c6899-lmtrw" event={"ID":"4bf3ca4a-32ee-45c6-9545-15598acc616d","Type":"ContainerStarted","Data":"0247963650f7dea2d3fba63d1e1502a7b9aa6cdc68b60f019ffaa03f46a36747"}
Sep 07 03:49:36.653027 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:36.652978    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-69dc9c6899-lmtrw" event={"ID":"4bf3ca4a-32ee-45c6-9545-15598acc616d","Type":"ContainerStarted","Data":"2cf52144252a15637f71c8a95b7372103139c3dfc2a424510a7d9ec78a47003e"}
Sep 07 03:49:36.654794 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:36.654767    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54cbb46fdd-l4pbm" event={"ID":"0a9263c2-a5c6-49db-8c08-c47a7b1846b6","Type":"ContainerStarted","Data":"499c714de2d91e6c27248494f78dcb79489b6909486de935f968857980930420"}
Sep 07 03:49:36.654907 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:36.654811    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54cbb46fdd-l4pbm" event={"ID":"0a9263c2-a5c6-49db-8c08-c47a7b1846b6","Type":"ContainerStarted","Data":"31fc1191f36a2313f8250f840c960e4ec9412f2f914f4f367dda41fb3455cc3b"}
Sep 07 03:49:36.656300 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:36.656277    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-cktwr"
Sep 07 03:49:36.658734 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:36.658715    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5dd7677cd4-phv45"
Sep 07 03:49:36.666797 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:36.666758    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-cktwr" podStartSLOduration=2.644367345 podStartE2EDuration="4.666742371s" totalImagesPullingTime="2.022375026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 03:49:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:49:36.665209462 +0000 UTC m=+79.977685363" watchObservedRunningTime="2026-09-07 03:49:36.666742371 +0000 UTC m=+79.979218276"
Sep 07 03:49:36.681697 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:36.681660    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54cbb46fdd-l4pbm" podStartSLOduration=2.681647972 podStartE2EDuration="2.681647972s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 03:49:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:49:36.680505026 +0000 UTC m=+79.992980928" watchObservedRunningTime="2026-09-07 03:49:36.681647972 +0000 UTC m=+79.994123864"
Sep 07 03:49:36.732106 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:36.731928    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-69dc9c6899-lmtrw" podStartSLOduration=2.596446027 podStartE2EDuration="4.731907702s" totalImagesPullingTime="2.135461675s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 03:49:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:49:36.730228232 +0000 UTC m=+80.042704154" watchObservedRunningTime="2026-09-07 03:49:36.731907702 +0000 UTC m=+80.044383605"
Sep 07 03:49:42.083966 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:42.083853    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54cbb46fdd-l4pbm"]
Sep 07 03:49:42.116162 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:42.116133    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5699f5f975-b7ks9"]
Sep 07 03:49:42.120607 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:42.120586    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5699f5f975-b7ks9"
Sep 07 03:49:42.135985 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:42.135958    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5699f5f975-b7ks9"]
Sep 07 03:49:42.229310 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:42.229282    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/800f7326-b838-4e61-843f-f6a6e6dcca92-trusted-ca-bundle\") pod \"console-5699f5f975-b7ks9\" (UID: \"800f7326-b838-4e61-843f-f6a6e6dcca92\") " pod="openshift-console/console-5699f5f975-b7ks9"
Sep 07 03:49:42.229466 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:42.229320    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/800f7326-b838-4e61-843f-f6a6e6dcca92-console-config\") pod \"console-5699f5f975-b7ks9\" (UID: \"800f7326-b838-4e61-843f-f6a6e6dcca92\") " pod="openshift-console/console-5699f5f975-b7ks9"
Sep 07 03:49:42.229466 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:42.229341    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/800f7326-b838-4e61-843f-f6a6e6dcca92-service-ca\") pod \"console-5699f5f975-b7ks9\" (UID: \"800f7326-b838-4e61-843f-f6a6e6dcca92\") " pod="openshift-console/console-5699f5f975-b7ks9"
Sep 07 03:49:42.229466 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:42.229401    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktjtg\" (UniqueName: \"kubernetes.io/projected/800f7326-b838-4e61-843f-f6a6e6dcca92-kube-api-access-ktjtg\") pod \"console-5699f5f975-b7ks9\" (UID: \"800f7326-b838-4e61-843f-f6a6e6dcca92\") " pod="openshift-console/console-5699f5f975-b7ks9"
Sep 07 03:49:42.229466 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:42.229431    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/800f7326-b838-4e61-843f-f6a6e6dcca92-console-serving-cert\") pod \"console-5699f5f975-b7ks9\" (UID: \"800f7326-b838-4e61-843f-f6a6e6dcca92\") " pod="openshift-console/console-5699f5f975-b7ks9"
Sep 07 03:49:42.229659 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:42.229488    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/800f7326-b838-4e61-843f-f6a6e6dcca92-console-oauth-config\") pod \"console-5699f5f975-b7ks9\" (UID: \"800f7326-b838-4e61-843f-f6a6e6dcca92\") " pod="openshift-console/console-5699f5f975-b7ks9"
Sep 07 03:49:42.229659 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:42.229532    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/800f7326-b838-4e61-843f-f6a6e6dcca92-oauth-serving-cert\") pod \"console-5699f5f975-b7ks9\" (UID: \"800f7326-b838-4e61-843f-f6a6e6dcca92\") " pod="openshift-console/console-5699f5f975-b7ks9"
Sep 07 03:49:42.330584 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:42.330559    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/800f7326-b838-4e61-843f-f6a6e6dcca92-oauth-serving-cert\") pod \"console-5699f5f975-b7ks9\" (UID: \"800f7326-b838-4e61-843f-f6a6e6dcca92\") " pod="openshift-console/console-5699f5f975-b7ks9"
Sep 07 03:49:42.330750 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:42.330590    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/800f7326-b838-4e61-843f-f6a6e6dcca92-trusted-ca-bundle\") pod \"console-5699f5f975-b7ks9\" (UID: \"800f7326-b838-4e61-843f-f6a6e6dcca92\") " pod="openshift-console/console-5699f5f975-b7ks9"
Sep 07 03:49:42.330750 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:42.330608    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/800f7326-b838-4e61-843f-f6a6e6dcca92-console-config\") pod \"console-5699f5f975-b7ks9\" (UID: \"800f7326-b838-4e61-843f-f6a6e6dcca92\") " pod="openshift-console/console-5699f5f975-b7ks9"
Sep 07 03:49:42.330750 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:42.330648    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/800f7326-b838-4e61-843f-f6a6e6dcca92-service-ca\") pod \"console-5699f5f975-b7ks9\" (UID: \"800f7326-b838-4e61-843f-f6a6e6dcca92\") " pod="openshift-console/console-5699f5f975-b7ks9"
Sep 07 03:49:42.330750 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:42.330693    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktjtg\" (UniqueName: \"kubernetes.io/projected/800f7326-b838-4e61-843f-f6a6e6dcca92-kube-api-access-ktjtg\") pod \"console-5699f5f975-b7ks9\" (UID: \"800f7326-b838-4e61-843f-f6a6e6dcca92\") " pod="openshift-console/console-5699f5f975-b7ks9"
Sep 07 03:49:42.330750 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:42.330710    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/800f7326-b838-4e61-843f-f6a6e6dcca92-console-serving-cert\") pod \"console-5699f5f975-b7ks9\" (UID: \"800f7326-b838-4e61-843f-f6a6e6dcca92\") " pod="openshift-console/console-5699f5f975-b7ks9"
Sep 07 03:49:42.331005 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:42.330758    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/800f7326-b838-4e61-843f-f6a6e6dcca92-console-oauth-config\") pod \"console-5699f5f975-b7ks9\" (UID: \"800f7326-b838-4e61-843f-f6a6e6dcca92\") " pod="openshift-console/console-5699f5f975-b7ks9"
Sep 07 03:49:42.331436 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:42.331408    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/800f7326-b838-4e61-843f-f6a6e6dcca92-oauth-serving-cert\") pod \"console-5699f5f975-b7ks9\" (UID: \"800f7326-b838-4e61-843f-f6a6e6dcca92\") " pod="openshift-console/console-5699f5f975-b7ks9"
Sep 07 03:49:42.331538 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:42.331408    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/800f7326-b838-4e61-843f-f6a6e6dcca92-console-config\") pod \"console-5699f5f975-b7ks9\" (UID: \"800f7326-b838-4e61-843f-f6a6e6dcca92\") " pod="openshift-console/console-5699f5f975-b7ks9"
Sep 07 03:49:42.331538 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:42.331515    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/800f7326-b838-4e61-843f-f6a6e6dcca92-service-ca\") pod \"console-5699f5f975-b7ks9\" (UID: \"800f7326-b838-4e61-843f-f6a6e6dcca92\") " pod="openshift-console/console-5699f5f975-b7ks9"
Sep 07 03:49:42.331662 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:42.331568    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/800f7326-b838-4e61-843f-f6a6e6dcca92-trusted-ca-bundle\") pod \"console-5699f5f975-b7ks9\" (UID: \"800f7326-b838-4e61-843f-f6a6e6dcca92\") " pod="openshift-console/console-5699f5f975-b7ks9"
Sep 07 03:49:42.333107 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:42.333079    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/800f7326-b838-4e61-843f-f6a6e6dcca92-console-oauth-config\") pod \"console-5699f5f975-b7ks9\" (UID: \"800f7326-b838-4e61-843f-f6a6e6dcca92\") " pod="openshift-console/console-5699f5f975-b7ks9"
Sep 07 03:49:42.333275 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:42.333256    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/800f7326-b838-4e61-843f-f6a6e6dcca92-console-serving-cert\") pod \"console-5699f5f975-b7ks9\" (UID: \"800f7326-b838-4e61-843f-f6a6e6dcca92\") " pod="openshift-console/console-5699f5f975-b7ks9"
Sep 07 03:49:42.338613 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:42.338563    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktjtg\" (UniqueName: \"kubernetes.io/projected/800f7326-b838-4e61-843f-f6a6e6dcca92-kube-api-access-ktjtg\") pod \"console-5699f5f975-b7ks9\" (UID: \"800f7326-b838-4e61-843f-f6a6e6dcca92\") " pod="openshift-console/console-5699f5f975-b7ks9"
Sep 07 03:49:42.430294 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:42.430268    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5699f5f975-b7ks9"
Sep 07 03:49:42.702389 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:42.702361    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5699f5f975-b7ks9"]
Sep 07 03:49:42.704818 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:49:42.704792    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod800f7326_b838_4e61_843f_f6a6e6dcca92.slice/crio-549ca019433f8835e8eb22b2ff37bc1a5c00d78c14fff7ba9de72bbbbda93bb1 WatchSource:0}: Error finding container 549ca019433f8835e8eb22b2ff37bc1a5c00d78c14fff7ba9de72bbbbda93bb1: Status 404 returned error can't find the container with id 549ca019433f8835e8eb22b2ff37bc1a5c00d78c14fff7ba9de72bbbbda93bb1
Sep 07 03:49:43.686268 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:43.686232    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5699f5f975-b7ks9" event={"ID":"800f7326-b838-4e61-843f-f6a6e6dcca92","Type":"ContainerStarted","Data":"259f7d176c9e6255c9b46253cb9b95b261a2ca5b75ae56070cb92a920c3dbd8f"}
Sep 07 03:49:43.686665 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:43.686279    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5699f5f975-b7ks9" event={"ID":"800f7326-b838-4e61-843f-f6a6e6dcca92","Type":"ContainerStarted","Data":"549ca019433f8835e8eb22b2ff37bc1a5c00d78c14fff7ba9de72bbbbda93bb1"}
Sep 07 03:49:43.705511 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:43.705453    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5699f5f975-b7ks9" podStartSLOduration=1.705436793 podStartE2EDuration="1.705436793s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 03:49:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:49:43.704337142 +0000 UTC m=+87.016813043" watchObservedRunningTime="2026-09-07 03:49:43.705436793 +0000 UTC m=+87.017912694"
Sep 07 03:49:45.177759 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:45.177724    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54cbb46fdd-l4pbm"
Sep 07 03:49:52.431066 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:52.431029    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5699f5f975-b7ks9"
Sep 07 03:49:52.431616 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:52.431100    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5699f5f975-b7ks9"
Sep 07 03:49:52.435902 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:52.435884    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5699f5f975-b7ks9"
Sep 07 03:49:52.455742 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:52.455724    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-777967499f-zrndh"
Sep 07 03:49:52.455971 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:52.455951    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-777967499f-zrndh"
Sep 07 03:49:52.722239 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:52.722166    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5699f5f975-b7ks9"
Sep 07 03:49:52.766694 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:52.766662    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5dd7677cd4-phv45"]
Sep 07 03:49:59.590797 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:49:59.590766    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hvk8h"
Sep 07 03:50:07.104361 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:07.104312    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-54cbb46fdd-l4pbm" podUID="0a9263c2-a5c6-49db-8c08-c47a7b1846b6" containerName="console" containerID="cri-o://499c714de2d91e6c27248494f78dcb79489b6909486de935f968857980930420" gracePeriod=15
Sep 07 03:50:07.367020 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:07.366991    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54cbb46fdd-l4pbm"
Sep 07 03:50:07.433937 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:07.433907    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0a9263c2-a5c6-49db-8c08-c47a7b1846b6-console-config\") pod \"0a9263c2-a5c6-49db-8c08-c47a7b1846b6\" (UID: \"0a9263c2-a5c6-49db-8c08-c47a7b1846b6\") "
Sep 07 03:50:07.434077 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:07.433953    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0a9263c2-a5c6-49db-8c08-c47a7b1846b6-console-serving-cert\") pod \"0a9263c2-a5c6-49db-8c08-c47a7b1846b6\" (UID: \"0a9263c2-a5c6-49db-8c08-c47a7b1846b6\") "
Sep 07 03:50:07.434077 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:07.434002    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ltbq\" (UniqueName: \"kubernetes.io/projected/0a9263c2-a5c6-49db-8c08-c47a7b1846b6-kube-api-access-8ltbq\") pod \"0a9263c2-a5c6-49db-8c08-c47a7b1846b6\" (UID: \"0a9263c2-a5c6-49db-8c08-c47a7b1846b6\") "
Sep 07 03:50:07.434077 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:07.434020    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0a9263c2-a5c6-49db-8c08-c47a7b1846b6-oauth-serving-cert\") pod \"0a9263c2-a5c6-49db-8c08-c47a7b1846b6\" (UID: \"0a9263c2-a5c6-49db-8c08-c47a7b1846b6\") "
Sep 07 03:50:07.434077 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:07.434063    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0a9263c2-a5c6-49db-8c08-c47a7b1846b6-service-ca\") pod \"0a9263c2-a5c6-49db-8c08-c47a7b1846b6\" (UID: \"0a9263c2-a5c6-49db-8c08-c47a7b1846b6\") "
Sep 07 03:50:07.434291 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:07.434210    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a9263c2-a5c6-49db-8c08-c47a7b1846b6-trusted-ca-bundle\") pod \"0a9263c2-a5c6-49db-8c08-c47a7b1846b6\" (UID: \"0a9263c2-a5c6-49db-8c08-c47a7b1846b6\") "
Sep 07 03:50:07.434291 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:07.434281    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0a9263c2-a5c6-49db-8c08-c47a7b1846b6-console-oauth-config\") pod \"0a9263c2-a5c6-49db-8c08-c47a7b1846b6\" (UID: \"0a9263c2-a5c6-49db-8c08-c47a7b1846b6\") "
Sep 07 03:50:07.434391 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:07.434341    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a9263c2-a5c6-49db-8c08-c47a7b1846b6-console-config" (OuterVolumeSpecName: "console-config") pod "0a9263c2-a5c6-49db-8c08-c47a7b1846b6" (UID: "0a9263c2-a5c6-49db-8c08-c47a7b1846b6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 03:50:07.434553 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:07.434527    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a9263c2-a5c6-49db-8c08-c47a7b1846b6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0a9263c2-a5c6-49db-8c08-c47a7b1846b6" (UID: "0a9263c2-a5c6-49db-8c08-c47a7b1846b6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 03:50:07.434641 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:07.434533    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a9263c2-a5c6-49db-8c08-c47a7b1846b6-service-ca" (OuterVolumeSpecName: "service-ca") pod "0a9263c2-a5c6-49db-8c08-c47a7b1846b6" (UID: "0a9263c2-a5c6-49db-8c08-c47a7b1846b6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 03:50:07.434641 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:07.434533    2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0a9263c2-a5c6-49db-8c08-c47a7b1846b6-console-config\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:50:07.434757 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:07.434712    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a9263c2-a5c6-49db-8c08-c47a7b1846b6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0a9263c2-a5c6-49db-8c08-c47a7b1846b6" (UID: "0a9263c2-a5c6-49db-8c08-c47a7b1846b6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 03:50:07.436299 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:07.436273    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a9263c2-a5c6-49db-8c08-c47a7b1846b6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0a9263c2-a5c6-49db-8c08-c47a7b1846b6" (UID: "0a9263c2-a5c6-49db-8c08-c47a7b1846b6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 03:50:07.436402 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:07.436316    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a9263c2-a5c6-49db-8c08-c47a7b1846b6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0a9263c2-a5c6-49db-8c08-c47a7b1846b6" (UID: "0a9263c2-a5c6-49db-8c08-c47a7b1846b6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 03:50:07.436402 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:07.436326    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a9263c2-a5c6-49db-8c08-c47a7b1846b6-kube-api-access-8ltbq" (OuterVolumeSpecName: "kube-api-access-8ltbq") pod "0a9263c2-a5c6-49db-8c08-c47a7b1846b6" (UID: "0a9263c2-a5c6-49db-8c08-c47a7b1846b6"). InnerVolumeSpecName "kube-api-access-8ltbq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 03:50:07.535666 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:07.535615    2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0a9263c2-a5c6-49db-8c08-c47a7b1846b6-service-ca\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:50:07.535666 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:07.535660    2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a9263c2-a5c6-49db-8c08-c47a7b1846b6-trusted-ca-bundle\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:50:07.535666 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:07.535669    2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0a9263c2-a5c6-49db-8c08-c47a7b1846b6-console-oauth-config\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:50:07.535847 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:07.535678    2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0a9263c2-a5c6-49db-8c08-c47a7b1846b6-console-serving-cert\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:50:07.535847 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:07.535687    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ltbq\" (UniqueName: \"kubernetes.io/projected/0a9263c2-a5c6-49db-8c08-c47a7b1846b6-kube-api-access-8ltbq\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:50:07.535847 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:07.535696    2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0a9263c2-a5c6-49db-8c08-c47a7b1846b6-oauth-serving-cert\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:50:07.775364 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:07.775290    2559 generic.go:356] "Generic (PLEG): container finished" podID="0a9263c2-a5c6-49db-8c08-c47a7b1846b6" containerID="499c714de2d91e6c27248494f78dcb79489b6909486de935f968857980930420" exitCode=0
Sep 07 03:50:07.775364 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:07.775340    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54cbb46fdd-l4pbm"
Sep 07 03:50:07.775526 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:07.775377    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54cbb46fdd-l4pbm" event={"ID":"0a9263c2-a5c6-49db-8c08-c47a7b1846b6","Type":"ContainerDied","Data":"499c714de2d91e6c27248494f78dcb79489b6909486de935f968857980930420"}
Sep 07 03:50:07.775526 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:07.775438    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54cbb46fdd-l4pbm" event={"ID":"0a9263c2-a5c6-49db-8c08-c47a7b1846b6","Type":"ContainerDied","Data":"31fc1191f36a2313f8250f840c960e4ec9412f2f914f4f367dda41fb3455cc3b"}
Sep 07 03:50:07.775526 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:07.775461    2559 scope.go:117] "RemoveContainer" containerID="499c714de2d91e6c27248494f78dcb79489b6909486de935f968857980930420"
Sep 07 03:50:07.783766 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:07.783749    2559 scope.go:117] "RemoveContainer" containerID="499c714de2d91e6c27248494f78dcb79489b6909486de935f968857980930420"
Sep 07 03:50:07.784016 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:50:07.783997    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"499c714de2d91e6c27248494f78dcb79489b6909486de935f968857980930420\": container with ID starting with 499c714de2d91e6c27248494f78dcb79489b6909486de935f968857980930420 not found: ID does not exist" containerID="499c714de2d91e6c27248494f78dcb79489b6909486de935f968857980930420"
Sep 07 03:50:07.784068 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:07.784026    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"499c714de2d91e6c27248494f78dcb79489b6909486de935f968857980930420"} err="failed to get container status \"499c714de2d91e6c27248494f78dcb79489b6909486de935f968857980930420\": rpc error: code = NotFound desc = could not find container \"499c714de2d91e6c27248494f78dcb79489b6909486de935f968857980930420\": container with ID starting with 499c714de2d91e6c27248494f78dcb79489b6909486de935f968857980930420 not found: ID does not exist"
Sep 07 03:50:07.794891 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:07.794872    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54cbb46fdd-l4pbm"]
Sep 07 03:50:07.797789 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:07.797768    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54cbb46fdd-l4pbm"]
Sep 07 03:50:09.178169 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:09.178134    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a9263c2-a5c6-49db-8c08-c47a7b1846b6" path="/var/lib/kubelet/pods/0a9263c2-a5c6-49db-8c08-c47a7b1846b6/volumes"
Sep 07 03:50:12.460288 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:12.460258    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-777967499f-zrndh"
Sep 07 03:50:12.464114 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:12.464090    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-777967499f-zrndh"
Sep 07 03:50:17.792521 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:17.792456    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5dd7677cd4-phv45" podUID="2cd0e730-85b4-4317-936a-2c07ca36ac77" containerName="console" containerID="cri-o://a742cbc73f62a3c7f6d7ade9180c4ec35122a35ef707a2b971e431d8f058cd77" gracePeriod=15
Sep 07 03:50:18.031279 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:18.031252    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dd7677cd4-phv45"
Sep 07 03:50:18.108843 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:18.108814    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2cd0e730-85b4-4317-936a-2c07ca36ac77-oauth-serving-cert\") pod \"2cd0e730-85b4-4317-936a-2c07ca36ac77\" (UID: \"2cd0e730-85b4-4317-936a-2c07ca36ac77\") "
Sep 07 03:50:18.108986 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:18.108861    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2cd0e730-85b4-4317-936a-2c07ca36ac77-service-ca\") pod \"2cd0e730-85b4-4317-936a-2c07ca36ac77\" (UID: \"2cd0e730-85b4-4317-936a-2c07ca36ac77\") "
Sep 07 03:50:18.108986 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:18.108883    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2cd0e730-85b4-4317-936a-2c07ca36ac77-console-serving-cert\") pod \"2cd0e730-85b4-4317-936a-2c07ca36ac77\" (UID: \"2cd0e730-85b4-4317-936a-2c07ca36ac77\") "
Sep 07 03:50:18.108986 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:18.108905    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vvlpw\" (UniqueName: \"kubernetes.io/projected/2cd0e730-85b4-4317-936a-2c07ca36ac77-kube-api-access-vvlpw\") pod \"2cd0e730-85b4-4317-936a-2c07ca36ac77\" (UID: \"2cd0e730-85b4-4317-936a-2c07ca36ac77\") "
Sep 07 03:50:18.108986 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:18.108938    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2cd0e730-85b4-4317-936a-2c07ca36ac77-console-config\") pod \"2cd0e730-85b4-4317-936a-2c07ca36ac77\" (UID: \"2cd0e730-85b4-4317-936a-2c07ca36ac77\") "
Sep 07 03:50:18.108986 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:18.108956    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2cd0e730-85b4-4317-936a-2c07ca36ac77-console-oauth-config\") pod \"2cd0e730-85b4-4317-936a-2c07ca36ac77\" (UID: \"2cd0e730-85b4-4317-936a-2c07ca36ac77\") "
Sep 07 03:50:18.109334 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:18.109290    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2cd0e730-85b4-4317-936a-2c07ca36ac77-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2cd0e730-85b4-4317-936a-2c07ca36ac77" (UID: "2cd0e730-85b4-4317-936a-2c07ca36ac77"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 03:50:18.109334 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:18.109302    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2cd0e730-85b4-4317-936a-2c07ca36ac77-service-ca" (OuterVolumeSpecName: "service-ca") pod "2cd0e730-85b4-4317-936a-2c07ca36ac77" (UID: "2cd0e730-85b4-4317-936a-2c07ca36ac77"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 03:50:18.109483 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:18.109345    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2cd0e730-85b4-4317-936a-2c07ca36ac77-console-config" (OuterVolumeSpecName: "console-config") pod "2cd0e730-85b4-4317-936a-2c07ca36ac77" (UID: "2cd0e730-85b4-4317-936a-2c07ca36ac77"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 03:50:18.111182 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:18.111158    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cd0e730-85b4-4317-936a-2c07ca36ac77-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2cd0e730-85b4-4317-936a-2c07ca36ac77" (UID: "2cd0e730-85b4-4317-936a-2c07ca36ac77"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 03:50:18.111182 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:18.111158    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cd0e730-85b4-4317-936a-2c07ca36ac77-kube-api-access-vvlpw" (OuterVolumeSpecName: "kube-api-access-vvlpw") pod "2cd0e730-85b4-4317-936a-2c07ca36ac77" (UID: "2cd0e730-85b4-4317-936a-2c07ca36ac77"). InnerVolumeSpecName "kube-api-access-vvlpw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 03:50:18.111299 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:18.111215    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cd0e730-85b4-4317-936a-2c07ca36ac77-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2cd0e730-85b4-4317-936a-2c07ca36ac77" (UID: "2cd0e730-85b4-4317-936a-2c07ca36ac77"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 03:50:18.209521 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:18.209491    2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2cd0e730-85b4-4317-936a-2c07ca36ac77-oauth-serving-cert\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:50:18.209521 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:18.209515    2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2cd0e730-85b4-4317-936a-2c07ca36ac77-service-ca\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:50:18.209521 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:18.209525    2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2cd0e730-85b4-4317-936a-2c07ca36ac77-console-serving-cert\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:50:18.209729 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:18.209534    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vvlpw\" (UniqueName: \"kubernetes.io/projected/2cd0e730-85b4-4317-936a-2c07ca36ac77-kube-api-access-vvlpw\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:50:18.209729 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:18.209542    2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2cd0e730-85b4-4317-936a-2c07ca36ac77-console-config\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:50:18.209729 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:18.209555    2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2cd0e730-85b4-4317-936a-2c07ca36ac77-console-oauth-config\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:50:18.820126 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:18.820090    2559 generic.go:356] "Generic (PLEG): container finished" podID="2cd0e730-85b4-4317-936a-2c07ca36ac77" containerID="a742cbc73f62a3c7f6d7ade9180c4ec35122a35ef707a2b971e431d8f058cd77" exitCode=0
Sep 07 03:50:18.820517 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:18.820137    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dd7677cd4-phv45"
Sep 07 03:50:18.820517 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:18.820163    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dd7677cd4-phv45" event={"ID":"2cd0e730-85b4-4317-936a-2c07ca36ac77","Type":"ContainerDied","Data":"a742cbc73f62a3c7f6d7ade9180c4ec35122a35ef707a2b971e431d8f058cd77"}
Sep 07 03:50:18.820517 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:18.820204    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dd7677cd4-phv45" event={"ID":"2cd0e730-85b4-4317-936a-2c07ca36ac77","Type":"ContainerDied","Data":"45aaad70c91fe787d54042173c2199d5693caa25011736c7968a333aa3722aad"}
Sep 07 03:50:18.820517 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:18.820225    2559 scope.go:117] "RemoveContainer" containerID="a742cbc73f62a3c7f6d7ade9180c4ec35122a35ef707a2b971e431d8f058cd77"
Sep 07 03:50:18.828353 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:18.828332    2559 scope.go:117] "RemoveContainer" containerID="a742cbc73f62a3c7f6d7ade9180c4ec35122a35ef707a2b971e431d8f058cd77"
Sep 07 03:50:18.828615 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:50:18.828597    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a742cbc73f62a3c7f6d7ade9180c4ec35122a35ef707a2b971e431d8f058cd77\": container with ID starting with a742cbc73f62a3c7f6d7ade9180c4ec35122a35ef707a2b971e431d8f058cd77 not found: ID does not exist" containerID="a742cbc73f62a3c7f6d7ade9180c4ec35122a35ef707a2b971e431d8f058cd77"
Sep 07 03:50:18.828685 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:18.828643    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a742cbc73f62a3c7f6d7ade9180c4ec35122a35ef707a2b971e431d8f058cd77"} err="failed to get container status \"a742cbc73f62a3c7f6d7ade9180c4ec35122a35ef707a2b971e431d8f058cd77\": rpc error: code = NotFound desc = could not find container \"a742cbc73f62a3c7f6d7ade9180c4ec35122a35ef707a2b971e431d8f058cd77\": container with ID starting with a742cbc73f62a3c7f6d7ade9180c4ec35122a35ef707a2b971e431d8f058cd77 not found: ID does not exist"
Sep 07 03:50:18.839751 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:18.839728    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5dd7677cd4-phv45"]
Sep 07 03:50:18.841568 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:18.841543    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5dd7677cd4-phv45"]
Sep 07 03:50:19.181971 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:19.181936    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2cd0e730-85b4-4317-936a-2c07ca36ac77" path="/var/lib/kubelet/pods/2cd0e730-85b4-4317-936a-2c07ca36ac77/volumes"
Sep 07 03:50:48.002036 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:48.001882    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 07 03:50:48.002617 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:48.002281    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="27ced0c4-a27d-4c48-96e2-da962483e808" containerName="alertmanager" containerID="cri-o://c948b440e6bfc342d24f8b392f22da3492ba977a73c11d1ada5d572ed42e3f6a" gracePeriod=120
Sep 07 03:50:48.002617 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:48.002318    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="27ced0c4-a27d-4c48-96e2-da962483e808" containerName="kube-rbac-proxy-metric" containerID="cri-o://e9886a97fcf07831c2d064cd1fba51068fe387722205470a983bc5557f513a38" gracePeriod=120
Sep 07 03:50:48.002617 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:48.002355    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="27ced0c4-a27d-4c48-96e2-da962483e808" containerName="prom-label-proxy" containerID="cri-o://4edeb67a3445bb44f52e9355ba7d2fe855a050dd7c36d5f6072db2e42c5ec23c" gracePeriod=120
Sep 07 03:50:48.002617 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:48.002375    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="27ced0c4-a27d-4c48-96e2-da962483e808" containerName="kube-rbac-proxy-web" containerID="cri-o://74246e593123da33c1276754ae6a8d589d1f7864aa57a7117e55784121acb92a" gracePeriod=120
Sep 07 03:50:48.002617 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:48.002485    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="27ced0c4-a27d-4c48-96e2-da962483e808" containerName="kube-rbac-proxy" containerID="cri-o://d1e39266e262769ba49d6f04a061bc8e9fa06f872a9d201c19d8b293c2e9d999" gracePeriod=120
Sep 07 03:50:48.002617 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:48.002524    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="27ced0c4-a27d-4c48-96e2-da962483e808" containerName="config-reloader" containerID="cri-o://c1f8dfe1a37c7772cfaa9c476a267f9534e8085ffc349d7aea2e19ab25966226" gracePeriod=120
Sep 07 03:50:48.928036 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:48.928002    2559 generic.go:356] "Generic (PLEG): container finished" podID="27ced0c4-a27d-4c48-96e2-da962483e808" containerID="4edeb67a3445bb44f52e9355ba7d2fe855a050dd7c36d5f6072db2e42c5ec23c" exitCode=0
Sep 07 03:50:48.928036 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:48.928027    2559 generic.go:356] "Generic (PLEG): container finished" podID="27ced0c4-a27d-4c48-96e2-da962483e808" containerID="d1e39266e262769ba49d6f04a061bc8e9fa06f872a9d201c19d8b293c2e9d999" exitCode=0
Sep 07 03:50:48.928036 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:48.928035    2559 generic.go:356] "Generic (PLEG): container finished" podID="27ced0c4-a27d-4c48-96e2-da962483e808" containerID="c1f8dfe1a37c7772cfaa9c476a267f9534e8085ffc349d7aea2e19ab25966226" exitCode=0
Sep 07 03:50:48.928036 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:48.928042    2559 generic.go:356] "Generic (PLEG): container finished" podID="27ced0c4-a27d-4c48-96e2-da962483e808" containerID="c948b440e6bfc342d24f8b392f22da3492ba977a73c11d1ada5d572ed42e3f6a" exitCode=0
Sep 07 03:50:48.928293 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:48.928071    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"27ced0c4-a27d-4c48-96e2-da962483e808","Type":"ContainerDied","Data":"4edeb67a3445bb44f52e9355ba7d2fe855a050dd7c36d5f6072db2e42c5ec23c"}
Sep 07 03:50:48.928293 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:48.928132    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"27ced0c4-a27d-4c48-96e2-da962483e808","Type":"ContainerDied","Data":"d1e39266e262769ba49d6f04a061bc8e9fa06f872a9d201c19d8b293c2e9d999"}
Sep 07 03:50:48.928293 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:48.928158    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"27ced0c4-a27d-4c48-96e2-da962483e808","Type":"ContainerDied","Data":"c1f8dfe1a37c7772cfaa9c476a267f9534e8085ffc349d7aea2e19ab25966226"}
Sep 07 03:50:48.928293 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:48.928181    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"27ced0c4-a27d-4c48-96e2-da962483e808","Type":"ContainerDied","Data":"c948b440e6bfc342d24f8b392f22da3492ba977a73c11d1ada5d572ed42e3f6a"}
Sep 07 03:50:49.245155 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.245130    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:50:49.322756 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.322724    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/27ced0c4-a27d-4c48-96e2-da962483e808-secret-alertmanager-kube-rbac-proxy-web\") pod \"27ced0c4-a27d-4c48-96e2-da962483e808\" (UID: \"27ced0c4-a27d-4c48-96e2-da962483e808\") "
Sep 07 03:50:49.322910 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.322770    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/27ced0c4-a27d-4c48-96e2-da962483e808-secret-alertmanager-kube-rbac-proxy-metric\") pod \"27ced0c4-a27d-4c48-96e2-da962483e808\" (UID: \"27ced0c4-a27d-4c48-96e2-da962483e808\") "
Sep 07 03:50:49.322910 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.322799    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/27ced0c4-a27d-4c48-96e2-da962483e808-web-config\") pod \"27ced0c4-a27d-4c48-96e2-da962483e808\" (UID: \"27ced0c4-a27d-4c48-96e2-da962483e808\") "
Sep 07 03:50:49.323030 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.322926    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/27ced0c4-a27d-4c48-96e2-da962483e808-config-out\") pod \"27ced0c4-a27d-4c48-96e2-da962483e808\" (UID: \"27ced0c4-a27d-4c48-96e2-da962483e808\") "
Sep 07 03:50:49.323030 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.322987    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27ced0c4-a27d-4c48-96e2-da962483e808-metrics-client-ca\") pod \"27ced0c4-a27d-4c48-96e2-da962483e808\" (UID: \"27ced0c4-a27d-4c48-96e2-da962483e808\") "
Sep 07 03:50:49.323030 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.323015    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/27ced0c4-a27d-4c48-96e2-da962483e808-cluster-tls-config\") pod \"27ced0c4-a27d-4c48-96e2-da962483e808\" (UID: \"27ced0c4-a27d-4c48-96e2-da962483e808\") "
Sep 07 03:50:49.323175 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.323058    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27ced0c4-a27d-4c48-96e2-da962483e808-alertmanager-trusted-ca-bundle\") pod \"27ced0c4-a27d-4c48-96e2-da962483e808\" (UID: \"27ced0c4-a27d-4c48-96e2-da962483e808\") "
Sep 07 03:50:49.323175 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.323101    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/27ced0c4-a27d-4c48-96e2-da962483e808-secret-alertmanager-main-tls\") pod \"27ced0c4-a27d-4c48-96e2-da962483e808\" (UID: \"27ced0c4-a27d-4c48-96e2-da962483e808\") "
Sep 07 03:50:49.323175 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.323137    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9lrgs\" (UniqueName: \"kubernetes.io/projected/27ced0c4-a27d-4c48-96e2-da962483e808-kube-api-access-9lrgs\") pod \"27ced0c4-a27d-4c48-96e2-da962483e808\" (UID: \"27ced0c4-a27d-4c48-96e2-da962483e808\") "
Sep 07 03:50:49.323175 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.323168    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/27ced0c4-a27d-4c48-96e2-da962483e808-alertmanager-main-db\") pod \"27ced0c4-a27d-4c48-96e2-da962483e808\" (UID: \"27ced0c4-a27d-4c48-96e2-da962483e808\") "
Sep 07 03:50:49.323375 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.323219    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/27ced0c4-a27d-4c48-96e2-da962483e808-config-volume\") pod \"27ced0c4-a27d-4c48-96e2-da962483e808\" (UID: \"27ced0c4-a27d-4c48-96e2-da962483e808\") "
Sep 07 03:50:49.323375 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.323246    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/27ced0c4-a27d-4c48-96e2-da962483e808-tls-assets\") pod \"27ced0c4-a27d-4c48-96e2-da962483e808\" (UID: \"27ced0c4-a27d-4c48-96e2-da962483e808\") "
Sep 07 03:50:49.323375 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.323281    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/27ced0c4-a27d-4c48-96e2-da962483e808-secret-alertmanager-kube-rbac-proxy\") pod \"27ced0c4-a27d-4c48-96e2-da962483e808\" (UID: \"27ced0c4-a27d-4c48-96e2-da962483e808\") "
Sep 07 03:50:49.326690 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.325717    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27ced0c4-a27d-4c48-96e2-da962483e808-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "27ced0c4-a27d-4c48-96e2-da962483e808" (UID: "27ced0c4-a27d-4c48-96e2-da962483e808"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 03:50:49.326690 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.326109    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27ced0c4-a27d-4c48-96e2-da962483e808-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "27ced0c4-a27d-4c48-96e2-da962483e808" (UID: "27ced0c4-a27d-4c48-96e2-da962483e808"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 03:50:49.326690 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.326443    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27ced0c4-a27d-4c48-96e2-da962483e808-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "27ced0c4-a27d-4c48-96e2-da962483e808" (UID: "27ced0c4-a27d-4c48-96e2-da962483e808"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 03:50:49.328037 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.326736    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27ced0c4-a27d-4c48-96e2-da962483e808-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "27ced0c4-a27d-4c48-96e2-da962483e808" (UID: "27ced0c4-a27d-4c48-96e2-da962483e808"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 03:50:49.328037 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.327000    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27ced0c4-a27d-4c48-96e2-da962483e808-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "27ced0c4-a27d-4c48-96e2-da962483e808" (UID: "27ced0c4-a27d-4c48-96e2-da962483e808"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 03:50:49.328037 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.327316    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27ced0c4-a27d-4c48-96e2-da962483e808-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "27ced0c4-a27d-4c48-96e2-da962483e808" (UID: "27ced0c4-a27d-4c48-96e2-da962483e808"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 03:50:49.328037 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.327357    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27ced0c4-a27d-4c48-96e2-da962483e808-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "27ced0c4-a27d-4c48-96e2-da962483e808" (UID: "27ced0c4-a27d-4c48-96e2-da962483e808"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 03:50:49.328037 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.327566    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27ced0c4-a27d-4c48-96e2-da962483e808-config-out" (OuterVolumeSpecName: "config-out") pod "27ced0c4-a27d-4c48-96e2-da962483e808" (UID: "27ced0c4-a27d-4c48-96e2-da962483e808"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 03:50:49.329660 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.329610    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27ced0c4-a27d-4c48-96e2-da962483e808-kube-api-access-9lrgs" (OuterVolumeSpecName: "kube-api-access-9lrgs") pod "27ced0c4-a27d-4c48-96e2-da962483e808" (UID: "27ced0c4-a27d-4c48-96e2-da962483e808"). InnerVolumeSpecName "kube-api-access-9lrgs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 03:50:49.329838 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.329790    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27ced0c4-a27d-4c48-96e2-da962483e808-config-volume" (OuterVolumeSpecName: "config-volume") pod "27ced0c4-a27d-4c48-96e2-da962483e808" (UID: "27ced0c4-a27d-4c48-96e2-da962483e808"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 03:50:49.330067 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.330041    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27ced0c4-a27d-4c48-96e2-da962483e808-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "27ced0c4-a27d-4c48-96e2-da962483e808" (UID: "27ced0c4-a27d-4c48-96e2-da962483e808"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 03:50:49.330933 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.330835    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27ced0c4-a27d-4c48-96e2-da962483e808-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "27ced0c4-a27d-4c48-96e2-da962483e808" (UID: "27ced0c4-a27d-4c48-96e2-da962483e808"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 03:50:49.337141 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.337117    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27ced0c4-a27d-4c48-96e2-da962483e808-web-config" (OuterVolumeSpecName: "web-config") pod "27ced0c4-a27d-4c48-96e2-da962483e808" (UID: "27ced0c4-a27d-4c48-96e2-da962483e808"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 03:50:49.424636 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.424588    2559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/27ced0c4-a27d-4c48-96e2-da962483e808-alertmanager-main-db\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:50:49.424636 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.424614    2559 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/27ced0c4-a27d-4c48-96e2-da962483e808-config-volume\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:50:49.424636 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.424641    2559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/27ced0c4-a27d-4c48-96e2-da962483e808-tls-assets\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:50:49.424822 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.424652    2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/27ced0c4-a27d-4c48-96e2-da962483e808-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:50:49.424822 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.424662    2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/27ced0c4-a27d-4c48-96e2-da962483e808-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:50:49.424822 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.424670    2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/27ced0c4-a27d-4c48-96e2-da962483e808-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:50:49.424822 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.424680    2559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/27ced0c4-a27d-4c48-96e2-da962483e808-web-config\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:50:49.424822 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.424687    2559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/27ced0c4-a27d-4c48-96e2-da962483e808-config-out\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:50:49.424822 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.424694    2559 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27ced0c4-a27d-4c48-96e2-da962483e808-metrics-client-ca\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:50:49.424822 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.424702    2559 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/27ced0c4-a27d-4c48-96e2-da962483e808-cluster-tls-config\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:50:49.424822 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.424710    2559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/27ced0c4-a27d-4c48-96e2-da962483e808-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:50:49.424822 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.424718    2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/27ced0c4-a27d-4c48-96e2-da962483e808-secret-alertmanager-main-tls\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:50:49.424822 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.424728    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lrgs\" (UniqueName: \"kubernetes.io/projected/27ced0c4-a27d-4c48-96e2-da962483e808-kube-api-access-9lrgs\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:50:49.935096 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.935059    2559 generic.go:356] "Generic (PLEG): container finished" podID="27ced0c4-a27d-4c48-96e2-da962483e808" containerID="e9886a97fcf07831c2d064cd1fba51068fe387722205470a983bc5557f513a38" exitCode=0
Sep 07 03:50:49.935096 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.935089    2559 generic.go:356] "Generic (PLEG): container finished" podID="27ced0c4-a27d-4c48-96e2-da962483e808" containerID="74246e593123da33c1276754ae6a8d589d1f7864aa57a7117e55784121acb92a" exitCode=0
Sep 07 03:50:49.935302 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.935138    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"27ced0c4-a27d-4c48-96e2-da962483e808","Type":"ContainerDied","Data":"e9886a97fcf07831c2d064cd1fba51068fe387722205470a983bc5557f513a38"}
Sep 07 03:50:49.935302 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.935153    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:50:49.935302 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.935234    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"27ced0c4-a27d-4c48-96e2-da962483e808","Type":"ContainerDied","Data":"74246e593123da33c1276754ae6a8d589d1f7864aa57a7117e55784121acb92a"}
Sep 07 03:50:49.935302 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.935261    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"27ced0c4-a27d-4c48-96e2-da962483e808","Type":"ContainerDied","Data":"5d527d7698d31624dac532dda57d0d2913f1bb3b46b6a99172526efd11078087"}
Sep 07 03:50:49.935302 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.935291    2559 scope.go:117] "RemoveContainer" containerID="4edeb67a3445bb44f52e9355ba7d2fe855a050dd7c36d5f6072db2e42c5ec23c"
Sep 07 03:50:49.947755 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.947736    2559 scope.go:117] "RemoveContainer" containerID="e9886a97fcf07831c2d064cd1fba51068fe387722205470a983bc5557f513a38"
Sep 07 03:50:49.955226 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.955202    2559 scope.go:117] "RemoveContainer" containerID="d1e39266e262769ba49d6f04a061bc8e9fa06f872a9d201c19d8b293c2e9d999"
Sep 07 03:50:49.960269 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.960244    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 07 03:50:49.962247 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.962227    2559 scope.go:117] "RemoveContainer" containerID="74246e593123da33c1276754ae6a8d589d1f7864aa57a7117e55784121acb92a"
Sep 07 03:50:49.963727 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.963705    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 07 03:50:49.968793 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.968778    2559 scope.go:117] "RemoveContainer" containerID="c1f8dfe1a37c7772cfaa9c476a267f9534e8085ffc349d7aea2e19ab25966226"
Sep 07 03:50:49.975438 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.975422    2559 scope.go:117] "RemoveContainer" containerID="c948b440e6bfc342d24f8b392f22da3492ba977a73c11d1ada5d572ed42e3f6a"
Sep 07 03:50:49.982205 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.982153    2559 scope.go:117] "RemoveContainer" containerID="0ec5c435635608b832f2402c0a2ad59eab38cac40a0dc0cf7f115fbd580411ed"
Sep 07 03:50:49.989733 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.989237    2559 scope.go:117] "RemoveContainer" containerID="4edeb67a3445bb44f52e9355ba7d2fe855a050dd7c36d5f6072db2e42c5ec23c"
Sep 07 03:50:49.989733 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:50:49.989555    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4edeb67a3445bb44f52e9355ba7d2fe855a050dd7c36d5f6072db2e42c5ec23c\": container with ID starting with 4edeb67a3445bb44f52e9355ba7d2fe855a050dd7c36d5f6072db2e42c5ec23c not found: ID does not exist" containerID="4edeb67a3445bb44f52e9355ba7d2fe855a050dd7c36d5f6072db2e42c5ec23c"
Sep 07 03:50:49.989733 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.989585    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4edeb67a3445bb44f52e9355ba7d2fe855a050dd7c36d5f6072db2e42c5ec23c"} err="failed to get container status \"4edeb67a3445bb44f52e9355ba7d2fe855a050dd7c36d5f6072db2e42c5ec23c\": rpc error: code = NotFound desc = could not find container \"4edeb67a3445bb44f52e9355ba7d2fe855a050dd7c36d5f6072db2e42c5ec23c\": container with ID starting with 4edeb67a3445bb44f52e9355ba7d2fe855a050dd7c36d5f6072db2e42c5ec23c not found: ID does not exist"
Sep 07 03:50:49.989733 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.989609    2559 scope.go:117] "RemoveContainer" containerID="e9886a97fcf07831c2d064cd1fba51068fe387722205470a983bc5557f513a38"
Sep 07 03:50:49.990196 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:50:49.990173    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9886a97fcf07831c2d064cd1fba51068fe387722205470a983bc5557f513a38\": container with ID starting with e9886a97fcf07831c2d064cd1fba51068fe387722205470a983bc5557f513a38 not found: ID does not exist" containerID="e9886a97fcf07831c2d064cd1fba51068fe387722205470a983bc5557f513a38"
Sep 07 03:50:49.990340 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.990306    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9886a97fcf07831c2d064cd1fba51068fe387722205470a983bc5557f513a38"} err="failed to get container status \"e9886a97fcf07831c2d064cd1fba51068fe387722205470a983bc5557f513a38\": rpc error: code = NotFound desc = could not find container \"e9886a97fcf07831c2d064cd1fba51068fe387722205470a983bc5557f513a38\": container with ID starting with e9886a97fcf07831c2d064cd1fba51068fe387722205470a983bc5557f513a38 not found: ID does not exist"
Sep 07 03:50:49.990340 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.990339    2559 scope.go:117] "RemoveContainer" containerID="d1e39266e262769ba49d6f04a061bc8e9fa06f872a9d201c19d8b293c2e9d999"
Sep 07 03:50:49.990941 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:50:49.990910    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1e39266e262769ba49d6f04a061bc8e9fa06f872a9d201c19d8b293c2e9d999\": container with ID starting with d1e39266e262769ba49d6f04a061bc8e9fa06f872a9d201c19d8b293c2e9d999 not found: ID does not exist" containerID="d1e39266e262769ba49d6f04a061bc8e9fa06f872a9d201c19d8b293c2e9d999"
Sep 07 03:50:49.991035 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.990948    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1e39266e262769ba49d6f04a061bc8e9fa06f872a9d201c19d8b293c2e9d999"} err="failed to get container status \"d1e39266e262769ba49d6f04a061bc8e9fa06f872a9d201c19d8b293c2e9d999\": rpc error: code = NotFound desc = could not find container \"d1e39266e262769ba49d6f04a061bc8e9fa06f872a9d201c19d8b293c2e9d999\": container with ID starting with d1e39266e262769ba49d6f04a061bc8e9fa06f872a9d201c19d8b293c2e9d999 not found: ID does not exist"
Sep 07 03:50:49.991035 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.990968    2559 scope.go:117] "RemoveContainer" containerID="74246e593123da33c1276754ae6a8d589d1f7864aa57a7117e55784121acb92a"
Sep 07 03:50:49.991281 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:50:49.991251    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74246e593123da33c1276754ae6a8d589d1f7864aa57a7117e55784121acb92a\": container with ID starting with 74246e593123da33c1276754ae6a8d589d1f7864aa57a7117e55784121acb92a not found: ID does not exist" containerID="74246e593123da33c1276754ae6a8d589d1f7864aa57a7117e55784121acb92a"
Sep 07 03:50:49.991345 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.991277    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74246e593123da33c1276754ae6a8d589d1f7864aa57a7117e55784121acb92a"} err="failed to get container status \"74246e593123da33c1276754ae6a8d589d1f7864aa57a7117e55784121acb92a\": rpc error: code = NotFound desc = could not find container \"74246e593123da33c1276754ae6a8d589d1f7864aa57a7117e55784121acb92a\": container with ID starting with 74246e593123da33c1276754ae6a8d589d1f7864aa57a7117e55784121acb92a not found: ID does not exist"
Sep 07 03:50:49.991345 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.991291    2559 scope.go:117] "RemoveContainer" containerID="c1f8dfe1a37c7772cfaa9c476a267f9534e8085ffc349d7aea2e19ab25966226"
Sep 07 03:50:49.991590 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:50:49.991571    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1f8dfe1a37c7772cfaa9c476a267f9534e8085ffc349d7aea2e19ab25966226\": container with ID starting with c1f8dfe1a37c7772cfaa9c476a267f9534e8085ffc349d7aea2e19ab25966226 not found: ID does not exist" containerID="c1f8dfe1a37c7772cfaa9c476a267f9534e8085ffc349d7aea2e19ab25966226"
Sep 07 03:50:49.991651 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.991596    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1f8dfe1a37c7772cfaa9c476a267f9534e8085ffc349d7aea2e19ab25966226"} err="failed to get container status \"c1f8dfe1a37c7772cfaa9c476a267f9534e8085ffc349d7aea2e19ab25966226\": rpc error: code = NotFound desc = could not find container \"c1f8dfe1a37c7772cfaa9c476a267f9534e8085ffc349d7aea2e19ab25966226\": container with ID starting with c1f8dfe1a37c7772cfaa9c476a267f9534e8085ffc349d7aea2e19ab25966226 not found: ID does not exist"
Sep 07 03:50:49.991651 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.991610    2559 scope.go:117] "RemoveContainer" containerID="c948b440e6bfc342d24f8b392f22da3492ba977a73c11d1ada5d572ed42e3f6a"
Sep 07 03:50:49.991764 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.991653    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 07 03:50:49.991854 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:50:49.991837    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c948b440e6bfc342d24f8b392f22da3492ba977a73c11d1ada5d572ed42e3f6a\": container with ID starting with c948b440e6bfc342d24f8b392f22da3492ba977a73c11d1ada5d572ed42e3f6a not found: ID does not exist" containerID="c948b440e6bfc342d24f8b392f22da3492ba977a73c11d1ada5d572ed42e3f6a"
Sep 07 03:50:49.991898 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.991857    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c948b440e6bfc342d24f8b392f22da3492ba977a73c11d1ada5d572ed42e3f6a"} err="failed to get container status \"c948b440e6bfc342d24f8b392f22da3492ba977a73c11d1ada5d572ed42e3f6a\": rpc error: code = NotFound desc = could not find container \"c948b440e6bfc342d24f8b392f22da3492ba977a73c11d1ada5d572ed42e3f6a\": container with ID starting with c948b440e6bfc342d24f8b392f22da3492ba977a73c11d1ada5d572ed42e3f6a not found: ID does not exist"
Sep 07 03:50:49.991898 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.991869    2559 scope.go:117] "RemoveContainer" containerID="0ec5c435635608b832f2402c0a2ad59eab38cac40a0dc0cf7f115fbd580411ed"
Sep 07 03:50:49.991973 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.991929    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cd0e730-85b4-4317-936a-2c07ca36ac77" containerName="console"
Sep 07 03:50:49.991973 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.991940    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cd0e730-85b4-4317-936a-2c07ca36ac77" containerName="console"
Sep 07 03:50:49.991973 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.991947    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27ced0c4-a27d-4c48-96e2-da962483e808" containerName="config-reloader"
Sep 07 03:50:49.991973 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.991954    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="27ced0c4-a27d-4c48-96e2-da962483e808" containerName="config-reloader"
Sep 07 03:50:49.991973 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.991964    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27ced0c4-a27d-4c48-96e2-da962483e808" containerName="prom-label-proxy"
Sep 07 03:50:49.992140 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.991974    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="27ced0c4-a27d-4c48-96e2-da962483e808" containerName="prom-label-proxy"
Sep 07 03:50:49.992140 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.991989    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27ced0c4-a27d-4c48-96e2-da962483e808" containerName="init-config-reloader"
Sep 07 03:50:49.992140 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.991994    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="27ced0c4-a27d-4c48-96e2-da962483e808" containerName="init-config-reloader"
Sep 07 03:50:49.992140 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.992000    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27ced0c4-a27d-4c48-96e2-da962483e808" containerName="alertmanager"
Sep 07 03:50:49.992140 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.992006    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="27ced0c4-a27d-4c48-96e2-da962483e808" containerName="alertmanager"
Sep 07 03:50:49.992140 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.992016    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27ced0c4-a27d-4c48-96e2-da962483e808" containerName="kube-rbac-proxy-web"
Sep 07 03:50:49.992140 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.992025    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="27ced0c4-a27d-4c48-96e2-da962483e808" containerName="kube-rbac-proxy-web"
Sep 07 03:50:49.992140 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.992034    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27ced0c4-a27d-4c48-96e2-da962483e808" containerName="kube-rbac-proxy"
Sep 07 03:50:49.992140 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.992040    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="27ced0c4-a27d-4c48-96e2-da962483e808" containerName="kube-rbac-proxy"
Sep 07 03:50:49.992140 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.992053    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a9263c2-a5c6-49db-8c08-c47a7b1846b6" containerName="console"
Sep 07 03:50:49.992140 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.992059    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a9263c2-a5c6-49db-8c08-c47a7b1846b6" containerName="console"
Sep 07 03:50:49.992140 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.992066    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27ced0c4-a27d-4c48-96e2-da962483e808" containerName="kube-rbac-proxy-metric"
Sep 07 03:50:49.992140 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.992071    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="27ced0c4-a27d-4c48-96e2-da962483e808" containerName="kube-rbac-proxy-metric"
Sep 07 03:50:49.992140 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:50:49.992081    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ec5c435635608b832f2402c0a2ad59eab38cac40a0dc0cf7f115fbd580411ed\": container with ID starting with 0ec5c435635608b832f2402c0a2ad59eab38cac40a0dc0cf7f115fbd580411ed not found: ID does not exist" containerID="0ec5c435635608b832f2402c0a2ad59eab38cac40a0dc0cf7f115fbd580411ed"
Sep 07 03:50:49.992140 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.992095    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ec5c435635608b832f2402c0a2ad59eab38cac40a0dc0cf7f115fbd580411ed"} err="failed to get container status \"0ec5c435635608b832f2402c0a2ad59eab38cac40a0dc0cf7f115fbd580411ed\": rpc error: code = NotFound desc = could not find container \"0ec5c435635608b832f2402c0a2ad59eab38cac40a0dc0cf7f115fbd580411ed\": container with ID starting with 0ec5c435635608b832f2402c0a2ad59eab38cac40a0dc0cf7f115fbd580411ed not found: ID does not exist"
Sep 07 03:50:49.992140 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.992106    2559 scope.go:117] "RemoveContainer" containerID="4edeb67a3445bb44f52e9355ba7d2fe855a050dd7c36d5f6072db2e42c5ec23c"
Sep 07 03:50:49.992140 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.992113    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="27ced0c4-a27d-4c48-96e2-da962483e808" containerName="config-reloader"
Sep 07 03:50:49.992140 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.992121    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="27ced0c4-a27d-4c48-96e2-da962483e808" containerName="prom-label-proxy"
Sep 07 03:50:49.992140 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.992127    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="27ced0c4-a27d-4c48-96e2-da962483e808" containerName="kube-rbac-proxy-web"
Sep 07 03:50:49.992140 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.992131    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="27ced0c4-a27d-4c48-96e2-da962483e808" containerName="kube-rbac-proxy-metric"
Sep 07 03:50:49.992140 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.992137    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="27ced0c4-a27d-4c48-96e2-da962483e808" containerName="alertmanager"
Sep 07 03:50:49.992140 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.992144    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a9263c2-a5c6-49db-8c08-c47a7b1846b6" containerName="console"
Sep 07 03:50:49.992944 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.992152    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2cd0e730-85b4-4317-936a-2c07ca36ac77" containerName="console"
Sep 07 03:50:49.992944 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.992160    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="27ced0c4-a27d-4c48-96e2-da962483e808" containerName="kube-rbac-proxy"
Sep 07 03:50:49.992944 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.992321    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4edeb67a3445bb44f52e9355ba7d2fe855a050dd7c36d5f6072db2e42c5ec23c"} err="failed to get container status \"4edeb67a3445bb44f52e9355ba7d2fe855a050dd7c36d5f6072db2e42c5ec23c\": rpc error: code = NotFound desc = could not find container \"4edeb67a3445bb44f52e9355ba7d2fe855a050dd7c36d5f6072db2e42c5ec23c\": container with ID starting with 4edeb67a3445bb44f52e9355ba7d2fe855a050dd7c36d5f6072db2e42c5ec23c not found: ID does not exist"
Sep 07 03:50:49.992944 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.992333    2559 scope.go:117] "RemoveContainer" containerID="e9886a97fcf07831c2d064cd1fba51068fe387722205470a983bc5557f513a38"
Sep 07 03:50:49.992944 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.992502    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9886a97fcf07831c2d064cd1fba51068fe387722205470a983bc5557f513a38"} err="failed to get container status \"e9886a97fcf07831c2d064cd1fba51068fe387722205470a983bc5557f513a38\": rpc error: code = NotFound desc = could not find container \"e9886a97fcf07831c2d064cd1fba51068fe387722205470a983bc5557f513a38\": container with ID starting with e9886a97fcf07831c2d064cd1fba51068fe387722205470a983bc5557f513a38 not found: ID does not exist"
Sep 07 03:50:49.992944 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.992517    2559 scope.go:117] "RemoveContainer" containerID="d1e39266e262769ba49d6f04a061bc8e9fa06f872a9d201c19d8b293c2e9d999"
Sep 07 03:50:49.992944 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.992698    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1e39266e262769ba49d6f04a061bc8e9fa06f872a9d201c19d8b293c2e9d999"} err="failed to get container status \"d1e39266e262769ba49d6f04a061bc8e9fa06f872a9d201c19d8b293c2e9d999\": rpc error: code = NotFound desc = could not find container \"d1e39266e262769ba49d6f04a061bc8e9fa06f872a9d201c19d8b293c2e9d999\": container with ID starting with d1e39266e262769ba49d6f04a061bc8e9fa06f872a9d201c19d8b293c2e9d999 not found: ID does not exist"
Sep 07 03:50:49.992944 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.992710    2559 scope.go:117] "RemoveContainer" containerID="74246e593123da33c1276754ae6a8d589d1f7864aa57a7117e55784121acb92a"
Sep 07 03:50:49.992944 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.992920    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74246e593123da33c1276754ae6a8d589d1f7864aa57a7117e55784121acb92a"} err="failed to get container status \"74246e593123da33c1276754ae6a8d589d1f7864aa57a7117e55784121acb92a\": rpc error: code = NotFound desc = could not find container \"74246e593123da33c1276754ae6a8d589d1f7864aa57a7117e55784121acb92a\": container with ID starting with 74246e593123da33c1276754ae6a8d589d1f7864aa57a7117e55784121acb92a not found: ID does not exist"
Sep 07 03:50:49.992944 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.992946    2559 scope.go:117] "RemoveContainer" containerID="c1f8dfe1a37c7772cfaa9c476a267f9534e8085ffc349d7aea2e19ab25966226"
Sep 07 03:50:49.993352 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.993192    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1f8dfe1a37c7772cfaa9c476a267f9534e8085ffc349d7aea2e19ab25966226"} err="failed to get container status \"c1f8dfe1a37c7772cfaa9c476a267f9534e8085ffc349d7aea2e19ab25966226\": rpc error: code = NotFound desc = could not find container \"c1f8dfe1a37c7772cfaa9c476a267f9534e8085ffc349d7aea2e19ab25966226\": container with ID starting with c1f8dfe1a37c7772cfaa9c476a267f9534e8085ffc349d7aea2e19ab25966226 not found: ID does not exist"
Sep 07 03:50:49.993352 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.993208    2559 scope.go:117] "RemoveContainer" containerID="c948b440e6bfc342d24f8b392f22da3492ba977a73c11d1ada5d572ed42e3f6a"
Sep 07 03:50:49.993446 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.993377    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c948b440e6bfc342d24f8b392f22da3492ba977a73c11d1ada5d572ed42e3f6a"} err="failed to get container status \"c948b440e6bfc342d24f8b392f22da3492ba977a73c11d1ada5d572ed42e3f6a\": rpc error: code = NotFound desc = could not find container \"c948b440e6bfc342d24f8b392f22da3492ba977a73c11d1ada5d572ed42e3f6a\": container with ID starting with c948b440e6bfc342d24f8b392f22da3492ba977a73c11d1ada5d572ed42e3f6a not found: ID does not exist"
Sep 07 03:50:49.993446 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.993399    2559 scope.go:117] "RemoveContainer" containerID="0ec5c435635608b832f2402c0a2ad59eab38cac40a0dc0cf7f115fbd580411ed"
Sep 07 03:50:49.993606 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.993587    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ec5c435635608b832f2402c0a2ad59eab38cac40a0dc0cf7f115fbd580411ed"} err="failed to get container status \"0ec5c435635608b832f2402c0a2ad59eab38cac40a0dc0cf7f115fbd580411ed\": rpc error: code = NotFound desc = could not find container \"0ec5c435635608b832f2402c0a2ad59eab38cac40a0dc0cf7f115fbd580411ed\": container with ID starting with 0ec5c435635608b832f2402c0a2ad59eab38cac40a0dc0cf7f115fbd580411ed not found: ID does not exist"
Sep 07 03:50:49.996947 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.996932    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:50:49.998949 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.998926    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-dgdgq\""
Sep 07 03:50:49.999099 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.999081    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 07 03:50:49.999240 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.999218    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 07 03:50:49.999348 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.999257    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 07 03:50:49.999348 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.999277    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 07 03:50:49.999348 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.999280    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 07 03:50:49.999348 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.999328    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 07 03:50:49.999660 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.999356    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 07 03:50:49.999660 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:49.999605    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 07 03:50:50.004316 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:50.004297    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 07 03:50:50.011675 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:50.011651    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 07 03:50:50.028951 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:50.028912    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5e5065fb-a246-46ec-ad61-d998576a2e8f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5e5065fb-a246-46ec-ad61-d998576a2e8f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:50:50.028951 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:50.028954    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5e5065fb-a246-46ec-ad61-d998576a2e8f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5e5065fb-a246-46ec-ad61-d998576a2e8f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:50:50.029144 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:50.029021    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5e5065fb-a246-46ec-ad61-d998576a2e8f-config-out\") pod \"alertmanager-main-0\" (UID: \"5e5065fb-a246-46ec-ad61-d998576a2e8f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:50:50.029144 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:50.029060    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e5065fb-a246-46ec-ad61-d998576a2e8f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5e5065fb-a246-46ec-ad61-d998576a2e8f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:50:50.029144 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:50.029098    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5e5065fb-a246-46ec-ad61-d998576a2e8f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5e5065fb-a246-46ec-ad61-d998576a2e8f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:50:50.029240 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:50.029166    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e5065fb-a246-46ec-ad61-d998576a2e8f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5e5065fb-a246-46ec-ad61-d998576a2e8f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:50:50.029240 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:50.029194    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhgfn\" (UniqueName: \"kubernetes.io/projected/5e5065fb-a246-46ec-ad61-d998576a2e8f-kube-api-access-lhgfn\") pod \"alertmanager-main-0\" (UID: \"5e5065fb-a246-46ec-ad61-d998576a2e8f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:50:50.029240 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:50.029227    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5e5065fb-a246-46ec-ad61-d998576a2e8f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5e5065fb-a246-46ec-ad61-d998576a2e8f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:50:50.029370 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:50.029248    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5e5065fb-a246-46ec-ad61-d998576a2e8f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5e5065fb-a246-46ec-ad61-d998576a2e8f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:50:50.029370 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:50.029282    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5e5065fb-a246-46ec-ad61-d998576a2e8f-web-config\") pod \"alertmanager-main-0\" (UID: \"5e5065fb-a246-46ec-ad61-d998576a2e8f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:50:50.029370 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:50.029312    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5e5065fb-a246-46ec-ad61-d998576a2e8f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5e5065fb-a246-46ec-ad61-d998576a2e8f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:50:50.029370 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:50.029347    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5e5065fb-a246-46ec-ad61-d998576a2e8f-config-volume\") pod \"alertmanager-main-0\" (UID: \"5e5065fb-a246-46ec-ad61-d998576a2e8f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:50:50.029491 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:50.029381    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5e5065fb-a246-46ec-ad61-d998576a2e8f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5e5065fb-a246-46ec-ad61-d998576a2e8f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:50:50.130639 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:50.130573    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e5065fb-a246-46ec-ad61-d998576a2e8f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5e5065fb-a246-46ec-ad61-d998576a2e8f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:50:50.130774 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:50.130654    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhgfn\" (UniqueName: \"kubernetes.io/projected/5e5065fb-a246-46ec-ad61-d998576a2e8f-kube-api-access-lhgfn\") pod \"alertmanager-main-0\" (UID: \"5e5065fb-a246-46ec-ad61-d998576a2e8f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:50:50.130774 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:50.130699    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5e5065fb-a246-46ec-ad61-d998576a2e8f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5e5065fb-a246-46ec-ad61-d998576a2e8f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:50:50.130774 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:50.130727    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5e5065fb-a246-46ec-ad61-d998576a2e8f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5e5065fb-a246-46ec-ad61-d998576a2e8f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:50:50.130774 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:50.130762    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5e5065fb-a246-46ec-ad61-d998576a2e8f-web-config\") pod \"alertmanager-main-0\" (UID: \"5e5065fb-a246-46ec-ad61-d998576a2e8f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:50:50.130951 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:50.130792    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5e5065fb-a246-46ec-ad61-d998576a2e8f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5e5065fb-a246-46ec-ad61-d998576a2e8f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:50:50.130951 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:50.130865    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5e5065fb-a246-46ec-ad61-d998576a2e8f-config-volume\") pod \"alertmanager-main-0\" (UID: \"5e5065fb-a246-46ec-ad61-d998576a2e8f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:50:50.130951 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:50.130903    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5e5065fb-a246-46ec-ad61-d998576a2e8f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5e5065fb-a246-46ec-ad61-d998576a2e8f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:50:50.130951 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:50.130943    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5e5065fb-a246-46ec-ad61-d998576a2e8f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5e5065fb-a246-46ec-ad61-d998576a2e8f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:50:50.131137 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:50.130974    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5e5065fb-a246-46ec-ad61-d998576a2e8f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5e5065fb-a246-46ec-ad61-d998576a2e8f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:50:50.131137 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:50.131000    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5e5065fb-a246-46ec-ad61-d998576a2e8f-config-out\") pod \"alertmanager-main-0\" (UID: \"5e5065fb-a246-46ec-ad61-d998576a2e8f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:50:50.131137 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:50.131031    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e5065fb-a246-46ec-ad61-d998576a2e8f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5e5065fb-a246-46ec-ad61-d998576a2e8f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:50:50.131137 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:50.131068    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5e5065fb-a246-46ec-ad61-d998576a2e8f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5e5065fb-a246-46ec-ad61-d998576a2e8f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:50:50.131137 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:50.131113    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5e5065fb-a246-46ec-ad61-d998576a2e8f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5e5065fb-a246-46ec-ad61-d998576a2e8f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:50:50.131678 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:50.131651    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e5065fb-a246-46ec-ad61-d998576a2e8f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5e5065fb-a246-46ec-ad61-d998576a2e8f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:50:50.133996 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:50.133883    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5e5065fb-a246-46ec-ad61-d998576a2e8f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5e5065fb-a246-46ec-ad61-d998576a2e8f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:50:50.133996 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:50.133898    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5e5065fb-a246-46ec-ad61-d998576a2e8f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5e5065fb-a246-46ec-ad61-d998576a2e8f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:50:50.133996 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:50.133942    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5e5065fb-a246-46ec-ad61-d998576a2e8f-web-config\") pod \"alertmanager-main-0\" (UID: \"5e5065fb-a246-46ec-ad61-d998576a2e8f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:50:50.134203 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:50.134107    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5e5065fb-a246-46ec-ad61-d998576a2e8f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5e5065fb-a246-46ec-ad61-d998576a2e8f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:50:50.134203 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:50.134107    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5e5065fb-a246-46ec-ad61-d998576a2e8f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5e5065fb-a246-46ec-ad61-d998576a2e8f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:50:50.134203 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:50.134186    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5e5065fb-a246-46ec-ad61-d998576a2e8f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5e5065fb-a246-46ec-ad61-d998576a2e8f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:50:50.134416 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:50.134391    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5e5065fb-a246-46ec-ad61-d998576a2e8f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5e5065fb-a246-46ec-ad61-d998576a2e8f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:50:50.134520 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:50.134503    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e5065fb-a246-46ec-ad61-d998576a2e8f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5e5065fb-a246-46ec-ad61-d998576a2e8f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:50:50.134719 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:50.134701    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5e5065fb-a246-46ec-ad61-d998576a2e8f-config-volume\") pod \"alertmanager-main-0\" (UID: \"5e5065fb-a246-46ec-ad61-d998576a2e8f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:50:50.135558 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:50.135542    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5e5065fb-a246-46ec-ad61-d998576a2e8f-config-out\") pod \"alertmanager-main-0\" (UID: \"5e5065fb-a246-46ec-ad61-d998576a2e8f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:50:50.138512 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:50.138493    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhgfn\" (UniqueName: \"kubernetes.io/projected/5e5065fb-a246-46ec-ad61-d998576a2e8f-kube-api-access-lhgfn\") pod \"alertmanager-main-0\" (UID: \"5e5065fb-a246-46ec-ad61-d998576a2e8f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:50:50.306149 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:50.306044    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 07 03:50:50.584658 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:50.584633    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 07 03:50:50.587168 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:50:50.587138    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e5065fb_a246_46ec_ad61_d998576a2e8f.slice/crio-5952aece9d3abd2674eef2226c09544813f9b8e17cb921fe099f0c52183cb356 WatchSource:0}: Error finding container 5952aece9d3abd2674eef2226c09544813f9b8e17cb921fe099f0c52183cb356: Status 404 returned error can't find the container with id 5952aece9d3abd2674eef2226c09544813f9b8e17cb921fe099f0c52183cb356
Sep 07 03:50:50.940934 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:50.940901    2559 generic.go:356] "Generic (PLEG): container finished" podID="5e5065fb-a246-46ec-ad61-d998576a2e8f" containerID="08ff3be15e8227318d8985d3d47003136543b472dd4fddcc7b8a92101f05ef50" exitCode=0
Sep 07 03:50:50.941089 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:50.940987    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5e5065fb-a246-46ec-ad61-d998576a2e8f","Type":"ContainerDied","Data":"08ff3be15e8227318d8985d3d47003136543b472dd4fddcc7b8a92101f05ef50"}
Sep 07 03:50:50.941089 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:50.941063    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5e5065fb-a246-46ec-ad61-d998576a2e8f","Type":"ContainerStarted","Data":"5952aece9d3abd2674eef2226c09544813f9b8e17cb921fe099f0c52183cb356"}
Sep 07 03:50:51.178697 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:51.178668    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27ced0c4-a27d-4c48-96e2-da962483e808" path="/var/lib/kubelet/pods/27ced0c4-a27d-4c48-96e2-da962483e808/volumes"
Sep 07 03:50:51.950142 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:51.950070    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5e5065fb-a246-46ec-ad61-d998576a2e8f","Type":"ContainerStarted","Data":"1f0036ef71e4366c46368c4369ccd41dc6f71b3f267c22fc0baef29da72d842c"}
Sep 07 03:50:51.950501 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:51.950192    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5e5065fb-a246-46ec-ad61-d998576a2e8f","Type":"ContainerStarted","Data":"f70a5a10f6f7ab023e8cbf59c802179b98b14c9c55b482f80fc0d699866774b9"}
Sep 07 03:50:51.950501 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:51.950233    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5e5065fb-a246-46ec-ad61-d998576a2e8f","Type":"ContainerStarted","Data":"721a422921819d7a16c0787e9e7215f3c278878d67248fcded61758129fcc09a"}
Sep 07 03:50:51.950501 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:51.950268    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5e5065fb-a246-46ec-ad61-d998576a2e8f","Type":"ContainerStarted","Data":"f03134a625def6893243f82cc4cedae1e7d4858f53afa34c27d81b6c49a976ef"}
Sep 07 03:50:51.950501 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:51.950304    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5e5065fb-a246-46ec-ad61-d998576a2e8f","Type":"ContainerStarted","Data":"64faa0998f6ee4b8cce992686a92cc8c8450cbe15637a0b69e67ad96f4d9c087"}
Sep 07 03:50:51.950501 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:51.950348    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5e5065fb-a246-46ec-ad61-d998576a2e8f","Type":"ContainerStarted","Data":"90a249d164bb6753c12c2b752ef0ff88904e1013609cc3f242c06a89d03b2f0f"}
Sep 07 03:50:51.979511 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:50:51.979456    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.95839525 podStartE2EDuration="2.97943736s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.04211ms" isStatefulPod=false podCreationTimestamp="2026-09-07 03:50:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:50:51.977119525 +0000 UTC m=+155.289595426" watchObservedRunningTime="2026-09-07 03:50:51.97943736 +0000 UTC m=+155.291913261"
Sep 07 03:51:09.992889 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:09.992815    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-74c646f97-x6nss"]
Sep 07 03:51:09.995785 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:09.995768    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74c646f97-x6nss"
Sep 07 03:51:10.007538 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:10.007512    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74c646f97-x6nss"]
Sep 07 03:51:10.074890 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:10.074858    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc2m7\" (UniqueName: \"kubernetes.io/projected/d3ab2bd5-8000-4878-8977-59a8c0e4d985-kube-api-access-fc2m7\") pod \"console-74c646f97-x6nss\" (UID: \"d3ab2bd5-8000-4878-8977-59a8c0e4d985\") " pod="openshift-console/console-74c646f97-x6nss"
Sep 07 03:51:10.075037 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:10.074909    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3ab2bd5-8000-4878-8977-59a8c0e4d985-console-serving-cert\") pod \"console-74c646f97-x6nss\" (UID: \"d3ab2bd5-8000-4878-8977-59a8c0e4d985\") " pod="openshift-console/console-74c646f97-x6nss"
Sep 07 03:51:10.075037 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:10.074965    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3ab2bd5-8000-4878-8977-59a8c0e4d985-service-ca\") pod \"console-74c646f97-x6nss\" (UID: \"d3ab2bd5-8000-4878-8977-59a8c0e4d985\") " pod="openshift-console/console-74c646f97-x6nss"
Sep 07 03:51:10.075037 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:10.074997    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3ab2bd5-8000-4878-8977-59a8c0e4d985-trusted-ca-bundle\") pod \"console-74c646f97-x6nss\" (UID: \"d3ab2bd5-8000-4878-8977-59a8c0e4d985\") " pod="openshift-console/console-74c646f97-x6nss"
Sep 07 03:51:10.075037 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:10.075022    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3ab2bd5-8000-4878-8977-59a8c0e4d985-console-config\") pod \"console-74c646f97-x6nss\" (UID: \"d3ab2bd5-8000-4878-8977-59a8c0e4d985\") " pod="openshift-console/console-74c646f97-x6nss"
Sep 07 03:51:10.075184 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:10.075055    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3ab2bd5-8000-4878-8977-59a8c0e4d985-console-oauth-config\") pod \"console-74c646f97-x6nss\" (UID: \"d3ab2bd5-8000-4878-8977-59a8c0e4d985\") " pod="openshift-console/console-74c646f97-x6nss"
Sep 07 03:51:10.075184 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:10.075077    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3ab2bd5-8000-4878-8977-59a8c0e4d985-oauth-serving-cert\") pod \"console-74c646f97-x6nss\" (UID: \"d3ab2bd5-8000-4878-8977-59a8c0e4d985\") " pod="openshift-console/console-74c646f97-x6nss"
Sep 07 03:51:10.175428 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:10.175401    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3ab2bd5-8000-4878-8977-59a8c0e4d985-console-config\") pod \"console-74c646f97-x6nss\" (UID: \"d3ab2bd5-8000-4878-8977-59a8c0e4d985\") " pod="openshift-console/console-74c646f97-x6nss"
Sep 07 03:51:10.175577 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:10.175438    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3ab2bd5-8000-4878-8977-59a8c0e4d985-console-oauth-config\") pod \"console-74c646f97-x6nss\" (UID: \"d3ab2bd5-8000-4878-8977-59a8c0e4d985\") " pod="openshift-console/console-74c646f97-x6nss"
Sep 07 03:51:10.175577 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:10.175453    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3ab2bd5-8000-4878-8977-59a8c0e4d985-oauth-serving-cert\") pod \"console-74c646f97-x6nss\" (UID: \"d3ab2bd5-8000-4878-8977-59a8c0e4d985\") " pod="openshift-console/console-74c646f97-x6nss"
Sep 07 03:51:10.175577 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:10.175476    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc2m7\" (UniqueName: \"kubernetes.io/projected/d3ab2bd5-8000-4878-8977-59a8c0e4d985-kube-api-access-fc2m7\") pod \"console-74c646f97-x6nss\" (UID: \"d3ab2bd5-8000-4878-8977-59a8c0e4d985\") " pod="openshift-console/console-74c646f97-x6nss"
Sep 07 03:51:10.175577 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:10.175503    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3ab2bd5-8000-4878-8977-59a8c0e4d985-console-serving-cert\") pod \"console-74c646f97-x6nss\" (UID: \"d3ab2bd5-8000-4878-8977-59a8c0e4d985\") " pod="openshift-console/console-74c646f97-x6nss"
Sep 07 03:51:10.175577 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:10.175527    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3ab2bd5-8000-4878-8977-59a8c0e4d985-service-ca\") pod \"console-74c646f97-x6nss\" (UID: \"d3ab2bd5-8000-4878-8977-59a8c0e4d985\") " pod="openshift-console/console-74c646f97-x6nss"
Sep 07 03:51:10.175577 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:10.175548    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3ab2bd5-8000-4878-8977-59a8c0e4d985-trusted-ca-bundle\") pod \"console-74c646f97-x6nss\" (UID: \"d3ab2bd5-8000-4878-8977-59a8c0e4d985\") " pod="openshift-console/console-74c646f97-x6nss"
Sep 07 03:51:10.176233 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:10.176211    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3ab2bd5-8000-4878-8977-59a8c0e4d985-oauth-serving-cert\") pod \"console-74c646f97-x6nss\" (UID: \"d3ab2bd5-8000-4878-8977-59a8c0e4d985\") " pod="openshift-console/console-74c646f97-x6nss"
Sep 07 03:51:10.176314 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:10.176262    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3ab2bd5-8000-4878-8977-59a8c0e4d985-service-ca\") pod \"console-74c646f97-x6nss\" (UID: \"d3ab2bd5-8000-4878-8977-59a8c0e4d985\") " pod="openshift-console/console-74c646f97-x6nss"
Sep 07 03:51:10.176314 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:10.176297    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3ab2bd5-8000-4878-8977-59a8c0e4d985-console-config\") pod \"console-74c646f97-x6nss\" (UID: \"d3ab2bd5-8000-4878-8977-59a8c0e4d985\") " pod="openshift-console/console-74c646f97-x6nss"
Sep 07 03:51:10.176693 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:10.176669    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3ab2bd5-8000-4878-8977-59a8c0e4d985-trusted-ca-bundle\") pod \"console-74c646f97-x6nss\" (UID: \"d3ab2bd5-8000-4878-8977-59a8c0e4d985\") " pod="openshift-console/console-74c646f97-x6nss"
Sep 07 03:51:10.178075 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:10.178053    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3ab2bd5-8000-4878-8977-59a8c0e4d985-console-serving-cert\") pod \"console-74c646f97-x6nss\" (UID: \"d3ab2bd5-8000-4878-8977-59a8c0e4d985\") " pod="openshift-console/console-74c646f97-x6nss"
Sep 07 03:51:10.178139 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:10.178126    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3ab2bd5-8000-4878-8977-59a8c0e4d985-console-oauth-config\") pod \"console-74c646f97-x6nss\" (UID: \"d3ab2bd5-8000-4878-8977-59a8c0e4d985\") " pod="openshift-console/console-74c646f97-x6nss"
Sep 07 03:51:10.182547 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:10.182529    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc2m7\" (UniqueName: \"kubernetes.io/projected/d3ab2bd5-8000-4878-8977-59a8c0e4d985-kube-api-access-fc2m7\") pod \"console-74c646f97-x6nss\" (UID: \"d3ab2bd5-8000-4878-8977-59a8c0e4d985\") " pod="openshift-console/console-74c646f97-x6nss"
Sep 07 03:51:10.304510 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:10.304442    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74c646f97-x6nss"
Sep 07 03:51:10.572968 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:10.572860    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74c646f97-x6nss"]
Sep 07 03:51:10.575479 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:51:10.575445    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3ab2bd5_8000_4878_8977_59a8c0e4d985.slice/crio-7b5a9a1da09e7098f579e7971a4e23548d2658aae716100ea1eb304c6e349dd6 WatchSource:0}: Error finding container 7b5a9a1da09e7098f579e7971a4e23548d2658aae716100ea1eb304c6e349dd6: Status 404 returned error can't find the container with id 7b5a9a1da09e7098f579e7971a4e23548d2658aae716100ea1eb304c6e349dd6
Sep 07 03:51:11.018053 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:11.018020    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74c646f97-x6nss" event={"ID":"d3ab2bd5-8000-4878-8977-59a8c0e4d985","Type":"ContainerStarted","Data":"f337ec0ac2bd9c7cb9ccfa6db888d146c1cb8f7ac5e2a2dc3e2f65a693e1f062"}
Sep 07 03:51:11.018482 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:11.018094    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74c646f97-x6nss" event={"ID":"d3ab2bd5-8000-4878-8977-59a8c0e4d985","Type":"ContainerStarted","Data":"7b5a9a1da09e7098f579e7971a4e23548d2658aae716100ea1eb304c6e349dd6"}
Sep 07 03:51:11.034142 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:11.034094    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-74c646f97-x6nss" podStartSLOduration=2.034076706 podStartE2EDuration="2.034076706s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 03:51:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:51:11.033536809 +0000 UTC m=+174.346012703" watchObservedRunningTime="2026-09-07 03:51:11.034076706 +0000 UTC m=+174.346552609"
Sep 07 03:51:20.305276 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:20.305237    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-74c646f97-x6nss"
Sep 07 03:51:20.305736 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:20.305300    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-74c646f97-x6nss"
Sep 07 03:51:20.310074 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:20.310052    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-74c646f97-x6nss"
Sep 07 03:51:21.058898 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:21.058867    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-74c646f97-x6nss"
Sep 07 03:51:21.102993 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:21.102959    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5699f5f975-b7ks9"]
Sep 07 03:51:46.122442 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:46.122376    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5699f5f975-b7ks9" podUID="800f7326-b838-4e61-843f-f6a6e6dcca92" containerName="console" containerID="cri-o://259f7d176c9e6255c9b46253cb9b95b261a2ca5b75ae56070cb92a920c3dbd8f" gracePeriod=15
Sep 07 03:51:46.364900 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:46.364875    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5699f5f975-b7ks9"
Sep 07 03:51:46.476720 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:46.476596    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/800f7326-b838-4e61-843f-f6a6e6dcca92-console-oauth-config\") pod \"800f7326-b838-4e61-843f-f6a6e6dcca92\" (UID: \"800f7326-b838-4e61-843f-f6a6e6dcca92\") "
Sep 07 03:51:46.476720 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:46.476668    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/800f7326-b838-4e61-843f-f6a6e6dcca92-service-ca\") pod \"800f7326-b838-4e61-843f-f6a6e6dcca92\" (UID: \"800f7326-b838-4e61-843f-f6a6e6dcca92\") "
Sep 07 03:51:46.476720 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:46.476705    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/800f7326-b838-4e61-843f-f6a6e6dcca92-console-config\") pod \"800f7326-b838-4e61-843f-f6a6e6dcca92\" (UID: \"800f7326-b838-4e61-843f-f6a6e6dcca92\") "
Sep 07 03:51:46.476993 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:46.476756    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/800f7326-b838-4e61-843f-f6a6e6dcca92-console-serving-cert\") pod \"800f7326-b838-4e61-843f-f6a6e6dcca92\" (UID: \"800f7326-b838-4e61-843f-f6a6e6dcca92\") "
Sep 07 03:51:46.476993 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:46.476797    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/800f7326-b838-4e61-843f-f6a6e6dcca92-oauth-serving-cert\") pod \"800f7326-b838-4e61-843f-f6a6e6dcca92\" (UID: \"800f7326-b838-4e61-843f-f6a6e6dcca92\") "
Sep 07 03:51:46.476993 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:46.476852    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ktjtg\" (UniqueName: \"kubernetes.io/projected/800f7326-b838-4e61-843f-f6a6e6dcca92-kube-api-access-ktjtg\") pod \"800f7326-b838-4e61-843f-f6a6e6dcca92\" (UID: \"800f7326-b838-4e61-843f-f6a6e6dcca92\") "
Sep 07 03:51:46.476993 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:46.476885    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/800f7326-b838-4e61-843f-f6a6e6dcca92-trusted-ca-bundle\") pod \"800f7326-b838-4e61-843f-f6a6e6dcca92\" (UID: \"800f7326-b838-4e61-843f-f6a6e6dcca92\") "
Sep 07 03:51:46.477182 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:46.477095    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/800f7326-b838-4e61-843f-f6a6e6dcca92-service-ca" (OuterVolumeSpecName: "service-ca") pod "800f7326-b838-4e61-843f-f6a6e6dcca92" (UID: "800f7326-b838-4e61-843f-f6a6e6dcca92"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 03:51:46.477278 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:46.477257    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/800f7326-b838-4e61-843f-f6a6e6dcca92-console-config" (OuterVolumeSpecName: "console-config") pod "800f7326-b838-4e61-843f-f6a6e6dcca92" (UID: "800f7326-b838-4e61-843f-f6a6e6dcca92"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 03:51:46.477341 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:46.477268    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/800f7326-b838-4e61-843f-f6a6e6dcca92-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "800f7326-b838-4e61-843f-f6a6e6dcca92" (UID: "800f7326-b838-4e61-843f-f6a6e6dcca92"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 03:51:46.477445 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:46.477424    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/800f7326-b838-4e61-843f-f6a6e6dcca92-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "800f7326-b838-4e61-843f-f6a6e6dcca92" (UID: "800f7326-b838-4e61-843f-f6a6e6dcca92"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 03:51:46.478979 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:46.478956    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/800f7326-b838-4e61-843f-f6a6e6dcca92-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "800f7326-b838-4e61-843f-f6a6e6dcca92" (UID: "800f7326-b838-4e61-843f-f6a6e6dcca92"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 03:51:46.479050 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:46.478993    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/800f7326-b838-4e61-843f-f6a6e6dcca92-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "800f7326-b838-4e61-843f-f6a6e6dcca92" (UID: "800f7326-b838-4e61-843f-f6a6e6dcca92"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 03:51:46.479086 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:46.479072    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/800f7326-b838-4e61-843f-f6a6e6dcca92-kube-api-access-ktjtg" (OuterVolumeSpecName: "kube-api-access-ktjtg") pod "800f7326-b838-4e61-843f-f6a6e6dcca92" (UID: "800f7326-b838-4e61-843f-f6a6e6dcca92"). InnerVolumeSpecName "kube-api-access-ktjtg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 03:51:46.581684 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:46.578031    2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/800f7326-b838-4e61-843f-f6a6e6dcca92-console-serving-cert\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:51:46.581684 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:46.578071    2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/800f7326-b838-4e61-843f-f6a6e6dcca92-oauth-serving-cert\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:51:46.581684 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:46.578089    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ktjtg\" (UniqueName: \"kubernetes.io/projected/800f7326-b838-4e61-843f-f6a6e6dcca92-kube-api-access-ktjtg\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:51:46.581684 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:46.578110    2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/800f7326-b838-4e61-843f-f6a6e6dcca92-trusted-ca-bundle\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:51:46.581684 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:46.578126    2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/800f7326-b838-4e61-843f-f6a6e6dcca92-console-oauth-config\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:51:46.581684 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:46.578141    2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/800f7326-b838-4e61-843f-f6a6e6dcca92-service-ca\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:51:46.581684 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:46.578155    2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/800f7326-b838-4e61-843f-f6a6e6dcca92-console-config\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:51:47.148566 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:47.148527    2559 generic.go:356] "Generic (PLEG): container finished" podID="800f7326-b838-4e61-843f-f6a6e6dcca92" containerID="259f7d176c9e6255c9b46253cb9b95b261a2ca5b75ae56070cb92a920c3dbd8f" exitCode=0
Sep 07 03:51:47.149017 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:47.148605    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5699f5f975-b7ks9"
Sep 07 03:51:47.149017 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:47.148637    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5699f5f975-b7ks9" event={"ID":"800f7326-b838-4e61-843f-f6a6e6dcca92","Type":"ContainerDied","Data":"259f7d176c9e6255c9b46253cb9b95b261a2ca5b75ae56070cb92a920c3dbd8f"}
Sep 07 03:51:47.149017 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:47.148723    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5699f5f975-b7ks9" event={"ID":"800f7326-b838-4e61-843f-f6a6e6dcca92","Type":"ContainerDied","Data":"549ca019433f8835e8eb22b2ff37bc1a5c00d78c14fff7ba9de72bbbbda93bb1"}
Sep 07 03:51:47.149017 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:47.148744    2559 scope.go:117] "RemoveContainer" containerID="259f7d176c9e6255c9b46253cb9b95b261a2ca5b75ae56070cb92a920c3dbd8f"
Sep 07 03:51:47.156843 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:47.156825    2559 scope.go:117] "RemoveContainer" containerID="259f7d176c9e6255c9b46253cb9b95b261a2ca5b75ae56070cb92a920c3dbd8f"
Sep 07 03:51:47.157092 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:51:47.157065    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"259f7d176c9e6255c9b46253cb9b95b261a2ca5b75ae56070cb92a920c3dbd8f\": container with ID starting with 259f7d176c9e6255c9b46253cb9b95b261a2ca5b75ae56070cb92a920c3dbd8f not found: ID does not exist" containerID="259f7d176c9e6255c9b46253cb9b95b261a2ca5b75ae56070cb92a920c3dbd8f"
Sep 07 03:51:47.157164 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:47.157105    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"259f7d176c9e6255c9b46253cb9b95b261a2ca5b75ae56070cb92a920c3dbd8f"} err="failed to get container status \"259f7d176c9e6255c9b46253cb9b95b261a2ca5b75ae56070cb92a920c3dbd8f\": rpc error: code = NotFound desc = could not find container \"259f7d176c9e6255c9b46253cb9b95b261a2ca5b75ae56070cb92a920c3dbd8f\": container with ID starting with 259f7d176c9e6255c9b46253cb9b95b261a2ca5b75ae56070cb92a920c3dbd8f not found: ID does not exist"
Sep 07 03:51:47.169556 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:47.169528    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5699f5f975-b7ks9"]
Sep 07 03:51:47.172688 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:47.172667    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5699f5f975-b7ks9"]
Sep 07 03:51:47.178013 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:47.177992    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="800f7326-b838-4e61-843f-f6a6e6dcca92" path="/var/lib/kubelet/pods/800f7326-b838-4e61-843f-f6a6e6dcca92/volumes"
Sep 07 03:51:55.062967 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:55.062927    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbj8x"]
Sep 07 03:51:55.063562 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:55.063322    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="800f7326-b838-4e61-843f-f6a6e6dcca92" containerName="console"
Sep 07 03:51:55.063562 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:55.063340    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="800f7326-b838-4e61-843f-f6a6e6dcca92" containerName="console"
Sep 07 03:51:55.063562 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:55.063419    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="800f7326-b838-4e61-843f-f6a6e6dcca92" containerName="console"
Sep 07 03:51:55.068754 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:55.068716    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbj8x"
Sep 07 03:51:55.070746 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:55.070725    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 07 03:51:55.070852 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:55.070750    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wzkt6\""
Sep 07 03:51:55.071272 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:55.071255    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 07 03:51:55.075111 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:55.075089    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbj8x"]
Sep 07 03:51:55.146786 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:55.146753    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6421d5ca-5358-42b1-9392-598d88372006-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbj8x\" (UID: \"6421d5ca-5358-42b1-9392-598d88372006\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbj8x"
Sep 07 03:51:55.146919 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:55.146799    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6421d5ca-5358-42b1-9392-598d88372006-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbj8x\" (UID: \"6421d5ca-5358-42b1-9392-598d88372006\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbj8x"
Sep 07 03:51:55.146919 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:55.146825    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7f4z\" (UniqueName: \"kubernetes.io/projected/6421d5ca-5358-42b1-9392-598d88372006-kube-api-access-f7f4z\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbj8x\" (UID: \"6421d5ca-5358-42b1-9392-598d88372006\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbj8x"
Sep 07 03:51:55.248243 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:55.248210    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6421d5ca-5358-42b1-9392-598d88372006-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbj8x\" (UID: \"6421d5ca-5358-42b1-9392-598d88372006\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbj8x"
Sep 07 03:51:55.248390 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:55.248267    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6421d5ca-5358-42b1-9392-598d88372006-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbj8x\" (UID: \"6421d5ca-5358-42b1-9392-598d88372006\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbj8x"
Sep 07 03:51:55.248390 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:55.248298    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7f4z\" (UniqueName: \"kubernetes.io/projected/6421d5ca-5358-42b1-9392-598d88372006-kube-api-access-f7f4z\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbj8x\" (UID: \"6421d5ca-5358-42b1-9392-598d88372006\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbj8x"
Sep 07 03:51:55.248687 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:55.248666    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6421d5ca-5358-42b1-9392-598d88372006-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbj8x\" (UID: \"6421d5ca-5358-42b1-9392-598d88372006\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbj8x"
Sep 07 03:51:55.248734 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:55.248668    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6421d5ca-5358-42b1-9392-598d88372006-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbj8x\" (UID: \"6421d5ca-5358-42b1-9392-598d88372006\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbj8x"
Sep 07 03:51:55.256788 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:55.256770    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7f4z\" (UniqueName: \"kubernetes.io/projected/6421d5ca-5358-42b1-9392-598d88372006-kube-api-access-f7f4z\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbj8x\" (UID: \"6421d5ca-5358-42b1-9392-598d88372006\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbj8x"
Sep 07 03:51:55.379122 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:55.379095    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbj8x"
Sep 07 03:51:55.647309 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:55.647190    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbj8x"]
Sep 07 03:51:55.649959 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:51:55.649931    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6421d5ca_5358_42b1_9392_598d88372006.slice/crio-f11b21738eea8b0b15fd9569ed43d52d942c146e97c7ccc5bd066b7f960cb43d WatchSource:0}: Error finding container f11b21738eea8b0b15fd9569ed43d52d942c146e97c7ccc5bd066b7f960cb43d: Status 404 returned error can't find the container with id f11b21738eea8b0b15fd9569ed43d52d942c146e97c7ccc5bd066b7f960cb43d
Sep 07 03:51:56.187149 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:51:56.187111    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbj8x" event={"ID":"6421d5ca-5358-42b1-9392-598d88372006","Type":"ContainerStarted","Data":"f11b21738eea8b0b15fd9569ed43d52d942c146e97c7ccc5bd066b7f960cb43d"}
Sep 07 03:52:02.213072 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:02.213034    2559 generic.go:356] "Generic (PLEG): container finished" podID="6421d5ca-5358-42b1-9392-598d88372006" containerID="0902c821f2af3e204a0d8cf0729548e543aea1eb810fea74fed9f51c89e5206f" exitCode=0
Sep 07 03:52:02.213585 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:02.213122    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbj8x" event={"ID":"6421d5ca-5358-42b1-9392-598d88372006","Type":"ContainerDied","Data":"0902c821f2af3e204a0d8cf0729548e543aea1eb810fea74fed9f51c89e5206f"}
Sep 07 03:52:04.222871 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:04.222839    2559 generic.go:356] "Generic (PLEG): container finished" podID="6421d5ca-5358-42b1-9392-598d88372006" containerID="3649b200eaba05d8d39ee073b2099087d3c0532ac0b370e8bc55c634f2821139" exitCode=0
Sep 07 03:52:04.223199 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:04.222926    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbj8x" event={"ID":"6421d5ca-5358-42b1-9392-598d88372006","Type":"ContainerDied","Data":"3649b200eaba05d8d39ee073b2099087d3c0532ac0b370e8bc55c634f2821139"}
Sep 07 03:52:11.252808 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:11.252775    2559 generic.go:356] "Generic (PLEG): container finished" podID="6421d5ca-5358-42b1-9392-598d88372006" containerID="e130dc6b5990e77c204825fd84227c75a9da3fc0f05b565c2640747b97b1777d" exitCode=0
Sep 07 03:52:11.253160 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:11.252819    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbj8x" event={"ID":"6421d5ca-5358-42b1-9392-598d88372006","Type":"ContainerDied","Data":"e130dc6b5990e77c204825fd84227c75a9da3fc0f05b565c2640747b97b1777d"}
Sep 07 03:52:12.383129 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:12.383103    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbj8x"
Sep 07 03:52:12.491485 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:12.491452    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f7f4z\" (UniqueName: \"kubernetes.io/projected/6421d5ca-5358-42b1-9392-598d88372006-kube-api-access-f7f4z\") pod \"6421d5ca-5358-42b1-9392-598d88372006\" (UID: \"6421d5ca-5358-42b1-9392-598d88372006\") "
Sep 07 03:52:12.491671 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:12.491525    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6421d5ca-5358-42b1-9392-598d88372006-util\") pod \"6421d5ca-5358-42b1-9392-598d88372006\" (UID: \"6421d5ca-5358-42b1-9392-598d88372006\") "
Sep 07 03:52:12.491671 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:12.491559    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6421d5ca-5358-42b1-9392-598d88372006-bundle\") pod \"6421d5ca-5358-42b1-9392-598d88372006\" (UID: \"6421d5ca-5358-42b1-9392-598d88372006\") "
Sep 07 03:52:12.492265 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:12.492230    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6421d5ca-5358-42b1-9392-598d88372006-bundle" (OuterVolumeSpecName: "bundle") pod "6421d5ca-5358-42b1-9392-598d88372006" (UID: "6421d5ca-5358-42b1-9392-598d88372006"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 03:52:12.493705 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:12.493677    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6421d5ca-5358-42b1-9392-598d88372006-kube-api-access-f7f4z" (OuterVolumeSpecName: "kube-api-access-f7f4z") pod "6421d5ca-5358-42b1-9392-598d88372006" (UID: "6421d5ca-5358-42b1-9392-598d88372006"). InnerVolumeSpecName "kube-api-access-f7f4z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 03:52:12.496516 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:12.496496    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6421d5ca-5358-42b1-9392-598d88372006-util" (OuterVolumeSpecName: "util") pod "6421d5ca-5358-42b1-9392-598d88372006" (UID: "6421d5ca-5358-42b1-9392-598d88372006"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 03:52:12.592574 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:12.592476    2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6421d5ca-5358-42b1-9392-598d88372006-util\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:52:12.592574 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:12.592510    2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6421d5ca-5358-42b1-9392-598d88372006-bundle\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:52:12.592574 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:12.592523    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7f4z\" (UniqueName: \"kubernetes.io/projected/6421d5ca-5358-42b1-9392-598d88372006-kube-api-access-f7f4z\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:52:13.266817 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:13.262777    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbj8x" event={"ID":"6421d5ca-5358-42b1-9392-598d88372006","Type":"ContainerDied","Data":"f11b21738eea8b0b15fd9569ed43d52d942c146e97c7ccc5bd066b7f960cb43d"}
Sep 07 03:52:13.266817 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:13.262885    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f11b21738eea8b0b15fd9569ed43d52d942c146e97c7ccc5bd066b7f960cb43d"
Sep 07 03:52:13.266817 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:13.263002    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lbj8x"
Sep 07 03:52:17.987236 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:17.987202    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2np7q"]
Sep 07 03:52:17.987599 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:17.987466    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6421d5ca-5358-42b1-9392-598d88372006" containerName="pull"
Sep 07 03:52:17.987599 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:17.987481    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6421d5ca-5358-42b1-9392-598d88372006" containerName="pull"
Sep 07 03:52:17.987599 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:17.987496    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6421d5ca-5358-42b1-9392-598d88372006" containerName="extract"
Sep 07 03:52:17.987599 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:17.987504    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6421d5ca-5358-42b1-9392-598d88372006" containerName="extract"
Sep 07 03:52:17.987599 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:17.987514    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6421d5ca-5358-42b1-9392-598d88372006" containerName="util"
Sep 07 03:52:17.987599 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:17.987520    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6421d5ca-5358-42b1-9392-598d88372006" containerName="util"
Sep 07 03:52:17.987599 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:17.987574    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6421d5ca-5358-42b1-9392-598d88372006" containerName="extract"
Sep 07 03:52:17.992943 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:17.992927    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2np7q"
Sep 07 03:52:17.994986 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:17.994950    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 07 03:52:17.995118 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:17.994985    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 07 03:52:17.995118 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:17.995092    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-z5n8s\""
Sep 07 03:52:18.004638 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:18.004603    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2np7q"]
Sep 07 03:52:18.137447 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:18.137406    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c12852d7-17de-4832-b5ba-1b0f679612b7-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-2np7q\" (UID: \"c12852d7-17de-4832-b5ba-1b0f679612b7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2np7q"
Sep 07 03:52:18.137650 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:18.137453    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8p9tt\" (UniqueName: \"kubernetes.io/projected/c12852d7-17de-4832-b5ba-1b0f679612b7-kube-api-access-8p9tt\") pod \"cert-manager-operator-controller-manager-55c444bf86-2np7q\" (UID: \"c12852d7-17de-4832-b5ba-1b0f679612b7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2np7q"
Sep 07 03:52:18.238006 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:18.237916    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c12852d7-17de-4832-b5ba-1b0f679612b7-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-2np7q\" (UID: \"c12852d7-17de-4832-b5ba-1b0f679612b7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2np7q"
Sep 07 03:52:18.238006 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:18.237958    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8p9tt\" (UniqueName: \"kubernetes.io/projected/c12852d7-17de-4832-b5ba-1b0f679612b7-kube-api-access-8p9tt\") pod \"cert-manager-operator-controller-manager-55c444bf86-2np7q\" (UID: \"c12852d7-17de-4832-b5ba-1b0f679612b7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2np7q"
Sep 07 03:52:18.238384 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:18.238361    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c12852d7-17de-4832-b5ba-1b0f679612b7-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-2np7q\" (UID: \"c12852d7-17de-4832-b5ba-1b0f679612b7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2np7q"
Sep 07 03:52:18.249249 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:18.249218    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8p9tt\" (UniqueName: \"kubernetes.io/projected/c12852d7-17de-4832-b5ba-1b0f679612b7-kube-api-access-8p9tt\") pod \"cert-manager-operator-controller-manager-55c444bf86-2np7q\" (UID: \"c12852d7-17de-4832-b5ba-1b0f679612b7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2np7q"
Sep 07 03:52:18.302634 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:18.302601    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2np7q"
Sep 07 03:52:18.581344 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:18.581247    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2np7q"]
Sep 07 03:52:18.584965 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:52:18.584934    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc12852d7_17de_4832_b5ba_1b0f679612b7.slice/crio-2fc2ccfaf71188130acff7835f344032eb0e2b986875f057c71261c521a2dde2 WatchSource:0}: Error finding container 2fc2ccfaf71188130acff7835f344032eb0e2b986875f057c71261c521a2dde2: Status 404 returned error can't find the container with id 2fc2ccfaf71188130acff7835f344032eb0e2b986875f057c71261c521a2dde2
Sep 07 03:52:19.289714 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:19.289672    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2np7q" event={"ID":"c12852d7-17de-4832-b5ba-1b0f679612b7","Type":"ContainerStarted","Data":"2fc2ccfaf71188130acff7835f344032eb0e2b986875f057c71261c521a2dde2"}
Sep 07 03:52:21.299787 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:21.299748    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2np7q" event={"ID":"c12852d7-17de-4832-b5ba-1b0f679612b7","Type":"ContainerStarted","Data":"77c30589cb3d3cf5761bd324bf4f32c51c9fdb110de0db622fdf043ac037f9a9"}
Sep 07 03:52:21.318962 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:21.318858    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2np7q" podStartSLOduration=2.198128401 podStartE2EDuration="4.318840712s" totalImagesPullingTime="2.120712311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 03:52:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:52:21.317800776 +0000 UTC m=+244.630276681" watchObservedRunningTime="2026-09-07 03:52:21.318840712 +0000 UTC m=+244.631316614"
Sep 07 03:52:22.324174 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:22.324139    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2k7lx"]
Sep 07 03:52:22.345057 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:22.345030    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2k7lx"]
Sep 07 03:52:22.345232 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:22.345155    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2k7lx"
Sep 07 03:52:22.347557 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:22.347520    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wzkt6\""
Sep 07 03:52:22.347557 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:22.347522    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 07 03:52:22.347974 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:22.347958    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 07 03:52:22.477504 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:22.477471    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6m87\" (UniqueName: \"kubernetes.io/projected/9f8852ea-6ac9-42b9-8514-836f2caf9b36-kube-api-access-q6m87\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2k7lx\" (UID: \"9f8852ea-6ac9-42b9-8514-836f2caf9b36\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2k7lx"
Sep 07 03:52:22.477504 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:22.477507    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f8852ea-6ac9-42b9-8514-836f2caf9b36-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2k7lx\" (UID: \"9f8852ea-6ac9-42b9-8514-836f2caf9b36\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2k7lx"
Sep 07 03:52:22.477732 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:22.477547    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f8852ea-6ac9-42b9-8514-836f2caf9b36-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2k7lx\" (UID: \"9f8852ea-6ac9-42b9-8514-836f2caf9b36\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2k7lx"
Sep 07 03:52:22.578871 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:22.578771    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f8852ea-6ac9-42b9-8514-836f2caf9b36-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2k7lx\" (UID: \"9f8852ea-6ac9-42b9-8514-836f2caf9b36\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2k7lx"
Sep 07 03:52:22.578871 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:22.578833    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6m87\" (UniqueName: \"kubernetes.io/projected/9f8852ea-6ac9-42b9-8514-836f2caf9b36-kube-api-access-q6m87\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2k7lx\" (UID: \"9f8852ea-6ac9-42b9-8514-836f2caf9b36\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2k7lx"
Sep 07 03:52:22.578871 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:22.578855    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f8852ea-6ac9-42b9-8514-836f2caf9b36-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2k7lx\" (UID: \"9f8852ea-6ac9-42b9-8514-836f2caf9b36\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2k7lx"
Sep 07 03:52:22.579256 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:22.579230    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f8852ea-6ac9-42b9-8514-836f2caf9b36-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2k7lx\" (UID: \"9f8852ea-6ac9-42b9-8514-836f2caf9b36\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2k7lx"
Sep 07 03:52:22.579326 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:22.579236    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f8852ea-6ac9-42b9-8514-836f2caf9b36-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2k7lx\" (UID: \"9f8852ea-6ac9-42b9-8514-836f2caf9b36\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2k7lx"
Sep 07 03:52:22.586983 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:22.586964    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6m87\" (UniqueName: \"kubernetes.io/projected/9f8852ea-6ac9-42b9-8514-836f2caf9b36-kube-api-access-q6m87\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2k7lx\" (UID: \"9f8852ea-6ac9-42b9-8514-836f2caf9b36\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2k7lx"
Sep 07 03:52:22.654435 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:22.654402    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2k7lx"
Sep 07 03:52:22.931942 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:22.931916    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2k7lx"]
Sep 07 03:52:22.934262 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:52:22.934237    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f8852ea_6ac9_42b9_8514_836f2caf9b36.slice/crio-cfe4021c5dc6dfad49fc952723ef05ee40b7b8e557af9032eea3aada206e05e0 WatchSource:0}: Error finding container cfe4021c5dc6dfad49fc952723ef05ee40b7b8e557af9032eea3aada206e05e0: Status 404 returned error can't find the container with id cfe4021c5dc6dfad49fc952723ef05ee40b7b8e557af9032eea3aada206e05e0
Sep 07 03:52:23.309558 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:23.309457    2559 generic.go:356] "Generic (PLEG): container finished" podID="9f8852ea-6ac9-42b9-8514-836f2caf9b36" containerID="055f86febe31cc922ffc864196062a504c2119848aa309ff581b6f2a4ed7f9b7" exitCode=0
Sep 07 03:52:23.309771 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:23.309543    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2k7lx" event={"ID":"9f8852ea-6ac9-42b9-8514-836f2caf9b36","Type":"ContainerDied","Data":"055f86febe31cc922ffc864196062a504c2119848aa309ff581b6f2a4ed7f9b7"}
Sep 07 03:52:23.309771 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:23.309607    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2k7lx" event={"ID":"9f8852ea-6ac9-42b9-8514-836f2caf9b36","Type":"ContainerStarted","Data":"cfe4021c5dc6dfad49fc952723ef05ee40b7b8e557af9032eea3aada206e05e0"}
Sep 07 03:52:24.563568 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:24.563535    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-5kzqf"]
Sep 07 03:52:24.577040 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:24.577013    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-5kzqf"]
Sep 07 03:52:24.577205 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:24.577146    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5kzqf"
Sep 07 03:52:24.579110 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:24.579086    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 07 03:52:24.579822 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:24.579788    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-wnzjn\""
Sep 07 03:52:24.579949 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:24.579789    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 07 03:52:24.700775 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:24.700738    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tm2h4\" (UniqueName: \"kubernetes.io/projected/9bf2f9bc-a0d6-41bd-a077-7d831a841d18-kube-api-access-tm2h4\") pod \"cert-manager-cainjector-559cdd8c87-5kzqf\" (UID: \"9bf2f9bc-a0d6-41bd-a077-7d831a841d18\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5kzqf"
Sep 07 03:52:24.700926 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:24.700789    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9bf2f9bc-a0d6-41bd-a077-7d831a841d18-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-5kzqf\" (UID: \"9bf2f9bc-a0d6-41bd-a077-7d831a841d18\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5kzqf"
Sep 07 03:52:24.802081 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:24.802039    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9bf2f9bc-a0d6-41bd-a077-7d831a841d18-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-5kzqf\" (UID: \"9bf2f9bc-a0d6-41bd-a077-7d831a841d18\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5kzqf"
Sep 07 03:52:24.802268 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:24.802157    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm2h4\" (UniqueName: \"kubernetes.io/projected/9bf2f9bc-a0d6-41bd-a077-7d831a841d18-kube-api-access-tm2h4\") pod \"cert-manager-cainjector-559cdd8c87-5kzqf\" (UID: \"9bf2f9bc-a0d6-41bd-a077-7d831a841d18\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5kzqf"
Sep 07 03:52:24.810429 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:24.810402    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9bf2f9bc-a0d6-41bd-a077-7d831a841d18-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-5kzqf\" (UID: \"9bf2f9bc-a0d6-41bd-a077-7d831a841d18\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5kzqf"
Sep 07 03:52:24.810563 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:24.810523    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tm2h4\" (UniqueName: \"kubernetes.io/projected/9bf2f9bc-a0d6-41bd-a077-7d831a841d18-kube-api-access-tm2h4\") pod \"cert-manager-cainjector-559cdd8c87-5kzqf\" (UID: \"9bf2f9bc-a0d6-41bd-a077-7d831a841d18\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5kzqf"
Sep 07 03:52:24.895257 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:24.895224    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5kzqf"
Sep 07 03:52:25.809120 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:25.809098    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-5kzqf"]
Sep 07 03:52:25.821568 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:52:25.821542    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9bf2f9bc_a0d6_41bd_a077_7d831a841d18.slice/crio-d99b07395d62c5ddd3cdb9b172b667102132a87da0fe51830eb7c42497879ce1 WatchSource:0}: Error finding container d99b07395d62c5ddd3cdb9b172b667102132a87da0fe51830eb7c42497879ce1: Status 404 returned error can't find the container with id d99b07395d62c5ddd3cdb9b172b667102132a87da0fe51830eb7c42497879ce1
Sep 07 03:52:26.324905 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:26.324860    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5kzqf" event={"ID":"9bf2f9bc-a0d6-41bd-a077-7d831a841d18","Type":"ContainerStarted","Data":"d99b07395d62c5ddd3cdb9b172b667102132a87da0fe51830eb7c42497879ce1"}
Sep 07 03:52:26.326479 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:26.326454    2559 generic.go:356] "Generic (PLEG): container finished" podID="9f8852ea-6ac9-42b9-8514-836f2caf9b36" containerID="1bd8cece7ce08ff29f1f1cabede7683857f7a1132cec05ce7214929f0fadc465" exitCode=0
Sep 07 03:52:26.326645 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:26.326537    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2k7lx" event={"ID":"9f8852ea-6ac9-42b9-8514-836f2caf9b36","Type":"ContainerDied","Data":"1bd8cece7ce08ff29f1f1cabede7683857f7a1132cec05ce7214929f0fadc465"}
Sep 07 03:52:27.333177 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:27.333142    2559 generic.go:356] "Generic (PLEG): container finished" podID="9f8852ea-6ac9-42b9-8514-836f2caf9b36" containerID="fe5b80e5d4e1d32fb23c7ce9586d46a78822a4e9b87baf7dcd19d378372e1b3d" exitCode=0
Sep 07 03:52:27.333616 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:27.333230    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2k7lx" event={"ID":"9f8852ea-6ac9-42b9-8514-836f2caf9b36","Type":"ContainerDied","Data":"fe5b80e5d4e1d32fb23c7ce9586d46a78822a4e9b87baf7dcd19d378372e1b3d"}
Sep 07 03:52:28.313217 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:28.313184    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-9t985"]
Sep 07 03:52:28.315718 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:28.315699    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-9t985"
Sep 07 03:52:28.317592 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:28.317571    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-vffjg\""
Sep 07 03:52:28.325532 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:28.325508    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-9t985"]
Sep 07 03:52:28.433814 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:28.433784    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1ebee092-ba39-4417-b26a-fc71a89f9f12-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-9t985\" (UID: \"1ebee092-ba39-4417-b26a-fc71a89f9f12\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9t985"
Sep 07 03:52:28.434158 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:28.433821    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8twnd\" (UniqueName: \"kubernetes.io/projected/1ebee092-ba39-4417-b26a-fc71a89f9f12-kube-api-access-8twnd\") pod \"cert-manager-webhook-6486ffd997-9t985\" (UID: \"1ebee092-ba39-4417-b26a-fc71a89f9f12\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9t985"
Sep 07 03:52:28.466270 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:28.466173    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2k7lx"
Sep 07 03:52:28.534797 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:28.534743    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1ebee092-ba39-4417-b26a-fc71a89f9f12-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-9t985\" (UID: \"1ebee092-ba39-4417-b26a-fc71a89f9f12\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9t985"
Sep 07 03:52:28.534797 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:28.534793    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8twnd\" (UniqueName: \"kubernetes.io/projected/1ebee092-ba39-4417-b26a-fc71a89f9f12-kube-api-access-8twnd\") pod \"cert-manager-webhook-6486ffd997-9t985\" (UID: \"1ebee092-ba39-4417-b26a-fc71a89f9f12\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9t985"
Sep 07 03:52:28.543081 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:28.543052    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8twnd\" (UniqueName: \"kubernetes.io/projected/1ebee092-ba39-4417-b26a-fc71a89f9f12-kube-api-access-8twnd\") pod \"cert-manager-webhook-6486ffd997-9t985\" (UID: \"1ebee092-ba39-4417-b26a-fc71a89f9f12\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9t985"
Sep 07 03:52:28.543193 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:28.543089    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1ebee092-ba39-4417-b26a-fc71a89f9f12-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-9t985\" (UID: \"1ebee092-ba39-4417-b26a-fc71a89f9f12\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9t985"
Sep 07 03:52:28.625191 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:28.625157    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-9t985"
Sep 07 03:52:28.635580 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:28.635553    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f8852ea-6ac9-42b9-8514-836f2caf9b36-bundle\") pod \"9f8852ea-6ac9-42b9-8514-836f2caf9b36\" (UID: \"9f8852ea-6ac9-42b9-8514-836f2caf9b36\") "
Sep 07 03:52:28.635667 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:28.635650    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q6m87\" (UniqueName: \"kubernetes.io/projected/9f8852ea-6ac9-42b9-8514-836f2caf9b36-kube-api-access-q6m87\") pod \"9f8852ea-6ac9-42b9-8514-836f2caf9b36\" (UID: \"9f8852ea-6ac9-42b9-8514-836f2caf9b36\") "
Sep 07 03:52:28.635741 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:28.635726    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f8852ea-6ac9-42b9-8514-836f2caf9b36-util\") pod \"9f8852ea-6ac9-42b9-8514-836f2caf9b36\" (UID: \"9f8852ea-6ac9-42b9-8514-836f2caf9b36\") "
Sep 07 03:52:28.635953 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:28.635925    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f8852ea-6ac9-42b9-8514-836f2caf9b36-bundle" (OuterVolumeSpecName: "bundle") pod "9f8852ea-6ac9-42b9-8514-836f2caf9b36" (UID: "9f8852ea-6ac9-42b9-8514-836f2caf9b36"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 03:52:28.637706 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:28.637677    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f8852ea-6ac9-42b9-8514-836f2caf9b36-kube-api-access-q6m87" (OuterVolumeSpecName: "kube-api-access-q6m87") pod "9f8852ea-6ac9-42b9-8514-836f2caf9b36" (UID: "9f8852ea-6ac9-42b9-8514-836f2caf9b36"). InnerVolumeSpecName "kube-api-access-q6m87". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 03:52:28.642074 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:28.642051    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f8852ea-6ac9-42b9-8514-836f2caf9b36-util" (OuterVolumeSpecName: "util") pod "9f8852ea-6ac9-42b9-8514-836f2caf9b36" (UID: "9f8852ea-6ac9-42b9-8514-836f2caf9b36"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 03:52:28.737320 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:28.737285    2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9f8852ea-6ac9-42b9-8514-836f2caf9b36-util\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:52:28.737320 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:28.737314    2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9f8852ea-6ac9-42b9-8514-836f2caf9b36-bundle\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:52:28.737320 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:28.737323    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q6m87\" (UniqueName: \"kubernetes.io/projected/9f8852ea-6ac9-42b9-8514-836f2caf9b36-kube-api-access-q6m87\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:52:28.901893 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:28.901811    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-9t985"]
Sep 07 03:52:28.904578 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:52:28.904549    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1ebee092_ba39_4417_b26a_fc71a89f9f12.slice/crio-cc92607fc478b74faca3d711bb42acace334f63d8ebb43150a699b1c367c27a2 WatchSource:0}: Error finding container cc92607fc478b74faca3d711bb42acace334f63d8ebb43150a699b1c367c27a2: Status 404 returned error can't find the container with id cc92607fc478b74faca3d711bb42acace334f63d8ebb43150a699b1c367c27a2
Sep 07 03:52:29.343683 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:29.343650    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-9t985" event={"ID":"1ebee092-ba39-4417-b26a-fc71a89f9f12","Type":"ContainerStarted","Data":"893e5266ea69a1cef5cf10b4f1f961a6ad14114fba62d02d1e7b2ab710c35daf"}
Sep 07 03:52:29.343854 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:29.343699    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-9t985" event={"ID":"1ebee092-ba39-4417-b26a-fc71a89f9f12","Type":"ContainerStarted","Data":"cc92607fc478b74faca3d711bb42acace334f63d8ebb43150a699b1c367c27a2"}
Sep 07 03:52:29.343854 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:29.343723    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-9t985"
Sep 07 03:52:29.345218 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:29.345187    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5kzqf" event={"ID":"9bf2f9bc-a0d6-41bd-a077-7d831a841d18","Type":"ContainerStarted","Data":"64e2d198055b84ede593c474026a1504b34aadf271890a191d73202df72c118e"}
Sep 07 03:52:29.347010 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:29.346987    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2k7lx" event={"ID":"9f8852ea-6ac9-42b9-8514-836f2caf9b36","Type":"ContainerDied","Data":"cfe4021c5dc6dfad49fc952723ef05ee40b7b8e557af9032eea3aada206e05e0"}
Sep 07 03:52:29.347084 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:29.347010    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2k7lx"
Sep 07 03:52:29.347084 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:29.347024    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cfe4021c5dc6dfad49fc952723ef05ee40b7b8e557af9032eea3aada206e05e0"
Sep 07 03:52:29.359083 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:29.359045    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-9t985" podStartSLOduration=1.359032797 podStartE2EDuration="1.359032797s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 03:52:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:52:29.3580993 +0000 UTC m=+252.670575202" watchObservedRunningTime="2026-09-07 03:52:29.359032797 +0000 UTC m=+252.671508698"
Sep 07 03:52:29.379271 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:29.379228    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5kzqf" podStartSLOduration=2.85947086 podStartE2EDuration="5.379213048s" totalImagesPullingTime="2.519742188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 03:52:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:52:29.378311446 +0000 UTC m=+252.690787349" watchObservedRunningTime="2026-09-07 03:52:29.379213048 +0000 UTC m=+252.691688949"
Sep 07 03:52:35.353747 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:35.353707    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-9t985"
Sep 07 03:52:35.884835 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:35.884796    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s6s5g"]
Sep 07 03:52:35.885100 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:35.885088    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f8852ea-6ac9-42b9-8514-836f2caf9b36" containerName="util"
Sep 07 03:52:35.885146 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:35.885103    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f8852ea-6ac9-42b9-8514-836f2caf9b36" containerName="util"
Sep 07 03:52:35.885146 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:35.885124    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f8852ea-6ac9-42b9-8514-836f2caf9b36" containerName="extract"
Sep 07 03:52:35.885146 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:35.885131    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f8852ea-6ac9-42b9-8514-836f2caf9b36" containerName="extract"
Sep 07 03:52:35.885146 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:35.885142    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f8852ea-6ac9-42b9-8514-836f2caf9b36" containerName="pull"
Sep 07 03:52:35.885146 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:35.885147    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f8852ea-6ac9-42b9-8514-836f2caf9b36" containerName="pull"
Sep 07 03:52:35.885309 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:35.885191    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f8852ea-6ac9-42b9-8514-836f2caf9b36" containerName="extract"
Sep 07 03:52:35.887949 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:35.887932    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s6s5g"
Sep 07 03:52:35.889901 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:35.889880    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 07 03:52:35.890653 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:35.890612    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 07 03:52:35.890768 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:35.890660    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-srxxf\""
Sep 07 03:52:35.896451 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:35.896422    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s6s5g"]
Sep 07 03:52:36.000032 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:35.999997    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7g844\" (UniqueName: \"kubernetes.io/projected/e0912204-badd-452e-9631-9b69c23d3546-kube-api-access-7g844\") pod \"openshift-lws-operator-fd8ccff4c-s6s5g\" (UID: \"e0912204-badd-452e-9631-9b69c23d3546\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s6s5g"
Sep 07 03:52:36.000032 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:36.000038    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e0912204-badd-452e-9631-9b69c23d3546-tmp\") pod \"openshift-lws-operator-fd8ccff4c-s6s5g\" (UID: \"e0912204-badd-452e-9631-9b69c23d3546\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s6s5g"
Sep 07 03:52:36.100590 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:36.100555    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7g844\" (UniqueName: \"kubernetes.io/projected/e0912204-badd-452e-9631-9b69c23d3546-kube-api-access-7g844\") pod \"openshift-lws-operator-fd8ccff4c-s6s5g\" (UID: \"e0912204-badd-452e-9631-9b69c23d3546\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s6s5g"
Sep 07 03:52:36.100590 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:36.100594    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e0912204-badd-452e-9631-9b69c23d3546-tmp\") pod \"openshift-lws-operator-fd8ccff4c-s6s5g\" (UID: \"e0912204-badd-452e-9631-9b69c23d3546\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s6s5g"
Sep 07 03:52:36.100997 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:36.100977    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e0912204-badd-452e-9631-9b69c23d3546-tmp\") pod \"openshift-lws-operator-fd8ccff4c-s6s5g\" (UID: \"e0912204-badd-452e-9631-9b69c23d3546\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s6s5g"
Sep 07 03:52:36.108290 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:36.108270    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7g844\" (UniqueName: \"kubernetes.io/projected/e0912204-badd-452e-9631-9b69c23d3546-kube-api-access-7g844\") pod \"openshift-lws-operator-fd8ccff4c-s6s5g\" (UID: \"e0912204-badd-452e-9631-9b69c23d3546\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s6s5g"
Sep 07 03:52:36.197414 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:36.197318    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s6s5g"
Sep 07 03:52:36.467322 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:36.467280    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s6s5g"]
Sep 07 03:52:36.469675 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:52:36.469643    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode0912204_badd_452e_9631_9b69c23d3546.slice/crio-854bd9aca1ebe4b1cc15e83d9a3bad33d014d920fa6e8b31dd04398e49bbace4 WatchSource:0}: Error finding container 854bd9aca1ebe4b1cc15e83d9a3bad33d014d920fa6e8b31dd04398e49bbace4: Status 404 returned error can't find the container with id 854bd9aca1ebe4b1cc15e83d9a3bad33d014d920fa6e8b31dd04398e49bbace4
Sep 07 03:52:37.381205 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:37.381173    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s6s5g" event={"ID":"e0912204-badd-452e-9631-9b69c23d3546","Type":"ContainerStarted","Data":"854bd9aca1ebe4b1cc15e83d9a3bad33d014d920fa6e8b31dd04398e49bbace4"}
Sep 07 03:52:39.391303 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:39.391268    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s6s5g" event={"ID":"e0912204-badd-452e-9631-9b69c23d3546","Type":"ContainerStarted","Data":"a8d24801cecec0e15439c59c3403668599c8ec785c45ee893965deb0db85955d"}
Sep 07 03:52:39.406741 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:39.406694    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s6s5g" podStartSLOduration=1.8079037009999999 podStartE2EDuration="4.406677968s" totalImagesPullingTime="2.598774267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 03:52:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:52:39.404918998 +0000 UTC m=+262.717394899" watchObservedRunningTime="2026-09-07 03:52:39.406677968 +0000 UTC m=+262.719153881"
Sep 07 03:52:41.704590 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:41.704552    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af557ln"]
Sep 07 03:52:41.707945 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:41.707927    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af557ln"
Sep 07 03:52:41.710161 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:41.710134    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 07 03:52:41.710161 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:41.710147    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 07 03:52:41.710333 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:41.710269    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wzkt6\""
Sep 07 03:52:41.715487 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:41.715463    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af557ln"]
Sep 07 03:52:41.746991 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:41.746952    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f52f9a6a-305e-4baf-8cae-6c5d08d201ed-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af557ln\" (UID: \"f52f9a6a-305e-4baf-8cae-6c5d08d201ed\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af557ln"
Sep 07 03:52:41.747131 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:41.747014    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f52f9a6a-305e-4baf-8cae-6c5d08d201ed-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af557ln\" (UID: \"f52f9a6a-305e-4baf-8cae-6c5d08d201ed\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af557ln"
Sep 07 03:52:41.747131 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:41.747064    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpf45\" (UniqueName: \"kubernetes.io/projected/f52f9a6a-305e-4baf-8cae-6c5d08d201ed-kube-api-access-rpf45\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af557ln\" (UID: \"f52f9a6a-305e-4baf-8cae-6c5d08d201ed\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af557ln"
Sep 07 03:52:41.848012 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:41.847967    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f52f9a6a-305e-4baf-8cae-6c5d08d201ed-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af557ln\" (UID: \"f52f9a6a-305e-4baf-8cae-6c5d08d201ed\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af557ln"
Sep 07 03:52:41.848190 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:41.848109    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpf45\" (UniqueName: \"kubernetes.io/projected/f52f9a6a-305e-4baf-8cae-6c5d08d201ed-kube-api-access-rpf45\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af557ln\" (UID: \"f52f9a6a-305e-4baf-8cae-6c5d08d201ed\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af557ln"
Sep 07 03:52:41.848190 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:41.848148    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f52f9a6a-305e-4baf-8cae-6c5d08d201ed-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af557ln\" (UID: \"f52f9a6a-305e-4baf-8cae-6c5d08d201ed\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af557ln"
Sep 07 03:52:41.848444 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:41.848419    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f52f9a6a-305e-4baf-8cae-6c5d08d201ed-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af557ln\" (UID: \"f52f9a6a-305e-4baf-8cae-6c5d08d201ed\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af557ln"
Sep 07 03:52:41.848481 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:41.848432    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f52f9a6a-305e-4baf-8cae-6c5d08d201ed-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af557ln\" (UID: \"f52f9a6a-305e-4baf-8cae-6c5d08d201ed\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af557ln"
Sep 07 03:52:41.856155 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:41.856125    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpf45\" (UniqueName: \"kubernetes.io/projected/f52f9a6a-305e-4baf-8cae-6c5d08d201ed-kube-api-access-rpf45\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af557ln\" (UID: \"f52f9a6a-305e-4baf-8cae-6c5d08d201ed\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af557ln"
Sep 07 03:52:42.018316 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:42.018235    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af557ln"
Sep 07 03:52:42.293507 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:42.293483    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af557ln"]
Sep 07 03:52:42.295917 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:52:42.295889    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf52f9a6a_305e_4baf_8cae_6c5d08d201ed.slice/crio-303612c756e66dfdb3ee19aeb6e6a19dfd9daeadb34b34fe90180c81f115d24e WatchSource:0}: Error finding container 303612c756e66dfdb3ee19aeb6e6a19dfd9daeadb34b34fe90180c81f115d24e: Status 404 returned error can't find the container with id 303612c756e66dfdb3ee19aeb6e6a19dfd9daeadb34b34fe90180c81f115d24e
Sep 07 03:52:42.405873 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:42.405845    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af557ln" event={"ID":"f52f9a6a-305e-4baf-8cae-6c5d08d201ed","Type":"ContainerStarted","Data":"0f352c4983163f1e8b847710c8254da3d679b958e4ab81e893f7f8885835fc21"}
Sep 07 03:52:42.406145 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:42.405905    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af557ln" event={"ID":"f52f9a6a-305e-4baf-8cae-6c5d08d201ed","Type":"ContainerStarted","Data":"303612c756e66dfdb3ee19aeb6e6a19dfd9daeadb34b34fe90180c81f115d24e"}
Sep 07 03:52:43.411693 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:43.411661    2559 generic.go:356] "Generic (PLEG): container finished" podID="f52f9a6a-305e-4baf-8cae-6c5d08d201ed" containerID="0f352c4983163f1e8b847710c8254da3d679b958e4ab81e893f7f8885835fc21" exitCode=0
Sep 07 03:52:43.411693 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:43.411684    2559 generic.go:356] "Generic (PLEG): container finished" podID="f52f9a6a-305e-4baf-8cae-6c5d08d201ed" containerID="b528930b4d7053844a1da29cb8cb51e4d05918c9473c17676d16cd83635da60b" exitCode=0
Sep 07 03:52:43.412104 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:43.411718    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af557ln" event={"ID":"f52f9a6a-305e-4baf-8cae-6c5d08d201ed","Type":"ContainerDied","Data":"0f352c4983163f1e8b847710c8254da3d679b958e4ab81e893f7f8885835fc21"}
Sep 07 03:52:43.412104 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:43.411753    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af557ln" event={"ID":"f52f9a6a-305e-4baf-8cae-6c5d08d201ed","Type":"ContainerDied","Data":"b528930b4d7053844a1da29cb8cb51e4d05918c9473c17676d16cd83635da60b"}
Sep 07 03:52:44.423540 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:44.423502    2559 generic.go:356] "Generic (PLEG): container finished" podID="f52f9a6a-305e-4baf-8cae-6c5d08d201ed" containerID="9c4f17a12b32c865b8368304d5325e5cbedcef879df4b84ae21560f84ab03676" exitCode=0
Sep 07 03:52:44.423918 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:44.423587    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af557ln" event={"ID":"f52f9a6a-305e-4baf-8cae-6c5d08d201ed","Type":"ContainerDied","Data":"9c4f17a12b32c865b8368304d5325e5cbedcef879df4b84ae21560f84ab03676"}
Sep 07 03:52:45.547483 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:45.547460    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af557ln"
Sep 07 03:52:45.575676 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:45.575651    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rpf45\" (UniqueName: \"kubernetes.io/projected/f52f9a6a-305e-4baf-8cae-6c5d08d201ed-kube-api-access-rpf45\") pod \"f52f9a6a-305e-4baf-8cae-6c5d08d201ed\" (UID: \"f52f9a6a-305e-4baf-8cae-6c5d08d201ed\") "
Sep 07 03:52:45.575826 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:45.575691    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f52f9a6a-305e-4baf-8cae-6c5d08d201ed-bundle\") pod \"f52f9a6a-305e-4baf-8cae-6c5d08d201ed\" (UID: \"f52f9a6a-305e-4baf-8cae-6c5d08d201ed\") "
Sep 07 03:52:45.575826 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:45.575712    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f52f9a6a-305e-4baf-8cae-6c5d08d201ed-util\") pod \"f52f9a6a-305e-4baf-8cae-6c5d08d201ed\" (UID: \"f52f9a6a-305e-4baf-8cae-6c5d08d201ed\") "
Sep 07 03:52:45.576386 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:45.576356    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f52f9a6a-305e-4baf-8cae-6c5d08d201ed-bundle" (OuterVolumeSpecName: "bundle") pod "f52f9a6a-305e-4baf-8cae-6c5d08d201ed" (UID: "f52f9a6a-305e-4baf-8cae-6c5d08d201ed"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 03:52:45.578031 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:45.577999    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f52f9a6a-305e-4baf-8cae-6c5d08d201ed-kube-api-access-rpf45" (OuterVolumeSpecName: "kube-api-access-rpf45") pod "f52f9a6a-305e-4baf-8cae-6c5d08d201ed" (UID: "f52f9a6a-305e-4baf-8cae-6c5d08d201ed"). InnerVolumeSpecName "kube-api-access-rpf45". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 03:52:45.581166 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:45.581133    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f52f9a6a-305e-4baf-8cae-6c5d08d201ed-util" (OuterVolumeSpecName: "util") pod "f52f9a6a-305e-4baf-8cae-6c5d08d201ed" (UID: "f52f9a6a-305e-4baf-8cae-6c5d08d201ed"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 03:52:45.676439 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:45.676404    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rpf45\" (UniqueName: \"kubernetes.io/projected/f52f9a6a-305e-4baf-8cae-6c5d08d201ed-kube-api-access-rpf45\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:52:45.676439 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:45.676437    2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f52f9a6a-305e-4baf-8cae-6c5d08d201ed-bundle\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:52:45.676439 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:45.676450    2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f52f9a6a-305e-4baf-8cae-6c5d08d201ed-util\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:52:46.434915 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:46.434872    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af557ln" event={"ID":"f52f9a6a-305e-4baf-8cae-6c5d08d201ed","Type":"ContainerDied","Data":"303612c756e66dfdb3ee19aeb6e6a19dfd9daeadb34b34fe90180c81f115d24e"}
Sep 07 03:52:46.434915 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:46.434908    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af557ln"
Sep 07 03:52:46.435130 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:46.434932    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="303612c756e66dfdb3ee19aeb6e6a19dfd9daeadb34b34fe90180c81f115d24e"
Sep 07 03:52:55.510371 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:55.510337    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0npffj"]
Sep 07 03:52:55.511046 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:55.510610    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f52f9a6a-305e-4baf-8cae-6c5d08d201ed" containerName="extract"
Sep 07 03:52:55.511046 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:55.510641    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f52f9a6a-305e-4baf-8cae-6c5d08d201ed" containerName="extract"
Sep 07 03:52:55.511046 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:55.510662    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f52f9a6a-305e-4baf-8cae-6c5d08d201ed" containerName="pull"
Sep 07 03:52:55.511046 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:55.510667    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f52f9a6a-305e-4baf-8cae-6c5d08d201ed" containerName="pull"
Sep 07 03:52:55.511046 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:55.510674    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f52f9a6a-305e-4baf-8cae-6c5d08d201ed" containerName="util"
Sep 07 03:52:55.511046 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:55.510679    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f52f9a6a-305e-4baf-8cae-6c5d08d201ed" containerName="util"
Sep 07 03:52:55.511046 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:55.510732    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f52f9a6a-305e-4baf-8cae-6c5d08d201ed" containerName="extract"
Sep 07 03:52:55.516236 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:55.516213    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0npffj"
Sep 07 03:52:55.518375 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:55.518351    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 07 03:52:55.518494 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:55.518400    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wzkt6\""
Sep 07 03:52:55.518494 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:55.518362    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 07 03:52:55.523604 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:55.523526    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0npffj"]
Sep 07 03:52:55.541080 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:55.541051    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb59v\" (UniqueName: \"kubernetes.io/projected/f8bfc1c6-b868-45a5-839d-14837ca9d905-kube-api-access-mb59v\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0npffj\" (UID: \"f8bfc1c6-b868-45a5-839d-14837ca9d905\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0npffj"
Sep 07 03:52:55.541234 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:55.541084    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8bfc1c6-b868-45a5-839d-14837ca9d905-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0npffj\" (UID: \"f8bfc1c6-b868-45a5-839d-14837ca9d905\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0npffj"
Sep 07 03:52:55.541234 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:55.541115    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8bfc1c6-b868-45a5-839d-14837ca9d905-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0npffj\" (UID: \"f8bfc1c6-b868-45a5-839d-14837ca9d905\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0npffj"
Sep 07 03:52:55.642318 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:55.642260    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mb59v\" (UniqueName: \"kubernetes.io/projected/f8bfc1c6-b868-45a5-839d-14837ca9d905-kube-api-access-mb59v\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0npffj\" (UID: \"f8bfc1c6-b868-45a5-839d-14837ca9d905\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0npffj"
Sep 07 03:52:55.642318 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:55.642324    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8bfc1c6-b868-45a5-839d-14837ca9d905-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0npffj\" (UID: \"f8bfc1c6-b868-45a5-839d-14837ca9d905\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0npffj"
Sep 07 03:52:55.642570 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:55.642364    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8bfc1c6-b868-45a5-839d-14837ca9d905-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0npffj\" (UID: \"f8bfc1c6-b868-45a5-839d-14837ca9d905\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0npffj"
Sep 07 03:52:55.642725 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:55.642703    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8bfc1c6-b868-45a5-839d-14837ca9d905-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0npffj\" (UID: \"f8bfc1c6-b868-45a5-839d-14837ca9d905\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0npffj"
Sep 07 03:52:55.642786 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:55.642713    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8bfc1c6-b868-45a5-839d-14837ca9d905-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0npffj\" (UID: \"f8bfc1c6-b868-45a5-839d-14837ca9d905\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0npffj"
Sep 07 03:52:55.653530 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:55.653502    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb59v\" (UniqueName: \"kubernetes.io/projected/f8bfc1c6-b868-45a5-839d-14837ca9d905-kube-api-access-mb59v\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0npffj\" (UID: \"f8bfc1c6-b868-45a5-839d-14837ca9d905\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0npffj"
Sep 07 03:52:55.826667 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:55.826551    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0npffj"
Sep 07 03:52:56.101401 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:56.101363    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0npffj"]
Sep 07 03:52:56.103175 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:52:56.103133    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8bfc1c6_b868_45a5_839d_14837ca9d905.slice/crio-24c6e933b0be82ab7a061f36329e6bb853837fdab096893170fa62be3fd3559a WatchSource:0}: Error finding container 24c6e933b0be82ab7a061f36329e6bb853837fdab096893170fa62be3fd3559a: Status 404 returned error can't find the container with id 24c6e933b0be82ab7a061f36329e6bb853837fdab096893170fa62be3fd3559a
Sep 07 03:52:56.482322 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:56.482284    2559 generic.go:356] "Generic (PLEG): container finished" podID="f8bfc1c6-b868-45a5-839d-14837ca9d905" containerID="f4f3a7a969d7bf57e8db661f34bff00aa781b6ecc94f50bbdbe7cf59e3cc9981" exitCode=0
Sep 07 03:52:56.482490 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:56.482376    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0npffj" event={"ID":"f8bfc1c6-b868-45a5-839d-14837ca9d905","Type":"ContainerDied","Data":"f4f3a7a969d7bf57e8db661f34bff00aa781b6ecc94f50bbdbe7cf59e3cc9981"}
Sep 07 03:52:56.482490 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:56.482431    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0npffj" event={"ID":"f8bfc1c6-b868-45a5-839d-14837ca9d905","Type":"ContainerStarted","Data":"24c6e933b0be82ab7a061f36329e6bb853837fdab096893170fa62be3fd3559a"}
Sep 07 03:52:56.640982 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:56.640946    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-756ff4ddd-tknv4"]
Sep 07 03:52:56.644511 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:56.644489    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-756ff4ddd-tknv4"
Sep 07 03:52:56.646737 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:56.646712    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 07 03:52:56.646885 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:56.646745    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 07 03:52:56.646885 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:56.646769    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 07 03:52:56.647499 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:56.647477    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 07 03:52:56.647641 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:56.647603    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7q6jm\""
Sep 07 03:52:56.650396 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:56.650377    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kts2c\" (UniqueName: \"kubernetes.io/projected/4c508801-72ba-4ba1-9db7-7e9a421fb6b5-kube-api-access-kts2c\") pod \"opendatahub-operator-controller-manager-756ff4ddd-tknv4\" (UID: \"4c508801-72ba-4ba1-9db7-7e9a421fb6b5\") " pod="opendatahub/opendatahub-operator-controller-manager-756ff4ddd-tknv4"
Sep 07 03:52:56.650486 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:56.650424    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4c508801-72ba-4ba1-9db7-7e9a421fb6b5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-756ff4ddd-tknv4\" (UID: \"4c508801-72ba-4ba1-9db7-7e9a421fb6b5\") " pod="opendatahub/opendatahub-operator-controller-manager-756ff4ddd-tknv4"
Sep 07 03:52:56.650486 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:56.650458    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c508801-72ba-4ba1-9db7-7e9a421fb6b5-tmp\") pod \"opendatahub-operator-controller-manager-756ff4ddd-tknv4\" (UID: \"4c508801-72ba-4ba1-9db7-7e9a421fb6b5\") " pod="opendatahub/opendatahub-operator-controller-manager-756ff4ddd-tknv4"
Sep 07 03:52:56.650577 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:56.650506    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4c508801-72ba-4ba1-9db7-7e9a421fb6b5-manifests\") pod \"opendatahub-operator-controller-manager-756ff4ddd-tknv4\" (UID: \"4c508801-72ba-4ba1-9db7-7e9a421fb6b5\") " pod="opendatahub/opendatahub-operator-controller-manager-756ff4ddd-tknv4"
Sep 07 03:52:56.650577 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:56.650529    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4c508801-72ba-4ba1-9db7-7e9a421fb6b5-webhook-cert\") pod \"opendatahub-operator-controller-manager-756ff4ddd-tknv4\" (UID: \"4c508801-72ba-4ba1-9db7-7e9a421fb6b5\") " pod="opendatahub/opendatahub-operator-controller-manager-756ff4ddd-tknv4"
Sep 07 03:52:56.661988 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:56.661966    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-756ff4ddd-tknv4"]
Sep 07 03:52:56.751564 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:56.751463    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4c508801-72ba-4ba1-9db7-7e9a421fb6b5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-756ff4ddd-tknv4\" (UID: \"4c508801-72ba-4ba1-9db7-7e9a421fb6b5\") " pod="opendatahub/opendatahub-operator-controller-manager-756ff4ddd-tknv4"
Sep 07 03:52:56.751564 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:56.751527    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c508801-72ba-4ba1-9db7-7e9a421fb6b5-tmp\") pod \"opendatahub-operator-controller-manager-756ff4ddd-tknv4\" (UID: \"4c508801-72ba-4ba1-9db7-7e9a421fb6b5\") " pod="opendatahub/opendatahub-operator-controller-manager-756ff4ddd-tknv4"
Sep 07 03:52:56.751564 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:56.751555    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4c508801-72ba-4ba1-9db7-7e9a421fb6b5-manifests\") pod \"opendatahub-operator-controller-manager-756ff4ddd-tknv4\" (UID: \"4c508801-72ba-4ba1-9db7-7e9a421fb6b5\") " pod="opendatahub/opendatahub-operator-controller-manager-756ff4ddd-tknv4"
Sep 07 03:52:56.751892 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:56.751576    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4c508801-72ba-4ba1-9db7-7e9a421fb6b5-webhook-cert\") pod \"opendatahub-operator-controller-manager-756ff4ddd-tknv4\" (UID: \"4c508801-72ba-4ba1-9db7-7e9a421fb6b5\") " pod="opendatahub/opendatahub-operator-controller-manager-756ff4ddd-tknv4"
Sep 07 03:52:56.751892 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:56.751647    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kts2c\" (UniqueName: \"kubernetes.io/projected/4c508801-72ba-4ba1-9db7-7e9a421fb6b5-kube-api-access-kts2c\") pod \"opendatahub-operator-controller-manager-756ff4ddd-tknv4\" (UID: \"4c508801-72ba-4ba1-9db7-7e9a421fb6b5\") " pod="opendatahub/opendatahub-operator-controller-manager-756ff4ddd-tknv4"
Sep 07 03:52:56.752045 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:56.752018    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4c508801-72ba-4ba1-9db7-7e9a421fb6b5-manifests\") pod \"opendatahub-operator-controller-manager-756ff4ddd-tknv4\" (UID: \"4c508801-72ba-4ba1-9db7-7e9a421fb6b5\") " pod="opendatahub/opendatahub-operator-controller-manager-756ff4ddd-tknv4"
Sep 07 03:52:56.753819 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:56.753797    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c508801-72ba-4ba1-9db7-7e9a421fb6b5-tmp\") pod \"opendatahub-operator-controller-manager-756ff4ddd-tknv4\" (UID: \"4c508801-72ba-4ba1-9db7-7e9a421fb6b5\") " pod="opendatahub/opendatahub-operator-controller-manager-756ff4ddd-tknv4"
Sep 07 03:52:56.754070 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:56.754049    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4c508801-72ba-4ba1-9db7-7e9a421fb6b5-webhook-cert\") pod \"opendatahub-operator-controller-manager-756ff4ddd-tknv4\" (UID: \"4c508801-72ba-4ba1-9db7-7e9a421fb6b5\") " pod="opendatahub/opendatahub-operator-controller-manager-756ff4ddd-tknv4"
Sep 07 03:52:56.754133 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:56.754094    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4c508801-72ba-4ba1-9db7-7e9a421fb6b5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-756ff4ddd-tknv4\" (UID: \"4c508801-72ba-4ba1-9db7-7e9a421fb6b5\") " pod="opendatahub/opendatahub-operator-controller-manager-756ff4ddd-tknv4"
Sep 07 03:52:56.759839 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:56.759818    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kts2c\" (UniqueName: \"kubernetes.io/projected/4c508801-72ba-4ba1-9db7-7e9a421fb6b5-kube-api-access-kts2c\") pod \"opendatahub-operator-controller-manager-756ff4ddd-tknv4\" (UID: \"4c508801-72ba-4ba1-9db7-7e9a421fb6b5\") " pod="opendatahub/opendatahub-operator-controller-manager-756ff4ddd-tknv4"
Sep 07 03:52:56.955526 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:56.955485    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-756ff4ddd-tknv4"
Sep 07 03:52:57.267508 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:57.267440    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-756ff4ddd-tknv4"]
Sep 07 03:52:57.270212 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:52:57.270186    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c508801_72ba_4ba1_9db7_7e9a421fb6b5.slice/crio-38d214528335f9bd5dcceafdebf8f9a4f5dcee559f71178222f9b1e646704a8e WatchSource:0}: Error finding container 38d214528335f9bd5dcceafdebf8f9a4f5dcee559f71178222f9b1e646704a8e: Status 404 returned error can't find the container with id 38d214528335f9bd5dcceafdebf8f9a4f5dcee559f71178222f9b1e646704a8e
Sep 07 03:52:57.487818 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:57.487778    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-756ff4ddd-tknv4" event={"ID":"4c508801-72ba-4ba1-9db7-7e9a421fb6b5","Type":"ContainerStarted","Data":"38d214528335f9bd5dcceafdebf8f9a4f5dcee559f71178222f9b1e646704a8e"}
Sep 07 03:52:57.489679 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:57.489647    2559 generic.go:356] "Generic (PLEG): container finished" podID="f8bfc1c6-b868-45a5-839d-14837ca9d905" containerID="82509ef39a5e2c5777f52ecb433c8a30268ee7e1e9f563a35f6eaca227f60230" exitCode=0
Sep 07 03:52:57.489797 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:57.489724    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0npffj" event={"ID":"f8bfc1c6-b868-45a5-839d-14837ca9d905","Type":"ContainerDied","Data":"82509ef39a5e2c5777f52ecb433c8a30268ee7e1e9f563a35f6eaca227f60230"}
Sep 07 03:52:58.498956 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:58.498916    2559 generic.go:356] "Generic (PLEG): container finished" podID="f8bfc1c6-b868-45a5-839d-14837ca9d905" containerID="fff41eec713d824334d50ce4c0f2962830cb35c3d12af9c1bd7eaa319e959127" exitCode=0
Sep 07 03:52:58.499415 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:52:58.499016    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0npffj" event={"ID":"f8bfc1c6-b868-45a5-839d-14837ca9d905","Type":"ContainerDied","Data":"fff41eec713d824334d50ce4c0f2962830cb35c3d12af9c1bd7eaa319e959127"}
Sep 07 03:53:00.196445 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:00.196416    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0npffj"
Sep 07 03:53:00.282088 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:00.282063    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mb59v\" (UniqueName: \"kubernetes.io/projected/f8bfc1c6-b868-45a5-839d-14837ca9d905-kube-api-access-mb59v\") pod \"f8bfc1c6-b868-45a5-839d-14837ca9d905\" (UID: \"f8bfc1c6-b868-45a5-839d-14837ca9d905\") "
Sep 07 03:53:00.282200 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:00.282096    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8bfc1c6-b868-45a5-839d-14837ca9d905-util\") pod \"f8bfc1c6-b868-45a5-839d-14837ca9d905\" (UID: \"f8bfc1c6-b868-45a5-839d-14837ca9d905\") "
Sep 07 03:53:00.282200 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:00.282187    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8bfc1c6-b868-45a5-839d-14837ca9d905-bundle\") pod \"f8bfc1c6-b868-45a5-839d-14837ca9d905\" (UID: \"f8bfc1c6-b868-45a5-839d-14837ca9d905\") "
Sep 07 03:53:00.282874 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:00.282844    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8bfc1c6-b868-45a5-839d-14837ca9d905-bundle" (OuterVolumeSpecName: "bundle") pod "f8bfc1c6-b868-45a5-839d-14837ca9d905" (UID: "f8bfc1c6-b868-45a5-839d-14837ca9d905"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 03:53:00.283941 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:00.283917    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8bfc1c6-b868-45a5-839d-14837ca9d905-kube-api-access-mb59v" (OuterVolumeSpecName: "kube-api-access-mb59v") pod "f8bfc1c6-b868-45a5-839d-14837ca9d905" (UID: "f8bfc1c6-b868-45a5-839d-14837ca9d905"). InnerVolumeSpecName "kube-api-access-mb59v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 03:53:00.287259 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:00.287220    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8bfc1c6-b868-45a5-839d-14837ca9d905-util" (OuterVolumeSpecName: "util") pod "f8bfc1c6-b868-45a5-839d-14837ca9d905" (UID: "f8bfc1c6-b868-45a5-839d-14837ca9d905"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 03:53:00.383451 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:00.383417    2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8bfc1c6-b868-45a5-839d-14837ca9d905-bundle\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:53:00.383451 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:00.383443    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mb59v\" (UniqueName: \"kubernetes.io/projected/f8bfc1c6-b868-45a5-839d-14837ca9d905-kube-api-access-mb59v\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:53:00.383451 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:00.383452    2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8bfc1c6-b868-45a5-839d-14837ca9d905-util\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:53:00.510928 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:00.510834    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-756ff4ddd-tknv4" event={"ID":"4c508801-72ba-4ba1-9db7-7e9a421fb6b5","Type":"ContainerStarted","Data":"d73aedfd5b2873770eaae137d1a11d81ee10972beeb574f3f70c3af8cc2e0167"}
Sep 07 03:53:00.512669 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:00.512644    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0npffj" event={"ID":"f8bfc1c6-b868-45a5-839d-14837ca9d905","Type":"ContainerDied","Data":"24c6e933b0be82ab7a061f36329e6bb853837fdab096893170fa62be3fd3559a"}
Sep 07 03:53:00.512780 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:00.512684    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="24c6e933b0be82ab7a061f36329e6bb853837fdab096893170fa62be3fd3559a"
Sep 07 03:53:00.512780 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:00.512650    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0npffj"
Sep 07 03:53:01.518638 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:01.518595    2559 generic.go:356] "Generic (PLEG): container finished" podID="4c508801-72ba-4ba1-9db7-7e9a421fb6b5" containerID="d73aedfd5b2873770eaae137d1a11d81ee10972beeb574f3f70c3af8cc2e0167" exitCode=0
Sep 07 03:53:01.519015 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:01.518652    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-756ff4ddd-tknv4" event={"ID":"4c508801-72ba-4ba1-9db7-7e9a421fb6b5","Type":"ContainerDied","Data":"d73aedfd5b2873770eaae137d1a11d81ee10972beeb574f3f70c3af8cc2e0167"}
Sep 07 03:53:02.525246 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:02.525207    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-756ff4ddd-tknv4" event={"ID":"4c508801-72ba-4ba1-9db7-7e9a421fb6b5","Type":"ContainerStarted","Data":"7e25665c0e3e32542f03dbddbe23676c6636da1f1cd00836e46e0013e7daa54b"}
Sep 07 03:53:02.525670 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:02.525374    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-756ff4ddd-tknv4"
Sep 07 03:53:02.550651 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:02.550577    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-756ff4ddd-tknv4" podStartSLOduration=2.17577691 podStartE2EDuration="6.550558235s" totalImagesPullingTime="3.327349559s" totalInitContainerRuntime="1.047431766s" isStatefulPod=false podCreationTimestamp="2026-09-07 03:52:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:53:02.549039923 +0000 UTC m=+285.861515837" watchObservedRunningTime="2026-09-07 03:53:02.550558235 +0000 UTC m=+285.863034139"
Sep 07 03:53:13.531046 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:13.531011    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-756ff4ddd-tknv4"
Sep 07 03:53:14.687841 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:14.687811    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-758b7d97c6-z8pc2"]
Sep 07 03:53:14.688216 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:14.688084    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8bfc1c6-b868-45a5-839d-14837ca9d905" containerName="util"
Sep 07 03:53:14.688216 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:14.688095    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8bfc1c6-b868-45a5-839d-14837ca9d905" containerName="util"
Sep 07 03:53:14.688216 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:14.688113    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8bfc1c6-b868-45a5-839d-14837ca9d905" containerName="pull"
Sep 07 03:53:14.688216 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:14.688118    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8bfc1c6-b868-45a5-839d-14837ca9d905" containerName="pull"
Sep 07 03:53:14.688216 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:14.688129    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8bfc1c6-b868-45a5-839d-14837ca9d905" containerName="extract"
Sep 07 03:53:14.688216 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:14.688134    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8bfc1c6-b868-45a5-839d-14837ca9d905" containerName="extract"
Sep 07 03:53:14.688216 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:14.688184    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8bfc1c6-b868-45a5-839d-14837ca9d905" containerName="extract"
Sep 07 03:53:14.692322 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:14.692306    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-758b7d97c6-z8pc2"
Sep 07 03:53:14.694292 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:14.694268    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 07 03:53:14.694899 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:14.694871    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 07 03:53:14.695013 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:14.694932    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-df89q\""
Sep 07 03:53:14.695013 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:14.694931    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 07 03:53:14.700847 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:14.700822    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-758b7d97c6-z8pc2"]
Sep 07 03:53:14.809262 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:14.809227    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/be5b5614-68b9-4aca-ae45-26f7c73403a0-metrics-cert\") pod \"lws-controller-manager-758b7d97c6-z8pc2\" (UID: \"be5b5614-68b9-4aca-ae45-26f7c73403a0\") " pod="openshift-lws-operator/lws-controller-manager-758b7d97c6-z8pc2"
Sep 07 03:53:14.809438 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:14.809275    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be5b5614-68b9-4aca-ae45-26f7c73403a0-cert\") pod \"lws-controller-manager-758b7d97c6-z8pc2\" (UID: \"be5b5614-68b9-4aca-ae45-26f7c73403a0\") " pod="openshift-lws-operator/lws-controller-manager-758b7d97c6-z8pc2"
Sep 07 03:53:14.809438 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:14.809294    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2ffj\" (UniqueName: \"kubernetes.io/projected/be5b5614-68b9-4aca-ae45-26f7c73403a0-kube-api-access-l2ffj\") pod \"lws-controller-manager-758b7d97c6-z8pc2\" (UID: \"be5b5614-68b9-4aca-ae45-26f7c73403a0\") " pod="openshift-lws-operator/lws-controller-manager-758b7d97c6-z8pc2"
Sep 07 03:53:14.809438 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:14.809418    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/be5b5614-68b9-4aca-ae45-26f7c73403a0-manager-config\") pod \"lws-controller-manager-758b7d97c6-z8pc2\" (UID: \"be5b5614-68b9-4aca-ae45-26f7c73403a0\") " pod="openshift-lws-operator/lws-controller-manager-758b7d97c6-z8pc2"
Sep 07 03:53:14.910051 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:14.910011    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/be5b5614-68b9-4aca-ae45-26f7c73403a0-manager-config\") pod \"lws-controller-manager-758b7d97c6-z8pc2\" (UID: \"be5b5614-68b9-4aca-ae45-26f7c73403a0\") " pod="openshift-lws-operator/lws-controller-manager-758b7d97c6-z8pc2"
Sep 07 03:53:14.910254 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:14.910077    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/be5b5614-68b9-4aca-ae45-26f7c73403a0-metrics-cert\") pod \"lws-controller-manager-758b7d97c6-z8pc2\" (UID: \"be5b5614-68b9-4aca-ae45-26f7c73403a0\") " pod="openshift-lws-operator/lws-controller-manager-758b7d97c6-z8pc2"
Sep 07 03:53:14.910254 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:14.910104    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be5b5614-68b9-4aca-ae45-26f7c73403a0-cert\") pod \"lws-controller-manager-758b7d97c6-z8pc2\" (UID: \"be5b5614-68b9-4aca-ae45-26f7c73403a0\") " pod="openshift-lws-operator/lws-controller-manager-758b7d97c6-z8pc2"
Sep 07 03:53:14.910254 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:14.910120    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2ffj\" (UniqueName: \"kubernetes.io/projected/be5b5614-68b9-4aca-ae45-26f7c73403a0-kube-api-access-l2ffj\") pod \"lws-controller-manager-758b7d97c6-z8pc2\" (UID: \"be5b5614-68b9-4aca-ae45-26f7c73403a0\") " pod="openshift-lws-operator/lws-controller-manager-758b7d97c6-z8pc2"
Sep 07 03:53:14.910851 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:14.910827    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/be5b5614-68b9-4aca-ae45-26f7c73403a0-manager-config\") pod \"lws-controller-manager-758b7d97c6-z8pc2\" (UID: \"be5b5614-68b9-4aca-ae45-26f7c73403a0\") " pod="openshift-lws-operator/lws-controller-manager-758b7d97c6-z8pc2"
Sep 07 03:53:14.912594 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:14.912565    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be5b5614-68b9-4aca-ae45-26f7c73403a0-cert\") pod \"lws-controller-manager-758b7d97c6-z8pc2\" (UID: \"be5b5614-68b9-4aca-ae45-26f7c73403a0\") " pod="openshift-lws-operator/lws-controller-manager-758b7d97c6-z8pc2"
Sep 07 03:53:14.912912 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:14.912888    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/be5b5614-68b9-4aca-ae45-26f7c73403a0-metrics-cert\") pod \"lws-controller-manager-758b7d97c6-z8pc2\" (UID: \"be5b5614-68b9-4aca-ae45-26f7c73403a0\") " pod="openshift-lws-operator/lws-controller-manager-758b7d97c6-z8pc2"
Sep 07 03:53:14.922219 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:14.922196    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2ffj\" (UniqueName: \"kubernetes.io/projected/be5b5614-68b9-4aca-ae45-26f7c73403a0-kube-api-access-l2ffj\") pod \"lws-controller-manager-758b7d97c6-z8pc2\" (UID: \"be5b5614-68b9-4aca-ae45-26f7c73403a0\") " pod="openshift-lws-operator/lws-controller-manager-758b7d97c6-z8pc2"
Sep 07 03:53:15.002472 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:15.002388    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-758b7d97c6-z8pc2"
Sep 07 03:53:15.283811 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:15.283782    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-758b7d97c6-z8pc2"]
Sep 07 03:53:15.286184 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:53:15.286155    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe5b5614_68b9_4aca_ae45_26f7c73403a0.slice/crio-b3119caee5a7a6ddb65d92c79086bc0a03a3be3c4cfda5edf9f70c415a6b3370 WatchSource:0}: Error finding container b3119caee5a7a6ddb65d92c79086bc0a03a3be3c4cfda5edf9f70c415a6b3370: Status 404 returned error can't find the container with id b3119caee5a7a6ddb65d92c79086bc0a03a3be3c4cfda5edf9f70c415a6b3370
Sep 07 03:53:15.583672 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:15.583567    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-758b7d97c6-z8pc2" event={"ID":"be5b5614-68b9-4aca-ae45-26f7c73403a0","Type":"ContainerStarted","Data":"b3119caee5a7a6ddb65d92c79086bc0a03a3be3c4cfda5edf9f70c415a6b3370"}
Sep 07 03:53:17.127522 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:17.127484    2559 kubelet.go:1648] "Image garbage collection succeeded"
Sep 07 03:53:17.595908 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:17.595807    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-758b7d97c6-z8pc2" event={"ID":"be5b5614-68b9-4aca-ae45-26f7c73403a0","Type":"ContainerStarted","Data":"5197817a7ebb879a74982779a1744f8b649e00cbc3543315ad062093f13da214"}
Sep 07 03:53:17.598001 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:17.595955    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-758b7d97c6-z8pc2"
Sep 07 03:53:17.612766 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:17.612718    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-758b7d97c6-z8pc2" podStartSLOduration=2.211192355 podStartE2EDuration="3.612704294s" totalImagesPullingTime="1.401511939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 03:53:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:53:17.612539099 +0000 UTC m=+300.925015003" watchObservedRunningTime="2026-09-07 03:53:17.612704294 +0000 UTC m=+300.925180195"
Sep 07 03:53:23.636385 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.633889    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg"]
Sep 07 03:53:23.638683 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.638658    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg"
Sep 07 03:53:23.642645 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.641251    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-qhgmn\""
Sep 07 03:53:23.642645 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.641687    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 07 03:53:23.642645 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.642138    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 07 03:53:23.642645 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.642369    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 07 03:53:23.648969 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.648942    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg"]
Sep 07 03:53:23.689985 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.689956    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl"]
Sep 07 03:53:23.693046 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.693029    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl"
Sep 07 03:53:23.706022 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.705997    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl"]
Sep 07 03:53:23.785995 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.785961    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d427b1d6-a9b3-443c-9b18-21626e945dea-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg\" (UID: \"d427b1d6-a9b3-443c-9b18-21626e945dea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg"
Sep 07 03:53:23.785995 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.786004    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d427b1d6-a9b3-443c-9b18-21626e945dea-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg\" (UID: \"d427b1d6-a9b3-443c-9b18-21626e945dea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg"
Sep 07 03:53:23.786213 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.786024    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d427b1d6-a9b3-443c-9b18-21626e945dea-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg\" (UID: \"d427b1d6-a9b3-443c-9b18-21626e945dea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg"
Sep 07 03:53:23.786213 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.786054    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d427b1d6-a9b3-443c-9b18-21626e945dea-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg\" (UID: \"d427b1d6-a9b3-443c-9b18-21626e945dea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg"
Sep 07 03:53:23.786213 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.786117    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59e537f6-23ed-4c64-9797-b1a466d933a8-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl\" (UID: \"59e537f6-23ed-4c64-9797-b1a466d933a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl"
Sep 07 03:53:23.786213 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.786157    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d427b1d6-a9b3-443c-9b18-21626e945dea-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg\" (UID: \"d427b1d6-a9b3-443c-9b18-21626e945dea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg"
Sep 07 03:53:23.786213 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.786199    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d427b1d6-a9b3-443c-9b18-21626e945dea-istio-token\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg\" (UID: \"d427b1d6-a9b3-443c-9b18-21626e945dea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg"
Sep 07 03:53:23.786368 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.786228    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59e537f6-23ed-4c64-9797-b1a466d933a8-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl\" (UID: \"59e537f6-23ed-4c64-9797-b1a466d933a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl"
Sep 07 03:53:23.786368 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.786260    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbpb8\" (UniqueName: \"kubernetes.io/projected/59e537f6-23ed-4c64-9797-b1a466d933a8-kube-api-access-jbpb8\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl\" (UID: \"59e537f6-23ed-4c64-9797-b1a466d933a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl"
Sep 07 03:53:23.786368 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.786307    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d427b1d6-a9b3-443c-9b18-21626e945dea-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg\" (UID: \"d427b1d6-a9b3-443c-9b18-21626e945dea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg"
Sep 07 03:53:23.786368 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.786342    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d427b1d6-a9b3-443c-9b18-21626e945dea-istio-data\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg\" (UID: \"d427b1d6-a9b3-443c-9b18-21626e945dea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg"
Sep 07 03:53:23.786493 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.786368    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgmr8\" (UniqueName: \"kubernetes.io/projected/d427b1d6-a9b3-443c-9b18-21626e945dea-kube-api-access-mgmr8\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg\" (UID: \"d427b1d6-a9b3-443c-9b18-21626e945dea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg"
Sep 07 03:53:23.786493 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.786387    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59e537f6-23ed-4c64-9797-b1a466d933a8-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl\" (UID: \"59e537f6-23ed-4c64-9797-b1a466d933a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl"
Sep 07 03:53:23.786493 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.786440    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59e537f6-23ed-4c64-9797-b1a466d933a8-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl\" (UID: \"59e537f6-23ed-4c64-9797-b1a466d933a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl"
Sep 07 03:53:23.786493 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.786470    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59e537f6-23ed-4c64-9797-b1a466d933a8-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl\" (UID: \"59e537f6-23ed-4c64-9797-b1a466d933a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl"
Sep 07 03:53:23.786613 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.786497    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59e537f6-23ed-4c64-9797-b1a466d933a8-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl\" (UID: \"59e537f6-23ed-4c64-9797-b1a466d933a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl"
Sep 07 03:53:23.786613 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.786511    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59e537f6-23ed-4c64-9797-b1a466d933a8-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl\" (UID: \"59e537f6-23ed-4c64-9797-b1a466d933a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl"
Sep 07 03:53:23.786613 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.786529    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59e537f6-23ed-4c64-9797-b1a466d933a8-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl\" (UID: \"59e537f6-23ed-4c64-9797-b1a466d933a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl"
Sep 07 03:53:23.887320 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.887232    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59e537f6-23ed-4c64-9797-b1a466d933a8-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl\" (UID: \"59e537f6-23ed-4c64-9797-b1a466d933a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl"
Sep 07 03:53:23.887320 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.887278    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbpb8\" (UniqueName: \"kubernetes.io/projected/59e537f6-23ed-4c64-9797-b1a466d933a8-kube-api-access-jbpb8\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl\" (UID: \"59e537f6-23ed-4c64-9797-b1a466d933a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl"
Sep 07 03:53:23.887320 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.887300    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d427b1d6-a9b3-443c-9b18-21626e945dea-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg\" (UID: \"d427b1d6-a9b3-443c-9b18-21626e945dea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg"
Sep 07 03:53:23.887320 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.887323    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d427b1d6-a9b3-443c-9b18-21626e945dea-istio-data\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg\" (UID: \"d427b1d6-a9b3-443c-9b18-21626e945dea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg"
Sep 07 03:53:23.887676 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.887451    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgmr8\" (UniqueName: \"kubernetes.io/projected/d427b1d6-a9b3-443c-9b18-21626e945dea-kube-api-access-mgmr8\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg\" (UID: \"d427b1d6-a9b3-443c-9b18-21626e945dea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg"
Sep 07 03:53:23.887676 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.887501    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59e537f6-23ed-4c64-9797-b1a466d933a8-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl\" (UID: \"59e537f6-23ed-4c64-9797-b1a466d933a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl"
Sep 07 03:53:23.887676 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.887561    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59e537f6-23ed-4c64-9797-b1a466d933a8-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl\" (UID: \"59e537f6-23ed-4c64-9797-b1a466d933a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl"
Sep 07 03:53:23.887676 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.887592    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59e537f6-23ed-4c64-9797-b1a466d933a8-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl\" (UID: \"59e537f6-23ed-4c64-9797-b1a466d933a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl"
Sep 07 03:53:23.887676 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.887638    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59e537f6-23ed-4c64-9797-b1a466d933a8-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl\" (UID: \"59e537f6-23ed-4c64-9797-b1a466d933a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl"
Sep 07 03:53:23.887676 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.887661    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59e537f6-23ed-4c64-9797-b1a466d933a8-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl\" (UID: \"59e537f6-23ed-4c64-9797-b1a466d933a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl"
Sep 07 03:53:23.887982 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.887688    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59e537f6-23ed-4c64-9797-b1a466d933a8-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl\" (UID: \"59e537f6-23ed-4c64-9797-b1a466d933a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl"
Sep 07 03:53:23.887982 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.887721    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d427b1d6-a9b3-443c-9b18-21626e945dea-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg\" (UID: \"d427b1d6-a9b3-443c-9b18-21626e945dea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg"
Sep 07 03:53:23.887982 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.887725    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d427b1d6-a9b3-443c-9b18-21626e945dea-istio-data\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg\" (UID: \"d427b1d6-a9b3-443c-9b18-21626e945dea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg"
Sep 07 03:53:23.887982 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.887789    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d427b1d6-a9b3-443c-9b18-21626e945dea-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg\" (UID: \"d427b1d6-a9b3-443c-9b18-21626e945dea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg"
Sep 07 03:53:23.887982 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.887828    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d427b1d6-a9b3-443c-9b18-21626e945dea-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg\" (UID: \"d427b1d6-a9b3-443c-9b18-21626e945dea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg"
Sep 07 03:53:23.887982 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.887866    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d427b1d6-a9b3-443c-9b18-21626e945dea-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg\" (UID: \"d427b1d6-a9b3-443c-9b18-21626e945dea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg"
Sep 07 03:53:23.887982 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.887790    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d427b1d6-a9b3-443c-9b18-21626e945dea-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg\" (UID: \"d427b1d6-a9b3-443c-9b18-21626e945dea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg"
Sep 07 03:53:23.887982 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.887900    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59e537f6-23ed-4c64-9797-b1a466d933a8-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl\" (UID: \"59e537f6-23ed-4c64-9797-b1a466d933a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl"
Sep 07 03:53:23.887982 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.887936    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d427b1d6-a9b3-443c-9b18-21626e945dea-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg\" (UID: \"d427b1d6-a9b3-443c-9b18-21626e945dea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg"
Sep 07 03:53:23.887982 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.887972    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d427b1d6-a9b3-443c-9b18-21626e945dea-istio-token\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg\" (UID: \"d427b1d6-a9b3-443c-9b18-21626e945dea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg"
Sep 07 03:53:23.888496 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.888010    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d427b1d6-a9b3-443c-9b18-21626e945dea-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg\" (UID: \"d427b1d6-a9b3-443c-9b18-21626e945dea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg"
Sep 07 03:53:23.888496 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.888085    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59e537f6-23ed-4c64-9797-b1a466d933a8-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl\" (UID: \"59e537f6-23ed-4c64-9797-b1a466d933a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl"
Sep 07 03:53:23.888496 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.888268    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59e537f6-23ed-4c64-9797-b1a466d933a8-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl\" (UID: \"59e537f6-23ed-4c64-9797-b1a466d933a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl"
Sep 07 03:53:23.888496 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.888328    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59e537f6-23ed-4c64-9797-b1a466d933a8-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl\" (UID: \"59e537f6-23ed-4c64-9797-b1a466d933a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl"
Sep 07 03:53:23.888496 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.888477    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59e537f6-23ed-4c64-9797-b1a466d933a8-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl\" (UID: \"59e537f6-23ed-4c64-9797-b1a466d933a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl"
Sep 07 03:53:23.888776 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.888536    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d427b1d6-a9b3-443c-9b18-21626e945dea-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg\" (UID: \"d427b1d6-a9b3-443c-9b18-21626e945dea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg"
Sep 07 03:53:23.888776 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.888735    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59e537f6-23ed-4c64-9797-b1a466d933a8-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl\" (UID: \"59e537f6-23ed-4c64-9797-b1a466d933a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl"
Sep 07 03:53:23.888964 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.888945    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d427b1d6-a9b3-443c-9b18-21626e945dea-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg\" (UID: \"d427b1d6-a9b3-443c-9b18-21626e945dea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg"
Sep 07 03:53:23.890211 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.890183    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59e537f6-23ed-4c64-9797-b1a466d933a8-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl\" (UID: \"59e537f6-23ed-4c64-9797-b1a466d933a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl"
Sep 07 03:53:23.890371 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.890355    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d427b1d6-a9b3-443c-9b18-21626e945dea-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg\" (UID: \"d427b1d6-a9b3-443c-9b18-21626e945dea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg"
Sep 07 03:53:23.890431 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.890376    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59e537f6-23ed-4c64-9797-b1a466d933a8-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl\" (UID: \"59e537f6-23ed-4c64-9797-b1a466d933a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl"
Sep 07 03:53:23.890431 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.890376    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d427b1d6-a9b3-443c-9b18-21626e945dea-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg\" (UID: \"d427b1d6-a9b3-443c-9b18-21626e945dea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg"
Sep 07 03:53:23.895305 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.895273    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59e537f6-23ed-4c64-9797-b1a466d933a8-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl\" (UID: \"59e537f6-23ed-4c64-9797-b1a466d933a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl"
Sep 07 03:53:23.895576 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.895556    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbpb8\" (UniqueName: \"kubernetes.io/projected/59e537f6-23ed-4c64-9797-b1a466d933a8-kube-api-access-jbpb8\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl\" (UID: \"59e537f6-23ed-4c64-9797-b1a466d933a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl"
Sep 07 03:53:23.895816 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.895798    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgmr8\" (UniqueName: \"kubernetes.io/projected/d427b1d6-a9b3-443c-9b18-21626e945dea-kube-api-access-mgmr8\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg\" (UID: \"d427b1d6-a9b3-443c-9b18-21626e945dea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg"
Sep 07 03:53:23.895985 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.895967    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d427b1d6-a9b3-443c-9b18-21626e945dea-istio-token\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg\" (UID: \"d427b1d6-a9b3-443c-9b18-21626e945dea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg"
Sep 07 03:53:23.957143 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:23.957113    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg"
Sep 07 03:53:24.003822 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:24.003793    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl"
Sep 07 03:53:24.229894 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:24.229871    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg"]
Sep 07 03:53:24.231809 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:53:24.231780    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd427b1d6_a9b3_443c_9b18_21626e945dea.slice/crio-0ea3822ff72805820b7c1e114fc61d229631d8bfcfb2d683a6e1c6b5c7acbda5 WatchSource:0}: Error finding container 0ea3822ff72805820b7c1e114fc61d229631d8bfcfb2d683a6e1c6b5c7acbda5: Status 404 returned error can't find the container with id 0ea3822ff72805820b7c1e114fc61d229631d8bfcfb2d683a6e1c6b5c7acbda5
Sep 07 03:53:24.233804 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:24.233788    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 03:53:24.298603 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:24.298581    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl"]
Sep 07 03:53:24.299987 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:53:24.299960    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59e537f6_23ed_4c64_9797_b1a466d933a8.slice/crio-78b0cde4a41938cae890137a73e1f36d39b0045adddfe6a3097a63e60e371631 WatchSource:0}: Error finding container 78b0cde4a41938cae890137a73e1f36d39b0045adddfe6a3097a63e60e371631: Status 404 returned error can't find the container with id 78b0cde4a41938cae890137a73e1f36d39b0045adddfe6a3097a63e60e371631
Sep 07 03:53:24.631363 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:24.631320    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl" event={"ID":"59e537f6-23ed-4c64-9797-b1a466d933a8","Type":"ContainerStarted","Data":"78b0cde4a41938cae890137a73e1f36d39b0045adddfe6a3097a63e60e371631"}
Sep 07 03:53:24.632482 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:24.632458    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg" event={"ID":"d427b1d6-a9b3-443c-9b18-21626e945dea","Type":"ContainerStarted","Data":"0ea3822ff72805820b7c1e114fc61d229631d8bfcfb2d683a6e1c6b5c7acbda5"}
Sep 07 03:53:26.919122 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:26.919081    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 03:53:26.919418 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:26.919155    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 03:53:26.919418 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:26.919182    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 03:53:26.924745 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:26.924719    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 03:53:26.924829 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:26.924778    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 03:53:26.924829 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:26.924808    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 03:53:27.042632 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:27.042574    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-ldp27"]
Sep 07 03:53:27.046223 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:27.046196    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-ldp27"
Sep 07 03:53:27.048588 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:27.048388    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 07 03:53:27.048588 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:27.048475    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-z8pfg\""
Sep 07 03:53:27.061966 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:27.060449    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-ldp27"]
Sep 07 03:53:27.118945 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:27.118903    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmw92\" (UniqueName: \"kubernetes.io/projected/bdbe4393-0cc2-4304-a9ec-77cfccee1a6c-kube-api-access-qmw92\") pod \"odh-model-controller-7998c67dc4-ldp27\" (UID: \"bdbe4393-0cc2-4304-a9ec-77cfccee1a6c\") " pod="opendatahub/odh-model-controller-7998c67dc4-ldp27"
Sep 07 03:53:27.119125 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:27.119097    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bdbe4393-0cc2-4304-a9ec-77cfccee1a6c-cert\") pod \"odh-model-controller-7998c67dc4-ldp27\" (UID: \"bdbe4393-0cc2-4304-a9ec-77cfccee1a6c\") " pod="opendatahub/odh-model-controller-7998c67dc4-ldp27"
Sep 07 03:53:27.220315 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:27.220237    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmw92\" (UniqueName: \"kubernetes.io/projected/bdbe4393-0cc2-4304-a9ec-77cfccee1a6c-kube-api-access-qmw92\") pod \"odh-model-controller-7998c67dc4-ldp27\" (UID: \"bdbe4393-0cc2-4304-a9ec-77cfccee1a6c\") " pod="opendatahub/odh-model-controller-7998c67dc4-ldp27"
Sep 07 03:53:27.220315 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:27.220287    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bdbe4393-0cc2-4304-a9ec-77cfccee1a6c-cert\") pod \"odh-model-controller-7998c67dc4-ldp27\" (UID: \"bdbe4393-0cc2-4304-a9ec-77cfccee1a6c\") " pod="opendatahub/odh-model-controller-7998c67dc4-ldp27"
Sep 07 03:53:27.220502 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:53:27.220390    2559 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 07 03:53:27.220502 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:53:27.220449    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdbe4393-0cc2-4304-a9ec-77cfccee1a6c-cert podName:bdbe4393-0cc2-4304-a9ec-77cfccee1a6c nodeName:}" failed. No retries permitted until 2026-09-07 03:53:27.720431593 +0000 UTC m=+311.032907477 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bdbe4393-0cc2-4304-a9ec-77cfccee1a6c-cert") pod "odh-model-controller-7998c67dc4-ldp27" (UID: "bdbe4393-0cc2-4304-a9ec-77cfccee1a6c") : secret "odh-model-controller-webhook-cert" not found
Sep 07 03:53:27.228821 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:27.228788    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmw92\" (UniqueName: \"kubernetes.io/projected/bdbe4393-0cc2-4304-a9ec-77cfccee1a6c-kube-api-access-qmw92\") pod \"odh-model-controller-7998c67dc4-ldp27\" (UID: \"bdbe4393-0cc2-4304-a9ec-77cfccee1a6c\") " pod="opendatahub/odh-model-controller-7998c67dc4-ldp27"
Sep 07 03:53:27.654894 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:27.654861    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg" event={"ID":"d427b1d6-a9b3-443c-9b18-21626e945dea","Type":"ContainerStarted","Data":"a61f9a8abdf7405c736a7fb594ccfaa397b38f8c8aa96ef60794e14c00b7cf33"}
Sep 07 03:53:27.656885 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:27.656857    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl" event={"ID":"59e537f6-23ed-4c64-9797-b1a466d933a8","Type":"ContainerStarted","Data":"ee0f2cf3f6f5203551d08b96afd1e05c074447ec670f912e2e0a9aa2adb471e2"}
Sep 07 03:53:27.677992 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:27.677943    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg" podStartSLOduration=1.993005927 podStartE2EDuration="4.677928735s" totalImagesPullingTime="2.684922808s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 03:53:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:53:27.675396133 +0000 UTC m=+310.987872036" watchObservedRunningTime="2026-09-07 03:53:27.677928735 +0000 UTC m=+310.990404637"
Sep 07 03:53:27.681135 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:27.681110    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-72687"]
Sep 07 03:53:27.684565 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:27.684545    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-72687"
Sep 07 03:53:27.686513 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:27.686489    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 07 03:53:27.686638 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:27.686498    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-tgxlj\""
Sep 07 03:53:27.695077 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:27.695040    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-72687"]
Sep 07 03:53:27.696919 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:27.696879    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl" podStartSLOduration=2.074424508 podStartE2EDuration="4.696865951s" totalImagesPullingTime="2.622441443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 03:53:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:53:27.695516218 +0000 UTC m=+311.007992121" watchObservedRunningTime="2026-09-07 03:53:27.696865951 +0000 UTC m=+311.009341853"
Sep 07 03:53:27.725775 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:27.725741    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bdbe4393-0cc2-4304-a9ec-77cfccee1a6c-cert\") pod \"odh-model-controller-7998c67dc4-ldp27\" (UID: \"bdbe4393-0cc2-4304-a9ec-77cfccee1a6c\") " pod="opendatahub/odh-model-controller-7998c67dc4-ldp27"
Sep 07 03:53:27.728162 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:27.728139    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bdbe4393-0cc2-4304-a9ec-77cfccee1a6c-cert\") pod \"odh-model-controller-7998c67dc4-ldp27\" (UID: \"bdbe4393-0cc2-4304-a9ec-77cfccee1a6c\") " pod="opendatahub/odh-model-controller-7998c67dc4-ldp27"
Sep 07 03:53:27.826789 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:27.826757    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnc6b\" (UniqueName: \"kubernetes.io/projected/97edede6-2df4-4b84-a765-8f310bd79daa-kube-api-access-cnc6b\") pod \"model-serving-api-54d89bd5fc-72687\" (UID: \"97edede6-2df4-4b84-a765-8f310bd79daa\") " pod="opendatahub/model-serving-api-54d89bd5fc-72687"
Sep 07 03:53:27.826952 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:27.826824    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97edede6-2df4-4b84-a765-8f310bd79daa-tls-certs\") pod \"model-serving-api-54d89bd5fc-72687\" (UID: \"97edede6-2df4-4b84-a765-8f310bd79daa\") " pod="opendatahub/model-serving-api-54d89bd5fc-72687"
Sep 07 03:53:27.928112 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:27.928024    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnc6b\" (UniqueName: \"kubernetes.io/projected/97edede6-2df4-4b84-a765-8f310bd79daa-kube-api-access-cnc6b\") pod \"model-serving-api-54d89bd5fc-72687\" (UID: \"97edede6-2df4-4b84-a765-8f310bd79daa\") " pod="opendatahub/model-serving-api-54d89bd5fc-72687"
Sep 07 03:53:27.928112 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:27.928088    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97edede6-2df4-4b84-a765-8f310bd79daa-tls-certs\") pod \"model-serving-api-54d89bd5fc-72687\" (UID: \"97edede6-2df4-4b84-a765-8f310bd79daa\") " pod="opendatahub/model-serving-api-54d89bd5fc-72687"
Sep 07 03:53:27.930472 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:27.930445    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97edede6-2df4-4b84-a765-8f310bd79daa-tls-certs\") pod \"model-serving-api-54d89bd5fc-72687\" (UID: \"97edede6-2df4-4b84-a765-8f310bd79daa\") " pod="opendatahub/model-serving-api-54d89bd5fc-72687"
Sep 07 03:53:27.937093 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:27.937066    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnc6b\" (UniqueName: \"kubernetes.io/projected/97edede6-2df4-4b84-a765-8f310bd79daa-kube-api-access-cnc6b\") pod \"model-serving-api-54d89bd5fc-72687\" (UID: \"97edede6-2df4-4b84-a765-8f310bd79daa\") " pod="opendatahub/model-serving-api-54d89bd5fc-72687"
Sep 07 03:53:27.957549 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:27.957517    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg"
Sep 07 03:53:27.963504 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:27.963479    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-ldp27"
Sep 07 03:53:27.996146 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:27.996110    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-72687"
Sep 07 03:53:28.004376 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:28.004344    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl"
Sep 07 03:53:28.010922 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:28.010894    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl"
Sep 07 03:53:28.237425 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:28.237271    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-ldp27"]
Sep 07 03:53:28.239680 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:53:28.239647    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdbe4393_0cc2_4304_a9ec_77cfccee1a6c.slice/crio-c4035071831e43a7086e432e7e4537b142ac1c70885dcaee40400dae89420968 WatchSource:0}: Error finding container c4035071831e43a7086e432e7e4537b142ac1c70885dcaee40400dae89420968: Status 404 returned error can't find the container with id c4035071831e43a7086e432e7e4537b142ac1c70885dcaee40400dae89420968
Sep 07 03:53:28.278266 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:28.278231    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-72687"]
Sep 07 03:53:28.279503 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:53:28.279479    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97edede6_2df4_4b84_a765_8f310bd79daa.slice/crio-613a7e5a07f063f1bec6aeb5d75ee8f1de8f0cfc0ebe51fef0253c34558f4b61 WatchSource:0}: Error finding container 613a7e5a07f063f1bec6aeb5d75ee8f1de8f0cfc0ebe51fef0253c34558f4b61: Status 404 returned error can't find the container with id 613a7e5a07f063f1bec6aeb5d75ee8f1de8f0cfc0ebe51fef0253c34558f4b61
Sep 07 03:53:28.603778 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:28.603687    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-758b7d97c6-z8pc2"
Sep 07 03:53:28.673156 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:28.673120    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-ldp27" event={"ID":"bdbe4393-0cc2-4304-a9ec-77cfccee1a6c","Type":"ContainerStarted","Data":"c4035071831e43a7086e432e7e4537b142ac1c70885dcaee40400dae89420968"}
Sep 07 03:53:28.674809 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:28.674766    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-72687" event={"ID":"97edede6-2df4-4b84-a765-8f310bd79daa","Type":"ContainerStarted","Data":"613a7e5a07f063f1bec6aeb5d75ee8f1de8f0cfc0ebe51fef0253c34558f4b61"}
Sep 07 03:53:28.675071 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:28.675052    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl"
Sep 07 03:53:28.676136 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:28.676114    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl"
Sep 07 03:53:28.721164 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:28.721125    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg"]
Sep 07 03:53:28.959840 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:28.959802    2559 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Sep 07 03:53:28.960360 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:28.959870    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg" podUID="d427b1d6-a9b3-443c-9b18-21626e945dea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Sep 07 03:53:29.958017 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:29.957978    2559 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Sep 07 03:53:29.958206 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:29.958046    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg" podUID="d427b1d6-a9b3-443c-9b18-21626e945dea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Sep 07 03:53:30.690587 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:30.690411    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg" podUID="d427b1d6-a9b3-443c-9b18-21626e945dea" containerName="istio-proxy" containerID="cri-o://a61f9a8abdf7405c736a7fb594ccfaa397b38f8c8aa96ef60794e14c00b7cf33" gracePeriod=30
Sep 07 03:53:32.702671 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:32.702610    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-ldp27" event={"ID":"bdbe4393-0cc2-4304-a9ec-77cfccee1a6c","Type":"ContainerStarted","Data":"8216672adb237178a6f50040c1180c21f143c1c43476668f557e1162d71aa8ba"}
Sep 07 03:53:32.703150 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:32.702693    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-ldp27"
Sep 07 03:53:32.704108 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:32.704083    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-72687" event={"ID":"97edede6-2df4-4b84-a765-8f310bd79daa","Type":"ContainerStarted","Data":"924e122eceebc56ef6f35563632fd9c5792b6fed069b11a471bbcbe9e0d6f5f7"}
Sep 07 03:53:32.704213 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:32.704129    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-72687"
Sep 07 03:53:32.718989 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:32.718943    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-ldp27" podStartSLOduration=1.67965358 podStartE2EDuration="5.718926603s" totalImagesPullingTime="4.039273023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 03:53:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:53:32.717687551 +0000 UTC m=+316.030163453" watchObservedRunningTime="2026-09-07 03:53:32.718926603 +0000 UTC m=+316.031402506"
Sep 07 03:53:32.733387 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:32.733305    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-72687" podStartSLOduration=1.78664277 podStartE2EDuration="5.73328867s" totalImagesPullingTime="3.9466459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 03:53:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:53:32.733001727 +0000 UTC m=+316.045477640" watchObservedRunningTime="2026-09-07 03:53:32.73328867 +0000 UTC m=+316.045764582"
Sep 07 03:53:34.711302 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:34.711263    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-qppls"]
Sep 07 03:53:34.714742 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:34.714721    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qppls"
Sep 07 03:53:34.717106 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:34.717085    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 07 03:53:34.717339 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:34.717316    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 07 03:53:34.718165 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:34.718145    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-6sc2g\""
Sep 07 03:53:34.719662 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:34.719613    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 07 03:53:34.727681 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:34.727641    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-qppls"]
Sep 07 03:53:34.797040 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:34.797011    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0cf3c1d9-36ef-4334-a238-eb19395532c2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-qppls\" (UID: \"0cf3c1d9-36ef-4334-a238-eb19395532c2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qppls"
Sep 07 03:53:34.797212 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:34.797052    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0cf3c1d9-36ef-4334-a238-eb19395532c2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-qppls\" (UID: \"0cf3c1d9-36ef-4334-a238-eb19395532c2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qppls"
Sep 07 03:53:34.797212 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:34.797078    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0cf3c1d9-36ef-4334-a238-eb19395532c2-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-qppls\" (UID: \"0cf3c1d9-36ef-4334-a238-eb19395532c2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qppls"
Sep 07 03:53:34.797212 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:34.797100    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0cf3c1d9-36ef-4334-a238-eb19395532c2-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-qppls\" (UID: \"0cf3c1d9-36ef-4334-a238-eb19395532c2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qppls"
Sep 07 03:53:34.797349 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:34.797206    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0cf3c1d9-36ef-4334-a238-eb19395532c2-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-qppls\" (UID: \"0cf3c1d9-36ef-4334-a238-eb19395532c2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qppls"
Sep 07 03:53:34.797349 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:34.797237    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0cf3c1d9-36ef-4334-a238-eb19395532c2-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-qppls\" (UID: \"0cf3c1d9-36ef-4334-a238-eb19395532c2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qppls"
Sep 07 03:53:34.797349 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:34.797264    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5mkh\" (UniqueName: \"kubernetes.io/projected/0cf3c1d9-36ef-4334-a238-eb19395532c2-kube-api-access-h5mkh\") pod \"istiod-openshift-gateway-5677ccb49b-qppls\" (UID: \"0cf3c1d9-36ef-4334-a238-eb19395532c2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qppls"
Sep 07 03:53:34.898020 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:34.897988    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0cf3c1d9-36ef-4334-a238-eb19395532c2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-qppls\" (UID: \"0cf3c1d9-36ef-4334-a238-eb19395532c2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qppls"
Sep 07 03:53:34.898179 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:34.898026    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0cf3c1d9-36ef-4334-a238-eb19395532c2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-qppls\" (UID: \"0cf3c1d9-36ef-4334-a238-eb19395532c2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qppls"
Sep 07 03:53:34.898179 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:34.898051    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0cf3c1d9-36ef-4334-a238-eb19395532c2-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-qppls\" (UID: \"0cf3c1d9-36ef-4334-a238-eb19395532c2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qppls"
Sep 07 03:53:34.898179 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:34.898071    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0cf3c1d9-36ef-4334-a238-eb19395532c2-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-qppls\" (UID: \"0cf3c1d9-36ef-4334-a238-eb19395532c2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qppls"
Sep 07 03:53:34.898179 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:34.898116    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0cf3c1d9-36ef-4334-a238-eb19395532c2-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-qppls\" (UID: \"0cf3c1d9-36ef-4334-a238-eb19395532c2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qppls"
Sep 07 03:53:34.898179 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:34.898136    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0cf3c1d9-36ef-4334-a238-eb19395532c2-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-qppls\" (UID: \"0cf3c1d9-36ef-4334-a238-eb19395532c2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qppls"
Sep 07 03:53:34.898179 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:34.898155    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5mkh\" (UniqueName: \"kubernetes.io/projected/0cf3c1d9-36ef-4334-a238-eb19395532c2-kube-api-access-h5mkh\") pod \"istiod-openshift-gateway-5677ccb49b-qppls\" (UID: \"0cf3c1d9-36ef-4334-a238-eb19395532c2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qppls"
Sep 07 03:53:34.898948 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:34.898919    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0cf3c1d9-36ef-4334-a238-eb19395532c2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-qppls\" (UID: \"0cf3c1d9-36ef-4334-a238-eb19395532c2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qppls"
Sep 07 03:53:34.900591 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:34.900567    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0cf3c1d9-36ef-4334-a238-eb19395532c2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-qppls\" (UID: \"0cf3c1d9-36ef-4334-a238-eb19395532c2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qppls"
Sep 07 03:53:34.900728 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:34.900708    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0cf3c1d9-36ef-4334-a238-eb19395532c2-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-qppls\" (UID: \"0cf3c1d9-36ef-4334-a238-eb19395532c2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qppls"
Sep 07 03:53:34.900770 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:34.900745    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0cf3c1d9-36ef-4334-a238-eb19395532c2-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-qppls\" (UID: \"0cf3c1d9-36ef-4334-a238-eb19395532c2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qppls"
Sep 07 03:53:34.900812 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:34.900780    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0cf3c1d9-36ef-4334-a238-eb19395532c2-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-qppls\" (UID: \"0cf3c1d9-36ef-4334-a238-eb19395532c2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qppls"
Sep 07 03:53:34.920842 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:34.920815    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0cf3c1d9-36ef-4334-a238-eb19395532c2-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-qppls\" (UID: \"0cf3c1d9-36ef-4334-a238-eb19395532c2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qppls"
Sep 07 03:53:34.921211 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:34.921193    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5mkh\" (UniqueName: \"kubernetes.io/projected/0cf3c1d9-36ef-4334-a238-eb19395532c2-kube-api-access-h5mkh\") pod \"istiod-openshift-gateway-5677ccb49b-qppls\" (UID: \"0cf3c1d9-36ef-4334-a238-eb19395532c2\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qppls"
Sep 07 03:53:35.026343 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:35.026261    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qppls"
Sep 07 03:53:35.315795 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:35.315771    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-qppls"]
Sep 07 03:53:35.317146 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:53:35.317122    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cf3c1d9_36ef_4334_a238_eb19395532c2.slice/crio-dc68a4aafac545ca1f4d9f9ce738c122ddb577e4d1cc37b53c9e44468dae3944 WatchSource:0}: Error finding container dc68a4aafac545ca1f4d9f9ce738c122ddb577e4d1cc37b53c9e44468dae3944: Status 404 returned error can't find the container with id dc68a4aafac545ca1f4d9f9ce738c122ddb577e4d1cc37b53c9e44468dae3944
Sep 07 03:53:35.719000 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:35.718966    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qppls" event={"ID":"0cf3c1d9-36ef-4334-a238-eb19395532c2","Type":"ContainerStarted","Data":"dc68a4aafac545ca1f4d9f9ce738c122ddb577e4d1cc37b53c9e44468dae3944"}
Sep 07 03:53:35.942026 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:35.941998    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg"
Sep 07 03:53:36.109110 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:36.109076    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d427b1d6-a9b3-443c-9b18-21626e945dea-istio-token\") pod \"d427b1d6-a9b3-443c-9b18-21626e945dea\" (UID: \"d427b1d6-a9b3-443c-9b18-21626e945dea\") "
Sep 07 03:53:36.109273 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:36.109129    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d427b1d6-a9b3-443c-9b18-21626e945dea-istiod-ca-cert\") pod \"d427b1d6-a9b3-443c-9b18-21626e945dea\" (UID: \"d427b1d6-a9b3-443c-9b18-21626e945dea\") "
Sep 07 03:53:36.109273 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:36.109152    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d427b1d6-a9b3-443c-9b18-21626e945dea-workload-socket\") pod \"d427b1d6-a9b3-443c-9b18-21626e945dea\" (UID: \"d427b1d6-a9b3-443c-9b18-21626e945dea\") "
Sep 07 03:53:36.109273 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:36.109167    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d427b1d6-a9b3-443c-9b18-21626e945dea-istio-data\") pod \"d427b1d6-a9b3-443c-9b18-21626e945dea\" (UID: \"d427b1d6-a9b3-443c-9b18-21626e945dea\") "
Sep 07 03:53:36.109273 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:36.109192    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d427b1d6-a9b3-443c-9b18-21626e945dea-istio-envoy\") pod \"d427b1d6-a9b3-443c-9b18-21626e945dea\" (UID: \"d427b1d6-a9b3-443c-9b18-21626e945dea\") "
Sep 07 03:53:36.109451 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:36.109276    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d427b1d6-a9b3-443c-9b18-21626e945dea-istio-podinfo\") pod \"d427b1d6-a9b3-443c-9b18-21626e945dea\" (UID: \"d427b1d6-a9b3-443c-9b18-21626e945dea\") "
Sep 07 03:53:36.109451 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:36.109305    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mgmr8\" (UniqueName: \"kubernetes.io/projected/d427b1d6-a9b3-443c-9b18-21626e945dea-kube-api-access-mgmr8\") pod \"d427b1d6-a9b3-443c-9b18-21626e945dea\" (UID: \"d427b1d6-a9b3-443c-9b18-21626e945dea\") "
Sep 07 03:53:36.109451 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:36.109370    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d427b1d6-a9b3-443c-9b18-21626e945dea-credential-socket\") pod \"d427b1d6-a9b3-443c-9b18-21626e945dea\" (UID: \"d427b1d6-a9b3-443c-9b18-21626e945dea\") "
Sep 07 03:53:36.109451 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:36.109424    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d427b1d6-a9b3-443c-9b18-21626e945dea-workload-certs\") pod \"d427b1d6-a9b3-443c-9b18-21626e945dea\" (UID: \"d427b1d6-a9b3-443c-9b18-21626e945dea\") "
Sep 07 03:53:36.109683 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:36.109468    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d427b1d6-a9b3-443c-9b18-21626e945dea-istio-data" (OuterVolumeSpecName: "istio-data") pod "d427b1d6-a9b3-443c-9b18-21626e945dea" (UID: "d427b1d6-a9b3-443c-9b18-21626e945dea"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 03:53:36.109683 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:36.109506    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d427b1d6-a9b3-443c-9b18-21626e945dea-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d427b1d6-a9b3-443c-9b18-21626e945dea" (UID: "d427b1d6-a9b3-443c-9b18-21626e945dea"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 03:53:36.109816 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:36.109724    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d427b1d6-a9b3-443c-9b18-21626e945dea-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d427b1d6-a9b3-443c-9b18-21626e945dea" (UID: "d427b1d6-a9b3-443c-9b18-21626e945dea"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 03:53:36.109867 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:36.109814    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d427b1d6-a9b3-443c-9b18-21626e945dea-istiod-ca-cert\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:53:36.109867 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:36.109832    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d427b1d6-a9b3-443c-9b18-21626e945dea-workload-socket\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:53:36.109867 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:36.109847    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d427b1d6-a9b3-443c-9b18-21626e945dea-istio-data\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:53:36.110014 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:36.109865    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d427b1d6-a9b3-443c-9b18-21626e945dea-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d427b1d6-a9b3-443c-9b18-21626e945dea" (UID: "d427b1d6-a9b3-443c-9b18-21626e945dea"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 03:53:36.110014 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:36.109904    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d427b1d6-a9b3-443c-9b18-21626e945dea-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d427b1d6-a9b3-443c-9b18-21626e945dea" (UID: "d427b1d6-a9b3-443c-9b18-21626e945dea"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 03:53:36.111673 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:36.111641    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d427b1d6-a9b3-443c-9b18-21626e945dea-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d427b1d6-a9b3-443c-9b18-21626e945dea" (UID: "d427b1d6-a9b3-443c-9b18-21626e945dea"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 03:53:36.111801 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:36.111697    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d427b1d6-a9b3-443c-9b18-21626e945dea-kube-api-access-mgmr8" (OuterVolumeSpecName: "kube-api-access-mgmr8") pod "d427b1d6-a9b3-443c-9b18-21626e945dea" (UID: "d427b1d6-a9b3-443c-9b18-21626e945dea"). InnerVolumeSpecName "kube-api-access-mgmr8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 03:53:36.111801 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:36.111760    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d427b1d6-a9b3-443c-9b18-21626e945dea-istio-token" (OuterVolumeSpecName: "istio-token") pod "d427b1d6-a9b3-443c-9b18-21626e945dea" (UID: "d427b1d6-a9b3-443c-9b18-21626e945dea"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 03:53:36.111801 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:36.111775    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d427b1d6-a9b3-443c-9b18-21626e945dea-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d427b1d6-a9b3-443c-9b18-21626e945dea" (UID: "d427b1d6-a9b3-443c-9b18-21626e945dea"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 03:53:36.211037 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:36.211004    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d427b1d6-a9b3-443c-9b18-21626e945dea-workload-certs\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:53:36.211037 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:36.211033    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d427b1d6-a9b3-443c-9b18-21626e945dea-istio-token\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:53:36.211037 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:36.211041    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d427b1d6-a9b3-443c-9b18-21626e945dea-istio-envoy\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:53:36.211231 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:36.211050    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d427b1d6-a9b3-443c-9b18-21626e945dea-istio-podinfo\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:53:36.211231 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:36.211058    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mgmr8\" (UniqueName: \"kubernetes.io/projected/d427b1d6-a9b3-443c-9b18-21626e945dea-kube-api-access-mgmr8\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:53:36.211231 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:36.211067    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d427b1d6-a9b3-443c-9b18-21626e945dea-credential-socket\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:53:36.726280 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:36.726243    2559 generic.go:356] "Generic (PLEG): container finished" podID="d427b1d6-a9b3-443c-9b18-21626e945dea" containerID="a61f9a8abdf7405c736a7fb594ccfaa397b38f8c8aa96ef60794e14c00b7cf33" exitCode=0
Sep 07 03:53:36.726734 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:36.726291    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg"
Sep 07 03:53:36.726734 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:36.726320    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg" event={"ID":"d427b1d6-a9b3-443c-9b18-21626e945dea","Type":"ContainerDied","Data":"a61f9a8abdf7405c736a7fb594ccfaa397b38f8c8aa96ef60794e14c00b7cf33"}
Sep 07 03:53:36.726734 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:36.726380    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg" event={"ID":"d427b1d6-a9b3-443c-9b18-21626e945dea","Type":"ContainerDied","Data":"0ea3822ff72805820b7c1e114fc61d229631d8bfcfb2d683a6e1c6b5c7acbda5"}
Sep 07 03:53:36.726734 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:36.726413    2559 scope.go:117] "RemoveContainer" containerID="a61f9a8abdf7405c736a7fb594ccfaa397b38f8c8aa96ef60794e14c00b7cf33"
Sep 07 03:53:36.743242 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:36.743221    2559 scope.go:117] "RemoveContainer" containerID="a61f9a8abdf7405c736a7fb594ccfaa397b38f8c8aa96ef60794e14c00b7cf33"
Sep 07 03:53:36.743583 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:53:36.743555    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a61f9a8abdf7405c736a7fb594ccfaa397b38f8c8aa96ef60794e14c00b7cf33\": container with ID starting with a61f9a8abdf7405c736a7fb594ccfaa397b38f8c8aa96ef60794e14c00b7cf33 not found: ID does not exist" containerID="a61f9a8abdf7405c736a7fb594ccfaa397b38f8c8aa96ef60794e14c00b7cf33"
Sep 07 03:53:36.743780 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:36.743592    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a61f9a8abdf7405c736a7fb594ccfaa397b38f8c8aa96ef60794e14c00b7cf33"} err="failed to get container status \"a61f9a8abdf7405c736a7fb594ccfaa397b38f8c8aa96ef60794e14c00b7cf33\": rpc error: code = NotFound desc = could not find container \"a61f9a8abdf7405c736a7fb594ccfaa397b38f8c8aa96ef60794e14c00b7cf33\": container with ID starting with a61f9a8abdf7405c736a7fb594ccfaa397b38f8c8aa96ef60794e14c00b7cf33 not found: ID does not exist"
Sep 07 03:53:36.766352 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:36.766328    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg"]
Sep 07 03:53:36.777050 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:36.777026    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg"]
Sep 07 03:53:37.181141 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:37.181106    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d427b1d6-a9b3-443c-9b18-21626e945dea" path="/var/lib/kubelet/pods/d427b1d6-a9b3-443c-9b18-21626e945dea/volumes"
Sep 07 03:53:37.918128 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:37.918099    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 03:53:37.918395 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:37.918161    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 03:53:38.738080 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:38.738042    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qppls" event={"ID":"0cf3c1d9-36ef-4334-a238-eb19395532c2","Type":"ContainerStarted","Data":"a28b9d6c9e122b298f78cb891c9055b5679a05012649959cf8423d6360f17ad7"}
Sep 07 03:53:38.738275 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:38.738191    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qppls"
Sep 07 03:53:38.739774 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:38.739749    2559 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-qppls container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 07 03:53:38.739870 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:38.739799    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qppls" podUID="0cf3c1d9-36ef-4334-a238-eb19395532c2" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 07 03:53:38.792357 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:38.792308    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qppls" podStartSLOduration=2.193597507 podStartE2EDuration="4.792293129s" totalImagesPullingTime="2.598695622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 03:53:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:53:38.790703212 +0000 UTC m=+322.103179114" watchObservedRunningTime="2026-09-07 03:53:38.792293129 +0000 UTC m=+322.104769031"
Sep 07 03:53:39.743236 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:39.743206    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qppls"
Sep 07 03:53:43.711256 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:43.711223    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-ldp27"
Sep 07 03:53:43.713289 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:53:43.713267    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-72687"
Sep 07 03:54:31.234281 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.234247    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mxh57"]
Sep 07 03:54:31.234754 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.234579    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d427b1d6-a9b3-443c-9b18-21626e945dea" containerName="istio-proxy"
Sep 07 03:54:31.234754 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.234591    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d427b1d6-a9b3-443c-9b18-21626e945dea" containerName="istio-proxy"
Sep 07 03:54:31.234754 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.234666    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d427b1d6-a9b3-443c-9b18-21626e945dea" containerName="istio-proxy"
Sep 07 03:54:31.238963 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.238944    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mxh57"
Sep 07 03:54:31.241048 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.241026    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 07 03:54:31.241453 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.241418    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 07 03:54:31.241453 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.241425    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wzkt6\""
Sep 07 03:54:31.244879 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.244856    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mxh57"]
Sep 07 03:54:31.332365 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.332344    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ckjpp9"]
Sep 07 03:54:31.335568 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.335552    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ckjpp9"
Sep 07 03:54:31.346902 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.346881    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ckjpp9"]
Sep 07 03:54:31.362816 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.362794    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d68581d2-0c58-41c3-a36f-2945a3fc6faa-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mxh57\" (UID: \"d68581d2-0c58-41c3-a36f-2945a3fc6faa\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mxh57"
Sep 07 03:54:31.362918 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.362823    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f44s\" (UniqueName: \"kubernetes.io/projected/d68581d2-0c58-41c3-a36f-2945a3fc6faa-kube-api-access-6f44s\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mxh57\" (UID: \"d68581d2-0c58-41c3-a36f-2945a3fc6faa\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mxh57"
Sep 07 03:54:31.362918 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.362862    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d68581d2-0c58-41c3-a36f-2945a3fc6faa-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mxh57\" (UID: \"d68581d2-0c58-41c3-a36f-2945a3fc6faa\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mxh57"
Sep 07 03:54:31.431650 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.431607    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bhwtb"]
Sep 07 03:54:31.435016 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.434998    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bhwtb"
Sep 07 03:54:31.443737 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.443716    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bhwtb"]
Sep 07 03:54:31.464002 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.463977    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d68581d2-0c58-41c3-a36f-2945a3fc6faa-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mxh57\" (UID: \"d68581d2-0c58-41c3-a36f-2945a3fc6faa\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mxh57"
Sep 07 03:54:31.464092 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.464022    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2264e96e-08fb-4525-8f69-7c41561abe4d-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ckjpp9\" (UID: \"2264e96e-08fb-4525-8f69-7c41561abe4d\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ckjpp9"
Sep 07 03:54:31.464092 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.464045    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2264e96e-08fb-4525-8f69-7c41561abe4d-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ckjpp9\" (UID: \"2264e96e-08fb-4525-8f69-7c41561abe4d\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ckjpp9"
Sep 07 03:54:31.464166 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.464141    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d68581d2-0c58-41c3-a36f-2945a3fc6faa-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mxh57\" (UID: \"d68581d2-0c58-41c3-a36f-2945a3fc6faa\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mxh57"
Sep 07 03:54:31.464201 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.464175    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f44s\" (UniqueName: \"kubernetes.io/projected/d68581d2-0c58-41c3-a36f-2945a3fc6faa-kube-api-access-6f44s\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mxh57\" (UID: \"d68581d2-0c58-41c3-a36f-2945a3fc6faa\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mxh57"
Sep 07 03:54:31.464238 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.464219    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wlrp\" (UniqueName: \"kubernetes.io/projected/2264e96e-08fb-4525-8f69-7c41561abe4d-kube-api-access-2wlrp\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ckjpp9\" (UID: \"2264e96e-08fb-4525-8f69-7c41561abe4d\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ckjpp9"
Sep 07 03:54:31.464398 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.464380    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d68581d2-0c58-41c3-a36f-2945a3fc6faa-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mxh57\" (UID: \"d68581d2-0c58-41c3-a36f-2945a3fc6faa\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mxh57"
Sep 07 03:54:31.464434 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.464421    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d68581d2-0c58-41c3-a36f-2945a3fc6faa-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mxh57\" (UID: \"d68581d2-0c58-41c3-a36f-2945a3fc6faa\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mxh57"
Sep 07 03:54:31.472194 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.472170    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f44s\" (UniqueName: \"kubernetes.io/projected/d68581d2-0c58-41c3-a36f-2945a3fc6faa-kube-api-access-6f44s\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mxh57\" (UID: \"d68581d2-0c58-41c3-a36f-2945a3fc6faa\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mxh57"
Sep 07 03:54:31.545065 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.544994    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rj64"]
Sep 07 03:54:31.549972 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.549949    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mxh57"
Sep 07 03:54:31.550407 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.550386    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rj64"
Sep 07 03:54:31.556969 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.556948    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rj64"]
Sep 07 03:54:31.565198 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.564687    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcmrn\" (UniqueName: \"kubernetes.io/projected/bbc450aa-9925-4513-aa14-a54288317378-kube-api-access-pcmrn\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bhwtb\" (UID: \"bbc450aa-9925-4513-aa14-a54288317378\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bhwtb"
Sep 07 03:54:31.565198 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.564758    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wlrp\" (UniqueName: \"kubernetes.io/projected/2264e96e-08fb-4525-8f69-7c41561abe4d-kube-api-access-2wlrp\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ckjpp9\" (UID: \"2264e96e-08fb-4525-8f69-7c41561abe4d\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ckjpp9"
Sep 07 03:54:31.565198 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.564823    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bbc450aa-9925-4513-aa14-a54288317378-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bhwtb\" (UID: \"bbc450aa-9925-4513-aa14-a54288317378\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bhwtb"
Sep 07 03:54:31.565198 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.564862    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2264e96e-08fb-4525-8f69-7c41561abe4d-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ckjpp9\" (UID: \"2264e96e-08fb-4525-8f69-7c41561abe4d\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ckjpp9"
Sep 07 03:54:31.565198 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.564899    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bbc450aa-9925-4513-aa14-a54288317378-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bhwtb\" (UID: \"bbc450aa-9925-4513-aa14-a54288317378\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bhwtb"
Sep 07 03:54:31.565198 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.564924    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2264e96e-08fb-4525-8f69-7c41561abe4d-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ckjpp9\" (UID: \"2264e96e-08fb-4525-8f69-7c41561abe4d\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ckjpp9"
Sep 07 03:54:31.565641 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.565293    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2264e96e-08fb-4525-8f69-7c41561abe4d-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ckjpp9\" (UID: \"2264e96e-08fb-4525-8f69-7c41561abe4d\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ckjpp9"
Sep 07 03:54:31.565641 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.565538    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2264e96e-08fb-4525-8f69-7c41561abe4d-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ckjpp9\" (UID: \"2264e96e-08fb-4525-8f69-7c41561abe4d\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ckjpp9"
Sep 07 03:54:31.573064 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.573042    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wlrp\" (UniqueName: \"kubernetes.io/projected/2264e96e-08fb-4525-8f69-7c41561abe4d-kube-api-access-2wlrp\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ckjpp9\" (UID: \"2264e96e-08fb-4525-8f69-7c41561abe4d\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ckjpp9"
Sep 07 03:54:31.643964 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.643935    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ckjpp9"
Sep 07 03:54:31.665818 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.665785    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bbc450aa-9925-4513-aa14-a54288317378-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bhwtb\" (UID: \"bbc450aa-9925-4513-aa14-a54288317378\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bhwtb"
Sep 07 03:54:31.665926 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.665843    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ad0da4cf-3857-4499-87ce-e70f14f8b290-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rj64\" (UID: \"ad0da4cf-3857-4499-87ce-e70f14f8b290\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rj64"
Sep 07 03:54:31.665926 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.665883    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bbc450aa-9925-4513-aa14-a54288317378-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bhwtb\" (UID: \"bbc450aa-9925-4513-aa14-a54288317378\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bhwtb"
Sep 07 03:54:31.666018 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.665952    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dg5fq\" (UniqueName: \"kubernetes.io/projected/ad0da4cf-3857-4499-87ce-e70f14f8b290-kube-api-access-dg5fq\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rj64\" (UID: \"ad0da4cf-3857-4499-87ce-e70f14f8b290\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rj64"
Sep 07 03:54:31.666071 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.666012    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcmrn\" (UniqueName: \"kubernetes.io/projected/bbc450aa-9925-4513-aa14-a54288317378-kube-api-access-pcmrn\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bhwtb\" (UID: \"bbc450aa-9925-4513-aa14-a54288317378\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bhwtb"
Sep 07 03:54:31.666125 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.666077    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ad0da4cf-3857-4499-87ce-e70f14f8b290-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rj64\" (UID: \"ad0da4cf-3857-4499-87ce-e70f14f8b290\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rj64"
Sep 07 03:54:31.666276 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.666249    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bbc450aa-9925-4513-aa14-a54288317378-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bhwtb\" (UID: \"bbc450aa-9925-4513-aa14-a54288317378\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bhwtb"
Sep 07 03:54:31.666276 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.666269    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bbc450aa-9925-4513-aa14-a54288317378-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bhwtb\" (UID: \"bbc450aa-9925-4513-aa14-a54288317378\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bhwtb"
Sep 07 03:54:31.674602 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.674577    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcmrn\" (UniqueName: \"kubernetes.io/projected/bbc450aa-9925-4513-aa14-a54288317378-kube-api-access-pcmrn\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bhwtb\" (UID: \"bbc450aa-9925-4513-aa14-a54288317378\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bhwtb"
Sep 07 03:54:31.743976 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.743947    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bhwtb"
Sep 07 03:54:31.767428 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.767388    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ad0da4cf-3857-4499-87ce-e70f14f8b290-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rj64\" (UID: \"ad0da4cf-3857-4499-87ce-e70f14f8b290\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rj64"
Sep 07 03:54:31.767555 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.767461    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dg5fq\" (UniqueName: \"kubernetes.io/projected/ad0da4cf-3857-4499-87ce-e70f14f8b290-kube-api-access-dg5fq\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rj64\" (UID: \"ad0da4cf-3857-4499-87ce-e70f14f8b290\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rj64"
Sep 07 03:54:31.767555 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.767532    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ad0da4cf-3857-4499-87ce-e70f14f8b290-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rj64\" (UID: \"ad0da4cf-3857-4499-87ce-e70f14f8b290\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rj64"
Sep 07 03:54:31.767785 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.767763    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ad0da4cf-3857-4499-87ce-e70f14f8b290-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rj64\" (UID: \"ad0da4cf-3857-4499-87ce-e70f14f8b290\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rj64"
Sep 07 03:54:31.767897 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.767875    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ad0da4cf-3857-4499-87ce-e70f14f8b290-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rj64\" (UID: \"ad0da4cf-3857-4499-87ce-e70f14f8b290\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rj64"
Sep 07 03:54:31.776452 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.776423    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dg5fq\" (UniqueName: \"kubernetes.io/projected/ad0da4cf-3857-4499-87ce-e70f14f8b290-kube-api-access-dg5fq\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rj64\" (UID: \"ad0da4cf-3857-4499-87ce-e70f14f8b290\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rj64"
Sep 07 03:54:31.823110 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.823085    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mxh57"]
Sep 07 03:54:31.825116 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:54:31.825093    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd68581d2_0c58_41c3_a36f_2945a3fc6faa.slice/crio-46c77a22107d3088b75d3f2dcef6606b1d77381e27b5d6e5ad230c73827ad606 WatchSource:0}: Error finding container 46c77a22107d3088b75d3f2dcef6606b1d77381e27b5d6e5ad230c73827ad606: Status 404 returned error can't find the container with id 46c77a22107d3088b75d3f2dcef6606b1d77381e27b5d6e5ad230c73827ad606
Sep 07 03:54:31.881277 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.881255    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rj64"
Sep 07 03:54:31.922886 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:31.922857    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ckjpp9"]
Sep 07 03:54:31.924431 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:54:31.924388    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2264e96e_08fb_4525_8f69_7c41561abe4d.slice/crio-543f13890a56c97c8225186f137cfa8196a487179f3820e60b393e183ad8b95e WatchSource:0}: Error finding container 543f13890a56c97c8225186f137cfa8196a487179f3820e60b393e183ad8b95e: Status 404 returned error can't find the container with id 543f13890a56c97c8225186f137cfa8196a487179f3820e60b393e183ad8b95e
Sep 07 03:54:32.007209 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:32.007183    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ckjpp9" event={"ID":"2264e96e-08fb-4525-8f69-7c41561abe4d","Type":"ContainerStarted","Data":"543f13890a56c97c8225186f137cfa8196a487179f3820e60b393e183ad8b95e"}
Sep 07 03:54:32.008876 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:32.008842    2559 generic.go:356] "Generic (PLEG): container finished" podID="d68581d2-0c58-41c3-a36f-2945a3fc6faa" containerID="a8957423a1080c2cee31d88ec82ac9ad6ccba0ef9f495c8f98ef03c1b951078a" exitCode=0
Sep 07 03:54:32.008993 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:32.008891    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mxh57" event={"ID":"d68581d2-0c58-41c3-a36f-2945a3fc6faa","Type":"ContainerDied","Data":"a8957423a1080c2cee31d88ec82ac9ad6ccba0ef9f495c8f98ef03c1b951078a"}
Sep 07 03:54:32.008993 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:32.008938    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mxh57" event={"ID":"d68581d2-0c58-41c3-a36f-2945a3fc6faa","Type":"ContainerStarted","Data":"46c77a22107d3088b75d3f2dcef6606b1d77381e27b5d6e5ad230c73827ad606"}
Sep 07 03:54:32.015973 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:32.015952    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bhwtb"]
Sep 07 03:54:32.017598 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:54:32.017575    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbc450aa_9925_4513_aa14_a54288317378.slice/crio-b740842abade35633cee4270663875939a25670b48bd9954beed47728f728350 WatchSource:0}: Error finding container b740842abade35633cee4270663875939a25670b48bd9954beed47728f728350: Status 404 returned error can't find the container with id b740842abade35633cee4270663875939a25670b48bd9954beed47728f728350
Sep 07 03:54:32.162598 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:32.162571    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rj64"]
Sep 07 03:54:32.194395 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:54:32.194368    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad0da4cf_3857_4499_87ce_e70f14f8b290.slice/crio-82669518e26c6715d22f629425df1d0d1f16fecf9b11e3e1c3dd671c5648c2be WatchSource:0}: Error finding container 82669518e26c6715d22f629425df1d0d1f16fecf9b11e3e1c3dd671c5648c2be: Status 404 returned error can't find the container with id 82669518e26c6715d22f629425df1d0d1f16fecf9b11e3e1c3dd671c5648c2be
Sep 07 03:54:33.016046 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:33.016003    2559 generic.go:356] "Generic (PLEG): container finished" podID="2264e96e-08fb-4525-8f69-7c41561abe4d" containerID="c79aa972edbeb3774d7880a46e335e31b914989716d302a4b5109091198a5031" exitCode=0
Sep 07 03:54:33.016466 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:33.016094    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ckjpp9" event={"ID":"2264e96e-08fb-4525-8f69-7c41561abe4d","Type":"ContainerDied","Data":"c79aa972edbeb3774d7880a46e335e31b914989716d302a4b5109091198a5031"}
Sep 07 03:54:33.018167 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:33.018142    2559 generic.go:356] "Generic (PLEG): container finished" podID="bbc450aa-9925-4513-aa14-a54288317378" containerID="27aa0fb60a41fd6d0ba755a647679f67ed25027187c33992568c732156800ff8" exitCode=0
Sep 07 03:54:33.018274 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:33.018229    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bhwtb" event={"ID":"bbc450aa-9925-4513-aa14-a54288317378","Type":"ContainerDied","Data":"27aa0fb60a41fd6d0ba755a647679f67ed25027187c33992568c732156800ff8"}
Sep 07 03:54:33.018337 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:33.018284    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bhwtb" event={"ID":"bbc450aa-9925-4513-aa14-a54288317378","Type":"ContainerStarted","Data":"b740842abade35633cee4270663875939a25670b48bd9954beed47728f728350"}
Sep 07 03:54:33.020574 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:33.020548    2559 generic.go:356] "Generic (PLEG): container finished" podID="ad0da4cf-3857-4499-87ce-e70f14f8b290" containerID="301e3b57ed0fe31b33531a4d76fb3b76a43a0f4eccbb7613e7dff9111781c45e" exitCode=0
Sep 07 03:54:33.020688 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:33.020600    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rj64" event={"ID":"ad0da4cf-3857-4499-87ce-e70f14f8b290","Type":"ContainerDied","Data":"301e3b57ed0fe31b33531a4d76fb3b76a43a0f4eccbb7613e7dff9111781c45e"}
Sep 07 03:54:33.020688 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:33.020662    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rj64" event={"ID":"ad0da4cf-3857-4499-87ce-e70f14f8b290","Type":"ContainerStarted","Data":"82669518e26c6715d22f629425df1d0d1f16fecf9b11e3e1c3dd671c5648c2be"}
Sep 07 03:54:34.029210 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:34.029177    2559 generic.go:356] "Generic (PLEG): container finished" podID="d68581d2-0c58-41c3-a36f-2945a3fc6faa" containerID="e6a0b5cee126dcc2d7439704b1101a165cb4225d947996b2477b38e3beb74974" exitCode=0
Sep 07 03:54:34.029673 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:34.029262    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mxh57" event={"ID":"d68581d2-0c58-41c3-a36f-2945a3fc6faa","Type":"ContainerDied","Data":"e6a0b5cee126dcc2d7439704b1101a165cb4225d947996b2477b38e3beb74974"}
Sep 07 03:54:34.171040 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:34.171009    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-675775547b-tpgqf"]
Sep 07 03:54:34.180653 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:34.180588    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-675775547b-tpgqf"
Sep 07 03:54:34.189097 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:34.189066    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-675775547b-tpgqf"]
Sep 07 03:54:34.290295 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:34.290269    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e155b9e-30ca-4f44-9b1e-2c4086033dff-console-serving-cert\") pod \"console-675775547b-tpgqf\" (UID: \"0e155b9e-30ca-4f44-9b1e-2c4086033dff\") " pod="openshift-console/console-675775547b-tpgqf"
Sep 07 03:54:34.290377 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:34.290314    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0e155b9e-30ca-4f44-9b1e-2c4086033dff-console-config\") pod \"console-675775547b-tpgqf\" (UID: \"0e155b9e-30ca-4f44-9b1e-2c4086033dff\") " pod="openshift-console/console-675775547b-tpgqf"
Sep 07 03:54:34.290377 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:34.290342    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e155b9e-30ca-4f44-9b1e-2c4086033dff-trusted-ca-bundle\") pod \"console-675775547b-tpgqf\" (UID: \"0e155b9e-30ca-4f44-9b1e-2c4086033dff\") " pod="openshift-console/console-675775547b-tpgqf"
Sep 07 03:54:34.290520 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:34.290404    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0e155b9e-30ca-4f44-9b1e-2c4086033dff-service-ca\") pod \"console-675775547b-tpgqf\" (UID: \"0e155b9e-30ca-4f44-9b1e-2c4086033dff\") " pod="openshift-console/console-675775547b-tpgqf"
Sep 07 03:54:34.290520 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:34.290480    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99hbs\" (UniqueName: \"kubernetes.io/projected/0e155b9e-30ca-4f44-9b1e-2c4086033dff-kube-api-access-99hbs\") pod \"console-675775547b-tpgqf\" (UID: \"0e155b9e-30ca-4f44-9b1e-2c4086033dff\") " pod="openshift-console/console-675775547b-tpgqf"
Sep 07 03:54:34.290591 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:34.290544    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0e155b9e-30ca-4f44-9b1e-2c4086033dff-console-oauth-config\") pod \"console-675775547b-tpgqf\" (UID: \"0e155b9e-30ca-4f44-9b1e-2c4086033dff\") " pod="openshift-console/console-675775547b-tpgqf"
Sep 07 03:54:34.290591 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:34.290576    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0e155b9e-30ca-4f44-9b1e-2c4086033dff-oauth-serving-cert\") pod \"console-675775547b-tpgqf\" (UID: \"0e155b9e-30ca-4f44-9b1e-2c4086033dff\") " pod="openshift-console/console-675775547b-tpgqf"
Sep 07 03:54:34.391802 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:34.391776    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e155b9e-30ca-4f44-9b1e-2c4086033dff-console-serving-cert\") pod \"console-675775547b-tpgqf\" (UID: \"0e155b9e-30ca-4f44-9b1e-2c4086033dff\") " pod="openshift-console/console-675775547b-tpgqf"
Sep 07 03:54:34.391802 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:34.391807    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0e155b9e-30ca-4f44-9b1e-2c4086033dff-console-config\") pod \"console-675775547b-tpgqf\" (UID: \"0e155b9e-30ca-4f44-9b1e-2c4086033dff\") " pod="openshift-console/console-675775547b-tpgqf"
Sep 07 03:54:34.392002 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:34.391823    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e155b9e-30ca-4f44-9b1e-2c4086033dff-trusted-ca-bundle\") pod \"console-675775547b-tpgqf\" (UID: \"0e155b9e-30ca-4f44-9b1e-2c4086033dff\") " pod="openshift-console/console-675775547b-tpgqf"
Sep 07 03:54:34.392002 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:34.391853    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0e155b9e-30ca-4f44-9b1e-2c4086033dff-service-ca\") pod \"console-675775547b-tpgqf\" (UID: \"0e155b9e-30ca-4f44-9b1e-2c4086033dff\") " pod="openshift-console/console-675775547b-tpgqf"
Sep 07 03:54:34.392002 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:34.391910    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99hbs\" (UniqueName: \"kubernetes.io/projected/0e155b9e-30ca-4f44-9b1e-2c4086033dff-kube-api-access-99hbs\") pod \"console-675775547b-tpgqf\" (UID: \"0e155b9e-30ca-4f44-9b1e-2c4086033dff\") " pod="openshift-console/console-675775547b-tpgqf"
Sep 07 03:54:34.392002 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:34.391947    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0e155b9e-30ca-4f44-9b1e-2c4086033dff-console-oauth-config\") pod \"console-675775547b-tpgqf\" (UID: \"0e155b9e-30ca-4f44-9b1e-2c4086033dff\") " pod="openshift-console/console-675775547b-tpgqf"
Sep 07 03:54:34.392002 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:34.391971    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0e155b9e-30ca-4f44-9b1e-2c4086033dff-oauth-serving-cert\") pod \"console-675775547b-tpgqf\" (UID: \"0e155b9e-30ca-4f44-9b1e-2c4086033dff\") " pod="openshift-console/console-675775547b-tpgqf"
Sep 07 03:54:34.392659 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:34.392599    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0e155b9e-30ca-4f44-9b1e-2c4086033dff-console-config\") pod \"console-675775547b-tpgqf\" (UID: \"0e155b9e-30ca-4f44-9b1e-2c4086033dff\") " pod="openshift-console/console-675775547b-tpgqf"
Sep 07 03:54:34.392781 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:34.392677    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0e155b9e-30ca-4f44-9b1e-2c4086033dff-oauth-serving-cert\") pod \"console-675775547b-tpgqf\" (UID: \"0e155b9e-30ca-4f44-9b1e-2c4086033dff\") " pod="openshift-console/console-675775547b-tpgqf"
Sep 07 03:54:34.392781 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:34.392679    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0e155b9e-30ca-4f44-9b1e-2c4086033dff-service-ca\") pod \"console-675775547b-tpgqf\" (UID: \"0e155b9e-30ca-4f44-9b1e-2c4086033dff\") " pod="openshift-console/console-675775547b-tpgqf"
Sep 07 03:54:34.393199 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:34.393149    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e155b9e-30ca-4f44-9b1e-2c4086033dff-trusted-ca-bundle\") pod \"console-675775547b-tpgqf\" (UID: \"0e155b9e-30ca-4f44-9b1e-2c4086033dff\") " pod="openshift-console/console-675775547b-tpgqf"
Sep 07 03:54:34.394604 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:34.394581    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e155b9e-30ca-4f44-9b1e-2c4086033dff-console-serving-cert\") pod \"console-675775547b-tpgqf\" (UID: \"0e155b9e-30ca-4f44-9b1e-2c4086033dff\") " pod="openshift-console/console-675775547b-tpgqf"
Sep 07 03:54:34.395514 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:34.395489    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0e155b9e-30ca-4f44-9b1e-2c4086033dff-console-oauth-config\") pod \"console-675775547b-tpgqf\" (UID: \"0e155b9e-30ca-4f44-9b1e-2c4086033dff\") " pod="openshift-console/console-675775547b-tpgqf"
Sep 07 03:54:34.402057 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:34.402017    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99hbs\" (UniqueName: \"kubernetes.io/projected/0e155b9e-30ca-4f44-9b1e-2c4086033dff-kube-api-access-99hbs\") pod \"console-675775547b-tpgqf\" (UID: \"0e155b9e-30ca-4f44-9b1e-2c4086033dff\") " pod="openshift-console/console-675775547b-tpgqf"
Sep 07 03:54:34.493441 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:34.493417    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-675775547b-tpgqf"
Sep 07 03:54:34.766590 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:34.766566    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-675775547b-tpgqf"]
Sep 07 03:54:34.768354 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:54:34.768331    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e155b9e_30ca_4f44_9b1e_2c4086033dff.slice/crio-807bfb801ea7566e42dd7e72445a0f09b5a46f8ade47828e2d625e3e6046ea36 WatchSource:0}: Error finding container 807bfb801ea7566e42dd7e72445a0f09b5a46f8ade47828e2d625e3e6046ea36: Status 404 returned error can't find the container with id 807bfb801ea7566e42dd7e72445a0f09b5a46f8ade47828e2d625e3e6046ea36
Sep 07 03:54:35.036156 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:35.036122    2559 generic.go:356] "Generic (PLEG): container finished" podID="2264e96e-08fb-4525-8f69-7c41561abe4d" containerID="3d5feb432f8a95379a8820de02990270abcb24e72dced1a1c39b1c78a26c26c1" exitCode=0
Sep 07 03:54:35.036555 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:35.036215    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ckjpp9" event={"ID":"2264e96e-08fb-4525-8f69-7c41561abe4d","Type":"ContainerDied","Data":"3d5feb432f8a95379a8820de02990270abcb24e72dced1a1c39b1c78a26c26c1"}
Sep 07 03:54:35.038351 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:35.038327    2559 generic.go:356] "Generic (PLEG): container finished" podID="bbc450aa-9925-4513-aa14-a54288317378" containerID="589a795e42d81ca665aebb6aff4af81f594d4adf1eed58afed08a578043addb7" exitCode=0
Sep 07 03:54:35.038439 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:35.038408    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bhwtb" event={"ID":"bbc450aa-9925-4513-aa14-a54288317378","Type":"ContainerDied","Data":"589a795e42d81ca665aebb6aff4af81f594d4adf1eed58afed08a578043addb7"}
Sep 07 03:54:35.040887 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:35.040867    2559 generic.go:356] "Generic (PLEG): container finished" podID="d68581d2-0c58-41c3-a36f-2945a3fc6faa" containerID="83bdb58e42ca969b1d8e98028c546625991bb10aa287a9b7e3ecd16389f819a9" exitCode=0
Sep 07 03:54:35.041028 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:35.040898    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mxh57" event={"ID":"d68581d2-0c58-41c3-a36f-2945a3fc6faa","Type":"ContainerDied","Data":"83bdb58e42ca969b1d8e98028c546625991bb10aa287a9b7e3ecd16389f819a9"}
Sep 07 03:54:35.042861 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:35.042833    2559 generic.go:356] "Generic (PLEG): container finished" podID="ad0da4cf-3857-4499-87ce-e70f14f8b290" containerID="7c226f6f1e603ec328176c71678485a1adbcdff69f50fdc738a136298da89f2f" exitCode=0
Sep 07 03:54:35.042936 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:35.042916    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rj64" event={"ID":"ad0da4cf-3857-4499-87ce-e70f14f8b290","Type":"ContainerDied","Data":"7c226f6f1e603ec328176c71678485a1adbcdff69f50fdc738a136298da89f2f"}
Sep 07 03:54:35.044532 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:35.044514    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-675775547b-tpgqf" event={"ID":"0e155b9e-30ca-4f44-9b1e-2c4086033dff","Type":"ContainerStarted","Data":"10e89ed2c51db79c53742429c1efdb96bce6ff15bc4382ebfb5dd5853e3441f2"}
Sep 07 03:54:35.044599 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:35.044548    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-675775547b-tpgqf" event={"ID":"0e155b9e-30ca-4f44-9b1e-2c4086033dff","Type":"ContainerStarted","Data":"807bfb801ea7566e42dd7e72445a0f09b5a46f8ade47828e2d625e3e6046ea36"}
Sep 07 03:54:35.118296 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:35.118189    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-675775547b-tpgqf" podStartSLOduration=1.118169345 podStartE2EDuration="1.118169345s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 03:54:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:54:35.117302275 +0000 UTC m=+378.429778177" watchObservedRunningTime="2026-09-07 03:54:35.118169345 +0000 UTC m=+378.430645248"
Sep 07 03:54:36.052656 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:36.052593    2559 generic.go:356] "Generic (PLEG): container finished" podID="ad0da4cf-3857-4499-87ce-e70f14f8b290" containerID="f1a01dede7d7c690d461c1e6360f88728fb248ba7bd4ddfdfc089889a70d5b99" exitCode=0
Sep 07 03:54:36.053041 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:36.052660    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rj64" event={"ID":"ad0da4cf-3857-4499-87ce-e70f14f8b290","Type":"ContainerDied","Data":"f1a01dede7d7c690d461c1e6360f88728fb248ba7bd4ddfdfc089889a70d5b99"}
Sep 07 03:54:36.055127 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:36.055104    2559 generic.go:356] "Generic (PLEG): container finished" podID="2264e96e-08fb-4525-8f69-7c41561abe4d" containerID="38dd4a9a3238782cac809c2c13412b6ca4c186dd75cb3fda9b44ed106d07ef62" exitCode=0
Sep 07 03:54:36.055262 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:36.055183    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ckjpp9" event={"ID":"2264e96e-08fb-4525-8f69-7c41561abe4d","Type":"ContainerDied","Data":"38dd4a9a3238782cac809c2c13412b6ca4c186dd75cb3fda9b44ed106d07ef62"}
Sep 07 03:54:36.057940 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:36.057916    2559 generic.go:356] "Generic (PLEG): container finished" podID="bbc450aa-9925-4513-aa14-a54288317378" containerID="6ef2dcd9097b89b593aa44540bb7b25e03c5bdcb041327b335d19f6ee084124f" exitCode=0
Sep 07 03:54:36.058043 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:36.057940    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bhwtb" event={"ID":"bbc450aa-9925-4513-aa14-a54288317378","Type":"ContainerDied","Data":"6ef2dcd9097b89b593aa44540bb7b25e03c5bdcb041327b335d19f6ee084124f"}
Sep 07 03:54:36.195877 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:36.195849    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mxh57"
Sep 07 03:54:36.309683 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:36.309595    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d68581d2-0c58-41c3-a36f-2945a3fc6faa-util\") pod \"d68581d2-0c58-41c3-a36f-2945a3fc6faa\" (UID: \"d68581d2-0c58-41c3-a36f-2945a3fc6faa\") "
Sep 07 03:54:36.309803 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:36.309762    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6f44s\" (UniqueName: \"kubernetes.io/projected/d68581d2-0c58-41c3-a36f-2945a3fc6faa-kube-api-access-6f44s\") pod \"d68581d2-0c58-41c3-a36f-2945a3fc6faa\" (UID: \"d68581d2-0c58-41c3-a36f-2945a3fc6faa\") "
Sep 07 03:54:36.309841 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:36.309810    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d68581d2-0c58-41c3-a36f-2945a3fc6faa-bundle\") pod \"d68581d2-0c58-41c3-a36f-2945a3fc6faa\" (UID: \"d68581d2-0c58-41c3-a36f-2945a3fc6faa\") "
Sep 07 03:54:36.310427 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:36.310391    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d68581d2-0c58-41c3-a36f-2945a3fc6faa-bundle" (OuterVolumeSpecName: "bundle") pod "d68581d2-0c58-41c3-a36f-2945a3fc6faa" (UID: "d68581d2-0c58-41c3-a36f-2945a3fc6faa"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 03:54:36.311949 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:36.311924    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d68581d2-0c58-41c3-a36f-2945a3fc6faa-kube-api-access-6f44s" (OuterVolumeSpecName: "kube-api-access-6f44s") pod "d68581d2-0c58-41c3-a36f-2945a3fc6faa" (UID: "d68581d2-0c58-41c3-a36f-2945a3fc6faa"). InnerVolumeSpecName "kube-api-access-6f44s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 03:54:36.315525 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:36.315505    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d68581d2-0c58-41c3-a36f-2945a3fc6faa-util" (OuterVolumeSpecName: "util") pod "d68581d2-0c58-41c3-a36f-2945a3fc6faa" (UID: "d68581d2-0c58-41c3-a36f-2945a3fc6faa"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 03:54:36.411141 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:36.411109    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6f44s\" (UniqueName: \"kubernetes.io/projected/d68581d2-0c58-41c3-a36f-2945a3fc6faa-kube-api-access-6f44s\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:54:36.411141 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:36.411139    2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d68581d2-0c58-41c3-a36f-2945a3fc6faa-bundle\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:54:36.411141 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:36.411149    2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d68581d2-0c58-41c3-a36f-2945a3fc6faa-util\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:54:37.068598 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:37.068570    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mxh57"
Sep 07 03:54:37.068966 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:37.068631    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053mxh57" event={"ID":"d68581d2-0c58-41c3-a36f-2945a3fc6faa","Type":"ContainerDied","Data":"46c77a22107d3088b75d3f2dcef6606b1d77381e27b5d6e5ad230c73827ad606"}
Sep 07 03:54:37.068966 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:37.068679    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="46c77a22107d3088b75d3f2dcef6606b1d77381e27b5d6e5ad230c73827ad606"
Sep 07 03:54:37.209814 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:37.209789    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bhwtb"
Sep 07 03:54:37.245971 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:37.245943    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rj64"
Sep 07 03:54:37.253258 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:37.253236    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ckjpp9"
Sep 07 03:54:37.317638 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:37.317587    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bbc450aa-9925-4513-aa14-a54288317378-util\") pod \"bbc450aa-9925-4513-aa14-a54288317378\" (UID: \"bbc450aa-9925-4513-aa14-a54288317378\") "
Sep 07 03:54:37.317771 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:37.317661    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bbc450aa-9925-4513-aa14-a54288317378-bundle\") pod \"bbc450aa-9925-4513-aa14-a54288317378\" (UID: \"bbc450aa-9925-4513-aa14-a54288317378\") "
Sep 07 03:54:37.317771 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:37.317727    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pcmrn\" (UniqueName: \"kubernetes.io/projected/bbc450aa-9925-4513-aa14-a54288317378-kube-api-access-pcmrn\") pod \"bbc450aa-9925-4513-aa14-a54288317378\" (UID: \"bbc450aa-9925-4513-aa14-a54288317378\") "
Sep 07 03:54:37.318125 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:37.318102    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbc450aa-9925-4513-aa14-a54288317378-bundle" (OuterVolumeSpecName: "bundle") pod "bbc450aa-9925-4513-aa14-a54288317378" (UID: "bbc450aa-9925-4513-aa14-a54288317378"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 03:54:37.319717 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:37.319669    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbc450aa-9925-4513-aa14-a54288317378-kube-api-access-pcmrn" (OuterVolumeSpecName: "kube-api-access-pcmrn") pod "bbc450aa-9925-4513-aa14-a54288317378" (UID: "bbc450aa-9925-4513-aa14-a54288317378"). InnerVolumeSpecName "kube-api-access-pcmrn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 03:54:37.418840 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:37.418816    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2wlrp\" (UniqueName: \"kubernetes.io/projected/2264e96e-08fb-4525-8f69-7c41561abe4d-kube-api-access-2wlrp\") pod \"2264e96e-08fb-4525-8f69-7c41561abe4d\" (UID: \"2264e96e-08fb-4525-8f69-7c41561abe4d\") "
Sep 07 03:54:37.418949 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:37.418847    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ad0da4cf-3857-4499-87ce-e70f14f8b290-bundle\") pod \"ad0da4cf-3857-4499-87ce-e70f14f8b290\" (UID: \"ad0da4cf-3857-4499-87ce-e70f14f8b290\") "
Sep 07 03:54:37.418949 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:37.418907    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2264e96e-08fb-4525-8f69-7c41561abe4d-util\") pod \"2264e96e-08fb-4525-8f69-7c41561abe4d\" (UID: \"2264e96e-08fb-4525-8f69-7c41561abe4d\") "
Sep 07 03:54:37.418949 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:37.418930    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dg5fq\" (UniqueName: \"kubernetes.io/projected/ad0da4cf-3857-4499-87ce-e70f14f8b290-kube-api-access-dg5fq\") pod \"ad0da4cf-3857-4499-87ce-e70f14f8b290\" (UID: \"ad0da4cf-3857-4499-87ce-e70f14f8b290\") "
Sep 07 03:54:37.418949 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:37.418949    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ad0da4cf-3857-4499-87ce-e70f14f8b290-util\") pod \"ad0da4cf-3857-4499-87ce-e70f14f8b290\" (UID: \"ad0da4cf-3857-4499-87ce-e70f14f8b290\") "
Sep 07 03:54:37.419161 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:37.418976    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2264e96e-08fb-4525-8f69-7c41561abe4d-bundle\") pod \"2264e96e-08fb-4525-8f69-7c41561abe4d\" (UID: \"2264e96e-08fb-4525-8f69-7c41561abe4d\") "
Sep 07 03:54:37.419213 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:37.419199    2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bbc450aa-9925-4513-aa14-a54288317378-bundle\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:54:37.419281 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:37.419216    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pcmrn\" (UniqueName: \"kubernetes.io/projected/bbc450aa-9925-4513-aa14-a54288317378-kube-api-access-pcmrn\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:54:37.419438 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:37.419413    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad0da4cf-3857-4499-87ce-e70f14f8b290-bundle" (OuterVolumeSpecName: "bundle") pod "ad0da4cf-3857-4499-87ce-e70f14f8b290" (UID: "ad0da4cf-3857-4499-87ce-e70f14f8b290"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 03:54:37.419704 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:37.419682    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2264e96e-08fb-4525-8f69-7c41561abe4d-bundle" (OuterVolumeSpecName: "bundle") pod "2264e96e-08fb-4525-8f69-7c41561abe4d" (UID: "2264e96e-08fb-4525-8f69-7c41561abe4d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 03:54:37.420950 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:37.420930    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2264e96e-08fb-4525-8f69-7c41561abe4d-kube-api-access-2wlrp" (OuterVolumeSpecName: "kube-api-access-2wlrp") pod "2264e96e-08fb-4525-8f69-7c41561abe4d" (UID: "2264e96e-08fb-4525-8f69-7c41561abe4d"). InnerVolumeSpecName "kube-api-access-2wlrp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 03:54:37.421044 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:37.421004    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad0da4cf-3857-4499-87ce-e70f14f8b290-kube-api-access-dg5fq" (OuterVolumeSpecName: "kube-api-access-dg5fq") pod "ad0da4cf-3857-4499-87ce-e70f14f8b290" (UID: "ad0da4cf-3857-4499-87ce-e70f14f8b290"). InnerVolumeSpecName "kube-api-access-dg5fq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 03:54:37.424691 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:37.424669    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad0da4cf-3857-4499-87ce-e70f14f8b290-util" (OuterVolumeSpecName: "util") pod "ad0da4cf-3857-4499-87ce-e70f14f8b290" (UID: "ad0da4cf-3857-4499-87ce-e70f14f8b290"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 03:54:37.479369 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:37.479341    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbc450aa-9925-4513-aa14-a54288317378-util" (OuterVolumeSpecName: "util") pod "bbc450aa-9925-4513-aa14-a54288317378" (UID: "bbc450aa-9925-4513-aa14-a54288317378"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 03:54:37.481152 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:37.481135    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2264e96e-08fb-4525-8f69-7c41561abe4d-util" (OuterVolumeSpecName: "util") pod "2264e96e-08fb-4525-8f69-7c41561abe4d" (UID: "2264e96e-08fb-4525-8f69-7c41561abe4d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 03:54:37.520345 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:37.520326    2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2264e96e-08fb-4525-8f69-7c41561abe4d-util\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:54:37.520415 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:37.520346    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dg5fq\" (UniqueName: \"kubernetes.io/projected/ad0da4cf-3857-4499-87ce-e70f14f8b290-kube-api-access-dg5fq\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:54:37.520415 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:37.520357    2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bbc450aa-9925-4513-aa14-a54288317378-util\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:54:37.520415 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:37.520365    2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ad0da4cf-3857-4499-87ce-e70f14f8b290-util\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:54:37.520415 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:37.520373    2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2264e96e-08fb-4525-8f69-7c41561abe4d-bundle\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:54:37.520415 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:37.520381    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2wlrp\" (UniqueName: \"kubernetes.io/projected/2264e96e-08fb-4525-8f69-7c41561abe4d-kube-api-access-2wlrp\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:54:37.520415 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:37.520389    2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ad0da4cf-3857-4499-87ce-e70f14f8b290-bundle\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:54:38.076344 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:38.076313    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ckjpp9"
Sep 07 03:54:38.076344 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:38.076335    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183ckjpp9" event={"ID":"2264e96e-08fb-4525-8f69-7c41561abe4d","Type":"ContainerDied","Data":"543f13890a56c97c8225186f137cfa8196a487179f3820e60b393e183ad8b95e"}
Sep 07 03:54:38.076759 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:38.076382    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="543f13890a56c97c8225186f137cfa8196a487179f3820e60b393e183ad8b95e"
Sep 07 03:54:38.078575 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:38.078554    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bhwtb"
Sep 07 03:54:38.078700 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:38.078603    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0bhwtb" event={"ID":"bbc450aa-9925-4513-aa14-a54288317378","Type":"ContainerDied","Data":"b740842abade35633cee4270663875939a25670b48bd9954beed47728f728350"}
Sep 07 03:54:38.078700 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:38.078663    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b740842abade35633cee4270663875939a25670b48bd9954beed47728f728350"
Sep 07 03:54:38.080905 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:38.080876    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rj64" event={"ID":"ad0da4cf-3857-4499-87ce-e70f14f8b290","Type":"ContainerDied","Data":"82669518e26c6715d22f629425df1d0d1f16fecf9b11e3e1c3dd671c5648c2be"}
Sep 07 03:54:38.081016 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:38.080906    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb6rj64"
Sep 07 03:54:38.081016 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:38.080915    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="82669518e26c6715d22f629425df1d0d1f16fecf9b11e3e1c3dd671c5648c2be"
Sep 07 03:54:44.494438 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:44.494404    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-675775547b-tpgqf"
Sep 07 03:54:44.495009 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:44.494508    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-675775547b-tpgqf"
Sep 07 03:54:44.499524 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:44.499500    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-675775547b-tpgqf"
Sep 07 03:54:45.122071 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:45.122044    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-675775547b-tpgqf"
Sep 07 03:54:45.181296 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:54:45.181265    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74c646f97-x6nss"]
Sep 07 03:55:10.201336 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:55:10.201273    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-74c646f97-x6nss" podUID="d3ab2bd5-8000-4878-8977-59a8c0e4d985" containerName="console" containerID="cri-o://f337ec0ac2bd9c7cb9ccfa6db888d146c1cb8f7ac5e2a2dc3e2f65a693e1f062" gracePeriod=15
Sep 07 03:55:10.452350 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:55:10.452288    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74c646f97-x6nss"
Sep 07 03:55:10.572272 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:55:10.572243    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fc2m7\" (UniqueName: \"kubernetes.io/projected/d3ab2bd5-8000-4878-8977-59a8c0e4d985-kube-api-access-fc2m7\") pod \"d3ab2bd5-8000-4878-8977-59a8c0e4d985\" (UID: \"d3ab2bd5-8000-4878-8977-59a8c0e4d985\") "
Sep 07 03:55:10.572415 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:55:10.572285    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3ab2bd5-8000-4878-8977-59a8c0e4d985-console-serving-cert\") pod \"d3ab2bd5-8000-4878-8977-59a8c0e4d985\" (UID: \"d3ab2bd5-8000-4878-8977-59a8c0e4d985\") "
Sep 07 03:55:10.572415 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:55:10.572316    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3ab2bd5-8000-4878-8977-59a8c0e4d985-service-ca\") pod \"d3ab2bd5-8000-4878-8977-59a8c0e4d985\" (UID: \"d3ab2bd5-8000-4878-8977-59a8c0e4d985\") "
Sep 07 03:55:10.572415 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:55:10.572333    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3ab2bd5-8000-4878-8977-59a8c0e4d985-console-oauth-config\") pod \"d3ab2bd5-8000-4878-8977-59a8c0e4d985\" (UID: \"d3ab2bd5-8000-4878-8977-59a8c0e4d985\") "
Sep 07 03:55:10.572415 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:55:10.572376    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3ab2bd5-8000-4878-8977-59a8c0e4d985-oauth-serving-cert\") pod \"d3ab2bd5-8000-4878-8977-59a8c0e4d985\" (UID: \"d3ab2bd5-8000-4878-8977-59a8c0e4d985\") "
Sep 07 03:55:10.572415 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:55:10.572394    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3ab2bd5-8000-4878-8977-59a8c0e4d985-trusted-ca-bundle\") pod \"d3ab2bd5-8000-4878-8977-59a8c0e4d985\" (UID: \"d3ab2bd5-8000-4878-8977-59a8c0e4d985\") "
Sep 07 03:55:10.572415 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:55:10.572412    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3ab2bd5-8000-4878-8977-59a8c0e4d985-console-config\") pod \"d3ab2bd5-8000-4878-8977-59a8c0e4d985\" (UID: \"d3ab2bd5-8000-4878-8977-59a8c0e4d985\") "
Sep 07 03:55:10.572864 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:55:10.572832    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3ab2bd5-8000-4878-8977-59a8c0e4d985-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d3ab2bd5-8000-4878-8977-59a8c0e4d985" (UID: "d3ab2bd5-8000-4878-8977-59a8c0e4d985"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 03:55:10.572992 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:55:10.572891    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3ab2bd5-8000-4878-8977-59a8c0e4d985-service-ca" (OuterVolumeSpecName: "service-ca") pod "d3ab2bd5-8000-4878-8977-59a8c0e4d985" (UID: "d3ab2bd5-8000-4878-8977-59a8c0e4d985"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 03:55:10.572992 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:55:10.572928    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3ab2bd5-8000-4878-8977-59a8c0e4d985-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d3ab2bd5-8000-4878-8977-59a8c0e4d985" (UID: "d3ab2bd5-8000-4878-8977-59a8c0e4d985"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 03:55:10.572992 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:55:10.572935    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3ab2bd5-8000-4878-8977-59a8c0e4d985-console-config" (OuterVolumeSpecName: "console-config") pod "d3ab2bd5-8000-4878-8977-59a8c0e4d985" (UID: "d3ab2bd5-8000-4878-8977-59a8c0e4d985"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 03:55:10.574475 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:55:10.574454    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3ab2bd5-8000-4878-8977-59a8c0e4d985-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d3ab2bd5-8000-4878-8977-59a8c0e4d985" (UID: "d3ab2bd5-8000-4878-8977-59a8c0e4d985"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 03:55:10.574566 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:55:10.574500    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3ab2bd5-8000-4878-8977-59a8c0e4d985-kube-api-access-fc2m7" (OuterVolumeSpecName: "kube-api-access-fc2m7") pod "d3ab2bd5-8000-4878-8977-59a8c0e4d985" (UID: "d3ab2bd5-8000-4878-8977-59a8c0e4d985"). InnerVolumeSpecName "kube-api-access-fc2m7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 03:55:10.574608 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:55:10.574560    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3ab2bd5-8000-4878-8977-59a8c0e4d985-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d3ab2bd5-8000-4878-8977-59a8c0e4d985" (UID: "d3ab2bd5-8000-4878-8977-59a8c0e4d985"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 03:55:10.673962 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:55:10.673933    2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d3ab2bd5-8000-4878-8977-59a8c0e4d985-oauth-serving-cert\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:55:10.673962 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:55:10.673960    2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3ab2bd5-8000-4878-8977-59a8c0e4d985-trusted-ca-bundle\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:55:10.674102 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:55:10.673969    2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d3ab2bd5-8000-4878-8977-59a8c0e4d985-console-config\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:55:10.674102 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:55:10.673978    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fc2m7\" (UniqueName: \"kubernetes.io/projected/d3ab2bd5-8000-4878-8977-59a8c0e4d985-kube-api-access-fc2m7\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:55:10.674102 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:55:10.673987    2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d3ab2bd5-8000-4878-8977-59a8c0e4d985-console-serving-cert\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:55:10.674102 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:55:10.673995    2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d3ab2bd5-8000-4878-8977-59a8c0e4d985-service-ca\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:55:10.674102 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:55:10.674003    2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d3ab2bd5-8000-4878-8977-59a8c0e4d985-console-oauth-config\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 03:55:11.256256 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:55:11.256226    2559 generic.go:356] "Generic (PLEG): container finished" podID="d3ab2bd5-8000-4878-8977-59a8c0e4d985" containerID="f337ec0ac2bd9c7cb9ccfa6db888d146c1cb8f7ac5e2a2dc3e2f65a693e1f062" exitCode=0
Sep 07 03:55:11.256684 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:55:11.256273    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74c646f97-x6nss"
Sep 07 03:55:11.256684 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:55:11.256312    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74c646f97-x6nss" event={"ID":"d3ab2bd5-8000-4878-8977-59a8c0e4d985","Type":"ContainerDied","Data":"f337ec0ac2bd9c7cb9ccfa6db888d146c1cb8f7ac5e2a2dc3e2f65a693e1f062"}
Sep 07 03:55:11.256684 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:55:11.256372    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74c646f97-x6nss" event={"ID":"d3ab2bd5-8000-4878-8977-59a8c0e4d985","Type":"ContainerDied","Data":"7b5a9a1da09e7098f579e7971a4e23548d2658aae716100ea1eb304c6e349dd6"}
Sep 07 03:55:11.256684 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:55:11.256393    2559 scope.go:117] "RemoveContainer" containerID="f337ec0ac2bd9c7cb9ccfa6db888d146c1cb8f7ac5e2a2dc3e2f65a693e1f062"
Sep 07 03:55:11.265350 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:55:11.265332    2559 scope.go:117] "RemoveContainer" containerID="f337ec0ac2bd9c7cb9ccfa6db888d146c1cb8f7ac5e2a2dc3e2f65a693e1f062"
Sep 07 03:55:11.265632 ip-10-0-132-4 kubenswrapper[2559]: E0907 03:55:11.265600    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f337ec0ac2bd9c7cb9ccfa6db888d146c1cb8f7ac5e2a2dc3e2f65a693e1f062\": container with ID starting with f337ec0ac2bd9c7cb9ccfa6db888d146c1cb8f7ac5e2a2dc3e2f65a693e1f062 not found: ID does not exist" containerID="f337ec0ac2bd9c7cb9ccfa6db888d146c1cb8f7ac5e2a2dc3e2f65a693e1f062"
Sep 07 03:55:11.265691 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:55:11.265645    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f337ec0ac2bd9c7cb9ccfa6db888d146c1cb8f7ac5e2a2dc3e2f65a693e1f062"} err="failed to get container status \"f337ec0ac2bd9c7cb9ccfa6db888d146c1cb8f7ac5e2a2dc3e2f65a693e1f062\": rpc error: code = NotFound desc = could not find container \"f337ec0ac2bd9c7cb9ccfa6db888d146c1cb8f7ac5e2a2dc3e2f65a693e1f062\": container with ID starting with f337ec0ac2bd9c7cb9ccfa6db888d146c1cb8f7ac5e2a2dc3e2f65a693e1f062 not found: ID does not exist"
Sep 07 03:55:11.273367 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:55:11.273345    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74c646f97-x6nss"]
Sep 07 03:55:11.277530 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:55:11.277507    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-74c646f97-x6nss"]
Sep 07 03:55:13.178840 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:55:13.178807    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3ab2bd5-8000-4878-8977-59a8c0e4d985" path="/var/lib/kubelet/pods/d3ab2bd5-8000-4878-8977-59a8c0e4d985/volumes"
Sep 07 03:56:54.040655 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:56:54.040609    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-t4whn"]
Sep 07 03:56:54.041104 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:56:54.040922    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3ab2bd5-8000-4878-8977-59a8c0e4d985" containerName="console"
Sep 07 03:56:54.041104 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:56:54.040932    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3ab2bd5-8000-4878-8977-59a8c0e4d985" containerName="console"
Sep 07 03:56:54.041104 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:56:54.040941    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad0da4cf-3857-4499-87ce-e70f14f8b290" containerName="util"
Sep 07 03:56:54.041104 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:56:54.040946    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad0da4cf-3857-4499-87ce-e70f14f8b290" containerName="util"
Sep 07 03:56:54.041104 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:56:54.040954    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbc450aa-9925-4513-aa14-a54288317378" containerName="extract"
Sep 07 03:56:54.041104 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:56:54.040959    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbc450aa-9925-4513-aa14-a54288317378" containerName="extract"
Sep 07 03:56:54.041104 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:56:54.040968    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2264e96e-08fb-4525-8f69-7c41561abe4d" containerName="pull"
Sep 07 03:56:54.041104 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:56:54.040974    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2264e96e-08fb-4525-8f69-7c41561abe4d" containerName="pull"
Sep 07 03:56:54.041104 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:56:54.040980    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbc450aa-9925-4513-aa14-a54288317378" containerName="pull"
Sep 07 03:56:54.041104 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:56:54.040985    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbc450aa-9925-4513-aa14-a54288317378" containerName="pull"
Sep 07 03:56:54.041104 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:56:54.040993    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbc450aa-9925-4513-aa14-a54288317378" containerName="util"
Sep 07 03:56:54.041104 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:56:54.040997    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbc450aa-9925-4513-aa14-a54288317378" containerName="util"
Sep 07 03:56:54.041104 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:56:54.041003    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2264e96e-08fb-4525-8f69-7c41561abe4d" containerName="extract"
Sep 07 03:56:54.041104 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:56:54.041008    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2264e96e-08fb-4525-8f69-7c41561abe4d" containerName="extract"
Sep 07 03:56:54.041104 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:56:54.041014    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad0da4cf-3857-4499-87ce-e70f14f8b290" containerName="extract"
Sep 07 03:56:54.041104 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:56:54.041019    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad0da4cf-3857-4499-87ce-e70f14f8b290" containerName="extract"
Sep 07 03:56:54.041104 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:56:54.041028    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2264e96e-08fb-4525-8f69-7c41561abe4d" containerName="util"
Sep 07 03:56:54.041104 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:56:54.041033    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2264e96e-08fb-4525-8f69-7c41561abe4d" containerName="util"
Sep 07 03:56:54.041104 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:56:54.041040    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d68581d2-0c58-41c3-a36f-2945a3fc6faa" containerName="pull"
Sep 07 03:56:54.041104 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:56:54.041045    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d68581d2-0c58-41c3-a36f-2945a3fc6faa" containerName="pull"
Sep 07 03:56:54.041104 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:56:54.041050    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad0da4cf-3857-4499-87ce-e70f14f8b290" containerName="pull"
Sep 07 03:56:54.041104 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:56:54.041054    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad0da4cf-3857-4499-87ce-e70f14f8b290" containerName="pull"
Sep 07 03:56:54.041104 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:56:54.041063    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d68581d2-0c58-41c3-a36f-2945a3fc6faa" containerName="util"
Sep 07 03:56:54.041104 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:56:54.041067    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d68581d2-0c58-41c3-a36f-2945a3fc6faa" containerName="util"
Sep 07 03:56:54.041104 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:56:54.041072    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d68581d2-0c58-41c3-a36f-2945a3fc6faa" containerName="extract"
Sep 07 03:56:54.041104 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:56:54.041077    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d68581d2-0c58-41c3-a36f-2945a3fc6faa" containerName="extract"
Sep 07 03:56:54.041912 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:56:54.041126    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3ab2bd5-8000-4878-8977-59a8c0e4d985" containerName="console"
Sep 07 03:56:54.041912 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:56:54.041134    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2264e96e-08fb-4525-8f69-7c41561abe4d" containerName="extract"
Sep 07 03:56:54.041912 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:56:54.041141    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d68581d2-0c58-41c3-a36f-2945a3fc6faa" containerName="extract"
Sep 07 03:56:54.041912 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:56:54.041146    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad0da4cf-3857-4499-87ce-e70f14f8b290" containerName="extract"
Sep 07 03:56:54.041912 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:56:54.041151    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbc450aa-9925-4513-aa14-a54288317378" containerName="extract"
Sep 07 03:56:54.044061 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:56:54.044046    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-t4whn"
Sep 07 03:56:54.046308 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:56:54.046282    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 07 03:56:54.046439 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:56:54.046323    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-hwdzq\""
Sep 07 03:56:54.054161 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:56:54.054138    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-t4whn"]
Sep 07 03:56:54.170691 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:56:54.170663    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ccc5fd6-5875-4c48-bb6c-3e3c74b3e6b7-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-t4whn\" (UID: \"2ccc5fd6-5875-4c48-bb6c-3e3c74b3e6b7\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-t4whn"
Sep 07 03:56:54.170848 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:56:54.170709    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sv2tw\" (UniqueName: \"kubernetes.io/projected/2ccc5fd6-5875-4c48-bb6c-3e3c74b3e6b7-kube-api-access-sv2tw\") pod \"payload-processing-5b54b7fbb7-t4whn\" (UID: \"2ccc5fd6-5875-4c48-bb6c-3e3c74b3e6b7\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-t4whn"
Sep 07 03:56:54.272094 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:56:54.272060    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ccc5fd6-5875-4c48-bb6c-3e3c74b3e6b7-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-t4whn\" (UID: \"2ccc5fd6-5875-4c48-bb6c-3e3c74b3e6b7\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-t4whn"
Sep 07 03:56:54.272239 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:56:54.272122    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sv2tw\" (UniqueName: \"kubernetes.io/projected/2ccc5fd6-5875-4c48-bb6c-3e3c74b3e6b7-kube-api-access-sv2tw\") pod \"payload-processing-5b54b7fbb7-t4whn\" (UID: \"2ccc5fd6-5875-4c48-bb6c-3e3c74b3e6b7\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-t4whn"
Sep 07 03:56:54.272967 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:56:54.272940    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ccc5fd6-5875-4c48-bb6c-3e3c74b3e6b7-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-t4whn\" (UID: \"2ccc5fd6-5875-4c48-bb6c-3e3c74b3e6b7\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-t4whn"
Sep 07 03:56:54.281103 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:56:54.281082    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sv2tw\" (UniqueName: \"kubernetes.io/projected/2ccc5fd6-5875-4c48-bb6c-3e3c74b3e6b7-kube-api-access-sv2tw\") pod \"payload-processing-5b54b7fbb7-t4whn\" (UID: \"2ccc5fd6-5875-4c48-bb6c-3e3c74b3e6b7\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-t4whn"
Sep 07 03:56:54.355125 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:56:54.355067    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-t4whn"
Sep 07 03:56:54.627549 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:56:54.627528    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-t4whn"]
Sep 07 03:56:54.629188 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:56:54.629156    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ccc5fd6_5875_4c48_bb6c_3e3c74b3e6b7.slice/crio-218e930ace0c2f598f7328f88e1d08cfb64a4f0ab5f72b9071c6b030f24b9640 WatchSource:0}: Error finding container 218e930ace0c2f598f7328f88e1d08cfb64a4f0ab5f72b9071c6b030f24b9640: Status 404 returned error can't find the container with id 218e930ace0c2f598f7328f88e1d08cfb64a4f0ab5f72b9071c6b030f24b9640
Sep 07 03:56:54.787195 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:56:54.787164    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-t4whn" event={"ID":"2ccc5fd6-5875-4c48-bb6c-3e3c74b3e6b7","Type":"ContainerStarted","Data":"218e930ace0c2f598f7328f88e1d08cfb64a4f0ab5f72b9071c6b030f24b9640"}
Sep 07 03:56:56.799885 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:56:56.799843    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-t4whn" event={"ID":"2ccc5fd6-5875-4c48-bb6c-3e3c74b3e6b7","Type":"ContainerStarted","Data":"1cebc62aea70f75b87e8c7326bc69aaba4dc2143cefb97835d9e75b5788185d0"}
Sep 07 03:56:56.800244 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:56:56.799936    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-t4whn"
Sep 07 03:56:56.818542 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:56:56.818490    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-t4whn" podStartSLOduration=1.110458178 podStartE2EDuration="2.818476598s" totalImagesPullingTime="1.70801842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 03:56:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:56:56.815573778 +0000 UTC m=+520.128049680" watchObservedRunningTime="2026-09-07 03:56:56.818476598 +0000 UTC m=+520.130952533"
Sep 07 03:57:07.809868 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:57:07.809825    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-t4whn"
Sep 07 03:57:39.478694 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:57:39.478589    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7cx5"]
Sep 07 03:57:39.482459 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:57:39.482436    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7cx5"
Sep 07 03:57:39.485340 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:57:39.485318    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 07 03:57:39.485490 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:57:39.485319    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-v92z7\""
Sep 07 03:57:39.485490 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:57:39.485352    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 07 03:57:39.485490 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:57:39.485419    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 07 03:57:39.494485 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:57:39.494463    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7cx5"]
Sep 07 03:57:39.544983 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:57:39.544945    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34023d09-622d-4fe2-b106-a5cd66af1fb9-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l7cx5\" (UID: \"34023d09-622d-4fe2-b106-a5cd66af1fb9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7cx5"
Sep 07 03:57:39.545169 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:57:39.545013    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsz65\" (UniqueName: \"kubernetes.io/projected/34023d09-622d-4fe2-b106-a5cd66af1fb9-kube-api-access-wsz65\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l7cx5\" (UID: \"34023d09-622d-4fe2-b106-a5cd66af1fb9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7cx5"
Sep 07 03:57:39.545169 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:57:39.545065    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34023d09-622d-4fe2-b106-a5cd66af1fb9-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l7cx5\" (UID: \"34023d09-622d-4fe2-b106-a5cd66af1fb9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7cx5"
Sep 07 03:57:39.545169 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:57:39.545087    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34023d09-622d-4fe2-b106-a5cd66af1fb9-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l7cx5\" (UID: \"34023d09-622d-4fe2-b106-a5cd66af1fb9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7cx5"
Sep 07 03:57:39.545169 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:57:39.545128    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34023d09-622d-4fe2-b106-a5cd66af1fb9-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l7cx5\" (UID: \"34023d09-622d-4fe2-b106-a5cd66af1fb9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7cx5"
Sep 07 03:57:39.545320 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:57:39.545195    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34023d09-622d-4fe2-b106-a5cd66af1fb9-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l7cx5\" (UID: \"34023d09-622d-4fe2-b106-a5cd66af1fb9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7cx5"
Sep 07 03:57:39.645679 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:57:39.645610    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34023d09-622d-4fe2-b106-a5cd66af1fb9-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l7cx5\" (UID: \"34023d09-622d-4fe2-b106-a5cd66af1fb9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7cx5"
Sep 07 03:57:39.645863 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:57:39.645703    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34023d09-622d-4fe2-b106-a5cd66af1fb9-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l7cx5\" (UID: \"34023d09-622d-4fe2-b106-a5cd66af1fb9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7cx5"
Sep 07 03:57:39.645863 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:57:39.645749    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsz65\" (UniqueName: \"kubernetes.io/projected/34023d09-622d-4fe2-b106-a5cd66af1fb9-kube-api-access-wsz65\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l7cx5\" (UID: \"34023d09-622d-4fe2-b106-a5cd66af1fb9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7cx5"
Sep 07 03:57:39.645863 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:57:39.645795    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34023d09-622d-4fe2-b106-a5cd66af1fb9-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l7cx5\" (UID: \"34023d09-622d-4fe2-b106-a5cd66af1fb9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7cx5"
Sep 07 03:57:39.645863 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:57:39.645822    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34023d09-622d-4fe2-b106-a5cd66af1fb9-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l7cx5\" (UID: \"34023d09-622d-4fe2-b106-a5cd66af1fb9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7cx5"
Sep 07 03:57:39.645863 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:57:39.645850    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34023d09-622d-4fe2-b106-a5cd66af1fb9-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l7cx5\" (UID: \"34023d09-622d-4fe2-b106-a5cd66af1fb9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7cx5"
Sep 07 03:57:39.646126 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:57:39.646035    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34023d09-622d-4fe2-b106-a5cd66af1fb9-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l7cx5\" (UID: \"34023d09-622d-4fe2-b106-a5cd66af1fb9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7cx5"
Sep 07 03:57:39.646126 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:57:39.646114    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34023d09-622d-4fe2-b106-a5cd66af1fb9-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l7cx5\" (UID: \"34023d09-622d-4fe2-b106-a5cd66af1fb9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7cx5"
Sep 07 03:57:39.646269 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:57:39.646245    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34023d09-622d-4fe2-b106-a5cd66af1fb9-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l7cx5\" (UID: \"34023d09-622d-4fe2-b106-a5cd66af1fb9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7cx5"
Sep 07 03:57:39.648084 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:57:39.648062    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34023d09-622d-4fe2-b106-a5cd66af1fb9-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l7cx5\" (UID: \"34023d09-622d-4fe2-b106-a5cd66af1fb9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7cx5"
Sep 07 03:57:39.648434 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:57:39.648418    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34023d09-622d-4fe2-b106-a5cd66af1fb9-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l7cx5\" (UID: \"34023d09-622d-4fe2-b106-a5cd66af1fb9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7cx5"
Sep 07 03:57:39.653061 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:57:39.653035    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsz65\" (UniqueName: \"kubernetes.io/projected/34023d09-622d-4fe2-b106-a5cd66af1fb9-kube-api-access-wsz65\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-l7cx5\" (UID: \"34023d09-622d-4fe2-b106-a5cd66af1fb9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7cx5"
Sep 07 03:57:39.793385 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:57:39.793290    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7cx5"
Sep 07 03:57:40.069603 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:57:40.069574    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7cx5"]
Sep 07 03:57:40.072503 ip-10-0-132-4 kubenswrapper[2559]: W0907 03:57:40.072475    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34023d09_622d_4fe2_b106_a5cd66af1fb9.slice/crio-ac2abf85723c5a02f1a08c7d8ab3301bd860b8c5a2eff902437acf3fb254f581 WatchSource:0}: Error finding container ac2abf85723c5a02f1a08c7d8ab3301bd860b8c5a2eff902437acf3fb254f581: Status 404 returned error can't find the container with id ac2abf85723c5a02f1a08c7d8ab3301bd860b8c5a2eff902437acf3fb254f581
Sep 07 03:57:41.029335 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:57:41.029306    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7cx5" event={"ID":"34023d09-622d-4fe2-b106-a5cd66af1fb9","Type":"ContainerStarted","Data":"ac2abf85723c5a02f1a08c7d8ab3301bd860b8c5a2eff902437acf3fb254f581"}
Sep 07 03:57:42.036633 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:57:42.036578    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7cx5" event={"ID":"34023d09-622d-4fe2-b106-a5cd66af1fb9","Type":"ContainerStarted","Data":"c76f0b493d25534aec92455f4ac6afd69f3d7370e72c0860faa6776af0426afb"}
Sep 07 03:57:42.054924 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:57:42.054872    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7cx5" podStartSLOduration=2.099194358 podStartE2EDuration="3.054854098s" totalImagesPullingTime="955.65974ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 03:57:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 03:57:42.052327171 +0000 UTC m=+565.364803072" watchObservedRunningTime="2026-09-07 03:57:42.054854098 +0000 UTC m=+565.367330001"
Sep 07 03:57:49.794505 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:57:49.794464    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7cx5"
Sep 07 03:57:49.795008 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:57:49.794568    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7cx5"
Sep 07 03:57:49.807217 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:57:49.807188    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7cx5"
Sep 07 03:57:50.091061 ip-10-0-132-4 kubenswrapper[2559]: I0907 03:57:50.090982    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-l7cx5"
Sep 07 04:00:00.147485 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:00.147451    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29812560-vkg8j"]
Sep 07 04:00:00.150893 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:00.150876    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29812560-vkg8j"
Sep 07 04:00:00.152923 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:00.152898    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zs4ff\""
Sep 07 04:00:00.161847 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:00.161817    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29812560-vkg8j"]
Sep 07 04:00:00.163040 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:00.163012    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29812560-vkg8j"
Sep 07 04:00:00.432242 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:00.432219    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29812560-vkg8j"]
Sep 07 04:00:00.434322 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:00:00.434295    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6123c7fe_42f5_41cc_ae8e_5a54f97be64c.slice/crio-5bc2c6f611cb2149c28d0dd2e24febe2f4253322b6b2b32e03db64af61ff291f WatchSource:0}: Error finding container 5bc2c6f611cb2149c28d0dd2e24febe2f4253322b6b2b32e03db64af61ff291f: Status 404 returned error can't find the container with id 5bc2c6f611cb2149c28d0dd2e24febe2f4253322b6b2b32e03db64af61ff291f
Sep 07 04:00:00.436183 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:00.436163    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 04:00:00.759563 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:00.759474    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29812560-vkg8j" event={"ID":"6123c7fe-42f5-41cc-ae8e-5a54f97be64c","Type":"ContainerStarted","Data":"5bc2c6f611cb2149c28d0dd2e24febe2f4253322b6b2b32e03db64af61ff291f"}
Sep 07 04:00:03.778157 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:03.778118    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29812560-vkg8j" event={"ID":"6123c7fe-42f5-41cc-ae8e-5a54f97be64c","Type":"ContainerStarted","Data":"a577ddfae28d056a2f8205f261187ea3dd630e9797497ec6fcf45739d0118afb"}
Sep 07 04:00:03.791779 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:03.791737    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29812560-vkg8j" podStartSLOduration=0.876378142 podStartE2EDuration="3.791720697s" totalImagesPullingTime="2.915342555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:00:03.790505032 +0000 UTC m=+707.102980944" watchObservedRunningTime="2026-09-07 04:00:03.791720697 +0000 UTC m=+707.104196978"
Sep 07 04:00:04.785019 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:04.784984    2559 generic.go:356] "Generic (PLEG): container finished" podID="6123c7fe-42f5-41cc-ae8e-5a54f97be64c" containerID="a577ddfae28d056a2f8205f261187ea3dd630e9797497ec6fcf45739d0118afb" exitCode=0
Sep 07 04:00:04.785417 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:04.785084    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29812560-vkg8j" event={"ID":"6123c7fe-42f5-41cc-ae8e-5a54f97be64c","Type":"ContainerDied","Data":"a577ddfae28d056a2f8205f261187ea3dd630e9797497ec6fcf45739d0118afb"}
Sep 07 04:00:05.913306 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:05.913281    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29812560-vkg8j"
Sep 07 04:00:06.796308 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:06.796273    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29812560-vkg8j"
Sep 07 04:00:06.796481 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:06.796324    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29812560-vkg8j" event={"ID":"6123c7fe-42f5-41cc-ae8e-5a54f97be64c","Type":"ContainerDied","Data":"5bc2c6f611cb2149c28d0dd2e24febe2f4253322b6b2b32e03db64af61ff291f"}
Sep 07 04:00:06.796481 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:06.796374    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5bc2c6f611cb2149c28d0dd2e24febe2f4253322b6b2b32e03db64af61ff291f"
Sep 07 04:00:16.629393 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:16.629352    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6"]
Sep 07 04:00:16.629968 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:16.629939    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6123c7fe-42f5-41cc-ae8e-5a54f97be64c" containerName="cleanup"
Sep 07 04:00:16.630090 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:16.629996    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6123c7fe-42f5-41cc-ae8e-5a54f97be64c" containerName="cleanup"
Sep 07 04:00:16.630157 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:16.630147    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6123c7fe-42f5-41cc-ae8e-5a54f97be64c" containerName="cleanup"
Sep 07 04:00:16.633255 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:16.633233    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6"
Sep 07 04:00:16.635971 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:16.635947    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-1038cd-openshift-default-dockercfg-fmccj\""
Sep 07 04:00:16.647596 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:16.647570    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6"]
Sep 07 04:00:16.728733 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:16.728696    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6baa400b-c2af-4549-a34d-c1e4bc37bf8e-workload-certs\") pod \"e2e-inf-a-1038cd-openshift-default-594788f864-qggd6\" (UID: \"6baa400b-c2af-4549-a34d-c1e4bc37bf8e\") " pod="openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6"
Sep 07 04:00:16.728902 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:16.728742    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6baa400b-c2af-4549-a34d-c1e4bc37bf8e-workload-socket\") pod \"e2e-inf-a-1038cd-openshift-default-594788f864-qggd6\" (UID: \"6baa400b-c2af-4549-a34d-c1e4bc37bf8e\") " pod="openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6"
Sep 07 04:00:16.728902 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:16.728799    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6baa400b-c2af-4549-a34d-c1e4bc37bf8e-istio-podinfo\") pod \"e2e-inf-a-1038cd-openshift-default-594788f864-qggd6\" (UID: \"6baa400b-c2af-4549-a34d-c1e4bc37bf8e\") " pod="openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6"
Sep 07 04:00:16.728902 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:16.728833    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6baa400b-c2af-4549-a34d-c1e4bc37bf8e-istiod-ca-cert\") pod \"e2e-inf-a-1038cd-openshift-default-594788f864-qggd6\" (UID: \"6baa400b-c2af-4549-a34d-c1e4bc37bf8e\") " pod="openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6"
Sep 07 04:00:16.728902 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:16.728859    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6baa400b-c2af-4549-a34d-c1e4bc37bf8e-credential-socket\") pod \"e2e-inf-a-1038cd-openshift-default-594788f864-qggd6\" (UID: \"6baa400b-c2af-4549-a34d-c1e4bc37bf8e\") " pod="openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6"
Sep 07 04:00:16.728902 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:16.728892    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fntql\" (UniqueName: \"kubernetes.io/projected/6baa400b-c2af-4549-a34d-c1e4bc37bf8e-kube-api-access-fntql\") pod \"e2e-inf-a-1038cd-openshift-default-594788f864-qggd6\" (UID: \"6baa400b-c2af-4549-a34d-c1e4bc37bf8e\") " pod="openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6"
Sep 07 04:00:16.729098 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:16.728934    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6baa400b-c2af-4549-a34d-c1e4bc37bf8e-istio-envoy\") pod \"e2e-inf-a-1038cd-openshift-default-594788f864-qggd6\" (UID: \"6baa400b-c2af-4549-a34d-c1e4bc37bf8e\") " pod="openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6"
Sep 07 04:00:16.729098 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:16.728952    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6baa400b-c2af-4549-a34d-c1e4bc37bf8e-istio-token\") pod \"e2e-inf-a-1038cd-openshift-default-594788f864-qggd6\" (UID: \"6baa400b-c2af-4549-a34d-c1e4bc37bf8e\") " pod="openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6"
Sep 07 04:00:16.729098 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:16.728974    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6baa400b-c2af-4549-a34d-c1e4bc37bf8e-istio-data\") pod \"e2e-inf-a-1038cd-openshift-default-594788f864-qggd6\" (UID: \"6baa400b-c2af-4549-a34d-c1e4bc37bf8e\") " pod="openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6"
Sep 07 04:00:16.830539 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:16.830498    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6baa400b-c2af-4549-a34d-c1e4bc37bf8e-credential-socket\") pod \"e2e-inf-a-1038cd-openshift-default-594788f864-qggd6\" (UID: \"6baa400b-c2af-4549-a34d-c1e4bc37bf8e\") " pod="openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6"
Sep 07 04:00:16.830539 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:16.830540    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fntql\" (UniqueName: \"kubernetes.io/projected/6baa400b-c2af-4549-a34d-c1e4bc37bf8e-kube-api-access-fntql\") pod \"e2e-inf-a-1038cd-openshift-default-594788f864-qggd6\" (UID: \"6baa400b-c2af-4549-a34d-c1e4bc37bf8e\") " pod="openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6"
Sep 07 04:00:16.830902 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:16.830578    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6baa400b-c2af-4549-a34d-c1e4bc37bf8e-istio-envoy\") pod \"e2e-inf-a-1038cd-openshift-default-594788f864-qggd6\" (UID: \"6baa400b-c2af-4549-a34d-c1e4bc37bf8e\") " pod="openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6"
Sep 07 04:00:16.830902 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:16.830596    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6baa400b-c2af-4549-a34d-c1e4bc37bf8e-istio-token\") pod \"e2e-inf-a-1038cd-openshift-default-594788f864-qggd6\" (UID: \"6baa400b-c2af-4549-a34d-c1e4bc37bf8e\") " pod="openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6"
Sep 07 04:00:16.830902 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:16.830616    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6baa400b-c2af-4549-a34d-c1e4bc37bf8e-istio-data\") pod \"e2e-inf-a-1038cd-openshift-default-594788f864-qggd6\" (UID: \"6baa400b-c2af-4549-a34d-c1e4bc37bf8e\") " pod="openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6"
Sep 07 04:00:16.830902 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:16.830751    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6baa400b-c2af-4549-a34d-c1e4bc37bf8e-workload-certs\") pod \"e2e-inf-a-1038cd-openshift-default-594788f864-qggd6\" (UID: \"6baa400b-c2af-4549-a34d-c1e4bc37bf8e\") " pod="openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6"
Sep 07 04:00:16.830902 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:16.830788    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6baa400b-c2af-4549-a34d-c1e4bc37bf8e-workload-socket\") pod \"e2e-inf-a-1038cd-openshift-default-594788f864-qggd6\" (UID: \"6baa400b-c2af-4549-a34d-c1e4bc37bf8e\") " pod="openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6"
Sep 07 04:00:16.830902 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:16.830817    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6baa400b-c2af-4549-a34d-c1e4bc37bf8e-istio-podinfo\") pod \"e2e-inf-a-1038cd-openshift-default-594788f864-qggd6\" (UID: \"6baa400b-c2af-4549-a34d-c1e4bc37bf8e\") " pod="openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6"
Sep 07 04:00:16.830902 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:16.830841    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6baa400b-c2af-4549-a34d-c1e4bc37bf8e-istiod-ca-cert\") pod \"e2e-inf-a-1038cd-openshift-default-594788f864-qggd6\" (UID: \"6baa400b-c2af-4549-a34d-c1e4bc37bf8e\") " pod="openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6"
Sep 07 04:00:16.831247 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:16.831001    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6baa400b-c2af-4549-a34d-c1e4bc37bf8e-credential-socket\") pod \"e2e-inf-a-1038cd-openshift-default-594788f864-qggd6\" (UID: \"6baa400b-c2af-4549-a34d-c1e4bc37bf8e\") " pod="openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6"
Sep 07 04:00:16.831247 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:16.831148    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6baa400b-c2af-4549-a34d-c1e4bc37bf8e-istio-data\") pod \"e2e-inf-a-1038cd-openshift-default-594788f864-qggd6\" (UID: \"6baa400b-c2af-4549-a34d-c1e4bc37bf8e\") " pod="openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6"
Sep 07 04:00:16.831359 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:16.831249    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6baa400b-c2af-4549-a34d-c1e4bc37bf8e-workload-socket\") pod \"e2e-inf-a-1038cd-openshift-default-594788f864-qggd6\" (UID: \"6baa400b-c2af-4549-a34d-c1e4bc37bf8e\") " pod="openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6"
Sep 07 04:00:16.831359 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:16.831283    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6baa400b-c2af-4549-a34d-c1e4bc37bf8e-workload-certs\") pod \"e2e-inf-a-1038cd-openshift-default-594788f864-qggd6\" (UID: \"6baa400b-c2af-4549-a34d-c1e4bc37bf8e\") " pod="openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6"
Sep 07 04:00:16.831544 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:16.831524    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6baa400b-c2af-4549-a34d-c1e4bc37bf8e-istiod-ca-cert\") pod \"e2e-inf-a-1038cd-openshift-default-594788f864-qggd6\" (UID: \"6baa400b-c2af-4549-a34d-c1e4bc37bf8e\") " pod="openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6"
Sep 07 04:00:16.833032 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:16.833004    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6baa400b-c2af-4549-a34d-c1e4bc37bf8e-istio-envoy\") pod \"e2e-inf-a-1038cd-openshift-default-594788f864-qggd6\" (UID: \"6baa400b-c2af-4549-a34d-c1e4bc37bf8e\") " pod="openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6"
Sep 07 04:00:16.833243 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:16.833224    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6baa400b-c2af-4549-a34d-c1e4bc37bf8e-istio-podinfo\") pod \"e2e-inf-a-1038cd-openshift-default-594788f864-qggd6\" (UID: \"6baa400b-c2af-4549-a34d-c1e4bc37bf8e\") " pod="openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6"
Sep 07 04:00:16.837988 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:16.837968    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6baa400b-c2af-4549-a34d-c1e4bc37bf8e-istio-token\") pod \"e2e-inf-a-1038cd-openshift-default-594788f864-qggd6\" (UID: \"6baa400b-c2af-4549-a34d-c1e4bc37bf8e\") " pod="openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6"
Sep 07 04:00:16.838093 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:16.838055    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fntql\" (UniqueName: \"kubernetes.io/projected/6baa400b-c2af-4549-a34d-c1e4bc37bf8e-kube-api-access-fntql\") pod \"e2e-inf-a-1038cd-openshift-default-594788f864-qggd6\" (UID: \"6baa400b-c2af-4549-a34d-c1e4bc37bf8e\") " pod="openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6"
Sep 07 04:00:16.943536 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:16.943455    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6"
Sep 07 04:00:17.224051 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:17.224019    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6"]
Sep 07 04:00:17.225149 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:00:17.225121    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6baa400b_c2af_4549_a34d_c1e4bc37bf8e.slice/crio-d0b8c14562c8961e56f4c23969700e50b1beb44b0e4444f4092c260ea7e92ead WatchSource:0}: Error finding container d0b8c14562c8961e56f4c23969700e50b1beb44b0e4444f4092c260ea7e92ead: Status 404 returned error can't find the container with id d0b8c14562c8961e56f4c23969700e50b1beb44b0e4444f4092c260ea7e92ead
Sep 07 04:00:17.227182 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:17.227153    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 04:00:17.227266 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:17.227210    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 04:00:17.227266 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:17.227245    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 04:00:17.854948 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:17.854912    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6" event={"ID":"6baa400b-c2af-4549-a34d-c1e4bc37bf8e","Type":"ContainerStarted","Data":"d2b9edf7513f901b6267868c4bac16503f4796b7f5bf80c707f2e227548daeae"}
Sep 07 04:00:17.855333 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:17.854962    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6" event={"ID":"6baa400b-c2af-4549-a34d-c1e4bc37bf8e","Type":"ContainerStarted","Data":"d0b8c14562c8961e56f4c23969700e50b1beb44b0e4444f4092c260ea7e92ead"}
Sep 07 04:00:17.879030 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:17.878983    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6" podStartSLOduration=1.8789663829999999 podStartE2EDuration="1.878966383s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:00:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:00:17.876200342 +0000 UTC m=+721.188676244" watchObservedRunningTime="2026-09-07 04:00:17.878966383 +0000 UTC m=+721.191442284"
Sep 07 04:00:17.944185 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:17.944143    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6"
Sep 07 04:00:18.164848 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:18.164813    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7365-139773466596400"]
Sep 07 04:00:18.168270 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:18.168253    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7365-139773466596400"
Sep 07 04:00:18.170240 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:18.170220    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-lhk6n\""
Sep 07 04:00:18.175184 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:18.175158    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7365-139773466596400"]
Sep 07 04:00:18.342837 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:18.342810    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jr9ts\" (UniqueName: \"kubernetes.io/projected/5909fe53-d184-4656-abb0-49ed9d043556-kube-api-access-jr9ts\") pod \"test-curl-7365-139773466596400\" (UID: \"5909fe53-d184-4656-abb0-49ed9d043556\") " pod="opendatahub/test-curl-7365-139773466596400"
Sep 07 04:00:18.443655 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:18.443541    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr9ts\" (UniqueName: \"kubernetes.io/projected/5909fe53-d184-4656-abb0-49ed9d043556-kube-api-access-jr9ts\") pod \"test-curl-7365-139773466596400\" (UID: \"5909fe53-d184-4656-abb0-49ed9d043556\") " pod="opendatahub/test-curl-7365-139773466596400"
Sep 07 04:00:18.451187 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:18.451166    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jr9ts\" (UniqueName: \"kubernetes.io/projected/5909fe53-d184-4656-abb0-49ed9d043556-kube-api-access-jr9ts\") pod \"test-curl-7365-139773466596400\" (UID: \"5909fe53-d184-4656-abb0-49ed9d043556\") " pod="opendatahub/test-curl-7365-139773466596400"
Sep 07 04:00:18.479190 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:18.479166    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7365-139773466596400"
Sep 07 04:00:18.747582 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:18.747555    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7365-139773466596400"]
Sep 07 04:00:18.748992 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:00:18.748965    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5909fe53_d184_4656_abb0_49ed9d043556.slice/crio-4565dc4faa978c327dea169dcc9db0c180de5101941240c64607da6c176e20b8 WatchSource:0}: Error finding container 4565dc4faa978c327dea169dcc9db0c180de5101941240c64607da6c176e20b8: Status 404 returned error can't find the container with id 4565dc4faa978c327dea169dcc9db0c180de5101941240c64607da6c176e20b8
Sep 07 04:00:18.860705 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:18.860667    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7365-139773466596400" event={"ID":"5909fe53-d184-4656-abb0-49ed9d043556","Type":"ContainerStarted","Data":"4565dc4faa978c327dea169dcc9db0c180de5101941240c64607da6c176e20b8"}
Sep 07 04:00:18.949555 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:18.949523    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6"
Sep 07 04:00:19.866797 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:19.866763    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6"
Sep 07 04:00:19.867812 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:19.867785    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6"
Sep 07 04:00:20.872871 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:20.872831    2559 generic.go:356] "Generic (PLEG): container finished" podID="5909fe53-d184-4656-abb0-49ed9d043556" containerID="4a913366fca494f12fd9699ee63bf8ab261cc2f97394d502d75b4441282ae5d1" exitCode=0
Sep 07 04:00:20.873250 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:20.872913    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7365-139773466596400" event={"ID":"5909fe53-d184-4656-abb0-49ed9d043556","Type":"ContainerDied","Data":"4a913366fca494f12fd9699ee63bf8ab261cc2f97394d502d75b4441282ae5d1"}
Sep 07 04:00:21.724259 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:21.724222    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-1038cd-6785489774-t66c4"]
Sep 07 04:00:21.727696 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:21.727675    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1038cd-6785489774-t66c4"
Sep 07 04:00:21.729595 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:21.729576    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-1038cd\""
Sep 07 04:00:21.738501 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:21.738476    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-1038cd-6785489774-t66c4"]
Sep 07 04:00:21.773282 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:21.773258    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-1038cd-588f96c9f9-prwl4"]
Sep 07 04:00:21.776686 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:21.776669    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-1038cd-588f96c9f9-prwl4"
Sep 07 04:00:21.778763 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:21.778742    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-1038cd-dockercfg-x2gh7\""
Sep 07 04:00:21.789266 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:21.789246    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-1038cd-588f96c9f9-prwl4"]
Sep 07 04:00:21.876103 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:21.876074    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e43d079-07bb-4e1e-93bd-49c558a868f7-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-1038cd-6785489774-t66c4\" (UID: \"9e43d079-07bb-4e1e-93bd-49c558a868f7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1038cd-6785489774-t66c4"
Sep 07 04:00:21.876103 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:21.876104    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2psp\" (UniqueName: \"kubernetes.io/projected/dce7a6bf-7f71-4347-8ad3-4f95132100c5-kube-api-access-r2psp\") pod \"payload-processing-e2e-inf-a-1038cd-588f96c9f9-prwl4\" (UID: \"dce7a6bf-7f71-4347-8ad3-4f95132100c5\") " pod="openshift-ingress/payload-processing-e2e-inf-a-1038cd-588f96c9f9-prwl4"
Sep 07 04:00:21.876671 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:21.876130    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vknt6\" (UniqueName: \"kubernetes.io/projected/9e43d079-07bb-4e1e-93bd-49c558a868f7-kube-api-access-vknt6\") pod \"payload-pre-processing-e2e-inf-a-1038cd-6785489774-t66c4\" (UID: \"9e43d079-07bb-4e1e-93bd-49c558a868f7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1038cd-6785489774-t66c4"
Sep 07 04:00:21.876671 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:21.876211    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dce7a6bf-7f71-4347-8ad3-4f95132100c5-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-1038cd-588f96c9f9-prwl4\" (UID: \"dce7a6bf-7f71-4347-8ad3-4f95132100c5\") " pod="openshift-ingress/payload-processing-e2e-inf-a-1038cd-588f96c9f9-prwl4"
Sep 07 04:00:21.977307 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:21.977230    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e43d079-07bb-4e1e-93bd-49c558a868f7-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-1038cd-6785489774-t66c4\" (UID: \"9e43d079-07bb-4e1e-93bd-49c558a868f7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1038cd-6785489774-t66c4"
Sep 07 04:00:21.977307 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:21.977270    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2psp\" (UniqueName: \"kubernetes.io/projected/dce7a6bf-7f71-4347-8ad3-4f95132100c5-kube-api-access-r2psp\") pod \"payload-processing-e2e-inf-a-1038cd-588f96c9f9-prwl4\" (UID: \"dce7a6bf-7f71-4347-8ad3-4f95132100c5\") " pod="openshift-ingress/payload-processing-e2e-inf-a-1038cd-588f96c9f9-prwl4"
Sep 07 04:00:21.977538 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:21.977389    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vknt6\" (UniqueName: \"kubernetes.io/projected/9e43d079-07bb-4e1e-93bd-49c558a868f7-kube-api-access-vknt6\") pod \"payload-pre-processing-e2e-inf-a-1038cd-6785489774-t66c4\" (UID: \"9e43d079-07bb-4e1e-93bd-49c558a868f7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1038cd-6785489774-t66c4"
Sep 07 04:00:21.977630 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:21.977569    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dce7a6bf-7f71-4347-8ad3-4f95132100c5-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-1038cd-588f96c9f9-prwl4\" (UID: \"dce7a6bf-7f71-4347-8ad3-4f95132100c5\") " pod="openshift-ingress/payload-processing-e2e-inf-a-1038cd-588f96c9f9-prwl4"
Sep 07 04:00:21.978168 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:21.978142    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e43d079-07bb-4e1e-93bd-49c558a868f7-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-1038cd-6785489774-t66c4\" (UID: \"9e43d079-07bb-4e1e-93bd-49c558a868f7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1038cd-6785489774-t66c4"
Sep 07 04:00:21.978315 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:21.978296    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dce7a6bf-7f71-4347-8ad3-4f95132100c5-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-1038cd-588f96c9f9-prwl4\" (UID: \"dce7a6bf-7f71-4347-8ad3-4f95132100c5\") " pod="openshift-ingress/payload-processing-e2e-inf-a-1038cd-588f96c9f9-prwl4"
Sep 07 04:00:21.985566 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:21.985539    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2psp\" (UniqueName: \"kubernetes.io/projected/dce7a6bf-7f71-4347-8ad3-4f95132100c5-kube-api-access-r2psp\") pod \"payload-processing-e2e-inf-a-1038cd-588f96c9f9-prwl4\" (UID: \"dce7a6bf-7f71-4347-8ad3-4f95132100c5\") " pod="openshift-ingress/payload-processing-e2e-inf-a-1038cd-588f96c9f9-prwl4"
Sep 07 04:00:21.985718 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:21.985699    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vknt6\" (UniqueName: \"kubernetes.io/projected/9e43d079-07bb-4e1e-93bd-49c558a868f7-kube-api-access-vknt6\") pod \"payload-pre-processing-e2e-inf-a-1038cd-6785489774-t66c4\" (UID: \"9e43d079-07bb-4e1e-93bd-49c558a868f7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1038cd-6785489774-t66c4"
Sep 07 04:00:22.008460 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:22.008441    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7365-139773466596400"
Sep 07 04:00:22.038068 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:22.038042    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1038cd-6785489774-t66c4"
Sep 07 04:00:22.043567 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:22.043545    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7365-139773466596400_5909fe53-d184-4656-abb0-49ed9d043556/test-curl-7365-139773466596400/0.log"
Sep 07 04:00:22.064731 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:22.064702    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7365-139773466596400"]
Sep 07 04:00:22.068031 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:22.068005    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7365-139773466596400"]
Sep 07 04:00:22.085834 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:22.085812    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-1038cd-588f96c9f9-prwl4"
Sep 07 04:00:22.180316 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:22.180283    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jr9ts\" (UniqueName: \"kubernetes.io/projected/5909fe53-d184-4656-abb0-49ed9d043556-kube-api-access-jr9ts\") pod \"5909fe53-d184-4656-abb0-49ed9d043556\" (UID: \"5909fe53-d184-4656-abb0-49ed9d043556\") "
Sep 07 04:00:22.182302 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:22.182280    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5909fe53-d184-4656-abb0-49ed9d043556-kube-api-access-jr9ts" (OuterVolumeSpecName: "kube-api-access-jr9ts") pod "5909fe53-d184-4656-abb0-49ed9d043556" (UID: "5909fe53-d184-4656-abb0-49ed9d043556"). InnerVolumeSpecName "kube-api-access-jr9ts". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 04:00:22.281849 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:22.281775    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jr9ts\" (UniqueName: \"kubernetes.io/projected/5909fe53-d184-4656-abb0-49ed9d043556-kube-api-access-jr9ts\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:00:22.309784 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:22.309759    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-1038cd-6785489774-t66c4"]
Sep 07 04:00:22.310992 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:00:22.310965    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e43d079_07bb_4e1e_93bd_49c558a868f7.slice/crio-98401f8f97badda9413fcdac60ccb33b6724f71007fd3e5b7b3eee2c239cc25c WatchSource:0}: Error finding container 98401f8f97badda9413fcdac60ccb33b6724f71007fd3e5b7b3eee2c239cc25c: Status 404 returned error can't find the container with id 98401f8f97badda9413fcdac60ccb33b6724f71007fd3e5b7b3eee2c239cc25c
Sep 07 04:00:22.371019 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:22.370996    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-1038cd-588f96c9f9-prwl4"]
Sep 07 04:00:22.373379 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:00:22.373344    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddce7a6bf_7f71_4347_8ad3_4f95132100c5.slice/crio-1f9a52fc1f350dd36f3c9901f128bb35b7f3d2bdce2fe8bcb30d9ed90572b6d2 WatchSource:0}: Error finding container 1f9a52fc1f350dd36f3c9901f128bb35b7f3d2bdce2fe8bcb30d9ed90572b6d2: Status 404 returned error can't find the container with id 1f9a52fc1f350dd36f3c9901f128bb35b7f3d2bdce2fe8bcb30d9ed90572b6d2
Sep 07 04:00:22.886636 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:22.886575    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-1038cd-588f96c9f9-prwl4" event={"ID":"dce7a6bf-7f71-4347-8ad3-4f95132100c5","Type":"ContainerStarted","Data":"7d7efaeb6972ba9dd1c1f73f01b67905bf6f66e946968f2268304a49771513b6"}
Sep 07 04:00:22.887030 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:22.886667    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-1038cd-588f96c9f9-prwl4"
Sep 07 04:00:22.887030 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:22.886694    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-1038cd-588f96c9f9-prwl4" event={"ID":"dce7a6bf-7f71-4347-8ad3-4f95132100c5","Type":"ContainerStarted","Data":"1f9a52fc1f350dd36f3c9901f128bb35b7f3d2bdce2fe8bcb30d9ed90572b6d2"}
Sep 07 04:00:22.888244 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:22.888221    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7365-139773466596400"
Sep 07 04:00:22.888368 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:22.888227    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4565dc4faa978c327dea169dcc9db0c180de5101941240c64607da6c176e20b8"
Sep 07 04:00:22.889767 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:22.889743    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1038cd-6785489774-t66c4" event={"ID":"9e43d079-07bb-4e1e-93bd-49c558a868f7","Type":"ContainerStarted","Data":"15c5b9d1b2c634d8416a7516c2b0fab9c78c52b9288c740cf051b121bf09546f"}
Sep 07 04:00:22.889891 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:22.889788    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1038cd-6785489774-t66c4" event={"ID":"9e43d079-07bb-4e1e-93bd-49c558a868f7","Type":"ContainerStarted","Data":"98401f8f97badda9413fcdac60ccb33b6724f71007fd3e5b7b3eee2c239cc25c"}
Sep 07 04:00:22.889943 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:22.889889    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1038cd-6785489774-t66c4"
Sep 07 04:00:22.905348 ip-10-0-132-4 kubenswrapper[2559]: E0907 04:00:22.905316    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7365-139773466596400\" is forbidden: User \"system:node:ip-10-0-132-4.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-4.ec2.internal' and this object" podUID="5909fe53-d184-4656-abb0-49ed9d043556" pod="opendatahub/test-curl-7365-139773466596400"
Sep 07 04:00:22.906029 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:22.905990    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-1038cd-588f96c9f9-prwl4" podStartSLOduration=1.905977109 podStartE2EDuration="1.905977109s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:00:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:00:22.903593365 +0000 UTC m=+726.216069266" watchObservedRunningTime="2026-09-07 04:00:22.905977109 +0000 UTC m=+726.218453010"
Sep 07 04:00:22.923614 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:22.923567    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1038cd-6785489774-t66c4" podStartSLOduration=1.923551711 podStartE2EDuration="1.923551711s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:00:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:00:22.923092162 +0000 UTC m=+726.235568078" watchObservedRunningTime="2026-09-07 04:00:22.923551711 +0000 UTC m=+726.236027614"
Sep 07 04:00:23.180416 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:23.180331    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5909fe53-d184-4656-abb0-49ed9d043556" path="/var/lib/kubelet/pods/5909fe53-d184-4656-abb0-49ed9d043556/volumes"
Sep 07 04:00:24.283452 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:24.283417    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt"]
Sep 07 04:00:24.283975 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:24.283941    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5909fe53-d184-4656-abb0-49ed9d043556" containerName="test-curl-7365-139773466596400"
Sep 07 04:00:24.283975 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:24.283959    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5909fe53-d184-4656-abb0-49ed9d043556" containerName="test-curl-7365-139773466596400"
Sep 07 04:00:24.284089 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:24.284029    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5909fe53-d184-4656-abb0-49ed9d043556" containerName="test-curl-7365-139773466596400"
Sep 07 04:00:24.287515 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:24.287491    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt"
Sep 07 04:00:24.289433 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:24.289408    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-64f80f33-openshift-default-dockercfg-6gk9c\""
Sep 07 04:00:24.301382 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:24.301347    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt"]
Sep 07 04:00:24.401157 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:24.401119    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e2acf22-9700-4104-b346-6f44a0a09fd7-credential-socket\") pod \"e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt\" (UID: \"0e2acf22-9700-4104-b346-6f44a0a09fd7\") " pod="openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt"
Sep 07 04:00:24.401306 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:24.401172    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e2acf22-9700-4104-b346-6f44a0a09fd7-istio-token\") pod \"e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt\" (UID: \"0e2acf22-9700-4104-b346-6f44a0a09fd7\") " pod="openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt"
Sep 07 04:00:24.401306 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:24.401211    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e2acf22-9700-4104-b346-6f44a0a09fd7-workload-socket\") pod \"e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt\" (UID: \"0e2acf22-9700-4104-b346-6f44a0a09fd7\") " pod="openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt"
Sep 07 04:00:24.401384 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:24.401327    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlkvg\" (UniqueName: \"kubernetes.io/projected/0e2acf22-9700-4104-b346-6f44a0a09fd7-kube-api-access-nlkvg\") pod \"e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt\" (UID: \"0e2acf22-9700-4104-b346-6f44a0a09fd7\") " pod="openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt"
Sep 07 04:00:24.401442 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:24.401411    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e2acf22-9700-4104-b346-6f44a0a09fd7-istio-envoy\") pod \"e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt\" (UID: \"0e2acf22-9700-4104-b346-6f44a0a09fd7\") " pod="openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt"
Sep 07 04:00:24.401442 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:24.401437    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e2acf22-9700-4104-b346-6f44a0a09fd7-istiod-ca-cert\") pod \"e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt\" (UID: \"0e2acf22-9700-4104-b346-6f44a0a09fd7\") " pod="openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt"
Sep 07 04:00:24.401541 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:24.401504    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e2acf22-9700-4104-b346-6f44a0a09fd7-istio-podinfo\") pod \"e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt\" (UID: \"0e2acf22-9700-4104-b346-6f44a0a09fd7\") " pod="openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt"
Sep 07 04:00:24.401593 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:24.401554    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e2acf22-9700-4104-b346-6f44a0a09fd7-workload-certs\") pod \"e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt\" (UID: \"0e2acf22-9700-4104-b346-6f44a0a09fd7\") " pod="openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt"
Sep 07 04:00:24.401593 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:24.401584    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e2acf22-9700-4104-b346-6f44a0a09fd7-istio-data\") pod \"e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt\" (UID: \"0e2acf22-9700-4104-b346-6f44a0a09fd7\") " pod="openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt"
Sep 07 04:00:24.502935 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:24.502905    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e2acf22-9700-4104-b346-6f44a0a09fd7-workload-socket\") pod \"e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt\" (UID: \"0e2acf22-9700-4104-b346-6f44a0a09fd7\") " pod="openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt"
Sep 07 04:00:24.503132 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:24.502961    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlkvg\" (UniqueName: \"kubernetes.io/projected/0e2acf22-9700-4104-b346-6f44a0a09fd7-kube-api-access-nlkvg\") pod \"e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt\" (UID: \"0e2acf22-9700-4104-b346-6f44a0a09fd7\") " pod="openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt"
Sep 07 04:00:24.503132 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:24.503014    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e2acf22-9700-4104-b346-6f44a0a09fd7-istio-envoy\") pod \"e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt\" (UID: \"0e2acf22-9700-4104-b346-6f44a0a09fd7\") " pod="openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt"
Sep 07 04:00:24.503132 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:24.503044    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e2acf22-9700-4104-b346-6f44a0a09fd7-istiod-ca-cert\") pod \"e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt\" (UID: \"0e2acf22-9700-4104-b346-6f44a0a09fd7\") " pod="openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt"
Sep 07 04:00:24.503315 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:24.503233    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e2acf22-9700-4104-b346-6f44a0a09fd7-istio-podinfo\") pod \"e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt\" (UID: \"0e2acf22-9700-4104-b346-6f44a0a09fd7\") " pod="openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt"
Sep 07 04:00:24.503315 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:24.503287    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e2acf22-9700-4104-b346-6f44a0a09fd7-workload-certs\") pod \"e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt\" (UID: \"0e2acf22-9700-4104-b346-6f44a0a09fd7\") " pod="openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt"
Sep 07 04:00:24.503426 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:24.503316    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e2acf22-9700-4104-b346-6f44a0a09fd7-istio-data\") pod \"e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt\" (UID: \"0e2acf22-9700-4104-b346-6f44a0a09fd7\") " pod="openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt"
Sep 07 04:00:24.503426 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:24.503363    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e2acf22-9700-4104-b346-6f44a0a09fd7-workload-socket\") pod \"e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt\" (UID: \"0e2acf22-9700-4104-b346-6f44a0a09fd7\") " pod="openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt"
Sep 07 04:00:24.503426 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:24.503381    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e2acf22-9700-4104-b346-6f44a0a09fd7-credential-socket\") pod \"e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt\" (UID: \"0e2acf22-9700-4104-b346-6f44a0a09fd7\") " pod="openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt"
Sep 07 04:00:24.503426 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:24.503418    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e2acf22-9700-4104-b346-6f44a0a09fd7-istio-token\") pod \"e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt\" (UID: \"0e2acf22-9700-4104-b346-6f44a0a09fd7\") " pod="openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt"
Sep 07 04:00:24.503684 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:24.503635    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e2acf22-9700-4104-b346-6f44a0a09fd7-workload-certs\") pod \"e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt\" (UID: \"0e2acf22-9700-4104-b346-6f44a0a09fd7\") " pod="openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt"
Sep 07 04:00:24.503684 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:24.503675    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e2acf22-9700-4104-b346-6f44a0a09fd7-istio-data\") pod \"e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt\" (UID: \"0e2acf22-9700-4104-b346-6f44a0a09fd7\") " pod="openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt"
Sep 07 04:00:24.503825 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:24.503803    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e2acf22-9700-4104-b346-6f44a0a09fd7-istiod-ca-cert\") pod \"e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt\" (UID: \"0e2acf22-9700-4104-b346-6f44a0a09fd7\") " pod="openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt"
Sep 07 04:00:24.503883 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:24.503844    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e2acf22-9700-4104-b346-6f44a0a09fd7-credential-socket\") pod \"e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt\" (UID: \"0e2acf22-9700-4104-b346-6f44a0a09fd7\") " pod="openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt"
Sep 07 04:00:24.505195 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:24.505165    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e2acf22-9700-4104-b346-6f44a0a09fd7-istio-envoy\") pod \"e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt\" (UID: \"0e2acf22-9700-4104-b346-6f44a0a09fd7\") " pod="openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt"
Sep 07 04:00:24.505637 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:24.505601    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e2acf22-9700-4104-b346-6f44a0a09fd7-istio-podinfo\") pod \"e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt\" (UID: \"0e2acf22-9700-4104-b346-6f44a0a09fd7\") " pod="openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt"
Sep 07 04:00:24.510841 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:24.510814    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlkvg\" (UniqueName: \"kubernetes.io/projected/0e2acf22-9700-4104-b346-6f44a0a09fd7-kube-api-access-nlkvg\") pod \"e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt\" (UID: \"0e2acf22-9700-4104-b346-6f44a0a09fd7\") " pod="openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt"
Sep 07 04:00:24.510936 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:24.510906    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e2acf22-9700-4104-b346-6f44a0a09fd7-istio-token\") pod \"e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt\" (UID: \"0e2acf22-9700-4104-b346-6f44a0a09fd7\") " pod="openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt"
Sep 07 04:00:24.597866 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:24.597789    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt"
Sep 07 04:00:24.876828 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:24.876805    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt"]
Sep 07 04:00:24.878539 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:00:24.878510    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e2acf22_9700_4104_b346_6f44a0a09fd7.slice/crio-3ec3e89a77e988b73a74be9fad8527b048f2efe161e22ceddde318219fd01173 WatchSource:0}: Error finding container 3ec3e89a77e988b73a74be9fad8527b048f2efe161e22ceddde318219fd01173: Status 404 returned error can't find the container with id 3ec3e89a77e988b73a74be9fad8527b048f2efe161e22ceddde318219fd01173
Sep 07 04:00:24.880782 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:24.880748    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 04:00:24.880868 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:24.880817    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 04:00:24.880868 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:24.880846    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 04:00:24.904382 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:24.904359    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt" event={"ID":"0e2acf22-9700-4104-b346-6f44a0a09fd7","Type":"ContainerStarted","Data":"3ec3e89a77e988b73a74be9fad8527b048f2efe161e22ceddde318219fd01173"}
Sep 07 04:00:25.911028 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:25.910985    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt" event={"ID":"0e2acf22-9700-4104-b346-6f44a0a09fd7","Type":"ContainerStarted","Data":"0b8a9637224ad32202cf4a3702ff646900544b6470591bb71a8fdd84fbdb4660"}
Sep 07 04:00:25.931741 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:25.931685    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt" podStartSLOduration=1.931669474 podStartE2EDuration="1.931669474s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:00:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:00:25.928528648 +0000 UTC m=+729.241004567" watchObservedRunningTime="2026-09-07 04:00:25.931669474 +0000 UTC m=+729.244145375"
Sep 07 04:00:26.598461 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:26.598419    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt"
Sep 07 04:00:26.603583 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:26.603560    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt"
Sep 07 04:00:26.916535 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:26.916499    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt"
Sep 07 04:00:26.917638 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:26.917599    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt"
Sep 07 04:00:28.967266 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:28.967217    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-64f80f33-779b88cb6b-rjhwf"]
Sep 07 04:00:28.971352 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:28.971329    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-64f80f33-779b88cb6b-rjhwf"
Sep 07 04:00:28.973343 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:28.973322    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-64f80f33\""
Sep 07 04:00:28.973458 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:28.973441    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-64f80f33-dockercfg-rpvfk\""
Sep 07 04:00:28.981534 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:28.981508    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-64f80f33-779b88cb6b-rjhwf"]
Sep 07 04:00:29.152100 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:29.152050    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppwml\" (UniqueName: \"kubernetes.io/projected/99c0d73f-2698-4db1-a38a-5ab512c71e48-kube-api-access-ppwml\") pod \"payload-pre-processing-e2e-ait-64f80f33-779b88cb6b-rjhwf\" (UID: \"99c0d73f-2698-4db1-a38a-5ab512c71e48\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-64f80f33-779b88cb6b-rjhwf"
Sep 07 04:00:29.152362 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:29.152124    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/99c0d73f-2698-4db1-a38a-5ab512c71e48-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-64f80f33-779b88cb6b-rjhwf\" (UID: \"99c0d73f-2698-4db1-a38a-5ab512c71e48\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-64f80f33-779b88cb6b-rjhwf"
Sep 07 04:00:29.253019 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:29.252903    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppwml\" (UniqueName: \"kubernetes.io/projected/99c0d73f-2698-4db1-a38a-5ab512c71e48-kube-api-access-ppwml\") pod \"payload-pre-processing-e2e-ait-64f80f33-779b88cb6b-rjhwf\" (UID: \"99c0d73f-2698-4db1-a38a-5ab512c71e48\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-64f80f33-779b88cb6b-rjhwf"
Sep 07 04:00:29.253019 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:29.252988    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/99c0d73f-2698-4db1-a38a-5ab512c71e48-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-64f80f33-779b88cb6b-rjhwf\" (UID: \"99c0d73f-2698-4db1-a38a-5ab512c71e48\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-64f80f33-779b88cb6b-rjhwf"
Sep 07 04:00:29.254042 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:29.254009    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/99c0d73f-2698-4db1-a38a-5ab512c71e48-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-64f80f33-779b88cb6b-rjhwf\" (UID: \"99c0d73f-2698-4db1-a38a-5ab512c71e48\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-64f80f33-779b88cb6b-rjhwf"
Sep 07 04:00:29.262507 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:29.262474    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppwml\" (UniqueName: \"kubernetes.io/projected/99c0d73f-2698-4db1-a38a-5ab512c71e48-kube-api-access-ppwml\") pod \"payload-pre-processing-e2e-ait-64f80f33-779b88cb6b-rjhwf\" (UID: \"99c0d73f-2698-4db1-a38a-5ab512c71e48\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-64f80f33-779b88cb6b-rjhwf"
Sep 07 04:00:29.283331 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:29.283277    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-64f80f33-779b88cb6b-rjhwf"
Sep 07 04:00:29.566167 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:29.566129    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-64f80f33-779b88cb6b-rjhwf"]
Sep 07 04:00:29.567381 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:00:29.567354    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99c0d73f_2698_4db1_a38a_5ab512c71e48.slice/crio-03e32410295d94b8453942e63ee3d8a6f44d1527e23bc7916abd4121baf7829d WatchSource:0}: Error finding container 03e32410295d94b8453942e63ee3d8a6f44d1527e23bc7916abd4121baf7829d: Status 404 returned error can't find the container with id 03e32410295d94b8453942e63ee3d8a6f44d1527e23bc7916abd4121baf7829d
Sep 07 04:00:29.935365 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:29.934383    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-64f80f33-779b88cb6b-rjhwf" event={"ID":"99c0d73f-2698-4db1-a38a-5ab512c71e48","Type":"ContainerStarted","Data":"05245304d09a0554422f2df930999328b0fa24b34a921dc8a9157c618d1d26ca"}
Sep 07 04:00:29.935365 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:29.934458    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-64f80f33-779b88cb6b-rjhwf" event={"ID":"99c0d73f-2698-4db1-a38a-5ab512c71e48","Type":"ContainerStarted","Data":"03e32410295d94b8453942e63ee3d8a6f44d1527e23bc7916abd4121baf7829d"}
Sep 07 04:00:29.935365 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:29.935304    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-64f80f33-779b88cb6b-rjhwf"
Sep 07 04:00:29.951949 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:29.951891    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-64f80f33-779b88cb6b-rjhwf" podStartSLOduration=1.951870833 podStartE2EDuration="1.951870833s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:00:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:00:29.950886014 +0000 UTC m=+733.263361916" watchObservedRunningTime="2026-09-07 04:00:29.951870833 +0000 UTC m=+733.264346736"
Sep 07 04:00:32.426968 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:32.426932    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-908959-bb85d8f58-jn5qn"]
Sep 07 04:00:32.430655 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:32.430614    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-908959-bb85d8f58-jn5qn"
Sep 07 04:00:32.441682 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:32.441651    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-908959\""
Sep 07 04:00:32.442913 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:32.442365    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-908959-b84ff9dd5-z2wd9"]
Sep 07 04:00:32.451644 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:32.451168    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-908959-b84ff9dd5-z2wd9"
Sep 07 04:00:32.456642 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:32.454052    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-908959-bb85d8f58-jn5qn"]
Sep 07 04:00:32.456642 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:32.454602    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-908959-dockercfg-x6fqx\""
Sep 07 04:00:32.466666 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:32.466638    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-908959-b84ff9dd5-z2wd9"]
Sep 07 04:00:32.488575 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:32.488544    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ff538f1-8742-4977-81e2-9409347e1141-plugins-config-volume\") pod \"payload-processing-e2e-autores-908959-b84ff9dd5-z2wd9\" (UID: \"4ff538f1-8742-4977-81e2-9409347e1141\") " pod="openshift-ingress/payload-processing-e2e-autores-908959-b84ff9dd5-z2wd9"
Sep 07 04:00:32.488754 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:32.488588    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmmkg\" (UniqueName: \"kubernetes.io/projected/b825b52e-4c53-4e29-b81d-790c02c79f44-kube-api-access-zmmkg\") pod \"payload-pre-processing-e2e-autores-908959-bb85d8f58-jn5qn\" (UID: \"b825b52e-4c53-4e29-b81d-790c02c79f44\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-908959-bb85d8f58-jn5qn"
Sep 07 04:00:32.488754 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:32.488646    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6f25\" (UniqueName: \"kubernetes.io/projected/4ff538f1-8742-4977-81e2-9409347e1141-kube-api-access-f6f25\") pod \"payload-processing-e2e-autores-908959-b84ff9dd5-z2wd9\" (UID: \"4ff538f1-8742-4977-81e2-9409347e1141\") " pod="openshift-ingress/payload-processing-e2e-autores-908959-b84ff9dd5-z2wd9"
Sep 07 04:00:32.488754 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:32.488715    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b825b52e-4c53-4e29-b81d-790c02c79f44-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-908959-bb85d8f58-jn5qn\" (UID: \"b825b52e-4c53-4e29-b81d-790c02c79f44\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-908959-bb85d8f58-jn5qn"
Sep 07 04:00:32.589730 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:32.589692    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ff538f1-8742-4977-81e2-9409347e1141-plugins-config-volume\") pod \"payload-processing-e2e-autores-908959-b84ff9dd5-z2wd9\" (UID: \"4ff538f1-8742-4977-81e2-9409347e1141\") " pod="openshift-ingress/payload-processing-e2e-autores-908959-b84ff9dd5-z2wd9"
Sep 07 04:00:32.589942 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:32.589762    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmmkg\" (UniqueName: \"kubernetes.io/projected/b825b52e-4c53-4e29-b81d-790c02c79f44-kube-api-access-zmmkg\") pod \"payload-pre-processing-e2e-autores-908959-bb85d8f58-jn5qn\" (UID: \"b825b52e-4c53-4e29-b81d-790c02c79f44\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-908959-bb85d8f58-jn5qn"
Sep 07 04:00:32.589942 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:32.589831    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6f25\" (UniqueName: \"kubernetes.io/projected/4ff538f1-8742-4977-81e2-9409347e1141-kube-api-access-f6f25\") pod \"payload-processing-e2e-autores-908959-b84ff9dd5-z2wd9\" (UID: \"4ff538f1-8742-4977-81e2-9409347e1141\") " pod="openshift-ingress/payload-processing-e2e-autores-908959-b84ff9dd5-z2wd9"
Sep 07 04:00:32.589942 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:32.589886    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b825b52e-4c53-4e29-b81d-790c02c79f44-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-908959-bb85d8f58-jn5qn\" (UID: \"b825b52e-4c53-4e29-b81d-790c02c79f44\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-908959-bb85d8f58-jn5qn"
Sep 07 04:00:32.590959 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:32.590931    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b825b52e-4c53-4e29-b81d-790c02c79f44-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-908959-bb85d8f58-jn5qn\" (UID: \"b825b52e-4c53-4e29-b81d-790c02c79f44\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-908959-bb85d8f58-jn5qn"
Sep 07 04:00:32.591150 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:32.591094    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ff538f1-8742-4977-81e2-9409347e1141-plugins-config-volume\") pod \"payload-processing-e2e-autores-908959-b84ff9dd5-z2wd9\" (UID: \"4ff538f1-8742-4977-81e2-9409347e1141\") " pod="openshift-ingress/payload-processing-e2e-autores-908959-b84ff9dd5-z2wd9"
Sep 07 04:00:32.599043 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:32.599015    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmmkg\" (UniqueName: \"kubernetes.io/projected/b825b52e-4c53-4e29-b81d-790c02c79f44-kube-api-access-zmmkg\") pod \"payload-pre-processing-e2e-autores-908959-bb85d8f58-jn5qn\" (UID: \"b825b52e-4c53-4e29-b81d-790c02c79f44\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-908959-bb85d8f58-jn5qn"
Sep 07 04:00:32.599163 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:32.599015    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6f25\" (UniqueName: \"kubernetes.io/projected/4ff538f1-8742-4977-81e2-9409347e1141-kube-api-access-f6f25\") pod \"payload-processing-e2e-autores-908959-b84ff9dd5-z2wd9\" (UID: \"4ff538f1-8742-4977-81e2-9409347e1141\") " pod="openshift-ingress/payload-processing-e2e-autores-908959-b84ff9dd5-z2wd9"
Sep 07 04:00:32.746532 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:32.746434    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-908959-bb85d8f58-jn5qn"
Sep 07 04:00:32.781971 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:32.781859    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-908959-b84ff9dd5-z2wd9"
Sep 07 04:00:33.027804 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:33.027781    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-908959-bb85d8f58-jn5qn"]
Sep 07 04:00:33.029030 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:00:33.029004    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb825b52e_4c53_4e29_b81d_790c02c79f44.slice/crio-014e67149f0017584ad6cfef81b333751432de720af033ff3b6e64afecce7793 WatchSource:0}: Error finding container 014e67149f0017584ad6cfef81b333751432de720af033ff3b6e64afecce7793: Status 404 returned error can't find the container with id 014e67149f0017584ad6cfef81b333751432de720af033ff3b6e64afecce7793
Sep 07 04:00:33.105565 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:33.105537    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-908959-b84ff9dd5-z2wd9"]
Sep 07 04:00:33.113801 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:00:33.113774    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ff538f1_8742_4977_81e2_9409347e1141.slice/crio-a55228c4bc304ad36b658f929746ce8e13f46127afa804ac7f8a062e87e6971b WatchSource:0}: Error finding container a55228c4bc304ad36b658f929746ce8e13f46127afa804ac7f8a062e87e6971b: Status 404 returned error can't find the container with id a55228c4bc304ad36b658f929746ce8e13f46127afa804ac7f8a062e87e6971b
Sep 07 04:00:33.899285 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:33.899249    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-1038cd-588f96c9f9-prwl4"
Sep 07 04:00:33.899779 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:33.899412    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1038cd-6785489774-t66c4"
Sep 07 04:00:33.986384 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:33.986331    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-908959-bb85d8f58-jn5qn" event={"ID":"b825b52e-4c53-4e29-b81d-790c02c79f44","Type":"ContainerStarted","Data":"4682ef187c041e5f4109d93d1ec939200456044a7d98bb38cd600c8566fab3b1"}
Sep 07 04:00:33.986721 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:33.986694    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-908959-bb85d8f58-jn5qn" event={"ID":"b825b52e-4c53-4e29-b81d-790c02c79f44","Type":"ContainerStarted","Data":"014e67149f0017584ad6cfef81b333751432de720af033ff3b6e64afecce7793"}
Sep 07 04:00:33.987895 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:33.987876    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-908959-bb85d8f58-jn5qn"
Sep 07 04:00:34.008091 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:34.007592    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-908959-b84ff9dd5-z2wd9" event={"ID":"4ff538f1-8742-4977-81e2-9409347e1141","Type":"ContainerStarted","Data":"384a92f6849343a913c58d57788eda46b2d31693bb22554553fa858f367907f2"}
Sep 07 04:00:34.008091 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:34.007704    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-908959-b84ff9dd5-z2wd9" event={"ID":"4ff538f1-8742-4977-81e2-9409347e1141","Type":"ContainerStarted","Data":"a55228c4bc304ad36b658f929746ce8e13f46127afa804ac7f8a062e87e6971b"}
Sep 07 04:00:34.008309 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:34.008194    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-908959-b84ff9dd5-z2wd9"
Sep 07 04:00:34.012310 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:34.012256    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-autores-908959-bb85d8f58-jn5qn" podStartSLOduration=2.012238497 podStartE2EDuration="2.012238497s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:00:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:00:34.009923058 +0000 UTC m=+737.322398962" watchObservedRunningTime="2026-09-07 04:00:34.012238497 +0000 UTC m=+737.324714403"
Sep 07 04:00:34.029491 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:34.029439    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-908959-b84ff9dd5-z2wd9" podStartSLOduration=2.029420726 podStartE2EDuration="2.029420726s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:00:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:00:34.028696027 +0000 UTC m=+737.341171956" watchObservedRunningTime="2026-09-07 04:00:34.029420726 +0000 UTC m=+737.341896632"
Sep 07 04:00:35.907827 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:35.907780    2559 patch_prober.go:28] interesting pod/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 07 04:00:35.908219 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:35.907848    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6" podUID="6baa400b-c2af-4549-a34d-c1e4bc37bf8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 07 04:00:38.032546 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:38.032459    2559 generic.go:356] "Generic (PLEG): container finished" podID="6baa400b-c2af-4549-a34d-c1e4bc37bf8e" containerID="d2b9edf7513f901b6267868c4bac16503f4796b7f5bf80c707f2e227548daeae" exitCode=0
Sep 07 04:00:38.032546 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:38.032535    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6" event={"ID":"6baa400b-c2af-4549-a34d-c1e4bc37bf8e","Type":"ContainerDied","Data":"d2b9edf7513f901b6267868c4bac16503f4796b7f5bf80c707f2e227548daeae"}
Sep 07 04:00:38.033017 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:38.032943    2559 scope.go:117] "RemoveContainer" containerID="d2b9edf7513f901b6267868c4bac16503f4796b7f5bf80c707f2e227548daeae"
Sep 07 04:00:38.034191 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:38.034145    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 04:00:38.034308 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:38.034245    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 04:00:38.034308 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:38.034295    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 04:00:39.048009 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:39.047973    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6" event={"ID":"6baa400b-c2af-4549-a34d-c1e4bc37bf8e","Type":"ContainerStarted","Data":"6a529da645ee5659188edac29298cf541ed34e473d02c48e64d5a60c57393543"}
Sep 07 04:00:39.944731 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:39.944676    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6"
Sep 07 04:00:39.944957 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:39.944743    2559 patch_prober.go:28] interesting pod/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 07 04:00:39.944957 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:39.944804    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6" podUID="6baa400b-c2af-4549-a34d-c1e4bc37bf8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 07 04:00:40.959295 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:40.959257    2559 patch_prober.go:28] interesting pod/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 07 04:00:40.959731 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:40.959327    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6" podUID="6baa400b-c2af-4549-a34d-c1e4bc37bf8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 07 04:00:41.944149 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:41.944112    2559 patch_prober.go:28] interesting pod/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 07 04:00:41.944434 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:41.944400    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6" podUID="6baa400b-c2af-4549-a34d-c1e4bc37bf8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 07 04:00:41.955685 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:41.954775    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-64f80f33-779b88cb6b-rjhwf"
Sep 07 04:00:42.945645 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:42.944583    2559 patch_prober.go:28] interesting pod/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 07 04:00:42.945645 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:42.944671    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6" podUID="6baa400b-c2af-4549-a34d-c1e4bc37bf8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 07 04:00:42.958809 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:42.958770    2559 patch_prober.go:28] interesting pod/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 07 04:00:42.958997 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:42.958833    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt" podUID="0e2acf22-9700-4104-b346-6f44a0a09fd7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 07 04:00:43.944953 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:43.944914    2559 patch_prober.go:28] interesting pod/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 07 04:00:43.945688 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:43.945227    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6" podUID="6baa400b-c2af-4549-a34d-c1e4bc37bf8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 07 04:00:44.973775 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:44.973683    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6"
Sep 07 04:00:44.974280 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:44.974075    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6"
Sep 07 04:00:44.975752 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:44.975720    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6"
Sep 07 04:00:45.087268 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:45.087239    2559 generic.go:356] "Generic (PLEG): container finished" podID="0e2acf22-9700-4104-b346-6f44a0a09fd7" containerID="0b8a9637224ad32202cf4a3702ff646900544b6470591bb71a8fdd84fbdb4660" exitCode=0
Sep 07 04:00:45.087441 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:45.087318    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt" event={"ID":"0e2acf22-9700-4104-b346-6f44a0a09fd7","Type":"ContainerDied","Data":"0b8a9637224ad32202cf4a3702ff646900544b6470591bb71a8fdd84fbdb4660"}
Sep 07 04:00:45.087781 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:45.087745    2559 scope.go:117] "RemoveContainer" containerID="0b8a9637224ad32202cf4a3702ff646900544b6470591bb71a8fdd84fbdb4660"
Sep 07 04:00:45.088901 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:45.088872    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 04:00:45.089015 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:45.088961    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 04:00:45.089015 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:45.089010    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 04:00:45.302812 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:45.302726    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7"]
Sep 07 04:00:45.305965 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:45.305941    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7"
Sep 07 04:00:45.308396 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:45.308372    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-a8da4e-openshift-default-dockercfg-hd7sq\""
Sep 07 04:00:45.320070 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:45.320046    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7"]
Sep 07 04:00:45.447304 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:45.447271    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hh6kj\" (UniqueName: \"kubernetes.io/projected/d49a6a62-bffc-447c-b826-0a4e89959050-kube-api-access-hh6kj\") pod \"e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7\" (UID: \"d49a6a62-bffc-447c-b826-0a4e89959050\") " pod="openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7"
Sep 07 04:00:45.447467 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:45.447332    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d49a6a62-bffc-447c-b826-0a4e89959050-credential-socket\") pod \"e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7\" (UID: \"d49a6a62-bffc-447c-b826-0a4e89959050\") " pod="openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7"
Sep 07 04:00:45.447467 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:45.447399    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d49a6a62-bffc-447c-b826-0a4e89959050-workload-certs\") pod \"e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7\" (UID: \"d49a6a62-bffc-447c-b826-0a4e89959050\") " pod="openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7"
Sep 07 04:00:45.447467 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:45.447441    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d49a6a62-bffc-447c-b826-0a4e89959050-istio-envoy\") pod \"e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7\" (UID: \"d49a6a62-bffc-447c-b826-0a4e89959050\") " pod="openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7"
Sep 07 04:00:45.447608 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:45.447479    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d49a6a62-bffc-447c-b826-0a4e89959050-istiod-ca-cert\") pod \"e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7\" (UID: \"d49a6a62-bffc-447c-b826-0a4e89959050\") " pod="openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7"
Sep 07 04:00:45.447608 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:45.447497    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d49a6a62-bffc-447c-b826-0a4e89959050-istio-data\") pod \"e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7\" (UID: \"d49a6a62-bffc-447c-b826-0a4e89959050\") " pod="openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7"
Sep 07 04:00:45.447608 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:45.447530    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d49a6a62-bffc-447c-b826-0a4e89959050-istio-token\") pod \"e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7\" (UID: \"d49a6a62-bffc-447c-b826-0a4e89959050\") " pod="openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7"
Sep 07 04:00:45.447608 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:45.447573    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d49a6a62-bffc-447c-b826-0a4e89959050-workload-socket\") pod \"e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7\" (UID: \"d49a6a62-bffc-447c-b826-0a4e89959050\") " pod="openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7"
Sep 07 04:00:45.447608 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:45.447589    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d49a6a62-bffc-447c-b826-0a4e89959050-istio-podinfo\") pod \"e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7\" (UID: \"d49a6a62-bffc-447c-b826-0a4e89959050\") " pod="openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7"
Sep 07 04:00:45.548701 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:45.548664    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d49a6a62-bffc-447c-b826-0a4e89959050-workload-socket\") pod \"e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7\" (UID: \"d49a6a62-bffc-447c-b826-0a4e89959050\") " pod="openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7"
Sep 07 04:00:45.548701 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:45.548705    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d49a6a62-bffc-447c-b826-0a4e89959050-istio-podinfo\") pod \"e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7\" (UID: \"d49a6a62-bffc-447c-b826-0a4e89959050\") " pod="openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7"
Sep 07 04:00:45.548950 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:45.548746    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hh6kj\" (UniqueName: \"kubernetes.io/projected/d49a6a62-bffc-447c-b826-0a4e89959050-kube-api-access-hh6kj\") pod \"e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7\" (UID: \"d49a6a62-bffc-447c-b826-0a4e89959050\") " pod="openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7"
Sep 07 04:00:45.548950 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:45.548800    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d49a6a62-bffc-447c-b826-0a4e89959050-credential-socket\") pod \"e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7\" (UID: \"d49a6a62-bffc-447c-b826-0a4e89959050\") " pod="openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7"
Sep 07 04:00:45.548950 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:45.548890    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d49a6a62-bffc-447c-b826-0a4e89959050-workload-certs\") pod \"e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7\" (UID: \"d49a6a62-bffc-447c-b826-0a4e89959050\") " pod="openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7"
Sep 07 04:00:45.549119 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:45.548980    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d49a6a62-bffc-447c-b826-0a4e89959050-istio-envoy\") pod \"e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7\" (UID: \"d49a6a62-bffc-447c-b826-0a4e89959050\") " pod="openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7"
Sep 07 04:00:45.549119 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:45.549032    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d49a6a62-bffc-447c-b826-0a4e89959050-istiod-ca-cert\") pod \"e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7\" (UID: \"d49a6a62-bffc-447c-b826-0a4e89959050\") " pod="openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7"
Sep 07 04:00:45.549119 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:45.549058    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d49a6a62-bffc-447c-b826-0a4e89959050-istio-data\") pod \"e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7\" (UID: \"d49a6a62-bffc-447c-b826-0a4e89959050\") " pod="openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7"
Sep 07 04:00:45.549119 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:45.549105    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d49a6a62-bffc-447c-b826-0a4e89959050-istio-token\") pod \"e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7\" (UID: \"d49a6a62-bffc-447c-b826-0a4e89959050\") " pod="openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7"
Sep 07 04:00:45.549350 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:45.549154    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d49a6a62-bffc-447c-b826-0a4e89959050-credential-socket\") pod \"e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7\" (UID: \"d49a6a62-bffc-447c-b826-0a4e89959050\") " pod="openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7"
Sep 07 04:00:45.549350 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:45.549104    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d49a6a62-bffc-447c-b826-0a4e89959050-workload-socket\") pod \"e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7\" (UID: \"d49a6a62-bffc-447c-b826-0a4e89959050\") " pod="openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7"
Sep 07 04:00:45.549350 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:45.549221    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d49a6a62-bffc-447c-b826-0a4e89959050-workload-certs\") pod \"e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7\" (UID: \"d49a6a62-bffc-447c-b826-0a4e89959050\") " pod="openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7"
Sep 07 04:00:45.549350 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:45.549327    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d49a6a62-bffc-447c-b826-0a4e89959050-istio-data\") pod \"e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7\" (UID: \"d49a6a62-bffc-447c-b826-0a4e89959050\") " pod="openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7"
Sep 07 04:00:45.550140 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:45.550063    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d49a6a62-bffc-447c-b826-0a4e89959050-istiod-ca-cert\") pod \"e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7\" (UID: \"d49a6a62-bffc-447c-b826-0a4e89959050\") " pod="openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7"
Sep 07 04:00:45.551817 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:45.551798    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d49a6a62-bffc-447c-b826-0a4e89959050-istio-envoy\") pod \"e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7\" (UID: \"d49a6a62-bffc-447c-b826-0a4e89959050\") " pod="openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7"
Sep 07 04:00:45.552078 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:45.552056    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d49a6a62-bffc-447c-b826-0a4e89959050-istio-podinfo\") pod \"e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7\" (UID: \"d49a6a62-bffc-447c-b826-0a4e89959050\") " pod="openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7"
Sep 07 04:00:45.557332 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:45.557273    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hh6kj\" (UniqueName: \"kubernetes.io/projected/d49a6a62-bffc-447c-b826-0a4e89959050-kube-api-access-hh6kj\") pod \"e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7\" (UID: \"d49a6a62-bffc-447c-b826-0a4e89959050\") " pod="openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7"
Sep 07 04:00:45.557556 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:45.557538    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d49a6a62-bffc-447c-b826-0a4e89959050-istio-token\") pod \"e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7\" (UID: \"d49a6a62-bffc-447c-b826-0a4e89959050\") " pod="openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7"
Sep 07 04:00:45.619315 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:45.619278    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7"
Sep 07 04:00:45.910283 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:45.910086    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7"]
Sep 07 04:00:45.913192 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:00:45.913163    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd49a6a62_bffc_447c_b826_0a4e89959050.slice/crio-7308c760489cc3bd531190d4dd97481a29e1a6f8c09f54b10dca61c0565053a4 WatchSource:0}: Error finding container 7308c760489cc3bd531190d4dd97481a29e1a6f8c09f54b10dca61c0565053a4: Status 404 returned error can't find the container with id 7308c760489cc3bd531190d4dd97481a29e1a6f8c09f54b10dca61c0565053a4
Sep 07 04:00:45.915657 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:45.915615    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 04:00:45.915734 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:45.915694    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 04:00:45.915734 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:45.915723    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 04:00:46.022108 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:46.022079    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-908959-b84ff9dd5-z2wd9"
Sep 07 04:00:46.022502 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:46.022158    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-908959-bb85d8f58-jn5qn"
Sep 07 04:00:46.099700 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:46.099664    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7" event={"ID":"d49a6a62-bffc-447c-b826-0a4e89959050","Type":"ContainerStarted","Data":"b9a0a48655f0a95c1e90c3c8d00510a02a13baf2fbda7d426b5fd029ad6e5ee2"}
Sep 07 04:00:46.099889 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:46.099750    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7" event={"ID":"d49a6a62-bffc-447c-b826-0a4e89959050","Type":"ContainerStarted","Data":"7308c760489cc3bd531190d4dd97481a29e1a6f8c09f54b10dca61c0565053a4"}
Sep 07 04:00:46.102949 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:46.102919    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt" event={"ID":"0e2acf22-9700-4104-b346-6f44a0a09fd7","Type":"ContainerStarted","Data":"6097c2f6bccdb8eb03412601fcc8048cd4c120cfa96d995efbbee4655e56e4cb"}
Sep 07 04:00:46.120824 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:46.120783    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7" podStartSLOduration=1.12076732 podStartE2EDuration="1.12076732s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:00:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:00:46.117987324 +0000 UTC m=+749.430463228" watchObservedRunningTime="2026-09-07 04:00:46.12076732 +0000 UTC m=+749.433243213"
Sep 07 04:00:46.598248 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:46.598219    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt"
Sep 07 04:00:46.598470 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:46.598441    2559 patch_prober.go:28] interesting pod/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 07 04:00:46.598586 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:46.598494    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt" podUID="0e2acf22-9700-4104-b346-6f44a0a09fd7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 07 04:00:46.620270 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:46.620242    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7"
Sep 07 04:00:46.621285 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:46.621256    2559 patch_prober.go:28] interesting pod/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 07 04:00:46.621391 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:46.621312    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7" podUID="d49a6a62-bffc-447c-b826-0a4e89959050" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 07 04:00:47.598551 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:47.598508    2559 patch_prober.go:28] interesting pod/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 07 04:00:47.599044 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:47.598582    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt" podUID="0e2acf22-9700-4104-b346-6f44a0a09fd7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 07 04:00:47.624061 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:47.624027    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7"
Sep 07 04:00:48.116414 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:48.116380    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7"
Sep 07 04:00:48.117489 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:48.117465    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7"
Sep 07 04:00:48.599225 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:48.599139    2559 patch_prober.go:28] interesting pod/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 07 04:00:48.599225 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:48.599199    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt" podUID="0e2acf22-9700-4104-b346-6f44a0a09fd7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 07 04:00:49.598477 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:49.598435    2559 patch_prober.go:28] interesting pod/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 07 04:00:49.598676 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:49.598493    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt" podUID="0e2acf22-9700-4104-b346-6f44a0a09fd7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 07 04:00:49.864930 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:49.864244    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-a8da4e-fc4ffddfd-5zzgm"]
Sep 07 04:00:49.867658 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:49.867613    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-a8da4e-fc4ffddfd-5zzgm"]
Sep 07 04:00:49.867776 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:49.867680    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a8da4e-fc4ffddfd-5zzgm"
Sep 07 04:00:49.869628 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:49.869593    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-a8da4e\""
Sep 07 04:00:49.869738 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:49.869649    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-a8da4e-dockercfg-wwlbj\""
Sep 07 04:00:50.007396 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:50.007351    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/345e7985-1b37-4162-8e1a-6fe74836c9c1-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-a8da4e-fc4ffddfd-5zzgm\" (UID: \"345e7985-1b37-4162-8e1a-6fe74836c9c1\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a8da4e-fc4ffddfd-5zzgm"
Sep 07 04:00:50.007589 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:50.007492    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4nm8\" (UniqueName: \"kubernetes.io/projected/345e7985-1b37-4162-8e1a-6fe74836c9c1-kube-api-access-b4nm8\") pod \"payload-pre-processing-e2e-inf-b-a8da4e-fc4ffddfd-5zzgm\" (UID: \"345e7985-1b37-4162-8e1a-6fe74836c9c1\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a8da4e-fc4ffddfd-5zzgm"
Sep 07 04:00:50.109047 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:50.109008    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/345e7985-1b37-4162-8e1a-6fe74836c9c1-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-a8da4e-fc4ffddfd-5zzgm\" (UID: \"345e7985-1b37-4162-8e1a-6fe74836c9c1\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a8da4e-fc4ffddfd-5zzgm"
Sep 07 04:00:50.109248 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:50.109085    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4nm8\" (UniqueName: \"kubernetes.io/projected/345e7985-1b37-4162-8e1a-6fe74836c9c1-kube-api-access-b4nm8\") pod \"payload-pre-processing-e2e-inf-b-a8da4e-fc4ffddfd-5zzgm\" (UID: \"345e7985-1b37-4162-8e1a-6fe74836c9c1\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a8da4e-fc4ffddfd-5zzgm"
Sep 07 04:00:50.109753 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:50.109733    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/345e7985-1b37-4162-8e1a-6fe74836c9c1-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-a8da4e-fc4ffddfd-5zzgm\" (UID: \"345e7985-1b37-4162-8e1a-6fe74836c9c1\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a8da4e-fc4ffddfd-5zzgm"
Sep 07 04:00:50.120518 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:50.120419    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4nm8\" (UniqueName: \"kubernetes.io/projected/345e7985-1b37-4162-8e1a-6fe74836c9c1-kube-api-access-b4nm8\") pod \"payload-pre-processing-e2e-inf-b-a8da4e-fc4ffddfd-5zzgm\" (UID: \"345e7985-1b37-4162-8e1a-6fe74836c9c1\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a8da4e-fc4ffddfd-5zzgm"
Sep 07 04:00:50.179860 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:50.179821    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a8da4e-fc4ffddfd-5zzgm"
Sep 07 04:00:50.466033 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:50.466004    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-a8da4e-fc4ffddfd-5zzgm"]
Sep 07 04:00:50.467282 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:00:50.467254    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod345e7985_1b37_4162_8e1a_6fe74836c9c1.slice/crio-9090730df847b16e6ed9f52209bb43893de8a621ec1195bc86181ddb07509eec WatchSource:0}: Error finding container 9090730df847b16e6ed9f52209bb43893de8a621ec1195bc86181ddb07509eec: Status 404 returned error can't find the container with id 9090730df847b16e6ed9f52209bb43893de8a621ec1195bc86181ddb07509eec
Sep 07 04:00:50.598782 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:50.598744    2559 patch_prober.go:28] interesting pod/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 07 04:00:50.598974 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:50.598800    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt" podUID="0e2acf22-9700-4104-b346-6f44a0a09fd7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 07 04:00:51.140189 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:51.140151    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a8da4e-fc4ffddfd-5zzgm" event={"ID":"345e7985-1b37-4162-8e1a-6fe74836c9c1","Type":"ContainerStarted","Data":"fbf48feed7adc0539809cc72806ba9b287c692f07dac78bc60d8c65af878a2c4"}
Sep 07 04:00:51.140713 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:51.140218    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a8da4e-fc4ffddfd-5zzgm" event={"ID":"345e7985-1b37-4162-8e1a-6fe74836c9c1","Type":"ContainerStarted","Data":"9090730df847b16e6ed9f52209bb43893de8a621ec1195bc86181ddb07509eec"}
Sep 07 04:00:51.140713 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:51.140249    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a8da4e-fc4ffddfd-5zzgm"
Sep 07 04:00:51.158203 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:51.158149    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a8da4e-fc4ffddfd-5zzgm" podStartSLOduration=2.158133616 podStartE2EDuration="2.158133616s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:00:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:00:51.155470674 +0000 UTC m=+754.467946578" watchObservedRunningTime="2026-09-07 04:00:51.158133616 +0000 UTC m=+754.470609517"
Sep 07 04:00:51.631444 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:51.631410    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt"
Sep 07 04:00:51.631901 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:51.631876    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt"
Sep 07 04:00:51.632976 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:00:51.632949    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt"
Sep 07 04:01:02.149854 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:02.149806    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a8da4e-fc4ffddfd-5zzgm"
Sep 07 04:01:09.484910 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:09.483390    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-64f80f33-779b88cb6b-rjhwf"]
Sep 07 04:01:09.484910 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:09.483723    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-64f80f33-779b88cb6b-rjhwf" podUID="99c0d73f-2698-4db1-a38a-5ab512c71e48" containerName="payload-pre-processing" containerID="cri-o://05245304d09a0554422f2df930999328b0fa24b34a921dc8a9157c618d1d26ca" gracePeriod=30
Sep 07 04:01:09.750032 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:09.749993    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-64f80f33-779b88cb6b-rjhwf"
Sep 07 04:01:09.808829 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:09.807977    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ppwml\" (UniqueName: \"kubernetes.io/projected/99c0d73f-2698-4db1-a38a-5ab512c71e48-kube-api-access-ppwml\") pod \"99c0d73f-2698-4db1-a38a-5ab512c71e48\" (UID: \"99c0d73f-2698-4db1-a38a-5ab512c71e48\") "
Sep 07 04:01:09.808829 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:09.808049    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/99c0d73f-2698-4db1-a38a-5ab512c71e48-plugins-config-volume\") pod \"99c0d73f-2698-4db1-a38a-5ab512c71e48\" (UID: \"99c0d73f-2698-4db1-a38a-5ab512c71e48\") "
Sep 07 04:01:09.808829 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:09.808705    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99c0d73f-2698-4db1-a38a-5ab512c71e48-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "99c0d73f-2698-4db1-a38a-5ab512c71e48" (UID: "99c0d73f-2698-4db1-a38a-5ab512c71e48"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 04:01:09.813697 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:09.813666    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99c0d73f-2698-4db1-a38a-5ab512c71e48-kube-api-access-ppwml" (OuterVolumeSpecName: "kube-api-access-ppwml") pod "99c0d73f-2698-4db1-a38a-5ab512c71e48" (UID: "99c0d73f-2698-4db1-a38a-5ab512c71e48"). InnerVolumeSpecName "kube-api-access-ppwml". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 04:01:09.845151 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:09.845111    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt"]
Sep 07 04:01:09.845412 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:09.845388    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt" podUID="0e2acf22-9700-4104-b346-6f44a0a09fd7" containerName="istio-proxy" containerID="cri-o://6097c2f6bccdb8eb03412601fcc8048cd4c120cfa96d995efbbee4655e56e4cb" gracePeriod=30
Sep 07 04:01:09.909806 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:09.909772    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ppwml\" (UniqueName: \"kubernetes.io/projected/99c0d73f-2698-4db1-a38a-5ab512c71e48-kube-api-access-ppwml\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:01:09.909806 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:09.909799    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/99c0d73f-2698-4db1-a38a-5ab512c71e48-plugins-config-volume\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:01:10.260212 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:10.260175    2559 generic.go:356] "Generic (PLEG): container finished" podID="99c0d73f-2698-4db1-a38a-5ab512c71e48" containerID="05245304d09a0554422f2df930999328b0fa24b34a921dc8a9157c618d1d26ca" exitCode=0
Sep 07 04:01:10.260395 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:10.260222    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-64f80f33-779b88cb6b-rjhwf"
Sep 07 04:01:10.260395 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:10.260255    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-64f80f33-779b88cb6b-rjhwf" event={"ID":"99c0d73f-2698-4db1-a38a-5ab512c71e48","Type":"ContainerDied","Data":"05245304d09a0554422f2df930999328b0fa24b34a921dc8a9157c618d1d26ca"}
Sep 07 04:01:10.260395 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:10.260314    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-64f80f33-779b88cb6b-rjhwf" event={"ID":"99c0d73f-2698-4db1-a38a-5ab512c71e48","Type":"ContainerDied","Data":"03e32410295d94b8453942e63ee3d8a6f44d1527e23bc7916abd4121baf7829d"}
Sep 07 04:01:10.260395 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:10.260344    2559 scope.go:117] "RemoveContainer" containerID="05245304d09a0554422f2df930999328b0fa24b34a921dc8a9157c618d1d26ca"
Sep 07 04:01:10.269879 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:10.269856    2559 scope.go:117] "RemoveContainer" containerID="05245304d09a0554422f2df930999328b0fa24b34a921dc8a9157c618d1d26ca"
Sep 07 04:01:10.270220 ip-10-0-132-4 kubenswrapper[2559]: E0907 04:01:10.270199    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05245304d09a0554422f2df930999328b0fa24b34a921dc8a9157c618d1d26ca\": container with ID starting with 05245304d09a0554422f2df930999328b0fa24b34a921dc8a9157c618d1d26ca not found: ID does not exist" containerID="05245304d09a0554422f2df930999328b0fa24b34a921dc8a9157c618d1d26ca"
Sep 07 04:01:10.270277 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:10.270229    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05245304d09a0554422f2df930999328b0fa24b34a921dc8a9157c618d1d26ca"} err="failed to get container status \"05245304d09a0554422f2df930999328b0fa24b34a921dc8a9157c618d1d26ca\": rpc error: code = NotFound desc = could not find container \"05245304d09a0554422f2df930999328b0fa24b34a921dc8a9157c618d1d26ca\": container with ID starting with 05245304d09a0554422f2df930999328b0fa24b34a921dc8a9157c618d1d26ca not found: ID does not exist"
Sep 07 04:01:10.282819 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:10.282795    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-64f80f33-779b88cb6b-rjhwf"]
Sep 07 04:01:10.285135 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:10.285116    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-64f80f33-779b88cb6b-rjhwf"]
Sep 07 04:01:11.179560 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:11.179479    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99c0d73f-2698-4db1-a38a-5ab512c71e48" path="/var/lib/kubelet/pods/99c0d73f-2698-4db1-a38a-5ab512c71e48/volumes"
Sep 07 04:01:11.268476 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:11.268445    2559 generic.go:356] "Generic (PLEG): container finished" podID="d49a6a62-bffc-447c-b826-0a4e89959050" containerID="b9a0a48655f0a95c1e90c3c8d00510a02a13baf2fbda7d426b5fd029ad6e5ee2" exitCode=0
Sep 07 04:01:11.268676 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:11.268514    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7" event={"ID":"d49a6a62-bffc-447c-b826-0a4e89959050","Type":"ContainerDied","Data":"b9a0a48655f0a95c1e90c3c8d00510a02a13baf2fbda7d426b5fd029ad6e5ee2"}
Sep 07 04:01:11.268932 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:11.268916    2559 scope.go:117] "RemoveContainer" containerID="b9a0a48655f0a95c1e90c3c8d00510a02a13baf2fbda7d426b5fd029ad6e5ee2"
Sep 07 04:01:11.269983 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:11.269952    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 04:01:11.270083 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:11.270037    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 04:01:11.270151 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:11.270089    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 04:01:12.276251 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:12.276220    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7" event={"ID":"d49a6a62-bffc-447c-b826-0a4e89959050","Type":"ContainerStarted","Data":"232b5c89ea74cb5640c30b1f4aae53b6a8e559bb2d40fafa97de9a70dc3cf241"}
Sep 07 04:01:12.620438 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:12.620408    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7"
Sep 07 04:01:12.620670 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:12.620648    2559 patch_prober.go:28] interesting pod/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 07 04:01:12.620717 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:12.620700    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7" podUID="d49a6a62-bffc-447c-b826-0a4e89959050" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 07 04:01:13.619966 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:13.619931    2559 patch_prober.go:28] interesting pod/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 07 04:01:13.620356 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:13.619997    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7" podUID="d49a6a62-bffc-447c-b826-0a4e89959050" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 07 04:01:13.988683 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:13.988596    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-e1915828-5c6f85ffd-k5dqf"]
Sep 07 04:01:13.989023 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:13.989007    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99c0d73f-2698-4db1-a38a-5ab512c71e48" containerName="payload-pre-processing"
Sep 07 04:01:13.989076 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:13.989025    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="99c0d73f-2698-4db1-a38a-5ab512c71e48" containerName="payload-pre-processing"
Sep 07 04:01:13.989127 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:13.989116    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="99c0d73f-2698-4db1-a38a-5ab512c71e48" containerName="payload-pre-processing"
Sep 07 04:01:13.991326 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:13.991299    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e1915828-5c6f85ffd-k5dqf"
Sep 07 04:01:13.993372 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:13.993345    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-e1915828-dockercfg-6kn4x\""
Sep 07 04:01:13.993609 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:13.993593    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-e1915828\""
Sep 07 04:01:14.002336 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:14.002316    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-e1915828-5c6f85ffd-k5dqf"]
Sep 07 04:01:14.013412 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:14.013384    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-e1915828-6bfdb7bfc8-525g9"]
Sep 07 04:01:14.016870 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:14.016849    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-e1915828-6bfdb7bfc8-525g9"
Sep 07 04:01:14.031183 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:14.031164    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-e1915828-6bfdb7bfc8-525g9"]
Sep 07 04:01:14.158971 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:14.158926    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c30366d-d4b4-40a0-8b54-214204d5b554-plugins-config-volume\") pod \"payload-processing-e2e-migrate-e1915828-6bfdb7bfc8-525g9\" (UID: \"5c30366d-d4b4-40a0-8b54-214204d5b554\") " pod="openshift-ingress/payload-processing-e2e-migrate-e1915828-6bfdb7bfc8-525g9"
Sep 07 04:01:14.159178 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:14.159007    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e526fc0c-e116-4533-bee3-73ea00356da0-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-e1915828-5c6f85ffd-k5dqf\" (UID: \"e526fc0c-e116-4533-bee3-73ea00356da0\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-e1915828-5c6f85ffd-k5dqf"
Sep 07 04:01:14.159178 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:14.159029    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xxdq\" (UniqueName: \"kubernetes.io/projected/e526fc0c-e116-4533-bee3-73ea00356da0-kube-api-access-6xxdq\") pod \"payload-pre-processing-e2e-migrate-e1915828-5c6f85ffd-k5dqf\" (UID: \"e526fc0c-e116-4533-bee3-73ea00356da0\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-e1915828-5c6f85ffd-k5dqf"
Sep 07 04:01:14.159178 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:14.159139    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwhj9\" (UniqueName: \"kubernetes.io/projected/5c30366d-d4b4-40a0-8b54-214204d5b554-kube-api-access-fwhj9\") pod \"payload-processing-e2e-migrate-e1915828-6bfdb7bfc8-525g9\" (UID: \"5c30366d-d4b4-40a0-8b54-214204d5b554\") " pod="openshift-ingress/payload-processing-e2e-migrate-e1915828-6bfdb7bfc8-525g9"
Sep 07 04:01:14.260103 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:14.260007    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwhj9\" (UniqueName: \"kubernetes.io/projected/5c30366d-d4b4-40a0-8b54-214204d5b554-kube-api-access-fwhj9\") pod \"payload-processing-e2e-migrate-e1915828-6bfdb7bfc8-525g9\" (UID: \"5c30366d-d4b4-40a0-8b54-214204d5b554\") " pod="openshift-ingress/payload-processing-e2e-migrate-e1915828-6bfdb7bfc8-525g9"
Sep 07 04:01:14.260103 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:14.260079    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c30366d-d4b4-40a0-8b54-214204d5b554-plugins-config-volume\") pod \"payload-processing-e2e-migrate-e1915828-6bfdb7bfc8-525g9\" (UID: \"5c30366d-d4b4-40a0-8b54-214204d5b554\") " pod="openshift-ingress/payload-processing-e2e-migrate-e1915828-6bfdb7bfc8-525g9"
Sep 07 04:01:14.260314 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:14.260119    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e526fc0c-e116-4533-bee3-73ea00356da0-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-e1915828-5c6f85ffd-k5dqf\" (UID: \"e526fc0c-e116-4533-bee3-73ea00356da0\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-e1915828-5c6f85ffd-k5dqf"
Sep 07 04:01:14.260314 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:14.260138    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xxdq\" (UniqueName: \"kubernetes.io/projected/e526fc0c-e116-4533-bee3-73ea00356da0-kube-api-access-6xxdq\") pod \"payload-pre-processing-e2e-migrate-e1915828-5c6f85ffd-k5dqf\" (UID: \"e526fc0c-e116-4533-bee3-73ea00356da0\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-e1915828-5c6f85ffd-k5dqf"
Sep 07 04:01:14.260987 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:14.260965    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e526fc0c-e116-4533-bee3-73ea00356da0-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-e1915828-5c6f85ffd-k5dqf\" (UID: \"e526fc0c-e116-4533-bee3-73ea00356da0\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-e1915828-5c6f85ffd-k5dqf"
Sep 07 04:01:14.261134 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:14.261111    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c30366d-d4b4-40a0-8b54-214204d5b554-plugins-config-volume\") pod \"payload-processing-e2e-migrate-e1915828-6bfdb7bfc8-525g9\" (UID: \"5c30366d-d4b4-40a0-8b54-214204d5b554\") " pod="openshift-ingress/payload-processing-e2e-migrate-e1915828-6bfdb7bfc8-525g9"
Sep 07 04:01:14.268710 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:14.268686    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xxdq\" (UniqueName: \"kubernetes.io/projected/e526fc0c-e116-4533-bee3-73ea00356da0-kube-api-access-6xxdq\") pod \"payload-pre-processing-e2e-migrate-e1915828-5c6f85ffd-k5dqf\" (UID: \"e526fc0c-e116-4533-bee3-73ea00356da0\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-e1915828-5c6f85ffd-k5dqf"
Sep 07 04:01:14.269068 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:14.269047    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwhj9\" (UniqueName: \"kubernetes.io/projected/5c30366d-d4b4-40a0-8b54-214204d5b554-kube-api-access-fwhj9\") pod \"payload-processing-e2e-migrate-e1915828-6bfdb7bfc8-525g9\" (UID: \"5c30366d-d4b4-40a0-8b54-214204d5b554\") " pod="openshift-ingress/payload-processing-e2e-migrate-e1915828-6bfdb7bfc8-525g9"
Sep 07 04:01:14.302466 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:14.302439    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e1915828-5c6f85ffd-k5dqf"
Sep 07 04:01:14.328670 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:14.328605    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-e1915828-6bfdb7bfc8-525g9"
Sep 07 04:01:14.600451 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:14.600426    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-e1915828-5c6f85ffd-k5dqf"]
Sep 07 04:01:14.601778 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:01:14.601751    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode526fc0c_e116_4533_bee3_73ea00356da0.slice/crio-f771d4624278802d5a396c281ef6e23cebf3175f90cbaafdb399c21e2078ca50 WatchSource:0}: Error finding container f771d4624278802d5a396c281ef6e23cebf3175f90cbaafdb399c21e2078ca50: Status 404 returned error can't find the container with id f771d4624278802d5a396c281ef6e23cebf3175f90cbaafdb399c21e2078ca50
Sep 07 04:01:14.619854 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:14.619828    2559 patch_prober.go:28] interesting pod/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 07 04:01:14.619930 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:14.619889    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7" podUID="d49a6a62-bffc-447c-b826-0a4e89959050" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 07 04:01:14.631632 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:14.631603    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-e1915828-6bfdb7bfc8-525g9"]
Sep 07 04:01:14.635652 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:01:14.633669    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c30366d_d4b4_40a0_8b54_214204d5b554.slice/crio-56d68218028a16735e11c954f35f9be5db71bb629adafa3bb50db4b38ef1d676 WatchSource:0}: Error finding container 56d68218028a16735e11c954f35f9be5db71bb629adafa3bb50db4b38ef1d676: Status 404 returned error can't find the container with id 56d68218028a16735e11c954f35f9be5db71bb629adafa3bb50db4b38ef1d676
Sep 07 04:01:15.117324 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:15.117261    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt"
Sep 07 04:01:15.271826 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:15.271604    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e2acf22-9700-4104-b346-6f44a0a09fd7-workload-socket\") pod \"0e2acf22-9700-4104-b346-6f44a0a09fd7\" (UID: \"0e2acf22-9700-4104-b346-6f44a0a09fd7\") "
Sep 07 04:01:15.271826 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:15.271669    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nlkvg\" (UniqueName: \"kubernetes.io/projected/0e2acf22-9700-4104-b346-6f44a0a09fd7-kube-api-access-nlkvg\") pod \"0e2acf22-9700-4104-b346-6f44a0a09fd7\" (UID: \"0e2acf22-9700-4104-b346-6f44a0a09fd7\") "
Sep 07 04:01:15.271826 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:15.271717    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e2acf22-9700-4104-b346-6f44a0a09fd7-istio-token\") pod \"0e2acf22-9700-4104-b346-6f44a0a09fd7\" (UID: \"0e2acf22-9700-4104-b346-6f44a0a09fd7\") "
Sep 07 04:01:15.271826 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:15.271841    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e2acf22-9700-4104-b346-6f44a0a09fd7-istio-envoy\") pod \"0e2acf22-9700-4104-b346-6f44a0a09fd7\" (UID: \"0e2acf22-9700-4104-b346-6f44a0a09fd7\") "
Sep 07 04:01:15.272174 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:15.271871    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e2acf22-9700-4104-b346-6f44a0a09fd7-workload-certs\") pod \"0e2acf22-9700-4104-b346-6f44a0a09fd7\" (UID: \"0e2acf22-9700-4104-b346-6f44a0a09fd7\") "
Sep 07 04:01:15.272174 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:15.271902    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e2acf22-9700-4104-b346-6f44a0a09fd7-credential-socket\") pod \"0e2acf22-9700-4104-b346-6f44a0a09fd7\" (UID: \"0e2acf22-9700-4104-b346-6f44a0a09fd7\") "
Sep 07 04:01:15.272174 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:15.271932    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e2acf22-9700-4104-b346-6f44a0a09fd7-istio-data\") pod \"0e2acf22-9700-4104-b346-6f44a0a09fd7\" (UID: \"0e2acf22-9700-4104-b346-6f44a0a09fd7\") "
Sep 07 04:01:15.272174 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:15.271964    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e2acf22-9700-4104-b346-6f44a0a09fd7-istio-podinfo\") pod \"0e2acf22-9700-4104-b346-6f44a0a09fd7\" (UID: \"0e2acf22-9700-4104-b346-6f44a0a09fd7\") "
Sep 07 04:01:15.272174 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:15.271991    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e2acf22-9700-4104-b346-6f44a0a09fd7-istiod-ca-cert\") pod \"0e2acf22-9700-4104-b346-6f44a0a09fd7\" (UID: \"0e2acf22-9700-4104-b346-6f44a0a09fd7\") "
Sep 07 04:01:15.272711 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:15.272686    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e2acf22-9700-4104-b346-6f44a0a09fd7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0e2acf22-9700-4104-b346-6f44a0a09fd7" (UID: "0e2acf22-9700-4104-b346-6f44a0a09fd7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:01:15.273001 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:15.272974    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e2acf22-9700-4104-b346-6f44a0a09fd7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0e2acf22-9700-4104-b346-6f44a0a09fd7" (UID: "0e2acf22-9700-4104-b346-6f44a0a09fd7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:01:15.273132 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:15.273114    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e2acf22-9700-4104-b346-6f44a0a09fd7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0e2acf22-9700-4104-b346-6f44a0a09fd7" (UID: "0e2acf22-9700-4104-b346-6f44a0a09fd7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:01:15.273326 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:15.273258    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e2acf22-9700-4104-b346-6f44a0a09fd7-istio-data" (OuterVolumeSpecName: "istio-data") pod "0e2acf22-9700-4104-b346-6f44a0a09fd7" (UID: "0e2acf22-9700-4104-b346-6f44a0a09fd7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:01:15.273848 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:15.273821    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e2acf22-9700-4104-b346-6f44a0a09fd7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0e2acf22-9700-4104-b346-6f44a0a09fd7" (UID: "0e2acf22-9700-4104-b346-6f44a0a09fd7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 04:01:15.275426 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:15.275392    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e2acf22-9700-4104-b346-6f44a0a09fd7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0e2acf22-9700-4104-b346-6f44a0a09fd7" (UID: "0e2acf22-9700-4104-b346-6f44a0a09fd7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:01:15.275682 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:15.275659    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0e2acf22-9700-4104-b346-6f44a0a09fd7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0e2acf22-9700-4104-b346-6f44a0a09fd7" (UID: "0e2acf22-9700-4104-b346-6f44a0a09fd7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 04:01:15.276408 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:15.276388    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e2acf22-9700-4104-b346-6f44a0a09fd7-istio-token" (OuterVolumeSpecName: "istio-token") pod "0e2acf22-9700-4104-b346-6f44a0a09fd7" (UID: "0e2acf22-9700-4104-b346-6f44a0a09fd7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 04:01:15.277138 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:15.277117    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e2acf22-9700-4104-b346-6f44a0a09fd7-kube-api-access-nlkvg" (OuterVolumeSpecName: "kube-api-access-nlkvg") pod "0e2acf22-9700-4104-b346-6f44a0a09fd7" (UID: "0e2acf22-9700-4104-b346-6f44a0a09fd7"). InnerVolumeSpecName "kube-api-access-nlkvg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 04:01:15.295796 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:15.295769    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-e1915828-6bfdb7bfc8-525g9" event={"ID":"5c30366d-d4b4-40a0-8b54-214204d5b554","Type":"ContainerStarted","Data":"fa16d372dccd57edae92bf97d6992e1a7fb6e1c009e033602d9f518ea9728a17"}
Sep 07 04:01:15.295894 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:15.295820    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-e1915828-6bfdb7bfc8-525g9" event={"ID":"5c30366d-d4b4-40a0-8b54-214204d5b554","Type":"ContainerStarted","Data":"56d68218028a16735e11c954f35f9be5db71bb629adafa3bb50db4b38ef1d676"}
Sep 07 04:01:15.295894 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:15.295872    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-e1915828-6bfdb7bfc8-525g9"
Sep 07 04:01:15.297689 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:15.297666    2559 generic.go:356] "Generic (PLEG): container finished" podID="0e2acf22-9700-4104-b346-6f44a0a09fd7" containerID="6097c2f6bccdb8eb03412601fcc8048cd4c120cfa96d995efbbee4655e56e4cb" exitCode=0
Sep 07 04:01:15.297781 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:15.297709    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt"
Sep 07 04:01:15.297781 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:15.297729    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt" event={"ID":"0e2acf22-9700-4104-b346-6f44a0a09fd7","Type":"ContainerDied","Data":"6097c2f6bccdb8eb03412601fcc8048cd4c120cfa96d995efbbee4655e56e4cb"}
Sep 07 04:01:15.297781 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:15.297775    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt" event={"ID":"0e2acf22-9700-4104-b346-6f44a0a09fd7","Type":"ContainerDied","Data":"3ec3e89a77e988b73a74be9fad8527b048f2efe161e22ceddde318219fd01173"}
Sep 07 04:01:15.297940 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:15.297805    2559 scope.go:117] "RemoveContainer" containerID="6097c2f6bccdb8eb03412601fcc8048cd4c120cfa96d995efbbee4655e56e4cb"
Sep 07 04:01:15.299567 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:15.299543    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e1915828-5c6f85ffd-k5dqf" event={"ID":"e526fc0c-e116-4533-bee3-73ea00356da0","Type":"ContainerStarted","Data":"a90d2ef40633a2bc27fddaca45e0f392dd0b1cac9a6f3616fb9f585412612973"}
Sep 07 04:01:15.299674 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:15.299591    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e1915828-5c6f85ffd-k5dqf" event={"ID":"e526fc0c-e116-4533-bee3-73ea00356da0","Type":"ContainerStarted","Data":"f771d4624278802d5a396c281ef6e23cebf3175f90cbaafdb399c21e2078ca50"}
Sep 07 04:01:15.299868 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:15.299850    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e1915828-5c6f85ffd-k5dqf"
Sep 07 04:01:15.307647 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:15.307414    2559 scope.go:117] "RemoveContainer" containerID="0b8a9637224ad32202cf4a3702ff646900544b6470591bb71a8fdd84fbdb4660"
Sep 07 04:01:15.316326 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:15.316309    2559 scope.go:117] "RemoveContainer" containerID="6097c2f6bccdb8eb03412601fcc8048cd4c120cfa96d995efbbee4655e56e4cb"
Sep 07 04:01:15.316581 ip-10-0-132-4 kubenswrapper[2559]: E0907 04:01:15.316562    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6097c2f6bccdb8eb03412601fcc8048cd4c120cfa96d995efbbee4655e56e4cb\": container with ID starting with 6097c2f6bccdb8eb03412601fcc8048cd4c120cfa96d995efbbee4655e56e4cb not found: ID does not exist" containerID="6097c2f6bccdb8eb03412601fcc8048cd4c120cfa96d995efbbee4655e56e4cb"
Sep 07 04:01:15.316710 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:15.316587    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6097c2f6bccdb8eb03412601fcc8048cd4c120cfa96d995efbbee4655e56e4cb"} err="failed to get container status \"6097c2f6bccdb8eb03412601fcc8048cd4c120cfa96d995efbbee4655e56e4cb\": rpc error: code = NotFound desc = could not find container \"6097c2f6bccdb8eb03412601fcc8048cd4c120cfa96d995efbbee4655e56e4cb\": container with ID starting with 6097c2f6bccdb8eb03412601fcc8048cd4c120cfa96d995efbbee4655e56e4cb not found: ID does not exist"
Sep 07 04:01:15.316710 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:15.316602    2559 scope.go:117] "RemoveContainer" containerID="0b8a9637224ad32202cf4a3702ff646900544b6470591bb71a8fdd84fbdb4660"
Sep 07 04:01:15.316871 ip-10-0-132-4 kubenswrapper[2559]: E0907 04:01:15.316853    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b8a9637224ad32202cf4a3702ff646900544b6470591bb71a8fdd84fbdb4660\": container with ID starting with 0b8a9637224ad32202cf4a3702ff646900544b6470591bb71a8fdd84fbdb4660 not found: ID does not exist" containerID="0b8a9637224ad32202cf4a3702ff646900544b6470591bb71a8fdd84fbdb4660"
Sep 07 04:01:15.316926 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:15.316874    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b8a9637224ad32202cf4a3702ff646900544b6470591bb71a8fdd84fbdb4660"} err="failed to get container status \"0b8a9637224ad32202cf4a3702ff646900544b6470591bb71a8fdd84fbdb4660\": rpc error: code = NotFound desc = could not find container \"0b8a9637224ad32202cf4a3702ff646900544b6470591bb71a8fdd84fbdb4660\": container with ID starting with 0b8a9637224ad32202cf4a3702ff646900544b6470591bb71a8fdd84fbdb4660 not found: ID does not exist"
Sep 07 04:01:15.330862 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:15.330796    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e1915828-5c6f85ffd-k5dqf" podStartSLOduration=2.330779969 podStartE2EDuration="2.330779969s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:01:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:01:15.329866352 +0000 UTC m=+778.642342255" watchObservedRunningTime="2026-09-07 04:01:15.330779969 +0000 UTC m=+778.643255871"
Sep 07 04:01:15.342450 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:15.340393    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-e1915828-6bfdb7bfc8-525g9" podStartSLOduration=2.340373505 podStartE2EDuration="2.340373505s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:01:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:01:15.314599448 +0000 UTC m=+778.627075382" watchObservedRunningTime="2026-09-07 04:01:15.340373505 +0000 UTC m=+778.652849408"
Sep 07 04:01:15.364912 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:15.364837    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt"]
Sep 07 04:01:15.370706 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:15.370635    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt"]
Sep 07 04:01:15.373103 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:15.373074    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e2acf22-9700-4104-b346-6f44a0a09fd7-istio-envoy\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:01:15.373103 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:15.373101    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e2acf22-9700-4104-b346-6f44a0a09fd7-workload-certs\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:01:15.373244 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:15.373111    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e2acf22-9700-4104-b346-6f44a0a09fd7-credential-socket\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:01:15.373244 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:15.373126    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e2acf22-9700-4104-b346-6f44a0a09fd7-istio-data\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:01:15.373244 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:15.373136    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e2acf22-9700-4104-b346-6f44a0a09fd7-istio-podinfo\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:01:15.373244 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:15.373143    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e2acf22-9700-4104-b346-6f44a0a09fd7-istiod-ca-cert\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:01:15.373244 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:15.373151    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e2acf22-9700-4104-b346-6f44a0a09fd7-workload-socket\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:01:15.373244 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:15.373159    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nlkvg\" (UniqueName: \"kubernetes.io/projected/0e2acf22-9700-4104-b346-6f44a0a09fd7-kube-api-access-nlkvg\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:01:15.373244 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:15.373167    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e2acf22-9700-4104-b346-6f44a0a09fd7-istio-token\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:01:15.620142 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:15.620107    2559 patch_prober.go:28] interesting pod/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 07 04:01:15.620300 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:15.620168    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7" podUID="d49a6a62-bffc-447c-b826-0a4e89959050" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 07 04:01:16.620213 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:16.620176    2559 patch_prober.go:28] interesting pod/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 07 04:01:16.620712 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:16.620240    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7" podUID="d49a6a62-bffc-447c-b826-0a4e89959050" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 07 04:01:17.179964 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:17.179929    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e2acf22-9700-4104-b346-6f44a0a09fd7" path="/var/lib/kubelet/pods/0e2acf22-9700-4104-b346-6f44a0a09fd7/volumes"
Sep 07 04:01:17.678294 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:17.678246    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7"
Sep 07 04:01:17.678790 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:17.678693    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7"
Sep 07 04:01:17.679741 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:17.679715    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7"
Sep 07 04:01:26.308593 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:26.308550    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-e1915828-6bfdb7bfc8-525g9"
Sep 07 04:01:26.309002 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:26.308642    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e1915828-5c6f85ffd-k5dqf"
Sep 07 04:01:44.858575 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:44.858483    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-e1915828-6bfdb7bfc8-525g9"]
Sep 07 04:01:44.859219 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:44.858826    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-e1915828-6bfdb7bfc8-525g9" podUID="5c30366d-d4b4-40a0-8b54-214204d5b554" containerName="payload-processing" containerID="cri-o://fa16d372dccd57edae92bf97d6992e1a7fb6e1c009e033602d9f518ea9728a17" gracePeriod=30
Sep 07 04:01:44.867905 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:44.867870    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-e1915828-5c6f85ffd-k5dqf"]
Sep 07 04:01:44.868354 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:44.868305    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e1915828-5c6f85ffd-k5dqf" podUID="e526fc0c-e116-4533-bee3-73ea00356da0" containerName="payload-pre-processing" containerID="cri-o://a90d2ef40633a2bc27fddaca45e0f392dd0b1cac9a6f3616fb9f585412612973" gracePeriod=30
Sep 07 04:01:45.157520 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.157484    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-e1915828-6bfdb7bfc8-525g9"
Sep 07 04:01:45.166454 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.166432    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e1915828-5c6f85ffd-k5dqf"
Sep 07 04:01:45.253902 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.253857    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6xxdq\" (UniqueName: \"kubernetes.io/projected/e526fc0c-e116-4533-bee3-73ea00356da0-kube-api-access-6xxdq\") pod \"e526fc0c-e116-4533-bee3-73ea00356da0\" (UID: \"e526fc0c-e116-4533-bee3-73ea00356da0\") "
Sep 07 04:01:45.254098 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.253942    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e526fc0c-e116-4533-bee3-73ea00356da0-plugins-config-volume\") pod \"e526fc0c-e116-4533-bee3-73ea00356da0\" (UID: \"e526fc0c-e116-4533-bee3-73ea00356da0\") "
Sep 07 04:01:45.254098 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.254029    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fwhj9\" (UniqueName: \"kubernetes.io/projected/5c30366d-d4b4-40a0-8b54-214204d5b554-kube-api-access-fwhj9\") pod \"5c30366d-d4b4-40a0-8b54-214204d5b554\" (UID: \"5c30366d-d4b4-40a0-8b54-214204d5b554\") "
Sep 07 04:01:45.254098 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.254077    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c30366d-d4b4-40a0-8b54-214204d5b554-plugins-config-volume\") pod \"5c30366d-d4b4-40a0-8b54-214204d5b554\" (UID: \"5c30366d-d4b4-40a0-8b54-214204d5b554\") "
Sep 07 04:01:45.254471 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.254390    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e526fc0c-e116-4533-bee3-73ea00356da0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e526fc0c-e116-4533-bee3-73ea00356da0" (UID: "e526fc0c-e116-4533-bee3-73ea00356da0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 04:01:45.254759 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.254729    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c30366d-d4b4-40a0-8b54-214204d5b554-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5c30366d-d4b4-40a0-8b54-214204d5b554" (UID: "5c30366d-d4b4-40a0-8b54-214204d5b554"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 04:01:45.256267 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.256235    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e526fc0c-e116-4533-bee3-73ea00356da0-kube-api-access-6xxdq" (OuterVolumeSpecName: "kube-api-access-6xxdq") pod "e526fc0c-e116-4533-bee3-73ea00356da0" (UID: "e526fc0c-e116-4533-bee3-73ea00356da0"). InnerVolumeSpecName "kube-api-access-6xxdq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 04:01:45.256602 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.256576    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c30366d-d4b4-40a0-8b54-214204d5b554-kube-api-access-fwhj9" (OuterVolumeSpecName: "kube-api-access-fwhj9") pod "5c30366d-d4b4-40a0-8b54-214204d5b554" (UID: "5c30366d-d4b4-40a0-8b54-214204d5b554"). InnerVolumeSpecName "kube-api-access-fwhj9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 04:01:45.355202 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.355172    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fwhj9\" (UniqueName: \"kubernetes.io/projected/5c30366d-d4b4-40a0-8b54-214204d5b554-kube-api-access-fwhj9\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:01:45.355202 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.355197    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c30366d-d4b4-40a0-8b54-214204d5b554-plugins-config-volume\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:01:45.355202 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.355206    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xxdq\" (UniqueName: \"kubernetes.io/projected/e526fc0c-e116-4533-bee3-73ea00356da0-kube-api-access-6xxdq\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:01:45.355421 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.355215    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e526fc0c-e116-4533-bee3-73ea00356da0-plugins-config-volume\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:01:45.470694 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.470584    2559 generic.go:356] "Generic (PLEG): container finished" podID="5c30366d-d4b4-40a0-8b54-214204d5b554" containerID="fa16d372dccd57edae92bf97d6992e1a7fb6e1c009e033602d9f518ea9728a17" exitCode=0
Sep 07 04:01:45.470694 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.470677    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-e1915828-6bfdb7bfc8-525g9"
Sep 07 04:01:45.471074 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.470683    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-e1915828-6bfdb7bfc8-525g9" event={"ID":"5c30366d-d4b4-40a0-8b54-214204d5b554","Type":"ContainerDied","Data":"fa16d372dccd57edae92bf97d6992e1a7fb6e1c009e033602d9f518ea9728a17"}
Sep 07 04:01:45.471074 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.470871    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-e1915828-6bfdb7bfc8-525g9" event={"ID":"5c30366d-d4b4-40a0-8b54-214204d5b554","Type":"ContainerDied","Data":"56d68218028a16735e11c954f35f9be5db71bb629adafa3bb50db4b38ef1d676"}
Sep 07 04:01:45.471074 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.470912    2559 scope.go:117] "RemoveContainer" containerID="fa16d372dccd57edae92bf97d6992e1a7fb6e1c009e033602d9f518ea9728a17"
Sep 07 04:01:45.472300 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.472270    2559 generic.go:356] "Generic (PLEG): container finished" podID="e526fc0c-e116-4533-bee3-73ea00356da0" containerID="a90d2ef40633a2bc27fddaca45e0f392dd0b1cac9a6f3616fb9f585412612973" exitCode=0
Sep 07 04:01:45.472364 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.472308    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e1915828-5c6f85ffd-k5dqf"
Sep 07 04:01:45.472364 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.472322    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e1915828-5c6f85ffd-k5dqf" event={"ID":"e526fc0c-e116-4533-bee3-73ea00356da0","Type":"ContainerDied","Data":"a90d2ef40633a2bc27fddaca45e0f392dd0b1cac9a6f3616fb9f585412612973"}
Sep 07 04:01:45.472443 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.472365    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e1915828-5c6f85ffd-k5dqf" event={"ID":"e526fc0c-e116-4533-bee3-73ea00356da0","Type":"ContainerDied","Data":"f771d4624278802d5a396c281ef6e23cebf3175f90cbaafdb399c21e2078ca50"}
Sep 07 04:01:45.483187 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.483155    2559 scope.go:117] "RemoveContainer" containerID="fa16d372dccd57edae92bf97d6992e1a7fb6e1c009e033602d9f518ea9728a17"
Sep 07 04:01:45.483459 ip-10-0-132-4 kubenswrapper[2559]: E0907 04:01:45.483438    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa16d372dccd57edae92bf97d6992e1a7fb6e1c009e033602d9f518ea9728a17\": container with ID starting with fa16d372dccd57edae92bf97d6992e1a7fb6e1c009e033602d9f518ea9728a17 not found: ID does not exist" containerID="fa16d372dccd57edae92bf97d6992e1a7fb6e1c009e033602d9f518ea9728a17"
Sep 07 04:01:45.483544 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.483469    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa16d372dccd57edae92bf97d6992e1a7fb6e1c009e033602d9f518ea9728a17"} err="failed to get container status \"fa16d372dccd57edae92bf97d6992e1a7fb6e1c009e033602d9f518ea9728a17\": rpc error: code = NotFound desc = could not find container \"fa16d372dccd57edae92bf97d6992e1a7fb6e1c009e033602d9f518ea9728a17\": container with ID starting with fa16d372dccd57edae92bf97d6992e1a7fb6e1c009e033602d9f518ea9728a17 not found: ID does not exist"
Sep 07 04:01:45.483544 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.483489    2559 scope.go:117] "RemoveContainer" containerID="a90d2ef40633a2bc27fddaca45e0f392dd0b1cac9a6f3616fb9f585412612973"
Sep 07 04:01:45.491778 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.491756    2559 scope.go:117] "RemoveContainer" containerID="a90d2ef40633a2bc27fddaca45e0f392dd0b1cac9a6f3616fb9f585412612973"
Sep 07 04:01:45.492030 ip-10-0-132-4 kubenswrapper[2559]: E0907 04:01:45.492010    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a90d2ef40633a2bc27fddaca45e0f392dd0b1cac9a6f3616fb9f585412612973\": container with ID starting with a90d2ef40633a2bc27fddaca45e0f392dd0b1cac9a6f3616fb9f585412612973 not found: ID does not exist" containerID="a90d2ef40633a2bc27fddaca45e0f392dd0b1cac9a6f3616fb9f585412612973"
Sep 07 04:01:45.492077 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.492037    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a90d2ef40633a2bc27fddaca45e0f392dd0b1cac9a6f3616fb9f585412612973"} err="failed to get container status \"a90d2ef40633a2bc27fddaca45e0f392dd0b1cac9a6f3616fb9f585412612973\": rpc error: code = NotFound desc = could not find container \"a90d2ef40633a2bc27fddaca45e0f392dd0b1cac9a6f3616fb9f585412612973\": container with ID starting with a90d2ef40633a2bc27fddaca45e0f392dd0b1cac9a6f3616fb9f585412612973 not found: ID does not exist"
Sep 07 04:01:45.497294 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.497271    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-e1915828-5c6f85ffd-k5dqf"]
Sep 07 04:01:45.500547 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.500529    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-e1915828-5c6f85ffd-k5dqf"]
Sep 07 04:01:45.509414 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.509395    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-e1915828-6bfdb7bfc8-525g9"]
Sep 07 04:01:45.513147 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.513127    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-e1915828-6bfdb7bfc8-525g9"]
Sep 07 04:01:45.893967 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.893936    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb"]
Sep 07 04:01:45.894338 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.894326    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e2acf22-9700-4104-b346-6f44a0a09fd7" containerName="istio-proxy"
Sep 07 04:01:45.894380 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.894340    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e2acf22-9700-4104-b346-6f44a0a09fd7" containerName="istio-proxy"
Sep 07 04:01:45.894380 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.894348    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c30366d-d4b4-40a0-8b54-214204d5b554" containerName="payload-processing"
Sep 07 04:01:45.894380 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.894354    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c30366d-d4b4-40a0-8b54-214204d5b554" containerName="payload-processing"
Sep 07 04:01:45.894380 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.894363    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e526fc0c-e116-4533-bee3-73ea00356da0" containerName="payload-pre-processing"
Sep 07 04:01:45.894380 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.894368    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e526fc0c-e116-4533-bee3-73ea00356da0" containerName="payload-pre-processing"
Sep 07 04:01:45.894380 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.894376    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e2acf22-9700-4104-b346-6f44a0a09fd7" containerName="istio-proxy"
Sep 07 04:01:45.894380 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.894381    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e2acf22-9700-4104-b346-6f44a0a09fd7" containerName="istio-proxy"
Sep 07 04:01:45.894593 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.894435    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e2acf22-9700-4104-b346-6f44a0a09fd7" containerName="istio-proxy"
Sep 07 04:01:45.894593 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.894443    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e2acf22-9700-4104-b346-6f44a0a09fd7" containerName="istio-proxy"
Sep 07 04:01:45.894593 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.894449    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e526fc0c-e116-4533-bee3-73ea00356da0" containerName="payload-pre-processing"
Sep 07 04:01:45.894593 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.894457    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c30366d-d4b4-40a0-8b54-214204d5b554" containerName="payload-processing"
Sep 07 04:01:45.897150 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.897131    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb"
Sep 07 04:01:45.899482 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.899462    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-4d42cf5d-openshift-default-dockercfg-6swnp\""
Sep 07 04:01:45.911949 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.911927    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb"]
Sep 07 04:01:45.962008 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.961973    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16cf3c25-3214-4f35-bec6-d7fdd67afb66-istio-envoy\") pod \"e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb\" (UID: \"16cf3c25-3214-4f35-bec6-d7fdd67afb66\") " pod="openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb"
Sep 07 04:01:45.962163 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.962013    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16cf3c25-3214-4f35-bec6-d7fdd67afb66-istio-podinfo\") pod \"e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb\" (UID: \"16cf3c25-3214-4f35-bec6-d7fdd67afb66\") " pod="openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb"
Sep 07 04:01:45.962163 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.962038    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16cf3c25-3214-4f35-bec6-d7fdd67afb66-istio-data\") pod \"e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb\" (UID: \"16cf3c25-3214-4f35-bec6-d7fdd67afb66\") " pod="openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb"
Sep 07 04:01:45.962163 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.962114    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16cf3c25-3214-4f35-bec6-d7fdd67afb66-credential-socket\") pod \"e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb\" (UID: \"16cf3c25-3214-4f35-bec6-d7fdd67afb66\") " pod="openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb"
Sep 07 04:01:45.962280 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.962165    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16cf3c25-3214-4f35-bec6-d7fdd67afb66-workload-socket\") pod \"e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb\" (UID: \"16cf3c25-3214-4f35-bec6-d7fdd67afb66\") " pod="openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb"
Sep 07 04:01:45.962280 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.962191    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16cf3c25-3214-4f35-bec6-d7fdd67afb66-istiod-ca-cert\") pod \"e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb\" (UID: \"16cf3c25-3214-4f35-bec6-d7fdd67afb66\") " pod="openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb"
Sep 07 04:01:45.962280 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.962220    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwp2t\" (UniqueName: \"kubernetes.io/projected/16cf3c25-3214-4f35-bec6-d7fdd67afb66-kube-api-access-mwp2t\") pod \"e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb\" (UID: \"16cf3c25-3214-4f35-bec6-d7fdd67afb66\") " pod="openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb"
Sep 07 04:01:45.962280 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.962241    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16cf3c25-3214-4f35-bec6-d7fdd67afb66-workload-certs\") pod \"e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb\" (UID: \"16cf3c25-3214-4f35-bec6-d7fdd67afb66\") " pod="openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb"
Sep 07 04:01:45.962423 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:45.962298    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16cf3c25-3214-4f35-bec6-d7fdd67afb66-istio-token\") pod \"e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb\" (UID: \"16cf3c25-3214-4f35-bec6-d7fdd67afb66\") " pod="openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb"
Sep 07 04:01:46.063580 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:46.063540    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16cf3c25-3214-4f35-bec6-d7fdd67afb66-istio-data\") pod \"e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb\" (UID: \"16cf3c25-3214-4f35-bec6-d7fdd67afb66\") " pod="openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb"
Sep 07 04:01:46.063783 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:46.063595    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16cf3c25-3214-4f35-bec6-d7fdd67afb66-credential-socket\") pod \"e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb\" (UID: \"16cf3c25-3214-4f35-bec6-d7fdd67afb66\") " pod="openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb"
Sep 07 04:01:46.063783 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:46.063657    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16cf3c25-3214-4f35-bec6-d7fdd67afb66-workload-socket\") pod \"e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb\" (UID: \"16cf3c25-3214-4f35-bec6-d7fdd67afb66\") " pod="openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb"
Sep 07 04:01:46.063783 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:46.063690    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16cf3c25-3214-4f35-bec6-d7fdd67afb66-istiod-ca-cert\") pod \"e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb\" (UID: \"16cf3c25-3214-4f35-bec6-d7fdd67afb66\") " pod="openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb"
Sep 07 04:01:46.063783 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:46.063731    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwp2t\" (UniqueName: \"kubernetes.io/projected/16cf3c25-3214-4f35-bec6-d7fdd67afb66-kube-api-access-mwp2t\") pod \"e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb\" (UID: \"16cf3c25-3214-4f35-bec6-d7fdd67afb66\") " pod="openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb"
Sep 07 04:01:46.063783 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:46.063759    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16cf3c25-3214-4f35-bec6-d7fdd67afb66-workload-certs\") pod \"e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb\" (UID: \"16cf3c25-3214-4f35-bec6-d7fdd67afb66\") " pod="openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb"
Sep 07 04:01:46.064055 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:46.063816    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16cf3c25-3214-4f35-bec6-d7fdd67afb66-istio-token\") pod \"e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb\" (UID: \"16cf3c25-3214-4f35-bec6-d7fdd67afb66\") " pod="openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb"
Sep 07 04:01:46.064055 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:46.063868    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16cf3c25-3214-4f35-bec6-d7fdd67afb66-istio-envoy\") pod \"e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb\" (UID: \"16cf3c25-3214-4f35-bec6-d7fdd67afb66\") " pod="openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb"
Sep 07 04:01:46.064055 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:46.063906    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16cf3c25-3214-4f35-bec6-d7fdd67afb66-istio-podinfo\") pod \"e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb\" (UID: \"16cf3c25-3214-4f35-bec6-d7fdd67afb66\") " pod="openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb"
Sep 07 04:01:46.064055 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:46.064010    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16cf3c25-3214-4f35-bec6-d7fdd67afb66-istio-data\") pod \"e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb\" (UID: \"16cf3c25-3214-4f35-bec6-d7fdd67afb66\") " pod="openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb"
Sep 07 04:01:46.064055 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:46.064033    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16cf3c25-3214-4f35-bec6-d7fdd67afb66-workload-socket\") pod \"e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb\" (UID: \"16cf3c25-3214-4f35-bec6-d7fdd67afb66\") " pod="openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb"
Sep 07 04:01:46.064319 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:46.064077    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16cf3c25-3214-4f35-bec6-d7fdd67afb66-credential-socket\") pod \"e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb\" (UID: \"16cf3c25-3214-4f35-bec6-d7fdd67afb66\") " pod="openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb"
Sep 07 04:01:46.064375 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:46.064338    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16cf3c25-3214-4f35-bec6-d7fdd67afb66-workload-certs\") pod \"e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb\" (UID: \"16cf3c25-3214-4f35-bec6-d7fdd67afb66\") " pod="openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb"
Sep 07 04:01:46.064375 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:46.064350    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16cf3c25-3214-4f35-bec6-d7fdd67afb66-istiod-ca-cert\") pod \"e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb\" (UID: \"16cf3c25-3214-4f35-bec6-d7fdd67afb66\") " pod="openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb"
Sep 07 04:01:46.066181 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:46.066162    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16cf3c25-3214-4f35-bec6-d7fdd67afb66-istio-envoy\") pod \"e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb\" (UID: \"16cf3c25-3214-4f35-bec6-d7fdd67afb66\") " pod="openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb"
Sep 07 04:01:46.066433 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:46.066413    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16cf3c25-3214-4f35-bec6-d7fdd67afb66-istio-podinfo\") pod \"e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb\" (UID: \"16cf3c25-3214-4f35-bec6-d7fdd67afb66\") " pod="openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb"
Sep 07 04:01:46.072035 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:46.072011    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwp2t\" (UniqueName: \"kubernetes.io/projected/16cf3c25-3214-4f35-bec6-d7fdd67afb66-kube-api-access-mwp2t\") pod \"e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb\" (UID: \"16cf3c25-3214-4f35-bec6-d7fdd67afb66\") " pod="openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb"
Sep 07 04:01:46.072170 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:46.072151    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16cf3c25-3214-4f35-bec6-d7fdd67afb66-istio-token\") pod \"e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb\" (UID: \"16cf3c25-3214-4f35-bec6-d7fdd67afb66\") " pod="openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb"
Sep 07 04:01:46.207305 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:46.207217    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb"
Sep 07 04:01:46.479082 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:46.479053    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb"]
Sep 07 04:01:46.480852 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:01:46.480828    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16cf3c25_3214_4f35_bec6_d7fdd67afb66.slice/crio-0be7360964a60870c7939e979dcd4a87969879c417b838a728a60016cc01a1ce WatchSource:0}: Error finding container 0be7360964a60870c7939e979dcd4a87969879c417b838a728a60016cc01a1ce: Status 404 returned error can't find the container with id 0be7360964a60870c7939e979dcd4a87969879c417b838a728a60016cc01a1ce
Sep 07 04:01:46.482857 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:46.482828    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 04:01:46.482924 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:46.482887    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 04:01:46.482924 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:46.482914    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 04:01:47.187577 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:47.187538    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c30366d-d4b4-40a0-8b54-214204d5b554" path="/var/lib/kubelet/pods/5c30366d-d4b4-40a0-8b54-214204d5b554/volumes"
Sep 07 04:01:47.187966 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:47.187938    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e526fc0c-e116-4533-bee3-73ea00356da0" path="/var/lib/kubelet/pods/e526fc0c-e116-4533-bee3-73ea00356da0/volumes"
Sep 07 04:01:47.488011 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:47.487921    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb" event={"ID":"16cf3c25-3214-4f35-bec6-d7fdd67afb66","Type":"ContainerStarted","Data":"08afc204d30497ae0e7483291510dc72babfc5fe7943a5193571699ce8129e11"}
Sep 07 04:01:47.488011 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:47.487976    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb" event={"ID":"16cf3c25-3214-4f35-bec6-d7fdd67afb66","Type":"ContainerStarted","Data":"0be7360964a60870c7939e979dcd4a87969879c417b838a728a60016cc01a1ce"}
Sep 07 04:01:47.510695 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:47.510644    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb" podStartSLOduration=2.51061618 podStartE2EDuration="2.51061618s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:01:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:01:47.507562992 +0000 UTC m=+810.820038895" watchObservedRunningTime="2026-09-07 04:01:47.51061618 +0000 UTC m=+810.823092083"
Sep 07 04:01:48.208431 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:48.208395    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb"
Sep 07 04:01:48.213804 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:48.213775    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb"
Sep 07 04:01:48.494752 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:48.494671    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb"
Sep 07 04:01:48.495550 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:48.495527    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb"
Sep 07 04:01:50.651120 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:50.651085    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4d42cf5d-d48b676b-2s9fk"]
Sep 07 04:01:50.654406 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:50.654383    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4d42cf5d-d48b676b-2s9fk"
Sep 07 04:01:50.656828 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:50.656802    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-4d42cf5d\""
Sep 07 04:01:50.656965 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:50.656802    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-4d42cf5d-dockercfg-g6kch\""
Sep 07 04:01:50.664370 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:50.664345    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4d42cf5d-d48b676b-2s9fk"]
Sep 07 04:01:50.674538 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:50.674498    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4d42cf5d-848865df4c-jqrfq"]
Sep 07 04:01:50.678758 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:50.678734    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-4d42cf5d-848865df4c-jqrfq"
Sep 07 04:01:50.682106 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:50.682084    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4d42cf5d-848865df4c-jqrfq"]
Sep 07 04:01:50.812678 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:50.812616    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9n9f\" (UniqueName: \"kubernetes.io/projected/ae096b0b-8220-428f-abc0-a5333384c4bb-kube-api-access-k9n9f\") pod \"payload-processing-e2e-ait-4d42cf5d-848865df4c-jqrfq\" (UID: \"ae096b0b-8220-428f-abc0-a5333384c4bb\") " pod="openshift-ingress/payload-processing-e2e-ait-4d42cf5d-848865df4c-jqrfq"
Sep 07 04:01:50.812850 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:50.812697    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae096b0b-8220-428f-abc0-a5333384c4bb-plugins-config-volume\") pod \"payload-processing-e2e-ait-4d42cf5d-848865df4c-jqrfq\" (UID: \"ae096b0b-8220-428f-abc0-a5333384c4bb\") " pod="openshift-ingress/payload-processing-e2e-ait-4d42cf5d-848865df4c-jqrfq"
Sep 07 04:01:50.812850 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:50.812726    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gztkq\" (UniqueName: \"kubernetes.io/projected/dca6c2ea-5585-4c76-a70c-af1ce98656c1-kube-api-access-gztkq\") pod \"payload-pre-processing-e2e-ait-4d42cf5d-d48b676b-2s9fk\" (UID: \"dca6c2ea-5585-4c76-a70c-af1ce98656c1\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4d42cf5d-d48b676b-2s9fk"
Sep 07 04:01:50.812925 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:50.812866    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dca6c2ea-5585-4c76-a70c-af1ce98656c1-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-4d42cf5d-d48b676b-2s9fk\" (UID: \"dca6c2ea-5585-4c76-a70c-af1ce98656c1\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4d42cf5d-d48b676b-2s9fk"
Sep 07 04:01:50.914294 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:50.914213    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dca6c2ea-5585-4c76-a70c-af1ce98656c1-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-4d42cf5d-d48b676b-2s9fk\" (UID: \"dca6c2ea-5585-4c76-a70c-af1ce98656c1\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4d42cf5d-d48b676b-2s9fk"
Sep 07 04:01:50.914294 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:50.914256    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9n9f\" (UniqueName: \"kubernetes.io/projected/ae096b0b-8220-428f-abc0-a5333384c4bb-kube-api-access-k9n9f\") pod \"payload-processing-e2e-ait-4d42cf5d-848865df4c-jqrfq\" (UID: \"ae096b0b-8220-428f-abc0-a5333384c4bb\") " pod="openshift-ingress/payload-processing-e2e-ait-4d42cf5d-848865df4c-jqrfq"
Sep 07 04:01:50.914482 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:50.914366    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae096b0b-8220-428f-abc0-a5333384c4bb-plugins-config-volume\") pod \"payload-processing-e2e-ait-4d42cf5d-848865df4c-jqrfq\" (UID: \"ae096b0b-8220-428f-abc0-a5333384c4bb\") " pod="openshift-ingress/payload-processing-e2e-ait-4d42cf5d-848865df4c-jqrfq"
Sep 07 04:01:50.914482 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:50.914410    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gztkq\" (UniqueName: \"kubernetes.io/projected/dca6c2ea-5585-4c76-a70c-af1ce98656c1-kube-api-access-gztkq\") pod \"payload-pre-processing-e2e-ait-4d42cf5d-d48b676b-2s9fk\" (UID: \"dca6c2ea-5585-4c76-a70c-af1ce98656c1\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4d42cf5d-d48b676b-2s9fk"
Sep 07 04:01:50.915177 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:50.915151    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dca6c2ea-5585-4c76-a70c-af1ce98656c1-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-4d42cf5d-d48b676b-2s9fk\" (UID: \"dca6c2ea-5585-4c76-a70c-af1ce98656c1\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4d42cf5d-d48b676b-2s9fk"
Sep 07 04:01:50.915262 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:50.915199    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae096b0b-8220-428f-abc0-a5333384c4bb-plugins-config-volume\") pod \"payload-processing-e2e-ait-4d42cf5d-848865df4c-jqrfq\" (UID: \"ae096b0b-8220-428f-abc0-a5333384c4bb\") " pod="openshift-ingress/payload-processing-e2e-ait-4d42cf5d-848865df4c-jqrfq"
Sep 07 04:01:50.921825 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:50.921802    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9n9f\" (UniqueName: \"kubernetes.io/projected/ae096b0b-8220-428f-abc0-a5333384c4bb-kube-api-access-k9n9f\") pod \"payload-processing-e2e-ait-4d42cf5d-848865df4c-jqrfq\" (UID: \"ae096b0b-8220-428f-abc0-a5333384c4bb\") " pod="openshift-ingress/payload-processing-e2e-ait-4d42cf5d-848865df4c-jqrfq"
Sep 07 04:01:50.921932 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:50.921836    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gztkq\" (UniqueName: \"kubernetes.io/projected/dca6c2ea-5585-4c76-a70c-af1ce98656c1-kube-api-access-gztkq\") pod \"payload-pre-processing-e2e-ait-4d42cf5d-d48b676b-2s9fk\" (UID: \"dca6c2ea-5585-4c76-a70c-af1ce98656c1\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4d42cf5d-d48b676b-2s9fk"
Sep 07 04:01:50.969113 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:50.969084    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4d42cf5d-d48b676b-2s9fk"
Sep 07 04:01:50.990506 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:50.990478    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-4d42cf5d-848865df4c-jqrfq"
Sep 07 04:01:51.254038 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:51.254008    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4d42cf5d-d48b676b-2s9fk"]
Sep 07 04:01:51.254812 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:01:51.254783    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddca6c2ea_5585_4c76_a70c_af1ce98656c1.slice/crio-b1f9f6bea4c02270e8e2906b89ae637000b538dbd3631fb1180b446579071bd1 WatchSource:0}: Error finding container b1f9f6bea4c02270e8e2906b89ae637000b538dbd3631fb1180b446579071bd1: Status 404 returned error can't find the container with id b1f9f6bea4c02270e8e2906b89ae637000b538dbd3631fb1180b446579071bd1
Sep 07 04:01:51.273014 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:51.272989    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4d42cf5d-848865df4c-jqrfq"]
Sep 07 04:01:51.273346 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:01:51.273321    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae096b0b_8220_428f_abc0_a5333384c4bb.slice/crio-af61eb4e1ca0efd0106d1df8fae4de48afd714bef40d631d520cfb6416a203c8 WatchSource:0}: Error finding container af61eb4e1ca0efd0106d1df8fae4de48afd714bef40d631d520cfb6416a203c8: Status 404 returned error can't find the container with id af61eb4e1ca0efd0106d1df8fae4de48afd714bef40d631d520cfb6416a203c8
Sep 07 04:01:51.514169 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:51.514068    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-4d42cf5d-848865df4c-jqrfq" event={"ID":"ae096b0b-8220-428f-abc0-a5333384c4bb","Type":"ContainerStarted","Data":"7f39265659c9da91149441d0b119b3c823928ca9b3d7feec1a7140f0ccb2380f"}
Sep 07 04:01:51.514169 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:51.514132    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-4d42cf5d-848865df4c-jqrfq" event={"ID":"ae096b0b-8220-428f-abc0-a5333384c4bb","Type":"ContainerStarted","Data":"af61eb4e1ca0efd0106d1df8fae4de48afd714bef40d631d520cfb6416a203c8"}
Sep 07 04:01:51.514398 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:51.514246    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-4d42cf5d-848865df4c-jqrfq"
Sep 07 04:01:51.515772 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:51.515750    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4d42cf5d-d48b676b-2s9fk" event={"ID":"dca6c2ea-5585-4c76-a70c-af1ce98656c1","Type":"ContainerStarted","Data":"bb1ed1a9d9ec1fe883f6ae3089a504fa1a403c14cc977d014b90eee6904587df"}
Sep 07 04:01:51.515888 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:51.515791    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4d42cf5d-d48b676b-2s9fk" event={"ID":"dca6c2ea-5585-4c76-a70c-af1ce98656c1","Type":"ContainerStarted","Data":"b1f9f6bea4c02270e8e2906b89ae637000b538dbd3631fb1180b446579071bd1"}
Sep 07 04:01:51.515888 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:51.515819    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-4d42cf5d-d48b676b-2s9fk"
Sep 07 04:01:51.529697 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:51.529653    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-4d42cf5d-848865df4c-jqrfq" podStartSLOduration=1.5296374959999999 podStartE2EDuration="1.529637496s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:01:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:01:51.527795028 +0000 UTC m=+814.840270931" watchObservedRunningTime="2026-09-07 04:01:51.529637496 +0000 UTC m=+814.842113399"
Sep 07 04:01:51.544576 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:51.544534    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-4d42cf5d-d48b676b-2s9fk" podStartSLOduration=1.544520673 podStartE2EDuration="1.544520673s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:01:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:01:51.541679631 +0000 UTC m=+814.854155534" watchObservedRunningTime="2026-09-07 04:01:51.544520673 +0000 UTC m=+814.856996610"
Sep 07 04:01:52.574468 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:52.574427    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-908959-bnrr4"]
Sep 07 04:01:52.576980 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:52.576962    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-908959-bnrr4"
Sep 07 04:01:52.579163 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:52.579141    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zs4ff\""
Sep 07 04:01:52.579294 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:52.579169    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 07 04:01:52.584592 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:52.584572    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-908959-bnrr4"]
Sep 07 04:01:52.752193 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:52.752160    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d68bccbd-e519-4592-8995-f74439a4fa15-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-908959-bnrr4\" (UID: \"d68bccbd-e519-4592-8995-f74439a4fa15\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-908959-bnrr4"
Sep 07 04:01:52.853805 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:52.853710    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d68bccbd-e519-4592-8995-f74439a4fa15-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-908959-bnrr4\" (UID: \"d68bccbd-e519-4592-8995-f74439a4fa15\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-908959-bnrr4"
Sep 07 04:01:52.854545 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:52.854523    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d68bccbd-e519-4592-8995-f74439a4fa15-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-908959-bnrr4\" (UID: \"d68bccbd-e519-4592-8995-f74439a4fa15\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-908959-bnrr4"
Sep 07 04:01:52.890364 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:52.890320    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-908959-bnrr4"
Sep 07 04:01:53.165719 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:53.165670    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-908959-bnrr4"]
Sep 07 04:01:53.167795 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:01:53.167756    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd68bccbd_e519_4592_8995_f74439a4fa15.slice/crio-427bf624d97d142ff1da488c32bc0af2d748f87ce5942a3dfae5dbd19c7b65d2 WatchSource:0}: Error finding container 427bf624d97d142ff1da488c32bc0af2d748f87ce5942a3dfae5dbd19c7b65d2: Status 404 returned error can't find the container with id 427bf624d97d142ff1da488c32bc0af2d748f87ce5942a3dfae5dbd19c7b65d2
Sep 07 04:01:53.529182 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:53.529139    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-908959-bnrr4" event={"ID":"d68bccbd-e519-4592-8995-f74439a4fa15","Type":"ContainerStarted","Data":"39958517833a7c1f3a1c7bcffe9db16df154df6d424d1c33c7743aaa7888e976"}
Sep 07 04:01:53.529358 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:53.529242    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-908959-bnrr4" event={"ID":"d68bccbd-e519-4592-8995-f74439a4fa15","Type":"ContainerStarted","Data":"427bf624d97d142ff1da488c32bc0af2d748f87ce5942a3dfae5dbd19c7b65d2"}
Sep 07 04:01:53.544374 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:53.544325    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-908959-bnrr4" podStartSLOduration=1.544310946 podStartE2EDuration="1.544310946s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:01:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:01:53.542031363 +0000 UTC m=+816.854507265" watchObservedRunningTime="2026-09-07 04:01:53.544310946 +0000 UTC m=+816.856786877"
Sep 07 04:01:54.537404 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:54.537358    2559 generic.go:356] "Generic (PLEG): container finished" podID="d68bccbd-e519-4592-8995-f74439a4fa15" containerID="39958517833a7c1f3a1c7bcffe9db16df154df6d424d1c33c7743aaa7888e976" exitCode=0
Sep 07 04:01:54.537813 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:54.537411    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-908959-bnrr4" event={"ID":"d68bccbd-e519-4592-8995-f74439a4fa15","Type":"ContainerDied","Data":"39958517833a7c1f3a1c7bcffe9db16df154df6d424d1c33c7743aaa7888e976"}
Sep 07 04:01:55.676257 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:55.676233    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-908959-bnrr4"
Sep 07 04:01:55.786699 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:55.786665    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d68bccbd-e519-4592-8995-f74439a4fa15-maas-api-service-ca\") pod \"d68bccbd-e519-4592-8995-f74439a4fa15\" (UID: \"d68bccbd-e519-4592-8995-f74439a4fa15\") "
Sep 07 04:01:55.787111 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:55.787085    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d68bccbd-e519-4592-8995-f74439a4fa15-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d68bccbd-e519-4592-8995-f74439a4fa15" (UID: "d68bccbd-e519-4592-8995-f74439a4fa15"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 04:01:55.888132 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:55.888102    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d68bccbd-e519-4592-8995-f74439a4fa15-maas-api-service-ca\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:01:56.551720 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:56.551692    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-908959-bnrr4"
Sep 07 04:01:56.551720 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:56.551714    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-908959-bnrr4" event={"ID":"d68bccbd-e519-4592-8995-f74439a4fa15","Type":"ContainerDied","Data":"427bf624d97d142ff1da488c32bc0af2d748f87ce5942a3dfae5dbd19c7b65d2"}
Sep 07 04:01:56.551940 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:01:56.551760    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="427bf624d97d142ff1da488c32bc0af2d748f87ce5942a3dfae5dbd19c7b65d2"
Sep 07 04:02:02.524837 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:02.524801    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-4d42cf5d-d48b676b-2s9fk"
Sep 07 04:02:02.525291 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:02.524919    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-4d42cf5d-848865df4c-jqrfq"
Sep 07 04:02:03.105647 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:03.105144    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-908959-b84ff9dd5-z2wd9"]
Sep 07 04:02:03.105647 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:03.105521    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-908959-b84ff9dd5-z2wd9" podUID="4ff538f1-8742-4977-81e2-9409347e1141" containerName="payload-processing" containerID="cri-o://384a92f6849343a913c58d57788eda46b2d31693bb22554553fa858f367907f2" gracePeriod=30
Sep 07 04:02:03.124203 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:03.124174    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-908959-bb85d8f58-jn5qn"]
Sep 07 04:02:03.124600 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:03.124570    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-autores-908959-bb85d8f58-jn5qn" podUID="b825b52e-4c53-4e29-b81d-790c02c79f44" containerName="payload-pre-processing" containerID="cri-o://4682ef187c041e5f4109d93d1ec939200456044a7d98bb38cd600c8566fab3b1" gracePeriod=30
Sep 07 04:02:03.264837 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:03.264806    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-908959-bnrr4"]
Sep 07 04:02:03.269255 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:03.269160    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-908959-bnrr4"]
Sep 07 04:02:03.451655 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:03.446815    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-908959-b84ff9dd5-z2wd9"
Sep 07 04:02:03.476479 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:03.476452    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ff538f1-8742-4977-81e2-9409347e1141-plugins-config-volume\") pod \"4ff538f1-8742-4977-81e2-9409347e1141\" (UID: \"4ff538f1-8742-4977-81e2-9409347e1141\") "
Sep 07 04:02:03.476599 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:03.476497    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6f25\" (UniqueName: \"kubernetes.io/projected/4ff538f1-8742-4977-81e2-9409347e1141-kube-api-access-f6f25\") pod \"4ff538f1-8742-4977-81e2-9409347e1141\" (UID: \"4ff538f1-8742-4977-81e2-9409347e1141\") "
Sep 07 04:02:03.476879 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:03.476858    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ff538f1-8742-4977-81e2-9409347e1141-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4ff538f1-8742-4977-81e2-9409347e1141" (UID: "4ff538f1-8742-4977-81e2-9409347e1141"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 04:02:03.478672 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:03.478641    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ff538f1-8742-4977-81e2-9409347e1141-kube-api-access-f6f25" (OuterVolumeSpecName: "kube-api-access-f6f25") pod "4ff538f1-8742-4977-81e2-9409347e1141" (UID: "4ff538f1-8742-4977-81e2-9409347e1141"). InnerVolumeSpecName "kube-api-access-f6f25". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 04:02:03.485737 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:03.485719    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-908959-bb85d8f58-jn5qn"
Sep 07 04:02:03.577737 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:03.577701    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b825b52e-4c53-4e29-b81d-790c02c79f44-plugins-config-volume\") pod \"b825b52e-4c53-4e29-b81d-790c02c79f44\" (UID: \"b825b52e-4c53-4e29-b81d-790c02c79f44\") "
Sep 07 04:02:03.578209 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:03.577780    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zmmkg\" (UniqueName: \"kubernetes.io/projected/b825b52e-4c53-4e29-b81d-790c02c79f44-kube-api-access-zmmkg\") pod \"b825b52e-4c53-4e29-b81d-790c02c79f44\" (UID: \"b825b52e-4c53-4e29-b81d-790c02c79f44\") "
Sep 07 04:02:03.578209 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:03.578079    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b825b52e-4c53-4e29-b81d-790c02c79f44-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b825b52e-4c53-4e29-b81d-790c02c79f44" (UID: "b825b52e-4c53-4e29-b81d-790c02c79f44"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 04:02:03.578209 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:03.578156    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ff538f1-8742-4977-81e2-9409347e1141-plugins-config-volume\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:02:03.578209 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:03.578175    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6f25\" (UniqueName: \"kubernetes.io/projected/4ff538f1-8742-4977-81e2-9409347e1141-kube-api-access-f6f25\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:02:03.578209 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:03.578187    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b825b52e-4c53-4e29-b81d-790c02c79f44-plugins-config-volume\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:02:03.579792 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:03.579770    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b825b52e-4c53-4e29-b81d-790c02c79f44-kube-api-access-zmmkg" (OuterVolumeSpecName: "kube-api-access-zmmkg") pod "b825b52e-4c53-4e29-b81d-790c02c79f44" (UID: "b825b52e-4c53-4e29-b81d-790c02c79f44"). InnerVolumeSpecName "kube-api-access-zmmkg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 04:02:03.599438 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:03.599409    2559 generic.go:356] "Generic (PLEG): container finished" podID="b825b52e-4c53-4e29-b81d-790c02c79f44" containerID="4682ef187c041e5f4109d93d1ec939200456044a7d98bb38cd600c8566fab3b1" exitCode=0
Sep 07 04:02:03.599569 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:03.599457    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-908959-bb85d8f58-jn5qn"
Sep 07 04:02:03.599569 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:03.599500    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-908959-bb85d8f58-jn5qn" event={"ID":"b825b52e-4c53-4e29-b81d-790c02c79f44","Type":"ContainerDied","Data":"4682ef187c041e5f4109d93d1ec939200456044a7d98bb38cd600c8566fab3b1"}
Sep 07 04:02:03.599569 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:03.599564    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-908959-bb85d8f58-jn5qn" event={"ID":"b825b52e-4c53-4e29-b81d-790c02c79f44","Type":"ContainerDied","Data":"014e67149f0017584ad6cfef81b333751432de720af033ff3b6e64afecce7793"}
Sep 07 04:02:03.599766 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:03.599595    2559 scope.go:117] "RemoveContainer" containerID="4682ef187c041e5f4109d93d1ec939200456044a7d98bb38cd600c8566fab3b1"
Sep 07 04:02:03.601058 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:03.601035    2559 generic.go:356] "Generic (PLEG): container finished" podID="4ff538f1-8742-4977-81e2-9409347e1141" containerID="384a92f6849343a913c58d57788eda46b2d31693bb22554553fa858f367907f2" exitCode=0
Sep 07 04:02:03.601163 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:03.601063    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-908959-b84ff9dd5-z2wd9" event={"ID":"4ff538f1-8742-4977-81e2-9409347e1141","Type":"ContainerDied","Data":"384a92f6849343a913c58d57788eda46b2d31693bb22554553fa858f367907f2"}
Sep 07 04:02:03.601163 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:03.601078    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-908959-b84ff9dd5-z2wd9"
Sep 07 04:02:03.601163 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:03.601115    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-908959-b84ff9dd5-z2wd9" event={"ID":"4ff538f1-8742-4977-81e2-9409347e1141","Type":"ContainerDied","Data":"a55228c4bc304ad36b658f929746ce8e13f46127afa804ac7f8a062e87e6971b"}
Sep 07 04:02:03.610054 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:03.610037    2559 scope.go:117] "RemoveContainer" containerID="4682ef187c041e5f4109d93d1ec939200456044a7d98bb38cd600c8566fab3b1"
Sep 07 04:02:03.610390 ip-10-0-132-4 kubenswrapper[2559]: E0907 04:02:03.610369    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4682ef187c041e5f4109d93d1ec939200456044a7d98bb38cd600c8566fab3b1\": container with ID starting with 4682ef187c041e5f4109d93d1ec939200456044a7d98bb38cd600c8566fab3b1 not found: ID does not exist" containerID="4682ef187c041e5f4109d93d1ec939200456044a7d98bb38cd600c8566fab3b1"
Sep 07 04:02:03.610498 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:03.610399    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4682ef187c041e5f4109d93d1ec939200456044a7d98bb38cd600c8566fab3b1"} err="failed to get container status \"4682ef187c041e5f4109d93d1ec939200456044a7d98bb38cd600c8566fab3b1\": rpc error: code = NotFound desc = could not find container \"4682ef187c041e5f4109d93d1ec939200456044a7d98bb38cd600c8566fab3b1\": container with ID starting with 4682ef187c041e5f4109d93d1ec939200456044a7d98bb38cd600c8566fab3b1 not found: ID does not exist"
Sep 07 04:02:03.610498 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:03.610422    2559 scope.go:117] "RemoveContainer" containerID="384a92f6849343a913c58d57788eda46b2d31693bb22554553fa858f367907f2"
Sep 07 04:02:03.619044 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:03.619025    2559 scope.go:117] "RemoveContainer" containerID="384a92f6849343a913c58d57788eda46b2d31693bb22554553fa858f367907f2"
Sep 07 04:02:03.619319 ip-10-0-132-4 kubenswrapper[2559]: E0907 04:02:03.619297    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"384a92f6849343a913c58d57788eda46b2d31693bb22554553fa858f367907f2\": container with ID starting with 384a92f6849343a913c58d57788eda46b2d31693bb22554553fa858f367907f2 not found: ID does not exist" containerID="384a92f6849343a913c58d57788eda46b2d31693bb22554553fa858f367907f2"
Sep 07 04:02:03.619367 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:03.619328    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"384a92f6849343a913c58d57788eda46b2d31693bb22554553fa858f367907f2"} err="failed to get container status \"384a92f6849343a913c58d57788eda46b2d31693bb22554553fa858f367907f2\": rpc error: code = NotFound desc = could not find container \"384a92f6849343a913c58d57788eda46b2d31693bb22554553fa858f367907f2\": container with ID starting with 384a92f6849343a913c58d57788eda46b2d31693bb22554553fa858f367907f2 not found: ID does not exist"
Sep 07 04:02:03.624674 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:03.624654    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-908959-bb85d8f58-jn5qn"]
Sep 07 04:02:03.627129 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:03.627078    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-908959-bb85d8f58-jn5qn"]
Sep 07 04:02:03.655699 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:03.655655    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-908959-b84ff9dd5-z2wd9"]
Sep 07 04:02:03.659794 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:03.659755    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-908959-b84ff9dd5-z2wd9"]
Sep 07 04:02:03.679100 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:03.679072    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zmmkg\" (UniqueName: \"kubernetes.io/projected/b825b52e-4c53-4e29-b81d-790c02c79f44-kube-api-access-zmmkg\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:02:05.179747 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:05.179717    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ff538f1-8742-4977-81e2-9409347e1141" path="/var/lib/kubelet/pods/4ff538f1-8742-4977-81e2-9409347e1141/volumes"
Sep 07 04:02:05.180131 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:05.180100    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b825b52e-4c53-4e29-b81d-790c02c79f44" path="/var/lib/kubelet/pods/b825b52e-4c53-4e29-b81d-790c02c79f44/volumes"
Sep 07 04:02:05.180383 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:05.180370    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d68bccbd-e519-4592-8995-f74439a4fa15" path="/var/lib/kubelet/pods/d68bccbd-e519-4592-8995-f74439a4fa15/volumes"
Sep 07 04:02:11.659857 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:11.659768    2559 generic.go:356] "Generic (PLEG): container finished" podID="16cf3c25-3214-4f35-bec6-d7fdd67afb66" containerID="08afc204d30497ae0e7483291510dc72babfc5fe7943a5193571699ce8129e11" exitCode=0
Sep 07 04:02:11.659857 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:11.659842    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb" event={"ID":"16cf3c25-3214-4f35-bec6-d7fdd67afb66","Type":"ContainerDied","Data":"08afc204d30497ae0e7483291510dc72babfc5fe7943a5193571699ce8129e11"}
Sep 07 04:02:11.660382 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:11.660240    2559 scope.go:117] "RemoveContainer" containerID="08afc204d30497ae0e7483291510dc72babfc5fe7943a5193571699ce8129e11"
Sep 07 04:02:11.661313 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:11.661285    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 04:02:11.661382 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:11.661353    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 04:02:11.661421 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:11.661398    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 04:02:12.668148 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:12.668118    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb" event={"ID":"16cf3c25-3214-4f35-bec6-d7fdd67afb66","Type":"ContainerStarted","Data":"f04840b41a8df132bff8e4f4b71cecc722d77066c72df13d7c000c6662cc7cc0"}
Sep 07 04:02:13.208336 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:13.208305    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb"
Sep 07 04:02:13.208544 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:13.208523    2559 patch_prober.go:28] interesting pod/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 07 04:02:13.208590 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:13.208572    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb" podUID="16cf3c25-3214-4f35-bec6-d7fdd67afb66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 07 04:02:14.207924 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:14.207890    2559 patch_prober.go:28] interesting pod/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 07 04:02:14.208327 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:14.207952    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb" podUID="16cf3c25-3214-4f35-bec6-d7fdd67afb66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 07 04:02:14.554360 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:14.554269    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4d42cf5d-hqmxf"]
Sep 07 04:02:14.554934 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:14.554905    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d68bccbd-e519-4592-8995-f74439a4fa15" containerName="revoke-keys"
Sep 07 04:02:14.554934 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:14.554933    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d68bccbd-e519-4592-8995-f74439a4fa15" containerName="revoke-keys"
Sep 07 04:02:14.555130 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:14.554967    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ff538f1-8742-4977-81e2-9409347e1141" containerName="payload-processing"
Sep 07 04:02:14.555130 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:14.554977    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ff538f1-8742-4977-81e2-9409347e1141" containerName="payload-processing"
Sep 07 04:02:14.555130 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:14.555003    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b825b52e-4c53-4e29-b81d-790c02c79f44" containerName="payload-pre-processing"
Sep 07 04:02:14.555130 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:14.555013    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b825b52e-4c53-4e29-b81d-790c02c79f44" containerName="payload-pre-processing"
Sep 07 04:02:14.555130 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:14.555104    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ff538f1-8742-4977-81e2-9409347e1141" containerName="payload-processing"
Sep 07 04:02:14.555130 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:14.555118    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d68bccbd-e519-4592-8995-f74439a4fa15" containerName="revoke-keys"
Sep 07 04:02:14.555130 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:14.555128    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b825b52e-4c53-4e29-b81d-790c02c79f44" containerName="payload-pre-processing"
Sep 07 04:02:14.557802 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:14.557782    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4d42cf5d-hqmxf"
Sep 07 04:02:14.559981 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:14.559948    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zs4ff\""
Sep 07 04:02:14.560138 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:14.559963    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 07 04:02:14.565993 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:14.565969    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4d42cf5d-hqmxf"]
Sep 07 04:02:14.686358 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:14.686326    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74b0d778-7168-47ca-bfe5-054b38534ba3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4d42cf5d-hqmxf\" (UID: \"74b0d778-7168-47ca-bfe5-054b38534ba3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4d42cf5d-hqmxf"
Sep 07 04:02:14.787137 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:14.787100    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74b0d778-7168-47ca-bfe5-054b38534ba3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4d42cf5d-hqmxf\" (UID: \"74b0d778-7168-47ca-bfe5-054b38534ba3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4d42cf5d-hqmxf"
Sep 07 04:02:14.787739 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:14.787721    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74b0d778-7168-47ca-bfe5-054b38534ba3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4d42cf5d-hqmxf\" (UID: \"74b0d778-7168-47ca-bfe5-054b38534ba3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4d42cf5d-hqmxf"
Sep 07 04:02:14.873889 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:14.873856    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4d42cf5d-hqmxf"
Sep 07 04:02:15.060058 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:15.060019    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-a84f90-6bbdc768f8-4524f"]
Sep 07 04:02:15.063524 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:15.063491    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a84f90-6bbdc768f8-4524f"
Sep 07 04:02:15.066313 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:15.066281    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-a84f90-dockercfg-r74gk\""
Sep 07 04:02:15.068734 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:15.068715    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-a84f90\""
Sep 07 04:02:15.070106 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:15.070083    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-a84f90-6bbdc768f8-4524f"]
Sep 07 04:02:15.153889 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:15.153736    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4d42cf5d-hqmxf"]
Sep 07 04:02:15.192813 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:15.192445    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxx5j\" (UniqueName: \"kubernetes.io/projected/9dd2635b-2354-45a5-935d-10f55ceffd61-kube-api-access-hxx5j\") pod \"payload-pre-processing-e2e-explicit-a84f90-6bbdc768f8-4524f\" (UID: \"9dd2635b-2354-45a5-935d-10f55ceffd61\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-a84f90-6bbdc768f8-4524f"
Sep 07 04:02:15.192813 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:15.192494    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9dd2635b-2354-45a5-935d-10f55ceffd61-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-a84f90-6bbdc768f8-4524f\" (UID: \"9dd2635b-2354-45a5-935d-10f55ceffd61\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-a84f90-6bbdc768f8-4524f"
Sep 07 04:02:15.208826 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:15.208774    2559 patch_prober.go:28] interesting pod/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 07 04:02:15.209222 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:15.208840    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb" podUID="16cf3c25-3214-4f35-bec6-d7fdd67afb66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 07 04:02:15.294070 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:15.294041    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxx5j\" (UniqueName: \"kubernetes.io/projected/9dd2635b-2354-45a5-935d-10f55ceffd61-kube-api-access-hxx5j\") pod \"payload-pre-processing-e2e-explicit-a84f90-6bbdc768f8-4524f\" (UID: \"9dd2635b-2354-45a5-935d-10f55ceffd61\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-a84f90-6bbdc768f8-4524f"
Sep 07 04:02:15.294070 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:15.294074    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9dd2635b-2354-45a5-935d-10f55ceffd61-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-a84f90-6bbdc768f8-4524f\" (UID: \"9dd2635b-2354-45a5-935d-10f55ceffd61\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-a84f90-6bbdc768f8-4524f"
Sep 07 04:02:15.294776 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:15.294758    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9dd2635b-2354-45a5-935d-10f55ceffd61-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-a84f90-6bbdc768f8-4524f\" (UID: \"9dd2635b-2354-45a5-935d-10f55ceffd61\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-a84f90-6bbdc768f8-4524f"
Sep 07 04:02:15.344322 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:15.344285    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxx5j\" (UniqueName: \"kubernetes.io/projected/9dd2635b-2354-45a5-935d-10f55ceffd61-kube-api-access-hxx5j\") pod \"payload-pre-processing-e2e-explicit-a84f90-6bbdc768f8-4524f\" (UID: \"9dd2635b-2354-45a5-935d-10f55ceffd61\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-a84f90-6bbdc768f8-4524f"
Sep 07 04:02:15.377134 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:15.377095    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a84f90-6bbdc768f8-4524f"
Sep 07 04:02:15.663236 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:15.663206    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-a84f90-6bbdc768f8-4524f"]
Sep 07 04:02:15.664978 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:02:15.664948    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dd2635b_2354_45a5_935d_10f55ceffd61.slice/crio-61ac56a24daeec178bb50bb4d83949973854ff06952bb3cc4f58a6317964df24 WatchSource:0}: Error finding container 61ac56a24daeec178bb50bb4d83949973854ff06952bb3cc4f58a6317964df24: Status 404 returned error can't find the container with id 61ac56a24daeec178bb50bb4d83949973854ff06952bb3cc4f58a6317964df24
Sep 07 04:02:15.687336 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:15.687308    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a84f90-6bbdc768f8-4524f" event={"ID":"9dd2635b-2354-45a5-935d-10f55ceffd61","Type":"ContainerStarted","Data":"61ac56a24daeec178bb50bb4d83949973854ff06952bb3cc4f58a6317964df24"}
Sep 07 04:02:15.688849 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:15.688821    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4d42cf5d-hqmxf" event={"ID":"74b0d778-7168-47ca-bfe5-054b38534ba3","Type":"ContainerStarted","Data":"9603995dd8ef6a0a26d5647e0107e31eddfe1eb78eb5b9ec2ce70eea126eefc5"}
Sep 07 04:02:15.688934 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:15.688867    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4d42cf5d-hqmxf" event={"ID":"74b0d778-7168-47ca-bfe5-054b38534ba3","Type":"ContainerStarted","Data":"8faa28207d09dcfed9290aba41ccccc0d4f2e0124c37a4f9cd6d61bdb032185f"}
Sep 07 04:02:15.704996 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:15.704954    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4d42cf5d-hqmxf" podStartSLOduration=1.704940583 podStartE2EDuration="1.704940583s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:02:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:02:15.701602794 +0000 UTC m=+839.014078711" watchObservedRunningTime="2026-09-07 04:02:15.704940583 +0000 UTC m=+839.017416484"
Sep 07 04:02:16.207858 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:16.207822    2559 patch_prober.go:28] interesting pod/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 07 04:02:16.208066 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:16.207886    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb" podUID="16cf3c25-3214-4f35-bec6-d7fdd67afb66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 07 04:02:16.702599 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:16.702559    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a84f90-6bbdc768f8-4524f" event={"ID":"9dd2635b-2354-45a5-935d-10f55ceffd61","Type":"ContainerStarted","Data":"203dce699181e91e767f43cf363ed20cdabdcad02978f62bdc8a9e6243c8a8dc"}
Sep 07 04:02:16.703117 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:16.702688    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a84f90-6bbdc768f8-4524f"
Sep 07 04:02:16.704316 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:16.704288    2559 generic.go:356] "Generic (PLEG): container finished" podID="74b0d778-7168-47ca-bfe5-054b38534ba3" containerID="9603995dd8ef6a0a26d5647e0107e31eddfe1eb78eb5b9ec2ce70eea126eefc5" exitCode=0
Sep 07 04:02:16.704426 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:16.704356    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4d42cf5d-hqmxf" event={"ID":"74b0d778-7168-47ca-bfe5-054b38534ba3","Type":"ContainerDied","Data":"9603995dd8ef6a0a26d5647e0107e31eddfe1eb78eb5b9ec2ce70eea126eefc5"}
Sep 07 04:02:16.721097 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:16.721050    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a84f90-6bbdc768f8-4524f" podStartSLOduration=1.721037088 podStartE2EDuration="1.721037088s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:02:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:02:16.718114508 +0000 UTC m=+840.030590410" watchObservedRunningTime="2026-09-07 04:02:16.721037088 +0000 UTC m=+840.033512989"
Sep 07 04:02:17.207858 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:17.207821    2559 patch_prober.go:28] interesting pod/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 07 04:02:17.208031 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:17.207876    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb" podUID="16cf3c25-3214-4f35-bec6-d7fdd67afb66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 07 04:02:17.894254 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:17.894225    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4d42cf5d-hqmxf"
Sep 07 04:02:18.021887 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:18.021770    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74b0d778-7168-47ca-bfe5-054b38534ba3-maas-api-service-ca\") pod \"74b0d778-7168-47ca-bfe5-054b38534ba3\" (UID: \"74b0d778-7168-47ca-bfe5-054b38534ba3\") "
Sep 07 04:02:18.022119 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:18.022090    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74b0d778-7168-47ca-bfe5-054b38534ba3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "74b0d778-7168-47ca-bfe5-054b38534ba3" (UID: "74b0d778-7168-47ca-bfe5-054b38534ba3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 04:02:18.122834 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:18.122795    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74b0d778-7168-47ca-bfe5-054b38534ba3-maas-api-service-ca\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:02:18.212202 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:18.212170    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb"
Sep 07 04:02:18.212483 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:18.212462    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb"
Sep 07 04:02:18.213128 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:18.213113    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb"
Sep 07 04:02:18.717075 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:18.717042    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4d42cf5d-hqmxf"
Sep 07 04:02:18.717250 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:18.717072    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4d42cf5d-hqmxf" event={"ID":"74b0d778-7168-47ca-bfe5-054b38534ba3","Type":"ContainerDied","Data":"8faa28207d09dcfed9290aba41ccccc0d4f2e0124c37a4f9cd6d61bdb032185f"}
Sep 07 04:02:18.717250 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:18.717118    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8faa28207d09dcfed9290aba41ccccc0d4f2e0124c37a4f9cd6d61bdb032185f"
Sep 07 04:02:20.709158 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:20.709124    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4d42cf5d-848865df4c-jqrfq"]
Sep 07 04:02:20.709652 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:20.709397    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-4d42cf5d-848865df4c-jqrfq" podUID="ae096b0b-8220-428f-abc0-a5333384c4bb" containerName="payload-processing" containerID="cri-o://7f39265659c9da91149441d0b119b3c823928ca9b3d7feec1a7140f0ccb2380f" gracePeriod=30
Sep 07 04:02:20.716411 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:20.716384    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4d42cf5d-d48b676b-2s9fk"]
Sep 07 04:02:20.716682 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:20.716655    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-4d42cf5d-d48b676b-2s9fk" podUID="dca6c2ea-5585-4c76-a70c-af1ce98656c1" containerName="payload-pre-processing" containerID="cri-o://bb1ed1a9d9ec1fe883f6ae3089a504fa1a403c14cc977d014b90eee6904587df" gracePeriod=30
Sep 07 04:02:20.853743 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:20.853616    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4d42cf5d-hqmxf"]
Sep 07 04:02:20.856383 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:20.856351    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4d42cf5d-hqmxf"]
Sep 07 04:02:20.992508 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:20.992484    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-4d42cf5d-848865df4c-jqrfq"
Sep 07 04:02:21.004838 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:21.004809    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4d42cf5d-d48b676b-2s9fk"
Sep 07 04:02:21.049965 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:21.049935    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae096b0b-8220-428f-abc0-a5333384c4bb-plugins-config-volume\") pod \"ae096b0b-8220-428f-abc0-a5333384c4bb\" (UID: \"ae096b0b-8220-428f-abc0-a5333384c4bb\") "
Sep 07 04:02:21.050142 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:21.049989    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dca6c2ea-5585-4c76-a70c-af1ce98656c1-plugins-config-volume\") pod \"dca6c2ea-5585-4c76-a70c-af1ce98656c1\" (UID: \"dca6c2ea-5585-4c76-a70c-af1ce98656c1\") "
Sep 07 04:02:21.050142 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:21.050030    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gztkq\" (UniqueName: \"kubernetes.io/projected/dca6c2ea-5585-4c76-a70c-af1ce98656c1-kube-api-access-gztkq\") pod \"dca6c2ea-5585-4c76-a70c-af1ce98656c1\" (UID: \"dca6c2ea-5585-4c76-a70c-af1ce98656c1\") "
Sep 07 04:02:21.050142 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:21.050071    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9n9f\" (UniqueName: \"kubernetes.io/projected/ae096b0b-8220-428f-abc0-a5333384c4bb-kube-api-access-k9n9f\") pod \"ae096b0b-8220-428f-abc0-a5333384c4bb\" (UID: \"ae096b0b-8220-428f-abc0-a5333384c4bb\") "
Sep 07 04:02:21.050390 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:21.050316    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae096b0b-8220-428f-abc0-a5333384c4bb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ae096b0b-8220-428f-abc0-a5333384c4bb" (UID: "ae096b0b-8220-428f-abc0-a5333384c4bb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 04:02:21.050449 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:21.050400    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae096b0b-8220-428f-abc0-a5333384c4bb-plugins-config-volume\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:02:21.050449 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:21.050416    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dca6c2ea-5585-4c76-a70c-af1ce98656c1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "dca6c2ea-5585-4c76-a70c-af1ce98656c1" (UID: "dca6c2ea-5585-4c76-a70c-af1ce98656c1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 04:02:21.052210 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:21.052186    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dca6c2ea-5585-4c76-a70c-af1ce98656c1-kube-api-access-gztkq" (OuterVolumeSpecName: "kube-api-access-gztkq") pod "dca6c2ea-5585-4c76-a70c-af1ce98656c1" (UID: "dca6c2ea-5585-4c76-a70c-af1ce98656c1"). InnerVolumeSpecName "kube-api-access-gztkq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 04:02:21.052302 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:21.052230    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae096b0b-8220-428f-abc0-a5333384c4bb-kube-api-access-k9n9f" (OuterVolumeSpecName: "kube-api-access-k9n9f") pod "ae096b0b-8220-428f-abc0-a5333384c4bb" (UID: "ae096b0b-8220-428f-abc0-a5333384c4bb"). InnerVolumeSpecName "kube-api-access-k9n9f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 04:02:21.151116 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:21.151079    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dca6c2ea-5585-4c76-a70c-af1ce98656c1-plugins-config-volume\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:02:21.151116 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:21.151111    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gztkq\" (UniqueName: \"kubernetes.io/projected/dca6c2ea-5585-4c76-a70c-af1ce98656c1-kube-api-access-gztkq\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:02:21.151116 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:21.151124    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9n9f\" (UniqueName: \"kubernetes.io/projected/ae096b0b-8220-428f-abc0-a5333384c4bb-kube-api-access-k9n9f\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:02:21.180378 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:21.180347    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74b0d778-7168-47ca-bfe5-054b38534ba3" path="/var/lib/kubelet/pods/74b0d778-7168-47ca-bfe5-054b38534ba3/volumes"
Sep 07 04:02:21.749480 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:21.749447    2559 generic.go:356] "Generic (PLEG): container finished" podID="dca6c2ea-5585-4c76-a70c-af1ce98656c1" containerID="bb1ed1a9d9ec1fe883f6ae3089a504fa1a403c14cc977d014b90eee6904587df" exitCode=0
Sep 07 04:02:21.749959 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:21.749507    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4d42cf5d-d48b676b-2s9fk"
Sep 07 04:02:21.749959 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:21.749534    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4d42cf5d-d48b676b-2s9fk" event={"ID":"dca6c2ea-5585-4c76-a70c-af1ce98656c1","Type":"ContainerDied","Data":"bb1ed1a9d9ec1fe883f6ae3089a504fa1a403c14cc977d014b90eee6904587df"}
Sep 07 04:02:21.749959 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:21.749590    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4d42cf5d-d48b676b-2s9fk" event={"ID":"dca6c2ea-5585-4c76-a70c-af1ce98656c1","Type":"ContainerDied","Data":"b1f9f6bea4c02270e8e2906b89ae637000b538dbd3631fb1180b446579071bd1"}
Sep 07 04:02:21.749959 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:21.749642    2559 scope.go:117] "RemoveContainer" containerID="bb1ed1a9d9ec1fe883f6ae3089a504fa1a403c14cc977d014b90eee6904587df"
Sep 07 04:02:21.751182 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:21.751112    2559 generic.go:356] "Generic (PLEG): container finished" podID="ae096b0b-8220-428f-abc0-a5333384c4bb" containerID="7f39265659c9da91149441d0b119b3c823928ca9b3d7feec1a7140f0ccb2380f" exitCode=0
Sep 07 04:02:21.751182 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:21.751167    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-4d42cf5d-848865df4c-jqrfq"
Sep 07 04:02:21.751338 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:21.751205    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-4d42cf5d-848865df4c-jqrfq" event={"ID":"ae096b0b-8220-428f-abc0-a5333384c4bb","Type":"ContainerDied","Data":"7f39265659c9da91149441d0b119b3c823928ca9b3d7feec1a7140f0ccb2380f"}
Sep 07 04:02:21.751338 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:21.751243    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-4d42cf5d-848865df4c-jqrfq" event={"ID":"ae096b0b-8220-428f-abc0-a5333384c4bb","Type":"ContainerDied","Data":"af61eb4e1ca0efd0106d1df8fae4de48afd714bef40d631d520cfb6416a203c8"}
Sep 07 04:02:21.759494 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:21.759478    2559 scope.go:117] "RemoveContainer" containerID="bb1ed1a9d9ec1fe883f6ae3089a504fa1a403c14cc977d014b90eee6904587df"
Sep 07 04:02:21.759788 ip-10-0-132-4 kubenswrapper[2559]: E0907 04:02:21.759769    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb1ed1a9d9ec1fe883f6ae3089a504fa1a403c14cc977d014b90eee6904587df\": container with ID starting with bb1ed1a9d9ec1fe883f6ae3089a504fa1a403c14cc977d014b90eee6904587df not found: ID does not exist" containerID="bb1ed1a9d9ec1fe883f6ae3089a504fa1a403c14cc977d014b90eee6904587df"
Sep 07 04:02:21.759850 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:21.759796    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb1ed1a9d9ec1fe883f6ae3089a504fa1a403c14cc977d014b90eee6904587df"} err="failed to get container status \"bb1ed1a9d9ec1fe883f6ae3089a504fa1a403c14cc977d014b90eee6904587df\": rpc error: code = NotFound desc = could not find container \"bb1ed1a9d9ec1fe883f6ae3089a504fa1a403c14cc977d014b90eee6904587df\": container with ID starting with bb1ed1a9d9ec1fe883f6ae3089a504fa1a403c14cc977d014b90eee6904587df not found: ID does not exist"
Sep 07 04:02:21.759850 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:21.759811    2559 scope.go:117] "RemoveContainer" containerID="7f39265659c9da91149441d0b119b3c823928ca9b3d7feec1a7140f0ccb2380f"
Sep 07 04:02:21.769227 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:21.769208    2559 scope.go:117] "RemoveContainer" containerID="7f39265659c9da91149441d0b119b3c823928ca9b3d7feec1a7140f0ccb2380f"
Sep 07 04:02:21.769389 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:21.769361    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4d42cf5d-848865df4c-jqrfq"]
Sep 07 04:02:21.769523 ip-10-0-132-4 kubenswrapper[2559]: E0907 04:02:21.769505    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f39265659c9da91149441d0b119b3c823928ca9b3d7feec1a7140f0ccb2380f\": container with ID starting with 7f39265659c9da91149441d0b119b3c823928ca9b3d7feec1a7140f0ccb2380f not found: ID does not exist" containerID="7f39265659c9da91149441d0b119b3c823928ca9b3d7feec1a7140f0ccb2380f"
Sep 07 04:02:21.769573 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:21.769530    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f39265659c9da91149441d0b119b3c823928ca9b3d7feec1a7140f0ccb2380f"} err="failed to get container status \"7f39265659c9da91149441d0b119b3c823928ca9b3d7feec1a7140f0ccb2380f\": rpc error: code = NotFound desc = could not find container \"7f39265659c9da91149441d0b119b3c823928ca9b3d7feec1a7140f0ccb2380f\": container with ID starting with 7f39265659c9da91149441d0b119b3c823928ca9b3d7feec1a7140f0ccb2380f not found: ID does not exist"
Sep 07 04:02:21.774118 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:21.774094    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4d42cf5d-848865df4c-jqrfq"]
Sep 07 04:02:21.786558 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:21.786536    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4d42cf5d-d48b676b-2s9fk"]
Sep 07 04:02:21.790110 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:21.790091    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4d42cf5d-d48b676b-2s9fk"]
Sep 07 04:02:21.948522 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:21.948489    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb"]
Sep 07 04:02:21.948784 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:21.948757    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb" podUID="16cf3c25-3214-4f35-bec6-d7fdd67afb66" containerName="istio-proxy" containerID="cri-o://f04840b41a8df132bff8e4f4b71cecc722d77066c72df13d7c000c6662cc7cc0" gracePeriod=30
Sep 07 04:02:23.180170 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:23.180136    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae096b0b-8220-428f-abc0-a5333384c4bb" path="/var/lib/kubelet/pods/ae096b0b-8220-428f-abc0-a5333384c4bb/volumes"
Sep 07 04:02:23.180541 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:23.180494    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dca6c2ea-5585-4c76-a70c-af1ce98656c1" path="/var/lib/kubelet/pods/dca6c2ea-5585-4c76-a70c-af1ce98656c1/volumes"
Sep 07 04:02:27.220099 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.220073    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb"
Sep 07 04:02:27.326117 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.326075    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16cf3c25-3214-4f35-bec6-d7fdd67afb66-workload-certs\") pod \"16cf3c25-3214-4f35-bec6-d7fdd67afb66\" (UID: \"16cf3c25-3214-4f35-bec6-d7fdd67afb66\") "
Sep 07 04:02:27.326293 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.326140    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mwp2t\" (UniqueName: \"kubernetes.io/projected/16cf3c25-3214-4f35-bec6-d7fdd67afb66-kube-api-access-mwp2t\") pod \"16cf3c25-3214-4f35-bec6-d7fdd67afb66\" (UID: \"16cf3c25-3214-4f35-bec6-d7fdd67afb66\") "
Sep 07 04:02:27.326293 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.326171    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16cf3c25-3214-4f35-bec6-d7fdd67afb66-istio-envoy\") pod \"16cf3c25-3214-4f35-bec6-d7fdd67afb66\" (UID: \"16cf3c25-3214-4f35-bec6-d7fdd67afb66\") "
Sep 07 04:02:27.326293 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.326186    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16cf3c25-3214-4f35-bec6-d7fdd67afb66-credential-socket\") pod \"16cf3c25-3214-4f35-bec6-d7fdd67afb66\" (UID: \"16cf3c25-3214-4f35-bec6-d7fdd67afb66\") "
Sep 07 04:02:27.326293 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.326212    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16cf3c25-3214-4f35-bec6-d7fdd67afb66-workload-socket\") pod \"16cf3c25-3214-4f35-bec6-d7fdd67afb66\" (UID: \"16cf3c25-3214-4f35-bec6-d7fdd67afb66\") "
Sep 07 04:02:27.326533 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.326298    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16cf3c25-3214-4f35-bec6-d7fdd67afb66-istio-token\") pod \"16cf3c25-3214-4f35-bec6-d7fdd67afb66\" (UID: \"16cf3c25-3214-4f35-bec6-d7fdd67afb66\") "
Sep 07 04:02:27.326533 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.326326    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16cf3c25-3214-4f35-bec6-d7fdd67afb66-istio-data\") pod \"16cf3c25-3214-4f35-bec6-d7fdd67afb66\" (UID: \"16cf3c25-3214-4f35-bec6-d7fdd67afb66\") "
Sep 07 04:02:27.326533 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.326427    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16cf3c25-3214-4f35-bec6-d7fdd67afb66-istiod-ca-cert\") pod \"16cf3c25-3214-4f35-bec6-d7fdd67afb66\" (UID: \"16cf3c25-3214-4f35-bec6-d7fdd67afb66\") "
Sep 07 04:02:27.326533 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.326465    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16cf3c25-3214-4f35-bec6-d7fdd67afb66-istio-podinfo\") pod \"16cf3c25-3214-4f35-bec6-d7fdd67afb66\" (UID: \"16cf3c25-3214-4f35-bec6-d7fdd67afb66\") "
Sep 07 04:02:27.326533 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.326475    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16cf3c25-3214-4f35-bec6-d7fdd67afb66-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "16cf3c25-3214-4f35-bec6-d7fdd67afb66" (UID: "16cf3c25-3214-4f35-bec6-d7fdd67afb66"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:02:27.326836 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.326648    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16cf3c25-3214-4f35-bec6-d7fdd67afb66-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "16cf3c25-3214-4f35-bec6-d7fdd67afb66" (UID: "16cf3c25-3214-4f35-bec6-d7fdd67afb66"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:02:27.326896 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.326831    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16cf3c25-3214-4f35-bec6-d7fdd67afb66-istio-data" (OuterVolumeSpecName: "istio-data") pod "16cf3c25-3214-4f35-bec6-d7fdd67afb66" (UID: "16cf3c25-3214-4f35-bec6-d7fdd67afb66"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:02:27.326953 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.326925    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16cf3c25-3214-4f35-bec6-d7fdd67afb66-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "16cf3c25-3214-4f35-bec6-d7fdd67afb66" (UID: "16cf3c25-3214-4f35-bec6-d7fdd67afb66"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:02:27.327081 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.327032    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16cf3c25-3214-4f35-bec6-d7fdd67afb66-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "16cf3c25-3214-4f35-bec6-d7fdd67afb66" (UID: "16cf3c25-3214-4f35-bec6-d7fdd67afb66"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 04:02:27.327452 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.327359    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16cf3c25-3214-4f35-bec6-d7fdd67afb66-credential-socket\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:02:27.327452 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.327384    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16cf3c25-3214-4f35-bec6-d7fdd67afb66-workload-socket\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:02:27.327452 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.327401    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16cf3c25-3214-4f35-bec6-d7fdd67afb66-istio-data\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:02:27.327452 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.327414    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16cf3c25-3214-4f35-bec6-d7fdd67afb66-istiod-ca-cert\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:02:27.327452 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.327427    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16cf3c25-3214-4f35-bec6-d7fdd67afb66-workload-certs\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:02:27.328778 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.328753    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16cf3c25-3214-4f35-bec6-d7fdd67afb66-istio-token" (OuterVolumeSpecName: "istio-token") pod "16cf3c25-3214-4f35-bec6-d7fdd67afb66" (UID: "16cf3c25-3214-4f35-bec6-d7fdd67afb66"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 04:02:27.328989 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.328967    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16cf3c25-3214-4f35-bec6-d7fdd67afb66-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "16cf3c25-3214-4f35-bec6-d7fdd67afb66" (UID: "16cf3c25-3214-4f35-bec6-d7fdd67afb66"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:02:27.329044 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.328971    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16cf3c25-3214-4f35-bec6-d7fdd67afb66-kube-api-access-mwp2t" (OuterVolumeSpecName: "kube-api-access-mwp2t") pod "16cf3c25-3214-4f35-bec6-d7fdd67afb66" (UID: "16cf3c25-3214-4f35-bec6-d7fdd67afb66"). InnerVolumeSpecName "kube-api-access-mwp2t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 04:02:27.329044 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.329005    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/16cf3c25-3214-4f35-bec6-d7fdd67afb66-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "16cf3c25-3214-4f35-bec6-d7fdd67afb66" (UID: "16cf3c25-3214-4f35-bec6-d7fdd67afb66"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 04:02:27.428911 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.428881    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16cf3c25-3214-4f35-bec6-d7fdd67afb66-istio-podinfo\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:02:27.428911 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.428904    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwp2t\" (UniqueName: \"kubernetes.io/projected/16cf3c25-3214-4f35-bec6-d7fdd67afb66-kube-api-access-mwp2t\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:02:27.428911 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.428914    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16cf3c25-3214-4f35-bec6-d7fdd67afb66-istio-envoy\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:02:27.429106 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.428923    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16cf3c25-3214-4f35-bec6-d7fdd67afb66-istio-token\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:02:27.647163 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.647131    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-320efe75-d676fdc6b-7mcvl"]
Sep 07 04:02:27.647557 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.647542    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dca6c2ea-5585-4c76-a70c-af1ce98656c1" containerName="payload-pre-processing"
Sep 07 04:02:27.647638 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.647558    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="dca6c2ea-5585-4c76-a70c-af1ce98656c1" containerName="payload-pre-processing"
Sep 07 04:02:27.647638 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.647587    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74b0d778-7168-47ca-bfe5-054b38534ba3" containerName="revoke-keys"
Sep 07 04:02:27.647638 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.647596    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="74b0d778-7168-47ca-bfe5-054b38534ba3" containerName="revoke-keys"
Sep 07 04:02:27.647638 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.647612    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae096b0b-8220-428f-abc0-a5333384c4bb" containerName="payload-processing"
Sep 07 04:02:27.647638 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.647634    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae096b0b-8220-428f-abc0-a5333384c4bb" containerName="payload-processing"
Sep 07 04:02:27.647931 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.647649    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16cf3c25-3214-4f35-bec6-d7fdd67afb66" containerName="istio-proxy"
Sep 07 04:02:27.647931 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.647656    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="16cf3c25-3214-4f35-bec6-d7fdd67afb66" containerName="istio-proxy"
Sep 07 04:02:27.647931 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.647780    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="16cf3c25-3214-4f35-bec6-d7fdd67afb66" containerName="istio-proxy"
Sep 07 04:02:27.647931 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.647793    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="dca6c2ea-5585-4c76-a70c-af1ce98656c1" containerName="payload-pre-processing"
Sep 07 04:02:27.647931 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.647801    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="74b0d778-7168-47ca-bfe5-054b38534ba3" containerName="revoke-keys"
Sep 07 04:02:27.647931 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.647812    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae096b0b-8220-428f-abc0-a5333384c4bb" containerName="payload-processing"
Sep 07 04:02:27.651323 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.651306    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-320efe75-d676fdc6b-7mcvl"
Sep 07 04:02:27.653293 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.653272    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-320efe75\""
Sep 07 04:02:27.653390 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.653375    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-320efe75-dockercfg-mmhtd\""
Sep 07 04:02:27.661934 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.661908    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-320efe75-d676fdc6b-7mcvl"]
Sep 07 04:02:27.694811 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.694785    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-320efe75-589579586f-v5dnz"]
Sep 07 04:02:27.695155 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.695144    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16cf3c25-3214-4f35-bec6-d7fdd67afb66" containerName="istio-proxy"
Sep 07 04:02:27.695199 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.695157    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="16cf3c25-3214-4f35-bec6-d7fdd67afb66" containerName="istio-proxy"
Sep 07 04:02:27.695250 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.695240    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="16cf3c25-3214-4f35-bec6-d7fdd67afb66" containerName="istio-proxy"
Sep 07 04:02:27.698192 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.698176    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-320efe75-589579586f-v5dnz"
Sep 07 04:02:27.708413 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.708387    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-320efe75-589579586f-v5dnz"]
Sep 07 04:02:27.712106 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.712087    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a84f90-6bbdc768f8-4524f"
Sep 07 04:02:27.730990 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.730948    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6739af47-cd04-4932-bf73-298c4a769f6c-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-320efe75-d676fdc6b-7mcvl\" (UID: \"6739af47-cd04-4932-bf73-298c4a769f6c\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-320efe75-d676fdc6b-7mcvl"
Sep 07 04:02:27.731131 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.731064    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqqpb\" (UniqueName: \"kubernetes.io/projected/6739af47-cd04-4932-bf73-298c4a769f6c-kube-api-access-xqqpb\") pod \"payload-pre-processing-e2e-derive-320efe75-d676fdc6b-7mcvl\" (UID: \"6739af47-cd04-4932-bf73-298c4a769f6c\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-320efe75-d676fdc6b-7mcvl"
Sep 07 04:02:27.793189 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.793155    2559 generic.go:356] "Generic (PLEG): container finished" podID="16cf3c25-3214-4f35-bec6-d7fdd67afb66" containerID="f04840b41a8df132bff8e4f4b71cecc722d77066c72df13d7c000c6662cc7cc0" exitCode=0
Sep 07 04:02:27.793394 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.793223    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb" event={"ID":"16cf3c25-3214-4f35-bec6-d7fdd67afb66","Type":"ContainerDied","Data":"f04840b41a8df132bff8e4f4b71cecc722d77066c72df13d7c000c6662cc7cc0"}
Sep 07 04:02:27.793394 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.793232    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb"
Sep 07 04:02:27.793394 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.793289    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb" event={"ID":"16cf3c25-3214-4f35-bec6-d7fdd67afb66","Type":"ContainerDied","Data":"0be7360964a60870c7939e979dcd4a87969879c417b838a728a60016cc01a1ce"}
Sep 07 04:02:27.793394 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.793324    2559 scope.go:117] "RemoveContainer" containerID="f04840b41a8df132bff8e4f4b71cecc722d77066c72df13d7c000c6662cc7cc0"
Sep 07 04:02:27.803206 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.803187    2559 scope.go:117] "RemoveContainer" containerID="08afc204d30497ae0e7483291510dc72babfc5fe7943a5193571699ce8129e11"
Sep 07 04:02:27.812032 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.812013    2559 scope.go:117] "RemoveContainer" containerID="f04840b41a8df132bff8e4f4b71cecc722d77066c72df13d7c000c6662cc7cc0"
Sep 07 04:02:27.812299 ip-10-0-132-4 kubenswrapper[2559]: E0907 04:02:27.812279    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f04840b41a8df132bff8e4f4b71cecc722d77066c72df13d7c000c6662cc7cc0\": container with ID starting with f04840b41a8df132bff8e4f4b71cecc722d77066c72df13d7c000c6662cc7cc0 not found: ID does not exist" containerID="f04840b41a8df132bff8e4f4b71cecc722d77066c72df13d7c000c6662cc7cc0"
Sep 07 04:02:27.812367 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.812305    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f04840b41a8df132bff8e4f4b71cecc722d77066c72df13d7c000c6662cc7cc0"} err="failed to get container status \"f04840b41a8df132bff8e4f4b71cecc722d77066c72df13d7c000c6662cc7cc0\": rpc error: code = NotFound desc = could not find container \"f04840b41a8df132bff8e4f4b71cecc722d77066c72df13d7c000c6662cc7cc0\": container with ID starting with f04840b41a8df132bff8e4f4b71cecc722d77066c72df13d7c000c6662cc7cc0 not found: ID does not exist"
Sep 07 04:02:27.812367 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.812322    2559 scope.go:117] "RemoveContainer" containerID="08afc204d30497ae0e7483291510dc72babfc5fe7943a5193571699ce8129e11"
Sep 07 04:02:27.812561 ip-10-0-132-4 kubenswrapper[2559]: E0907 04:02:27.812547    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08afc204d30497ae0e7483291510dc72babfc5fe7943a5193571699ce8129e11\": container with ID starting with 08afc204d30497ae0e7483291510dc72babfc5fe7943a5193571699ce8129e11 not found: ID does not exist" containerID="08afc204d30497ae0e7483291510dc72babfc5fe7943a5193571699ce8129e11"
Sep 07 04:02:27.812604 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.812567    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08afc204d30497ae0e7483291510dc72babfc5fe7943a5193571699ce8129e11"} err="failed to get container status \"08afc204d30497ae0e7483291510dc72babfc5fe7943a5193571699ce8129e11\": rpc error: code = NotFound desc = could not find container \"08afc204d30497ae0e7483291510dc72babfc5fe7943a5193571699ce8129e11\": container with ID starting with 08afc204d30497ae0e7483291510dc72babfc5fe7943a5193571699ce8129e11 not found: ID does not exist"
Sep 07 04:02:27.817160 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.817137    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb"]
Sep 07 04:02:27.820732 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.820709    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb"]
Sep 07 04:02:27.832444 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.832422    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqqpb\" (UniqueName: \"kubernetes.io/projected/6739af47-cd04-4932-bf73-298c4a769f6c-kube-api-access-xqqpb\") pod \"payload-pre-processing-e2e-derive-320efe75-d676fdc6b-7mcvl\" (UID: \"6739af47-cd04-4932-bf73-298c4a769f6c\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-320efe75-d676fdc6b-7mcvl"
Sep 07 04:02:27.832528 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.832462    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7ecc7472-ab1f-4feb-97a5-76406b5fe544-plugins-config-volume\") pod \"payload-processing-e2e-derive-320efe75-589579586f-v5dnz\" (UID: \"7ecc7472-ab1f-4feb-97a5-76406b5fe544\") " pod="openshift-ingress/payload-processing-e2e-derive-320efe75-589579586f-v5dnz"
Sep 07 04:02:27.832528 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.832495    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rhpf\" (UniqueName: \"kubernetes.io/projected/7ecc7472-ab1f-4feb-97a5-76406b5fe544-kube-api-access-5rhpf\") pod \"payload-processing-e2e-derive-320efe75-589579586f-v5dnz\" (UID: \"7ecc7472-ab1f-4feb-97a5-76406b5fe544\") " pod="openshift-ingress/payload-processing-e2e-derive-320efe75-589579586f-v5dnz"
Sep 07 04:02:27.832614 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.832561    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6739af47-cd04-4932-bf73-298c4a769f6c-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-320efe75-d676fdc6b-7mcvl\" (UID: \"6739af47-cd04-4932-bf73-298c4a769f6c\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-320efe75-d676fdc6b-7mcvl"
Sep 07 04:02:27.833242 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.833222    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6739af47-cd04-4932-bf73-298c4a769f6c-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-320efe75-d676fdc6b-7mcvl\" (UID: \"6739af47-cd04-4932-bf73-298c4a769f6c\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-320efe75-d676fdc6b-7mcvl"
Sep 07 04:02:27.849534 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.849506    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqqpb\" (UniqueName: \"kubernetes.io/projected/6739af47-cd04-4932-bf73-298c4a769f6c-kube-api-access-xqqpb\") pod \"payload-pre-processing-e2e-derive-320efe75-d676fdc6b-7mcvl\" (UID: \"6739af47-cd04-4932-bf73-298c4a769f6c\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-320efe75-d676fdc6b-7mcvl"
Sep 07 04:02:27.934176 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.934083    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7ecc7472-ab1f-4feb-97a5-76406b5fe544-plugins-config-volume\") pod \"payload-processing-e2e-derive-320efe75-589579586f-v5dnz\" (UID: \"7ecc7472-ab1f-4feb-97a5-76406b5fe544\") " pod="openshift-ingress/payload-processing-e2e-derive-320efe75-589579586f-v5dnz"
Sep 07 04:02:27.934176 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.934136    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rhpf\" (UniqueName: \"kubernetes.io/projected/7ecc7472-ab1f-4feb-97a5-76406b5fe544-kube-api-access-5rhpf\") pod \"payload-processing-e2e-derive-320efe75-589579586f-v5dnz\" (UID: \"7ecc7472-ab1f-4feb-97a5-76406b5fe544\") " pod="openshift-ingress/payload-processing-e2e-derive-320efe75-589579586f-v5dnz"
Sep 07 04:02:27.934819 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.934799    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7ecc7472-ab1f-4feb-97a5-76406b5fe544-plugins-config-volume\") pod \"payload-processing-e2e-derive-320efe75-589579586f-v5dnz\" (UID: \"7ecc7472-ab1f-4feb-97a5-76406b5fe544\") " pod="openshift-ingress/payload-processing-e2e-derive-320efe75-589579586f-v5dnz"
Sep 07 04:02:27.941169 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.941147    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rhpf\" (UniqueName: \"kubernetes.io/projected/7ecc7472-ab1f-4feb-97a5-76406b5fe544-kube-api-access-5rhpf\") pod \"payload-processing-e2e-derive-320efe75-589579586f-v5dnz\" (UID: \"7ecc7472-ab1f-4feb-97a5-76406b5fe544\") " pod="openshift-ingress/payload-processing-e2e-derive-320efe75-589579586f-v5dnz"
Sep 07 04:02:27.962317 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:27.962291    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-320efe75-d676fdc6b-7mcvl"
Sep 07 04:02:28.009598 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:28.009564    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-320efe75-589579586f-v5dnz"
Sep 07 04:02:28.232964 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:28.232939    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-320efe75-d676fdc6b-7mcvl"]
Sep 07 04:02:28.234468 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:02:28.234443    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6739af47_cd04_4932_bf73_298c4a769f6c.slice/crio-50a3cdc1243b99175494a1fd1cf08a6d5cc4b1a5413bb84159c7770b3030fe80 WatchSource:0}: Error finding container 50a3cdc1243b99175494a1fd1cf08a6d5cc4b1a5413bb84159c7770b3030fe80: Status 404 returned error can't find the container with id 50a3cdc1243b99175494a1fd1cf08a6d5cc4b1a5413bb84159c7770b3030fe80
Sep 07 04:02:28.288205 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:28.288182    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-320efe75-589579586f-v5dnz"]
Sep 07 04:02:28.289563 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:02:28.289526    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ecc7472_ab1f_4feb_97a5_76406b5fe544.slice/crio-e66259851bfc3719f70b43b05770e00ffa982239893d5a3676bbd74edd0da71c WatchSource:0}: Error finding container e66259851bfc3719f70b43b05770e00ffa982239893d5a3676bbd74edd0da71c: Status 404 returned error can't find the container with id e66259851bfc3719f70b43b05770e00ffa982239893d5a3676bbd74edd0da71c
Sep 07 04:02:28.801927 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:28.801884    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-320efe75-d676fdc6b-7mcvl" event={"ID":"6739af47-cd04-4932-bf73-298c4a769f6c","Type":"ContainerStarted","Data":"546c20102119ba544b4902a3b2f150120b009b74baa5db56f3a8e20a1751ab34"}
Sep 07 04:02:28.802135 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:28.801938    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-320efe75-d676fdc6b-7mcvl" event={"ID":"6739af47-cd04-4932-bf73-298c4a769f6c","Type":"ContainerStarted","Data":"50a3cdc1243b99175494a1fd1cf08a6d5cc4b1a5413bb84159c7770b3030fe80"}
Sep 07 04:02:28.802135 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:28.802079    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-320efe75-d676fdc6b-7mcvl"
Sep 07 04:02:28.803615 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:28.803590    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-320efe75-589579586f-v5dnz" event={"ID":"7ecc7472-ab1f-4feb-97a5-76406b5fe544","Type":"ContainerStarted","Data":"3ac340a4af6b042d8b34368a50ce818a1ce4d5b28a5634ea30f3cc451dec6db9"}
Sep 07 04:02:28.803760 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:28.803659    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-320efe75-589579586f-v5dnz" event={"ID":"7ecc7472-ab1f-4feb-97a5-76406b5fe544","Type":"ContainerStarted","Data":"e66259851bfc3719f70b43b05770e00ffa982239893d5a3676bbd74edd0da71c"}
Sep 07 04:02:28.803760 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:28.803688    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-320efe75-589579586f-v5dnz"
Sep 07 04:02:28.819353 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:28.819308    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-320efe75-d676fdc6b-7mcvl" podStartSLOduration=1.819288715 podStartE2EDuration="1.819288715s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:02:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:02:28.816909478 +0000 UTC m=+852.129385380" watchObservedRunningTime="2026-09-07 04:02:28.819288715 +0000 UTC m=+852.131764619"
Sep 07 04:02:28.833419 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:28.833372    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-320efe75-589579586f-v5dnz" podStartSLOduration=1.833349572 podStartE2EDuration="1.833349572s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:02:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:02:28.830174197 +0000 UTC m=+852.142650101" watchObservedRunningTime="2026-09-07 04:02:28.833349572 +0000 UTC m=+852.145825473"
Sep 07 04:02:29.182541 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:29.182502    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16cf3c25-3214-4f35-bec6-d7fdd67afb66" path="/var/lib/kubelet/pods/16cf3c25-3214-4f35-bec6-d7fdd67afb66/volumes"
Sep 07 04:02:39.812833 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:39.812795    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-320efe75-d676fdc6b-7mcvl"
Sep 07 04:02:39.813219 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:39.813097    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-320efe75-589579586f-v5dnz"
Sep 07 04:02:46.472564 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:46.472531    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-explicit-a84f90/explicit-model-a84f90-kserve-696866dbbf-bp55c"]
Sep 07 04:02:46.476121 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:46.476098    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-a84f90/explicit-model-a84f90-kserve-696866dbbf-bp55c"
Sep 07 04:02:46.478790 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:46.478760    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-a84f90\"/\"kube-root-ca.crt\""
Sep 07 04:02:46.478927 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:46.478803    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-a84f90\"/\"openshift-service-ca.crt\""
Sep 07 04:02:46.478927 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:46.478807    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-a84f90\"/\"explicit-model-a84f90-kserve-self-signed-certs\""
Sep 07 04:02:46.478927 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:46.478879    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-a84f90\"/\"default-dockercfg-fb57z\""
Sep 07 04:02:46.488191 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:46.488164    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-a84f90/explicit-model-a84f90-kserve-696866dbbf-bp55c"]
Sep 07 04:02:46.502501 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:46.502475    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/844afb23-e3a5-4134-861d-c9e361e7e4b9-model-cache\") pod \"explicit-model-a84f90-kserve-696866dbbf-bp55c\" (UID: \"844afb23-e3a5-4134-861d-c9e361e7e4b9\") " pod="ai-tenant-e2e-explicit-a84f90/explicit-model-a84f90-kserve-696866dbbf-bp55c"
Sep 07 04:02:46.502663 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:46.502510    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccglq\" (UniqueName: \"kubernetes.io/projected/844afb23-e3a5-4134-861d-c9e361e7e4b9-kube-api-access-ccglq\") pod \"explicit-model-a84f90-kserve-696866dbbf-bp55c\" (UID: \"844afb23-e3a5-4134-861d-c9e361e7e4b9\") " pod="ai-tenant-e2e-explicit-a84f90/explicit-model-a84f90-kserve-696866dbbf-bp55c"
Sep 07 04:02:46.502663 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:46.502538    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/844afb23-e3a5-4134-861d-c9e361e7e4b9-tmp-dir\") pod \"explicit-model-a84f90-kserve-696866dbbf-bp55c\" (UID: \"844afb23-e3a5-4134-861d-c9e361e7e4b9\") " pod="ai-tenant-e2e-explicit-a84f90/explicit-model-a84f90-kserve-696866dbbf-bp55c"
Sep 07 04:02:46.502663 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:46.502597    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/844afb23-e3a5-4134-861d-c9e361e7e4b9-home\") pod \"explicit-model-a84f90-kserve-696866dbbf-bp55c\" (UID: \"844afb23-e3a5-4134-861d-c9e361e7e4b9\") " pod="ai-tenant-e2e-explicit-a84f90/explicit-model-a84f90-kserve-696866dbbf-bp55c"
Sep 07 04:02:46.502663 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:46.502647    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/844afb23-e3a5-4134-861d-c9e361e7e4b9-dshm\") pod \"explicit-model-a84f90-kserve-696866dbbf-bp55c\" (UID: \"844afb23-e3a5-4134-861d-c9e361e7e4b9\") " pod="ai-tenant-e2e-explicit-a84f90/explicit-model-a84f90-kserve-696866dbbf-bp55c"
Sep 07 04:02:46.502899 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:46.502761    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/844afb23-e3a5-4134-861d-c9e361e7e4b9-tls-certs\") pod \"explicit-model-a84f90-kserve-696866dbbf-bp55c\" (UID: \"844afb23-e3a5-4134-861d-c9e361e7e4b9\") " pod="ai-tenant-e2e-explicit-a84f90/explicit-model-a84f90-kserve-696866dbbf-bp55c"
Sep 07 04:02:46.603494 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:46.603461    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/844afb23-e3a5-4134-861d-c9e361e7e4b9-model-cache\") pod \"explicit-model-a84f90-kserve-696866dbbf-bp55c\" (UID: \"844afb23-e3a5-4134-861d-c9e361e7e4b9\") " pod="ai-tenant-e2e-explicit-a84f90/explicit-model-a84f90-kserve-696866dbbf-bp55c"
Sep 07 04:02:46.603694 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:46.603505    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccglq\" (UniqueName: \"kubernetes.io/projected/844afb23-e3a5-4134-861d-c9e361e7e4b9-kube-api-access-ccglq\") pod \"explicit-model-a84f90-kserve-696866dbbf-bp55c\" (UID: \"844afb23-e3a5-4134-861d-c9e361e7e4b9\") " pod="ai-tenant-e2e-explicit-a84f90/explicit-model-a84f90-kserve-696866dbbf-bp55c"
Sep 07 04:02:46.603694 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:46.603533    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/844afb23-e3a5-4134-861d-c9e361e7e4b9-tmp-dir\") pod \"explicit-model-a84f90-kserve-696866dbbf-bp55c\" (UID: \"844afb23-e3a5-4134-861d-c9e361e7e4b9\") " pod="ai-tenant-e2e-explicit-a84f90/explicit-model-a84f90-kserve-696866dbbf-bp55c"
Sep 07 04:02:46.603694 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:46.603568    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/844afb23-e3a5-4134-861d-c9e361e7e4b9-home\") pod \"explicit-model-a84f90-kserve-696866dbbf-bp55c\" (UID: \"844afb23-e3a5-4134-861d-c9e361e7e4b9\") " pod="ai-tenant-e2e-explicit-a84f90/explicit-model-a84f90-kserve-696866dbbf-bp55c"
Sep 07 04:02:46.603694 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:46.603601    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/844afb23-e3a5-4134-861d-c9e361e7e4b9-dshm\") pod \"explicit-model-a84f90-kserve-696866dbbf-bp55c\" (UID: \"844afb23-e3a5-4134-861d-c9e361e7e4b9\") " pod="ai-tenant-e2e-explicit-a84f90/explicit-model-a84f90-kserve-696866dbbf-bp55c"
Sep 07 04:02:46.603911 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:46.603703    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/844afb23-e3a5-4134-861d-c9e361e7e4b9-tls-certs\") pod \"explicit-model-a84f90-kserve-696866dbbf-bp55c\" (UID: \"844afb23-e3a5-4134-861d-c9e361e7e4b9\") " pod="ai-tenant-e2e-explicit-a84f90/explicit-model-a84f90-kserve-696866dbbf-bp55c"
Sep 07 04:02:46.603911 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:46.603883    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/844afb23-e3a5-4134-861d-c9e361e7e4b9-model-cache\") pod \"explicit-model-a84f90-kserve-696866dbbf-bp55c\" (UID: \"844afb23-e3a5-4134-861d-c9e361e7e4b9\") " pod="ai-tenant-e2e-explicit-a84f90/explicit-model-a84f90-kserve-696866dbbf-bp55c"
Sep 07 04:02:46.604025 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:46.603948    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/844afb23-e3a5-4134-861d-c9e361e7e4b9-tmp-dir\") pod \"explicit-model-a84f90-kserve-696866dbbf-bp55c\" (UID: \"844afb23-e3a5-4134-861d-c9e361e7e4b9\") " pod="ai-tenant-e2e-explicit-a84f90/explicit-model-a84f90-kserve-696866dbbf-bp55c"
Sep 07 04:02:46.604080 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:46.604056    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/844afb23-e3a5-4134-861d-c9e361e7e4b9-home\") pod \"explicit-model-a84f90-kserve-696866dbbf-bp55c\" (UID: \"844afb23-e3a5-4134-861d-c9e361e7e4b9\") " pod="ai-tenant-e2e-explicit-a84f90/explicit-model-a84f90-kserve-696866dbbf-bp55c"
Sep 07 04:02:46.605884 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:46.605866    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/844afb23-e3a5-4134-861d-c9e361e7e4b9-dshm\") pod \"explicit-model-a84f90-kserve-696866dbbf-bp55c\" (UID: \"844afb23-e3a5-4134-861d-c9e361e7e4b9\") " pod="ai-tenant-e2e-explicit-a84f90/explicit-model-a84f90-kserve-696866dbbf-bp55c"
Sep 07 04:02:46.606133 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:46.606116    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/844afb23-e3a5-4134-861d-c9e361e7e4b9-tls-certs\") pod \"explicit-model-a84f90-kserve-696866dbbf-bp55c\" (UID: \"844afb23-e3a5-4134-861d-c9e361e7e4b9\") " pod="ai-tenant-e2e-explicit-a84f90/explicit-model-a84f90-kserve-696866dbbf-bp55c"
Sep 07 04:02:46.610071 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:46.610051    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccglq\" (UniqueName: \"kubernetes.io/projected/844afb23-e3a5-4134-861d-c9e361e7e4b9-kube-api-access-ccglq\") pod \"explicit-model-a84f90-kserve-696866dbbf-bp55c\" (UID: \"844afb23-e3a5-4134-861d-c9e361e7e4b9\") " pod="ai-tenant-e2e-explicit-a84f90/explicit-model-a84f90-kserve-696866dbbf-bp55c"
Sep 07 04:02:46.786227 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:46.786128    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-a84f90/explicit-model-a84f90-kserve-696866dbbf-bp55c"
Sep 07 04:02:47.060226 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:47.060194    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-a84f90/explicit-model-a84f90-kserve-696866dbbf-bp55c"]
Sep 07 04:02:47.061760 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:02:47.061734    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod844afb23_e3a5_4134_861d_c9e361e7e4b9.slice/crio-e1588e7f8c62965262c84a77d33edb17ae55cff07f856f46efbca44e0b7f5bd1 WatchSource:0}: Error finding container e1588e7f8c62965262c84a77d33edb17ae55cff07f856f46efbca44e0b7f5bd1: Status 404 returned error can't find the container with id e1588e7f8c62965262c84a77d33edb17ae55cff07f856f46efbca44e0b7f5bd1
Sep 07 04:02:47.919135 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:47.919096    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-a84f90/explicit-model-a84f90-kserve-696866dbbf-bp55c" event={"ID":"844afb23-e3a5-4134-861d-c9e361e7e4b9","Type":"ContainerStarted","Data":"f199c248094e771458c725e01d39ca0670cb305c2a0c18329f7d43b02886bd1c"}
Sep 07 04:02:47.919512 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:47.919146    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-a84f90/explicit-model-a84f90-kserve-696866dbbf-bp55c" event={"ID":"844afb23-e3a5-4134-861d-c9e361e7e4b9","Type":"ContainerStarted","Data":"e1588e7f8c62965262c84a77d33edb17ae55cff07f856f46efbca44e0b7f5bd1"}
Sep 07 04:02:47.935083 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:47.935034    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-explicit-a84f90/explicit-model-a84f90-kserve-696866dbbf-bp55c" podStartSLOduration=1.93501909 podStartE2EDuration="1.93501909s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:02:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:02:47.933461947 +0000 UTC m=+871.245937862" watchObservedRunningTime="2026-09-07 04:02:47.93501909 +0000 UTC m=+871.247494992"
Sep 07 04:02:50.516687 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:50.516652    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-320efe75-gj4rd"]
Sep 07 04:02:50.520396 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:50.520373    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-320efe75-gj4rd"
Sep 07 04:02:50.522354 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:50.522332    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 07 04:02:50.522465 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:50.522447    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zs4ff\""
Sep 07 04:02:50.527376 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:50.527352    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-320efe75-gj4rd"]
Sep 07 04:02:50.541793 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:50.541759    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/94c7f419-2a04-4ccb-bc52-aa30008bcc7f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-320efe75-gj4rd\" (UID: \"94c7f419-2a04-4ccb-bc52-aa30008bcc7f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-320efe75-gj4rd"
Sep 07 04:02:50.642994 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:50.642961    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/94c7f419-2a04-4ccb-bc52-aa30008bcc7f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-320efe75-gj4rd\" (UID: \"94c7f419-2a04-4ccb-bc52-aa30008bcc7f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-320efe75-gj4rd"
Sep 07 04:02:50.643585 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:50.643565    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/94c7f419-2a04-4ccb-bc52-aa30008bcc7f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-320efe75-gj4rd\" (UID: \"94c7f419-2a04-4ccb-bc52-aa30008bcc7f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-320efe75-gj4rd"
Sep 07 04:02:50.832692 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:50.832584    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-320efe75-gj4rd"
Sep 07 04:02:51.102072 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:51.102041    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-320efe75-gj4rd"]
Sep 07 04:02:51.103302 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:02:51.103273    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94c7f419_2a04_4ccb_bc52_aa30008bcc7f.slice/crio-6a835f5192d7f4c5d123f6008788942711545baacb866bcb26fbce6836dba130 WatchSource:0}: Error finding container 6a835f5192d7f4c5d123f6008788942711545baacb866bcb26fbce6836dba130: Status 404 returned error can't find the container with id 6a835f5192d7f4c5d123f6008788942711545baacb866bcb26fbce6836dba130
Sep 07 04:02:51.944468 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:51.944436    2559 generic.go:356] "Generic (PLEG): container finished" podID="94c7f419-2a04-4ccb-bc52-aa30008bcc7f" containerID="29f6ad48aef46cca0ff5b6614456ccbda804c3e98a25d5e7134cc078c0920dab" exitCode=0
Sep 07 04:02:51.944863 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:51.944517    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-320efe75-gj4rd" event={"ID":"94c7f419-2a04-4ccb-bc52-aa30008bcc7f","Type":"ContainerDied","Data":"29f6ad48aef46cca0ff5b6614456ccbda804c3e98a25d5e7134cc078c0920dab"}
Sep 07 04:02:51.944863 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:51.944575    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-320efe75-gj4rd" event={"ID":"94c7f419-2a04-4ccb-bc52-aa30008bcc7f","Type":"ContainerStarted","Data":"6a835f5192d7f4c5d123f6008788942711545baacb866bcb26fbce6836dba130"}
Sep 07 04:02:52.276410 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:52.276374    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-a8da4e/test-model-a8da4e-kserve-6bc5f99d7f-mz4tt"]
Sep 07 04:02:52.279941 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:52.279920    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-a8da4e/test-model-a8da4e-kserve-6bc5f99d7f-mz4tt"
Sep 07 04:02:52.281917 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:52.281895    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-a8da4e\"/\"kube-root-ca.crt\""
Sep 07 04:02:52.282487 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:52.282471    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-a8da4e\"/\"openshift-service-ca.crt\""
Sep 07 04:02:52.282487 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:52.282478    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-a8da4e\"/\"default-dockercfg-k829d\""
Sep 07 04:02:52.282615 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:52.282508    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-a8da4e\"/\"test-model-a8da4e-kserve-self-signed-certs\""
Sep 07 04:02:52.287421 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:52.287323    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-a8da4e/test-model-a8da4e-kserve-6bc5f99d7f-mz4tt"]
Sep 07 04:02:52.359445 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:52.359411    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2a83361-e10b-4f6c-979b-4d0db87d43ba-dshm\") pod \"test-model-a8da4e-kserve-6bc5f99d7f-mz4tt\" (UID: \"d2a83361-e10b-4f6c-979b-4d0db87d43ba\") " pod="ai-tenant-e2e-inf-b-a8da4e/test-model-a8da4e-kserve-6bc5f99d7f-mz4tt"
Sep 07 04:02:52.359445 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:52.359444    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2a83361-e10b-4f6c-979b-4d0db87d43ba-tmp-dir\") pod \"test-model-a8da4e-kserve-6bc5f99d7f-mz4tt\" (UID: \"d2a83361-e10b-4f6c-979b-4d0db87d43ba\") " pod="ai-tenant-e2e-inf-b-a8da4e/test-model-a8da4e-kserve-6bc5f99d7f-mz4tt"
Sep 07 04:02:52.359686 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:52.359479    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2a83361-e10b-4f6c-979b-4d0db87d43ba-home\") pod \"test-model-a8da4e-kserve-6bc5f99d7f-mz4tt\" (UID: \"d2a83361-e10b-4f6c-979b-4d0db87d43ba\") " pod="ai-tenant-e2e-inf-b-a8da4e/test-model-a8da4e-kserve-6bc5f99d7f-mz4tt"
Sep 07 04:02:52.359686 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:52.359559    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2a83361-e10b-4f6c-979b-4d0db87d43ba-model-cache\") pod \"test-model-a8da4e-kserve-6bc5f99d7f-mz4tt\" (UID: \"d2a83361-e10b-4f6c-979b-4d0db87d43ba\") " pod="ai-tenant-e2e-inf-b-a8da4e/test-model-a8da4e-kserve-6bc5f99d7f-mz4tt"
Sep 07 04:02:52.359686 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:52.359586    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2a83361-e10b-4f6c-979b-4d0db87d43ba-tls-certs\") pod \"test-model-a8da4e-kserve-6bc5f99d7f-mz4tt\" (UID: \"d2a83361-e10b-4f6c-979b-4d0db87d43ba\") " pod="ai-tenant-e2e-inf-b-a8da4e/test-model-a8da4e-kserve-6bc5f99d7f-mz4tt"
Sep 07 04:02:52.359686 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:52.359616    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x22cn\" (UniqueName: \"kubernetes.io/projected/d2a83361-e10b-4f6c-979b-4d0db87d43ba-kube-api-access-x22cn\") pod \"test-model-a8da4e-kserve-6bc5f99d7f-mz4tt\" (UID: \"d2a83361-e10b-4f6c-979b-4d0db87d43ba\") " pod="ai-tenant-e2e-inf-b-a8da4e/test-model-a8da4e-kserve-6bc5f99d7f-mz4tt"
Sep 07 04:02:52.460598 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:52.460560    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x22cn\" (UniqueName: \"kubernetes.io/projected/d2a83361-e10b-4f6c-979b-4d0db87d43ba-kube-api-access-x22cn\") pod \"test-model-a8da4e-kserve-6bc5f99d7f-mz4tt\" (UID: \"d2a83361-e10b-4f6c-979b-4d0db87d43ba\") " pod="ai-tenant-e2e-inf-b-a8da4e/test-model-a8da4e-kserve-6bc5f99d7f-mz4tt"
Sep 07 04:02:52.460802 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:52.460669    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2a83361-e10b-4f6c-979b-4d0db87d43ba-dshm\") pod \"test-model-a8da4e-kserve-6bc5f99d7f-mz4tt\" (UID: \"d2a83361-e10b-4f6c-979b-4d0db87d43ba\") " pod="ai-tenant-e2e-inf-b-a8da4e/test-model-a8da4e-kserve-6bc5f99d7f-mz4tt"
Sep 07 04:02:52.460802 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:52.460689    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2a83361-e10b-4f6c-979b-4d0db87d43ba-tmp-dir\") pod \"test-model-a8da4e-kserve-6bc5f99d7f-mz4tt\" (UID: \"d2a83361-e10b-4f6c-979b-4d0db87d43ba\") " pod="ai-tenant-e2e-inf-b-a8da4e/test-model-a8da4e-kserve-6bc5f99d7f-mz4tt"
Sep 07 04:02:52.460802 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:52.460735    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2a83361-e10b-4f6c-979b-4d0db87d43ba-home\") pod \"test-model-a8da4e-kserve-6bc5f99d7f-mz4tt\" (UID: \"d2a83361-e10b-4f6c-979b-4d0db87d43ba\") " pod="ai-tenant-e2e-inf-b-a8da4e/test-model-a8da4e-kserve-6bc5f99d7f-mz4tt"
Sep 07 04:02:52.460802 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:52.460764    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2a83361-e10b-4f6c-979b-4d0db87d43ba-model-cache\") pod \"test-model-a8da4e-kserve-6bc5f99d7f-mz4tt\" (UID: \"d2a83361-e10b-4f6c-979b-4d0db87d43ba\") " pod="ai-tenant-e2e-inf-b-a8da4e/test-model-a8da4e-kserve-6bc5f99d7f-mz4tt"
Sep 07 04:02:52.460802 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:52.460779    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2a83361-e10b-4f6c-979b-4d0db87d43ba-tls-certs\") pod \"test-model-a8da4e-kserve-6bc5f99d7f-mz4tt\" (UID: \"d2a83361-e10b-4f6c-979b-4d0db87d43ba\") " pod="ai-tenant-e2e-inf-b-a8da4e/test-model-a8da4e-kserve-6bc5f99d7f-mz4tt"
Sep 07 04:02:52.461233 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:52.461178    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2a83361-e10b-4f6c-979b-4d0db87d43ba-tmp-dir\") pod \"test-model-a8da4e-kserve-6bc5f99d7f-mz4tt\" (UID: \"d2a83361-e10b-4f6c-979b-4d0db87d43ba\") " pod="ai-tenant-e2e-inf-b-a8da4e/test-model-a8da4e-kserve-6bc5f99d7f-mz4tt"
Sep 07 04:02:52.461387 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:52.461299    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2a83361-e10b-4f6c-979b-4d0db87d43ba-home\") pod \"test-model-a8da4e-kserve-6bc5f99d7f-mz4tt\" (UID: \"d2a83361-e10b-4f6c-979b-4d0db87d43ba\") " pod="ai-tenant-e2e-inf-b-a8da4e/test-model-a8da4e-kserve-6bc5f99d7f-mz4tt"
Sep 07 04:02:52.461387 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:52.461378    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2a83361-e10b-4f6c-979b-4d0db87d43ba-model-cache\") pod \"test-model-a8da4e-kserve-6bc5f99d7f-mz4tt\" (UID: \"d2a83361-e10b-4f6c-979b-4d0db87d43ba\") " pod="ai-tenant-e2e-inf-b-a8da4e/test-model-a8da4e-kserve-6bc5f99d7f-mz4tt"
Sep 07 04:02:52.463602 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:52.463578    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2a83361-e10b-4f6c-979b-4d0db87d43ba-dshm\") pod \"test-model-a8da4e-kserve-6bc5f99d7f-mz4tt\" (UID: \"d2a83361-e10b-4f6c-979b-4d0db87d43ba\") " pod="ai-tenant-e2e-inf-b-a8da4e/test-model-a8da4e-kserve-6bc5f99d7f-mz4tt"
Sep 07 04:02:52.463935 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:52.463917    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2a83361-e10b-4f6c-979b-4d0db87d43ba-tls-certs\") pod \"test-model-a8da4e-kserve-6bc5f99d7f-mz4tt\" (UID: \"d2a83361-e10b-4f6c-979b-4d0db87d43ba\") " pod="ai-tenant-e2e-inf-b-a8da4e/test-model-a8da4e-kserve-6bc5f99d7f-mz4tt"
Sep 07 04:02:52.468224 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:52.468180    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x22cn\" (UniqueName: \"kubernetes.io/projected/d2a83361-e10b-4f6c-979b-4d0db87d43ba-kube-api-access-x22cn\") pod \"test-model-a8da4e-kserve-6bc5f99d7f-mz4tt\" (UID: \"d2a83361-e10b-4f6c-979b-4d0db87d43ba\") " pod="ai-tenant-e2e-inf-b-a8da4e/test-model-a8da4e-kserve-6bc5f99d7f-mz4tt"
Sep 07 04:02:52.590189 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:52.590096    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-a8da4e/test-model-a8da4e-kserve-6bc5f99d7f-mz4tt"
Sep 07 04:02:52.864190 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:52.864162    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-a8da4e/test-model-a8da4e-kserve-6bc5f99d7f-mz4tt"]
Sep 07 04:02:52.864496 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:02:52.864475    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd2a83361_e10b_4f6c_979b_4d0db87d43ba.slice/crio-72ba4257b202e7def463bc7e1c2859016cc12d3230d09981b4092196bb3db310 WatchSource:0}: Error finding container 72ba4257b202e7def463bc7e1c2859016cc12d3230d09981b4092196bb3db310: Status 404 returned error can't find the container with id 72ba4257b202e7def463bc7e1c2859016cc12d3230d09981b4092196bb3db310
Sep 07 04:02:52.955520 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:52.955490    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-a8da4e/test-model-a8da4e-kserve-6bc5f99d7f-mz4tt" event={"ID":"d2a83361-e10b-4f6c-979b-4d0db87d43ba","Type":"ContainerStarted","Data":"f808bd4f22e07b9ad6c03b7aab7429f44a86376c5475d0291706129781751ef0"}
Sep 07 04:02:52.955956 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:52.955538    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-a8da4e/test-model-a8da4e-kserve-6bc5f99d7f-mz4tt" event={"ID":"d2a83361-e10b-4f6c-979b-4d0db87d43ba","Type":"ContainerStarted","Data":"72ba4257b202e7def463bc7e1c2859016cc12d3230d09981b4092196bb3db310"}
Sep 07 04:02:52.972482 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:52.972433    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-a8da4e/test-model-a8da4e-kserve-6bc5f99d7f-mz4tt" podStartSLOduration=0.972416742 podStartE2EDuration="972.416742ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:02:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:02:52.969283042 +0000 UTC m=+876.281758934" watchObservedRunningTime="2026-09-07 04:02:52.972416742 +0000 UTC m=+876.284892669"
Sep 07 04:02:53.086337 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:53.086298    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-320efe75-gj4rd"
Sep 07 04:02:53.167805 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:53.167726    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/94c7f419-2a04-4ccb-bc52-aa30008bcc7f-maas-api-service-ca\") pod \"94c7f419-2a04-4ccb-bc52-aa30008bcc7f\" (UID: \"94c7f419-2a04-4ccb-bc52-aa30008bcc7f\") "
Sep 07 04:02:53.168065 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:53.168043    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94c7f419-2a04-4ccb-bc52-aa30008bcc7f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "94c7f419-2a04-4ccb-bc52-aa30008bcc7f" (UID: "94c7f419-2a04-4ccb-bc52-aa30008bcc7f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 04:02:53.269210 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:53.269177    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/94c7f419-2a04-4ccb-bc52-aa30008bcc7f-maas-api-service-ca\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:02:53.962279 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:53.962249    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-320efe75-gj4rd"
Sep 07 04:02:53.962690 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:53.962281    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-320efe75-gj4rd" event={"ID":"94c7f419-2a04-4ccb-bc52-aa30008bcc7f","Type":"ContainerDied","Data":"6a835f5192d7f4c5d123f6008788942711545baacb866bcb26fbce6836dba130"}
Sep 07 04:02:53.962690 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:53.962328    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6a835f5192d7f4c5d123f6008788942711545baacb866bcb26fbce6836dba130"
Sep 07 04:02:54.384874 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:54.384835    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-a84f90/explicit-model-a84f90-kserve-696866dbbf-bp55c"]
Sep 07 04:02:54.508409 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:54.508377    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-a84f90-s6p4t"]
Sep 07 04:02:54.508973 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:54.508936    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94c7f419-2a04-4ccb-bc52-aa30008bcc7f" containerName="revoke-keys"
Sep 07 04:02:54.508973 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:54.508960    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="94c7f419-2a04-4ccb-bc52-aa30008bcc7f" containerName="revoke-keys"
Sep 07 04:02:54.509192 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:54.509075    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="94c7f419-2a04-4ccb-bc52-aa30008bcc7f" containerName="revoke-keys"
Sep 07 04:02:54.512522 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:54.512504    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-a84f90-s6p4t"
Sep 07 04:02:54.514444 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:54.514422    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 07 04:02:54.514444 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:54.514435    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zs4ff\""
Sep 07 04:02:54.519535 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:54.519507    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-a84f90-s6p4t"]
Sep 07 04:02:54.581469 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:54.581438    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/afe12694-656b-4932-91d2-e8814ca4aa36-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-a84f90-s6p4t\" (UID: \"afe12694-656b-4932-91d2-e8814ca4aa36\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-a84f90-s6p4t"
Sep 07 04:02:54.683310 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:54.683203    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/afe12694-656b-4932-91d2-e8814ca4aa36-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-a84f90-s6p4t\" (UID: \"afe12694-656b-4932-91d2-e8814ca4aa36\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-a84f90-s6p4t"
Sep 07 04:02:54.684163 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:54.684130    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/afe12694-656b-4932-91d2-e8814ca4aa36-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-a84f90-s6p4t\" (UID: \"afe12694-656b-4932-91d2-e8814ca4aa36\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-a84f90-s6p4t"
Sep 07 04:02:54.826785 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:54.826753    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-a84f90-s6p4t"
Sep 07 04:02:55.098527 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:55.098500    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-a84f90-s6p4t"]
Sep 07 04:02:55.099804 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:02:55.099778    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafe12694_656b_4932_91d2_e8814ca4aa36.slice/crio-558f16618ed5271aa7b03df93d970313e7ce1814cef0fc4100bafd0b7e83e184 WatchSource:0}: Error finding container 558f16618ed5271aa7b03df93d970313e7ce1814cef0fc4100bafd0b7e83e184: Status 404 returned error can't find the container with id 558f16618ed5271aa7b03df93d970313e7ce1814cef0fc4100bafd0b7e83e184
Sep 07 04:02:55.975906 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:55.975876    2559 generic.go:356] "Generic (PLEG): container finished" podID="afe12694-656b-4932-91d2-e8814ca4aa36" containerID="379ed5d27f92d3adea135b0ee30ca7ed43187f708d2ba00afe3fae1550341e6c" exitCode=0
Sep 07 04:02:55.976017 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:55.975954    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-a84f90-s6p4t" event={"ID":"afe12694-656b-4932-91d2-e8814ca4aa36","Type":"ContainerDied","Data":"379ed5d27f92d3adea135b0ee30ca7ed43187f708d2ba00afe3fae1550341e6c"}
Sep 07 04:02:55.976017 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:55.976006    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-a84f90-s6p4t" event={"ID":"afe12694-656b-4932-91d2-e8814ca4aa36","Type":"ContainerStarted","Data":"558f16618ed5271aa7b03df93d970313e7ce1814cef0fc4100bafd0b7e83e184"}
Sep 07 04:02:56.786277 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:56.786241    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-explicit-a84f90/explicit-model-a84f90-kserve-696866dbbf-bp55c"
Sep 07 04:02:57.120730 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:57.120707    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-a84f90-s6p4t"
Sep 07 04:02:57.207982 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:57.207951    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/afe12694-656b-4932-91d2-e8814ca4aa36-maas-api-service-ca\") pod \"afe12694-656b-4932-91d2-e8814ca4aa36\" (UID: \"afe12694-656b-4932-91d2-e8814ca4aa36\") "
Sep 07 04:02:57.208321 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:57.208296    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afe12694-656b-4932-91d2-e8814ca4aa36-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "afe12694-656b-4932-91d2-e8814ca4aa36" (UID: "afe12694-656b-4932-91d2-e8814ca4aa36"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 04:02:57.309616 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:57.309584    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/afe12694-656b-4932-91d2-e8814ca4aa36-maas-api-service-ca\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:02:57.528463 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:57.528429    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-320efe75-589579586f-v5dnz"]
Sep 07 04:02:57.528707 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:57.528665    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-320efe75-589579586f-v5dnz" podUID="7ecc7472-ab1f-4feb-97a5-76406b5fe544" containerName="payload-processing" containerID="cri-o://3ac340a4af6b042d8b34368a50ce818a1ce4d5b28a5634ea30f3cc451dec6db9" gracePeriod=30
Sep 07 04:02:57.541479 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:57.541453    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-320efe75-d676fdc6b-7mcvl"]
Sep 07 04:02:57.541701 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:57.541679    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-320efe75-d676fdc6b-7mcvl" podUID="6739af47-cd04-4932-bf73-298c4a769f6c" containerName="payload-pre-processing" containerID="cri-o://546c20102119ba544b4902a3b2f150120b009b74baa5db56f3a8e20a1751ab34" gracePeriod=30
Sep 07 04:02:57.678577 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:57.678534    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-320efe75-gj4rd"]
Sep 07 04:02:57.682595 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:57.682566    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-320efe75-gj4rd"]
Sep 07 04:02:57.855031 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:57.855011    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-320efe75-589579586f-v5dnz"
Sep 07 04:02:57.858013 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:57.857988    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-320efe75-d676fdc6b-7mcvl"
Sep 07 04:02:57.919200 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:57.915601    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7ecc7472-ab1f-4feb-97a5-76406b5fe544-plugins-config-volume\") pod \"7ecc7472-ab1f-4feb-97a5-76406b5fe544\" (UID: \"7ecc7472-ab1f-4feb-97a5-76406b5fe544\") "
Sep 07 04:02:57.919200 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:57.915845    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5rhpf\" (UniqueName: \"kubernetes.io/projected/7ecc7472-ab1f-4feb-97a5-76406b5fe544-kube-api-access-5rhpf\") pod \"7ecc7472-ab1f-4feb-97a5-76406b5fe544\" (UID: \"7ecc7472-ab1f-4feb-97a5-76406b5fe544\") "
Sep 07 04:02:57.919200 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:57.915919    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6739af47-cd04-4932-bf73-298c4a769f6c-plugins-config-volume\") pod \"6739af47-cd04-4932-bf73-298c4a769f6c\" (UID: \"6739af47-cd04-4932-bf73-298c4a769f6c\") "
Sep 07 04:02:57.919200 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:57.915961    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xqqpb\" (UniqueName: \"kubernetes.io/projected/6739af47-cd04-4932-bf73-298c4a769f6c-kube-api-access-xqqpb\") pod \"6739af47-cd04-4932-bf73-298c4a769f6c\" (UID: \"6739af47-cd04-4932-bf73-298c4a769f6c\") "
Sep 07 04:02:57.919200 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:57.916528    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6739af47-cd04-4932-bf73-298c4a769f6c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6739af47-cd04-4932-bf73-298c4a769f6c" (UID: "6739af47-cd04-4932-bf73-298c4a769f6c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 04:02:57.919200 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:57.916997    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ecc7472-ab1f-4feb-97a5-76406b5fe544-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7ecc7472-ab1f-4feb-97a5-76406b5fe544" (UID: "7ecc7472-ab1f-4feb-97a5-76406b5fe544"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 04:02:57.919704 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:57.919404    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ecc7472-ab1f-4feb-97a5-76406b5fe544-kube-api-access-5rhpf" (OuterVolumeSpecName: "kube-api-access-5rhpf") pod "7ecc7472-ab1f-4feb-97a5-76406b5fe544" (UID: "7ecc7472-ab1f-4feb-97a5-76406b5fe544"). InnerVolumeSpecName "kube-api-access-5rhpf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 04:02:57.920863 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:57.920835    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6739af47-cd04-4932-bf73-298c4a769f6c-kube-api-access-xqqpb" (OuterVolumeSpecName: "kube-api-access-xqqpb") pod "6739af47-cd04-4932-bf73-298c4a769f6c" (UID: "6739af47-cd04-4932-bf73-298c4a769f6c"). InnerVolumeSpecName "kube-api-access-xqqpb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 04:02:57.989001 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:57.988965    2559 generic.go:356] "Generic (PLEG): container finished" podID="6739af47-cd04-4932-bf73-298c4a769f6c" containerID="546c20102119ba544b4902a3b2f150120b009b74baa5db56f3a8e20a1751ab34" exitCode=0
Sep 07 04:02:57.989175 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:57.989010    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-320efe75-d676fdc6b-7mcvl"
Sep 07 04:02:57.989175 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:57.989055    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-320efe75-d676fdc6b-7mcvl" event={"ID":"6739af47-cd04-4932-bf73-298c4a769f6c","Type":"ContainerDied","Data":"546c20102119ba544b4902a3b2f150120b009b74baa5db56f3a8e20a1751ab34"}
Sep 07 04:02:57.989175 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:57.989120    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-320efe75-d676fdc6b-7mcvl" event={"ID":"6739af47-cd04-4932-bf73-298c4a769f6c","Type":"ContainerDied","Data":"50a3cdc1243b99175494a1fd1cf08a6d5cc4b1a5413bb84159c7770b3030fe80"}
Sep 07 04:02:57.989175 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:57.989152    2559 scope.go:117] "RemoveContainer" containerID="546c20102119ba544b4902a3b2f150120b009b74baa5db56f3a8e20a1751ab34"
Sep 07 04:02:57.990593 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:57.990566    2559 generic.go:356] "Generic (PLEG): container finished" podID="7ecc7472-ab1f-4feb-97a5-76406b5fe544" containerID="3ac340a4af6b042d8b34368a50ce818a1ce4d5b28a5634ea30f3cc451dec6db9" exitCode=0
Sep 07 04:02:57.990732 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:57.990610    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-320efe75-589579586f-v5dnz"
Sep 07 04:02:57.990732 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:57.990666    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-320efe75-589579586f-v5dnz" event={"ID":"7ecc7472-ab1f-4feb-97a5-76406b5fe544","Type":"ContainerDied","Data":"3ac340a4af6b042d8b34368a50ce818a1ce4d5b28a5634ea30f3cc451dec6db9"}
Sep 07 04:02:57.990732 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:57.990709    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-320efe75-589579586f-v5dnz" event={"ID":"7ecc7472-ab1f-4feb-97a5-76406b5fe544","Type":"ContainerDied","Data":"e66259851bfc3719f70b43b05770e00ffa982239893d5a3676bbd74edd0da71c"}
Sep 07 04:02:57.992343 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:57.992325    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-a84f90-s6p4t"
Sep 07 04:02:57.992463 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:57.992376    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-a84f90-s6p4t" event={"ID":"afe12694-656b-4932-91d2-e8814ca4aa36","Type":"ContainerDied","Data":"558f16618ed5271aa7b03df93d970313e7ce1814cef0fc4100bafd0b7e83e184"}
Sep 07 04:02:57.992463 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:57.992423    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="558f16618ed5271aa7b03df93d970313e7ce1814cef0fc4100bafd0b7e83e184"
Sep 07 04:02:58.000098 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:58.000077    2559 scope.go:117] "RemoveContainer" containerID="546c20102119ba544b4902a3b2f150120b009b74baa5db56f3a8e20a1751ab34"
Sep 07 04:02:58.000431 ip-10-0-132-4 kubenswrapper[2559]: E0907 04:02:58.000405    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"546c20102119ba544b4902a3b2f150120b009b74baa5db56f3a8e20a1751ab34\": container with ID starting with 546c20102119ba544b4902a3b2f150120b009b74baa5db56f3a8e20a1751ab34 not found: ID does not exist" containerID="546c20102119ba544b4902a3b2f150120b009b74baa5db56f3a8e20a1751ab34"
Sep 07 04:02:58.000508 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:58.000441    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"546c20102119ba544b4902a3b2f150120b009b74baa5db56f3a8e20a1751ab34"} err="failed to get container status \"546c20102119ba544b4902a3b2f150120b009b74baa5db56f3a8e20a1751ab34\": rpc error: code = NotFound desc = could not find container \"546c20102119ba544b4902a3b2f150120b009b74baa5db56f3a8e20a1751ab34\": container with ID starting with 546c20102119ba544b4902a3b2f150120b009b74baa5db56f3a8e20a1751ab34 not found: ID does not exist"
Sep 07 04:02:58.000508 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:58.000464    2559 scope.go:117] "RemoveContainer" containerID="3ac340a4af6b042d8b34368a50ce818a1ce4d5b28a5634ea30f3cc451dec6db9"
Sep 07 04:02:58.008941 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:58.008923    2559 scope.go:117] "RemoveContainer" containerID="3ac340a4af6b042d8b34368a50ce818a1ce4d5b28a5634ea30f3cc451dec6db9"
Sep 07 04:02:58.009208 ip-10-0-132-4 kubenswrapper[2559]: E0907 04:02:58.009169    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ac340a4af6b042d8b34368a50ce818a1ce4d5b28a5634ea30f3cc451dec6db9\": container with ID starting with 3ac340a4af6b042d8b34368a50ce818a1ce4d5b28a5634ea30f3cc451dec6db9 not found: ID does not exist" containerID="3ac340a4af6b042d8b34368a50ce818a1ce4d5b28a5634ea30f3cc451dec6db9"
Sep 07 04:02:58.009208 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:58.009192    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ac340a4af6b042d8b34368a50ce818a1ce4d5b28a5634ea30f3cc451dec6db9"} err="failed to get container status \"3ac340a4af6b042d8b34368a50ce818a1ce4d5b28a5634ea30f3cc451dec6db9\": rpc error: code = NotFound desc = could not find container \"3ac340a4af6b042d8b34368a50ce818a1ce4d5b28a5634ea30f3cc451dec6db9\": container with ID starting with 3ac340a4af6b042d8b34368a50ce818a1ce4d5b28a5634ea30f3cc451dec6db9 not found: ID does not exist"
Sep 07 04:02:58.015964 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:58.015944    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-320efe75-d676fdc6b-7mcvl"]
Sep 07 04:02:58.017328 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:58.017304    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5rhpf\" (UniqueName: \"kubernetes.io/projected/7ecc7472-ab1f-4feb-97a5-76406b5fe544-kube-api-access-5rhpf\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:02:58.017427 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:58.017332    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6739af47-cd04-4932-bf73-298c4a769f6c-plugins-config-volume\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:02:58.017427 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:58.017346    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqqpb\" (UniqueName: \"kubernetes.io/projected/6739af47-cd04-4932-bf73-298c4a769f6c-kube-api-access-xqqpb\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:02:58.017427 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:58.017359    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7ecc7472-ab1f-4feb-97a5-76406b5fe544-plugins-config-volume\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:02:58.019851 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:58.019834    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-320efe75-d676fdc6b-7mcvl"]
Sep 07 04:02:58.030798 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:58.030754    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-320efe75-589579586f-v5dnz"]
Sep 07 04:02:58.032999 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:58.032981    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-320efe75-589579586f-v5dnz"]
Sep 07 04:02:59.179490 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:59.179452    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6739af47-cd04-4932-bf73-298c4a769f6c" path="/var/lib/kubelet/pods/6739af47-cd04-4932-bf73-298c4a769f6c/volumes"
Sep 07 04:02:59.179909 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:59.179853    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ecc7472-ab1f-4feb-97a5-76406b5fe544" path="/var/lib/kubelet/pods/7ecc7472-ab1f-4feb-97a5-76406b5fe544/volumes"
Sep 07 04:02:59.180140 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:02:59.180127    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94c7f419-2a04-4ccb-bc52-aa30008bcc7f" path="/var/lib/kubelet/pods/94c7f419-2a04-4ccb-bc52-aa30008bcc7f/volumes"
Sep 07 04:03:02.590476 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:02.590438    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-a8da4e/test-model-a8da4e-kserve-6bc5f99d7f-mz4tt"
Sep 07 04:03:02.590989 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:02.590778    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-a8da4e/test-model-a8da4e-kserve-6bc5f99d7f-mz4tt"
Sep 07 04:03:02.603268 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:02.603247    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-a8da4e/test-model-a8da4e-kserve-6bc5f99d7f-mz4tt"
Sep 07 04:03:03.047462 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:03.047432    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-a8da4e/test-model-a8da4e-kserve-6bc5f99d7f-mz4tt"
Sep 07 04:03:05.343300 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:05.343261    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-a84f90-6bbdc768f8-4524f"]
Sep 07 04:03:05.343773 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:05.343505    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a84f90-6bbdc768f8-4524f" podUID="9dd2635b-2354-45a5-935d-10f55ceffd61" containerName="payload-pre-processing" containerID="cri-o://203dce699181e91e767f43cf363ed20cdabdcad02978f62bdc8a9e6243c8a8dc" gracePeriod=30
Sep 07 04:03:05.485327 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:05.485277    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-a84f90-s6p4t"]
Sep 07 04:03:05.488377 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:05.488351    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-a84f90-s6p4t"]
Sep 07 04:03:05.609061 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:05.609028    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a84f90-6bbdc768f8-4524f"
Sep 07 04:03:05.692604 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:05.692575    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9dd2635b-2354-45a5-935d-10f55ceffd61-plugins-config-volume\") pod \"9dd2635b-2354-45a5-935d-10f55ceffd61\" (UID: \"9dd2635b-2354-45a5-935d-10f55ceffd61\") "
Sep 07 04:03:05.692806 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:05.692706    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hxx5j\" (UniqueName: \"kubernetes.io/projected/9dd2635b-2354-45a5-935d-10f55ceffd61-kube-api-access-hxx5j\") pod \"9dd2635b-2354-45a5-935d-10f55ceffd61\" (UID: \"9dd2635b-2354-45a5-935d-10f55ceffd61\") "
Sep 07 04:03:05.692945 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:05.692922    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9dd2635b-2354-45a5-935d-10f55ceffd61-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9dd2635b-2354-45a5-935d-10f55ceffd61" (UID: "9dd2635b-2354-45a5-935d-10f55ceffd61"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 04:03:05.694763 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:05.694735    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9dd2635b-2354-45a5-935d-10f55ceffd61-kube-api-access-hxx5j" (OuterVolumeSpecName: "kube-api-access-hxx5j") pod "9dd2635b-2354-45a5-935d-10f55ceffd61" (UID: "9dd2635b-2354-45a5-935d-10f55ceffd61"). InnerVolumeSpecName "kube-api-access-hxx5j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 04:03:05.794236 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:05.794189    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9dd2635b-2354-45a5-935d-10f55ceffd61-plugins-config-volume\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:03:05.794236 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:05.794226    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hxx5j\" (UniqueName: \"kubernetes.io/projected/9dd2635b-2354-45a5-935d-10f55ceffd61-kube-api-access-hxx5j\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:03:06.055308 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:06.055218    2559 generic.go:356] "Generic (PLEG): container finished" podID="9dd2635b-2354-45a5-935d-10f55ceffd61" containerID="203dce699181e91e767f43cf363ed20cdabdcad02978f62bdc8a9e6243c8a8dc" exitCode=0
Sep 07 04:03:06.055308 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:06.055280    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a84f90-6bbdc768f8-4524f"
Sep 07 04:03:06.055541 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:06.055312    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a84f90-6bbdc768f8-4524f" event={"ID":"9dd2635b-2354-45a5-935d-10f55ceffd61","Type":"ContainerDied","Data":"203dce699181e91e767f43cf363ed20cdabdcad02978f62bdc8a9e6243c8a8dc"}
Sep 07 04:03:06.055541 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:06.055400    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a84f90-6bbdc768f8-4524f" event={"ID":"9dd2635b-2354-45a5-935d-10f55ceffd61","Type":"ContainerDied","Data":"61ac56a24daeec178bb50bb4d83949973854ff06952bb3cc4f58a6317964df24"}
Sep 07 04:03:06.055541 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:06.055434    2559 scope.go:117] "RemoveContainer" containerID="203dce699181e91e767f43cf363ed20cdabdcad02978f62bdc8a9e6243c8a8dc"
Sep 07 04:03:06.065083 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:06.065066    2559 scope.go:117] "RemoveContainer" containerID="203dce699181e91e767f43cf363ed20cdabdcad02978f62bdc8a9e6243c8a8dc"
Sep 07 04:03:06.065331 ip-10-0-132-4 kubenswrapper[2559]: E0907 04:03:06.065314    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"203dce699181e91e767f43cf363ed20cdabdcad02978f62bdc8a9e6243c8a8dc\": container with ID starting with 203dce699181e91e767f43cf363ed20cdabdcad02978f62bdc8a9e6243c8a8dc not found: ID does not exist" containerID="203dce699181e91e767f43cf363ed20cdabdcad02978f62bdc8a9e6243c8a8dc"
Sep 07 04:03:06.065384 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:06.065338    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"203dce699181e91e767f43cf363ed20cdabdcad02978f62bdc8a9e6243c8a8dc"} err="failed to get container status \"203dce699181e91e767f43cf363ed20cdabdcad02978f62bdc8a9e6243c8a8dc\": rpc error: code = NotFound desc = could not find container \"203dce699181e91e767f43cf363ed20cdabdcad02978f62bdc8a9e6243c8a8dc\": container with ID starting with 203dce699181e91e767f43cf363ed20cdabdcad02978f62bdc8a9e6243c8a8dc not found: ID does not exist"
Sep 07 04:03:06.076546 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:06.076526    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-a84f90-6bbdc768f8-4524f"]
Sep 07 04:03:06.079977 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:06.079957    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-a84f90-6bbdc768f8-4524f"]
Sep 07 04:03:07.180601 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:07.180568    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9dd2635b-2354-45a5-935d-10f55ceffd61" path="/var/lib/kubelet/pods/9dd2635b-2354-45a5-935d-10f55ceffd61/volumes"
Sep 07 04:03:07.181003 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:07.180927    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afe12694-656b-4932-91d2-e8814ca4aa36" path="/var/lib/kubelet/pods/afe12694-656b-4932-91d2-e8814ca4aa36/volumes"
Sep 07 04:03:09.405212 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:09.405174    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-explicit-a84f90/explicit-model-a84f90-kserve-696866dbbf-bp55c" podUID="844afb23-e3a5-4134-861d-c9e361e7e4b9" containerName="main" containerID="cri-o://f199c248094e771458c725e01d39ca0670cb305c2a0c18329f7d43b02886bd1c" gracePeriod=45
Sep 07 04:03:09.657960 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:09.657899    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-a84f90/explicit-model-a84f90-kserve-696866dbbf-bp55c"
Sep 07 04:03:09.734465 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:09.734383    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/844afb23-e3a5-4134-861d-c9e361e7e4b9-tls-certs\") pod \"844afb23-e3a5-4134-861d-c9e361e7e4b9\" (UID: \"844afb23-e3a5-4134-861d-c9e361e7e4b9\") "
Sep 07 04:03:09.734465 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:09.734447    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ccglq\" (UniqueName: \"kubernetes.io/projected/844afb23-e3a5-4134-861d-c9e361e7e4b9-kube-api-access-ccglq\") pod \"844afb23-e3a5-4134-861d-c9e361e7e4b9\" (UID: \"844afb23-e3a5-4134-861d-c9e361e7e4b9\") "
Sep 07 04:03:09.734741 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:09.734469    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/844afb23-e3a5-4134-861d-c9e361e7e4b9-dshm\") pod \"844afb23-e3a5-4134-861d-c9e361e7e4b9\" (UID: \"844afb23-e3a5-4134-861d-c9e361e7e4b9\") "
Sep 07 04:03:09.734741 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:09.734559    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/844afb23-e3a5-4134-861d-c9e361e7e4b9-home\") pod \"844afb23-e3a5-4134-861d-c9e361e7e4b9\" (UID: \"844afb23-e3a5-4134-861d-c9e361e7e4b9\") "
Sep 07 04:03:09.734860 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:09.734740    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/844afb23-e3a5-4134-861d-c9e361e7e4b9-model-cache\") pod \"844afb23-e3a5-4134-861d-c9e361e7e4b9\" (UID: \"844afb23-e3a5-4134-861d-c9e361e7e4b9\") "
Sep 07 04:03:09.734860 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:09.734824    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/844afb23-e3a5-4134-861d-c9e361e7e4b9-tmp-dir\") pod \"844afb23-e3a5-4134-861d-c9e361e7e4b9\" (UID: \"844afb23-e3a5-4134-861d-c9e361e7e4b9\") "
Sep 07 04:03:09.734957 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:09.734879    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/844afb23-e3a5-4134-861d-c9e361e7e4b9-home" (OuterVolumeSpecName: "home") pod "844afb23-e3a5-4134-861d-c9e361e7e4b9" (UID: "844afb23-e3a5-4134-861d-c9e361e7e4b9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:03:09.735146 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:09.735049    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/844afb23-e3a5-4134-861d-c9e361e7e4b9-model-cache" (OuterVolumeSpecName: "model-cache") pod "844afb23-e3a5-4134-861d-c9e361e7e4b9" (UID: "844afb23-e3a5-4134-861d-c9e361e7e4b9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:03:09.735146 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:09.735118    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/844afb23-e3a5-4134-861d-c9e361e7e4b9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "844afb23-e3a5-4134-861d-c9e361e7e4b9" (UID: "844afb23-e3a5-4134-861d-c9e361e7e4b9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:03:09.735332 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:09.735227    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/844afb23-e3a5-4134-861d-c9e361e7e4b9-model-cache\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:03:09.735332 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:09.735243    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/844afb23-e3a5-4134-861d-c9e361e7e4b9-tmp-dir\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:03:09.735332 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:09.735251    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/844afb23-e3a5-4134-861d-c9e361e7e4b9-home\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:03:09.736915 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:09.736892    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/844afb23-e3a5-4134-861d-c9e361e7e4b9-dshm" (OuterVolumeSpecName: "dshm") pod "844afb23-e3a5-4134-861d-c9e361e7e4b9" (UID: "844afb23-e3a5-4134-861d-c9e361e7e4b9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:03:09.737238 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:09.737217    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/844afb23-e3a5-4134-861d-c9e361e7e4b9-kube-api-access-ccglq" (OuterVolumeSpecName: "kube-api-access-ccglq") pod "844afb23-e3a5-4134-861d-c9e361e7e4b9" (UID: "844afb23-e3a5-4134-861d-c9e361e7e4b9"). InnerVolumeSpecName "kube-api-access-ccglq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 04:03:09.737319 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:09.737218    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/844afb23-e3a5-4134-861d-c9e361e7e4b9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "844afb23-e3a5-4134-861d-c9e361e7e4b9" (UID: "844afb23-e3a5-4134-861d-c9e361e7e4b9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 04:03:09.836366 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:09.836330    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/844afb23-e3a5-4134-861d-c9e361e7e4b9-tls-certs\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:03:09.836366 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:09.836359    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ccglq\" (UniqueName: \"kubernetes.io/projected/844afb23-e3a5-4134-861d-c9e361e7e4b9-kube-api-access-ccglq\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:03:09.836366 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:09.836370    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/844afb23-e3a5-4134-861d-c9e361e7e4b9-dshm\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:03:10.080505 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:10.080410    2559 generic.go:356] "Generic (PLEG): container finished" podID="844afb23-e3a5-4134-861d-c9e361e7e4b9" containerID="f199c248094e771458c725e01d39ca0670cb305c2a0c18329f7d43b02886bd1c" exitCode=0
Sep 07 04:03:10.080505 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:10.080476    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-a84f90/explicit-model-a84f90-kserve-696866dbbf-bp55c"
Sep 07 04:03:10.080505 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:10.080486    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-a84f90/explicit-model-a84f90-kserve-696866dbbf-bp55c" event={"ID":"844afb23-e3a5-4134-861d-c9e361e7e4b9","Type":"ContainerDied","Data":"f199c248094e771458c725e01d39ca0670cb305c2a0c18329f7d43b02886bd1c"}
Sep 07 04:03:10.080805 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:10.080540    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-a84f90/explicit-model-a84f90-kserve-696866dbbf-bp55c" event={"ID":"844afb23-e3a5-4134-861d-c9e361e7e4b9","Type":"ContainerDied","Data":"e1588e7f8c62965262c84a77d33edb17ae55cff07f856f46efbca44e0b7f5bd1"}
Sep 07 04:03:10.080805 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:10.080562    2559 scope.go:117] "RemoveContainer" containerID="f199c248094e771458c725e01d39ca0670cb305c2a0c18329f7d43b02886bd1c"
Sep 07 04:03:10.091602 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:10.091581    2559 scope.go:117] "RemoveContainer" containerID="f199c248094e771458c725e01d39ca0670cb305c2a0c18329f7d43b02886bd1c"
Sep 07 04:03:10.092005 ip-10-0-132-4 kubenswrapper[2559]: E0907 04:03:10.091983    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f199c248094e771458c725e01d39ca0670cb305c2a0c18329f7d43b02886bd1c\": container with ID starting with f199c248094e771458c725e01d39ca0670cb305c2a0c18329f7d43b02886bd1c not found: ID does not exist" containerID="f199c248094e771458c725e01d39ca0670cb305c2a0c18329f7d43b02886bd1c"
Sep 07 04:03:10.092065 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:10.092013    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f199c248094e771458c725e01d39ca0670cb305c2a0c18329f7d43b02886bd1c"} err="failed to get container status \"f199c248094e771458c725e01d39ca0670cb305c2a0c18329f7d43b02886bd1c\": rpc error: code = NotFound desc = could not find container \"f199c248094e771458c725e01d39ca0670cb305c2a0c18329f7d43b02886bd1c\": container with ID starting with f199c248094e771458c725e01d39ca0670cb305c2a0c18329f7d43b02886bd1c not found: ID does not exist"
Sep 07 04:03:10.101688 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:10.101667    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-a84f90/explicit-model-a84f90-kserve-696866dbbf-bp55c"]
Sep 07 04:03:10.104922 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:10.104901    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-explicit-a84f90/explicit-model-a84f90-kserve-696866dbbf-bp55c"]
Sep 07 04:03:11.179024 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:11.178990    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="844afb23-e3a5-4134-861d-c9e361e7e4b9" path="/var/lib/kubelet/pods/844afb23-e3a5-4134-861d-c9e361e7e4b9/volumes"
Sep 07 04:03:35.667868 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:35.667830    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-noten-860c6d/noten-model-860c6d-kserve-8fc9b7959-fd26p"]
Sep 07 04:03:35.668474 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:35.668376    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ecc7472-ab1f-4feb-97a5-76406b5fe544" containerName="payload-processing"
Sep 07 04:03:35.668474 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:35.668391    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ecc7472-ab1f-4feb-97a5-76406b5fe544" containerName="payload-processing"
Sep 07 04:03:35.668474 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:35.668416    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="844afb23-e3a5-4134-861d-c9e361e7e4b9" containerName="main"
Sep 07 04:03:35.668474 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:35.668425    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="844afb23-e3a5-4134-861d-c9e361e7e4b9" containerName="main"
Sep 07 04:03:35.668474 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:35.668438    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afe12694-656b-4932-91d2-e8814ca4aa36" containerName="revoke-keys"
Sep 07 04:03:35.668474 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:35.668446    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="afe12694-656b-4932-91d2-e8814ca4aa36" containerName="revoke-keys"
Sep 07 04:03:35.668474 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:35.668458    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6739af47-cd04-4932-bf73-298c4a769f6c" containerName="payload-pre-processing"
Sep 07 04:03:35.668474 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:35.668466    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6739af47-cd04-4932-bf73-298c4a769f6c" containerName="payload-pre-processing"
Sep 07 04:03:35.668474 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:35.668475    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9dd2635b-2354-45a5-935d-10f55ceffd61" containerName="payload-pre-processing"
Sep 07 04:03:35.669014 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:35.668485    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dd2635b-2354-45a5-935d-10f55ceffd61" containerName="payload-pre-processing"
Sep 07 04:03:35.669014 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:35.668589    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ecc7472-ab1f-4feb-97a5-76406b5fe544" containerName="payload-processing"
Sep 07 04:03:35.669014 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:35.668603    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6739af47-cd04-4932-bf73-298c4a769f6c" containerName="payload-pre-processing"
Sep 07 04:03:35.669014 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:35.668613    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="afe12694-656b-4932-91d2-e8814ca4aa36" containerName="revoke-keys"
Sep 07 04:03:35.669014 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:35.668638    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9dd2635b-2354-45a5-935d-10f55ceffd61" containerName="payload-pre-processing"
Sep 07 04:03:35.669014 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:35.668648    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="844afb23-e3a5-4134-861d-c9e361e7e4b9" containerName="main"
Sep 07 04:03:35.673390 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:35.673365    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-860c6d/noten-model-860c6d-kserve-8fc9b7959-fd26p"
Sep 07 04:03:35.676041 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:35.676020    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-860c6d\"/\"noten-model-860c6d-kserve-self-signed-certs\""
Sep 07 04:03:35.676179 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:35.676058    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-860c6d\"/\"kube-root-ca.crt\""
Sep 07 04:03:35.676282 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:35.676255    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-860c6d\"/\"openshift-service-ca.crt\""
Sep 07 04:03:35.676371 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:35.676292    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-860c6d\"/\"default-dockercfg-gkbms\""
Sep 07 04:03:35.681149 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:35.681122    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-860c6d/noten-model-860c6d-kserve-8fc9b7959-fd26p"]
Sep 07 04:03:35.779050 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:35.779014    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45qtc\" (UniqueName: \"kubernetes.io/projected/c51702e8-8a63-42d3-b807-5a644a7afae6-kube-api-access-45qtc\") pod \"noten-model-860c6d-kserve-8fc9b7959-fd26p\" (UID: \"c51702e8-8a63-42d3-b807-5a644a7afae6\") " pod="ai-tenant-e2e-noten-860c6d/noten-model-860c6d-kserve-8fc9b7959-fd26p"
Sep 07 04:03:35.779050 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:35.779056    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c51702e8-8a63-42d3-b807-5a644a7afae6-home\") pod \"noten-model-860c6d-kserve-8fc9b7959-fd26p\" (UID: \"c51702e8-8a63-42d3-b807-5a644a7afae6\") " pod="ai-tenant-e2e-noten-860c6d/noten-model-860c6d-kserve-8fc9b7959-fd26p"
Sep 07 04:03:35.779303 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:35.779125    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c51702e8-8a63-42d3-b807-5a644a7afae6-tls-certs\") pod \"noten-model-860c6d-kserve-8fc9b7959-fd26p\" (UID: \"c51702e8-8a63-42d3-b807-5a644a7afae6\") " pod="ai-tenant-e2e-noten-860c6d/noten-model-860c6d-kserve-8fc9b7959-fd26p"
Sep 07 04:03:35.779303 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:35.779221    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c51702e8-8a63-42d3-b807-5a644a7afae6-dshm\") pod \"noten-model-860c6d-kserve-8fc9b7959-fd26p\" (UID: \"c51702e8-8a63-42d3-b807-5a644a7afae6\") " pod="ai-tenant-e2e-noten-860c6d/noten-model-860c6d-kserve-8fc9b7959-fd26p"
Sep 07 04:03:35.779303 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:35.779273    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c51702e8-8a63-42d3-b807-5a644a7afae6-model-cache\") pod \"noten-model-860c6d-kserve-8fc9b7959-fd26p\" (UID: \"c51702e8-8a63-42d3-b807-5a644a7afae6\") " pod="ai-tenant-e2e-noten-860c6d/noten-model-860c6d-kserve-8fc9b7959-fd26p"
Sep 07 04:03:35.779442 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:35.779309    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c51702e8-8a63-42d3-b807-5a644a7afae6-tmp-dir\") pod \"noten-model-860c6d-kserve-8fc9b7959-fd26p\" (UID: \"c51702e8-8a63-42d3-b807-5a644a7afae6\") " pod="ai-tenant-e2e-noten-860c6d/noten-model-860c6d-kserve-8fc9b7959-fd26p"
Sep 07 04:03:35.879817 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:35.879778    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c51702e8-8a63-42d3-b807-5a644a7afae6-tls-certs\") pod \"noten-model-860c6d-kserve-8fc9b7959-fd26p\" (UID: \"c51702e8-8a63-42d3-b807-5a644a7afae6\") " pod="ai-tenant-e2e-noten-860c6d/noten-model-860c6d-kserve-8fc9b7959-fd26p"
Sep 07 04:03:35.880002 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:35.879853    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c51702e8-8a63-42d3-b807-5a644a7afae6-dshm\") pod \"noten-model-860c6d-kserve-8fc9b7959-fd26p\" (UID: \"c51702e8-8a63-42d3-b807-5a644a7afae6\") " pod="ai-tenant-e2e-noten-860c6d/noten-model-860c6d-kserve-8fc9b7959-fd26p"
Sep 07 04:03:35.880002 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:35.879892    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c51702e8-8a63-42d3-b807-5a644a7afae6-model-cache\") pod \"noten-model-860c6d-kserve-8fc9b7959-fd26p\" (UID: \"c51702e8-8a63-42d3-b807-5a644a7afae6\") " pod="ai-tenant-e2e-noten-860c6d/noten-model-860c6d-kserve-8fc9b7959-fd26p"
Sep 07 04:03:35.880002 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:35.879911    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c51702e8-8a63-42d3-b807-5a644a7afae6-tmp-dir\") pod \"noten-model-860c6d-kserve-8fc9b7959-fd26p\" (UID: \"c51702e8-8a63-42d3-b807-5a644a7afae6\") " pod="ai-tenant-e2e-noten-860c6d/noten-model-860c6d-kserve-8fc9b7959-fd26p"
Sep 07 04:03:35.880002 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:35.879944    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45qtc\" (UniqueName: \"kubernetes.io/projected/c51702e8-8a63-42d3-b807-5a644a7afae6-kube-api-access-45qtc\") pod \"noten-model-860c6d-kserve-8fc9b7959-fd26p\" (UID: \"c51702e8-8a63-42d3-b807-5a644a7afae6\") " pod="ai-tenant-e2e-noten-860c6d/noten-model-860c6d-kserve-8fc9b7959-fd26p"
Sep 07 04:03:35.880210 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:35.879999    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c51702e8-8a63-42d3-b807-5a644a7afae6-home\") pod \"noten-model-860c6d-kserve-8fc9b7959-fd26p\" (UID: \"c51702e8-8a63-42d3-b807-5a644a7afae6\") " pod="ai-tenant-e2e-noten-860c6d/noten-model-860c6d-kserve-8fc9b7959-fd26p"
Sep 07 04:03:35.880359 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:35.880333    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c51702e8-8a63-42d3-b807-5a644a7afae6-model-cache\") pod \"noten-model-860c6d-kserve-8fc9b7959-fd26p\" (UID: \"c51702e8-8a63-42d3-b807-5a644a7afae6\") " pod="ai-tenant-e2e-noten-860c6d/noten-model-860c6d-kserve-8fc9b7959-fd26p"
Sep 07 04:03:35.880499 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:35.880371    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c51702e8-8a63-42d3-b807-5a644a7afae6-tmp-dir\") pod \"noten-model-860c6d-kserve-8fc9b7959-fd26p\" (UID: \"c51702e8-8a63-42d3-b807-5a644a7afae6\") " pod="ai-tenant-e2e-noten-860c6d/noten-model-860c6d-kserve-8fc9b7959-fd26p"
Sep 07 04:03:35.880499 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:35.880413    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c51702e8-8a63-42d3-b807-5a644a7afae6-home\") pod \"noten-model-860c6d-kserve-8fc9b7959-fd26p\" (UID: \"c51702e8-8a63-42d3-b807-5a644a7afae6\") " pod="ai-tenant-e2e-noten-860c6d/noten-model-860c6d-kserve-8fc9b7959-fd26p"
Sep 07 04:03:35.882180 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:35.882160    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c51702e8-8a63-42d3-b807-5a644a7afae6-dshm\") pod \"noten-model-860c6d-kserve-8fc9b7959-fd26p\" (UID: \"c51702e8-8a63-42d3-b807-5a644a7afae6\") " pod="ai-tenant-e2e-noten-860c6d/noten-model-860c6d-kserve-8fc9b7959-fd26p"
Sep 07 04:03:35.882490 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:35.882473    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c51702e8-8a63-42d3-b807-5a644a7afae6-tls-certs\") pod \"noten-model-860c6d-kserve-8fc9b7959-fd26p\" (UID: \"c51702e8-8a63-42d3-b807-5a644a7afae6\") " pod="ai-tenant-e2e-noten-860c6d/noten-model-860c6d-kserve-8fc9b7959-fd26p"
Sep 07 04:03:35.887530 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:35.887511    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45qtc\" (UniqueName: \"kubernetes.io/projected/c51702e8-8a63-42d3-b807-5a644a7afae6-kube-api-access-45qtc\") pod \"noten-model-860c6d-kserve-8fc9b7959-fd26p\" (UID: \"c51702e8-8a63-42d3-b807-5a644a7afae6\") " pod="ai-tenant-e2e-noten-860c6d/noten-model-860c6d-kserve-8fc9b7959-fd26p"
Sep 07 04:03:35.985047 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:35.984964    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-860c6d/noten-model-860c6d-kserve-8fc9b7959-fd26p"
Sep 07 04:03:36.258357 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:36.258332    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-860c6d/noten-model-860c6d-kserve-8fc9b7959-fd26p"]
Sep 07 04:03:37.244814 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:37.244767    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-860c6d/noten-model-860c6d-kserve-8fc9b7959-fd26p" event={"ID":"c51702e8-8a63-42d3-b807-5a644a7afae6","Type":"ContainerStarted","Data":"98c689ae5876090bf64f40d9fccd2b986efa79a87e0530a88227b9db1cbb10ee"}
Sep 07 04:03:37.245284 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:37.244824    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-860c6d/noten-model-860c6d-kserve-8fc9b7959-fd26p" event={"ID":"c51702e8-8a63-42d3-b807-5a644a7afae6","Type":"ContainerStarted","Data":"2b766baf1dc598858716678ca36ab09a264a382e7ba2b69fa58bd6e4ec88893b"}
Sep 07 04:03:37.259902 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:37.259851    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-noten-860c6d/noten-model-860c6d-kserve-8fc9b7959-fd26p" podStartSLOduration=2.25983599 podStartE2EDuration="2.25983599s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:03:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:03:37.258356719 +0000 UTC m=+920.570832642" watchObservedRunningTime="2026-09-07 04:03:37.25983599 +0000 UTC m=+920.572311893"
Sep 07 04:03:44.164010 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:44.163979    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-860c6d/noten-model-860c6d-kserve-8fc9b7959-fd26p"]
Sep 07 04:03:45.985862 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:45.985824    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-noten-860c6d/noten-model-860c6d-kserve-8fc9b7959-fd26p"
Sep 07 04:03:59.184016 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:59.183970    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-noten-860c6d/noten-model-860c6d-kserve-8fc9b7959-fd26p" podUID="c51702e8-8a63-42d3-b807-5a644a7afae6" containerName="main" containerID="cri-o://98c689ae5876090bf64f40d9fccd2b986efa79a87e0530a88227b9db1cbb10ee" gracePeriod=45
Sep 07 04:03:59.380034 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:59.379998    2559 generic.go:356] "Generic (PLEG): container finished" podID="c51702e8-8a63-42d3-b807-5a644a7afae6" containerID="98c689ae5876090bf64f40d9fccd2b986efa79a87e0530a88227b9db1cbb10ee" exitCode=0
Sep 07 04:03:59.380189 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:59.380067    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-860c6d/noten-model-860c6d-kserve-8fc9b7959-fd26p" event={"ID":"c51702e8-8a63-42d3-b807-5a644a7afae6","Type":"ContainerDied","Data":"98c689ae5876090bf64f40d9fccd2b986efa79a87e0530a88227b9db1cbb10ee"}
Sep 07 04:03:59.429481 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:59.429457    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-860c6d/noten-model-860c6d-kserve-8fc9b7959-fd26p"
Sep 07 04:03:59.510059 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:59.509983    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c51702e8-8a63-42d3-b807-5a644a7afae6-model-cache\") pod \"c51702e8-8a63-42d3-b807-5a644a7afae6\" (UID: \"c51702e8-8a63-42d3-b807-5a644a7afae6\") "
Sep 07 04:03:59.510059 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:59.510023    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-45qtc\" (UniqueName: \"kubernetes.io/projected/c51702e8-8a63-42d3-b807-5a644a7afae6-kube-api-access-45qtc\") pod \"c51702e8-8a63-42d3-b807-5a644a7afae6\" (UID: \"c51702e8-8a63-42d3-b807-5a644a7afae6\") "
Sep 07 04:03:59.510059 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:59.510054    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c51702e8-8a63-42d3-b807-5a644a7afae6-home\") pod \"c51702e8-8a63-42d3-b807-5a644a7afae6\" (UID: \"c51702e8-8a63-42d3-b807-5a644a7afae6\") "
Sep 07 04:03:59.510292 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:59.510090    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c51702e8-8a63-42d3-b807-5a644a7afae6-tmp-dir\") pod \"c51702e8-8a63-42d3-b807-5a644a7afae6\" (UID: \"c51702e8-8a63-42d3-b807-5a644a7afae6\") "
Sep 07 04:03:59.510292 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:59.510115    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c51702e8-8a63-42d3-b807-5a644a7afae6-dshm\") pod \"c51702e8-8a63-42d3-b807-5a644a7afae6\" (UID: \"c51702e8-8a63-42d3-b807-5a644a7afae6\") "
Sep 07 04:03:59.510292 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:59.510238    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c51702e8-8a63-42d3-b807-5a644a7afae6-model-cache" (OuterVolumeSpecName: "model-cache") pod "c51702e8-8a63-42d3-b807-5a644a7afae6" (UID: "c51702e8-8a63-42d3-b807-5a644a7afae6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:03:59.510292 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:59.510244    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c51702e8-8a63-42d3-b807-5a644a7afae6-tls-certs\") pod \"c51702e8-8a63-42d3-b807-5a644a7afae6\" (UID: \"c51702e8-8a63-42d3-b807-5a644a7afae6\") "
Sep 07 04:03:59.510503 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:59.510329    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c51702e8-8a63-42d3-b807-5a644a7afae6-home" (OuterVolumeSpecName: "home") pod "c51702e8-8a63-42d3-b807-5a644a7afae6" (UID: "c51702e8-8a63-42d3-b807-5a644a7afae6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:03:59.510503 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:59.510386    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c51702e8-8a63-42d3-b807-5a644a7afae6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c51702e8-8a63-42d3-b807-5a644a7afae6" (UID: "c51702e8-8a63-42d3-b807-5a644a7afae6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:03:59.510681 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:59.510660    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c51702e8-8a63-42d3-b807-5a644a7afae6-tmp-dir\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:03:59.510746 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:59.510684    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c51702e8-8a63-42d3-b807-5a644a7afae6-model-cache\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:03:59.510746 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:59.510694    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c51702e8-8a63-42d3-b807-5a644a7afae6-home\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:03:59.512265 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:59.512238    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c51702e8-8a63-42d3-b807-5a644a7afae6-dshm" (OuterVolumeSpecName: "dshm") pod "c51702e8-8a63-42d3-b807-5a644a7afae6" (UID: "c51702e8-8a63-42d3-b807-5a644a7afae6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:03:59.512362 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:59.512293    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c51702e8-8a63-42d3-b807-5a644a7afae6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c51702e8-8a63-42d3-b807-5a644a7afae6" (UID: "c51702e8-8a63-42d3-b807-5a644a7afae6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 04:03:59.512362 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:59.512314    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c51702e8-8a63-42d3-b807-5a644a7afae6-kube-api-access-45qtc" (OuterVolumeSpecName: "kube-api-access-45qtc") pod "c51702e8-8a63-42d3-b807-5a644a7afae6" (UID: "c51702e8-8a63-42d3-b807-5a644a7afae6"). InnerVolumeSpecName "kube-api-access-45qtc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 04:03:59.611779 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:59.611748    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c51702e8-8a63-42d3-b807-5a644a7afae6-dshm\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:03:59.611779 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:59.611772    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c51702e8-8a63-42d3-b807-5a644a7afae6-tls-certs\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:03:59.611779 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:03:59.611783    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-45qtc\" (UniqueName: \"kubernetes.io/projected/c51702e8-8a63-42d3-b807-5a644a7afae6-kube-api-access-45qtc\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:04:00.387757 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:00.387723    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-860c6d/noten-model-860c6d-kserve-8fc9b7959-fd26p" event={"ID":"c51702e8-8a63-42d3-b807-5a644a7afae6","Type":"ContainerDied","Data":"2b766baf1dc598858716678ca36ab09a264a382e7ba2b69fa58bd6e4ec88893b"}
Sep 07 04:04:00.388169 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:00.387761    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-860c6d/noten-model-860c6d-kserve-8fc9b7959-fd26p"
Sep 07 04:04:00.388169 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:00.387774    2559 scope.go:117] "RemoveContainer" containerID="98c689ae5876090bf64f40d9fccd2b986efa79a87e0530a88227b9db1cbb10ee"
Sep 07 04:04:00.426035 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:00.426010    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-860c6d/noten-model-860c6d-kserve-8fc9b7959-fd26p"]
Sep 07 04:04:00.430605 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:00.430585    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-noten-860c6d/noten-model-860c6d-kserve-8fc9b7959-fd26p"]
Sep 07 04:04:01.179966 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:01.179933    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c51702e8-8a63-42d3-b807-5a644a7afae6" path="/var/lib/kubelet/pods/c51702e8-8a63-42d3-b807-5a644a7afae6/volumes"
Sep 07 04:04:04.181550 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:04.181509    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-a8da4e/test-model-a8da4e-kserve-6bc5f99d7f-mz4tt"]
Sep 07 04:04:14.696180 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:14.696144    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-1038cd-588f96c9f9-prwl4"]
Sep 07 04:04:14.696718 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:14.696404    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-1038cd-588f96c9f9-prwl4" podUID="dce7a6bf-7f71-4347-8ad3-4f95132100c5" containerName="payload-processing" containerID="cri-o://7d7efaeb6972ba9dd1c1f73f01b67905bf6f66e946968f2268304a49771513b6" gracePeriod=30
Sep 07 04:04:14.702401 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:14.702370    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-1038cd-6785489774-t66c4"]
Sep 07 04:04:14.702676 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:14.702596    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1038cd-6785489774-t66c4" podUID="9e43d079-07bb-4e1e-93bd-49c558a868f7" containerName="payload-pre-processing" containerID="cri-o://15c5b9d1b2c634d8416a7516c2b0fab9c78c52b9288c740cf051b121bf09546f" gracePeriod=30
Sep 07 04:04:14.989454 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:14.989425    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-1038cd-588f96c9f9-prwl4"
Sep 07 04:04:14.991919 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:14.991901    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1038cd-6785489774-t66c4"
Sep 07 04:04:15.058328 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:15.058292    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r2psp\" (UniqueName: \"kubernetes.io/projected/dce7a6bf-7f71-4347-8ad3-4f95132100c5-kube-api-access-r2psp\") pod \"dce7a6bf-7f71-4347-8ad3-4f95132100c5\" (UID: \"dce7a6bf-7f71-4347-8ad3-4f95132100c5\") "
Sep 07 04:04:15.058482 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:15.058341    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vknt6\" (UniqueName: \"kubernetes.io/projected/9e43d079-07bb-4e1e-93bd-49c558a868f7-kube-api-access-vknt6\") pod \"9e43d079-07bb-4e1e-93bd-49c558a868f7\" (UID: \"9e43d079-07bb-4e1e-93bd-49c558a868f7\") "
Sep 07 04:04:15.058482 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:15.058381    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e43d079-07bb-4e1e-93bd-49c558a868f7-plugins-config-volume\") pod \"9e43d079-07bb-4e1e-93bd-49c558a868f7\" (UID: \"9e43d079-07bb-4e1e-93bd-49c558a868f7\") "
Sep 07 04:04:15.058482 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:15.058413    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dce7a6bf-7f71-4347-8ad3-4f95132100c5-plugins-config-volume\") pod \"dce7a6bf-7f71-4347-8ad3-4f95132100c5\" (UID: \"dce7a6bf-7f71-4347-8ad3-4f95132100c5\") "
Sep 07 04:04:15.058837 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:15.058813    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e43d079-07bb-4e1e-93bd-49c558a868f7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9e43d079-07bb-4e1e-93bd-49c558a868f7" (UID: "9e43d079-07bb-4e1e-93bd-49c558a868f7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 04:04:15.058915 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:15.058832    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dce7a6bf-7f71-4347-8ad3-4f95132100c5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "dce7a6bf-7f71-4347-8ad3-4f95132100c5" (UID: "dce7a6bf-7f71-4347-8ad3-4f95132100c5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 04:04:15.060394 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:15.060373    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e43d079-07bb-4e1e-93bd-49c558a868f7-kube-api-access-vknt6" (OuterVolumeSpecName: "kube-api-access-vknt6") pod "9e43d079-07bb-4e1e-93bd-49c558a868f7" (UID: "9e43d079-07bb-4e1e-93bd-49c558a868f7"). InnerVolumeSpecName "kube-api-access-vknt6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 04:04:15.060498 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:15.060405    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dce7a6bf-7f71-4347-8ad3-4f95132100c5-kube-api-access-r2psp" (OuterVolumeSpecName: "kube-api-access-r2psp") pod "dce7a6bf-7f71-4347-8ad3-4f95132100c5" (UID: "dce7a6bf-7f71-4347-8ad3-4f95132100c5"). InnerVolumeSpecName "kube-api-access-r2psp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 04:04:15.160027 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:15.159994    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vknt6\" (UniqueName: \"kubernetes.io/projected/9e43d079-07bb-4e1e-93bd-49c558a868f7-kube-api-access-vknt6\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:04:15.160164 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:15.160043    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9e43d079-07bb-4e1e-93bd-49c558a868f7-plugins-config-volume\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:04:15.160164 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:15.160058    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dce7a6bf-7f71-4347-8ad3-4f95132100c5-plugins-config-volume\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:04:15.160164 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:15.160071    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r2psp\" (UniqueName: \"kubernetes.io/projected/dce7a6bf-7f71-4347-8ad3-4f95132100c5-kube-api-access-r2psp\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:04:15.475221 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:15.475189    2559 generic.go:356] "Generic (PLEG): container finished" podID="9e43d079-07bb-4e1e-93bd-49c558a868f7" containerID="15c5b9d1b2c634d8416a7516c2b0fab9c78c52b9288c740cf051b121bf09546f" exitCode=0
Sep 07 04:04:15.475401 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:15.475239    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1038cd-6785489774-t66c4"
Sep 07 04:04:15.475401 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:15.475279    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1038cd-6785489774-t66c4" event={"ID":"9e43d079-07bb-4e1e-93bd-49c558a868f7","Type":"ContainerDied","Data":"15c5b9d1b2c634d8416a7516c2b0fab9c78c52b9288c740cf051b121bf09546f"}
Sep 07 04:04:15.475401 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:15.475346    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-1038cd-6785489774-t66c4" event={"ID":"9e43d079-07bb-4e1e-93bd-49c558a868f7","Type":"ContainerDied","Data":"98401f8f97badda9413fcdac60ccb33b6724f71007fd3e5b7b3eee2c239cc25c"}
Sep 07 04:04:15.475401 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:15.475380    2559 scope.go:117] "RemoveContainer" containerID="15c5b9d1b2c634d8416a7516c2b0fab9c78c52b9288c740cf051b121bf09546f"
Sep 07 04:04:15.476684 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:15.476660    2559 generic.go:356] "Generic (PLEG): container finished" podID="dce7a6bf-7f71-4347-8ad3-4f95132100c5" containerID="7d7efaeb6972ba9dd1c1f73f01b67905bf6f66e946968f2268304a49771513b6" exitCode=0
Sep 07 04:04:15.476800 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:15.476715    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-1038cd-588f96c9f9-prwl4"
Sep 07 04:04:15.476800 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:15.476748    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-1038cd-588f96c9f9-prwl4" event={"ID":"dce7a6bf-7f71-4347-8ad3-4f95132100c5","Type":"ContainerDied","Data":"7d7efaeb6972ba9dd1c1f73f01b67905bf6f66e946968f2268304a49771513b6"}
Sep 07 04:04:15.476883 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:15.476801    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-1038cd-588f96c9f9-prwl4" event={"ID":"dce7a6bf-7f71-4347-8ad3-4f95132100c5","Type":"ContainerDied","Data":"1f9a52fc1f350dd36f3c9901f128bb35b7f3d2bdce2fe8bcb30d9ed90572b6d2"}
Sep 07 04:04:15.484524 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:15.484507    2559 scope.go:117] "RemoveContainer" containerID="15c5b9d1b2c634d8416a7516c2b0fab9c78c52b9288c740cf051b121bf09546f"
Sep 07 04:04:15.484810 ip-10-0-132-4 kubenswrapper[2559]: E0907 04:04:15.484789    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15c5b9d1b2c634d8416a7516c2b0fab9c78c52b9288c740cf051b121bf09546f\": container with ID starting with 15c5b9d1b2c634d8416a7516c2b0fab9c78c52b9288c740cf051b121bf09546f not found: ID does not exist" containerID="15c5b9d1b2c634d8416a7516c2b0fab9c78c52b9288c740cf051b121bf09546f"
Sep 07 04:04:15.484897 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:15.484817    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15c5b9d1b2c634d8416a7516c2b0fab9c78c52b9288c740cf051b121bf09546f"} err="failed to get container status \"15c5b9d1b2c634d8416a7516c2b0fab9c78c52b9288c740cf051b121bf09546f\": rpc error: code = NotFound desc = could not find container \"15c5b9d1b2c634d8416a7516c2b0fab9c78c52b9288c740cf051b121bf09546f\": container with ID starting with 15c5b9d1b2c634d8416a7516c2b0fab9c78c52b9288c740cf051b121bf09546f not found: ID does not exist"
Sep 07 04:04:15.484897 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:15.484834    2559 scope.go:117] "RemoveContainer" containerID="7d7efaeb6972ba9dd1c1f73f01b67905bf6f66e946968f2268304a49771513b6"
Sep 07 04:04:15.494014 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:15.493995    2559 scope.go:117] "RemoveContainer" containerID="7d7efaeb6972ba9dd1c1f73f01b67905bf6f66e946968f2268304a49771513b6"
Sep 07 04:04:15.494338 ip-10-0-132-4 kubenswrapper[2559]: E0907 04:04:15.494295    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d7efaeb6972ba9dd1c1f73f01b67905bf6f66e946968f2268304a49771513b6\": container with ID starting with 7d7efaeb6972ba9dd1c1f73f01b67905bf6f66e946968f2268304a49771513b6 not found: ID does not exist" containerID="7d7efaeb6972ba9dd1c1f73f01b67905bf6f66e946968f2268304a49771513b6"
Sep 07 04:04:15.494400 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:15.494345    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d7efaeb6972ba9dd1c1f73f01b67905bf6f66e946968f2268304a49771513b6"} err="failed to get container status \"7d7efaeb6972ba9dd1c1f73f01b67905bf6f66e946968f2268304a49771513b6\": rpc error: code = NotFound desc = could not find container \"7d7efaeb6972ba9dd1c1f73f01b67905bf6f66e946968f2268304a49771513b6\": container with ID starting with 7d7efaeb6972ba9dd1c1f73f01b67905bf6f66e946968f2268304a49771513b6 not found: ID does not exist"
Sep 07 04:04:15.494519 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:15.494503    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-1038cd-588f96c9f9-prwl4"]
Sep 07 04:04:15.497575 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:15.497554    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-1038cd-588f96c9f9-prwl4"]
Sep 07 04:04:15.505517 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:15.505496    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-1038cd-6785489774-t66c4"]
Sep 07 04:04:15.511593 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:15.511574    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-1038cd-6785489774-t66c4"]
Sep 07 04:04:17.180721 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:17.180686    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e43d079-07bb-4e1e-93bd-49c558a868f7" path="/var/lib/kubelet/pods/9e43d079-07bb-4e1e-93bd-49c558a868f7/volumes"
Sep 07 04:04:17.181075 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:17.181017    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dce7a6bf-7f71-4347-8ad3-4f95132100c5" path="/var/lib/kubelet/pods/dce7a6bf-7f71-4347-8ad3-4f95132100c5/volumes"
Sep 07 04:04:19.203101 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:19.203036    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-a8da4e/test-model-a8da4e-kserve-6bc5f99d7f-mz4tt" podUID="d2a83361-e10b-4f6c-979b-4d0db87d43ba" containerName="main" containerID="cri-o://f808bd4f22e07b9ad6c03b7aab7429f44a86376c5475d0291706129781751ef0" gracePeriod=45
Sep 07 04:04:19.456789 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:19.456735    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-a8da4e/test-model-a8da4e-kserve-6bc5f99d7f-mz4tt"
Sep 07 04:04:19.499651 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:19.499601    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2a83361-e10b-4f6c-979b-4d0db87d43ba-dshm\") pod \"d2a83361-e10b-4f6c-979b-4d0db87d43ba\" (UID: \"d2a83361-e10b-4f6c-979b-4d0db87d43ba\") "
Sep 07 04:04:19.499803 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:19.499670    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2a83361-e10b-4f6c-979b-4d0db87d43ba-home\") pod \"d2a83361-e10b-4f6c-979b-4d0db87d43ba\" (UID: \"d2a83361-e10b-4f6c-979b-4d0db87d43ba\") "
Sep 07 04:04:19.499803 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:19.499715    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2a83361-e10b-4f6c-979b-4d0db87d43ba-tmp-dir\") pod \"d2a83361-e10b-4f6c-979b-4d0db87d43ba\" (UID: \"d2a83361-e10b-4f6c-979b-4d0db87d43ba\") "
Sep 07 04:04:19.499803 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:19.499761    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2a83361-e10b-4f6c-979b-4d0db87d43ba-model-cache\") pod \"d2a83361-e10b-4f6c-979b-4d0db87d43ba\" (UID: \"d2a83361-e10b-4f6c-979b-4d0db87d43ba\") "
Sep 07 04:04:19.499981 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:19.499849    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x22cn\" (UniqueName: \"kubernetes.io/projected/d2a83361-e10b-4f6c-979b-4d0db87d43ba-kube-api-access-x22cn\") pod \"d2a83361-e10b-4f6c-979b-4d0db87d43ba\" (UID: \"d2a83361-e10b-4f6c-979b-4d0db87d43ba\") "
Sep 07 04:04:19.499981 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:19.499878    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2a83361-e10b-4f6c-979b-4d0db87d43ba-tls-certs\") pod \"d2a83361-e10b-4f6c-979b-4d0db87d43ba\" (UID: \"d2a83361-e10b-4f6c-979b-4d0db87d43ba\") "
Sep 07 04:04:19.500092 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:19.499960    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2a83361-e10b-4f6c-979b-4d0db87d43ba-home" (OuterVolumeSpecName: "home") pod "d2a83361-e10b-4f6c-979b-4d0db87d43ba" (UID: "d2a83361-e10b-4f6c-979b-4d0db87d43ba"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:04:19.500092 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:19.500041    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2a83361-e10b-4f6c-979b-4d0db87d43ba-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d2a83361-e10b-4f6c-979b-4d0db87d43ba" (UID: "d2a83361-e10b-4f6c-979b-4d0db87d43ba"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:04:19.500092 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:19.500057    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2a83361-e10b-4f6c-979b-4d0db87d43ba-model-cache" (OuterVolumeSpecName: "model-cache") pod "d2a83361-e10b-4f6c-979b-4d0db87d43ba" (UID: "d2a83361-e10b-4f6c-979b-4d0db87d43ba"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:04:19.500250 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:19.500214    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2a83361-e10b-4f6c-979b-4d0db87d43ba-home\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:04:19.500250 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:19.500231    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2a83361-e10b-4f6c-979b-4d0db87d43ba-tmp-dir\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:04:19.500250 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:19.500246    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2a83361-e10b-4f6c-979b-4d0db87d43ba-model-cache\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:04:19.502115 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:19.502083    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2a83361-e10b-4f6c-979b-4d0db87d43ba-dshm" (OuterVolumeSpecName: "dshm") pod "d2a83361-e10b-4f6c-979b-4d0db87d43ba" (UID: "d2a83361-e10b-4f6c-979b-4d0db87d43ba"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:04:19.502236 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:19.502182    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2a83361-e10b-4f6c-979b-4d0db87d43ba-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d2a83361-e10b-4f6c-979b-4d0db87d43ba" (UID: "d2a83361-e10b-4f6c-979b-4d0db87d43ba"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 04:04:19.502684 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:19.502661    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2a83361-e10b-4f6c-979b-4d0db87d43ba-kube-api-access-x22cn" (OuterVolumeSpecName: "kube-api-access-x22cn") pod "d2a83361-e10b-4f6c-979b-4d0db87d43ba" (UID: "d2a83361-e10b-4f6c-979b-4d0db87d43ba"). InnerVolumeSpecName "kube-api-access-x22cn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 04:04:19.502930 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:19.502905    2559 generic.go:356] "Generic (PLEG): container finished" podID="d2a83361-e10b-4f6c-979b-4d0db87d43ba" containerID="f808bd4f22e07b9ad6c03b7aab7429f44a86376c5475d0291706129781751ef0" exitCode=0
Sep 07 04:04:19.502995 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:19.502943    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-a8da4e/test-model-a8da4e-kserve-6bc5f99d7f-mz4tt"
Sep 07 04:04:19.502995 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:19.502947    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-a8da4e/test-model-a8da4e-kserve-6bc5f99d7f-mz4tt" event={"ID":"d2a83361-e10b-4f6c-979b-4d0db87d43ba","Type":"ContainerDied","Data":"f808bd4f22e07b9ad6c03b7aab7429f44a86376c5475d0291706129781751ef0"}
Sep 07 04:04:19.502995 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:19.502989    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-a8da4e/test-model-a8da4e-kserve-6bc5f99d7f-mz4tt" event={"ID":"d2a83361-e10b-4f6c-979b-4d0db87d43ba","Type":"ContainerDied","Data":"72ba4257b202e7def463bc7e1c2859016cc12d3230d09981b4092196bb3db310"}
Sep 07 04:04:19.503091 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:19.503011    2559 scope.go:117] "RemoveContainer" containerID="f808bd4f22e07b9ad6c03b7aab7429f44a86376c5475d0291706129781751ef0"
Sep 07 04:04:19.523409 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:19.523393    2559 scope.go:117] "RemoveContainer" containerID="f808bd4f22e07b9ad6c03b7aab7429f44a86376c5475d0291706129781751ef0"
Sep 07 04:04:19.523773 ip-10-0-132-4 kubenswrapper[2559]: E0907 04:04:19.523751    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f808bd4f22e07b9ad6c03b7aab7429f44a86376c5475d0291706129781751ef0\": container with ID starting with f808bd4f22e07b9ad6c03b7aab7429f44a86376c5475d0291706129781751ef0 not found: ID does not exist" containerID="f808bd4f22e07b9ad6c03b7aab7429f44a86376c5475d0291706129781751ef0"
Sep 07 04:04:19.523858 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:19.523779    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f808bd4f22e07b9ad6c03b7aab7429f44a86376c5475d0291706129781751ef0"} err="failed to get container status \"f808bd4f22e07b9ad6c03b7aab7429f44a86376c5475d0291706129781751ef0\": rpc error: code = NotFound desc = could not find container \"f808bd4f22e07b9ad6c03b7aab7429f44a86376c5475d0291706129781751ef0\": container with ID starting with f808bd4f22e07b9ad6c03b7aab7429f44a86376c5475d0291706129781751ef0 not found: ID does not exist"
Sep 07 04:04:19.532273 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:19.532251    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-a8da4e/test-model-a8da4e-kserve-6bc5f99d7f-mz4tt"]
Sep 07 04:04:19.535873 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:19.535847    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-a8da4e/test-model-a8da4e-kserve-6bc5f99d7f-mz4tt"]
Sep 07 04:04:19.601314 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:19.601290    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x22cn\" (UniqueName: \"kubernetes.io/projected/d2a83361-e10b-4f6c-979b-4d0db87d43ba-kube-api-access-x22cn\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:04:19.601314 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:19.601313    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2a83361-e10b-4f6c-979b-4d0db87d43ba-tls-certs\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:04:19.601442 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:19.601326    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2a83361-e10b-4f6c-979b-4d0db87d43ba-dshm\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:04:21.128871 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:21.128838    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6"]
Sep 07 04:04:21.129350 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:21.129111    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6" podUID="6baa400b-c2af-4549-a34d-c1e4bc37bf8e" containerName="istio-proxy" containerID="cri-o://6a529da645ee5659188edac29298cf541ed34e473d02c48e64d5a60c57393543" gracePeriod=30
Sep 07 04:04:21.179813 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:21.179772    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2a83361-e10b-4f6c-979b-4d0db87d43ba" path="/var/lib/kubelet/pods/d2a83361-e10b-4f6c-979b-4d0db87d43ba/volumes"
Sep 07 04:04:21.465775 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:21.465690    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a8da4e-vgzzx"]
Sep 07 04:04:21.466242 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:21.466211    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2a83361-e10b-4f6c-979b-4d0db87d43ba" containerName="main"
Sep 07 04:04:21.466242 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:21.466238    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2a83361-e10b-4f6c-979b-4d0db87d43ba" containerName="main"
Sep 07 04:04:21.466242 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:21.466246    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c51702e8-8a63-42d3-b807-5a644a7afae6" containerName="main"
Sep 07 04:04:21.466242 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:21.466251    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c51702e8-8a63-42d3-b807-5a644a7afae6" containerName="main"
Sep 07 04:04:21.466540 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:21.466272    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e43d079-07bb-4e1e-93bd-49c558a868f7" containerName="payload-pre-processing"
Sep 07 04:04:21.466540 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:21.466278    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e43d079-07bb-4e1e-93bd-49c558a868f7" containerName="payload-pre-processing"
Sep 07 04:04:21.466540 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:21.466286    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dce7a6bf-7f71-4347-8ad3-4f95132100c5" containerName="payload-processing"
Sep 07 04:04:21.466540 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:21.466293    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="dce7a6bf-7f71-4347-8ad3-4f95132100c5" containerName="payload-processing"
Sep 07 04:04:21.466540 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:21.466350    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2a83361-e10b-4f6c-979b-4d0db87d43ba" containerName="main"
Sep 07 04:04:21.466540 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:21.466359    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="dce7a6bf-7f71-4347-8ad3-4f95132100c5" containerName="payload-processing"
Sep 07 04:04:21.466540 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:21.466369    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e43d079-07bb-4e1e-93bd-49c558a868f7" containerName="payload-pre-processing"
Sep 07 04:04:21.466540 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:21.466376    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c51702e8-8a63-42d3-b807-5a644a7afae6" containerName="main"
Sep 07 04:04:21.470860 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:21.470841    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a8da4e-vgzzx"
Sep 07 04:04:21.472757 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:21.472737    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 07 04:04:21.472932 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:21.472914    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zs4ff\""
Sep 07 04:04:21.479431 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:21.479408    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a8da4e-vgzzx"]
Sep 07 04:04:21.519999 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:21.519971    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1768ef6b-9f2b-44f6-bc0f-ae5e228852e5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-a8da4e-vgzzx\" (UID: \"1768ef6b-9f2b-44f6-bc0f-ae5e228852e5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a8da4e-vgzzx"
Sep 07 04:04:21.621486 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:21.621447    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1768ef6b-9f2b-44f6-bc0f-ae5e228852e5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-a8da4e-vgzzx\" (UID: \"1768ef6b-9f2b-44f6-bc0f-ae5e228852e5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a8da4e-vgzzx"
Sep 07 04:04:21.622062 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:21.622043    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1768ef6b-9f2b-44f6-bc0f-ae5e228852e5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-a8da4e-vgzzx\" (UID: \"1768ef6b-9f2b-44f6-bc0f-ae5e228852e5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a8da4e-vgzzx"
Sep 07 04:04:21.786738 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:21.786638    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a8da4e-vgzzx"
Sep 07 04:04:22.055144 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:22.055120    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a8da4e-vgzzx"]
Sep 07 04:04:22.057073 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:04:22.057046    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1768ef6b_9f2b_44f6_bc0f_ae5e228852e5.slice/crio-a8c367a42a8f81aa1c92f2e46bd6d6784cc4ac311836b105ac5338dbf5c4961c WatchSource:0}: Error finding container a8c367a42a8f81aa1c92f2e46bd6d6784cc4ac311836b105ac5338dbf5c4961c: Status 404 returned error can't find the container with id a8c367a42a8f81aa1c92f2e46bd6d6784cc4ac311836b105ac5338dbf5c4961c
Sep 07 04:04:22.522694 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:22.522655    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a8da4e-vgzzx" event={"ID":"1768ef6b-9f2b-44f6-bc0f-ae5e228852e5","Type":"ContainerStarted","Data":"5d0841f9a6f8436bc26a8057b8d708d696f0f3660d9b8cde95450821422951b9"}
Sep 07 04:04:22.523072 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:22.522712    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a8da4e-vgzzx" event={"ID":"1768ef6b-9f2b-44f6-bc0f-ae5e228852e5","Type":"ContainerStarted","Data":"a8c367a42a8f81aa1c92f2e46bd6d6784cc4ac311836b105ac5338dbf5c4961c"}
Sep 07 04:04:22.537766 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:22.537724    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a8da4e-vgzzx" podStartSLOduration=1.537708219 podStartE2EDuration="1.537708219s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:04:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:04:22.53557867 +0000 UTC m=+965.848054572" watchObservedRunningTime="2026-09-07 04:04:22.537708219 +0000 UTC m=+965.850184120"
Sep 07 04:04:23.529349 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:23.529312    2559 generic.go:356] "Generic (PLEG): container finished" podID="1768ef6b-9f2b-44f6-bc0f-ae5e228852e5" containerID="5d0841f9a6f8436bc26a8057b8d708d696f0f3660d9b8cde95450821422951b9" exitCode=0
Sep 07 04:04:23.529816 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:23.529382    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a8da4e-vgzzx" event={"ID":"1768ef6b-9f2b-44f6-bc0f-ae5e228852e5","Type":"ContainerDied","Data":"5d0841f9a6f8436bc26a8057b8d708d696f0f3660d9b8cde95450821422951b9"}
Sep 07 04:04:24.660769 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:24.660747    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a8da4e-vgzzx"
Sep 07 04:04:24.749291 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:24.749262    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1768ef6b-9f2b-44f6-bc0f-ae5e228852e5-maas-api-service-ca\") pod \"1768ef6b-9f2b-44f6-bc0f-ae5e228852e5\" (UID: \"1768ef6b-9f2b-44f6-bc0f-ae5e228852e5\") "
Sep 07 04:04:24.749580 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:24.749558    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1768ef6b-9f2b-44f6-bc0f-ae5e228852e5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1768ef6b-9f2b-44f6-bc0f-ae5e228852e5" (UID: "1768ef6b-9f2b-44f6-bc0f-ae5e228852e5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 04:04:24.850715 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:24.850648    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1768ef6b-9f2b-44f6-bc0f-ae5e228852e5-maas-api-service-ca\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:04:25.542059 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:25.541980    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a8da4e-vgzzx"
Sep 07 04:04:25.542059 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:25.542000    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a8da4e-vgzzx" event={"ID":"1768ef6b-9f2b-44f6-bc0f-ae5e228852e5","Type":"ContainerDied","Data":"a8c367a42a8f81aa1c92f2e46bd6d6784cc4ac311836b105ac5338dbf5c4961c"}
Sep 07 04:04:25.542059 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:25.542050    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a8c367a42a8f81aa1c92f2e46bd6d6784cc4ac311836b105ac5338dbf5c4961c"
Sep 07 04:04:26.375658 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:26.375633    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6"
Sep 07 04:04:26.465265 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:26.465204    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6baa400b-c2af-4549-a34d-c1e4bc37bf8e-istio-data\") pod \"6baa400b-c2af-4549-a34d-c1e4bc37bf8e\" (UID: \"6baa400b-c2af-4549-a34d-c1e4bc37bf8e\") "
Sep 07 04:04:26.465265 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:26.465234    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6baa400b-c2af-4549-a34d-c1e4bc37bf8e-workload-socket\") pod \"6baa400b-c2af-4549-a34d-c1e4bc37bf8e\" (UID: \"6baa400b-c2af-4549-a34d-c1e4bc37bf8e\") "
Sep 07 04:04:26.465265 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:26.465263    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6baa400b-c2af-4549-a34d-c1e4bc37bf8e-istio-podinfo\") pod \"6baa400b-c2af-4549-a34d-c1e4bc37bf8e\" (UID: \"6baa400b-c2af-4549-a34d-c1e4bc37bf8e\") "
Sep 07 04:04:26.465482 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:26.465301    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6baa400b-c2af-4549-a34d-c1e4bc37bf8e-istiod-ca-cert\") pod \"6baa400b-c2af-4549-a34d-c1e4bc37bf8e\" (UID: \"6baa400b-c2af-4549-a34d-c1e4bc37bf8e\") "
Sep 07 04:04:26.465482 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:26.465319    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6baa400b-c2af-4549-a34d-c1e4bc37bf8e-istio-token\") pod \"6baa400b-c2af-4549-a34d-c1e4bc37bf8e\" (UID: \"6baa400b-c2af-4549-a34d-c1e4bc37bf8e\") "
Sep 07 04:04:26.465482 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:26.465342    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6baa400b-c2af-4549-a34d-c1e4bc37bf8e-workload-certs\") pod \"6baa400b-c2af-4549-a34d-c1e4bc37bf8e\" (UID: \"6baa400b-c2af-4549-a34d-c1e4bc37bf8e\") "
Sep 07 04:04:26.465482 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:26.465381    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fntql\" (UniqueName: \"kubernetes.io/projected/6baa400b-c2af-4549-a34d-c1e4bc37bf8e-kube-api-access-fntql\") pod \"6baa400b-c2af-4549-a34d-c1e4bc37bf8e\" (UID: \"6baa400b-c2af-4549-a34d-c1e4bc37bf8e\") "
Sep 07 04:04:26.465482 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:26.465406    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6baa400b-c2af-4549-a34d-c1e4bc37bf8e-istio-envoy\") pod \"6baa400b-c2af-4549-a34d-c1e4bc37bf8e\" (UID: \"6baa400b-c2af-4549-a34d-c1e4bc37bf8e\") "
Sep 07 04:04:26.465482 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:26.465435    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6baa400b-c2af-4549-a34d-c1e4bc37bf8e-credential-socket\") pod \"6baa400b-c2af-4549-a34d-c1e4bc37bf8e\" (UID: \"6baa400b-c2af-4549-a34d-c1e4bc37bf8e\") "
Sep 07 04:04:26.465804 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:26.465517    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6baa400b-c2af-4549-a34d-c1e4bc37bf8e-istio-data" (OuterVolumeSpecName: "istio-data") pod "6baa400b-c2af-4549-a34d-c1e4bc37bf8e" (UID: "6baa400b-c2af-4549-a34d-c1e4bc37bf8e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:04:26.465804 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:26.465711    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6baa400b-c2af-4549-a34d-c1e4bc37bf8e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6baa400b-c2af-4549-a34d-c1e4bc37bf8e" (UID: "6baa400b-c2af-4549-a34d-c1e4bc37bf8e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 04:04:26.465804 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:26.465530    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6baa400b-c2af-4549-a34d-c1e4bc37bf8e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6baa400b-c2af-4549-a34d-c1e4bc37bf8e" (UID: "6baa400b-c2af-4549-a34d-c1e4bc37bf8e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:04:26.465975 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:26.465801    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6baa400b-c2af-4549-a34d-c1e4bc37bf8e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6baa400b-c2af-4549-a34d-c1e4bc37bf8e" (UID: "6baa400b-c2af-4549-a34d-c1e4bc37bf8e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:04:26.465975 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:26.465813    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6baa400b-c2af-4549-a34d-c1e4bc37bf8e-istio-data\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:04:26.465975 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:26.465834    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6baa400b-c2af-4549-a34d-c1e4bc37bf8e-workload-socket\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:04:26.465975 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:26.465854    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6baa400b-c2af-4549-a34d-c1e4bc37bf8e-istiod-ca-cert\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:04:26.465975 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:26.465858    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6baa400b-c2af-4549-a34d-c1e4bc37bf8e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6baa400b-c2af-4549-a34d-c1e4bc37bf8e" (UID: "6baa400b-c2af-4549-a34d-c1e4bc37bf8e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:04:26.467726 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:26.467696    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6baa400b-c2af-4549-a34d-c1e4bc37bf8e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6baa400b-c2af-4549-a34d-c1e4bc37bf8e" (UID: "6baa400b-c2af-4549-a34d-c1e4bc37bf8e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:04:26.467726 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:26.467720    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6baa400b-c2af-4549-a34d-c1e4bc37bf8e-istio-token" (OuterVolumeSpecName: "istio-token") pod "6baa400b-c2af-4549-a34d-c1e4bc37bf8e" (UID: "6baa400b-c2af-4549-a34d-c1e4bc37bf8e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 04:04:26.467994 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:26.467973    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6baa400b-c2af-4549-a34d-c1e4bc37bf8e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6baa400b-c2af-4549-a34d-c1e4bc37bf8e" (UID: "6baa400b-c2af-4549-a34d-c1e4bc37bf8e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 04:04:26.468067 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:26.467990    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6baa400b-c2af-4549-a34d-c1e4bc37bf8e-kube-api-access-fntql" (OuterVolumeSpecName: "kube-api-access-fntql") pod "6baa400b-c2af-4549-a34d-c1e4bc37bf8e" (UID: "6baa400b-c2af-4549-a34d-c1e4bc37bf8e"). InnerVolumeSpecName "kube-api-access-fntql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 04:04:26.549205 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:26.549173    2559 generic.go:356] "Generic (PLEG): container finished" podID="6baa400b-c2af-4549-a34d-c1e4bc37bf8e" containerID="6a529da645ee5659188edac29298cf541ed34e473d02c48e64d5a60c57393543" exitCode=0
Sep 07 04:04:26.549372 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:26.549228    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6"
Sep 07 04:04:26.549372 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:26.549258    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6" event={"ID":"6baa400b-c2af-4549-a34d-c1e4bc37bf8e","Type":"ContainerDied","Data":"6a529da645ee5659188edac29298cf541ed34e473d02c48e64d5a60c57393543"}
Sep 07 04:04:26.549372 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:26.549311    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6" event={"ID":"6baa400b-c2af-4549-a34d-c1e4bc37bf8e","Type":"ContainerDied","Data":"d0b8c14562c8961e56f4c23969700e50b1beb44b0e4444f4092c260ea7e92ead"}
Sep 07 04:04:26.549372 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:26.549323    2559 scope.go:117] "RemoveContainer" containerID="6a529da645ee5659188edac29298cf541ed34e473d02c48e64d5a60c57393543"
Sep 07 04:04:26.559252 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:26.559237    2559 scope.go:117] "RemoveContainer" containerID="d2b9edf7513f901b6267868c4bac16503f4796b7f5bf80c707f2e227548daeae"
Sep 07 04:04:26.566677 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:26.566655    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6baa400b-c2af-4549-a34d-c1e4bc37bf8e-istio-podinfo\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:04:26.566677 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:26.566677    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6baa400b-c2af-4549-a34d-c1e4bc37bf8e-istio-token\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:04:26.566811 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:26.566686    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6baa400b-c2af-4549-a34d-c1e4bc37bf8e-workload-certs\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:04:26.566811 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:26.566694    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fntql\" (UniqueName: \"kubernetes.io/projected/6baa400b-c2af-4549-a34d-c1e4bc37bf8e-kube-api-access-fntql\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:04:26.566811 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:26.566704    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6baa400b-c2af-4549-a34d-c1e4bc37bf8e-istio-envoy\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:04:26.566811 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:26.566713    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6baa400b-c2af-4549-a34d-c1e4bc37bf8e-credential-socket\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:04:26.567092 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:26.567073    2559 scope.go:117] "RemoveContainer" containerID="6a529da645ee5659188edac29298cf541ed34e473d02c48e64d5a60c57393543"
Sep 07 04:04:26.567341 ip-10-0-132-4 kubenswrapper[2559]: E0907 04:04:26.567323    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a529da645ee5659188edac29298cf541ed34e473d02c48e64d5a60c57393543\": container with ID starting with 6a529da645ee5659188edac29298cf541ed34e473d02c48e64d5a60c57393543 not found: ID does not exist" containerID="6a529da645ee5659188edac29298cf541ed34e473d02c48e64d5a60c57393543"
Sep 07 04:04:26.567385 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:26.567349    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a529da645ee5659188edac29298cf541ed34e473d02c48e64d5a60c57393543"} err="failed to get container status \"6a529da645ee5659188edac29298cf541ed34e473d02c48e64d5a60c57393543\": rpc error: code = NotFound desc = could not find container \"6a529da645ee5659188edac29298cf541ed34e473d02c48e64d5a60c57393543\": container with ID starting with 6a529da645ee5659188edac29298cf541ed34e473d02c48e64d5a60c57393543 not found: ID does not exist"
Sep 07 04:04:26.567385 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:26.567365    2559 scope.go:117] "RemoveContainer" containerID="d2b9edf7513f901b6267868c4bac16503f4796b7f5bf80c707f2e227548daeae"
Sep 07 04:04:26.567597 ip-10-0-132-4 kubenswrapper[2559]: E0907 04:04:26.567582    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2b9edf7513f901b6267868c4bac16503f4796b7f5bf80c707f2e227548daeae\": container with ID starting with d2b9edf7513f901b6267868c4bac16503f4796b7f5bf80c707f2e227548daeae not found: ID does not exist" containerID="d2b9edf7513f901b6267868c4bac16503f4796b7f5bf80c707f2e227548daeae"
Sep 07 04:04:26.567676 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:26.567600    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2b9edf7513f901b6267868c4bac16503f4796b7f5bf80c707f2e227548daeae"} err="failed to get container status \"d2b9edf7513f901b6267868c4bac16503f4796b7f5bf80c707f2e227548daeae\": rpc error: code = NotFound desc = could not find container \"d2b9edf7513f901b6267868c4bac16503f4796b7f5bf80c707f2e227548daeae\": container with ID starting with d2b9edf7513f901b6267868c4bac16503f4796b7f5bf80c707f2e227548daeae not found: ID does not exist"
Sep 07 04:04:26.572477 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:26.572456    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6"]
Sep 07 04:04:26.576185 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:26.576161    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6"]
Sep 07 04:04:27.180119 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:27.180085    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6baa400b-c2af-4549-a34d-c1e4bc37bf8e" path="/var/lib/kubelet/pods/6baa400b-c2af-4549-a34d-c1e4bc37bf8e/volumes"
Sep 07 04:04:32.028868 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:32.028781    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-a8da4e-fc4ffddfd-5zzgm"]
Sep 07 04:04:32.029380 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:32.029165    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a8da4e-fc4ffddfd-5zzgm" podUID="345e7985-1b37-4162-8e1a-6fe74836c9c1" containerName="payload-pre-processing" containerID="cri-o://fbf48feed7adc0539809cc72806ba9b287c692f07dac78bc60d8c65af878a2c4" gracePeriod=30
Sep 07 04:04:32.147054 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:32.147001    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a8da4e-fc4ffddfd-5zzgm" podUID="345e7985-1b37-4162-8e1a-6fe74836c9c1" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.133.0.51:9004: connect: connection refused"
Sep 07 04:04:32.163086 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:32.163057    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a8da4e-vgzzx"]
Sep 07 04:04:32.166744 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:32.166710    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a8da4e-vgzzx"]
Sep 07 04:04:32.288142 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:32.288071    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a8da4e-fc4ffddfd-5zzgm"
Sep 07 04:04:32.417047 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:32.417018    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/345e7985-1b37-4162-8e1a-6fe74836c9c1-plugins-config-volume\") pod \"345e7985-1b37-4162-8e1a-6fe74836c9c1\" (UID: \"345e7985-1b37-4162-8e1a-6fe74836c9c1\") "
Sep 07 04:04:32.417233 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:32.417072    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b4nm8\" (UniqueName: \"kubernetes.io/projected/345e7985-1b37-4162-8e1a-6fe74836c9c1-kube-api-access-b4nm8\") pod \"345e7985-1b37-4162-8e1a-6fe74836c9c1\" (UID: \"345e7985-1b37-4162-8e1a-6fe74836c9c1\") "
Sep 07 04:04:32.417365 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:32.417343    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/345e7985-1b37-4162-8e1a-6fe74836c9c1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "345e7985-1b37-4162-8e1a-6fe74836c9c1" (UID: "345e7985-1b37-4162-8e1a-6fe74836c9c1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 04:04:32.419092 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:32.419067    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/345e7985-1b37-4162-8e1a-6fe74836c9c1-kube-api-access-b4nm8" (OuterVolumeSpecName: "kube-api-access-b4nm8") pod "345e7985-1b37-4162-8e1a-6fe74836c9c1" (UID: "345e7985-1b37-4162-8e1a-6fe74836c9c1"). InnerVolumeSpecName "kube-api-access-b4nm8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 04:04:32.518518 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:32.518495    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/345e7985-1b37-4162-8e1a-6fe74836c9c1-plugins-config-volume\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:04:32.518518 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:32.518515    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b4nm8\" (UniqueName: \"kubernetes.io/projected/345e7985-1b37-4162-8e1a-6fe74836c9c1-kube-api-access-b4nm8\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:04:32.587396 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:32.587331    2559 generic.go:356] "Generic (PLEG): container finished" podID="345e7985-1b37-4162-8e1a-6fe74836c9c1" containerID="fbf48feed7adc0539809cc72806ba9b287c692f07dac78bc60d8c65af878a2c4" exitCode=0
Sep 07 04:04:32.587396 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:32.587378    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a8da4e-fc4ffddfd-5zzgm"
Sep 07 04:04:32.587562 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:32.587419    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a8da4e-fc4ffddfd-5zzgm" event={"ID":"345e7985-1b37-4162-8e1a-6fe74836c9c1","Type":"ContainerDied","Data":"fbf48feed7adc0539809cc72806ba9b287c692f07dac78bc60d8c65af878a2c4"}
Sep 07 04:04:32.587562 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:32.587475    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a8da4e-fc4ffddfd-5zzgm" event={"ID":"345e7985-1b37-4162-8e1a-6fe74836c9c1","Type":"ContainerDied","Data":"9090730df847b16e6ed9f52209bb43893de8a621ec1195bc86181ddb07509eec"}
Sep 07 04:04:32.587562 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:32.587504    2559 scope.go:117] "RemoveContainer" containerID="fbf48feed7adc0539809cc72806ba9b287c692f07dac78bc60d8c65af878a2c4"
Sep 07 04:04:32.596960 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:32.596941    2559 scope.go:117] "RemoveContainer" containerID="fbf48feed7adc0539809cc72806ba9b287c692f07dac78bc60d8c65af878a2c4"
Sep 07 04:04:32.597208 ip-10-0-132-4 kubenswrapper[2559]: E0907 04:04:32.597188    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbf48feed7adc0539809cc72806ba9b287c692f07dac78bc60d8c65af878a2c4\": container with ID starting with fbf48feed7adc0539809cc72806ba9b287c692f07dac78bc60d8c65af878a2c4 not found: ID does not exist" containerID="fbf48feed7adc0539809cc72806ba9b287c692f07dac78bc60d8c65af878a2c4"
Sep 07 04:04:32.597272 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:32.597219    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbf48feed7adc0539809cc72806ba9b287c692f07dac78bc60d8c65af878a2c4"} err="failed to get container status \"fbf48feed7adc0539809cc72806ba9b287c692f07dac78bc60d8c65af878a2c4\": rpc error: code = NotFound desc = could not find container \"fbf48feed7adc0539809cc72806ba9b287c692f07dac78bc60d8c65af878a2c4\": container with ID starting with fbf48feed7adc0539809cc72806ba9b287c692f07dac78bc60d8c65af878a2c4 not found: ID does not exist"
Sep 07 04:04:32.608555 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:32.608533    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-a8da4e-fc4ffddfd-5zzgm"]
Sep 07 04:04:32.615187 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:32.615152    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-a8da4e-fc4ffddfd-5zzgm"]
Sep 07 04:04:33.179308 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:33.179276    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1768ef6b-9f2b-44f6-bc0f-ae5e228852e5" path="/var/lib/kubelet/pods/1768ef6b-9f2b-44f6-bc0f-ae5e228852e5/volumes"
Sep 07 04:04:33.179651 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:33.179615    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="345e7985-1b37-4162-8e1a-6fe74836c9c1" path="/var/lib/kubelet/pods/345e7985-1b37-4162-8e1a-6fe74836c9c1/volumes"
Sep 07 04:04:33.321932 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:33.321902    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9"]
Sep 07 04:04:33.322239 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:33.322226    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6baa400b-c2af-4549-a34d-c1e4bc37bf8e" containerName="istio-proxy"
Sep 07 04:04:33.322239 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:33.322240    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6baa400b-c2af-4549-a34d-c1e4bc37bf8e" containerName="istio-proxy"
Sep 07 04:04:33.322389 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:33.322248    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6baa400b-c2af-4549-a34d-c1e4bc37bf8e" containerName="istio-proxy"
Sep 07 04:04:33.322389 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:33.322254    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6baa400b-c2af-4549-a34d-c1e4bc37bf8e" containerName="istio-proxy"
Sep 07 04:04:33.322389 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:33.322266    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="345e7985-1b37-4162-8e1a-6fe74836c9c1" containerName="payload-pre-processing"
Sep 07 04:04:33.322389 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:33.322272    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="345e7985-1b37-4162-8e1a-6fe74836c9c1" containerName="payload-pre-processing"
Sep 07 04:04:33.322389 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:33.322280    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1768ef6b-9f2b-44f6-bc0f-ae5e228852e5" containerName="revoke-keys"
Sep 07 04:04:33.322389 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:33.322285    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1768ef6b-9f2b-44f6-bc0f-ae5e228852e5" containerName="revoke-keys"
Sep 07 04:04:33.322389 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:33.322346    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="345e7985-1b37-4162-8e1a-6fe74836c9c1" containerName="payload-pre-processing"
Sep 07 04:04:33.322389 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:33.322354    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1768ef6b-9f2b-44f6-bc0f-ae5e228852e5" containerName="revoke-keys"
Sep 07 04:04:33.322389 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:33.322362    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6baa400b-c2af-4549-a34d-c1e4bc37bf8e" containerName="istio-proxy"
Sep 07 04:04:33.326677 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:33.326656    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9"
Sep 07 04:04:33.328778 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:33.328752    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-a5a838b2-openshift-default-dockercfg-lsm2b\""
Sep 07 04:04:33.339490 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:33.339466    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9"]
Sep 07 04:04:33.426055 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:33.426026    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a36e0d0-6bd7-402a-b195-bd3819c6e507-workload-socket\") pod \"e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9\" (UID: \"0a36e0d0-6bd7-402a-b195-bd3819c6e507\") " pod="openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9"
Sep 07 04:04:33.426200 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:33.426058    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh4gd\" (UniqueName: \"kubernetes.io/projected/0a36e0d0-6bd7-402a-b195-bd3819c6e507-kube-api-access-wh4gd\") pod \"e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9\" (UID: \"0a36e0d0-6bd7-402a-b195-bd3819c6e507\") " pod="openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9"
Sep 07 04:04:33.426200 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:33.426078    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a36e0d0-6bd7-402a-b195-bd3819c6e507-workload-certs\") pod \"e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9\" (UID: \"0a36e0d0-6bd7-402a-b195-bd3819c6e507\") " pod="openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9"
Sep 07 04:04:33.426200 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:33.426104    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a36e0d0-6bd7-402a-b195-bd3819c6e507-istiod-ca-cert\") pod \"e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9\" (UID: \"0a36e0d0-6bd7-402a-b195-bd3819c6e507\") " pod="openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9"
Sep 07 04:04:33.426326 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:33.426229    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a36e0d0-6bd7-402a-b195-bd3819c6e507-istio-token\") pod \"e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9\" (UID: \"0a36e0d0-6bd7-402a-b195-bd3819c6e507\") " pod="openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9"
Sep 07 04:04:33.426326 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:33.426268    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a36e0d0-6bd7-402a-b195-bd3819c6e507-credential-socket\") pod \"e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9\" (UID: \"0a36e0d0-6bd7-402a-b195-bd3819c6e507\") " pod="openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9"
Sep 07 04:04:33.426326 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:33.426318    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a36e0d0-6bd7-402a-b195-bd3819c6e507-istio-podinfo\") pod \"e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9\" (UID: \"0a36e0d0-6bd7-402a-b195-bd3819c6e507\") " pod="openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9"
Sep 07 04:04:33.426459 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:33.426361    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a36e0d0-6bd7-402a-b195-bd3819c6e507-istio-envoy\") pod \"e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9\" (UID: \"0a36e0d0-6bd7-402a-b195-bd3819c6e507\") " pod="openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9"
Sep 07 04:04:33.426459 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:33.426404    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a36e0d0-6bd7-402a-b195-bd3819c6e507-istio-data\") pod \"e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9\" (UID: \"0a36e0d0-6bd7-402a-b195-bd3819c6e507\") " pod="openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9"
Sep 07 04:04:33.526955 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:33.526884    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a36e0d0-6bd7-402a-b195-bd3819c6e507-workload-socket\") pod \"e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9\" (UID: \"0a36e0d0-6bd7-402a-b195-bd3819c6e507\") " pod="openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9"
Sep 07 04:04:33.526955 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:33.526915    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh4gd\" (UniqueName: \"kubernetes.io/projected/0a36e0d0-6bd7-402a-b195-bd3819c6e507-kube-api-access-wh4gd\") pod \"e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9\" (UID: \"0a36e0d0-6bd7-402a-b195-bd3819c6e507\") " pod="openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9"
Sep 07 04:04:33.526955 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:33.526933    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a36e0d0-6bd7-402a-b195-bd3819c6e507-workload-certs\") pod \"e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9\" (UID: \"0a36e0d0-6bd7-402a-b195-bd3819c6e507\") " pod="openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9"
Sep 07 04:04:33.527198 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:33.527044    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a36e0d0-6bd7-402a-b195-bd3819c6e507-istiod-ca-cert\") pod \"e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9\" (UID: \"0a36e0d0-6bd7-402a-b195-bd3819c6e507\") " pod="openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9"
Sep 07 04:04:33.527198 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:33.527131    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a36e0d0-6bd7-402a-b195-bd3819c6e507-istio-token\") pod \"e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9\" (UID: \"0a36e0d0-6bd7-402a-b195-bd3819c6e507\") " pod="openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9"
Sep 07 04:04:33.527198 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:33.527161    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a36e0d0-6bd7-402a-b195-bd3819c6e507-credential-socket\") pod \"e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9\" (UID: \"0a36e0d0-6bd7-402a-b195-bd3819c6e507\") " pod="openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9"
Sep 07 04:04:33.527364 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:33.527197    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a36e0d0-6bd7-402a-b195-bd3819c6e507-workload-socket\") pod \"e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9\" (UID: \"0a36e0d0-6bd7-402a-b195-bd3819c6e507\") " pod="openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9"
Sep 07 04:04:33.527364 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:33.527199    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a36e0d0-6bd7-402a-b195-bd3819c6e507-istio-podinfo\") pod \"e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9\" (UID: \"0a36e0d0-6bd7-402a-b195-bd3819c6e507\") " pod="openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9"
Sep 07 04:04:33.527364 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:33.527231    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a36e0d0-6bd7-402a-b195-bd3819c6e507-workload-certs\") pod \"e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9\" (UID: \"0a36e0d0-6bd7-402a-b195-bd3819c6e507\") " pod="openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9"
Sep 07 04:04:33.527364 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:33.527268    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a36e0d0-6bd7-402a-b195-bd3819c6e507-istio-envoy\") pod \"e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9\" (UID: \"0a36e0d0-6bd7-402a-b195-bd3819c6e507\") " pod="openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9"
Sep 07 04:04:33.527364 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:33.527306    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a36e0d0-6bd7-402a-b195-bd3819c6e507-istio-data\") pod \"e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9\" (UID: \"0a36e0d0-6bd7-402a-b195-bd3819c6e507\") " pod="openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9"
Sep 07 04:04:33.527611 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:33.527452    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a36e0d0-6bd7-402a-b195-bd3819c6e507-credential-socket\") pod \"e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9\" (UID: \"0a36e0d0-6bd7-402a-b195-bd3819c6e507\") " pod="openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9"
Sep 07 04:04:33.527701 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:33.527658    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a36e0d0-6bd7-402a-b195-bd3819c6e507-istio-data\") pod \"e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9\" (UID: \"0a36e0d0-6bd7-402a-b195-bd3819c6e507\") " pod="openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9"
Sep 07 04:04:33.527813 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:33.527792    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a36e0d0-6bd7-402a-b195-bd3819c6e507-istiod-ca-cert\") pod \"e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9\" (UID: \"0a36e0d0-6bd7-402a-b195-bd3819c6e507\") " pod="openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9"
Sep 07 04:04:33.529280 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:33.529259    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a36e0d0-6bd7-402a-b195-bd3819c6e507-istio-envoy\") pod \"e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9\" (UID: \"0a36e0d0-6bd7-402a-b195-bd3819c6e507\") " pod="openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9"
Sep 07 04:04:33.529599 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:33.529581    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a36e0d0-6bd7-402a-b195-bd3819c6e507-istio-podinfo\") pod \"e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9\" (UID: \"0a36e0d0-6bd7-402a-b195-bd3819c6e507\") " pod="openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9"
Sep 07 04:04:33.541536 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:33.541518    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh4gd\" (UniqueName: \"kubernetes.io/projected/0a36e0d0-6bd7-402a-b195-bd3819c6e507-kube-api-access-wh4gd\") pod \"e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9\" (UID: \"0a36e0d0-6bd7-402a-b195-bd3819c6e507\") " pod="openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9"
Sep 07 04:04:33.544864 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:33.544842    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a36e0d0-6bd7-402a-b195-bd3819c6e507-istio-token\") pod \"e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9\" (UID: \"0a36e0d0-6bd7-402a-b195-bd3819c6e507\") " pod="openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9"
Sep 07 04:04:33.637094 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:33.637071    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9"
Sep 07 04:04:33.911515 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:33.911487    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9"]
Sep 07 04:04:33.913167 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:04:33.913140    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a36e0d0_6bd7_402a_b195_bd3819c6e507.slice/crio-a244b50a566bcc6ede19367a5fa142f9e77f8743ba615d9ec298a96ec970ccdf WatchSource:0}: Error finding container a244b50a566bcc6ede19367a5fa142f9e77f8743ba615d9ec298a96ec970ccdf: Status 404 returned error can't find the container with id a244b50a566bcc6ede19367a5fa142f9e77f8743ba615d9ec298a96ec970ccdf
Sep 07 04:04:33.915373 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:33.915339    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 04:04:33.915432 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:33.915405    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 04:04:33.915476 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:33.915432    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 04:04:34.600727 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:34.600692    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9" event={"ID":"0a36e0d0-6bd7-402a-b195-bd3819c6e507","Type":"ContainerStarted","Data":"db9a992342a500244d856daa385db32ed4916c7ee9d509161dd503cbcbbae658"}
Sep 07 04:04:34.601090 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:34.600750    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9" event={"ID":"0a36e0d0-6bd7-402a-b195-bd3819c6e507","Type":"ContainerStarted","Data":"a244b50a566bcc6ede19367a5fa142f9e77f8743ba615d9ec298a96ec970ccdf"}
Sep 07 04:04:34.618556 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:34.618501    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9" podStartSLOduration=1.6184819959999999 podStartE2EDuration="1.618481996s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:04:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:04:34.617435274 +0000 UTC m=+977.929911187" watchObservedRunningTime="2026-09-07 04:04:34.618481996 +0000 UTC m=+977.930957900"
Sep 07 04:04:34.637756 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:34.637736    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9"
Sep 07 04:04:34.642360 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:34.642342    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9"
Sep 07 04:04:35.606154 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:35.606122    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9"
Sep 07 04:04:35.607179 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:35.607156    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9"
Sep 07 04:04:38.314438 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:38.314401    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a5a838b2-86cdc6b678-zgdvs"]
Sep 07 04:04:38.315016 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:38.314995    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6baa400b-c2af-4549-a34d-c1e4bc37bf8e" containerName="istio-proxy"
Sep 07 04:04:38.318040 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:38.318019    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a5a838b2-86cdc6b678-zgdvs"
Sep 07 04:04:38.320299 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:38.320273    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-a5a838b2-dockercfg-t79g2\""
Sep 07 04:04:38.320408 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:38.320277    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-a5a838b2\""
Sep 07 04:04:38.326743 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:38.326723    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a5a838b2-86cdc6b678-zgdvs"]
Sep 07 04:04:38.347588 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:38.347561    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a5a838b2-69c469bc57-m5976"]
Sep 07 04:04:38.350983 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:38.350964    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-a5a838b2-69c469bc57-m5976"
Sep 07 04:04:38.365364 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:38.365316    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a5a838b2-69c469bc57-m5976"]
Sep 07 04:04:38.469641 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:38.469579    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8fe99118-71d0-4055-9346-5a4e3a29c5a4-plugins-config-volume\") pod \"payload-processing-e2e-mt-a5a838b2-69c469bc57-m5976\" (UID: \"8fe99118-71d0-4055-9346-5a4e3a29c5a4\") " pod="openshift-ingress/payload-processing-e2e-mt-a5a838b2-69c469bc57-m5976"
Sep 07 04:04:38.469836 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:38.469655    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlp82\" (UniqueName: \"kubernetes.io/projected/2e68e78a-15ad-4a28-bcfa-d81a76136469-kube-api-access-zlp82\") pod \"payload-pre-processing-e2e-mt-a5a838b2-86cdc6b678-zgdvs\" (UID: \"2e68e78a-15ad-4a28-bcfa-d81a76136469\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a5a838b2-86cdc6b678-zgdvs"
Sep 07 04:04:38.469836 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:38.469771    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e68e78a-15ad-4a28-bcfa-d81a76136469-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-a5a838b2-86cdc6b678-zgdvs\" (UID: \"2e68e78a-15ad-4a28-bcfa-d81a76136469\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a5a838b2-86cdc6b678-zgdvs"
Sep 07 04:04:38.469836 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:38.469833    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbjsq\" (UniqueName: \"kubernetes.io/projected/8fe99118-71d0-4055-9346-5a4e3a29c5a4-kube-api-access-jbjsq\") pod \"payload-processing-e2e-mt-a5a838b2-69c469bc57-m5976\" (UID: \"8fe99118-71d0-4055-9346-5a4e3a29c5a4\") " pod="openshift-ingress/payload-processing-e2e-mt-a5a838b2-69c469bc57-m5976"
Sep 07 04:04:38.570730 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:38.570658    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8fe99118-71d0-4055-9346-5a4e3a29c5a4-plugins-config-volume\") pod \"payload-processing-e2e-mt-a5a838b2-69c469bc57-m5976\" (UID: \"8fe99118-71d0-4055-9346-5a4e3a29c5a4\") " pod="openshift-ingress/payload-processing-e2e-mt-a5a838b2-69c469bc57-m5976"
Sep 07 04:04:38.570730 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:38.570698    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlp82\" (UniqueName: \"kubernetes.io/projected/2e68e78a-15ad-4a28-bcfa-d81a76136469-kube-api-access-zlp82\") pod \"payload-pre-processing-e2e-mt-a5a838b2-86cdc6b678-zgdvs\" (UID: \"2e68e78a-15ad-4a28-bcfa-d81a76136469\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a5a838b2-86cdc6b678-zgdvs"
Sep 07 04:04:38.570730 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:38.570734    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e68e78a-15ad-4a28-bcfa-d81a76136469-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-a5a838b2-86cdc6b678-zgdvs\" (UID: \"2e68e78a-15ad-4a28-bcfa-d81a76136469\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a5a838b2-86cdc6b678-zgdvs"
Sep 07 04:04:38.570970 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:38.570771    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbjsq\" (UniqueName: \"kubernetes.io/projected/8fe99118-71d0-4055-9346-5a4e3a29c5a4-kube-api-access-jbjsq\") pod \"payload-processing-e2e-mt-a5a838b2-69c469bc57-m5976\" (UID: \"8fe99118-71d0-4055-9346-5a4e3a29c5a4\") " pod="openshift-ingress/payload-processing-e2e-mt-a5a838b2-69c469bc57-m5976"
Sep 07 04:04:38.571366 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:38.571344    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8fe99118-71d0-4055-9346-5a4e3a29c5a4-plugins-config-volume\") pod \"payload-processing-e2e-mt-a5a838b2-69c469bc57-m5976\" (UID: \"8fe99118-71d0-4055-9346-5a4e3a29c5a4\") " pod="openshift-ingress/payload-processing-e2e-mt-a5a838b2-69c469bc57-m5976"
Sep 07 04:04:38.571492 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:38.571474    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e68e78a-15ad-4a28-bcfa-d81a76136469-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-a5a838b2-86cdc6b678-zgdvs\" (UID: \"2e68e78a-15ad-4a28-bcfa-d81a76136469\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a5a838b2-86cdc6b678-zgdvs"
Sep 07 04:04:38.578788 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:38.578764    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlp82\" (UniqueName: \"kubernetes.io/projected/2e68e78a-15ad-4a28-bcfa-d81a76136469-kube-api-access-zlp82\") pod \"payload-pre-processing-e2e-mt-a5a838b2-86cdc6b678-zgdvs\" (UID: \"2e68e78a-15ad-4a28-bcfa-d81a76136469\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a5a838b2-86cdc6b678-zgdvs"
Sep 07 04:04:38.578908 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:38.578894    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbjsq\" (UniqueName: \"kubernetes.io/projected/8fe99118-71d0-4055-9346-5a4e3a29c5a4-kube-api-access-jbjsq\") pod \"payload-processing-e2e-mt-a5a838b2-69c469bc57-m5976\" (UID: \"8fe99118-71d0-4055-9346-5a4e3a29c5a4\") " pod="openshift-ingress/payload-processing-e2e-mt-a5a838b2-69c469bc57-m5976"
Sep 07 04:04:38.629970 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:38.629948    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a5a838b2-86cdc6b678-zgdvs"
Sep 07 04:04:38.669090 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:38.669059    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-a5a838b2-69c469bc57-m5976"
Sep 07 04:04:38.901156 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:38.901129    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a5a838b2-86cdc6b678-zgdvs"]
Sep 07 04:04:38.902798 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:04:38.902773    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e68e78a_15ad_4a28_bcfa_d81a76136469.slice/crio-939b50fca897e046033d2a995f2464e34d08a21d061b5099f049370d55774d9a WatchSource:0}: Error finding container 939b50fca897e046033d2a995f2464e34d08a21d061b5099f049370d55774d9a: Status 404 returned error can't find the container with id 939b50fca897e046033d2a995f2464e34d08a21d061b5099f049370d55774d9a
Sep 07 04:04:38.947234 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:38.947216    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a5a838b2-69c469bc57-m5976"]
Sep 07 04:04:38.958530 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:04:38.958502    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fe99118_71d0_4055_9346_5a4e3a29c5a4.slice/crio-5aac59e47f83811d81f3a200355b215203daa310556c19a7c1a251416464cf34 WatchSource:0}: Error finding container 5aac59e47f83811d81f3a200355b215203daa310556c19a7c1a251416464cf34: Status 404 returned error can't find the container with id 5aac59e47f83811d81f3a200355b215203daa310556c19a7c1a251416464cf34
Sep 07 04:04:39.532641 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:39.528979    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7"]
Sep 07 04:04:39.532641 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:39.529229    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7" podUID="d49a6a62-bffc-447c-b826-0a4e89959050" containerName="istio-proxy" containerID="cri-o://232b5c89ea74cb5640c30b1f4aae53b6a8e559bb2d40fafa97de9a70dc3cf241" gracePeriod=30
Sep 07 04:04:39.640456 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:39.639916    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-a5a838b2-69c469bc57-m5976" event={"ID":"8fe99118-71d0-4055-9346-5a4e3a29c5a4","Type":"ContainerStarted","Data":"3e1d420c02598468239934c598e0cbf106f564921b5079940d218d3ae64e7483"}
Sep 07 04:04:39.640456 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:39.639988    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-a5a838b2-69c469bc57-m5976" event={"ID":"8fe99118-71d0-4055-9346-5a4e3a29c5a4","Type":"ContainerStarted","Data":"5aac59e47f83811d81f3a200355b215203daa310556c19a7c1a251416464cf34"}
Sep 07 04:04:39.640756 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:39.640552    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-a5a838b2-69c469bc57-m5976"
Sep 07 04:04:39.642722 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:39.642695    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a5a838b2-86cdc6b678-zgdvs" event={"ID":"2e68e78a-15ad-4a28-bcfa-d81a76136469","Type":"ContainerStarted","Data":"82ee5c4c11592b61be478059126bc5cec91f636c39d8a0cb287efe03a1b749b9"}
Sep 07 04:04:39.642870 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:39.642742    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a5a838b2-86cdc6b678-zgdvs" event={"ID":"2e68e78a-15ad-4a28-bcfa-d81a76136469","Type":"ContainerStarted","Data":"939b50fca897e046033d2a995f2464e34d08a21d061b5099f049370d55774d9a"}
Sep 07 04:04:39.642870 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:39.642769    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-a5a838b2-86cdc6b678-zgdvs"
Sep 07 04:04:39.658007 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:39.657961    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-a5a838b2-69c469bc57-m5976" podStartSLOduration=1.657944415 podStartE2EDuration="1.657944415s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:04:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:04:39.654852343 +0000 UTC m=+982.967328246" watchObservedRunningTime="2026-09-07 04:04:39.657944415 +0000 UTC m=+982.970420319"
Sep 07 04:04:39.672409 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:39.672364    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-a5a838b2-86cdc6b678-zgdvs" podStartSLOduration=1.6723479239999999 podStartE2EDuration="1.672347924s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:04:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:04:39.668413317 +0000 UTC m=+982.980889218" watchObservedRunningTime="2026-09-07 04:04:39.672347924 +0000 UTC m=+982.984823827"
Sep 07 04:04:44.677727 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:44.677685    2559 generic.go:356] "Generic (PLEG): container finished" podID="d49a6a62-bffc-447c-b826-0a4e89959050" containerID="232b5c89ea74cb5640c30b1f4aae53b6a8e559bb2d40fafa97de9a70dc3cf241" exitCode=0
Sep 07 04:04:44.678181 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:44.677762    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7" event={"ID":"d49a6a62-bffc-447c-b826-0a4e89959050","Type":"ContainerDied","Data":"232b5c89ea74cb5640c30b1f4aae53b6a8e559bb2d40fafa97de9a70dc3cf241"}
Sep 07 04:04:44.678181 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:44.677889    2559 scope.go:117] "RemoveContainer" containerID="b9a0a48655f0a95c1e90c3c8d00510a02a13baf2fbda7d426b5fd029ad6e5ee2"
Sep 07 04:04:44.807817 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:44.807609    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b8cea6-bb446469d-plrnx"]
Sep 07 04:04:44.812430 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:44.812408    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b8cea6-bb446469d-plrnx"
Sep 07 04:04:44.814801 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:44.814780    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-b8cea6-dockercfg-b2w4k\""
Sep 07 04:04:44.819047 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:44.818937    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-b8cea6\""
Sep 07 04:04:44.822436 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:44.822413    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b8cea6-bb446469d-plrnx"]
Sep 07 04:04:44.823528 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:44.823461    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7"
Sep 07 04:04:44.932710 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:44.932671    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d49a6a62-bffc-447c-b826-0a4e89959050-istio-data\") pod \"d49a6a62-bffc-447c-b826-0a4e89959050\" (UID: \"d49a6a62-bffc-447c-b826-0a4e89959050\") "
Sep 07 04:04:44.932892 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:44.932722    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d49a6a62-bffc-447c-b826-0a4e89959050-istio-token\") pod \"d49a6a62-bffc-447c-b826-0a4e89959050\" (UID: \"d49a6a62-bffc-447c-b826-0a4e89959050\") "
Sep 07 04:04:44.932892 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:44.932745    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d49a6a62-bffc-447c-b826-0a4e89959050-istiod-ca-cert\") pod \"d49a6a62-bffc-447c-b826-0a4e89959050\" (UID: \"d49a6a62-bffc-447c-b826-0a4e89959050\") "
Sep 07 04:04:44.932892 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:44.932792    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d49a6a62-bffc-447c-b826-0a4e89959050-istio-envoy\") pod \"d49a6a62-bffc-447c-b826-0a4e89959050\" (UID: \"d49a6a62-bffc-447c-b826-0a4e89959050\") "
Sep 07 04:04:44.932892 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:44.932845    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hh6kj\" (UniqueName: \"kubernetes.io/projected/d49a6a62-bffc-447c-b826-0a4e89959050-kube-api-access-hh6kj\") pod \"d49a6a62-bffc-447c-b826-0a4e89959050\" (UID: \"d49a6a62-bffc-447c-b826-0a4e89959050\") "
Sep 07 04:04:44.932892 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:44.932874    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d49a6a62-bffc-447c-b826-0a4e89959050-workload-socket\") pod \"d49a6a62-bffc-447c-b826-0a4e89959050\" (UID: \"d49a6a62-bffc-447c-b826-0a4e89959050\") "
Sep 07 04:04:44.933154 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:44.932946    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d49a6a62-bffc-447c-b826-0a4e89959050-istio-podinfo\") pod \"d49a6a62-bffc-447c-b826-0a4e89959050\" (UID: \"d49a6a62-bffc-447c-b826-0a4e89959050\") "
Sep 07 04:04:44.933154 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:44.932973    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d49a6a62-bffc-447c-b826-0a4e89959050-credential-socket\") pod \"d49a6a62-bffc-447c-b826-0a4e89959050\" (UID: \"d49a6a62-bffc-447c-b826-0a4e89959050\") "
Sep 07 04:04:44.933154 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:44.933048    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d49a6a62-bffc-447c-b826-0a4e89959050-workload-certs\") pod \"d49a6a62-bffc-447c-b826-0a4e89959050\" (UID: \"d49a6a62-bffc-447c-b826-0a4e89959050\") "
Sep 07 04:04:44.933300 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:44.933264    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xv4l\" (UniqueName: \"kubernetes.io/projected/5186ad4d-b681-45df-83a6-914812141a1f-kube-api-access-8xv4l\") pod \"payload-pre-processing-e2e-shared-a-w3-b8cea6-bb446469d-plrnx\" (UID: \"5186ad4d-b681-45df-83a6-914812141a1f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b8cea6-bb446469d-plrnx"
Sep 07 04:04:44.933363 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:44.933319    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5186ad4d-b681-45df-83a6-914812141a1f-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-b8cea6-bb446469d-plrnx\" (UID: \"5186ad4d-b681-45df-83a6-914812141a1f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b8cea6-bb446469d-plrnx"
Sep 07 04:04:44.936679 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:44.933726    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d49a6a62-bffc-447c-b826-0a4e89959050-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d49a6a62-bffc-447c-b826-0a4e89959050" (UID: "d49a6a62-bffc-447c-b826-0a4e89959050"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:04:44.951891 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:44.951835    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d49a6a62-bffc-447c-b826-0a4e89959050-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d49a6a62-bffc-447c-b826-0a4e89959050" (UID: "d49a6a62-bffc-447c-b826-0a4e89959050"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:04:44.956653 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:44.952875    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d49a6a62-bffc-447c-b826-0a4e89959050-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d49a6a62-bffc-447c-b826-0a4e89959050" (UID: "d49a6a62-bffc-447c-b826-0a4e89959050"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 04:04:44.956653 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:44.953745    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d49a6a62-bffc-447c-b826-0a4e89959050-istio-data" (OuterVolumeSpecName: "istio-data") pod "d49a6a62-bffc-447c-b826-0a4e89959050" (UID: "d49a6a62-bffc-447c-b826-0a4e89959050"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:04:44.956653 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:44.954744    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d49a6a62-bffc-447c-b826-0a4e89959050-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d49a6a62-bffc-447c-b826-0a4e89959050" (UID: "d49a6a62-bffc-447c-b826-0a4e89959050"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:04:44.958172 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:44.958130    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d49a6a62-bffc-447c-b826-0a4e89959050-istio-token" (OuterVolumeSpecName: "istio-token") pod "d49a6a62-bffc-447c-b826-0a4e89959050" (UID: "d49a6a62-bffc-447c-b826-0a4e89959050"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 04:04:44.958995 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:44.958972    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d49a6a62-bffc-447c-b826-0a4e89959050-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d49a6a62-bffc-447c-b826-0a4e89959050" (UID: "d49a6a62-bffc-447c-b826-0a4e89959050"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:04:44.960542 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:44.960511    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d49a6a62-bffc-447c-b826-0a4e89959050-kube-api-access-hh6kj" (OuterVolumeSpecName: "kube-api-access-hh6kj") pod "d49a6a62-bffc-447c-b826-0a4e89959050" (UID: "d49a6a62-bffc-447c-b826-0a4e89959050"). InnerVolumeSpecName "kube-api-access-hh6kj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 04:04:44.960799 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:44.960776    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d49a6a62-bffc-447c-b826-0a4e89959050-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d49a6a62-bffc-447c-b826-0a4e89959050" (UID: "d49a6a62-bffc-447c-b826-0a4e89959050"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 04:04:45.039328 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:45.034086    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xv4l\" (UniqueName: \"kubernetes.io/projected/5186ad4d-b681-45df-83a6-914812141a1f-kube-api-access-8xv4l\") pod \"payload-pre-processing-e2e-shared-a-w3-b8cea6-bb446469d-plrnx\" (UID: \"5186ad4d-b681-45df-83a6-914812141a1f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b8cea6-bb446469d-plrnx"
Sep 07 04:04:45.039328 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:45.034143    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5186ad4d-b681-45df-83a6-914812141a1f-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-b8cea6-bb446469d-plrnx\" (UID: \"5186ad4d-b681-45df-83a6-914812141a1f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b8cea6-bb446469d-plrnx"
Sep 07 04:04:45.039328 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:45.034288    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d49a6a62-bffc-447c-b826-0a4e89959050-istiod-ca-cert\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:04:45.039328 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:45.034306    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d49a6a62-bffc-447c-b826-0a4e89959050-istio-envoy\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:04:45.039328 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:45.034320    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hh6kj\" (UniqueName: \"kubernetes.io/projected/d49a6a62-bffc-447c-b826-0a4e89959050-kube-api-access-hh6kj\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:04:45.039328 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:45.034334    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d49a6a62-bffc-447c-b826-0a4e89959050-workload-socket\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:04:45.039328 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:45.034348    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d49a6a62-bffc-447c-b826-0a4e89959050-istio-podinfo\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:04:45.039328 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:45.034360    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d49a6a62-bffc-447c-b826-0a4e89959050-credential-socket\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:04:45.039328 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:45.034373    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d49a6a62-bffc-447c-b826-0a4e89959050-workload-certs\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:04:45.039328 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:45.034385    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d49a6a62-bffc-447c-b826-0a4e89959050-istio-data\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:04:45.039328 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:45.034397    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d49a6a62-bffc-447c-b826-0a4e89959050-istio-token\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:04:45.039328 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:45.035232    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5186ad4d-b681-45df-83a6-914812141a1f-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-b8cea6-bb446469d-plrnx\" (UID: \"5186ad4d-b681-45df-83a6-914812141a1f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b8cea6-bb446469d-plrnx"
Sep 07 04:04:45.044274 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:45.044251    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xv4l\" (UniqueName: \"kubernetes.io/projected/5186ad4d-b681-45df-83a6-914812141a1f-kube-api-access-8xv4l\") pod \"payload-pre-processing-e2e-shared-a-w3-b8cea6-bb446469d-plrnx\" (UID: \"5186ad4d-b681-45df-83a6-914812141a1f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b8cea6-bb446469d-plrnx"
Sep 07 04:04:45.130788 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:45.130761    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b8cea6-bb446469d-plrnx"
Sep 07 04:04:45.417080 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:45.417047    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b8cea6-bb446469d-plrnx"]
Sep 07 04:04:45.418184 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:04:45.418158    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5186ad4d_b681_45df_83a6_914812141a1f.slice/crio-6a148d8ddcd1fbdf969c674ab0825862cddbb0e9ea7b8400dace1de421e5aaae WatchSource:0}: Error finding container 6a148d8ddcd1fbdf969c674ab0825862cddbb0e9ea7b8400dace1de421e5aaae: Status 404 returned error can't find the container with id 6a148d8ddcd1fbdf969c674ab0825862cddbb0e9ea7b8400dace1de421e5aaae
Sep 07 04:04:45.685573 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:45.685485    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7"
Sep 07 04:04:45.685573 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:45.685525    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7" event={"ID":"d49a6a62-bffc-447c-b826-0a4e89959050","Type":"ContainerDied","Data":"7308c760489cc3bd531190d4dd97481a29e1a6f8c09f54b10dca61c0565053a4"}
Sep 07 04:04:45.686069 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:45.685596    2559 scope.go:117] "RemoveContainer" containerID="232b5c89ea74cb5640c30b1f4aae53b6a8e559bb2d40fafa97de9a70dc3cf241"
Sep 07 04:04:45.687285 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:45.687257    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b8cea6-bb446469d-plrnx" event={"ID":"5186ad4d-b681-45df-83a6-914812141a1f","Type":"ContainerStarted","Data":"f350315486154edf015974ef0fd6fd47ed5bb57739a51ea2370897967ca0b844"}
Sep 07 04:04:45.687431 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:45.687311    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b8cea6-bb446469d-plrnx" event={"ID":"5186ad4d-b681-45df-83a6-914812141a1f","Type":"ContainerStarted","Data":"6a148d8ddcd1fbdf969c674ab0825862cddbb0e9ea7b8400dace1de421e5aaae"}
Sep 07 04:04:45.687431 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:45.687374    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b8cea6-bb446469d-plrnx"
Sep 07 04:04:45.707320 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:45.707274    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b8cea6-bb446469d-plrnx" podStartSLOduration=1.707261251 podStartE2EDuration="1.707261251s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:04:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:04:45.703909018 +0000 UTC m=+989.016384921" watchObservedRunningTime="2026-09-07 04:04:45.707261251 +0000 UTC m=+989.019737152"
Sep 07 04:04:45.718490 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:45.718468    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7"]
Sep 07 04:04:45.721819 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:45.721795    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7"]
Sep 07 04:04:47.182476 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:47.182445    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d49a6a62-bffc-447c-b826-0a4e89959050" path="/var/lib/kubelet/pods/d49a6a62-bffc-447c-b826-0a4e89959050/volumes"
Sep 07 04:04:50.650421 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:50.650383    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-a5a838b2-69c469bc57-m5976"
Sep 07 04:04:50.650916 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:50.650580    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-a5a838b2-86cdc6b678-zgdvs"
Sep 07 04:04:51.648762 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:51.648719    2559 patch_prober.go:28] interesting pod/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 07 04:04:51.648963 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:51.648816    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9" podUID="0a36e0d0-6bd7-402a-b195-bd3819c6e507" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 07 04:04:52.732122 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:52.732086    2559 generic.go:356] "Generic (PLEG): container finished" podID="0a36e0d0-6bd7-402a-b195-bd3819c6e507" containerID="db9a992342a500244d856daa385db32ed4916c7ee9d509161dd503cbcbbae658" exitCode=0
Sep 07 04:04:52.732586 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:52.732162    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9" event={"ID":"0a36e0d0-6bd7-402a-b195-bd3819c6e507","Type":"ContainerDied","Data":"db9a992342a500244d856daa385db32ed4916c7ee9d509161dd503cbcbbae658"}
Sep 07 04:04:52.732586 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:52.732549    2559 scope.go:117] "RemoveContainer" containerID="db9a992342a500244d856daa385db32ed4916c7ee9d509161dd503cbcbbae658"
Sep 07 04:04:52.733691 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:52.733656    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 04:04:52.733805 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:52.733732    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 04:04:52.733805 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:52.733777    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 04:04:53.740345 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:53.740310    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9" event={"ID":"0a36e0d0-6bd7-402a-b195-bd3819c6e507","Type":"ContainerStarted","Data":"c93460ca263ec648b5de6f6338abd49ec9e6f40ae664200da14c8d4d73b756ab"}
Sep 07 04:04:54.638201 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:54.638165    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9"
Sep 07 04:04:54.638487 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:54.638210    2559 patch_prober.go:28] interesting pod/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 07 04:04:54.638654 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:54.638608    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9" podUID="0a36e0d0-6bd7-402a-b195-bd3819c6e507" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 07 04:04:55.637742 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:55.637703    2559 patch_prober.go:28] interesting pod/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 07 04:04:55.638329 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:55.638293    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9" podUID="0a36e0d0-6bd7-402a-b195-bd3819c6e507" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 07 04:04:56.637858 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:56.637816    2559 patch_prober.go:28] interesting pod/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 07 04:04:56.638326 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:56.637892    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9" podUID="0a36e0d0-6bd7-402a-b195-bd3819c6e507" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 07 04:04:56.696261 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:56.696226    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b8cea6-bb446469d-plrnx"
Sep 07 04:04:57.638067 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:57.638024    2559 patch_prober.go:28] interesting pod/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 07 04:04:57.638558 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:57.638093    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9" podUID="0a36e0d0-6bd7-402a-b195-bd3819c6e507" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 07 04:04:58.637548 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:58.637510    2559 patch_prober.go:28] interesting pod/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 07 04:04:58.637861 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:58.637830    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9" podUID="0a36e0d0-6bd7-402a-b195-bd3819c6e507" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 07 04:04:59.641472 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:59.641444    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9"
Sep 07 04:04:59.641857 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:59.641768    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9"
Sep 07 04:04:59.642486 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:04:59.642469    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9"
Sep 07 04:05:08.464249 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:08.464215    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj"]
Sep 07 04:05:08.464758 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:08.464665    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d49a6a62-bffc-447c-b826-0a4e89959050" containerName="istio-proxy"
Sep 07 04:05:08.464758 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:08.464682    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d49a6a62-bffc-447c-b826-0a4e89959050" containerName="istio-proxy"
Sep 07 04:05:08.464758 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:08.464694    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d49a6a62-bffc-447c-b826-0a4e89959050" containerName="istio-proxy"
Sep 07 04:05:08.464758 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:08.464699    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d49a6a62-bffc-447c-b826-0a4e89959050" containerName="istio-proxy"
Sep 07 04:05:08.465003 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:08.464770    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d49a6a62-bffc-447c-b826-0a4e89959050" containerName="istio-proxy"
Sep 07 04:05:08.465003 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:08.464779    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d49a6a62-bffc-447c-b826-0a4e89959050" containerName="istio-proxy"
Sep 07 04:05:08.467153 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:08.467136    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj"
Sep 07 04:05:08.469201 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:08.469178    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-434d57-openshift-default-dockercfg-rvgcl\""
Sep 07 04:05:08.483185 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:08.483155    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj"]
Sep 07 04:05:08.542600 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:08.542566    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77a7cd30-a31b-415b-b454-69ff3c05a42e-workload-socket\") pod \"e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj\" (UID: \"77a7cd30-a31b-415b-b454-69ff3c05a42e\") " pod="openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj"
Sep 07 04:05:08.542783 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:08.542602    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77a7cd30-a31b-415b-b454-69ff3c05a42e-istio-podinfo\") pod \"e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj\" (UID: \"77a7cd30-a31b-415b-b454-69ff3c05a42e\") " pod="openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj"
Sep 07 04:05:08.542783 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:08.542676    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77a7cd30-a31b-415b-b454-69ff3c05a42e-istio-data\") pod \"e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj\" (UID: \"77a7cd30-a31b-415b-b454-69ff3c05a42e\") " pod="openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj"
Sep 07 04:05:08.542783 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:08.542707    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77a7cd30-a31b-415b-b454-69ff3c05a42e-istio-envoy\") pod \"e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj\" (UID: \"77a7cd30-a31b-415b-b454-69ff3c05a42e\") " pod="openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj"
Sep 07 04:05:08.542895 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:08.542777    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77a7cd30-a31b-415b-b454-69ff3c05a42e-workload-certs\") pod \"e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj\" (UID: \"77a7cd30-a31b-415b-b454-69ff3c05a42e\") " pod="openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj"
Sep 07 04:05:08.542895 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:08.542818    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77a7cd30-a31b-415b-b454-69ff3c05a42e-credential-socket\") pod \"e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj\" (UID: \"77a7cd30-a31b-415b-b454-69ff3c05a42e\") " pod="openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj"
Sep 07 04:05:08.542895 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:08.542861    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77a7cd30-a31b-415b-b454-69ff3c05a42e-istiod-ca-cert\") pod \"e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj\" (UID: \"77a7cd30-a31b-415b-b454-69ff3c05a42e\") " pod="openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj"
Sep 07 04:05:08.542895 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:08.542880    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77a7cd30-a31b-415b-b454-69ff3c05a42e-istio-token\") pod \"e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj\" (UID: \"77a7cd30-a31b-415b-b454-69ff3c05a42e\") " pod="openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj"
Sep 07 04:05:08.543038 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:08.542899    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mklg7\" (UniqueName: \"kubernetes.io/projected/77a7cd30-a31b-415b-b454-69ff3c05a42e-kube-api-access-mklg7\") pod \"e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj\" (UID: \"77a7cd30-a31b-415b-b454-69ff3c05a42e\") " pod="openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj"
Sep 07 04:05:08.643446 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:08.643405    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mklg7\" (UniqueName: \"kubernetes.io/projected/77a7cd30-a31b-415b-b454-69ff3c05a42e-kube-api-access-mklg7\") pod \"e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj\" (UID: \"77a7cd30-a31b-415b-b454-69ff3c05a42e\") " pod="openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj"
Sep 07 04:05:08.643674 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:08.643469    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77a7cd30-a31b-415b-b454-69ff3c05a42e-workload-socket\") pod \"e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj\" (UID: \"77a7cd30-a31b-415b-b454-69ff3c05a42e\") " pod="openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj"
Sep 07 04:05:08.643674 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:08.643492    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77a7cd30-a31b-415b-b454-69ff3c05a42e-istio-podinfo\") pod \"e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj\" (UID: \"77a7cd30-a31b-415b-b454-69ff3c05a42e\") " pod="openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj"
Sep 07 04:05:08.643674 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:08.643543    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77a7cd30-a31b-415b-b454-69ff3c05a42e-istio-data\") pod \"e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj\" (UID: \"77a7cd30-a31b-415b-b454-69ff3c05a42e\") " pod="openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj"
Sep 07 04:05:08.643674 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:08.643596    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77a7cd30-a31b-415b-b454-69ff3c05a42e-istio-envoy\") pod \"e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj\" (UID: \"77a7cd30-a31b-415b-b454-69ff3c05a42e\") " pod="openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj"
Sep 07 04:05:08.643674 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:08.643662    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77a7cd30-a31b-415b-b454-69ff3c05a42e-workload-certs\") pod \"e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj\" (UID: \"77a7cd30-a31b-415b-b454-69ff3c05a42e\") " pod="openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj"
Sep 07 04:05:08.644053 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:08.643709    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77a7cd30-a31b-415b-b454-69ff3c05a42e-credential-socket\") pod \"e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj\" (UID: \"77a7cd30-a31b-415b-b454-69ff3c05a42e\") " pod="openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj"
Sep 07 04:05:08.644053 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:08.643762    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77a7cd30-a31b-415b-b454-69ff3c05a42e-istiod-ca-cert\") pod \"e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj\" (UID: \"77a7cd30-a31b-415b-b454-69ff3c05a42e\") " pod="openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj"
Sep 07 04:05:08.644053 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:08.643792    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77a7cd30-a31b-415b-b454-69ff3c05a42e-istio-token\") pod \"e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj\" (UID: \"77a7cd30-a31b-415b-b454-69ff3c05a42e\") " pod="openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj"
Sep 07 04:05:08.644053 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:08.643981    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77a7cd30-a31b-415b-b454-69ff3c05a42e-workload-socket\") pod \"e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj\" (UID: \"77a7cd30-a31b-415b-b454-69ff3c05a42e\") " pod="openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj"
Sep 07 04:05:08.644415 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:08.644116    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77a7cd30-a31b-415b-b454-69ff3c05a42e-istio-data\") pod \"e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj\" (UID: \"77a7cd30-a31b-415b-b454-69ff3c05a42e\") " pod="openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj"
Sep 07 04:05:08.644415 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:08.644178    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77a7cd30-a31b-415b-b454-69ff3c05a42e-workload-certs\") pod \"e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj\" (UID: \"77a7cd30-a31b-415b-b454-69ff3c05a42e\") " pod="openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj"
Sep 07 04:05:08.644415 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:08.644318    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77a7cd30-a31b-415b-b454-69ff3c05a42e-credential-socket\") pod \"e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj\" (UID: \"77a7cd30-a31b-415b-b454-69ff3c05a42e\") " pod="openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj"
Sep 07 04:05:08.645023 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:08.644999    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77a7cd30-a31b-415b-b454-69ff3c05a42e-istiod-ca-cert\") pod \"e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj\" (UID: \"77a7cd30-a31b-415b-b454-69ff3c05a42e\") " pod="openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj"
Sep 07 04:05:08.646234 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:08.646208    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77a7cd30-a31b-415b-b454-69ff3c05a42e-istio-envoy\") pod \"e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj\" (UID: \"77a7cd30-a31b-415b-b454-69ff3c05a42e\") " pod="openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj"
Sep 07 04:05:08.646324 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:08.646237    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77a7cd30-a31b-415b-b454-69ff3c05a42e-istio-podinfo\") pod \"e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj\" (UID: \"77a7cd30-a31b-415b-b454-69ff3c05a42e\") " pod="openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj"
Sep 07 04:05:08.651948 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:08.651922    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77a7cd30-a31b-415b-b454-69ff3c05a42e-istio-token\") pod \"e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj\" (UID: \"77a7cd30-a31b-415b-b454-69ff3c05a42e\") " pod="openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj"
Sep 07 04:05:08.652311 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:08.652289    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mklg7\" (UniqueName: \"kubernetes.io/projected/77a7cd30-a31b-415b-b454-69ff3c05a42e-kube-api-access-mklg7\") pod \"e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj\" (UID: \"77a7cd30-a31b-415b-b454-69ff3c05a42e\") " pod="openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj"
Sep 07 04:05:08.660528 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:08.660504    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a5a838b2-br5ks"]
Sep 07 04:05:08.664272 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:08.664251    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a5a838b2-br5ks"
Sep 07 04:05:08.666274 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:08.666254    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 07 04:05:08.666374 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:08.666256    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zs4ff\""
Sep 07 04:05:08.670475 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:08.670418    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a5a838b2-br5ks"]
Sep 07 04:05:08.744533 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:08.744450    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d986740e-705c-41b1-9a49-f7bda99aff08-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-a5a838b2-br5ks\" (UID: \"d986740e-705c-41b1-9a49-f7bda99aff08\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a5a838b2-br5ks"
Sep 07 04:05:08.776929 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:08.776897    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj"
Sep 07 04:05:08.846031 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:08.845391    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d986740e-705c-41b1-9a49-f7bda99aff08-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-a5a838b2-br5ks\" (UID: \"d986740e-705c-41b1-9a49-f7bda99aff08\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a5a838b2-br5ks"
Sep 07 04:05:08.846031 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:08.845993    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d986740e-705c-41b1-9a49-f7bda99aff08-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-a5a838b2-br5ks\" (UID: \"d986740e-705c-41b1-9a49-f7bda99aff08\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a5a838b2-br5ks"
Sep 07 04:05:08.976423 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:08.976335    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a5a838b2-br5ks"
Sep 07 04:05:09.048764 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:09.048737    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj"]
Sep 07 04:05:09.049723 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:05:09.049697    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77a7cd30_a31b_415b_b454_69ff3c05a42e.slice/crio-318998482a265e0815f1953319b189c455e2e46bfcda4b9f04b10a6e5d7de098 WatchSource:0}: Error finding container 318998482a265e0815f1953319b189c455e2e46bfcda4b9f04b10a6e5d7de098: Status 404 returned error can't find the container with id 318998482a265e0815f1953319b189c455e2e46bfcda4b9f04b10a6e5d7de098
Sep 07 04:05:09.052214 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:09.052174    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 04:05:09.052347 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:09.052258    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 04:05:09.052347 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:09.052304    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 04:05:09.244750 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:09.244728    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a5a838b2-br5ks"]
Sep 07 04:05:09.246958 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:05:09.246928    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd986740e_705c_41b1_9a49_f7bda99aff08.slice/crio-5cdfe47536165340d9be7681c4052d65548e2ceeb817c6442bc9c87fbc885dfd WatchSource:0}: Error finding container 5cdfe47536165340d9be7681c4052d65548e2ceeb817c6442bc9c87fbc885dfd: Status 404 returned error can't find the container with id 5cdfe47536165340d9be7681c4052d65548e2ceeb817c6442bc9c87fbc885dfd
Sep 07 04:05:09.845233 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:09.845133    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a5a838b2-br5ks" event={"ID":"d986740e-705c-41b1-9a49-f7bda99aff08","Type":"ContainerStarted","Data":"fc3a87543daa691b2be375b161ccce0b5717bff485208c8700f437014ab6e606"}
Sep 07 04:05:09.845233 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:09.845198    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a5a838b2-br5ks" event={"ID":"d986740e-705c-41b1-9a49-f7bda99aff08","Type":"ContainerStarted","Data":"5cdfe47536165340d9be7681c4052d65548e2ceeb817c6442bc9c87fbc885dfd"}
Sep 07 04:05:09.846903 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:09.846876    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj" event={"ID":"77a7cd30-a31b-415b-b454-69ff3c05a42e","Type":"ContainerStarted","Data":"33c092d4737e7b1d1423752994434341c5a1c7301b7dab838609cc4d27a72b3f"}
Sep 07 04:05:09.847038 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:09.846918    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj" event={"ID":"77a7cd30-a31b-415b-b454-69ff3c05a42e","Type":"ContainerStarted","Data":"318998482a265e0815f1953319b189c455e2e46bfcda4b9f04b10a6e5d7de098"}
Sep 07 04:05:09.862067 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:09.862018    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a5a838b2-br5ks" podStartSLOduration=1.8619995280000001 podStartE2EDuration="1.861999528s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:05:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:05:09.858804613 +0000 UTC m=+1013.171280516" watchObservedRunningTime="2026-09-07 04:05:09.861999528 +0000 UTC m=+1013.174475434"
Sep 07 04:05:09.875606 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:09.875557    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj" podStartSLOduration=1.875541166 podStartE2EDuration="1.875541166s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:05:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:05:09.87447982 +0000 UTC m=+1013.186955721" watchObservedRunningTime="2026-09-07 04:05:09.875541166 +0000 UTC m=+1013.188017086"
Sep 07 04:05:10.777552 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:10.777517    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj"
Sep 07 04:05:10.782302 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:10.782281    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj"
Sep 07 04:05:10.857500 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:10.857464    2559 generic.go:356] "Generic (PLEG): container finished" podID="d986740e-705c-41b1-9a49-f7bda99aff08" containerID="fc3a87543daa691b2be375b161ccce0b5717bff485208c8700f437014ab6e606" exitCode=0
Sep 07 04:05:10.857886 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:10.857548    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a5a838b2-br5ks" event={"ID":"d986740e-705c-41b1-9a49-f7bda99aff08","Type":"ContainerDied","Data":"fc3a87543daa691b2be375b161ccce0b5717bff485208c8700f437014ab6e606"}
Sep 07 04:05:10.857935 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:10.857890    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj"
Sep 07 04:05:10.858582 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:10.858563    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj"
Sep 07 04:05:11.996230 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:11.996206    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a5a838b2-br5ks"
Sep 07 04:05:12.077847 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:12.077821    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d986740e-705c-41b1-9a49-f7bda99aff08-maas-api-service-ca\") pod \"d986740e-705c-41b1-9a49-f7bda99aff08\" (UID: \"d986740e-705c-41b1-9a49-f7bda99aff08\") "
Sep 07 04:05:12.078173 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:12.078154    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d986740e-705c-41b1-9a49-f7bda99aff08-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d986740e-705c-41b1-9a49-f7bda99aff08" (UID: "d986740e-705c-41b1-9a49-f7bda99aff08"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 04:05:12.178612 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:12.178560    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d986740e-705c-41b1-9a49-f7bda99aff08-maas-api-service-ca\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:05:12.872313 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:12.872288    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a5a838b2-br5ks"
Sep 07 04:05:12.872488 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:12.872284    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a5a838b2-br5ks" event={"ID":"d986740e-705c-41b1-9a49-f7bda99aff08","Type":"ContainerDied","Data":"5cdfe47536165340d9be7681c4052d65548e2ceeb817c6442bc9c87fbc885dfd"}
Sep 07 04:05:12.872488 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:12.872423    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5cdfe47536165340d9be7681c4052d65548e2ceeb817c6442bc9c87fbc885dfd"
Sep 07 04:05:13.427078 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:13.427051    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-434d57-6fdf76666-mqqph"]
Sep 07 04:05:13.427440 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:13.427422    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d986740e-705c-41b1-9a49-f7bda99aff08" containerName="revoke-keys"
Sep 07 04:05:13.427440 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:13.427434    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d986740e-705c-41b1-9a49-f7bda99aff08" containerName="revoke-keys"
Sep 07 04:05:13.427523 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:13.427501    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d986740e-705c-41b1-9a49-f7bda99aff08" containerName="revoke-keys"
Sep 07 04:05:13.429586 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:13.429556    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-434d57-6fdf76666-mqqph"
Sep 07 04:05:13.431286 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:13.431264    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-434d57\""
Sep 07 04:05:13.441548 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:13.441523    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-434d57-6fdf76666-mqqph"]
Sep 07 04:05:13.472724 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:13.472700    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-434d57-85f79bfcd7-db8vt"]
Sep 07 04:05:13.474900 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:13.474886    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-434d57-85f79bfcd7-db8vt"
Sep 07 04:05:13.476829 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:13.476800    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-434d57-dockercfg-xzhd7\""
Sep 07 04:05:13.485551 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:13.485527    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-434d57-85f79bfcd7-db8vt"]
Sep 07 04:05:13.490493 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:13.490471    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47aa091c-c557-4839-b6ca-f58d896cbe1b-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-434d57-6fdf76666-mqqph\" (UID: \"47aa091c-c557-4839-b6ca-f58d896cbe1b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-434d57-6fdf76666-mqqph"
Sep 07 04:05:13.490598 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:13.490581    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vstnm\" (UniqueName: \"kubernetes.io/projected/47aa091c-c557-4839-b6ca-f58d896cbe1b-kube-api-access-vstnm\") pod \"payload-pre-processing-e2e-shared-b-w3-434d57-6fdf76666-mqqph\" (UID: \"47aa091c-c557-4839-b6ca-f58d896cbe1b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-434d57-6fdf76666-mqqph"
Sep 07 04:05:13.592174 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:13.592134    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vstnm\" (UniqueName: \"kubernetes.io/projected/47aa091c-c557-4839-b6ca-f58d896cbe1b-kube-api-access-vstnm\") pod \"payload-pre-processing-e2e-shared-b-w3-434d57-6fdf76666-mqqph\" (UID: \"47aa091c-c557-4839-b6ca-f58d896cbe1b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-434d57-6fdf76666-mqqph"
Sep 07 04:05:13.592403 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:13.592198    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d74bd906-9379-4eaa-8ca9-ae39a8bd2053-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-434d57-85f79bfcd7-db8vt\" (UID: \"d74bd906-9379-4eaa-8ca9-ae39a8bd2053\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-434d57-85f79bfcd7-db8vt"
Sep 07 04:05:13.592403 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:13.592224    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47aa091c-c557-4839-b6ca-f58d896cbe1b-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-434d57-6fdf76666-mqqph\" (UID: \"47aa091c-c557-4839-b6ca-f58d896cbe1b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-434d57-6fdf76666-mqqph"
Sep 07 04:05:13.592403 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:13.592253    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m57qw\" (UniqueName: \"kubernetes.io/projected/d74bd906-9379-4eaa-8ca9-ae39a8bd2053-kube-api-access-m57qw\") pod \"payload-processing-e2e-shared-b-w3-434d57-85f79bfcd7-db8vt\" (UID: \"d74bd906-9379-4eaa-8ca9-ae39a8bd2053\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-434d57-85f79bfcd7-db8vt"
Sep 07 04:05:13.593007 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:13.592982    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47aa091c-c557-4839-b6ca-f58d896cbe1b-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-434d57-6fdf76666-mqqph\" (UID: \"47aa091c-c557-4839-b6ca-f58d896cbe1b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-434d57-6fdf76666-mqqph"
Sep 07 04:05:13.608844 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:13.608816    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vstnm\" (UniqueName: \"kubernetes.io/projected/47aa091c-c557-4839-b6ca-f58d896cbe1b-kube-api-access-vstnm\") pod \"payload-pre-processing-e2e-shared-b-w3-434d57-6fdf76666-mqqph\" (UID: \"47aa091c-c557-4839-b6ca-f58d896cbe1b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-434d57-6fdf76666-mqqph"
Sep 07 04:05:13.693586 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:13.693518    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d74bd906-9379-4eaa-8ca9-ae39a8bd2053-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-434d57-85f79bfcd7-db8vt\" (UID: \"d74bd906-9379-4eaa-8ca9-ae39a8bd2053\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-434d57-85f79bfcd7-db8vt"
Sep 07 04:05:13.693586 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:13.693562    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m57qw\" (UniqueName: \"kubernetes.io/projected/d74bd906-9379-4eaa-8ca9-ae39a8bd2053-kube-api-access-m57qw\") pod \"payload-processing-e2e-shared-b-w3-434d57-85f79bfcd7-db8vt\" (UID: \"d74bd906-9379-4eaa-8ca9-ae39a8bd2053\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-434d57-85f79bfcd7-db8vt"
Sep 07 04:05:13.694229 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:13.694203    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d74bd906-9379-4eaa-8ca9-ae39a8bd2053-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-434d57-85f79bfcd7-db8vt\" (UID: \"d74bd906-9379-4eaa-8ca9-ae39a8bd2053\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-434d57-85f79bfcd7-db8vt"
Sep 07 04:05:13.700295 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:13.700272    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m57qw\" (UniqueName: \"kubernetes.io/projected/d74bd906-9379-4eaa-8ca9-ae39a8bd2053-kube-api-access-m57qw\") pod \"payload-processing-e2e-shared-b-w3-434d57-85f79bfcd7-db8vt\" (UID: \"d74bd906-9379-4eaa-8ca9-ae39a8bd2053\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-434d57-85f79bfcd7-db8vt"
Sep 07 04:05:13.741375 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:13.741357    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-434d57-6fdf76666-mqqph"
Sep 07 04:05:13.784817 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:13.784790    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-434d57-85f79bfcd7-db8vt"
Sep 07 04:05:14.011474 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:14.011439    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-434d57-6fdf76666-mqqph"]
Sep 07 04:05:14.012277 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:05:14.012256    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47aa091c_c557_4839_b6ca_f58d896cbe1b.slice/crio-4994594626ca2a2951a5a2f3aed5de6a98bda1c2b39c7dc05869ceeff446d6b2 WatchSource:0}: Error finding container 4994594626ca2a2951a5a2f3aed5de6a98bda1c2b39c7dc05869ceeff446d6b2: Status 404 returned error can't find the container with id 4994594626ca2a2951a5a2f3aed5de6a98bda1c2b39c7dc05869ceeff446d6b2
Sep 07 04:05:14.067319 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:14.067295    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-434d57-85f79bfcd7-db8vt"]
Sep 07 04:05:14.068430 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:05:14.068403    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd74bd906_9379_4eaa_8ca9_ae39a8bd2053.slice/crio-6be887c850498b650a9ddcb53e6c947548c4b6e3cc6ecce05ef944946620b16a WatchSource:0}: Error finding container 6be887c850498b650a9ddcb53e6c947548c4b6e3cc6ecce05ef944946620b16a: Status 404 returned error can't find the container with id 6be887c850498b650a9ddcb53e6c947548c4b6e3cc6ecce05ef944946620b16a
Sep 07 04:05:14.887302 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:14.887272    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-434d57-6fdf76666-mqqph" event={"ID":"47aa091c-c557-4839-b6ca-f58d896cbe1b","Type":"ContainerStarted","Data":"4cdd9b1fed4243550c2e22c1c092696ad9e0cef45807b29e13cfebcdec7b9a20"}
Sep 07 04:05:14.887729 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:14.887330    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-434d57-6fdf76666-mqqph" event={"ID":"47aa091c-c557-4839-b6ca-f58d896cbe1b","Type":"ContainerStarted","Data":"4994594626ca2a2951a5a2f3aed5de6a98bda1c2b39c7dc05869ceeff446d6b2"}
Sep 07 04:05:14.887729 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:14.887358    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-434d57-6fdf76666-mqqph"
Sep 07 04:05:14.888934 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:14.888911    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-434d57-85f79bfcd7-db8vt" event={"ID":"d74bd906-9379-4eaa-8ca9-ae39a8bd2053","Type":"ContainerStarted","Data":"c02f028aa87bf3ec3ff97454c79e367600d9dfd073f2604905798b6e96f69b58"}
Sep 07 04:05:14.889036 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:14.888949    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-434d57-85f79bfcd7-db8vt" event={"ID":"d74bd906-9379-4eaa-8ca9-ae39a8bd2053","Type":"ContainerStarted","Data":"6be887c850498b650a9ddcb53e6c947548c4b6e3cc6ecce05ef944946620b16a"}
Sep 07 04:05:14.889088 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:14.889036    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-434d57-85f79bfcd7-db8vt"
Sep 07 04:05:14.903024 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:14.902983    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-434d57-6fdf76666-mqqph" podStartSLOduration=1.9029691720000002 podStartE2EDuration="1.902969172s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:05:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:05:14.900896414 +0000 UTC m=+1018.213372317" watchObservedRunningTime="2026-09-07 04:05:14.902969172 +0000 UTC m=+1018.215445075"
Sep 07 04:05:14.915333 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:14.915296    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-434d57-85f79bfcd7-db8vt" podStartSLOduration=1.9152821549999999 podStartE2EDuration="1.915282155s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:05:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:05:14.914256687 +0000 UTC m=+1018.226732586" watchObservedRunningTime="2026-09-07 04:05:14.915282155 +0000 UTC m=+1018.227758057"
Sep 07 04:05:19.315857 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:19.315821    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a5a838b2-69c469bc57-m5976"]
Sep 07 04:05:19.316297 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:19.316110    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-a5a838b2-69c469bc57-m5976" podUID="8fe99118-71d0-4055-9346-5a4e3a29c5a4" containerName="payload-processing" containerID="cri-o://3e1d420c02598468239934c598e0cbf106f564921b5079940d218d3ae64e7483" gracePeriod=30
Sep 07 04:05:19.323259 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:19.323021    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a5a838b2-86cdc6b678-zgdvs"]
Sep 07 04:05:19.323376 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:19.323335    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-a5a838b2-86cdc6b678-zgdvs" podUID="2e68e78a-15ad-4a28-bcfa-d81a76136469" containerName="payload-pre-processing" containerID="cri-o://82ee5c4c11592b61be478059126bc5cec91f636c39d8a0cb287efe03a1b749b9" gracePeriod=30
Sep 07 04:05:19.463019 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:19.462947    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a5a838b2-br5ks"]
Sep 07 04:05:19.465476 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:19.465447    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a5a838b2-br5ks"]
Sep 07 04:05:19.655657 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:19.655071    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-a5a838b2-69c469bc57-m5976"
Sep 07 04:05:19.660638 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:19.657138    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a5a838b2-86cdc6b678-zgdvs"
Sep 07 04:05:19.779880 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:19.779844    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8fe99118-71d0-4055-9346-5a4e3a29c5a4-plugins-config-volume\") pod \"8fe99118-71d0-4055-9346-5a4e3a29c5a4\" (UID: \"8fe99118-71d0-4055-9346-5a4e3a29c5a4\") "
Sep 07 04:05:19.780045 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:19.779897    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zlp82\" (UniqueName: \"kubernetes.io/projected/2e68e78a-15ad-4a28-bcfa-d81a76136469-kube-api-access-zlp82\") pod \"2e68e78a-15ad-4a28-bcfa-d81a76136469\" (UID: \"2e68e78a-15ad-4a28-bcfa-d81a76136469\") "
Sep 07 04:05:19.780045 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:19.779942    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbjsq\" (UniqueName: \"kubernetes.io/projected/8fe99118-71d0-4055-9346-5a4e3a29c5a4-kube-api-access-jbjsq\") pod \"8fe99118-71d0-4055-9346-5a4e3a29c5a4\" (UID: \"8fe99118-71d0-4055-9346-5a4e3a29c5a4\") "
Sep 07 04:05:19.780045 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:19.779995    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e68e78a-15ad-4a28-bcfa-d81a76136469-plugins-config-volume\") pod \"2e68e78a-15ad-4a28-bcfa-d81a76136469\" (UID: \"2e68e78a-15ad-4a28-bcfa-d81a76136469\") "
Sep 07 04:05:19.780259 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:19.780228    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fe99118-71d0-4055-9346-5a4e3a29c5a4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8fe99118-71d0-4055-9346-5a4e3a29c5a4" (UID: "8fe99118-71d0-4055-9346-5a4e3a29c5a4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 04:05:19.780394 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:19.780371    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e68e78a-15ad-4a28-bcfa-d81a76136469-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2e68e78a-15ad-4a28-bcfa-d81a76136469" (UID: "2e68e78a-15ad-4a28-bcfa-d81a76136469"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 04:05:19.782029 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:19.782006    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fe99118-71d0-4055-9346-5a4e3a29c5a4-kube-api-access-jbjsq" (OuterVolumeSpecName: "kube-api-access-jbjsq") pod "8fe99118-71d0-4055-9346-5a4e3a29c5a4" (UID: "8fe99118-71d0-4055-9346-5a4e3a29c5a4"). InnerVolumeSpecName "kube-api-access-jbjsq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 04:05:19.782141 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:19.782053    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e68e78a-15ad-4a28-bcfa-d81a76136469-kube-api-access-zlp82" (OuterVolumeSpecName: "kube-api-access-zlp82") pod "2e68e78a-15ad-4a28-bcfa-d81a76136469" (UID: "2e68e78a-15ad-4a28-bcfa-d81a76136469"). InnerVolumeSpecName "kube-api-access-zlp82". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 04:05:19.881156 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:19.881074    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e68e78a-15ad-4a28-bcfa-d81a76136469-plugins-config-volume\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:05:19.881156 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:19.881102    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8fe99118-71d0-4055-9346-5a4e3a29c5a4-plugins-config-volume\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:05:19.881156 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:19.881113    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zlp82\" (UniqueName: \"kubernetes.io/projected/2e68e78a-15ad-4a28-bcfa-d81a76136469-kube-api-access-zlp82\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:05:19.881156 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:19.881123    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbjsq\" (UniqueName: \"kubernetes.io/projected/8fe99118-71d0-4055-9346-5a4e3a29c5a4-kube-api-access-jbjsq\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:05:19.919456 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:19.919419    2559 generic.go:356] "Generic (PLEG): container finished" podID="8fe99118-71d0-4055-9346-5a4e3a29c5a4" containerID="3e1d420c02598468239934c598e0cbf106f564921b5079940d218d3ae64e7483" exitCode=0
Sep 07 04:05:19.919580 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:19.919487    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-a5a838b2-69c469bc57-m5976"
Sep 07 04:05:19.919580 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:19.919500    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-a5a838b2-69c469bc57-m5976" event={"ID":"8fe99118-71d0-4055-9346-5a4e3a29c5a4","Type":"ContainerDied","Data":"3e1d420c02598468239934c598e0cbf106f564921b5079940d218d3ae64e7483"}
Sep 07 04:05:19.919743 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:19.919592    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-a5a838b2-69c469bc57-m5976" event={"ID":"8fe99118-71d0-4055-9346-5a4e3a29c5a4","Type":"ContainerDied","Data":"5aac59e47f83811d81f3a200355b215203daa310556c19a7c1a251416464cf34"}
Sep 07 04:05:19.919743 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:19.919637    2559 scope.go:117] "RemoveContainer" containerID="3e1d420c02598468239934c598e0cbf106f564921b5079940d218d3ae64e7483"
Sep 07 04:05:19.920973 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:19.920946    2559 generic.go:356] "Generic (PLEG): container finished" podID="2e68e78a-15ad-4a28-bcfa-d81a76136469" containerID="82ee5c4c11592b61be478059126bc5cec91f636c39d8a0cb287efe03a1b749b9" exitCode=0
Sep 07 04:05:19.921097 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:19.920994    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a5a838b2-86cdc6b678-zgdvs"
Sep 07 04:05:19.921097 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:19.921028    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a5a838b2-86cdc6b678-zgdvs" event={"ID":"2e68e78a-15ad-4a28-bcfa-d81a76136469","Type":"ContainerDied","Data":"82ee5c4c11592b61be478059126bc5cec91f636c39d8a0cb287efe03a1b749b9"}
Sep 07 04:05:19.921097 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:19.921086    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a5a838b2-86cdc6b678-zgdvs" event={"ID":"2e68e78a-15ad-4a28-bcfa-d81a76136469","Type":"ContainerDied","Data":"939b50fca897e046033d2a995f2464e34d08a21d061b5099f049370d55774d9a"}
Sep 07 04:05:19.930129 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:19.930112    2559 scope.go:117] "RemoveContainer" containerID="3e1d420c02598468239934c598e0cbf106f564921b5079940d218d3ae64e7483"
Sep 07 04:05:19.930400 ip-10-0-132-4 kubenswrapper[2559]: E0907 04:05:19.930380    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e1d420c02598468239934c598e0cbf106f564921b5079940d218d3ae64e7483\": container with ID starting with 3e1d420c02598468239934c598e0cbf106f564921b5079940d218d3ae64e7483 not found: ID does not exist" containerID="3e1d420c02598468239934c598e0cbf106f564921b5079940d218d3ae64e7483"
Sep 07 04:05:19.930463 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:19.930406    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e1d420c02598468239934c598e0cbf106f564921b5079940d218d3ae64e7483"} err="failed to get container status \"3e1d420c02598468239934c598e0cbf106f564921b5079940d218d3ae64e7483\": rpc error: code = NotFound desc = could not find container \"3e1d420c02598468239934c598e0cbf106f564921b5079940d218d3ae64e7483\": container with ID starting with 3e1d420c02598468239934c598e0cbf106f564921b5079940d218d3ae64e7483 not found: ID does not exist"
Sep 07 04:05:19.930463 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:19.930424    2559 scope.go:117] "RemoveContainer" containerID="82ee5c4c11592b61be478059126bc5cec91f636c39d8a0cb287efe03a1b749b9"
Sep 07 04:05:19.954649 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:19.952335    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a5a838b2-86cdc6b678-zgdvs"]
Sep 07 04:05:19.963681 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:19.961385    2559 scope.go:117] "RemoveContainer" containerID="82ee5c4c11592b61be478059126bc5cec91f636c39d8a0cb287efe03a1b749b9"
Sep 07 04:05:19.963681 ip-10-0-132-4 kubenswrapper[2559]: E0907 04:05:19.961854    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82ee5c4c11592b61be478059126bc5cec91f636c39d8a0cb287efe03a1b749b9\": container with ID starting with 82ee5c4c11592b61be478059126bc5cec91f636c39d8a0cb287efe03a1b749b9 not found: ID does not exist" containerID="82ee5c4c11592b61be478059126bc5cec91f636c39d8a0cb287efe03a1b749b9"
Sep 07 04:05:19.963681 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:19.961891    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82ee5c4c11592b61be478059126bc5cec91f636c39d8a0cb287efe03a1b749b9"} err="failed to get container status \"82ee5c4c11592b61be478059126bc5cec91f636c39d8a0cb287efe03a1b749b9\": rpc error: code = NotFound desc = could not find container \"82ee5c4c11592b61be478059126bc5cec91f636c39d8a0cb287efe03a1b749b9\": container with ID starting with 82ee5c4c11592b61be478059126bc5cec91f636c39d8a0cb287efe03a1b749b9 not found: ID does not exist"
Sep 07 04:05:19.964314 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:19.964287    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a5a838b2-86cdc6b678-zgdvs"]
Sep 07 04:05:19.967031 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:19.967012    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a5a838b2-69c469bc57-m5976"]
Sep 07 04:05:19.969050 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:19.969033    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a5a838b2-69c469bc57-m5976"]
Sep 07 04:05:21.179704 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:21.179665    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e68e78a-15ad-4a28-bcfa-d81a76136469" path="/var/lib/kubelet/pods/2e68e78a-15ad-4a28-bcfa-d81a76136469/volumes"
Sep 07 04:05:21.180175 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:21.180156    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fe99118-71d0-4055-9346-5a4e3a29c5a4" path="/var/lib/kubelet/pods/8fe99118-71d0-4055-9346-5a4e3a29c5a4/volumes"
Sep 07 04:05:21.180455 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:21.180442    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d986740e-705c-41b1-9a49-f7bda99aff08" path="/var/lib/kubelet/pods/d986740e-705c-41b1-9a49-f7bda99aff08/volumes"
Sep 07 04:05:25.881926 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:25.881892    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9"]
Sep 07 04:05:25.882332 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:25.882194    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9" podUID="0a36e0d0-6bd7-402a-b195-bd3819c6e507" containerName="istio-proxy" containerID="cri-o://c93460ca263ec648b5de6f6338abd49ec9e6f40ae664200da14c8d4d73b756ab" gracePeriod=30
Sep 07 04:05:25.896812 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:25.896785    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-434d57-6fdf76666-mqqph"
Sep 07 04:05:25.896946 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:25.896875    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-434d57-85f79bfcd7-db8vt"
Sep 07 04:05:26.899760 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:26.899721    2559 patch_prober.go:28] interesting pod/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 07 04:05:26.900136 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:26.899788    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj" podUID="77a7cd30-a31b-415b-b454-69ff3c05a42e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 07 04:05:27.981467 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:27.981386    2559 generic.go:356] "Generic (PLEG): container finished" podID="77a7cd30-a31b-415b-b454-69ff3c05a42e" containerID="33c092d4737e7b1d1423752994434341c5a1c7301b7dab838609cc4d27a72b3f" exitCode=0
Sep 07 04:05:27.981930 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:27.981467    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj" event={"ID":"77a7cd30-a31b-415b-b454-69ff3c05a42e","Type":"ContainerDied","Data":"33c092d4737e7b1d1423752994434341c5a1c7301b7dab838609cc4d27a72b3f"}
Sep 07 04:05:27.982001 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:27.981971    2559 scope.go:117] "RemoveContainer" containerID="33c092d4737e7b1d1423752994434341c5a1c7301b7dab838609cc4d27a72b3f"
Sep 07 04:05:27.983009 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:27.982983    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 04:05:27.983074 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:27.983062    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 04:05:27.983111 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:27.983094    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 04:05:28.989347 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:28.989312    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj" event={"ID":"77a7cd30-a31b-415b-b454-69ff3c05a42e","Type":"ContainerStarted","Data":"f01abc945030d1f5551793e364c64eddc79fae0498bb1a8d4de9f5785dad97cf"}
Sep 07 04:05:29.651049 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:29.651001    2559 patch_prober.go:28] interesting pod/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 07 04:05:29.652034 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:29.651077    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9" podUID="0a36e0d0-6bd7-402a-b195-bd3819c6e507" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 07 04:05:29.777849 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:29.777819    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj"
Sep 07 04:05:29.778012 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:29.777992    2559 patch_prober.go:28] interesting pod/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 07 04:05:29.778061 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:29.778038    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj" podUID="77a7cd30-a31b-415b-b454-69ff3c05a42e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 07 04:05:30.777324 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:30.777286    2559 patch_prober.go:28] interesting pod/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 07 04:05:30.777730 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:30.777345    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj" podUID="77a7cd30-a31b-415b-b454-69ff3c05a42e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 07 04:05:31.006111 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:31.006083    2559 generic.go:356] "Generic (PLEG): container finished" podID="0a36e0d0-6bd7-402a-b195-bd3819c6e507" containerID="c93460ca263ec648b5de6f6338abd49ec9e6f40ae664200da14c8d4d73b756ab" exitCode=0
Sep 07 04:05:31.006217 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:31.006127    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9" event={"ID":"0a36e0d0-6bd7-402a-b195-bd3819c6e507","Type":"ContainerDied","Data":"c93460ca263ec648b5de6f6338abd49ec9e6f40ae664200da14c8d4d73b756ab"}
Sep 07 04:05:31.006217 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:31.006206    2559 scope.go:117] "RemoveContainer" containerID="db9a992342a500244d856daa385db32ed4916c7ee9d509161dd503cbcbbae658"
Sep 07 04:05:31.169860 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:31.169830    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9"
Sep 07 04:05:31.186864 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:31.186840    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wh4gd\" (UniqueName: \"kubernetes.io/projected/0a36e0d0-6bd7-402a-b195-bd3819c6e507-kube-api-access-wh4gd\") pod \"0a36e0d0-6bd7-402a-b195-bd3819c6e507\" (UID: \"0a36e0d0-6bd7-402a-b195-bd3819c6e507\") "
Sep 07 04:05:31.186978 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:31.186875    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a36e0d0-6bd7-402a-b195-bd3819c6e507-workload-certs\") pod \"0a36e0d0-6bd7-402a-b195-bd3819c6e507\" (UID: \"0a36e0d0-6bd7-402a-b195-bd3819c6e507\") "
Sep 07 04:05:31.186978 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:31.186891    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a36e0d0-6bd7-402a-b195-bd3819c6e507-istio-token\") pod \"0a36e0d0-6bd7-402a-b195-bd3819c6e507\" (UID: \"0a36e0d0-6bd7-402a-b195-bd3819c6e507\") "
Sep 07 04:05:31.186978 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:31.186920    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a36e0d0-6bd7-402a-b195-bd3819c6e507-credential-socket\") pod \"0a36e0d0-6bd7-402a-b195-bd3819c6e507\" (UID: \"0a36e0d0-6bd7-402a-b195-bd3819c6e507\") "
Sep 07 04:05:31.186978 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:31.186964    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a36e0d0-6bd7-402a-b195-bd3819c6e507-workload-socket\") pod \"0a36e0d0-6bd7-402a-b195-bd3819c6e507\" (UID: \"0a36e0d0-6bd7-402a-b195-bd3819c6e507\") "
Sep 07 04:05:31.187214 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:31.187035    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a36e0d0-6bd7-402a-b195-bd3819c6e507-istio-envoy\") pod \"0a36e0d0-6bd7-402a-b195-bd3819c6e507\" (UID: \"0a36e0d0-6bd7-402a-b195-bd3819c6e507\") "
Sep 07 04:05:31.187214 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:31.187061    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a36e0d0-6bd7-402a-b195-bd3819c6e507-istio-data\") pod \"0a36e0d0-6bd7-402a-b195-bd3819c6e507\" (UID: \"0a36e0d0-6bd7-402a-b195-bd3819c6e507\") "
Sep 07 04:05:31.187214 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:31.187200    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a36e0d0-6bd7-402a-b195-bd3819c6e507-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0a36e0d0-6bd7-402a-b195-bd3819c6e507" (UID: "0a36e0d0-6bd7-402a-b195-bd3819c6e507"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:05:31.187360 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:31.187219    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a36e0d0-6bd7-402a-b195-bd3819c6e507-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0a36e0d0-6bd7-402a-b195-bd3819c6e507" (UID: "0a36e0d0-6bd7-402a-b195-bd3819c6e507"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:05:31.187360 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:31.187338    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a36e0d0-6bd7-402a-b195-bd3819c6e507-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0a36e0d0-6bd7-402a-b195-bd3819c6e507" (UID: "0a36e0d0-6bd7-402a-b195-bd3819c6e507"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:05:31.187483 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:31.187462    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a36e0d0-6bd7-402a-b195-bd3819c6e507-istiod-ca-cert\") pod \"0a36e0d0-6bd7-402a-b195-bd3819c6e507\" (UID: \"0a36e0d0-6bd7-402a-b195-bd3819c6e507\") "
Sep 07 04:05:31.187879 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:31.187508    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a36e0d0-6bd7-402a-b195-bd3819c6e507-istio-data" (OuterVolumeSpecName: "istio-data") pod "0a36e0d0-6bd7-402a-b195-bd3819c6e507" (UID: "0a36e0d0-6bd7-402a-b195-bd3819c6e507"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:05:31.187879 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:31.187579    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a36e0d0-6bd7-402a-b195-bd3819c6e507-istio-podinfo\") pod \"0a36e0d0-6bd7-402a-b195-bd3819c6e507\" (UID: \"0a36e0d0-6bd7-402a-b195-bd3819c6e507\") "
Sep 07 04:05:31.187879 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:31.187818    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a36e0d0-6bd7-402a-b195-bd3819c6e507-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0a36e0d0-6bd7-402a-b195-bd3819c6e507" (UID: "0a36e0d0-6bd7-402a-b195-bd3819c6e507"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 04:05:31.188119 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:31.187974    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a36e0d0-6bd7-402a-b195-bd3819c6e507-istiod-ca-cert\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:05:31.188119 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:31.187994    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a36e0d0-6bd7-402a-b195-bd3819c6e507-workload-certs\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:05:31.188119 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:31.188007    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a36e0d0-6bd7-402a-b195-bd3819c6e507-credential-socket\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:05:31.188119 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:31.188021    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a36e0d0-6bd7-402a-b195-bd3819c6e507-workload-socket\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:05:31.188119 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:31.188034    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a36e0d0-6bd7-402a-b195-bd3819c6e507-istio-data\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:05:31.190283 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:31.189907    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a36e0d0-6bd7-402a-b195-bd3819c6e507-kube-api-access-wh4gd" (OuterVolumeSpecName: "kube-api-access-wh4gd") pod "0a36e0d0-6bd7-402a-b195-bd3819c6e507" (UID: "0a36e0d0-6bd7-402a-b195-bd3819c6e507"). InnerVolumeSpecName "kube-api-access-wh4gd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 04:05:31.190283 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:31.190243    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a36e0d0-6bd7-402a-b195-bd3819c6e507-istio-token" (OuterVolumeSpecName: "istio-token") pod "0a36e0d0-6bd7-402a-b195-bd3819c6e507" (UID: "0a36e0d0-6bd7-402a-b195-bd3819c6e507"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 04:05:31.191147 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:31.190328    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0a36e0d0-6bd7-402a-b195-bd3819c6e507-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0a36e0d0-6bd7-402a-b195-bd3819c6e507" (UID: "0a36e0d0-6bd7-402a-b195-bd3819c6e507"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 04:05:31.191147 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:31.190557    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a36e0d0-6bd7-402a-b195-bd3819c6e507-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0a36e0d0-6bd7-402a-b195-bd3819c6e507" (UID: "0a36e0d0-6bd7-402a-b195-bd3819c6e507"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:05:31.288689 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:31.288666    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wh4gd\" (UniqueName: \"kubernetes.io/projected/0a36e0d0-6bd7-402a-b195-bd3819c6e507-kube-api-access-wh4gd\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:05:31.288689 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:31.288688    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a36e0d0-6bd7-402a-b195-bd3819c6e507-istio-token\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:05:31.288847 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:31.288697    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a36e0d0-6bd7-402a-b195-bd3819c6e507-istio-envoy\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:05:31.288847 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:31.288705    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a36e0d0-6bd7-402a-b195-bd3819c6e507-istio-podinfo\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:05:31.778085 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:31.778045    2559 patch_prober.go:28] interesting pod/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 07 04:05:31.778491 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:31.778118    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj" podUID="77a7cd30-a31b-415b-b454-69ff3c05a42e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 07 04:05:32.013777 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:32.013745    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9"
Sep 07 04:05:32.013939 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:32.013780    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9" event={"ID":"0a36e0d0-6bd7-402a-b195-bd3819c6e507","Type":"ContainerDied","Data":"a244b50a566bcc6ede19367a5fa142f9e77f8743ba615d9ec298a96ec970ccdf"}
Sep 07 04:05:32.013939 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:32.013841    2559 scope.go:117] "RemoveContainer" containerID="c93460ca263ec648b5de6f6338abd49ec9e6f40ae664200da14c8d4d73b756ab"
Sep 07 04:05:32.038479 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:32.038414    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9"]
Sep 07 04:05:32.046643 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:32.042745    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9"]
Sep 07 04:05:32.778041 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:32.778005    2559 patch_prober.go:28] interesting pod/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 07 04:05:32.778212 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:32.778071    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj" podUID="77a7cd30-a31b-415b-b454-69ff3c05a42e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 07 04:05:33.179340 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:33.179309    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a36e0d0-6bd7-402a-b195-bd3819c6e507" path="/var/lib/kubelet/pods/0a36e0d0-6bd7-402a-b195-bd3819c6e507/volumes"
Sep 07 04:05:33.777486 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:33.777453    2559 patch_prober.go:28] interesting pod/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 07 04:05:33.777693 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:33.777518    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj" podUID="77a7cd30-a31b-415b-b454-69ff3c05a42e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 07 04:05:34.781359 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:34.781326    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj"
Sep 07 04:05:34.781781 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:34.781729    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj"
Sep 07 04:05:34.782361 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:34.782341    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj"
Sep 07 04:05:39.220359 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:39.220325    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv"]
Sep 07 04:05:39.220786 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:39.220712    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a36e0d0-6bd7-402a-b195-bd3819c6e507" containerName="istio-proxy"
Sep 07 04:05:39.220786 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:39.220730    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a36e0d0-6bd7-402a-b195-bd3819c6e507" containerName="istio-proxy"
Sep 07 04:05:39.220786 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:39.220739    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a36e0d0-6bd7-402a-b195-bd3819c6e507" containerName="istio-proxy"
Sep 07 04:05:39.220786 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:39.220745    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a36e0d0-6bd7-402a-b195-bd3819c6e507" containerName="istio-proxy"
Sep 07 04:05:39.220786 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:39.220764    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e68e78a-15ad-4a28-bcfa-d81a76136469" containerName="payload-pre-processing"
Sep 07 04:05:39.220786 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:39.220770    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e68e78a-15ad-4a28-bcfa-d81a76136469" containerName="payload-pre-processing"
Sep 07 04:05:39.220786 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:39.220782    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fe99118-71d0-4055-9346-5a4e3a29c5a4" containerName="payload-processing"
Sep 07 04:05:39.220786 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:39.220789    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fe99118-71d0-4055-9346-5a4e3a29c5a4" containerName="payload-processing"
Sep 07 04:05:39.221067 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:39.220850    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a36e0d0-6bd7-402a-b195-bd3819c6e507" containerName="istio-proxy"
Sep 07 04:05:39.221067 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:39.220859    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a36e0d0-6bd7-402a-b195-bd3819c6e507" containerName="istio-proxy"
Sep 07 04:05:39.221067 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:39.220868    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e68e78a-15ad-4a28-bcfa-d81a76136469" containerName="payload-pre-processing"
Sep 07 04:05:39.221067 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:39.220879    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fe99118-71d0-4055-9346-5a4e3a29c5a4" containerName="payload-processing"
Sep 07 04:05:39.225151 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:39.225131    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv"
Sep 07 04:05:39.227078 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:39.227061    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-747fee-openshift-default-dockercfg-lkrzt\""
Sep 07 04:05:39.233654 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:39.233611    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv"]
Sep 07 04:05:39.260457 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:39.260434    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49e003d0-feaa-4814-b10c-daf640f65527-istiod-ca-cert\") pod \"e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv\" (UID: \"49e003d0-feaa-4814-b10c-daf640f65527\") " pod="openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv"
Sep 07 04:05:39.260552 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:39.260468    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5hrb\" (UniqueName: \"kubernetes.io/projected/49e003d0-feaa-4814-b10c-daf640f65527-kube-api-access-m5hrb\") pod \"e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv\" (UID: \"49e003d0-feaa-4814-b10c-daf640f65527\") " pod="openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv"
Sep 07 04:05:39.260552 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:39.260498    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49e003d0-feaa-4814-b10c-daf640f65527-istio-data\") pod \"e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv\" (UID: \"49e003d0-feaa-4814-b10c-daf640f65527\") " pod="openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv"
Sep 07 04:05:39.260552 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:39.260547    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49e003d0-feaa-4814-b10c-daf640f65527-istio-envoy\") pod \"e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv\" (UID: \"49e003d0-feaa-4814-b10c-daf640f65527\") " pod="openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv"
Sep 07 04:05:39.260716 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:39.260590    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49e003d0-feaa-4814-b10c-daf640f65527-workload-socket\") pod \"e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv\" (UID: \"49e003d0-feaa-4814-b10c-daf640f65527\") " pod="openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv"
Sep 07 04:05:39.260716 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:39.260646    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49e003d0-feaa-4814-b10c-daf640f65527-istio-token\") pod \"e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv\" (UID: \"49e003d0-feaa-4814-b10c-daf640f65527\") " pod="openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv"
Sep 07 04:05:39.260716 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:39.260670    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49e003d0-feaa-4814-b10c-daf640f65527-istio-podinfo\") pod \"e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv\" (UID: \"49e003d0-feaa-4814-b10c-daf640f65527\") " pod="openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv"
Sep 07 04:05:39.260841 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:39.260725    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49e003d0-feaa-4814-b10c-daf640f65527-credential-socket\") pod \"e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv\" (UID: \"49e003d0-feaa-4814-b10c-daf640f65527\") " pod="openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv"
Sep 07 04:05:39.260841 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:39.260761    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49e003d0-feaa-4814-b10c-daf640f65527-workload-certs\") pod \"e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv\" (UID: \"49e003d0-feaa-4814-b10c-daf640f65527\") " pod="openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv"
Sep 07 04:05:39.361984 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:39.361946    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49e003d0-feaa-4814-b10c-daf640f65527-workload-certs\") pod \"e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv\" (UID: \"49e003d0-feaa-4814-b10c-daf640f65527\") " pod="openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv"
Sep 07 04:05:39.362172 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:39.361996    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49e003d0-feaa-4814-b10c-daf640f65527-istiod-ca-cert\") pod \"e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv\" (UID: \"49e003d0-feaa-4814-b10c-daf640f65527\") " pod="openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv"
Sep 07 04:05:39.362172 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:39.362016    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5hrb\" (UniqueName: \"kubernetes.io/projected/49e003d0-feaa-4814-b10c-daf640f65527-kube-api-access-m5hrb\") pod \"e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv\" (UID: \"49e003d0-feaa-4814-b10c-daf640f65527\") " pod="openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv"
Sep 07 04:05:39.362172 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:39.362042    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49e003d0-feaa-4814-b10c-daf640f65527-istio-data\") pod \"e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv\" (UID: \"49e003d0-feaa-4814-b10c-daf640f65527\") " pod="openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv"
Sep 07 04:05:39.362172 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:39.362063    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49e003d0-feaa-4814-b10c-daf640f65527-istio-envoy\") pod \"e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv\" (UID: \"49e003d0-feaa-4814-b10c-daf640f65527\") " pod="openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv"
Sep 07 04:05:39.362172 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:39.362092    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49e003d0-feaa-4814-b10c-daf640f65527-workload-socket\") pod \"e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv\" (UID: \"49e003d0-feaa-4814-b10c-daf640f65527\") " pod="openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv"
Sep 07 04:05:39.362172 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:39.362137    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49e003d0-feaa-4814-b10c-daf640f65527-istio-token\") pod \"e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv\" (UID: \"49e003d0-feaa-4814-b10c-daf640f65527\") " pod="openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv"
Sep 07 04:05:39.362540 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:39.362184    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49e003d0-feaa-4814-b10c-daf640f65527-istio-podinfo\") pod \"e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv\" (UID: \"49e003d0-feaa-4814-b10c-daf640f65527\") " pod="openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv"
Sep 07 04:05:39.362540 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:39.362406    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49e003d0-feaa-4814-b10c-daf640f65527-workload-certs\") pod \"e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv\" (UID: \"49e003d0-feaa-4814-b10c-daf640f65527\") " pod="openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv"
Sep 07 04:05:39.362540 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:39.362431    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49e003d0-feaa-4814-b10c-daf640f65527-istio-data\") pod \"e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv\" (UID: \"49e003d0-feaa-4814-b10c-daf640f65527\") " pod="openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv"
Sep 07 04:05:39.362540 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:39.362462    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49e003d0-feaa-4814-b10c-daf640f65527-credential-socket\") pod \"e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv\" (UID: \"49e003d0-feaa-4814-b10c-daf640f65527\") " pod="openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv"
Sep 07 04:05:39.362540 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:39.362495    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49e003d0-feaa-4814-b10c-daf640f65527-workload-socket\") pod \"e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv\" (UID: \"49e003d0-feaa-4814-b10c-daf640f65527\") " pod="openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv"
Sep 07 04:05:39.362838 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:39.362738    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49e003d0-feaa-4814-b10c-daf640f65527-credential-socket\") pod \"e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv\" (UID: \"49e003d0-feaa-4814-b10c-daf640f65527\") " pod="openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv"
Sep 07 04:05:39.362838 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:39.362802    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49e003d0-feaa-4814-b10c-daf640f65527-istiod-ca-cert\") pod \"e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv\" (UID: \"49e003d0-feaa-4814-b10c-daf640f65527\") " pod="openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv"
Sep 07 04:05:39.364272 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:39.364251    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49e003d0-feaa-4814-b10c-daf640f65527-istio-envoy\") pod \"e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv\" (UID: \"49e003d0-feaa-4814-b10c-daf640f65527\") " pod="openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv"
Sep 07 04:05:39.364720 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:39.364702    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49e003d0-feaa-4814-b10c-daf640f65527-istio-podinfo\") pod \"e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv\" (UID: \"49e003d0-feaa-4814-b10c-daf640f65527\") " pod="openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv"
Sep 07 04:05:39.368914 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:39.368889    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49e003d0-feaa-4814-b10c-daf640f65527-istio-token\") pod \"e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv\" (UID: \"49e003d0-feaa-4814-b10c-daf640f65527\") " pod="openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv"
Sep 07 04:05:39.369081 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:39.369066    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5hrb\" (UniqueName: \"kubernetes.io/projected/49e003d0-feaa-4814-b10c-daf640f65527-kube-api-access-m5hrb\") pod \"e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv\" (UID: \"49e003d0-feaa-4814-b10c-daf640f65527\") " pod="openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv"
Sep 07 04:05:39.536456 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:39.536397    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv"
Sep 07 04:05:39.811383 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:39.811361    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv"]
Sep 07 04:05:39.813029 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:05:39.812996    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49e003d0_feaa_4814_b10c_daf640f65527.slice/crio-e6885fc49a05baf25131faa80c5e4c2c53e10f5fdfbf5fbb924db22cac69deed WatchSource:0}: Error finding container e6885fc49a05baf25131faa80c5e4c2c53e10f5fdfbf5fbb924db22cac69deed: Status 404 returned error can't find the container with id e6885fc49a05baf25131faa80c5e4c2c53e10f5fdfbf5fbb924db22cac69deed
Sep 07 04:05:39.816554 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:39.816510    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 04:05:39.816721 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:39.816592    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 04:05:39.816721 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:39.816663    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 04:05:40.066788 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:40.066694    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv" event={"ID":"49e003d0-feaa-4814-b10c-daf640f65527","Type":"ContainerStarted","Data":"66f09b0dc3332ec23e5e8cc99e7801b69262f2d5edd2409fa2593eb860c90ebd"}
Sep 07 04:05:40.066957 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:40.066789    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv" event={"ID":"49e003d0-feaa-4814-b10c-daf640f65527","Type":"ContainerStarted","Data":"e6885fc49a05baf25131faa80c5e4c2c53e10f5fdfbf5fbb924db22cac69deed"}
Sep 07 04:05:40.083575 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:40.083514    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv" podStartSLOduration=1.083495546 podStartE2EDuration="1.083495546s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:05:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:05:40.082396109 +0000 UTC m=+1043.394872020" watchObservedRunningTime="2026-09-07 04:05:40.083495546 +0000 UTC m=+1043.395971470"
Sep 07 04:05:40.537274 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:40.537245    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv"
Sep 07 04:05:40.541982 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:40.541957    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv"
Sep 07 04:05:41.073351 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:41.073321    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv"
Sep 07 04:05:41.074313 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:41.074291    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv"
Sep 07 04:05:43.655532 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:43.655494    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-747fee-6bccf85d6b-ww5g5"]
Sep 07 04:05:43.659265 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:43.659243    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-747fee-6bccf85d6b-ww5g5"
Sep 07 04:05:43.661136 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:43.661116    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-747fee-dockercfg-sjqvh\""
Sep 07 04:05:43.661230 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:43.661153    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-747fee\""
Sep 07 04:05:43.669830 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:43.669809    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-747fee-6bccf85d6b-ww5g5"]
Sep 07 04:05:43.692146 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:43.692120    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-747fee-66566c8f57-4z8lp"]
Sep 07 04:05:43.696298 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:43.696280    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-747fee-66566c8f57-4z8lp"
Sep 07 04:05:43.702725 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:43.702688    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-747fee-66566c8f57-4z8lp"]
Sep 07 04:05:43.705772 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:43.705752    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwfsk\" (UniqueName: \"kubernetes.io/projected/b2d0c189-7fb1-4840-bef9-932be36977fe-kube-api-access-xwfsk\") pod \"payload-pre-processing-e2e-shared-a-w2-747fee-6bccf85d6b-ww5g5\" (UID: \"b2d0c189-7fb1-4840-bef9-932be36977fe\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-747fee-6bccf85d6b-ww5g5"
Sep 07 04:05:43.705859 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:43.705848    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2d0c189-7fb1-4840-bef9-932be36977fe-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-747fee-6bccf85d6b-ww5g5\" (UID: \"b2d0c189-7fb1-4840-bef9-932be36977fe\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-747fee-6bccf85d6b-ww5g5"
Sep 07 04:05:43.807195 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:43.807153    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwfsk\" (UniqueName: \"kubernetes.io/projected/b2d0c189-7fb1-4840-bef9-932be36977fe-kube-api-access-xwfsk\") pod \"payload-pre-processing-e2e-shared-a-w2-747fee-6bccf85d6b-ww5g5\" (UID: \"b2d0c189-7fb1-4840-bef9-932be36977fe\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-747fee-6bccf85d6b-ww5g5"
Sep 07 04:05:43.807369 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:43.807233    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md95c\" (UniqueName: \"kubernetes.io/projected/d608cb95-04bb-4d4e-bccd-31a68ef5504e-kube-api-access-md95c\") pod \"payload-processing-e2e-shared-a-w2-747fee-66566c8f57-4z8lp\" (UID: \"d608cb95-04bb-4d4e-bccd-31a68ef5504e\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-747fee-66566c8f57-4z8lp"
Sep 07 04:05:43.807369 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:43.807257    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d608cb95-04bb-4d4e-bccd-31a68ef5504e-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-747fee-66566c8f57-4z8lp\" (UID: \"d608cb95-04bb-4d4e-bccd-31a68ef5504e\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-747fee-66566c8f57-4z8lp"
Sep 07 04:05:43.807369 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:43.807278    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2d0c189-7fb1-4840-bef9-932be36977fe-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-747fee-6bccf85d6b-ww5g5\" (UID: \"b2d0c189-7fb1-4840-bef9-932be36977fe\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-747fee-6bccf85d6b-ww5g5"
Sep 07 04:05:43.808023 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:43.808000    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2d0c189-7fb1-4840-bef9-932be36977fe-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-747fee-6bccf85d6b-ww5g5\" (UID: \"b2d0c189-7fb1-4840-bef9-932be36977fe\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-747fee-6bccf85d6b-ww5g5"
Sep 07 04:05:43.814541 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:43.814517    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwfsk\" (UniqueName: \"kubernetes.io/projected/b2d0c189-7fb1-4840-bef9-932be36977fe-kube-api-access-xwfsk\") pod \"payload-pre-processing-e2e-shared-a-w2-747fee-6bccf85d6b-ww5g5\" (UID: \"b2d0c189-7fb1-4840-bef9-932be36977fe\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-747fee-6bccf85d6b-ww5g5"
Sep 07 04:05:43.907915 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:43.907846    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md95c\" (UniqueName: \"kubernetes.io/projected/d608cb95-04bb-4d4e-bccd-31a68ef5504e-kube-api-access-md95c\") pod \"payload-processing-e2e-shared-a-w2-747fee-66566c8f57-4z8lp\" (UID: \"d608cb95-04bb-4d4e-bccd-31a68ef5504e\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-747fee-66566c8f57-4z8lp"
Sep 07 04:05:43.907915 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:43.907890    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d608cb95-04bb-4d4e-bccd-31a68ef5504e-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-747fee-66566c8f57-4z8lp\" (UID: \"d608cb95-04bb-4d4e-bccd-31a68ef5504e\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-747fee-66566c8f57-4z8lp"
Sep 07 04:05:43.908498 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:43.908477    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d608cb95-04bb-4d4e-bccd-31a68ef5504e-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-747fee-66566c8f57-4z8lp\" (UID: \"d608cb95-04bb-4d4e-bccd-31a68ef5504e\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-747fee-66566c8f57-4z8lp"
Sep 07 04:05:43.915318 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:43.915291    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-md95c\" (UniqueName: \"kubernetes.io/projected/d608cb95-04bb-4d4e-bccd-31a68ef5504e-kube-api-access-md95c\") pod \"payload-processing-e2e-shared-a-w2-747fee-66566c8f57-4z8lp\" (UID: \"d608cb95-04bb-4d4e-bccd-31a68ef5504e\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-747fee-66566c8f57-4z8lp"
Sep 07 04:05:43.971727 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:43.971699    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-747fee-6bccf85d6b-ww5g5"
Sep 07 04:05:44.007401 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:44.007376    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-747fee-66566c8f57-4z8lp"
Sep 07 04:05:44.244534 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:44.244511    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-747fee-6bccf85d6b-ww5g5"]
Sep 07 04:05:44.245521 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:05:44.245498    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2d0c189_7fb1_4840_bef9_932be36977fe.slice/crio-453d0d5c1943bc1069844d5b8570b54480489daa442fe0227b7464aea8a4aa0c WatchSource:0}: Error finding container 453d0d5c1943bc1069844d5b8570b54480489daa442fe0227b7464aea8a4aa0c: Status 404 returned error can't find the container with id 453d0d5c1943bc1069844d5b8570b54480489daa442fe0227b7464aea8a4aa0c
Sep 07 04:05:44.287395 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:44.287368    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-747fee-66566c8f57-4z8lp"]
Sep 07 04:05:44.287923 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:05:44.287899    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd608cb95_04bb_4d4e_bccd_31a68ef5504e.slice/crio-70810c9a096f734323b8d23fc05b74d59ef2d6e4d178bd7b55af3cc70c2ef0a7 WatchSource:0}: Error finding container 70810c9a096f734323b8d23fc05b74d59ef2d6e4d178bd7b55af3cc70c2ef0a7: Status 404 returned error can't find the container with id 70810c9a096f734323b8d23fc05b74d59ef2d6e4d178bd7b55af3cc70c2ef0a7
Sep 07 04:05:45.101071 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:45.101031    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-747fee-6bccf85d6b-ww5g5" event={"ID":"b2d0c189-7fb1-4840-bef9-932be36977fe","Type":"ContainerStarted","Data":"a9c845bc470a078b7cb59b617736d5fd6d1934e6581cfb46fe4a8c00f0077fb4"}
Sep 07 04:05:45.101551 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:45.101134    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-747fee-6bccf85d6b-ww5g5"
Sep 07 04:05:45.101551 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:45.101157    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-747fee-6bccf85d6b-ww5g5" event={"ID":"b2d0c189-7fb1-4840-bef9-932be36977fe","Type":"ContainerStarted","Data":"453d0d5c1943bc1069844d5b8570b54480489daa442fe0227b7464aea8a4aa0c"}
Sep 07 04:05:45.102848 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:45.102824    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-747fee-66566c8f57-4z8lp" event={"ID":"d608cb95-04bb-4d4e-bccd-31a68ef5504e","Type":"ContainerStarted","Data":"426ce6a2af39915f5f788c096f967cd952d6037af13585f0d24d3d20bcb7beaa"}
Sep 07 04:05:45.102959 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:45.102874    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-747fee-66566c8f57-4z8lp"
Sep 07 04:05:45.102959 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:45.102892    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-747fee-66566c8f57-4z8lp" event={"ID":"d608cb95-04bb-4d4e-bccd-31a68ef5504e","Type":"ContainerStarted","Data":"70810c9a096f734323b8d23fc05b74d59ef2d6e4d178bd7b55af3cc70c2ef0a7"}
Sep 07 04:05:45.120737 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:45.120694    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-747fee-6bccf85d6b-ww5g5" podStartSLOduration=2.120679557 podStartE2EDuration="2.120679557s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:05:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:05:45.118190183 +0000 UTC m=+1048.430666091" watchObservedRunningTime="2026-09-07 04:05:45.120679557 +0000 UTC m=+1048.433155459"
Sep 07 04:05:45.133277 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:45.133239    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-747fee-66566c8f57-4z8lp" podStartSLOduration=2.133225473 podStartE2EDuration="2.133225473s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:05:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:05:45.131246251 +0000 UTC m=+1048.443722151" watchObservedRunningTime="2026-09-07 04:05:45.133225473 +0000 UTC m=+1048.445701371"
Sep 07 04:05:56.111174 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:56.111141    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-747fee-66566c8f57-4z8lp"
Sep 07 04:05:56.111717 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:56.111227    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-747fee-6bccf85d6b-ww5g5"
Sep 07 04:05:57.114757 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:57.114725    2559 patch_prober.go:28] interesting pod/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 07 04:05:57.115108 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:57.114775    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv" podUID="49e003d0-feaa-4814-b10c-daf640f65527" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 07 04:05:58.194596 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:58.194525    2559 generic.go:356] "Generic (PLEG): container finished" podID="49e003d0-feaa-4814-b10c-daf640f65527" containerID="66f09b0dc3332ec23e5e8cc99e7801b69262f2d5edd2409fa2593eb860c90ebd" exitCode=0
Sep 07 04:05:58.195030 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:58.194600    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv" event={"ID":"49e003d0-feaa-4814-b10c-daf640f65527","Type":"ContainerDied","Data":"66f09b0dc3332ec23e5e8cc99e7801b69262f2d5edd2409fa2593eb860c90ebd"}
Sep 07 04:05:58.195181 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:58.195162    2559 scope.go:117] "RemoveContainer" containerID="66f09b0dc3332ec23e5e8cc99e7801b69262f2d5edd2409fa2593eb860c90ebd"
Sep 07 04:05:58.196289 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:58.196259    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 04:05:58.196357 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:58.196335    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 04:05:58.196398 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:58.196368    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 04:05:59.202378 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:59.202343    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv" event={"ID":"49e003d0-feaa-4814-b10c-daf640f65527","Type":"ContainerStarted","Data":"02e4da9b62cfc76bcd664ab1c59689db55a56d8e6e5ec7aebb8b379e1dab3734"}
Sep 07 04:05:59.537324 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:59.537225    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv"
Sep 07 04:05:59.537719 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:59.537616    2559 patch_prober.go:28] interesting pod/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 07 04:05:59.537892 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:05:59.537869    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv" podUID="49e003d0-feaa-4814-b10c-daf640f65527" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 07 04:06:00.537020 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:00.536984    2559 patch_prober.go:28] interesting pod/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 07 04:06:00.537609 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:00.537577    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv" podUID="49e003d0-feaa-4814-b10c-daf640f65527" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 07 04:06:01.537497 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:01.537444    2559 patch_prober.go:28] interesting pod/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 07 04:06:01.538006 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:01.537520    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv" podUID="49e003d0-feaa-4814-b10c-daf640f65527" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 07 04:06:02.537366 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:02.537327    2559 patch_prober.go:28] interesting pod/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 07 04:06:02.537715 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:02.537682    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv" podUID="49e003d0-feaa-4814-b10c-daf640f65527" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 07 04:06:03.537914 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:03.537868    2559 patch_prober.go:28] interesting pod/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 07 04:06:03.538398 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:03.537972    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv" podUID="49e003d0-feaa-4814-b10c-daf640f65527" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 07 04:06:04.540842 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:04.540809    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv"
Sep 07 04:06:04.541246 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:04.541182    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv"
Sep 07 04:06:04.541811 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:04.541789    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv"
Sep 07 04:06:07.507291 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:07.507259    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk"]
Sep 07 04:06:07.509802 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:07.509785    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk"
Sep 07 04:06:07.511765 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:07.511742    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-a89024-openshift-default-dockercfg-5p7kz\""
Sep 07 04:06:07.522314 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:07.522291    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk"]
Sep 07 04:06:07.528182 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:07.528154    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4g9q\" (UniqueName: \"kubernetes.io/projected/9bacc8c6-79f9-44b6-998f-6cef08ea02ec-kube-api-access-d4g9q\") pod \"e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk\" (UID: \"9bacc8c6-79f9-44b6-998f-6cef08ea02ec\") " pod="openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk"
Sep 07 04:06:07.528289 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:07.528201    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bacc8c6-79f9-44b6-998f-6cef08ea02ec-istio-data\") pod \"e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk\" (UID: \"9bacc8c6-79f9-44b6-998f-6cef08ea02ec\") " pod="openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk"
Sep 07 04:06:07.528289 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:07.528231    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bacc8c6-79f9-44b6-998f-6cef08ea02ec-istiod-ca-cert\") pod \"e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk\" (UID: \"9bacc8c6-79f9-44b6-998f-6cef08ea02ec\") " pod="openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk"
Sep 07 04:06:07.528289 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:07.528282    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bacc8c6-79f9-44b6-998f-6cef08ea02ec-credential-socket\") pod \"e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk\" (UID: \"9bacc8c6-79f9-44b6-998f-6cef08ea02ec\") " pod="openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk"
Sep 07 04:06:07.528468 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:07.528334    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bacc8c6-79f9-44b6-998f-6cef08ea02ec-istio-token\") pod \"e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk\" (UID: \"9bacc8c6-79f9-44b6-998f-6cef08ea02ec\") " pod="openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk"
Sep 07 04:06:07.528531 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:07.528454    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bacc8c6-79f9-44b6-998f-6cef08ea02ec-istio-envoy\") pod \"e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk\" (UID: \"9bacc8c6-79f9-44b6-998f-6cef08ea02ec\") " pod="openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk"
Sep 07 04:06:07.528531 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:07.528511    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bacc8c6-79f9-44b6-998f-6cef08ea02ec-workload-certs\") pod \"e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk\" (UID: \"9bacc8c6-79f9-44b6-998f-6cef08ea02ec\") " pod="openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk"
Sep 07 04:06:07.528667 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:07.528554    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bacc8c6-79f9-44b6-998f-6cef08ea02ec-istio-podinfo\") pod \"e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk\" (UID: \"9bacc8c6-79f9-44b6-998f-6cef08ea02ec\") " pod="openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk"
Sep 07 04:06:07.528667 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:07.528584    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bacc8c6-79f9-44b6-998f-6cef08ea02ec-workload-socket\") pod \"e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk\" (UID: \"9bacc8c6-79f9-44b6-998f-6cef08ea02ec\") " pod="openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk"
Sep 07 04:06:07.629547 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:07.629506    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4g9q\" (UniqueName: \"kubernetes.io/projected/9bacc8c6-79f9-44b6-998f-6cef08ea02ec-kube-api-access-d4g9q\") pod \"e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk\" (UID: \"9bacc8c6-79f9-44b6-998f-6cef08ea02ec\") " pod="openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk"
Sep 07 04:06:07.629812 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:07.629775    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bacc8c6-79f9-44b6-998f-6cef08ea02ec-istio-data\") pod \"e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk\" (UID: \"9bacc8c6-79f9-44b6-998f-6cef08ea02ec\") " pod="openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk"
Sep 07 04:06:07.629927 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:07.629857    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bacc8c6-79f9-44b6-998f-6cef08ea02ec-istiod-ca-cert\") pod \"e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk\" (UID: \"9bacc8c6-79f9-44b6-998f-6cef08ea02ec\") " pod="openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk"
Sep 07 04:06:07.629927 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:07.629916    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bacc8c6-79f9-44b6-998f-6cef08ea02ec-credential-socket\") pod \"e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk\" (UID: \"9bacc8c6-79f9-44b6-998f-6cef08ea02ec\") " pod="openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk"
Sep 07 04:06:07.630041 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:07.629955    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bacc8c6-79f9-44b6-998f-6cef08ea02ec-istio-token\") pod \"e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk\" (UID: \"9bacc8c6-79f9-44b6-998f-6cef08ea02ec\") " pod="openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk"
Sep 07 04:06:07.630108 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:07.630042    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bacc8c6-79f9-44b6-998f-6cef08ea02ec-istio-envoy\") pod \"e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk\" (UID: \"9bacc8c6-79f9-44b6-998f-6cef08ea02ec\") " pod="openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk"
Sep 07 04:06:07.630108 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:07.630090    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bacc8c6-79f9-44b6-998f-6cef08ea02ec-workload-certs\") pod \"e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk\" (UID: \"9bacc8c6-79f9-44b6-998f-6cef08ea02ec\") " pod="openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk"
Sep 07 04:06:07.630215 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:07.630128    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bacc8c6-79f9-44b6-998f-6cef08ea02ec-istio-podinfo\") pod \"e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk\" (UID: \"9bacc8c6-79f9-44b6-998f-6cef08ea02ec\") " pod="openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk"
Sep 07 04:06:07.630215 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:07.630160    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bacc8c6-79f9-44b6-998f-6cef08ea02ec-workload-socket\") pod \"e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk\" (UID: \"9bacc8c6-79f9-44b6-998f-6cef08ea02ec\") " pod="openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk"
Sep 07 04:06:07.630559 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:07.630529    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bacc8c6-79f9-44b6-998f-6cef08ea02ec-workload-socket\") pod \"e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk\" (UID: \"9bacc8c6-79f9-44b6-998f-6cef08ea02ec\") " pod="openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk"
Sep 07 04:06:07.630700 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:07.630573    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bacc8c6-79f9-44b6-998f-6cef08ea02ec-istio-data\") pod \"e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk\" (UID: \"9bacc8c6-79f9-44b6-998f-6cef08ea02ec\") " pod="openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk"
Sep 07 04:06:07.631605 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:07.631571    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bacc8c6-79f9-44b6-998f-6cef08ea02ec-credential-socket\") pod \"e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk\" (UID: \"9bacc8c6-79f9-44b6-998f-6cef08ea02ec\") " pod="openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk"
Sep 07 04:06:07.631766 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:07.631744    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bacc8c6-79f9-44b6-998f-6cef08ea02ec-istiod-ca-cert\") pod \"e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk\" (UID: \"9bacc8c6-79f9-44b6-998f-6cef08ea02ec\") " pod="openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk"
Sep 07 04:06:07.631922 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:07.631873    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bacc8c6-79f9-44b6-998f-6cef08ea02ec-workload-certs\") pod \"e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk\" (UID: \"9bacc8c6-79f9-44b6-998f-6cef08ea02ec\") " pod="openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk"
Sep 07 04:06:07.634164 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:07.634139    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bacc8c6-79f9-44b6-998f-6cef08ea02ec-istio-envoy\") pod \"e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk\" (UID: \"9bacc8c6-79f9-44b6-998f-6cef08ea02ec\") " pod="openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk"
Sep 07 04:06:07.634434 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:07.634413    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bacc8c6-79f9-44b6-998f-6cef08ea02ec-istio-podinfo\") pod \"e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk\" (UID: \"9bacc8c6-79f9-44b6-998f-6cef08ea02ec\") " pod="openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk"
Sep 07 04:06:07.637715 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:07.637688    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4g9q\" (UniqueName: \"kubernetes.io/projected/9bacc8c6-79f9-44b6-998f-6cef08ea02ec-kube-api-access-d4g9q\") pod \"e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk\" (UID: \"9bacc8c6-79f9-44b6-998f-6cef08ea02ec\") " pod="openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk"
Sep 07 04:06:07.638044 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:07.638029    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bacc8c6-79f9-44b6-998f-6cef08ea02ec-istio-token\") pod \"e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk\" (UID: \"9bacc8c6-79f9-44b6-998f-6cef08ea02ec\") " pod="openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk"
Sep 07 04:06:07.821099 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:07.821039    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk"
Sep 07 04:06:08.094302 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:08.094274    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk"]
Sep 07 04:06:08.095695 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:06:08.095666    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bacc8c6_79f9_44b6_998f_6cef08ea02ec.slice/crio-245776fdeddd86e68d63c4a8a18f653ffe746f9820ae0beafe696dbacefd36ae WatchSource:0}: Error finding container 245776fdeddd86e68d63c4a8a18f653ffe746f9820ae0beafe696dbacefd36ae: Status 404 returned error can't find the container with id 245776fdeddd86e68d63c4a8a18f653ffe746f9820ae0beafe696dbacefd36ae
Sep 07 04:06:08.097980 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:08.097949    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 04:06:08.098065 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:08.098021    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 04:06:08.098133 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:08.098072    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 04:06:08.266602 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:08.266561    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk" event={"ID":"9bacc8c6-79f9-44b6-998f-6cef08ea02ec","Type":"ContainerStarted","Data":"823f8edd1c5067be80c1d24b8c61b9352c7668c5a6e3ed43cf8e02fef2c3cfd4"}
Sep 07 04:06:08.266776 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:08.266676    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk" event={"ID":"9bacc8c6-79f9-44b6-998f-6cef08ea02ec","Type":"ContainerStarted","Data":"245776fdeddd86e68d63c4a8a18f653ffe746f9820ae0beafe696dbacefd36ae"}
Sep 07 04:06:08.287008 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:08.286959    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk" podStartSLOduration=1.286945603 podStartE2EDuration="1.286945603s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:06:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:06:08.284010202 +0000 UTC m=+1071.596486116" watchObservedRunningTime="2026-09-07 04:06:08.286945603 +0000 UTC m=+1071.599421505"
Sep 07 04:06:08.821742 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:08.821709    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk"
Sep 07 04:06:09.827216 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:09.827126    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk"
Sep 07 04:06:10.280494 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:10.280466    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk"
Sep 07 04:06:10.281352 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:10.281329    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk"
Sep 07 04:06:26.321796 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:26.321760    2559 patch_prober.go:28] interesting pod/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 07 04:06:26.322180 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:26.321833    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk" podUID="9bacc8c6-79f9-44b6-998f-6cef08ea02ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 07 04:06:27.395154 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:27.395120    2559 generic.go:356] "Generic (PLEG): container finished" podID="9bacc8c6-79f9-44b6-998f-6cef08ea02ec" containerID="823f8edd1c5067be80c1d24b8c61b9352c7668c5a6e3ed43cf8e02fef2c3cfd4" exitCode=0
Sep 07 04:06:27.395739 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:27.395199    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk" event={"ID":"9bacc8c6-79f9-44b6-998f-6cef08ea02ec","Type":"ContainerDied","Data":"823f8edd1c5067be80c1d24b8c61b9352c7668c5a6e3ed43cf8e02fef2c3cfd4"}
Sep 07 04:06:27.395739 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:27.395721    2559 scope.go:117] "RemoveContainer" containerID="823f8edd1c5067be80c1d24b8c61b9352c7668c5a6e3ed43cf8e02fef2c3cfd4"
Sep 07 04:06:27.396840 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:27.396811    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 04:06:27.396904 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:27.396876    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 04:06:27.396941 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:27.396907    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 04:06:28.402313 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:28.402279    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk" event={"ID":"9bacc8c6-79f9-44b6-998f-6cef08ea02ec","Type":"ContainerStarted","Data":"fe954df7455cc9bd5e9e397771e0691a5c18dbb6bf8bb94c123145cd58ec0452"}
Sep 07 04:06:28.821797 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:28.821691    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk"
Sep 07 04:06:28.822013 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:28.821989    2559 patch_prober.go:28] interesting pod/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 07 04:06:28.822104 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:28.822045    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk" podUID="9bacc8c6-79f9-44b6-998f-6cef08ea02ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 07 04:06:29.821727 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:29.821692    2559 patch_prober.go:28] interesting pod/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 07 04:06:29.822093 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:29.821741    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk" podUID="9bacc8c6-79f9-44b6-998f-6cef08ea02ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 07 04:06:30.822078 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:30.822041    2559 patch_prober.go:28] interesting pod/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 07 04:06:30.822475 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:30.822095    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk" podUID="9bacc8c6-79f9-44b6-998f-6cef08ea02ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 07 04:06:31.821596 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:31.821554    2559 patch_prober.go:28] interesting pod/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 07 04:06:31.821827 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:31.821640    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk" podUID="9bacc8c6-79f9-44b6-998f-6cef08ea02ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 07 04:06:32.822279 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:32.822238    2559 patch_prober.go:28] interesting pod/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 07 04:06:32.822707 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:32.822297    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk" podUID="9bacc8c6-79f9-44b6-998f-6cef08ea02ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 07 04:06:33.825315 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:33.825280    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk"
Sep 07 04:06:33.825723 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:33.825656    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk"
Sep 07 04:06:33.826342 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:33.826325    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk"
Sep 07 04:06:53.451288 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:53.451256    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-107fc16f-84c775fd5d-mxn8x"]
Sep 07 04:06:53.453579 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:53.453563    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-107fc16f-84c775fd5d-mxn8x"
Sep 07 04:06:53.455488 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:53.455468    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-107fc16f-dockercfg-jqhnm\""
Sep 07 04:06:53.455632 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:53.455510    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-107fc16f\""
Sep 07 04:06:53.464073 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:53.464049    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-107fc16f-84c775fd5d-mxn8x"]
Sep 07 04:06:53.500501 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:53.500481    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-107fc16f-7996c68685-ttdtw"]
Sep 07 04:06:53.509956 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:53.509908    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-107fc16f-7996c68685-ttdtw"
Sep 07 04:06:53.513765 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:53.513740    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-107fc16f-7996c68685-ttdtw"]
Sep 07 04:06:53.549057 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:53.549030    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/312ca555-1544-4fdf-afe7-75ed4495f52f-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-107fc16f-84c775fd5d-mxn8x\" (UID: \"312ca555-1544-4fdf-afe7-75ed4495f52f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-107fc16f-84c775fd5d-mxn8x"
Sep 07 04:06:53.549179 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:53.549093    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1e89f8f-c472-4311-a2af-e2627800a0cf-plugins-config-volume\") pod \"payload-processing-e2e-mt-107fc16f-7996c68685-ttdtw\" (UID: \"d1e89f8f-c472-4311-a2af-e2627800a0cf\") " pod="openshift-ingress/payload-processing-e2e-mt-107fc16f-7996c68685-ttdtw"
Sep 07 04:06:53.549179 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:53.549128    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqb65\" (UniqueName: \"kubernetes.io/projected/d1e89f8f-c472-4311-a2af-e2627800a0cf-kube-api-access-kqb65\") pod \"payload-processing-e2e-mt-107fc16f-7996c68685-ttdtw\" (UID: \"d1e89f8f-c472-4311-a2af-e2627800a0cf\") " pod="openshift-ingress/payload-processing-e2e-mt-107fc16f-7996c68685-ttdtw"
Sep 07 04:06:53.549359 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:53.549177    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghks5\" (UniqueName: \"kubernetes.io/projected/312ca555-1544-4fdf-afe7-75ed4495f52f-kube-api-access-ghks5\") pod \"payload-pre-processing-e2e-mt-107fc16f-84c775fd5d-mxn8x\" (UID: \"312ca555-1544-4fdf-afe7-75ed4495f52f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-107fc16f-84c775fd5d-mxn8x"
Sep 07 04:06:53.649956 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:53.649920    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghks5\" (UniqueName: \"kubernetes.io/projected/312ca555-1544-4fdf-afe7-75ed4495f52f-kube-api-access-ghks5\") pod \"payload-pre-processing-e2e-mt-107fc16f-84c775fd5d-mxn8x\" (UID: \"312ca555-1544-4fdf-afe7-75ed4495f52f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-107fc16f-84c775fd5d-mxn8x"
Sep 07 04:06:53.650148 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:53.650034    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/312ca555-1544-4fdf-afe7-75ed4495f52f-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-107fc16f-84c775fd5d-mxn8x\" (UID: \"312ca555-1544-4fdf-afe7-75ed4495f52f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-107fc16f-84c775fd5d-mxn8x"
Sep 07 04:06:53.650148 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:53.650081    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1e89f8f-c472-4311-a2af-e2627800a0cf-plugins-config-volume\") pod \"payload-processing-e2e-mt-107fc16f-7996c68685-ttdtw\" (UID: \"d1e89f8f-c472-4311-a2af-e2627800a0cf\") " pod="openshift-ingress/payload-processing-e2e-mt-107fc16f-7996c68685-ttdtw"
Sep 07 04:06:53.650148 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:53.650105    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqb65\" (UniqueName: \"kubernetes.io/projected/d1e89f8f-c472-4311-a2af-e2627800a0cf-kube-api-access-kqb65\") pod \"payload-processing-e2e-mt-107fc16f-7996c68685-ttdtw\" (UID: \"d1e89f8f-c472-4311-a2af-e2627800a0cf\") " pod="openshift-ingress/payload-processing-e2e-mt-107fc16f-7996c68685-ttdtw"
Sep 07 04:06:53.650886 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:53.650859    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/312ca555-1544-4fdf-afe7-75ed4495f52f-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-107fc16f-84c775fd5d-mxn8x\" (UID: \"312ca555-1544-4fdf-afe7-75ed4495f52f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-107fc16f-84c775fd5d-mxn8x"
Sep 07 04:06:53.651044 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:53.650868    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1e89f8f-c472-4311-a2af-e2627800a0cf-plugins-config-volume\") pod \"payload-processing-e2e-mt-107fc16f-7996c68685-ttdtw\" (UID: \"d1e89f8f-c472-4311-a2af-e2627800a0cf\") " pod="openshift-ingress/payload-processing-e2e-mt-107fc16f-7996c68685-ttdtw"
Sep 07 04:06:53.657357 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:53.657327    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghks5\" (UniqueName: \"kubernetes.io/projected/312ca555-1544-4fdf-afe7-75ed4495f52f-kube-api-access-ghks5\") pod \"payload-pre-processing-e2e-mt-107fc16f-84c775fd5d-mxn8x\" (UID: \"312ca555-1544-4fdf-afe7-75ed4495f52f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-107fc16f-84c775fd5d-mxn8x"
Sep 07 04:06:53.657472 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:53.657392    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqb65\" (UniqueName: \"kubernetes.io/projected/d1e89f8f-c472-4311-a2af-e2627800a0cf-kube-api-access-kqb65\") pod \"payload-processing-e2e-mt-107fc16f-7996c68685-ttdtw\" (UID: \"d1e89f8f-c472-4311-a2af-e2627800a0cf\") " pod="openshift-ingress/payload-processing-e2e-mt-107fc16f-7996c68685-ttdtw"
Sep 07 04:06:53.764493 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:53.764433    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-107fc16f-84c775fd5d-mxn8x"
Sep 07 04:06:53.821985 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:53.821956    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-107fc16f-7996c68685-ttdtw"
Sep 07 04:06:54.034692 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:54.034663    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-107fc16f-84c775fd5d-mxn8x"]
Sep 07 04:06:54.035158 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:06:54.035134    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod312ca555_1544_4fdf_afe7_75ed4495f52f.slice/crio-c40aec11b5b899a4566565d310b0be0ef1c94eb57514c73cf2af0d206c645f91 WatchSource:0}: Error finding container c40aec11b5b899a4566565d310b0be0ef1c94eb57514c73cf2af0d206c645f91: Status 404 returned error can't find the container with id c40aec11b5b899a4566565d310b0be0ef1c94eb57514c73cf2af0d206c645f91
Sep 07 04:06:54.095914 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:54.095891    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-107fc16f-7996c68685-ttdtw"]
Sep 07 04:06:54.096753 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:06:54.096724    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1e89f8f_c472_4311_a2af_e2627800a0cf.slice/crio-da460184e98da1330a7bfa1ff123a053fcaaed924c47ad069cde33cf7861854f WatchSource:0}: Error finding container da460184e98da1330a7bfa1ff123a053fcaaed924c47ad069cde33cf7861854f: Status 404 returned error can't find the container with id da460184e98da1330a7bfa1ff123a053fcaaed924c47ad069cde33cf7861854f
Sep 07 04:06:54.586666 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:54.586608    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-107fc16f-84c775fd5d-mxn8x" event={"ID":"312ca555-1544-4fdf-afe7-75ed4495f52f","Type":"ContainerStarted","Data":"26e7a113061edb416f330b844b0ebb20fe11e3051b548513702e39dd1920148a"}
Sep 07 04:06:54.587106 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:54.586684    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-107fc16f-84c775fd5d-mxn8x" event={"ID":"312ca555-1544-4fdf-afe7-75ed4495f52f","Type":"ContainerStarted","Data":"c40aec11b5b899a4566565d310b0be0ef1c94eb57514c73cf2af0d206c645f91"}
Sep 07 04:06:54.587106 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:54.586785    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-107fc16f-84c775fd5d-mxn8x"
Sep 07 04:06:54.588599 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:54.588576    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-107fc16f-7996c68685-ttdtw" event={"ID":"d1e89f8f-c472-4311-a2af-e2627800a0cf","Type":"ContainerStarted","Data":"956b6f0b9f0ec822d4508197e653531080a925ad2af721343b75b8b93da9ef62"}
Sep 07 04:06:54.588770 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:54.588638    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-107fc16f-7996c68685-ttdtw" event={"ID":"d1e89f8f-c472-4311-a2af-e2627800a0cf","Type":"ContainerStarted","Data":"da460184e98da1330a7bfa1ff123a053fcaaed924c47ad069cde33cf7861854f"}
Sep 07 04:06:54.588770 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:54.588670    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-107fc16f-7996c68685-ttdtw"
Sep 07 04:06:54.601849 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:54.601799    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-107fc16f-84c775fd5d-mxn8x" podStartSLOduration=1.601781505 podStartE2EDuration="1.601781505s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:06:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:06:54.599773509 +0000 UTC m=+1117.912249415" watchObservedRunningTime="2026-09-07 04:06:54.601781505 +0000 UTC m=+1117.914257422"
Sep 07 04:06:54.613995 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:06:54.613952    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-107fc16f-7996c68685-ttdtw" podStartSLOduration=1.6139356999999999 podStartE2EDuration="1.6139357s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:06:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:06:54.613324092 +0000 UTC m=+1117.925800018" watchObservedRunningTime="2026-09-07 04:06:54.6139357 +0000 UTC m=+1117.926411615"
Sep 07 04:07:05.596346 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:07:05.596312    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-107fc16f-7996c68685-ttdtw"
Sep 07 04:07:05.597069 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:07:05.596388    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-107fc16f-84c775fd5d-mxn8x"
Sep 07 04:07:17.365503 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:07:17.365463    2559 scope.go:117] "RemoveContainer" containerID="4a913366fca494f12fd9699ee63bf8ab261cc2f97394d502d75b4441282ae5d1"
Sep 07 04:07:50.757301 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:07:50.757221    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-107fc16f-c2pms"]
Sep 07 04:07:50.760436 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:07:50.760420    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-107fc16f-c2pms"
Sep 07 04:07:50.762323 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:07:50.762297    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 07 04:07:50.762323 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:07:50.762301    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zs4ff\""
Sep 07 04:07:50.766585 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:07:50.766560    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-107fc16f-c2pms"]
Sep 07 04:07:50.845608 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:07:50.845583    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8b9d005-65f2-44a2-8dfb-a183b8d1ad62-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-107fc16f-c2pms\" (UID: \"f8b9d005-65f2-44a2-8dfb-a183b8d1ad62\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-107fc16f-c2pms"
Sep 07 04:07:50.946449 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:07:50.946428    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8b9d005-65f2-44a2-8dfb-a183b8d1ad62-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-107fc16f-c2pms\" (UID: \"f8b9d005-65f2-44a2-8dfb-a183b8d1ad62\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-107fc16f-c2pms"
Sep 07 04:07:50.947370 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:07:50.947345    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8b9d005-65f2-44a2-8dfb-a183b8d1ad62-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-107fc16f-c2pms\" (UID: \"f8b9d005-65f2-44a2-8dfb-a183b8d1ad62\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-107fc16f-c2pms"
Sep 07 04:07:51.072276 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:07:51.072190    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-107fc16f-c2pms"
Sep 07 04:07:51.345577 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:07:51.345555    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-107fc16f-c2pms"]
Sep 07 04:07:51.347050 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:07:51.347024    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8b9d005_65f2_44a2_8dfb_a183b8d1ad62.slice/crio-3fa3f489b5168458db6227fd95bc141cacba1e38fdfdeddcb59d1979f9f8a916 WatchSource:0}: Error finding container 3fa3f489b5168458db6227fd95bc141cacba1e38fdfdeddcb59d1979f9f8a916: Status 404 returned error can't find the container with id 3fa3f489b5168458db6227fd95bc141cacba1e38fdfdeddcb59d1979f9f8a916
Sep 07 04:07:51.962750 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:07:51.962602    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-107fc16f-c2pms" event={"ID":"f8b9d005-65f2-44a2-8dfb-a183b8d1ad62","Type":"ContainerStarted","Data":"837a73be73d65ce1c0f0b311db40da342adee3aad008ab9c3962c7ffda5e28db"}
Sep 07 04:07:51.963029 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:07:51.962786    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-107fc16f-c2pms" event={"ID":"f8b9d005-65f2-44a2-8dfb-a183b8d1ad62","Type":"ContainerStarted","Data":"3fa3f489b5168458db6227fd95bc141cacba1e38fdfdeddcb59d1979f9f8a916"}
Sep 07 04:07:52.970694 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:07:52.970654    2559 generic.go:356] "Generic (PLEG): container finished" podID="f8b9d005-65f2-44a2-8dfb-a183b8d1ad62" containerID="837a73be73d65ce1c0f0b311db40da342adee3aad008ab9c3962c7ffda5e28db" exitCode=0
Sep 07 04:07:52.971107 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:07:52.970745    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-107fc16f-c2pms" event={"ID":"f8b9d005-65f2-44a2-8dfb-a183b8d1ad62","Type":"ContainerDied","Data":"837a73be73d65ce1c0f0b311db40da342adee3aad008ab9c3962c7ffda5e28db"}
Sep 07 04:07:53.106532 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:07:53.106510    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-107fc16f-c2pms"
Sep 07 04:07:53.165579 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:07:53.165557    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8b9d005-65f2-44a2-8dfb-a183b8d1ad62-maas-api-service-ca\") pod \"f8b9d005-65f2-44a2-8dfb-a183b8d1ad62\" (UID: \"f8b9d005-65f2-44a2-8dfb-a183b8d1ad62\") "
Sep 07 04:07:53.165893 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:07:53.165873    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8b9d005-65f2-44a2-8dfb-a183b8d1ad62-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f8b9d005-65f2-44a2-8dfb-a183b8d1ad62" (UID: "f8b9d005-65f2-44a2-8dfb-a183b8d1ad62"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 04:07:53.267312 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:07:53.267241    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8b9d005-65f2-44a2-8dfb-a183b8d1ad62-maas-api-service-ca\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:07:53.978306 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:07:53.978281    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-107fc16f-c2pms"
Sep 07 04:07:53.978306 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:07:53.978284    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-107fc16f-c2pms" event={"ID":"f8b9d005-65f2-44a2-8dfb-a183b8d1ad62","Type":"ContainerDied","Data":"3fa3f489b5168458db6227fd95bc141cacba1e38fdfdeddcb59d1979f9f8a916"}
Sep 07 04:07:53.978710 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:07:53.978346    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3fa3f489b5168458db6227fd95bc141cacba1e38fdfdeddcb59d1979f9f8a916"
Sep 07 04:08:06.402091 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:08:06.402054    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-107fc16f-7996c68685-ttdtw"]
Sep 07 04:08:06.402865 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:08:06.402804    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-107fc16f-7996c68685-ttdtw" podUID="d1e89f8f-c472-4311-a2af-e2627800a0cf" containerName="payload-processing" containerID="cri-o://956b6f0b9f0ec822d4508197e653531080a925ad2af721343b75b8b93da9ef62" gracePeriod=30
Sep 07 04:08:06.407050 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:08:06.406315    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-107fc16f-84c775fd5d-mxn8x"]
Sep 07 04:08:06.407422 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:08:06.407380    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-107fc16f-84c775fd5d-mxn8x" podUID="312ca555-1544-4fdf-afe7-75ed4495f52f" containerName="payload-pre-processing" containerID="cri-o://26e7a113061edb416f330b844b0ebb20fe11e3051b548513702e39dd1920148a" gracePeriod=30
Sep 07 04:08:06.543687 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:08:06.543583    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-107fc16f-c2pms"]
Sep 07 04:08:06.547786 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:08:06.547755    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-107fc16f-c2pms"]
Sep 07 04:08:06.694439 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:08:06.694417    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-107fc16f-7996c68685-ttdtw"
Sep 07 04:08:06.697087 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:08:06.697070    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-107fc16f-84c775fd5d-mxn8x"
Sep 07 04:08:06.786956 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:08:06.786928    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kqb65\" (UniqueName: \"kubernetes.io/projected/d1e89f8f-c472-4311-a2af-e2627800a0cf-kube-api-access-kqb65\") pod \"d1e89f8f-c472-4311-a2af-e2627800a0cf\" (UID: \"d1e89f8f-c472-4311-a2af-e2627800a0cf\") "
Sep 07 04:08:06.787130 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:08:06.786983    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ghks5\" (UniqueName: \"kubernetes.io/projected/312ca555-1544-4fdf-afe7-75ed4495f52f-kube-api-access-ghks5\") pod \"312ca555-1544-4fdf-afe7-75ed4495f52f\" (UID: \"312ca555-1544-4fdf-afe7-75ed4495f52f\") "
Sep 07 04:08:06.787130 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:08:06.787059    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/312ca555-1544-4fdf-afe7-75ed4495f52f-plugins-config-volume\") pod \"312ca555-1544-4fdf-afe7-75ed4495f52f\" (UID: \"312ca555-1544-4fdf-afe7-75ed4495f52f\") "
Sep 07 04:08:06.787130 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:08:06.787107    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1e89f8f-c472-4311-a2af-e2627800a0cf-plugins-config-volume\") pod \"d1e89f8f-c472-4311-a2af-e2627800a0cf\" (UID: \"d1e89f8f-c472-4311-a2af-e2627800a0cf\") "
Sep 07 04:08:06.787480 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:08:06.787450    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/312ca555-1544-4fdf-afe7-75ed4495f52f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "312ca555-1544-4fdf-afe7-75ed4495f52f" (UID: "312ca555-1544-4fdf-afe7-75ed4495f52f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 04:08:06.787561 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:08:06.787483    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1e89f8f-c472-4311-a2af-e2627800a0cf-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d1e89f8f-c472-4311-a2af-e2627800a0cf" (UID: "d1e89f8f-c472-4311-a2af-e2627800a0cf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 04:08:06.789007 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:08:06.788986    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1e89f8f-c472-4311-a2af-e2627800a0cf-kube-api-access-kqb65" (OuterVolumeSpecName: "kube-api-access-kqb65") pod "d1e89f8f-c472-4311-a2af-e2627800a0cf" (UID: "d1e89f8f-c472-4311-a2af-e2627800a0cf"). InnerVolumeSpecName "kube-api-access-kqb65". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 04:08:06.789096 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:08:06.789013    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/312ca555-1544-4fdf-afe7-75ed4495f52f-kube-api-access-ghks5" (OuterVolumeSpecName: "kube-api-access-ghks5") pod "312ca555-1544-4fdf-afe7-75ed4495f52f" (UID: "312ca555-1544-4fdf-afe7-75ed4495f52f"). InnerVolumeSpecName "kube-api-access-ghks5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 04:08:06.887986 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:08:06.887948    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ghks5\" (UniqueName: \"kubernetes.io/projected/312ca555-1544-4fdf-afe7-75ed4495f52f-kube-api-access-ghks5\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:08:06.887986 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:08:06.887983    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/312ca555-1544-4fdf-afe7-75ed4495f52f-plugins-config-volume\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:08:06.887986 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:08:06.887992    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1e89f8f-c472-4311-a2af-e2627800a0cf-plugins-config-volume\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:08:06.888176 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:08:06.888002    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kqb65\" (UniqueName: \"kubernetes.io/projected/d1e89f8f-c472-4311-a2af-e2627800a0cf-kube-api-access-kqb65\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:08:07.059502 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:08:07.059423    2559 generic.go:356] "Generic (PLEG): container finished" podID="312ca555-1544-4fdf-afe7-75ed4495f52f" containerID="26e7a113061edb416f330b844b0ebb20fe11e3051b548513702e39dd1920148a" exitCode=0
Sep 07 04:08:07.059502 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:08:07.059469    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-107fc16f-84c775fd5d-mxn8x"
Sep 07 04:08:07.059716 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:08:07.059514    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-107fc16f-84c775fd5d-mxn8x" event={"ID":"312ca555-1544-4fdf-afe7-75ed4495f52f","Type":"ContainerDied","Data":"26e7a113061edb416f330b844b0ebb20fe11e3051b548513702e39dd1920148a"}
Sep 07 04:08:07.059716 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:08:07.059605    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-107fc16f-84c775fd5d-mxn8x" event={"ID":"312ca555-1544-4fdf-afe7-75ed4495f52f","Type":"ContainerDied","Data":"c40aec11b5b899a4566565d310b0be0ef1c94eb57514c73cf2af0d206c645f91"}
Sep 07 04:08:07.059716 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:08:07.059664    2559 scope.go:117] "RemoveContainer" containerID="26e7a113061edb416f330b844b0ebb20fe11e3051b548513702e39dd1920148a"
Sep 07 04:08:07.061030 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:08:07.061005    2559 generic.go:356] "Generic (PLEG): container finished" podID="d1e89f8f-c472-4311-a2af-e2627800a0cf" containerID="956b6f0b9f0ec822d4508197e653531080a925ad2af721343b75b8b93da9ef62" exitCode=0
Sep 07 04:08:07.061222 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:08:07.061044    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-107fc16f-7996c68685-ttdtw" event={"ID":"d1e89f8f-c472-4311-a2af-e2627800a0cf","Type":"ContainerDied","Data":"956b6f0b9f0ec822d4508197e653531080a925ad2af721343b75b8b93da9ef62"}
Sep 07 04:08:07.061222 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:08:07.061095    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-107fc16f-7996c68685-ttdtw" event={"ID":"d1e89f8f-c472-4311-a2af-e2627800a0cf","Type":"ContainerDied","Data":"da460184e98da1330a7bfa1ff123a053fcaaed924c47ad069cde33cf7861854f"}
Sep 07 04:08:07.061222 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:08:07.061053    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-107fc16f-7996c68685-ttdtw"
Sep 07 04:08:07.069145 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:08:07.069123    2559 scope.go:117] "RemoveContainer" containerID="26e7a113061edb416f330b844b0ebb20fe11e3051b548513702e39dd1920148a"
Sep 07 04:08:07.069422 ip-10-0-132-4 kubenswrapper[2559]: E0907 04:08:07.069401    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26e7a113061edb416f330b844b0ebb20fe11e3051b548513702e39dd1920148a\": container with ID starting with 26e7a113061edb416f330b844b0ebb20fe11e3051b548513702e39dd1920148a not found: ID does not exist" containerID="26e7a113061edb416f330b844b0ebb20fe11e3051b548513702e39dd1920148a"
Sep 07 04:08:07.069504 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:08:07.069431    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26e7a113061edb416f330b844b0ebb20fe11e3051b548513702e39dd1920148a"} err="failed to get container status \"26e7a113061edb416f330b844b0ebb20fe11e3051b548513702e39dd1920148a\": rpc error: code = NotFound desc = could not find container \"26e7a113061edb416f330b844b0ebb20fe11e3051b548513702e39dd1920148a\": container with ID starting with 26e7a113061edb416f330b844b0ebb20fe11e3051b548513702e39dd1920148a not found: ID does not exist"
Sep 07 04:08:07.069504 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:08:07.069454    2559 scope.go:117] "RemoveContainer" containerID="956b6f0b9f0ec822d4508197e653531080a925ad2af721343b75b8b93da9ef62"
Sep 07 04:08:07.078369 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:08:07.078352    2559 scope.go:117] "RemoveContainer" containerID="956b6f0b9f0ec822d4508197e653531080a925ad2af721343b75b8b93da9ef62"
Sep 07 04:08:07.078663 ip-10-0-132-4 kubenswrapper[2559]: E0907 04:08:07.078644    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"956b6f0b9f0ec822d4508197e653531080a925ad2af721343b75b8b93da9ef62\": container with ID starting with 956b6f0b9f0ec822d4508197e653531080a925ad2af721343b75b8b93da9ef62 not found: ID does not exist" containerID="956b6f0b9f0ec822d4508197e653531080a925ad2af721343b75b8b93da9ef62"
Sep 07 04:08:07.078722 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:08:07.078670    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"956b6f0b9f0ec822d4508197e653531080a925ad2af721343b75b8b93da9ef62"} err="failed to get container status \"956b6f0b9f0ec822d4508197e653531080a925ad2af721343b75b8b93da9ef62\": rpc error: code = NotFound desc = could not find container \"956b6f0b9f0ec822d4508197e653531080a925ad2af721343b75b8b93da9ef62\": container with ID starting with 956b6f0b9f0ec822d4508197e653531080a925ad2af721343b75b8b93da9ef62 not found: ID does not exist"
Sep 07 04:08:07.083630 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:08:07.083602    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-107fc16f-84c775fd5d-mxn8x"]
Sep 07 04:08:07.087040 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:08:07.087019    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-107fc16f-84c775fd5d-mxn8x"]
Sep 07 04:08:07.095859 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:08:07.095838    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-107fc16f-7996c68685-ttdtw"]
Sep 07 04:08:07.099540 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:08:07.099519    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-107fc16f-7996c68685-ttdtw"]
Sep 07 04:08:07.179063 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:08:07.179040    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="312ca555-1544-4fdf-afe7-75ed4495f52f" path="/var/lib/kubelet/pods/312ca555-1544-4fdf-afe7-75ed4495f52f/volumes"
Sep 07 04:08:07.179388 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:08:07.179376    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1e89f8f-c472-4311-a2af-e2627800a0cf" path="/var/lib/kubelet/pods/d1e89f8f-c472-4311-a2af-e2627800a0cf/volumes"
Sep 07 04:08:07.179677 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:08:07.179665    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8b9d005-65f2-44a2-8dfb-a183b8d1ad62" path="/var/lib/kubelet/pods/f8b9d005-65f2-44a2-8dfb-a183b8d1ad62/volumes"
Sep 07 04:08:17.386797 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:08:17.386765    2559 scope.go:117] "RemoveContainer" containerID="9603995dd8ef6a0a26d5647e0107e31eddfe1eb78eb5b9ec2ce70eea126eefc5"
Sep 07 04:08:17.394795 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:08:17.394775    2559 scope.go:117] "RemoveContainer" containerID="39958517833a7c1f3a1c7bcffe9db16df154df6d424d1c33c7743aaa7888e976"
Sep 07 04:09:04.684005 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:04.683971    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-b8cea6/sub-test-model-b8cea6-kserve-68949796f-2rxsn"]
Sep 07 04:09:04.684522 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:04.684413    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1e89f8f-c472-4311-a2af-e2627800a0cf" containerName="payload-processing"
Sep 07 04:09:04.684522 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:04.684427    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1e89f8f-c472-4311-a2af-e2627800a0cf" containerName="payload-processing"
Sep 07 04:09:04.684522 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:04.684451    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="312ca555-1544-4fdf-afe7-75ed4495f52f" containerName="payload-pre-processing"
Sep 07 04:09:04.684522 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:04.684457    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="312ca555-1544-4fdf-afe7-75ed4495f52f" containerName="payload-pre-processing"
Sep 07 04:09:04.684522 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:04.684466    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8b9d005-65f2-44a2-8dfb-a183b8d1ad62" containerName="revoke-keys"
Sep 07 04:09:04.684522 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:04.684472    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8b9d005-65f2-44a2-8dfb-a183b8d1ad62" containerName="revoke-keys"
Sep 07 04:09:04.684761 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:04.684540    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1e89f8f-c472-4311-a2af-e2627800a0cf" containerName="payload-processing"
Sep 07 04:09:04.684761 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:04.684550    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8b9d005-65f2-44a2-8dfb-a183b8d1ad62" containerName="revoke-keys"
Sep 07 04:09:04.684761 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:04.684557    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="312ca555-1544-4fdf-afe7-75ed4495f52f" containerName="payload-pre-processing"
Sep 07 04:09:04.687738 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:04.687716    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-b8cea6/sub-test-model-b8cea6-kserve-68949796f-2rxsn"
Sep 07 04:09:04.689846 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:04.689820    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-b8cea6\"/\"kube-root-ca.crt\""
Sep 07 04:09:04.690551 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:04.690529    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-b8cea6\"/\"sub-test-model-b8cea6-kserve-self-signed-certs\""
Sep 07 04:09:04.690686 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:04.690567    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-b8cea6\"/\"openshift-service-ca.crt\""
Sep 07 04:09:04.690686 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:04.690574    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-b8cea6\"/\"default-dockercfg-vxkmj\""
Sep 07 04:09:04.697307 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:04.697047    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-b8cea6/sub-test-model-b8cea6-kserve-68949796f-2rxsn"]
Sep 07 04:09:04.779458 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:04.779421    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a8a4485-6549-46e7-9919-d5d5a7bd7f8e-home\") pod \"sub-test-model-b8cea6-kserve-68949796f-2rxsn\" (UID: \"2a8a4485-6549-46e7-9919-d5d5a7bd7f8e\") " pod="ai-tenant-e2e-shared-a-w3-b8cea6/sub-test-model-b8cea6-kserve-68949796f-2rxsn"
Sep 07 04:09:04.779681 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:04.779471    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a8a4485-6549-46e7-9919-d5d5a7bd7f8e-tmp-dir\") pod \"sub-test-model-b8cea6-kserve-68949796f-2rxsn\" (UID: \"2a8a4485-6549-46e7-9919-d5d5a7bd7f8e\") " pod="ai-tenant-e2e-shared-a-w3-b8cea6/sub-test-model-b8cea6-kserve-68949796f-2rxsn"
Sep 07 04:09:04.779681 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:04.779531    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a8a4485-6549-46e7-9919-d5d5a7bd7f8e-model-cache\") pod \"sub-test-model-b8cea6-kserve-68949796f-2rxsn\" (UID: \"2a8a4485-6549-46e7-9919-d5d5a7bd7f8e\") " pod="ai-tenant-e2e-shared-a-w3-b8cea6/sub-test-model-b8cea6-kserve-68949796f-2rxsn"
Sep 07 04:09:04.779681 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:04.779594    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a8a4485-6549-46e7-9919-d5d5a7bd7f8e-tls-certs\") pod \"sub-test-model-b8cea6-kserve-68949796f-2rxsn\" (UID: \"2a8a4485-6549-46e7-9919-d5d5a7bd7f8e\") " pod="ai-tenant-e2e-shared-a-w3-b8cea6/sub-test-model-b8cea6-kserve-68949796f-2rxsn"
Sep 07 04:09:04.779681 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:04.779663    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a8a4485-6549-46e7-9919-d5d5a7bd7f8e-dshm\") pod \"sub-test-model-b8cea6-kserve-68949796f-2rxsn\" (UID: \"2a8a4485-6549-46e7-9919-d5d5a7bd7f8e\") " pod="ai-tenant-e2e-shared-a-w3-b8cea6/sub-test-model-b8cea6-kserve-68949796f-2rxsn"
Sep 07 04:09:04.779882 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:04.779721    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbnwc\" (UniqueName: \"kubernetes.io/projected/2a8a4485-6549-46e7-9919-d5d5a7bd7f8e-kube-api-access-xbnwc\") pod \"sub-test-model-b8cea6-kserve-68949796f-2rxsn\" (UID: \"2a8a4485-6549-46e7-9919-d5d5a7bd7f8e\") " pod="ai-tenant-e2e-shared-a-w3-b8cea6/sub-test-model-b8cea6-kserve-68949796f-2rxsn"
Sep 07 04:09:04.881337 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:04.881297    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a8a4485-6549-46e7-9919-d5d5a7bd7f8e-tmp-dir\") pod \"sub-test-model-b8cea6-kserve-68949796f-2rxsn\" (UID: \"2a8a4485-6549-46e7-9919-d5d5a7bd7f8e\") " pod="ai-tenant-e2e-shared-a-w3-b8cea6/sub-test-model-b8cea6-kserve-68949796f-2rxsn"
Sep 07 04:09:04.881547 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:04.881356    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a8a4485-6549-46e7-9919-d5d5a7bd7f8e-model-cache\") pod \"sub-test-model-b8cea6-kserve-68949796f-2rxsn\" (UID: \"2a8a4485-6549-46e7-9919-d5d5a7bd7f8e\") " pod="ai-tenant-e2e-shared-a-w3-b8cea6/sub-test-model-b8cea6-kserve-68949796f-2rxsn"
Sep 07 04:09:04.881547 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:04.881424    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a8a4485-6549-46e7-9919-d5d5a7bd7f8e-tls-certs\") pod \"sub-test-model-b8cea6-kserve-68949796f-2rxsn\" (UID: \"2a8a4485-6549-46e7-9919-d5d5a7bd7f8e\") " pod="ai-tenant-e2e-shared-a-w3-b8cea6/sub-test-model-b8cea6-kserve-68949796f-2rxsn"
Sep 07 04:09:04.881547 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:04.881473    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a8a4485-6549-46e7-9919-d5d5a7bd7f8e-dshm\") pod \"sub-test-model-b8cea6-kserve-68949796f-2rxsn\" (UID: \"2a8a4485-6549-46e7-9919-d5d5a7bd7f8e\") " pod="ai-tenant-e2e-shared-a-w3-b8cea6/sub-test-model-b8cea6-kserve-68949796f-2rxsn"
Sep 07 04:09:04.881740 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:04.881552    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbnwc\" (UniqueName: \"kubernetes.io/projected/2a8a4485-6549-46e7-9919-d5d5a7bd7f8e-kube-api-access-xbnwc\") pod \"sub-test-model-b8cea6-kserve-68949796f-2rxsn\" (UID: \"2a8a4485-6549-46e7-9919-d5d5a7bd7f8e\") " pod="ai-tenant-e2e-shared-a-w3-b8cea6/sub-test-model-b8cea6-kserve-68949796f-2rxsn"
Sep 07 04:09:04.881740 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:04.881588    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a8a4485-6549-46e7-9919-d5d5a7bd7f8e-home\") pod \"sub-test-model-b8cea6-kserve-68949796f-2rxsn\" (UID: \"2a8a4485-6549-46e7-9919-d5d5a7bd7f8e\") " pod="ai-tenant-e2e-shared-a-w3-b8cea6/sub-test-model-b8cea6-kserve-68949796f-2rxsn"
Sep 07 04:09:04.881857 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:04.881810    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a8a4485-6549-46e7-9919-d5d5a7bd7f8e-tmp-dir\") pod \"sub-test-model-b8cea6-kserve-68949796f-2rxsn\" (UID: \"2a8a4485-6549-46e7-9919-d5d5a7bd7f8e\") " pod="ai-tenant-e2e-shared-a-w3-b8cea6/sub-test-model-b8cea6-kserve-68949796f-2rxsn"
Sep 07 04:09:04.881934 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:04.881900    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a8a4485-6549-46e7-9919-d5d5a7bd7f8e-model-cache\") pod \"sub-test-model-b8cea6-kserve-68949796f-2rxsn\" (UID: \"2a8a4485-6549-46e7-9919-d5d5a7bd7f8e\") " pod="ai-tenant-e2e-shared-a-w3-b8cea6/sub-test-model-b8cea6-kserve-68949796f-2rxsn"
Sep 07 04:09:04.881996 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:04.881970    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a8a4485-6549-46e7-9919-d5d5a7bd7f8e-home\") pod \"sub-test-model-b8cea6-kserve-68949796f-2rxsn\" (UID: \"2a8a4485-6549-46e7-9919-d5d5a7bd7f8e\") " pod="ai-tenant-e2e-shared-a-w3-b8cea6/sub-test-model-b8cea6-kserve-68949796f-2rxsn"
Sep 07 04:09:04.884837 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:04.884810    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a8a4485-6549-46e7-9919-d5d5a7bd7f8e-dshm\") pod \"sub-test-model-b8cea6-kserve-68949796f-2rxsn\" (UID: \"2a8a4485-6549-46e7-9919-d5d5a7bd7f8e\") " pod="ai-tenant-e2e-shared-a-w3-b8cea6/sub-test-model-b8cea6-kserve-68949796f-2rxsn"
Sep 07 04:09:04.885006 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:04.884912    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a8a4485-6549-46e7-9919-d5d5a7bd7f8e-tls-certs\") pod \"sub-test-model-b8cea6-kserve-68949796f-2rxsn\" (UID: \"2a8a4485-6549-46e7-9919-d5d5a7bd7f8e\") " pod="ai-tenant-e2e-shared-a-w3-b8cea6/sub-test-model-b8cea6-kserve-68949796f-2rxsn"
Sep 07 04:09:04.889866 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:04.889837    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbnwc\" (UniqueName: \"kubernetes.io/projected/2a8a4485-6549-46e7-9919-d5d5a7bd7f8e-kube-api-access-xbnwc\") pod \"sub-test-model-b8cea6-kserve-68949796f-2rxsn\" (UID: \"2a8a4485-6549-46e7-9919-d5d5a7bd7f8e\") " pod="ai-tenant-e2e-shared-a-w3-b8cea6/sub-test-model-b8cea6-kserve-68949796f-2rxsn"
Sep 07 04:09:05.000327 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:05.000227    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-b8cea6/sub-test-model-b8cea6-kserve-68949796f-2rxsn"
Sep 07 04:09:05.271629 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:05.271591    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-b8cea6/sub-test-model-b8cea6-kserve-68949796f-2rxsn"]
Sep 07 04:09:05.272939 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:09:05.272910    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2a8a4485_6549_46e7_9919_d5d5a7bd7f8e.slice/crio-2a6bfcb0668b0cc92915d0620c677395cc0e8cd9aeee01e08ae7194f1b8ae23d WatchSource:0}: Error finding container 2a6bfcb0668b0cc92915d0620c677395cc0e8cd9aeee01e08ae7194f1b8ae23d: Status 404 returned error can't find the container with id 2a6bfcb0668b0cc92915d0620c677395cc0e8cd9aeee01e08ae7194f1b8ae23d
Sep 07 04:09:05.399971 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:05.399931    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-b8cea6/sub-test-model-b8cea6-kserve-68949796f-2rxsn" event={"ID":"2a8a4485-6549-46e7-9919-d5d5a7bd7f8e","Type":"ContainerStarted","Data":"6430377d87f4a429d6228d67f69cb0b48c37df36f818d9ae5ba88b6d8a25ed7a"}
Sep 07 04:09:05.400155 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:05.399987    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-b8cea6/sub-test-model-b8cea6-kserve-68949796f-2rxsn" event={"ID":"2a8a4485-6549-46e7-9919-d5d5a7bd7f8e","Type":"ContainerStarted","Data":"2a6bfcb0668b0cc92915d0620c677395cc0e8cd9aeee01e08ae7194f1b8ae23d"}
Sep 07 04:09:05.417816 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:05.417768    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-b8cea6/sub-test-model-b8cea6-kserve-68949796f-2rxsn" podStartSLOduration=1.417749471 podStartE2EDuration="1.417749471s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:09:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:09:05.413561457 +0000 UTC m=+1248.726037358" watchObservedRunningTime="2026-09-07 04:09:05.417749471 +0000 UTC m=+1248.730225378"
Sep 07 04:09:15.000882 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:15.000828    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-b8cea6/sub-test-model-b8cea6-kserve-68949796f-2rxsn"
Sep 07 04:09:15.000882 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:15.000896    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-b8cea6/sub-test-model-b8cea6-kserve-68949796f-2rxsn"
Sep 07 04:09:15.013394 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:15.013371    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-b8cea6/sub-test-model-b8cea6-kserve-68949796f-2rxsn"
Sep 07 04:09:15.469021 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:15.468985    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-b8cea6/sub-test-model-b8cea6-kserve-68949796f-2rxsn"
Sep 07 04:09:17.427870 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:17.427831    2559 scope.go:117] "RemoveContainer" containerID="29f6ad48aef46cca0ff5b6614456ccbda804c3e98a25d5e7134cc078c0920dab"
Sep 07 04:09:17.437779 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:17.437751    2559 scope.go:117] "RemoveContainer" containerID="379ed5d27f92d3adea135b0ee30ca7ed43187f708d2ba00afe3fae1550341e6c"
Sep 07 04:09:56.578838 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:56.578804    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-467e44-59445b5cdc-xfcqk"]
Sep 07 04:09:56.582522 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:56.582501    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-467e44-59445b5cdc-xfcqk"
Sep 07 04:09:56.584743 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:56.584718    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-467e44-dockercfg-g64tg\""
Sep 07 04:09:56.584743 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:56.584735    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-467e44\""
Sep 07 04:09:56.592519 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:56.592494    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-467e44-59445b5cdc-xfcqk"]
Sep 07 04:09:56.659530 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:56.659497    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/081c7440-9285-47de-94e2-88fd25212b1a-plugins-config-volume\") pod \"payload-processing-e2e-api-a-467e44-59445b5cdc-xfcqk\" (UID: \"081c7440-9285-47de-94e2-88fd25212b1a\") " pod="openshift-ingress/payload-processing-e2e-api-a-467e44-59445b5cdc-xfcqk"
Sep 07 04:09:56.659740 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:56.659591    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w42ln\" (UniqueName: \"kubernetes.io/projected/081c7440-9285-47de-94e2-88fd25212b1a-kube-api-access-w42ln\") pod \"payload-processing-e2e-api-a-467e44-59445b5cdc-xfcqk\" (UID: \"081c7440-9285-47de-94e2-88fd25212b1a\") " pod="openshift-ingress/payload-processing-e2e-api-a-467e44-59445b5cdc-xfcqk"
Sep 07 04:09:56.760981 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:56.760947    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/081c7440-9285-47de-94e2-88fd25212b1a-plugins-config-volume\") pod \"payload-processing-e2e-api-a-467e44-59445b5cdc-xfcqk\" (UID: \"081c7440-9285-47de-94e2-88fd25212b1a\") " pod="openshift-ingress/payload-processing-e2e-api-a-467e44-59445b5cdc-xfcqk"
Sep 07 04:09:56.761145 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:56.761015    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w42ln\" (UniqueName: \"kubernetes.io/projected/081c7440-9285-47de-94e2-88fd25212b1a-kube-api-access-w42ln\") pod \"payload-processing-e2e-api-a-467e44-59445b5cdc-xfcqk\" (UID: \"081c7440-9285-47de-94e2-88fd25212b1a\") " pod="openshift-ingress/payload-processing-e2e-api-a-467e44-59445b5cdc-xfcqk"
Sep 07 04:09:56.761677 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:56.761659    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/081c7440-9285-47de-94e2-88fd25212b1a-plugins-config-volume\") pod \"payload-processing-e2e-api-a-467e44-59445b5cdc-xfcqk\" (UID: \"081c7440-9285-47de-94e2-88fd25212b1a\") " pod="openshift-ingress/payload-processing-e2e-api-a-467e44-59445b5cdc-xfcqk"
Sep 07 04:09:56.775793 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:56.775770    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w42ln\" (UniqueName: \"kubernetes.io/projected/081c7440-9285-47de-94e2-88fd25212b1a-kube-api-access-w42ln\") pod \"payload-processing-e2e-api-a-467e44-59445b5cdc-xfcqk\" (UID: \"081c7440-9285-47de-94e2-88fd25212b1a\") " pod="openshift-ingress/payload-processing-e2e-api-a-467e44-59445b5cdc-xfcqk"
Sep 07 04:09:56.893082 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:56.893062    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-467e44-59445b5cdc-xfcqk"
Sep 07 04:09:57.166025 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:57.166002    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-467e44-59445b5cdc-xfcqk"]
Sep 07 04:09:57.167529 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:09:57.167504    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod081c7440_9285_47de_94e2_88fd25212b1a.slice/crio-2fbd756999f2995a68beb723e395ca7e07b607335c72f9d924b114fa14421d14 WatchSource:0}: Error finding container 2fbd756999f2995a68beb723e395ca7e07b607335c72f9d924b114fa14421d14: Status 404 returned error can't find the container with id 2fbd756999f2995a68beb723e395ca7e07b607335c72f9d924b114fa14421d14
Sep 07 04:09:57.724006 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:57.723966    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-467e44-59445b5cdc-xfcqk" event={"ID":"081c7440-9285-47de-94e2-88fd25212b1a","Type":"ContainerStarted","Data":"7ed84188f63405734bdd3b26f2a58d0f45fae3f0492e800af460ca54cd90b8dd"}
Sep 07 04:09:57.724511 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:57.724062    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-467e44-59445b5cdc-xfcqk" event={"ID":"081c7440-9285-47de-94e2-88fd25212b1a","Type":"ContainerStarted","Data":"2fbd756999f2995a68beb723e395ca7e07b607335c72f9d924b114fa14421d14"}
Sep 07 04:09:57.724511 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:57.724098    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-467e44-59445b5cdc-xfcqk"
Sep 07 04:09:57.741890 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:09:57.741839    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-467e44-59445b5cdc-xfcqk" podStartSLOduration=1.7418209180000002 podStartE2EDuration="1.741820918s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:09:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:09:57.738824752 +0000 UTC m=+1301.051300669" watchObservedRunningTime="2026-09-07 04:09:57.741820918 +0000 UTC m=+1301.054296871"
Sep 07 04:10:08.733053 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:08.733024    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-467e44-59445b5cdc-xfcqk"
Sep 07 04:10:18.260378 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:18.260346    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-b8cea6/sub-test-model-b8cea6-kserve-68949796f-2rxsn"]
Sep 07 04:10:25.695058 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:25.695021    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-cf1797-c898b8b67-2wkml"]
Sep 07 04:10:25.698849 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:25.698818    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-cf1797-c898b8b67-2wkml"
Sep 07 04:10:25.700838 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:25.700814    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-cf1797-dockercfg-xhtj7\""
Sep 07 04:10:25.700986 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:25.700817    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-cf1797\""
Sep 07 04:10:25.706384 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:25.706363    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-cf1797-c898b8b67-2wkml"]
Sep 07 04:10:25.740974 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:25.740945    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5s9k\" (UniqueName: \"kubernetes.io/projected/01e1fd88-6b34-42ea-b583-70ae2c467231-kube-api-access-r5s9k\") pod \"payload-processing-e2e-api-b-cf1797-c898b8b67-2wkml\" (UID: \"01e1fd88-6b34-42ea-b583-70ae2c467231\") " pod="openshift-ingress/payload-processing-e2e-api-b-cf1797-c898b8b67-2wkml"
Sep 07 04:10:25.741092 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:25.741008    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01e1fd88-6b34-42ea-b583-70ae2c467231-plugins-config-volume\") pod \"payload-processing-e2e-api-b-cf1797-c898b8b67-2wkml\" (UID: \"01e1fd88-6b34-42ea-b583-70ae2c467231\") " pod="openshift-ingress/payload-processing-e2e-api-b-cf1797-c898b8b67-2wkml"
Sep 07 04:10:25.842008 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:25.841971    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5s9k\" (UniqueName: \"kubernetes.io/projected/01e1fd88-6b34-42ea-b583-70ae2c467231-kube-api-access-r5s9k\") pod \"payload-processing-e2e-api-b-cf1797-c898b8b67-2wkml\" (UID: \"01e1fd88-6b34-42ea-b583-70ae2c467231\") " pod="openshift-ingress/payload-processing-e2e-api-b-cf1797-c898b8b67-2wkml"
Sep 07 04:10:25.842212 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:25.842043    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01e1fd88-6b34-42ea-b583-70ae2c467231-plugins-config-volume\") pod \"payload-processing-e2e-api-b-cf1797-c898b8b67-2wkml\" (UID: \"01e1fd88-6b34-42ea-b583-70ae2c467231\") " pod="openshift-ingress/payload-processing-e2e-api-b-cf1797-c898b8b67-2wkml"
Sep 07 04:10:25.842811 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:25.842786    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01e1fd88-6b34-42ea-b583-70ae2c467231-plugins-config-volume\") pod \"payload-processing-e2e-api-b-cf1797-c898b8b67-2wkml\" (UID: \"01e1fd88-6b34-42ea-b583-70ae2c467231\") " pod="openshift-ingress/payload-processing-e2e-api-b-cf1797-c898b8b67-2wkml"
Sep 07 04:10:25.851133 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:25.851105    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5s9k\" (UniqueName: \"kubernetes.io/projected/01e1fd88-6b34-42ea-b583-70ae2c467231-kube-api-access-r5s9k\") pod \"payload-processing-e2e-api-b-cf1797-c898b8b67-2wkml\" (UID: \"01e1fd88-6b34-42ea-b583-70ae2c467231\") " pod="openshift-ingress/payload-processing-e2e-api-b-cf1797-c898b8b67-2wkml"
Sep 07 04:10:26.012714 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:26.012611    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-cf1797-c898b8b67-2wkml"
Sep 07 04:10:26.284195 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:26.284165    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-cf1797-c898b8b67-2wkml"]
Sep 07 04:10:26.285111 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:10:26.285082    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01e1fd88_6b34_42ea_b583_70ae2c467231.slice/crio-b3a9a9d1b4906da8126bb200fd7d99d3829550aea9bb737d9722ef7705a1c5d3 WatchSource:0}: Error finding container b3a9a9d1b4906da8126bb200fd7d99d3829550aea9bb737d9722ef7705a1c5d3: Status 404 returned error can't find the container with id b3a9a9d1b4906da8126bb200fd7d99d3829550aea9bb737d9722ef7705a1c5d3
Sep 07 04:10:26.898888 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:26.898843    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-cf1797-c898b8b67-2wkml" event={"ID":"01e1fd88-6b34-42ea-b583-70ae2c467231","Type":"ContainerStarted","Data":"7b7e4c62d797b91a5bb8b281851590ffb5087629a3926048fa4973fa091526de"}
Sep 07 04:10:26.899276 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:26.898903    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-cf1797-c898b8b67-2wkml" event={"ID":"01e1fd88-6b34-42ea-b583-70ae2c467231","Type":"ContainerStarted","Data":"b3a9a9d1b4906da8126bb200fd7d99d3829550aea9bb737d9722ef7705a1c5d3"}
Sep 07 04:10:26.899276 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:26.898950    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-cf1797-c898b8b67-2wkml"
Sep 07 04:10:26.914390 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:26.914269    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-cf1797-c898b8b67-2wkml" podStartSLOduration=1.914252837 podStartE2EDuration="1.914252837s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:10:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:10:26.913547224 +0000 UTC m=+1330.226023127" watchObservedRunningTime="2026-09-07 04:10:26.914252837 +0000 UTC m=+1330.226728741"
Sep 07 04:10:33.280772 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:33.280712    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-b8cea6/sub-test-model-b8cea6-kserve-68949796f-2rxsn" podUID="2a8a4485-6549-46e7-9919-d5d5a7bd7f8e" containerName="main" containerID="cri-o://6430377d87f4a429d6228d67f69cb0b48c37df36f818d9ae5ba88b6d8a25ed7a" gracePeriod=45
Sep 07 04:10:33.528603 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:33.528581    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-b8cea6/sub-test-model-b8cea6-kserve-68949796f-2rxsn"
Sep 07 04:10:33.608518 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:33.608492    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a8a4485-6549-46e7-9919-d5d5a7bd7f8e-tmp-dir\") pod \"2a8a4485-6549-46e7-9919-d5d5a7bd7f8e\" (UID: \"2a8a4485-6549-46e7-9919-d5d5a7bd7f8e\") "
Sep 07 04:10:33.608661 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:33.608566    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a8a4485-6549-46e7-9919-d5d5a7bd7f8e-dshm\") pod \"2a8a4485-6549-46e7-9919-d5d5a7bd7f8e\" (UID: \"2a8a4485-6549-46e7-9919-d5d5a7bd7f8e\") "
Sep 07 04:10:33.608661 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:33.608586    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a8a4485-6549-46e7-9919-d5d5a7bd7f8e-model-cache\") pod \"2a8a4485-6549-46e7-9919-d5d5a7bd7f8e\" (UID: \"2a8a4485-6549-46e7-9919-d5d5a7bd7f8e\") "
Sep 07 04:10:33.608661 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:33.608605    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a8a4485-6549-46e7-9919-d5d5a7bd7f8e-tls-certs\") pod \"2a8a4485-6549-46e7-9919-d5d5a7bd7f8e\" (UID: \"2a8a4485-6549-46e7-9919-d5d5a7bd7f8e\") "
Sep 07 04:10:33.608787 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:33.608660    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xbnwc\" (UniqueName: \"kubernetes.io/projected/2a8a4485-6549-46e7-9919-d5d5a7bd7f8e-kube-api-access-xbnwc\") pod \"2a8a4485-6549-46e7-9919-d5d5a7bd7f8e\" (UID: \"2a8a4485-6549-46e7-9919-d5d5a7bd7f8e\") "
Sep 07 04:10:33.608787 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:33.608729    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a8a4485-6549-46e7-9919-d5d5a7bd7f8e-home\") pod \"2a8a4485-6549-46e7-9919-d5d5a7bd7f8e\" (UID: \"2a8a4485-6549-46e7-9919-d5d5a7bd7f8e\") "
Sep 07 04:10:33.608895 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:33.608810    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a8a4485-6549-46e7-9919-d5d5a7bd7f8e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2a8a4485-6549-46e7-9919-d5d5a7bd7f8e" (UID: "2a8a4485-6549-46e7-9919-d5d5a7bd7f8e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:10:33.608953 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:33.608885    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a8a4485-6549-46e7-9919-d5d5a7bd7f8e-model-cache" (OuterVolumeSpecName: "model-cache") pod "2a8a4485-6549-46e7-9919-d5d5a7bd7f8e" (UID: "2a8a4485-6549-46e7-9919-d5d5a7bd7f8e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:10:33.609068 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:33.609040    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a8a4485-6549-46e7-9919-d5d5a7bd7f8e-home" (OuterVolumeSpecName: "home") pod "2a8a4485-6549-46e7-9919-d5d5a7bd7f8e" (UID: "2a8a4485-6549-46e7-9919-d5d5a7bd7f8e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:10:33.609121 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:33.609066    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a8a4485-6549-46e7-9919-d5d5a7bd7f8e-model-cache\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:10:33.609121 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:33.609087    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a8a4485-6549-46e7-9919-d5d5a7bd7f8e-tmp-dir\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:10:33.610874 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:33.610850    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a8a4485-6549-46e7-9919-d5d5a7bd7f8e-dshm" (OuterVolumeSpecName: "dshm") pod "2a8a4485-6549-46e7-9919-d5d5a7bd7f8e" (UID: "2a8a4485-6549-46e7-9919-d5d5a7bd7f8e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:10:33.610959 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:33.610935    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a8a4485-6549-46e7-9919-d5d5a7bd7f8e-kube-api-access-xbnwc" (OuterVolumeSpecName: "kube-api-access-xbnwc") pod "2a8a4485-6549-46e7-9919-d5d5a7bd7f8e" (UID: "2a8a4485-6549-46e7-9919-d5d5a7bd7f8e"). InnerVolumeSpecName "kube-api-access-xbnwc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 04:10:33.610959 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:33.610944    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a8a4485-6549-46e7-9919-d5d5a7bd7f8e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2a8a4485-6549-46e7-9919-d5d5a7bd7f8e" (UID: "2a8a4485-6549-46e7-9919-d5d5a7bd7f8e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 04:10:33.709539 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:33.709514    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a8a4485-6549-46e7-9919-d5d5a7bd7f8e-dshm\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:10:33.709690 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:33.709541    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a8a4485-6549-46e7-9919-d5d5a7bd7f8e-tls-certs\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:10:33.709690 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:33.709555    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xbnwc\" (UniqueName: \"kubernetes.io/projected/2a8a4485-6549-46e7-9919-d5d5a7bd7f8e-kube-api-access-xbnwc\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:10:33.709690 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:33.709570    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a8a4485-6549-46e7-9919-d5d5a7bd7f8e-home\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:10:33.942174 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:33.942094    2559 generic.go:356] "Generic (PLEG): container finished" podID="2a8a4485-6549-46e7-9919-d5d5a7bd7f8e" containerID="6430377d87f4a429d6228d67f69cb0b48c37df36f818d9ae5ba88b6d8a25ed7a" exitCode=0
Sep 07 04:10:33.942174 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:33.942142    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-b8cea6/sub-test-model-b8cea6-kserve-68949796f-2rxsn"
Sep 07 04:10:33.942174 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:33.942157    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-b8cea6/sub-test-model-b8cea6-kserve-68949796f-2rxsn" event={"ID":"2a8a4485-6549-46e7-9919-d5d5a7bd7f8e","Type":"ContainerDied","Data":"6430377d87f4a429d6228d67f69cb0b48c37df36f818d9ae5ba88b6d8a25ed7a"}
Sep 07 04:10:33.942379 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:33.942195    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-b8cea6/sub-test-model-b8cea6-kserve-68949796f-2rxsn" event={"ID":"2a8a4485-6549-46e7-9919-d5d5a7bd7f8e","Type":"ContainerDied","Data":"2a6bfcb0668b0cc92915d0620c677395cc0e8cd9aeee01e08ae7194f1b8ae23d"}
Sep 07 04:10:33.942379 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:33.942214    2559 scope.go:117] "RemoveContainer" containerID="6430377d87f4a429d6228d67f69cb0b48c37df36f818d9ae5ba88b6d8a25ed7a"
Sep 07 04:10:33.952442 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:33.952426    2559 scope.go:117] "RemoveContainer" containerID="6430377d87f4a429d6228d67f69cb0b48c37df36f818d9ae5ba88b6d8a25ed7a"
Sep 07 04:10:33.952752 ip-10-0-132-4 kubenswrapper[2559]: E0907 04:10:33.952732    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6430377d87f4a429d6228d67f69cb0b48c37df36f818d9ae5ba88b6d8a25ed7a\": container with ID starting with 6430377d87f4a429d6228d67f69cb0b48c37df36f818d9ae5ba88b6d8a25ed7a not found: ID does not exist" containerID="6430377d87f4a429d6228d67f69cb0b48c37df36f818d9ae5ba88b6d8a25ed7a"
Sep 07 04:10:33.952821 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:33.952760    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6430377d87f4a429d6228d67f69cb0b48c37df36f818d9ae5ba88b6d8a25ed7a"} err="failed to get container status \"6430377d87f4a429d6228d67f69cb0b48c37df36f818d9ae5ba88b6d8a25ed7a\": rpc error: code = NotFound desc = could not find container \"6430377d87f4a429d6228d67f69cb0b48c37df36f818d9ae5ba88b6d8a25ed7a\": container with ID starting with 6430377d87f4a429d6228d67f69cb0b48c37df36f818d9ae5ba88b6d8a25ed7a not found: ID does not exist"
Sep 07 04:10:33.963467 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:33.963440    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-b8cea6/sub-test-model-b8cea6-kserve-68949796f-2rxsn"]
Sep 07 04:10:33.966057 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:33.966037    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-b8cea6/sub-test-model-b8cea6-kserve-68949796f-2rxsn"]
Sep 07 04:10:35.182651 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:35.182593    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a8a4485-6549-46e7-9919-d5d5a7bd7f8e" path="/var/lib/kubelet/pods/2a8a4485-6549-46e7-9919-d5d5a7bd7f8e/volumes"
Sep 07 04:10:37.906687 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:37.906657    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-cf1797-c898b8b67-2wkml"
Sep 07 04:10:51.817165 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:51.817082    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-467e44-nxjlb"]
Sep 07 04:10:51.817697 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:51.817574    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a8a4485-6549-46e7-9919-d5d5a7bd7f8e" containerName="main"
Sep 07 04:10:51.817697 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:51.817591    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a8a4485-6549-46e7-9919-d5d5a7bd7f8e" containerName="main"
Sep 07 04:10:51.817697 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:51.817692    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a8a4485-6549-46e7-9919-d5d5a7bd7f8e" containerName="main"
Sep 07 04:10:51.820912 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:51.820893    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-467e44-nxjlb"
Sep 07 04:10:51.822896 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:51.822872    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zs4ff\""
Sep 07 04:10:51.823019 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:51.822877    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 07 04:10:51.828468 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:51.828440    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-467e44-nxjlb"]
Sep 07 04:10:51.964607 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:51.964581    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/54d8c809-7d70-42eb-bef6-2f000e445ad3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-467e44-nxjlb\" (UID: \"54d8c809-7d70-42eb-bef6-2f000e445ad3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-467e44-nxjlb"
Sep 07 04:10:52.065306 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:52.065276    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/54d8c809-7d70-42eb-bef6-2f000e445ad3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-467e44-nxjlb\" (UID: \"54d8c809-7d70-42eb-bef6-2f000e445ad3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-467e44-nxjlb"
Sep 07 04:10:52.065981 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:52.065960    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/54d8c809-7d70-42eb-bef6-2f000e445ad3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-467e44-nxjlb\" (UID: \"54d8c809-7d70-42eb-bef6-2f000e445ad3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-467e44-nxjlb"
Sep 07 04:10:52.134447 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:52.134422    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-467e44-nxjlb"
Sep 07 04:10:52.403959 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:52.403932    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-467e44-nxjlb"]
Sep 07 04:10:52.405546 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:10:52.405518    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54d8c809_7d70_42eb_bef6_2f000e445ad3.slice/crio-d17b6e8a412ea5ab8c26fc06933077d12af2effe05a3e513db0bca5c6551eb3a WatchSource:0}: Error finding container d17b6e8a412ea5ab8c26fc06933077d12af2effe05a3e513db0bca5c6551eb3a: Status 404 returned error can't find the container with id d17b6e8a412ea5ab8c26fc06933077d12af2effe05a3e513db0bca5c6551eb3a
Sep 07 04:10:53.067131 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:53.067100    2559 generic.go:356] "Generic (PLEG): container finished" podID="54d8c809-7d70-42eb-bef6-2f000e445ad3" containerID="f277e4d4b704aae2394fd00c1b862a37a599bf7a928be93d471e457a9f6f6f24" exitCode=0
Sep 07 04:10:53.067430 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:53.067174    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-467e44-nxjlb" event={"ID":"54d8c809-7d70-42eb-bef6-2f000e445ad3","Type":"ContainerDied","Data":"f277e4d4b704aae2394fd00c1b862a37a599bf7a928be93d471e457a9f6f6f24"}
Sep 07 04:10:53.067430 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:53.067220    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-467e44-nxjlb" event={"ID":"54d8c809-7d70-42eb-bef6-2f000e445ad3","Type":"ContainerStarted","Data":"d17b6e8a412ea5ab8c26fc06933077d12af2effe05a3e513db0bca5c6551eb3a"}
Sep 07 04:10:54.208699 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:54.208675    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-467e44-nxjlb"
Sep 07 04:10:54.386729 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:54.386704    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/54d8c809-7d70-42eb-bef6-2f000e445ad3-maas-api-service-ca\") pod \"54d8c809-7d70-42eb-bef6-2f000e445ad3\" (UID: \"54d8c809-7d70-42eb-bef6-2f000e445ad3\") "
Sep 07 04:10:54.387041 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:54.387019    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54d8c809-7d70-42eb-bef6-2f000e445ad3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "54d8c809-7d70-42eb-bef6-2f000e445ad3" (UID: "54d8c809-7d70-42eb-bef6-2f000e445ad3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 04:10:54.487519 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:54.487493    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/54d8c809-7d70-42eb-bef6-2f000e445ad3-maas-api-service-ca\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:10:55.081286 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:55.081254    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-467e44-nxjlb"
Sep 07 04:10:55.081478 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:55.081288    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-467e44-nxjlb" event={"ID":"54d8c809-7d70-42eb-bef6-2f000e445ad3","Type":"ContainerDied","Data":"d17b6e8a412ea5ab8c26fc06933077d12af2effe05a3e513db0bca5c6551eb3a"}
Sep 07 04:10:55.081478 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:10:55.081366    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d17b6e8a412ea5ab8c26fc06933077d12af2effe05a3e513db0bca5c6551eb3a"
Sep 07 04:11:07.230565 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:07.230512    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-467e44-59445b5cdc-xfcqk"]
Sep 07 04:11:07.231339 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:07.230877    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-467e44-59445b5cdc-xfcqk" podUID="081c7440-9285-47de-94e2-88fd25212b1a" containerName="payload-processing" containerID="cri-o://7ed84188f63405734bdd3b26f2a58d0f45fae3f0492e800af460ca54cd90b8dd" gracePeriod=30
Sep 07 04:11:07.363428 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:07.363389    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-467e44-nxjlb"]
Sep 07 04:11:07.367028 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:07.367007    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-467e44-nxjlb"]
Sep 07 04:11:07.502365 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:07.502337    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-467e44-59445b5cdc-xfcqk"
Sep 07 04:11:07.593911 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:07.593887    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w42ln\" (UniqueName: \"kubernetes.io/projected/081c7440-9285-47de-94e2-88fd25212b1a-kube-api-access-w42ln\") pod \"081c7440-9285-47de-94e2-88fd25212b1a\" (UID: \"081c7440-9285-47de-94e2-88fd25212b1a\") "
Sep 07 04:11:07.594085 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:07.593928    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/081c7440-9285-47de-94e2-88fd25212b1a-plugins-config-volume\") pod \"081c7440-9285-47de-94e2-88fd25212b1a\" (UID: \"081c7440-9285-47de-94e2-88fd25212b1a\") "
Sep 07 04:11:07.594340 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:07.594313    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/081c7440-9285-47de-94e2-88fd25212b1a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "081c7440-9285-47de-94e2-88fd25212b1a" (UID: "081c7440-9285-47de-94e2-88fd25212b1a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 04:11:07.596311 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:07.596287    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/081c7440-9285-47de-94e2-88fd25212b1a-kube-api-access-w42ln" (OuterVolumeSpecName: "kube-api-access-w42ln") pod "081c7440-9285-47de-94e2-88fd25212b1a" (UID: "081c7440-9285-47de-94e2-88fd25212b1a"). InnerVolumeSpecName "kube-api-access-w42ln". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 04:11:07.694878 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:07.694855    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w42ln\" (UniqueName: \"kubernetes.io/projected/081c7440-9285-47de-94e2-88fd25212b1a-kube-api-access-w42ln\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:11:07.694878 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:07.694876    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/081c7440-9285-47de-94e2-88fd25212b1a-plugins-config-volume\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:11:08.165835 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:08.165800    2559 generic.go:356] "Generic (PLEG): container finished" podID="081c7440-9285-47de-94e2-88fd25212b1a" containerID="7ed84188f63405734bdd3b26f2a58d0f45fae3f0492e800af460ca54cd90b8dd" exitCode=0
Sep 07 04:11:08.166019 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:08.165845    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-467e44-59445b5cdc-xfcqk"
Sep 07 04:11:08.166019 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:08.165892    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-467e44-59445b5cdc-xfcqk" event={"ID":"081c7440-9285-47de-94e2-88fd25212b1a","Type":"ContainerDied","Data":"7ed84188f63405734bdd3b26f2a58d0f45fae3f0492e800af460ca54cd90b8dd"}
Sep 07 04:11:08.166019 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:08.165963    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-467e44-59445b5cdc-xfcqk" event={"ID":"081c7440-9285-47de-94e2-88fd25212b1a","Type":"ContainerDied","Data":"2fbd756999f2995a68beb723e395ca7e07b607335c72f9d924b114fa14421d14"}
Sep 07 04:11:08.166019 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:08.165996    2559 scope.go:117] "RemoveContainer" containerID="7ed84188f63405734bdd3b26f2a58d0f45fae3f0492e800af460ca54cd90b8dd"
Sep 07 04:11:08.175732 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:08.175714    2559 scope.go:117] "RemoveContainer" containerID="7ed84188f63405734bdd3b26f2a58d0f45fae3f0492e800af460ca54cd90b8dd"
Sep 07 04:11:08.176008 ip-10-0-132-4 kubenswrapper[2559]: E0907 04:11:08.175990    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ed84188f63405734bdd3b26f2a58d0f45fae3f0492e800af460ca54cd90b8dd\": container with ID starting with 7ed84188f63405734bdd3b26f2a58d0f45fae3f0492e800af460ca54cd90b8dd not found: ID does not exist" containerID="7ed84188f63405734bdd3b26f2a58d0f45fae3f0492e800af460ca54cd90b8dd"
Sep 07 04:11:08.176047 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:08.176017    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ed84188f63405734bdd3b26f2a58d0f45fae3f0492e800af460ca54cd90b8dd"} err="failed to get container status \"7ed84188f63405734bdd3b26f2a58d0f45fae3f0492e800af460ca54cd90b8dd\": rpc error: code = NotFound desc = could not find container \"7ed84188f63405734bdd3b26f2a58d0f45fae3f0492e800af460ca54cd90b8dd\": container with ID starting with 7ed84188f63405734bdd3b26f2a58d0f45fae3f0492e800af460ca54cd90b8dd not found: ID does not exist"
Sep 07 04:11:08.185862 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:08.185842    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-467e44-59445b5cdc-xfcqk"]
Sep 07 04:11:08.189694 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:08.189675    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-467e44-59445b5cdc-xfcqk"]
Sep 07 04:11:09.188139 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:09.188091    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="081c7440-9285-47de-94e2-88fd25212b1a" path="/var/lib/kubelet/pods/081c7440-9285-47de-94e2-88fd25212b1a/volumes"
Sep 07 04:11:09.188686 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:09.188661    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54d8c809-7d70-42eb-bef6-2f000e445ad3" path="/var/lib/kubelet/pods/54d8c809-7d70-42eb-bef6-2f000e445ad3/volumes"
Sep 07 04:11:14.042331 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:14.042295    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-cf1797-j4djw"]
Sep 07 04:11:14.042806 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:14.042694    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54d8c809-7d70-42eb-bef6-2f000e445ad3" containerName="revoke-keys"
Sep 07 04:11:14.042806 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:14.042707    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="54d8c809-7d70-42eb-bef6-2f000e445ad3" containerName="revoke-keys"
Sep 07 04:11:14.042806 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:14.042718    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="081c7440-9285-47de-94e2-88fd25212b1a" containerName="payload-processing"
Sep 07 04:11:14.042806 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:14.042724    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="081c7440-9285-47de-94e2-88fd25212b1a" containerName="payload-processing"
Sep 07 04:11:14.042806 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:14.042802    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="081c7440-9285-47de-94e2-88fd25212b1a" containerName="payload-processing"
Sep 07 04:11:14.042806 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:14.042810    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="54d8c809-7d70-42eb-bef6-2f000e445ad3" containerName="revoke-keys"
Sep 07 04:11:14.047388 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:14.047367    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-cf1797-j4djw"
Sep 07 04:11:14.049645 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:14.049604    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 07 04:11:14.049784 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:14.049760    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zs4ff\""
Sep 07 04:11:14.052680 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:14.052654    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-cf1797-j4djw"]
Sep 07 04:11:14.150595 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:14.150570    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e3fe8bd-372f-48e1-bdc3-5ac3aec1c381-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-cf1797-j4djw\" (UID: \"6e3fe8bd-372f-48e1-bdc3-5ac3aec1c381\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-cf1797-j4djw"
Sep 07 04:11:14.251166 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:14.251140    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e3fe8bd-372f-48e1-bdc3-5ac3aec1c381-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-cf1797-j4djw\" (UID: \"6e3fe8bd-372f-48e1-bdc3-5ac3aec1c381\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-cf1797-j4djw"
Sep 07 04:11:14.251933 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:14.251913    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e3fe8bd-372f-48e1-bdc3-5ac3aec1c381-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-cf1797-j4djw\" (UID: \"6e3fe8bd-372f-48e1-bdc3-5ac3aec1c381\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-cf1797-j4djw"
Sep 07 04:11:14.360204 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:14.360187    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-cf1797-j4djw"
Sep 07 04:11:14.635671 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:14.635639    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-cf1797-j4djw"]
Sep 07 04:11:14.636933 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:11:14.636902    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e3fe8bd_372f_48e1_bdc3_5ac3aec1c381.slice/crio-f821c8fd396a50a6801ead39b188fcc636f66e92801da1ee50d8e62a3f780dd6 WatchSource:0}: Error finding container f821c8fd396a50a6801ead39b188fcc636f66e92801da1ee50d8e62a3f780dd6: Status 404 returned error can't find the container with id f821c8fd396a50a6801ead39b188fcc636f66e92801da1ee50d8e62a3f780dd6
Sep 07 04:11:15.213863 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:15.213827    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-cf1797-j4djw" event={"ID":"6e3fe8bd-372f-48e1-bdc3-5ac3aec1c381","Type":"ContainerStarted","Data":"4bcec4e0f5d08f255d68b21c8feb97a8d351b2b2d37132a00c5dc7a493aa7a15"}
Sep 07 04:11:15.214258 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:15.213877    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-cf1797-j4djw" event={"ID":"6e3fe8bd-372f-48e1-bdc3-5ac3aec1c381","Type":"ContainerStarted","Data":"f821c8fd396a50a6801ead39b188fcc636f66e92801da1ee50d8e62a3f780dd6"}
Sep 07 04:11:15.228755 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:15.228704    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-cf1797-j4djw" podStartSLOduration=1.22868979 podStartE2EDuration="1.22868979s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:11:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:11:15.226012511 +0000 UTC m=+1378.538488413" watchObservedRunningTime="2026-09-07 04:11:15.22868979 +0000 UTC m=+1378.541165691"
Sep 07 04:11:16.221739 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:16.221699    2559 generic.go:356] "Generic (PLEG): container finished" podID="6e3fe8bd-372f-48e1-bdc3-5ac3aec1c381" containerID="4bcec4e0f5d08f255d68b21c8feb97a8d351b2b2d37132a00c5dc7a493aa7a15" exitCode=0
Sep 07 04:11:16.222127 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:16.221789    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-cf1797-j4djw" event={"ID":"6e3fe8bd-372f-48e1-bdc3-5ac3aec1c381","Type":"ContainerDied","Data":"4bcec4e0f5d08f255d68b21c8feb97a8d351b2b2d37132a00c5dc7a493aa7a15"}
Sep 07 04:11:16.763389 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:16.763352    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-434d57/rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss"]
Sep 07 04:11:16.767491 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:16.767467    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-434d57/rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss"
Sep 07 04:11:16.771484 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:16.770383    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-434d57\"/\"kube-root-ca.crt\""
Sep 07 04:11:16.771484 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:16.770697    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-434d57\"/\"openshift-service-ca.crt\""
Sep 07 04:11:16.771484 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:16.771369    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-434d57\"/\"rate-test-model-434d57-kserve-self-signed-certs\""
Sep 07 04:11:16.771794 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:16.771591    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-434d57\"/\"default-dockercfg-7kj8j\""
Sep 07 04:11:16.775398 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:16.775351    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-434d57/rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss"]
Sep 07 04:11:16.874400 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:16.874377    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd06bcbd-773c-49dc-8247-95f0f0078e9e-tmp-dir\") pod \"rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss\" (UID: \"dd06bcbd-773c-49dc-8247-95f0f0078e9e\") " pod="ai-tenant-e2e-shared-b-w3-434d57/rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss"
Sep 07 04:11:16.874488 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:16.874414    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97kk2\" (UniqueName: \"kubernetes.io/projected/dd06bcbd-773c-49dc-8247-95f0f0078e9e-kube-api-access-97kk2\") pod \"rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss\" (UID: \"dd06bcbd-773c-49dc-8247-95f0f0078e9e\") " pod="ai-tenant-e2e-shared-b-w3-434d57/rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss"
Sep 07 04:11:16.874488 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:16.874437    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd06bcbd-773c-49dc-8247-95f0f0078e9e-dshm\") pod \"rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss\" (UID: \"dd06bcbd-773c-49dc-8247-95f0f0078e9e\") " pod="ai-tenant-e2e-shared-b-w3-434d57/rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss"
Sep 07 04:11:16.874488 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:16.874453    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd06bcbd-773c-49dc-8247-95f0f0078e9e-model-cache\") pod \"rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss\" (UID: \"dd06bcbd-773c-49dc-8247-95f0f0078e9e\") " pod="ai-tenant-e2e-shared-b-w3-434d57/rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss"
Sep 07 04:11:16.874605 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:16.874515    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd06bcbd-773c-49dc-8247-95f0f0078e9e-tls-certs\") pod \"rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss\" (UID: \"dd06bcbd-773c-49dc-8247-95f0f0078e9e\") " pod="ai-tenant-e2e-shared-b-w3-434d57/rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss"
Sep 07 04:11:16.874668 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:16.874602    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd06bcbd-773c-49dc-8247-95f0f0078e9e-home\") pod \"rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss\" (UID: \"dd06bcbd-773c-49dc-8247-95f0f0078e9e\") " pod="ai-tenant-e2e-shared-b-w3-434d57/rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss"
Sep 07 04:11:16.975226 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:16.975193    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd06bcbd-773c-49dc-8247-95f0f0078e9e-tmp-dir\") pod \"rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss\" (UID: \"dd06bcbd-773c-49dc-8247-95f0f0078e9e\") " pod="ai-tenant-e2e-shared-b-w3-434d57/rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss"
Sep 07 04:11:16.975402 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:16.975256    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97kk2\" (UniqueName: \"kubernetes.io/projected/dd06bcbd-773c-49dc-8247-95f0f0078e9e-kube-api-access-97kk2\") pod \"rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss\" (UID: \"dd06bcbd-773c-49dc-8247-95f0f0078e9e\") " pod="ai-tenant-e2e-shared-b-w3-434d57/rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss"
Sep 07 04:11:16.975402 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:16.975292    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd06bcbd-773c-49dc-8247-95f0f0078e9e-dshm\") pod \"rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss\" (UID: \"dd06bcbd-773c-49dc-8247-95f0f0078e9e\") " pod="ai-tenant-e2e-shared-b-w3-434d57/rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss"
Sep 07 04:11:16.975402 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:16.975314    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd06bcbd-773c-49dc-8247-95f0f0078e9e-model-cache\") pod \"rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss\" (UID: \"dd06bcbd-773c-49dc-8247-95f0f0078e9e\") " pod="ai-tenant-e2e-shared-b-w3-434d57/rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss"
Sep 07 04:11:16.975568 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:16.975407    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd06bcbd-773c-49dc-8247-95f0f0078e9e-tls-certs\") pod \"rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss\" (UID: \"dd06bcbd-773c-49dc-8247-95f0f0078e9e\") " pod="ai-tenant-e2e-shared-b-w3-434d57/rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss"
Sep 07 04:11:16.975568 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:16.975495    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd06bcbd-773c-49dc-8247-95f0f0078e9e-home\") pod \"rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss\" (UID: \"dd06bcbd-773c-49dc-8247-95f0f0078e9e\") " pod="ai-tenant-e2e-shared-b-w3-434d57/rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss"
Sep 07 04:11:16.975725 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:16.975658    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd06bcbd-773c-49dc-8247-95f0f0078e9e-tmp-dir\") pod \"rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss\" (UID: \"dd06bcbd-773c-49dc-8247-95f0f0078e9e\") " pod="ai-tenant-e2e-shared-b-w3-434d57/rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss"
Sep 07 04:11:16.975784 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:16.975740    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd06bcbd-773c-49dc-8247-95f0f0078e9e-model-cache\") pod \"rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss\" (UID: \"dd06bcbd-773c-49dc-8247-95f0f0078e9e\") " pod="ai-tenant-e2e-shared-b-w3-434d57/rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss"
Sep 07 04:11:16.975828 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:16.975797    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd06bcbd-773c-49dc-8247-95f0f0078e9e-home\") pod \"rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss\" (UID: \"dd06bcbd-773c-49dc-8247-95f0f0078e9e\") " pod="ai-tenant-e2e-shared-b-w3-434d57/rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss"
Sep 07 04:11:16.977753 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:16.977728    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd06bcbd-773c-49dc-8247-95f0f0078e9e-dshm\") pod \"rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss\" (UID: \"dd06bcbd-773c-49dc-8247-95f0f0078e9e\") " pod="ai-tenant-e2e-shared-b-w3-434d57/rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss"
Sep 07 04:11:16.978249 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:16.978230    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd06bcbd-773c-49dc-8247-95f0f0078e9e-tls-certs\") pod \"rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss\" (UID: \"dd06bcbd-773c-49dc-8247-95f0f0078e9e\") " pod="ai-tenant-e2e-shared-b-w3-434d57/rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss"
Sep 07 04:11:16.985947 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:16.985921    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97kk2\" (UniqueName: \"kubernetes.io/projected/dd06bcbd-773c-49dc-8247-95f0f0078e9e-kube-api-access-97kk2\") pod \"rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss\" (UID: \"dd06bcbd-773c-49dc-8247-95f0f0078e9e\") " pod="ai-tenant-e2e-shared-b-w3-434d57/rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss"
Sep 07 04:11:17.080642 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:17.080563    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-434d57/rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss"
Sep 07 04:11:17.355876 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:17.355846    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-434d57/rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss"]
Sep 07 04:11:17.357071 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:11:17.357045    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddd06bcbd_773c_49dc_8247_95f0f0078e9e.slice/crio-ace83977415f35dc80985e6a93fbe28834bcfea585892cbc56a260295110dc12 WatchSource:0}: Error finding container ace83977415f35dc80985e6a93fbe28834bcfea585892cbc56a260295110dc12: Status 404 returned error can't find the container with id ace83977415f35dc80985e6a93fbe28834bcfea585892cbc56a260295110dc12
Sep 07 04:11:17.363909 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:17.363892    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-cf1797-j4djw"
Sep 07 04:11:17.470923 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:17.470891    2559 scope.go:117] "RemoveContainer" containerID="5d0841f9a6f8436bc26a8057b8d708d696f0f3660d9b8cde95450821422951b9"
Sep 07 04:11:17.479862 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:17.479839    2559 scope.go:117] "RemoveContainer" containerID="fc3a87543daa691b2be375b161ccce0b5717bff485208c8700f437014ab6e606"
Sep 07 04:11:17.484005 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:17.483987    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e3fe8bd-372f-48e1-bdc3-5ac3aec1c381-maas-api-service-ca\") pod \"6e3fe8bd-372f-48e1-bdc3-5ac3aec1c381\" (UID: \"6e3fe8bd-372f-48e1-bdc3-5ac3aec1c381\") "
Sep 07 04:11:17.484335 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:17.484314    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e3fe8bd-372f-48e1-bdc3-5ac3aec1c381-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6e3fe8bd-372f-48e1-bdc3-5ac3aec1c381" (UID: "6e3fe8bd-372f-48e1-bdc3-5ac3aec1c381"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 04:11:17.484433 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:17.484419    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6e3fe8bd-372f-48e1-bdc3-5ac3aec1c381-maas-api-service-ca\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:11:18.236068 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:18.236029    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-434d57/rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss" event={"ID":"dd06bcbd-773c-49dc-8247-95f0f0078e9e","Type":"ContainerStarted","Data":"9bc2883f64f6675d4813675d8beb5d4646a8181d19d7d664e7435a696d23693a"}
Sep 07 04:11:18.236068 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:18.236073    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-434d57/rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss" event={"ID":"dd06bcbd-773c-49dc-8247-95f0f0078e9e","Type":"ContainerStarted","Data":"ace83977415f35dc80985e6a93fbe28834bcfea585892cbc56a260295110dc12"}
Sep 07 04:11:18.237383 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:18.237364    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-cf1797-j4djw"
Sep 07 04:11:18.237488 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:18.237387    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-cf1797-j4djw" event={"ID":"6e3fe8bd-372f-48e1-bdc3-5ac3aec1c381","Type":"ContainerDied","Data":"f821c8fd396a50a6801ead39b188fcc636f66e92801da1ee50d8e62a3f780dd6"}
Sep 07 04:11:18.237488 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:18.237424    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f821c8fd396a50a6801ead39b188fcc636f66e92801da1ee50d8e62a3f780dd6"
Sep 07 04:11:18.252122 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:18.252076    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-434d57/rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss" podStartSLOduration=2.252059564 podStartE2EDuration="2.252059564s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:11:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:11:18.249481586 +0000 UTC m=+1381.561957487" watchObservedRunningTime="2026-09-07 04:11:18.252059564 +0000 UTC m=+1381.564535466"
Sep 07 04:11:27.080823 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:27.080777    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-434d57/rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss"
Sep 07 04:11:27.080823 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:27.080837    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-434d57/rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss"
Sep 07 04:11:27.093241 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:27.093217    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-434d57/rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss"
Sep 07 04:11:27.302361 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:27.302333    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-434d57/rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss"
Sep 07 04:11:29.485541 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:29.485504    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-cf1797-c898b8b67-2wkml"]
Sep 07 04:11:29.486034 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:29.485818    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-cf1797-c898b8b67-2wkml" podUID="01e1fd88-6b34-42ea-b583-70ae2c467231" containerName="payload-processing" containerID="cri-o://7b7e4c62d797b91a5bb8b281851590ffb5087629a3926048fa4973fa091526de" gracePeriod=30
Sep 07 04:11:29.616733 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:29.616675    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-cf1797-j4djw"]
Sep 07 04:11:29.619356 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:29.619328    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-cf1797-j4djw"]
Sep 07 04:11:29.748515 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:29.748464    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-cf1797-c898b8b67-2wkml"
Sep 07 04:11:29.897475 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:29.897436    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01e1fd88-6b34-42ea-b583-70ae2c467231-plugins-config-volume\") pod \"01e1fd88-6b34-42ea-b583-70ae2c467231\" (UID: \"01e1fd88-6b34-42ea-b583-70ae2c467231\") "
Sep 07 04:11:29.897700 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:29.897495    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5s9k\" (UniqueName: \"kubernetes.io/projected/01e1fd88-6b34-42ea-b583-70ae2c467231-kube-api-access-r5s9k\") pod \"01e1fd88-6b34-42ea-b583-70ae2c467231\" (UID: \"01e1fd88-6b34-42ea-b583-70ae2c467231\") "
Sep 07 04:11:29.897845 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:29.897821    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01e1fd88-6b34-42ea-b583-70ae2c467231-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "01e1fd88-6b34-42ea-b583-70ae2c467231" (UID: "01e1fd88-6b34-42ea-b583-70ae2c467231"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 04:11:29.899550 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:29.899530    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01e1fd88-6b34-42ea-b583-70ae2c467231-kube-api-access-r5s9k" (OuterVolumeSpecName: "kube-api-access-r5s9k") pod "01e1fd88-6b34-42ea-b583-70ae2c467231" (UID: "01e1fd88-6b34-42ea-b583-70ae2c467231"). InnerVolumeSpecName "kube-api-access-r5s9k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 04:11:29.998582 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:29.998507    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01e1fd88-6b34-42ea-b583-70ae2c467231-plugins-config-volume\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:11:29.998582 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:29.998541    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5s9k\" (UniqueName: \"kubernetes.io/projected/01e1fd88-6b34-42ea-b583-70ae2c467231-kube-api-access-r5s9k\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:11:30.308387 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:30.308306    2559 generic.go:356] "Generic (PLEG): container finished" podID="01e1fd88-6b34-42ea-b583-70ae2c467231" containerID="7b7e4c62d797b91a5bb8b281851590ffb5087629a3926048fa4973fa091526de" exitCode=0
Sep 07 04:11:30.308387 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:30.308349    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-cf1797-c898b8b67-2wkml"
Sep 07 04:11:30.308600 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:30.308395    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-cf1797-c898b8b67-2wkml" event={"ID":"01e1fd88-6b34-42ea-b583-70ae2c467231","Type":"ContainerDied","Data":"7b7e4c62d797b91a5bb8b281851590ffb5087629a3926048fa4973fa091526de"}
Sep 07 04:11:30.308600 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:30.308449    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-cf1797-c898b8b67-2wkml" event={"ID":"01e1fd88-6b34-42ea-b583-70ae2c467231","Type":"ContainerDied","Data":"b3a9a9d1b4906da8126bb200fd7d99d3829550aea9bb737d9722ef7705a1c5d3"}
Sep 07 04:11:30.308600 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:30.308481    2559 scope.go:117] "RemoveContainer" containerID="7b7e4c62d797b91a5bb8b281851590ffb5087629a3926048fa4973fa091526de"
Sep 07 04:11:30.323065 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:30.323040    2559 scope.go:117] "RemoveContainer" containerID="7b7e4c62d797b91a5bb8b281851590ffb5087629a3926048fa4973fa091526de"
Sep 07 04:11:30.323348 ip-10-0-132-4 kubenswrapper[2559]: E0907 04:11:30.323326    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b7e4c62d797b91a5bb8b281851590ffb5087629a3926048fa4973fa091526de\": container with ID starting with 7b7e4c62d797b91a5bb8b281851590ffb5087629a3926048fa4973fa091526de not found: ID does not exist" containerID="7b7e4c62d797b91a5bb8b281851590ffb5087629a3926048fa4973fa091526de"
Sep 07 04:11:30.323397 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:30.323356    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b7e4c62d797b91a5bb8b281851590ffb5087629a3926048fa4973fa091526de"} err="failed to get container status \"7b7e4c62d797b91a5bb8b281851590ffb5087629a3926048fa4973fa091526de\": rpc error: code = NotFound desc = could not find container \"7b7e4c62d797b91a5bb8b281851590ffb5087629a3926048fa4973fa091526de\": container with ID starting with 7b7e4c62d797b91a5bb8b281851590ffb5087629a3926048fa4973fa091526de not found: ID does not exist"
Sep 07 04:11:30.333265 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:30.333239    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-cf1797-c898b8b67-2wkml"]
Sep 07 04:11:30.336948 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:30.336921    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-cf1797-c898b8b67-2wkml"]
Sep 07 04:11:31.179966 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:31.179936    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01e1fd88-6b34-42ea-b583-70ae2c467231" path="/var/lib/kubelet/pods/01e1fd88-6b34-42ea-b583-70ae2c467231/volumes"
Sep 07 04:11:31.180327 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:31.180264    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e3fe8bd-372f-48e1-bdc3-5ac3aec1c381" path="/var/lib/kubelet/pods/6e3fe8bd-372f-48e1-bdc3-5ac3aec1c381/volumes"
Sep 07 04:11:36.356274 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:36.356240    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-747fee-jkjl9"]
Sep 07 04:11:36.356682 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:36.356647    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01e1fd88-6b34-42ea-b583-70ae2c467231" containerName="payload-processing"
Sep 07 04:11:36.356682 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:36.356660    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="01e1fd88-6b34-42ea-b583-70ae2c467231" containerName="payload-processing"
Sep 07 04:11:36.356682 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:36.356676    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e3fe8bd-372f-48e1-bdc3-5ac3aec1c381" containerName="revoke-keys"
Sep 07 04:11:36.356682 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:36.356682    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e3fe8bd-372f-48e1-bdc3-5ac3aec1c381" containerName="revoke-keys"
Sep 07 04:11:36.356824 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:36.356736    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="01e1fd88-6b34-42ea-b583-70ae2c467231" containerName="payload-processing"
Sep 07 04:11:36.356824 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:36.356746    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e3fe8bd-372f-48e1-bdc3-5ac3aec1c381" containerName="revoke-keys"
Sep 07 04:11:36.360953 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:36.360935    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-747fee-jkjl9"
Sep 07 04:11:36.362922 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:36.362897    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 07 04:11:36.362922 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:36.362916    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zs4ff\""
Sep 07 04:11:36.367144 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:36.367122    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-747fee-jkjl9"]
Sep 07 04:11:36.454733 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:36.454701    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ff9f137-b0c6-4fc0-8c36-97c681e84f38-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-747fee-jkjl9\" (UID: \"0ff9f137-b0c6-4fc0-8c36-97c681e84f38\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-747fee-jkjl9"
Sep 07 04:11:36.555612 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:36.555575    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ff9f137-b0c6-4fc0-8c36-97c681e84f38-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-747fee-jkjl9\" (UID: \"0ff9f137-b0c6-4fc0-8c36-97c681e84f38\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-747fee-jkjl9"
Sep 07 04:11:36.556634 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:36.556593    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ff9f137-b0c6-4fc0-8c36-97c681e84f38-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-747fee-jkjl9\" (UID: \"0ff9f137-b0c6-4fc0-8c36-97c681e84f38\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-747fee-jkjl9"
Sep 07 04:11:36.672801 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:36.672732    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-747fee-jkjl9"
Sep 07 04:11:36.947957 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:36.947929    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-747fee-jkjl9"]
Sep 07 04:11:36.949044 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:11:36.949018    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ff9f137_b0c6_4fc0_8c36_97c681e84f38.slice/crio-f17e9b68d04da5396a79c4f9c283844120c9a84afe6052e2a70fbdd93f525664 WatchSource:0}: Error finding container f17e9b68d04da5396a79c4f9c283844120c9a84afe6052e2a70fbdd93f525664: Status 404 returned error can't find the container with id f17e9b68d04da5396a79c4f9c283844120c9a84afe6052e2a70fbdd93f525664
Sep 07 04:11:37.351214 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:37.351178    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-747fee-jkjl9" event={"ID":"0ff9f137-b0c6-4fc0-8c36-97c681e84f38","Type":"ContainerStarted","Data":"46f6c94a1e36630a775ed43a8cb24b8251e586f57d79c88b6ca5d802133cd76a"}
Sep 07 04:11:37.351385 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:37.351241    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-747fee-jkjl9" event={"ID":"0ff9f137-b0c6-4fc0-8c36-97c681e84f38","Type":"ContainerStarted","Data":"f17e9b68d04da5396a79c4f9c283844120c9a84afe6052e2a70fbdd93f525664"}
Sep 07 04:11:37.364504 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:37.364456    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-747fee-jkjl9" podStartSLOduration=1.364439823 podStartE2EDuration="1.364439823s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:11:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:11:37.363228081 +0000 UTC m=+1400.675703993" watchObservedRunningTime="2026-09-07 04:11:37.364439823 +0000 UTC m=+1400.676915752"
Sep 07 04:11:38.361889 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:38.361853    2559 generic.go:356] "Generic (PLEG): container finished" podID="0ff9f137-b0c6-4fc0-8c36-97c681e84f38" containerID="46f6c94a1e36630a775ed43a8cb24b8251e586f57d79c88b6ca5d802133cd76a" exitCode=0
Sep 07 04:11:38.362137 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:38.361946    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-747fee-jkjl9" event={"ID":"0ff9f137-b0c6-4fc0-8c36-97c681e84f38","Type":"ContainerDied","Data":"46f6c94a1e36630a775ed43a8cb24b8251e586f57d79c88b6ca5d802133cd76a"}
Sep 07 04:11:39.500091 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:39.500065    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-747fee-jkjl9"
Sep 07 04:11:39.689918 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:39.689847    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ff9f137-b0c6-4fc0-8c36-97c681e84f38-maas-api-service-ca\") pod \"0ff9f137-b0c6-4fc0-8c36-97c681e84f38\" (UID: \"0ff9f137-b0c6-4fc0-8c36-97c681e84f38\") "
Sep 07 04:11:39.690184 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:39.690161    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ff9f137-b0c6-4fc0-8c36-97c681e84f38-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0ff9f137-b0c6-4fc0-8c36-97c681e84f38" (UID: "0ff9f137-b0c6-4fc0-8c36-97c681e84f38"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 04:11:39.790408 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:39.790384    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ff9f137-b0c6-4fc0-8c36-97c681e84f38-maas-api-service-ca\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:11:40.375567 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:40.375541    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-747fee-jkjl9"
Sep 07 04:11:40.375771 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:40.375566    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-747fee-jkjl9" event={"ID":"0ff9f137-b0c6-4fc0-8c36-97c681e84f38","Type":"ContainerDied","Data":"f17e9b68d04da5396a79c4f9c283844120c9a84afe6052e2a70fbdd93f525664"}
Sep 07 04:11:40.375771 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:40.375642    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f17e9b68d04da5396a79c4f9c283844120c9a84afe6052e2a70fbdd93f525664"
Sep 07 04:11:46.760418 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:46.760376    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-747fee-66566c8f57-4z8lp"]
Sep 07 04:11:46.760921 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:46.760659    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-747fee-66566c8f57-4z8lp" podUID="d608cb95-04bb-4d4e-bccd-31a68ef5504e" containerName="payload-processing" containerID="cri-o://426ce6a2af39915f5f788c096f967cd952d6037af13585f0d24d3d20bcb7beaa" gracePeriod=30
Sep 07 04:11:46.768105 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:46.768063    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-747fee-6bccf85d6b-ww5g5"]
Sep 07 04:11:46.768836 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:46.768650    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-747fee-6bccf85d6b-ww5g5" podUID="b2d0c189-7fb1-4840-bef9-932be36977fe" containerName="payload-pre-processing" containerID="cri-o://a9c845bc470a078b7cb59b617736d5fd6d1934e6581cfb46fe4a8c00f0077fb4" gracePeriod=30
Sep 07 04:11:46.894002 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:46.893965    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-747fee-jkjl9"]
Sep 07 04:11:46.896481 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:46.896451    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-747fee-jkjl9"]
Sep 07 04:11:47.049248 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:47.049224    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-747fee-66566c8f57-4z8lp"
Sep 07 04:11:47.076804 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:47.076781    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-747fee-6bccf85d6b-ww5g5"
Sep 07 04:11:47.155854 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:47.155826    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d608cb95-04bb-4d4e-bccd-31a68ef5504e-plugins-config-volume\") pod \"d608cb95-04bb-4d4e-bccd-31a68ef5504e\" (UID: \"d608cb95-04bb-4d4e-bccd-31a68ef5504e\") "
Sep 07 04:11:47.156051 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:47.155930    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-md95c\" (UniqueName: \"kubernetes.io/projected/d608cb95-04bb-4d4e-bccd-31a68ef5504e-kube-api-access-md95c\") pod \"d608cb95-04bb-4d4e-bccd-31a68ef5504e\" (UID: \"d608cb95-04bb-4d4e-bccd-31a68ef5504e\") "
Sep 07 04:11:47.156051 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:47.155974    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2d0c189-7fb1-4840-bef9-932be36977fe-plugins-config-volume\") pod \"b2d0c189-7fb1-4840-bef9-932be36977fe\" (UID: \"b2d0c189-7fb1-4840-bef9-932be36977fe\") "
Sep 07 04:11:47.156051 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:47.156012    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwfsk\" (UniqueName: \"kubernetes.io/projected/b2d0c189-7fb1-4840-bef9-932be36977fe-kube-api-access-xwfsk\") pod \"b2d0c189-7fb1-4840-bef9-932be36977fe\" (UID: \"b2d0c189-7fb1-4840-bef9-932be36977fe\") "
Sep 07 04:11:47.156371 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:47.156204    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d608cb95-04bb-4d4e-bccd-31a68ef5504e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d608cb95-04bb-4d4e-bccd-31a68ef5504e" (UID: "d608cb95-04bb-4d4e-bccd-31a68ef5504e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 04:11:47.156437 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:47.156380    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2d0c189-7fb1-4840-bef9-932be36977fe-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b2d0c189-7fb1-4840-bef9-932be36977fe" (UID: "b2d0c189-7fb1-4840-bef9-932be36977fe"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 04:11:47.158007 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:47.157985    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d608cb95-04bb-4d4e-bccd-31a68ef5504e-kube-api-access-md95c" (OuterVolumeSpecName: "kube-api-access-md95c") pod "d608cb95-04bb-4d4e-bccd-31a68ef5504e" (UID: "d608cb95-04bb-4d4e-bccd-31a68ef5504e"). InnerVolumeSpecName "kube-api-access-md95c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 04:11:47.158118 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:47.158100    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2d0c189-7fb1-4840-bef9-932be36977fe-kube-api-access-xwfsk" (OuterVolumeSpecName: "kube-api-access-xwfsk") pod "b2d0c189-7fb1-4840-bef9-932be36977fe" (UID: "b2d0c189-7fb1-4840-bef9-932be36977fe"). InnerVolumeSpecName "kube-api-access-xwfsk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 04:11:47.179371 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:47.179342    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ff9f137-b0c6-4fc0-8c36-97c681e84f38" path="/var/lib/kubelet/pods/0ff9f137-b0c6-4fc0-8c36-97c681e84f38/volumes"
Sep 07 04:11:47.257635 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:47.257597    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-md95c\" (UniqueName: \"kubernetes.io/projected/d608cb95-04bb-4d4e-bccd-31a68ef5504e-kube-api-access-md95c\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:11:47.257635 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:47.257634    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2d0c189-7fb1-4840-bef9-932be36977fe-plugins-config-volume\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:11:47.257831 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:47.257649    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwfsk\" (UniqueName: \"kubernetes.io/projected/b2d0c189-7fb1-4840-bef9-932be36977fe-kube-api-access-xwfsk\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:11:47.257831 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:47.257663    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d608cb95-04bb-4d4e-bccd-31a68ef5504e-plugins-config-volume\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:11:47.423734 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:47.423683    2559 generic.go:356] "Generic (PLEG): container finished" podID="b2d0c189-7fb1-4840-bef9-932be36977fe" containerID="a9c845bc470a078b7cb59b617736d5fd6d1934e6581cfb46fe4a8c00f0077fb4" exitCode=0
Sep 07 04:11:47.423937 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:47.423754    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-747fee-6bccf85d6b-ww5g5"
Sep 07 04:11:47.423937 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:47.423748    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-747fee-6bccf85d6b-ww5g5" event={"ID":"b2d0c189-7fb1-4840-bef9-932be36977fe","Type":"ContainerDied","Data":"a9c845bc470a078b7cb59b617736d5fd6d1934e6581cfb46fe4a8c00f0077fb4"}
Sep 07 04:11:47.423937 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:47.423926    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-747fee-6bccf85d6b-ww5g5" event={"ID":"b2d0c189-7fb1-4840-bef9-932be36977fe","Type":"ContainerDied","Data":"453d0d5c1943bc1069844d5b8570b54480489daa442fe0227b7464aea8a4aa0c"}
Sep 07 04:11:47.424120 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:47.423962    2559 scope.go:117] "RemoveContainer" containerID="a9c845bc470a078b7cb59b617736d5fd6d1934e6581cfb46fe4a8c00f0077fb4"
Sep 07 04:11:47.429140 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:47.429114    2559 generic.go:356] "Generic (PLEG): container finished" podID="d608cb95-04bb-4d4e-bccd-31a68ef5504e" containerID="426ce6a2af39915f5f788c096f967cd952d6037af13585f0d24d3d20bcb7beaa" exitCode=0
Sep 07 04:11:47.429260 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:47.429192    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-747fee-66566c8f57-4z8lp" event={"ID":"d608cb95-04bb-4d4e-bccd-31a68ef5504e","Type":"ContainerDied","Data":"426ce6a2af39915f5f788c096f967cd952d6037af13585f0d24d3d20bcb7beaa"}
Sep 07 04:11:47.429260 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:47.429233    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-747fee-66566c8f57-4z8lp" event={"ID":"d608cb95-04bb-4d4e-bccd-31a68ef5504e","Type":"ContainerDied","Data":"70810c9a096f734323b8d23fc05b74d59ef2d6e4d178bd7b55af3cc70c2ef0a7"}
Sep 07 04:11:47.429397 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:47.429299    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-747fee-66566c8f57-4z8lp"
Sep 07 04:11:47.435663 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:47.435607    2559 scope.go:117] "RemoveContainer" containerID="a9c845bc470a078b7cb59b617736d5fd6d1934e6581cfb46fe4a8c00f0077fb4"
Sep 07 04:11:47.435944 ip-10-0-132-4 kubenswrapper[2559]: E0907 04:11:47.435927    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9c845bc470a078b7cb59b617736d5fd6d1934e6581cfb46fe4a8c00f0077fb4\": container with ID starting with a9c845bc470a078b7cb59b617736d5fd6d1934e6581cfb46fe4a8c00f0077fb4 not found: ID does not exist" containerID="a9c845bc470a078b7cb59b617736d5fd6d1934e6581cfb46fe4a8c00f0077fb4"
Sep 07 04:11:47.436003 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:47.435953    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9c845bc470a078b7cb59b617736d5fd6d1934e6581cfb46fe4a8c00f0077fb4"} err="failed to get container status \"a9c845bc470a078b7cb59b617736d5fd6d1934e6581cfb46fe4a8c00f0077fb4\": rpc error: code = NotFound desc = could not find container \"a9c845bc470a078b7cb59b617736d5fd6d1934e6581cfb46fe4a8c00f0077fb4\": container with ID starting with a9c845bc470a078b7cb59b617736d5fd6d1934e6581cfb46fe4a8c00f0077fb4 not found: ID does not exist"
Sep 07 04:11:47.436003 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:47.435968    2559 scope.go:117] "RemoveContainer" containerID="426ce6a2af39915f5f788c096f967cd952d6037af13585f0d24d3d20bcb7beaa"
Sep 07 04:11:47.444204 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:47.444189    2559 scope.go:117] "RemoveContainer" containerID="426ce6a2af39915f5f788c096f967cd952d6037af13585f0d24d3d20bcb7beaa"
Sep 07 04:11:47.444480 ip-10-0-132-4 kubenswrapper[2559]: E0907 04:11:47.444459    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"426ce6a2af39915f5f788c096f967cd952d6037af13585f0d24d3d20bcb7beaa\": container with ID starting with 426ce6a2af39915f5f788c096f967cd952d6037af13585f0d24d3d20bcb7beaa not found: ID does not exist" containerID="426ce6a2af39915f5f788c096f967cd952d6037af13585f0d24d3d20bcb7beaa"
Sep 07 04:11:47.444557 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:47.444485    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"426ce6a2af39915f5f788c096f967cd952d6037af13585f0d24d3d20bcb7beaa"} err="failed to get container status \"426ce6a2af39915f5f788c096f967cd952d6037af13585f0d24d3d20bcb7beaa\": rpc error: code = NotFound desc = could not find container \"426ce6a2af39915f5f788c096f967cd952d6037af13585f0d24d3d20bcb7beaa\": container with ID starting with 426ce6a2af39915f5f788c096f967cd952d6037af13585f0d24d3d20bcb7beaa not found: ID does not exist"
Sep 07 04:11:47.444602 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:47.444567    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-747fee-6bccf85d6b-ww5g5"]
Sep 07 04:11:47.448330 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:47.448308    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-747fee-6bccf85d6b-ww5g5"]
Sep 07 04:11:47.457211 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:47.457192    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-747fee-66566c8f57-4z8lp"]
Sep 07 04:11:47.460175 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:47.460154    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-747fee-66566c8f57-4z8lp"]
Sep 07 04:11:49.179709 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:49.179679    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2d0c189-7fb1-4840-bef9-932be36977fe" path="/var/lib/kubelet/pods/b2d0c189-7fb1-4840-bef9-932be36977fe/volumes"
Sep 07 04:11:49.180079 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:49.180032    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d608cb95-04bb-4d4e-bccd-31a68ef5504e" path="/var/lib/kubelet/pods/d608cb95-04bb-4d4e-bccd-31a68ef5504e/volumes"
Sep 07 04:11:53.072863 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:53.072826    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv"]
Sep 07 04:11:53.073335 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:53.073144    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv" podUID="49e003d0-feaa-4814-b10c-daf640f65527" containerName="istio-proxy" containerID="cri-o://02e4da9b62cfc76bcd664ab1c59689db55a56d8e6e5ec7aebb8b379e1dab3734" gracePeriod=30
Sep 07 04:11:53.432878 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:53.432835    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-a89024-jw8j9"]
Sep 07 04:11:53.433312 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:53.433290    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d608cb95-04bb-4d4e-bccd-31a68ef5504e" containerName="payload-processing"
Sep 07 04:11:53.433404 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:53.433314    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d608cb95-04bb-4d4e-bccd-31a68ef5504e" containerName="payload-processing"
Sep 07 04:11:53.433404 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:53.433325    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ff9f137-b0c6-4fc0-8c36-97c681e84f38" containerName="revoke-keys"
Sep 07 04:11:53.433404 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:53.433333    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ff9f137-b0c6-4fc0-8c36-97c681e84f38" containerName="revoke-keys"
Sep 07 04:11:53.433404 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:53.433346    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2d0c189-7fb1-4840-bef9-932be36977fe" containerName="payload-pre-processing"
Sep 07 04:11:53.433404 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:53.433354    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2d0c189-7fb1-4840-bef9-932be36977fe" containerName="payload-pre-processing"
Sep 07 04:11:53.433696 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:53.433440    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d608cb95-04bb-4d4e-bccd-31a68ef5504e" containerName="payload-processing"
Sep 07 04:11:53.433696 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:53.433457    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ff9f137-b0c6-4fc0-8c36-97c681e84f38" containerName="revoke-keys"
Sep 07 04:11:53.433696 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:53.433470    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2d0c189-7fb1-4840-bef9-932be36977fe" containerName="payload-pre-processing"
Sep 07 04:11:53.438002 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:53.437981    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-a89024-jw8j9"
Sep 07 04:11:53.440688 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:53.440660    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 07 04:11:53.441329 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:53.441312    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zs4ff\""
Sep 07 04:11:53.447124 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:53.447099    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-a89024-jw8j9"]
Sep 07 04:11:53.513264 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:53.513230    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/432b31ec-0a0f-4984-9f05-0003bae0b08e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-a89024-jw8j9\" (UID: \"432b31ec-0a0f-4984-9f05-0003bae0b08e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-a89024-jw8j9"
Sep 07 04:11:53.614011 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:53.613970    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/432b31ec-0a0f-4984-9f05-0003bae0b08e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-a89024-jw8j9\" (UID: \"432b31ec-0a0f-4984-9f05-0003bae0b08e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-a89024-jw8j9"
Sep 07 04:11:53.614608 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:53.614587    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/432b31ec-0a0f-4984-9f05-0003bae0b08e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-a89024-jw8j9\" (UID: \"432b31ec-0a0f-4984-9f05-0003bae0b08e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-a89024-jw8j9"
Sep 07 04:11:53.748796 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:53.748715    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-a89024-jw8j9"
Sep 07 04:11:54.019860 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:54.019829    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-a89024-jw8j9"]
Sep 07 04:11:54.020844 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:11:54.020819    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod432b31ec_0a0f_4984_9f05_0003bae0b08e.slice/crio-c71dfbf756f5b729af89c749a0b96789909e93db028780d367a64c1657424cd3 WatchSource:0}: Error finding container c71dfbf756f5b729af89c749a0b96789909e93db028780d367a64c1657424cd3: Status 404 returned error can't find the container with id c71dfbf756f5b729af89c749a0b96789909e93db028780d367a64c1657424cd3
Sep 07 04:11:54.472422 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:54.472390    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-a89024-jw8j9" event={"ID":"432b31ec-0a0f-4984-9f05-0003bae0b08e","Type":"ContainerStarted","Data":"9aa8f8a60802533028973f136e07c259f65d68e30c17117d732b99bd5befd783"}
Sep 07 04:11:54.472770 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:54.472449    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-a89024-jw8j9" event={"ID":"432b31ec-0a0f-4984-9f05-0003bae0b08e","Type":"ContainerStarted","Data":"c71dfbf756f5b729af89c749a0b96789909e93db028780d367a64c1657424cd3"}
Sep 07 04:11:54.485780 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:54.485716    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-a89024-jw8j9" podStartSLOduration=1.485700501 podStartE2EDuration="1.485700501s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:11:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:11:54.484278404 +0000 UTC m=+1417.796754306" watchObservedRunningTime="2026-09-07 04:11:54.485700501 +0000 UTC m=+1417.798176404"
Sep 07 04:11:55.479430 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:55.479395    2559 generic.go:356] "Generic (PLEG): container finished" podID="432b31ec-0a0f-4984-9f05-0003bae0b08e" containerID="9aa8f8a60802533028973f136e07c259f65d68e30c17117d732b99bd5befd783" exitCode=0
Sep 07 04:11:55.479905 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:55.479484    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-a89024-jw8j9" event={"ID":"432b31ec-0a0f-4984-9f05-0003bae0b08e","Type":"ContainerDied","Data":"9aa8f8a60802533028973f136e07c259f65d68e30c17117d732b99bd5befd783"}
Sep 07 04:11:56.615281 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:56.615254    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-a89024-jw8j9"
Sep 07 04:11:56.744888 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:56.744793    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/432b31ec-0a0f-4984-9f05-0003bae0b08e-maas-api-service-ca\") pod \"432b31ec-0a0f-4984-9f05-0003bae0b08e\" (UID: \"432b31ec-0a0f-4984-9f05-0003bae0b08e\") "
Sep 07 04:11:56.745144 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:56.745120    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/432b31ec-0a0f-4984-9f05-0003bae0b08e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "432b31ec-0a0f-4984-9f05-0003bae0b08e" (UID: "432b31ec-0a0f-4984-9f05-0003bae0b08e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 04:11:56.846421 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:56.846390    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/432b31ec-0a0f-4984-9f05-0003bae0b08e-maas-api-service-ca\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:11:57.492283 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:57.492210    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-a89024-jw8j9"
Sep 07 04:11:57.492283 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:57.492252    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-a89024-jw8j9" event={"ID":"432b31ec-0a0f-4984-9f05-0003bae0b08e","Type":"ContainerDied","Data":"c71dfbf756f5b729af89c749a0b96789909e93db028780d367a64c1657424cd3"}
Sep 07 04:11:57.492472 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:57.492298    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c71dfbf756f5b729af89c749a0b96789909e93db028780d367a64c1657424cd3"
Sep 07 04:11:58.329430 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:58.329408    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv"
Sep 07 04:11:58.460200 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:58.460174    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49e003d0-feaa-4814-b10c-daf640f65527-istiod-ca-cert\") pod \"49e003d0-feaa-4814-b10c-daf640f65527\" (UID: \"49e003d0-feaa-4814-b10c-daf640f65527\") "
Sep 07 04:11:58.460317 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:58.460216    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49e003d0-feaa-4814-b10c-daf640f65527-istio-envoy\") pod \"49e003d0-feaa-4814-b10c-daf640f65527\" (UID: \"49e003d0-feaa-4814-b10c-daf640f65527\") "
Sep 07 04:11:58.460317 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:58.460241    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49e003d0-feaa-4814-b10c-daf640f65527-istio-podinfo\") pod \"49e003d0-feaa-4814-b10c-daf640f65527\" (UID: \"49e003d0-feaa-4814-b10c-daf640f65527\") "
Sep 07 04:11:58.460317 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:58.460289    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49e003d0-feaa-4814-b10c-daf640f65527-workload-socket\") pod \"49e003d0-feaa-4814-b10c-daf640f65527\" (UID: \"49e003d0-feaa-4814-b10c-daf640f65527\") "
Sep 07 04:11:58.460317 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:58.460310    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49e003d0-feaa-4814-b10c-daf640f65527-credential-socket\") pod \"49e003d0-feaa-4814-b10c-daf640f65527\" (UID: \"49e003d0-feaa-4814-b10c-daf640f65527\") "
Sep 07 04:11:58.460534 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:58.460350    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49e003d0-feaa-4814-b10c-daf640f65527-istio-token\") pod \"49e003d0-feaa-4814-b10c-daf640f65527\" (UID: \"49e003d0-feaa-4814-b10c-daf640f65527\") "
Sep 07 04:11:58.460534 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:58.460376    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49e003d0-feaa-4814-b10c-daf640f65527-workload-certs\") pod \"49e003d0-feaa-4814-b10c-daf640f65527\" (UID: \"49e003d0-feaa-4814-b10c-daf640f65527\") "
Sep 07 04:11:58.460534 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:58.460451    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5hrb\" (UniqueName: \"kubernetes.io/projected/49e003d0-feaa-4814-b10c-daf640f65527-kube-api-access-m5hrb\") pod \"49e003d0-feaa-4814-b10c-daf640f65527\" (UID: \"49e003d0-feaa-4814-b10c-daf640f65527\") "
Sep 07 04:11:58.460534 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:58.460482    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49e003d0-feaa-4814-b10c-daf640f65527-istio-data\") pod \"49e003d0-feaa-4814-b10c-daf640f65527\" (UID: \"49e003d0-feaa-4814-b10c-daf640f65527\") "
Sep 07 04:11:58.460795 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:58.460580    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49e003d0-feaa-4814-b10c-daf640f65527-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "49e003d0-feaa-4814-b10c-daf640f65527" (UID: "49e003d0-feaa-4814-b10c-daf640f65527"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:11:58.460795 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:58.460601    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49e003d0-feaa-4814-b10c-daf640f65527-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "49e003d0-feaa-4814-b10c-daf640f65527" (UID: "49e003d0-feaa-4814-b10c-daf640f65527"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 04:11:58.460908 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:58.460837    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49e003d0-feaa-4814-b10c-daf640f65527-istio-data" (OuterVolumeSpecName: "istio-data") pod "49e003d0-feaa-4814-b10c-daf640f65527" (UID: "49e003d0-feaa-4814-b10c-daf640f65527"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:11:58.460908 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:58.460855    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49e003d0-feaa-4814-b10c-daf640f65527-credential-socket\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:11:58.460908 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:58.460854    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49e003d0-feaa-4814-b10c-daf640f65527-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "49e003d0-feaa-4814-b10c-daf640f65527" (UID: "49e003d0-feaa-4814-b10c-daf640f65527"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:11:58.460908 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:58.460879    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49e003d0-feaa-4814-b10c-daf640f65527-istiod-ca-cert\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:11:58.461124 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:58.461039    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49e003d0-feaa-4814-b10c-daf640f65527-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "49e003d0-feaa-4814-b10c-daf640f65527" (UID: "49e003d0-feaa-4814-b10c-daf640f65527"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:11:58.462845 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:58.462793    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/49e003d0-feaa-4814-b10c-daf640f65527-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "49e003d0-feaa-4814-b10c-daf640f65527" (UID: "49e003d0-feaa-4814-b10c-daf640f65527"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 04:11:58.462845 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:58.462790    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49e003d0-feaa-4814-b10c-daf640f65527-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "49e003d0-feaa-4814-b10c-daf640f65527" (UID: "49e003d0-feaa-4814-b10c-daf640f65527"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:11:58.463028 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:58.462987    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49e003d0-feaa-4814-b10c-daf640f65527-istio-token" (OuterVolumeSpecName: "istio-token") pod "49e003d0-feaa-4814-b10c-daf640f65527" (UID: "49e003d0-feaa-4814-b10c-daf640f65527"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 04:11:58.463198 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:58.463167    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49e003d0-feaa-4814-b10c-daf640f65527-kube-api-access-m5hrb" (OuterVolumeSpecName: "kube-api-access-m5hrb") pod "49e003d0-feaa-4814-b10c-daf640f65527" (UID: "49e003d0-feaa-4814-b10c-daf640f65527"). InnerVolumeSpecName "kube-api-access-m5hrb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 04:11:58.500990 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:58.500967    2559 generic.go:356] "Generic (PLEG): container finished" podID="49e003d0-feaa-4814-b10c-daf640f65527" containerID="02e4da9b62cfc76bcd664ab1c59689db55a56d8e6e5ec7aebb8b379e1dab3734" exitCode=0
Sep 07 04:11:58.501083 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:58.501014    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv"
Sep 07 04:11:58.501083 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:58.501018    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv" event={"ID":"49e003d0-feaa-4814-b10c-daf640f65527","Type":"ContainerDied","Data":"02e4da9b62cfc76bcd664ab1c59689db55a56d8e6e5ec7aebb8b379e1dab3734"}
Sep 07 04:11:58.501083 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:58.501061    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv" event={"ID":"49e003d0-feaa-4814-b10c-daf640f65527","Type":"ContainerDied","Data":"e6885fc49a05baf25131faa80c5e4c2c53e10f5fdfbf5fbb924db22cac69deed"}
Sep 07 04:11:58.501083 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:58.501082    2559 scope.go:117] "RemoveContainer" containerID="02e4da9b62cfc76bcd664ab1c59689db55a56d8e6e5ec7aebb8b379e1dab3734"
Sep 07 04:11:58.510405 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:58.510387    2559 scope.go:117] "RemoveContainer" containerID="66f09b0dc3332ec23e5e8cc99e7801b69262f2d5edd2409fa2593eb860c90ebd"
Sep 07 04:11:58.518590 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:58.518570    2559 scope.go:117] "RemoveContainer" containerID="02e4da9b62cfc76bcd664ab1c59689db55a56d8e6e5ec7aebb8b379e1dab3734"
Sep 07 04:11:58.519251 ip-10-0-132-4 kubenswrapper[2559]: E0907 04:11:58.519230    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02e4da9b62cfc76bcd664ab1c59689db55a56d8e6e5ec7aebb8b379e1dab3734\": container with ID starting with 02e4da9b62cfc76bcd664ab1c59689db55a56d8e6e5ec7aebb8b379e1dab3734 not found: ID does not exist" containerID="02e4da9b62cfc76bcd664ab1c59689db55a56d8e6e5ec7aebb8b379e1dab3734"
Sep 07 04:11:58.519358 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:58.519262    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02e4da9b62cfc76bcd664ab1c59689db55a56d8e6e5ec7aebb8b379e1dab3734"} err="failed to get container status \"02e4da9b62cfc76bcd664ab1c59689db55a56d8e6e5ec7aebb8b379e1dab3734\": rpc error: code = NotFound desc = could not find container \"02e4da9b62cfc76bcd664ab1c59689db55a56d8e6e5ec7aebb8b379e1dab3734\": container with ID starting with 02e4da9b62cfc76bcd664ab1c59689db55a56d8e6e5ec7aebb8b379e1dab3734 not found: ID does not exist"
Sep 07 04:11:58.519358 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:58.519281    2559 scope.go:117] "RemoveContainer" containerID="66f09b0dc3332ec23e5e8cc99e7801b69262f2d5edd2409fa2593eb860c90ebd"
Sep 07 04:11:58.519589 ip-10-0-132-4 kubenswrapper[2559]: E0907 04:11:58.519567    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66f09b0dc3332ec23e5e8cc99e7801b69262f2d5edd2409fa2593eb860c90ebd\": container with ID starting with 66f09b0dc3332ec23e5e8cc99e7801b69262f2d5edd2409fa2593eb860c90ebd not found: ID does not exist" containerID="66f09b0dc3332ec23e5e8cc99e7801b69262f2d5edd2409fa2593eb860c90ebd"
Sep 07 04:11:58.519704 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:58.519598    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66f09b0dc3332ec23e5e8cc99e7801b69262f2d5edd2409fa2593eb860c90ebd"} err="failed to get container status \"66f09b0dc3332ec23e5e8cc99e7801b69262f2d5edd2409fa2593eb860c90ebd\": rpc error: code = NotFound desc = could not find container \"66f09b0dc3332ec23e5e8cc99e7801b69262f2d5edd2409fa2593eb860c90ebd\": container with ID starting with 66f09b0dc3332ec23e5e8cc99e7801b69262f2d5edd2409fa2593eb860c90ebd not found: ID does not exist"
Sep 07 04:11:58.521634 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:58.521604    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv"]
Sep 07 04:11:58.527235 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:58.527217    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv"]
Sep 07 04:11:58.562016 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:58.561995    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49e003d0-feaa-4814-b10c-daf640f65527-istio-data\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:11:58.562016 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:58.562015    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49e003d0-feaa-4814-b10c-daf640f65527-istio-envoy\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:11:58.562148 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:58.562025    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49e003d0-feaa-4814-b10c-daf640f65527-istio-podinfo\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:11:58.562148 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:58.562033    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49e003d0-feaa-4814-b10c-daf640f65527-workload-socket\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:11:58.562148 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:58.562041    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49e003d0-feaa-4814-b10c-daf640f65527-istio-token\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:11:58.562148 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:58.562048    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49e003d0-feaa-4814-b10c-daf640f65527-workload-certs\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:11:58.562148 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:58.562057    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5hrb\" (UniqueName: \"kubernetes.io/projected/49e003d0-feaa-4814-b10c-daf640f65527-kube-api-access-m5hrb\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:11:59.180544 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:11:59.180510    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49e003d0-feaa-4814-b10c-daf640f65527" path="/var/lib/kubelet/pods/49e003d0-feaa-4814-b10c-daf640f65527/volumes"
Sep 07 04:12:04.096903 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:04.096860    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-a89024-jw8j9"]
Sep 07 04:12:04.099369 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:04.099343    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-a89024-jw8j9"]
Sep 07 04:12:05.179030 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:05.178999    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="432b31ec-0a0f-4984-9f05-0003bae0b08e" path="/var/lib/kubelet/pods/432b31ec-0a0f-4984-9f05-0003bae0b08e/volumes"
Sep 07 04:12:06.073410 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:06.073377    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-434d57/rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss"]
Sep 07 04:12:10.988508 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:10.988471    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk"]
Sep 07 04:12:10.989039 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:10.988719    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk" podUID="9bacc8c6-79f9-44b6-998f-6cef08ea02ec" containerName="istio-proxy" containerID="cri-o://fe954df7455cc9bd5e9e397771e0691a5c18dbb6bf8bb94c123145cd58ec0452" gracePeriod=30
Sep 07 04:12:11.440153 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:11.440119    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-f8fdfa-66785f54d6-xxjmd"]
Sep 07 04:12:11.440510 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:11.440495    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49e003d0-feaa-4814-b10c-daf640f65527" containerName="istio-proxy"
Sep 07 04:12:11.440578 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:11.440512    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="49e003d0-feaa-4814-b10c-daf640f65527" containerName="istio-proxy"
Sep 07 04:12:11.440578 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:11.440524    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="432b31ec-0a0f-4984-9f05-0003bae0b08e" containerName="revoke-keys"
Sep 07 04:12:11.440578 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:11.440529    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="432b31ec-0a0f-4984-9f05-0003bae0b08e" containerName="revoke-keys"
Sep 07 04:12:11.440578 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:11.440542    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49e003d0-feaa-4814-b10c-daf640f65527" containerName="istio-proxy"
Sep 07 04:12:11.440578 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:11.440553    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="49e003d0-feaa-4814-b10c-daf640f65527" containerName="istio-proxy"
Sep 07 04:12:11.440776 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:11.440638    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="49e003d0-feaa-4814-b10c-daf640f65527" containerName="istio-proxy"
Sep 07 04:12:11.440776 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:11.440648    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="49e003d0-feaa-4814-b10c-daf640f65527" containerName="istio-proxy"
Sep 07 04:12:11.440776 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:11.440654    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="432b31ec-0a0f-4984-9f05-0003bae0b08e" containerName="revoke-keys"
Sep 07 04:12:11.445283 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:11.445262    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-f8fdfa-66785f54d6-xxjmd"
Sep 07 04:12:11.447310 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:11.447284    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-f8fdfa\""
Sep 07 04:12:11.447441 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:11.447384    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-f8fdfa-dockercfg-z4j29\""
Sep 07 04:12:11.453771 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:11.453749    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-f8fdfa-66785f54d6-xxjmd"]
Sep 07 04:12:11.492072 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:11.492048    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-f8fdfa-5fff6db5d7-zl7mr"]
Sep 07 04:12:11.495431 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:11.495415    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-f8fdfa-5fff6db5d7-zl7mr"
Sep 07 04:12:11.505163 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:11.505140    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-f8fdfa-5fff6db5d7-zl7mr"]
Sep 07 04:12:11.586718 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:11.586681    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj8h5\" (UniqueName: \"kubernetes.io/projected/2325c911-97a7-404f-84b6-c97f1a905f27-kube-api-access-kj8h5\") pod \"payload-processing-e2e-ipp-a-f8fdfa-5fff6db5d7-zl7mr\" (UID: \"2325c911-97a7-404f-84b6-c97f1a905f27\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-f8fdfa-5fff6db5d7-zl7mr"
Sep 07 04:12:11.587051 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:11.587027    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2325c911-97a7-404f-84b6-c97f1a905f27-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-f8fdfa-5fff6db5d7-zl7mr\" (UID: \"2325c911-97a7-404f-84b6-c97f1a905f27\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-f8fdfa-5fff6db5d7-zl7mr"
Sep 07 04:12:11.587218 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:11.587200    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hqld\" (UniqueName: \"kubernetes.io/projected/aecb9294-4d44-4dc4-bd59-f72cb336a2f6-kube-api-access-4hqld\") pod \"payload-pre-processing-e2e-ipp-a-f8fdfa-66785f54d6-xxjmd\" (UID: \"aecb9294-4d44-4dc4-bd59-f72cb336a2f6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-f8fdfa-66785f54d6-xxjmd"
Sep 07 04:12:11.587418 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:11.587351    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aecb9294-4d44-4dc4-bd59-f72cb336a2f6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-f8fdfa-66785f54d6-xxjmd\" (UID: \"aecb9294-4d44-4dc4-bd59-f72cb336a2f6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-f8fdfa-66785f54d6-xxjmd"
Sep 07 04:12:11.688865 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:11.688840    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj8h5\" (UniqueName: \"kubernetes.io/projected/2325c911-97a7-404f-84b6-c97f1a905f27-kube-api-access-kj8h5\") pod \"payload-processing-e2e-ipp-a-f8fdfa-5fff6db5d7-zl7mr\" (UID: \"2325c911-97a7-404f-84b6-c97f1a905f27\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-f8fdfa-5fff6db5d7-zl7mr"
Sep 07 04:12:11.688978 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:11.688887    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2325c911-97a7-404f-84b6-c97f1a905f27-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-f8fdfa-5fff6db5d7-zl7mr\" (UID: \"2325c911-97a7-404f-84b6-c97f1a905f27\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-f8fdfa-5fff6db5d7-zl7mr"
Sep 07 04:12:11.688978 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:11.688907    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hqld\" (UniqueName: \"kubernetes.io/projected/aecb9294-4d44-4dc4-bd59-f72cb336a2f6-kube-api-access-4hqld\") pod \"payload-pre-processing-e2e-ipp-a-f8fdfa-66785f54d6-xxjmd\" (UID: \"aecb9294-4d44-4dc4-bd59-f72cb336a2f6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-f8fdfa-66785f54d6-xxjmd"
Sep 07 04:12:11.688978 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:11.688936    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aecb9294-4d44-4dc4-bd59-f72cb336a2f6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-f8fdfa-66785f54d6-xxjmd\" (UID: \"aecb9294-4d44-4dc4-bd59-f72cb336a2f6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-f8fdfa-66785f54d6-xxjmd"
Sep 07 04:12:11.689660 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:11.689639    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aecb9294-4d44-4dc4-bd59-f72cb336a2f6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-f8fdfa-66785f54d6-xxjmd\" (UID: \"aecb9294-4d44-4dc4-bd59-f72cb336a2f6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-f8fdfa-66785f54d6-xxjmd"
Sep 07 04:12:11.689746 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:11.689656    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2325c911-97a7-404f-84b6-c97f1a905f27-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-f8fdfa-5fff6db5d7-zl7mr\" (UID: \"2325c911-97a7-404f-84b6-c97f1a905f27\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-f8fdfa-5fff6db5d7-zl7mr"
Sep 07 04:12:11.924026 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:11.923998    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hqld\" (UniqueName: \"kubernetes.io/projected/aecb9294-4d44-4dc4-bd59-f72cb336a2f6-kube-api-access-4hqld\") pod \"payload-pre-processing-e2e-ipp-a-f8fdfa-66785f54d6-xxjmd\" (UID: \"aecb9294-4d44-4dc4-bd59-f72cb336a2f6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-f8fdfa-66785f54d6-xxjmd"
Sep 07 04:12:11.924123 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:11.924078    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj8h5\" (UniqueName: \"kubernetes.io/projected/2325c911-97a7-404f-84b6-c97f1a905f27-kube-api-access-kj8h5\") pod \"payload-processing-e2e-ipp-a-f8fdfa-5fff6db5d7-zl7mr\" (UID: \"2325c911-97a7-404f-84b6-c97f1a905f27\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-f8fdfa-5fff6db5d7-zl7mr"
Sep 07 04:12:12.056405 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:12.056384    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-f8fdfa-66785f54d6-xxjmd"
Sep 07 04:12:12.106032 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:12.105951    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-f8fdfa-5fff6db5d7-zl7mr"
Sep 07 04:12:12.329142 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:12.329116    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-f8fdfa-66785f54d6-xxjmd"]
Sep 07 04:12:12.330083 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:12:12.330054    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaecb9294_4d44_4dc4_bd59_f72cb336a2f6.slice/crio-6608ea0e2c1ffafe02f1f61148cba4953e40551f5f0a2e9222440df90c100e92 WatchSource:0}: Error finding container 6608ea0e2c1ffafe02f1f61148cba4953e40551f5f0a2e9222440df90c100e92: Status 404 returned error can't find the container with id 6608ea0e2c1ffafe02f1f61148cba4953e40551f5f0a2e9222440df90c100e92
Sep 07 04:12:12.404276 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:12.404248    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-f8fdfa-5fff6db5d7-zl7mr"]
Sep 07 04:12:12.405714 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:12:12.405683    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2325c911_97a7_404f_84b6_c97f1a905f27.slice/crio-90bd14256ee3a0f32aa3fe49ce12768a9b41a5ac43a01187646e1f6f63b5ce3c WatchSource:0}: Error finding container 90bd14256ee3a0f32aa3fe49ce12768a9b41a5ac43a01187646e1f6f63b5ce3c: Status 404 returned error can't find the container with id 90bd14256ee3a0f32aa3fe49ce12768a9b41a5ac43a01187646e1f6f63b5ce3c
Sep 07 04:12:12.593394 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:12.593348    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-f8fdfa-5fff6db5d7-zl7mr" event={"ID":"2325c911-97a7-404f-84b6-c97f1a905f27","Type":"ContainerStarted","Data":"1411cda4f8e725dc46dfaa5abd69d2ed2555081122de02064e28295940d5c8c8"}
Sep 07 04:12:12.593541 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:12.593419    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-f8fdfa-5fff6db5d7-zl7mr"
Sep 07 04:12:12.593541 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:12.593444    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-f8fdfa-5fff6db5d7-zl7mr" event={"ID":"2325c911-97a7-404f-84b6-c97f1a905f27","Type":"ContainerStarted","Data":"90bd14256ee3a0f32aa3fe49ce12768a9b41a5ac43a01187646e1f6f63b5ce3c"}
Sep 07 04:12:12.595505 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:12.595420    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-f8fdfa-66785f54d6-xxjmd" event={"ID":"aecb9294-4d44-4dc4-bd59-f72cb336a2f6","Type":"ContainerStarted","Data":"3f944125959f1167b7e907401388627e36a3601ae09375a776ead699d7227002"}
Sep 07 04:12:12.595505 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:12.595480    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-f8fdfa-66785f54d6-xxjmd" event={"ID":"aecb9294-4d44-4dc4-bd59-f72cb336a2f6","Type":"ContainerStarted","Data":"6608ea0e2c1ffafe02f1f61148cba4953e40551f5f0a2e9222440df90c100e92"}
Sep 07 04:12:12.595684 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:12.595528    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-f8fdfa-66785f54d6-xxjmd"
Sep 07 04:12:12.609761 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:12.609717    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-f8fdfa-5fff6db5d7-zl7mr" podStartSLOduration=1.609703064 podStartE2EDuration="1.609703064s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:12:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:12:12.606722822 +0000 UTC m=+1435.919198721" watchObservedRunningTime="2026-09-07 04:12:12.609703064 +0000 UTC m=+1435.922178965"
Sep 07 04:12:12.621198 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:12.621152    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-f8fdfa-66785f54d6-xxjmd" podStartSLOduration=1.621139818 podStartE2EDuration="1.621139818s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:12:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:12:12.619277551 +0000 UTC m=+1435.931753453" watchObservedRunningTime="2026-09-07 04:12:12.621139818 +0000 UTC m=+1435.933615719"
Sep 07 04:12:16.265955 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:16.265899    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk"
Sep 07 04:12:16.330088 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:16.330062    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4g9q\" (UniqueName: \"kubernetes.io/projected/9bacc8c6-79f9-44b6-998f-6cef08ea02ec-kube-api-access-d4g9q\") pod \"9bacc8c6-79f9-44b6-998f-6cef08ea02ec\" (UID: \"9bacc8c6-79f9-44b6-998f-6cef08ea02ec\") "
Sep 07 04:12:16.330256 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:16.330125    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bacc8c6-79f9-44b6-998f-6cef08ea02ec-istiod-ca-cert\") pod \"9bacc8c6-79f9-44b6-998f-6cef08ea02ec\" (UID: \"9bacc8c6-79f9-44b6-998f-6cef08ea02ec\") "
Sep 07 04:12:16.330256 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:16.330189    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bacc8c6-79f9-44b6-998f-6cef08ea02ec-credential-socket\") pod \"9bacc8c6-79f9-44b6-998f-6cef08ea02ec\" (UID: \"9bacc8c6-79f9-44b6-998f-6cef08ea02ec\") "
Sep 07 04:12:16.330256 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:16.330213    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bacc8c6-79f9-44b6-998f-6cef08ea02ec-workload-certs\") pod \"9bacc8c6-79f9-44b6-998f-6cef08ea02ec\" (UID: \"9bacc8c6-79f9-44b6-998f-6cef08ea02ec\") "
Sep 07 04:12:16.330429 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:16.330303    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bacc8c6-79f9-44b6-998f-6cef08ea02ec-istio-envoy\") pod \"9bacc8c6-79f9-44b6-998f-6cef08ea02ec\" (UID: \"9bacc8c6-79f9-44b6-998f-6cef08ea02ec\") "
Sep 07 04:12:16.330429 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:16.330354    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bacc8c6-79f9-44b6-998f-6cef08ea02ec-istio-data\") pod \"9bacc8c6-79f9-44b6-998f-6cef08ea02ec\" (UID: \"9bacc8c6-79f9-44b6-998f-6cef08ea02ec\") "
Sep 07 04:12:16.330429 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:16.330386    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bacc8c6-79f9-44b6-998f-6cef08ea02ec-workload-socket\") pod \"9bacc8c6-79f9-44b6-998f-6cef08ea02ec\" (UID: \"9bacc8c6-79f9-44b6-998f-6cef08ea02ec\") "
Sep 07 04:12:16.330429 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:16.330409    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bacc8c6-79f9-44b6-998f-6cef08ea02ec-istio-token\") pod \"9bacc8c6-79f9-44b6-998f-6cef08ea02ec\" (UID: \"9bacc8c6-79f9-44b6-998f-6cef08ea02ec\") "
Sep 07 04:12:16.330657 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:16.330448    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bacc8c6-79f9-44b6-998f-6cef08ea02ec-istio-podinfo\") pod \"9bacc8c6-79f9-44b6-998f-6cef08ea02ec\" (UID: \"9bacc8c6-79f9-44b6-998f-6cef08ea02ec\") "
Sep 07 04:12:16.330657 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:16.330470    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bacc8c6-79f9-44b6-998f-6cef08ea02ec-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9bacc8c6-79f9-44b6-998f-6cef08ea02ec" (UID: "9bacc8c6-79f9-44b6-998f-6cef08ea02ec"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:12:16.330657 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:16.330497    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bacc8c6-79f9-44b6-998f-6cef08ea02ec-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9bacc8c6-79f9-44b6-998f-6cef08ea02ec" (UID: "9bacc8c6-79f9-44b6-998f-6cef08ea02ec"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:12:16.330657 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:16.330507    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bacc8c6-79f9-44b6-998f-6cef08ea02ec-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9bacc8c6-79f9-44b6-998f-6cef08ea02ec" (UID: "9bacc8c6-79f9-44b6-998f-6cef08ea02ec"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 04:12:16.330886 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:16.330696    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bacc8c6-79f9-44b6-998f-6cef08ea02ec-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9bacc8c6-79f9-44b6-998f-6cef08ea02ec" (UID: "9bacc8c6-79f9-44b6-998f-6cef08ea02ec"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:12:16.330886 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:16.330748    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bacc8c6-79f9-44b6-998f-6cef08ea02ec-istio-data" (OuterVolumeSpecName: "istio-data") pod "9bacc8c6-79f9-44b6-998f-6cef08ea02ec" (UID: "9bacc8c6-79f9-44b6-998f-6cef08ea02ec"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:12:16.331005 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:16.330989    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bacc8c6-79f9-44b6-998f-6cef08ea02ec-credential-socket\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:12:16.331060 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:16.331012    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bacc8c6-79f9-44b6-998f-6cef08ea02ec-workload-certs\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:12:16.331060 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:16.331026    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bacc8c6-79f9-44b6-998f-6cef08ea02ec-istio-data\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:12:16.331060 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:16.331039    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bacc8c6-79f9-44b6-998f-6cef08ea02ec-workload-socket\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:12:16.331060 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:16.331051    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bacc8c6-79f9-44b6-998f-6cef08ea02ec-istiod-ca-cert\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:12:16.332730 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:16.332700    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bacc8c6-79f9-44b6-998f-6cef08ea02ec-kube-api-access-d4g9q" (OuterVolumeSpecName: "kube-api-access-d4g9q") pod "9bacc8c6-79f9-44b6-998f-6cef08ea02ec" (UID: "9bacc8c6-79f9-44b6-998f-6cef08ea02ec"). InnerVolumeSpecName "kube-api-access-d4g9q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 04:12:16.332906 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:16.332887    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9bacc8c6-79f9-44b6-998f-6cef08ea02ec-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9bacc8c6-79f9-44b6-998f-6cef08ea02ec" (UID: "9bacc8c6-79f9-44b6-998f-6cef08ea02ec"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 04:12:16.333005 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:16.332986    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bacc8c6-79f9-44b6-998f-6cef08ea02ec-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9bacc8c6-79f9-44b6-998f-6cef08ea02ec" (UID: "9bacc8c6-79f9-44b6-998f-6cef08ea02ec"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:12:16.333050 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:16.332995    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bacc8c6-79f9-44b6-998f-6cef08ea02ec-istio-token" (OuterVolumeSpecName: "istio-token") pod "9bacc8c6-79f9-44b6-998f-6cef08ea02ec" (UID: "9bacc8c6-79f9-44b6-998f-6cef08ea02ec"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 04:12:16.432052 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:16.432020    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bacc8c6-79f9-44b6-998f-6cef08ea02ec-istio-envoy\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:12:16.432052 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:16.432052    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bacc8c6-79f9-44b6-998f-6cef08ea02ec-istio-token\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:12:16.432216 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:16.432067    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bacc8c6-79f9-44b6-998f-6cef08ea02ec-istio-podinfo\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:12:16.432216 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:16.432081    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4g9q\" (UniqueName: \"kubernetes.io/projected/9bacc8c6-79f9-44b6-998f-6cef08ea02ec-kube-api-access-d4g9q\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:12:16.624693 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:16.624661    2559 generic.go:356] "Generic (PLEG): container finished" podID="9bacc8c6-79f9-44b6-998f-6cef08ea02ec" containerID="fe954df7455cc9bd5e9e397771e0691a5c18dbb6bf8bb94c123145cd58ec0452" exitCode=0
Sep 07 04:12:16.624851 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:16.624714    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk"
Sep 07 04:12:16.624851 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:16.624739    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk" event={"ID":"9bacc8c6-79f9-44b6-998f-6cef08ea02ec","Type":"ContainerDied","Data":"fe954df7455cc9bd5e9e397771e0691a5c18dbb6bf8bb94c123145cd58ec0452"}
Sep 07 04:12:16.624851 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:16.624802    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk" event={"ID":"9bacc8c6-79f9-44b6-998f-6cef08ea02ec","Type":"ContainerDied","Data":"245776fdeddd86e68d63c4a8a18f653ffe746f9820ae0beafe696dbacefd36ae"}
Sep 07 04:12:16.624851 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:16.624823    2559 scope.go:117] "RemoveContainer" containerID="fe954df7455cc9bd5e9e397771e0691a5c18dbb6bf8bb94c123145cd58ec0452"
Sep 07 04:12:16.634950 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:16.634934    2559 scope.go:117] "RemoveContainer" containerID="823f8edd1c5067be80c1d24b8c61b9352c7668c5a6e3ed43cf8e02fef2c3cfd4"
Sep 07 04:12:16.643949 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:16.643923    2559 scope.go:117] "RemoveContainer" containerID="fe954df7455cc9bd5e9e397771e0691a5c18dbb6bf8bb94c123145cd58ec0452"
Sep 07 04:12:16.644231 ip-10-0-132-4 kubenswrapper[2559]: E0907 04:12:16.644211    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe954df7455cc9bd5e9e397771e0691a5c18dbb6bf8bb94c123145cd58ec0452\": container with ID starting with fe954df7455cc9bd5e9e397771e0691a5c18dbb6bf8bb94c123145cd58ec0452 not found: ID does not exist" containerID="fe954df7455cc9bd5e9e397771e0691a5c18dbb6bf8bb94c123145cd58ec0452"
Sep 07 04:12:16.644329 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:16.644238    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe954df7455cc9bd5e9e397771e0691a5c18dbb6bf8bb94c123145cd58ec0452"} err="failed to get container status \"fe954df7455cc9bd5e9e397771e0691a5c18dbb6bf8bb94c123145cd58ec0452\": rpc error: code = NotFound desc = could not find container \"fe954df7455cc9bd5e9e397771e0691a5c18dbb6bf8bb94c123145cd58ec0452\": container with ID starting with fe954df7455cc9bd5e9e397771e0691a5c18dbb6bf8bb94c123145cd58ec0452 not found: ID does not exist"
Sep 07 04:12:16.644329 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:16.644256    2559 scope.go:117] "RemoveContainer" containerID="823f8edd1c5067be80c1d24b8c61b9352c7668c5a6e3ed43cf8e02fef2c3cfd4"
Sep 07 04:12:16.644854 ip-10-0-132-4 kubenswrapper[2559]: E0907 04:12:16.644836    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"823f8edd1c5067be80c1d24b8c61b9352c7668c5a6e3ed43cf8e02fef2c3cfd4\": container with ID starting with 823f8edd1c5067be80c1d24b8c61b9352c7668c5a6e3ed43cf8e02fef2c3cfd4 not found: ID does not exist" containerID="823f8edd1c5067be80c1d24b8c61b9352c7668c5a6e3ed43cf8e02fef2c3cfd4"
Sep 07 04:12:16.644918 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:16.644860    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"823f8edd1c5067be80c1d24b8c61b9352c7668c5a6e3ed43cf8e02fef2c3cfd4"} err="failed to get container status \"823f8edd1c5067be80c1d24b8c61b9352c7668c5a6e3ed43cf8e02fef2c3cfd4\": rpc error: code = NotFound desc = could not find container \"823f8edd1c5067be80c1d24b8c61b9352c7668c5a6e3ed43cf8e02fef2c3cfd4\": container with ID starting with 823f8edd1c5067be80c1d24b8c61b9352c7668c5a6e3ed43cf8e02fef2c3cfd4 not found: ID does not exist"
Sep 07 04:12:16.646252 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:16.646230    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk"]
Sep 07 04:12:16.651031 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:16.651008    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk"]
Sep 07 04:12:17.180020 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:17.179992    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bacc8c6-79f9-44b6-998f-6cef08ea02ec" path="/var/lib/kubelet/pods/9bacc8c6-79f9-44b6-998f-6cef08ea02ec/volumes"
Sep 07 04:12:21.094200 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:21.094157    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-434d57/rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss" podUID="dd06bcbd-773c-49dc-8247-95f0f0078e9e" containerName="main" containerID="cri-o://9bc2883f64f6675d4813675d8beb5d4646a8181d19d7d664e7435a696d23693a" gracePeriod=45
Sep 07 04:12:21.339836 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:21.339811    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-434d57/rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss"
Sep 07 04:12:21.477309 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:21.477271    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd06bcbd-773c-49dc-8247-95f0f0078e9e-model-cache\") pod \"dd06bcbd-773c-49dc-8247-95f0f0078e9e\" (UID: \"dd06bcbd-773c-49dc-8247-95f0f0078e9e\") "
Sep 07 04:12:21.477309 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:21.477330    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd06bcbd-773c-49dc-8247-95f0f0078e9e-tls-certs\") pod \"dd06bcbd-773c-49dc-8247-95f0f0078e9e\" (UID: \"dd06bcbd-773c-49dc-8247-95f0f0078e9e\") "
Sep 07 04:12:21.477575 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:21.477353    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd06bcbd-773c-49dc-8247-95f0f0078e9e-tmp-dir\") pod \"dd06bcbd-773c-49dc-8247-95f0f0078e9e\" (UID: \"dd06bcbd-773c-49dc-8247-95f0f0078e9e\") "
Sep 07 04:12:21.477575 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:21.477393    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd06bcbd-773c-49dc-8247-95f0f0078e9e-dshm\") pod \"dd06bcbd-773c-49dc-8247-95f0f0078e9e\" (UID: \"dd06bcbd-773c-49dc-8247-95f0f0078e9e\") "
Sep 07 04:12:21.477575 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:21.477419    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd06bcbd-773c-49dc-8247-95f0f0078e9e-home\") pod \"dd06bcbd-773c-49dc-8247-95f0f0078e9e\" (UID: \"dd06bcbd-773c-49dc-8247-95f0f0078e9e\") "
Sep 07 04:12:21.477575 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:21.477496    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-97kk2\" (UniqueName: \"kubernetes.io/projected/dd06bcbd-773c-49dc-8247-95f0f0078e9e-kube-api-access-97kk2\") pod \"dd06bcbd-773c-49dc-8247-95f0f0078e9e\" (UID: \"dd06bcbd-773c-49dc-8247-95f0f0078e9e\") "
Sep 07 04:12:21.477801 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:21.477603    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd06bcbd-773c-49dc-8247-95f0f0078e9e-model-cache" (OuterVolumeSpecName: "model-cache") pod "dd06bcbd-773c-49dc-8247-95f0f0078e9e" (UID: "dd06bcbd-773c-49dc-8247-95f0f0078e9e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:12:21.477801 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:21.477664    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd06bcbd-773c-49dc-8247-95f0f0078e9e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "dd06bcbd-773c-49dc-8247-95f0f0078e9e" (UID: "dd06bcbd-773c-49dc-8247-95f0f0078e9e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:12:21.477883 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:21.477797    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd06bcbd-773c-49dc-8247-95f0f0078e9e-home" (OuterVolumeSpecName: "home") pod "dd06bcbd-773c-49dc-8247-95f0f0078e9e" (UID: "dd06bcbd-773c-49dc-8247-95f0f0078e9e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:12:21.477924 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:21.477901    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd06bcbd-773c-49dc-8247-95f0f0078e9e-model-cache\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:12:21.477924 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:21.477921    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd06bcbd-773c-49dc-8247-95f0f0078e9e-tmp-dir\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:12:21.478005 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:21.477934    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd06bcbd-773c-49dc-8247-95f0f0078e9e-home\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:12:21.479665 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:21.479633    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd06bcbd-773c-49dc-8247-95f0f0078e9e-dshm" (OuterVolumeSpecName: "dshm") pod "dd06bcbd-773c-49dc-8247-95f0f0078e9e" (UID: "dd06bcbd-773c-49dc-8247-95f0f0078e9e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:12:21.479665 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:21.479648    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd06bcbd-773c-49dc-8247-95f0f0078e9e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "dd06bcbd-773c-49dc-8247-95f0f0078e9e" (UID: "dd06bcbd-773c-49dc-8247-95f0f0078e9e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 04:12:21.479847 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:21.479684    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd06bcbd-773c-49dc-8247-95f0f0078e9e-kube-api-access-97kk2" (OuterVolumeSpecName: "kube-api-access-97kk2") pod "dd06bcbd-773c-49dc-8247-95f0f0078e9e" (UID: "dd06bcbd-773c-49dc-8247-95f0f0078e9e"). InnerVolumeSpecName "kube-api-access-97kk2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 04:12:21.578546 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:21.578521    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd06bcbd-773c-49dc-8247-95f0f0078e9e-tls-certs\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:12:21.578546 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:21.578541    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd06bcbd-773c-49dc-8247-95f0f0078e9e-dshm\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:12:21.578726 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:21.578551    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-97kk2\" (UniqueName: \"kubernetes.io/projected/dd06bcbd-773c-49dc-8247-95f0f0078e9e-kube-api-access-97kk2\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:12:21.653464 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:21.653433    2559 generic.go:356] "Generic (PLEG): container finished" podID="dd06bcbd-773c-49dc-8247-95f0f0078e9e" containerID="9bc2883f64f6675d4813675d8beb5d4646a8181d19d7d664e7435a696d23693a" exitCode=0
Sep 07 04:12:21.653594 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:21.653479    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-434d57/rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss"
Sep 07 04:12:21.653594 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:21.653525    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-434d57/rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss" event={"ID":"dd06bcbd-773c-49dc-8247-95f0f0078e9e","Type":"ContainerDied","Data":"9bc2883f64f6675d4813675d8beb5d4646a8181d19d7d664e7435a696d23693a"}
Sep 07 04:12:21.653594 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:21.653569    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-434d57/rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss" event={"ID":"dd06bcbd-773c-49dc-8247-95f0f0078e9e","Type":"ContainerDied","Data":"ace83977415f35dc80985e6a93fbe28834bcfea585892cbc56a260295110dc12"}
Sep 07 04:12:21.653594 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:21.653586    2559 scope.go:117] "RemoveContainer" containerID="9bc2883f64f6675d4813675d8beb5d4646a8181d19d7d664e7435a696d23693a"
Sep 07 04:12:21.663230 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:21.663211    2559 scope.go:117] "RemoveContainer" containerID="9bc2883f64f6675d4813675d8beb5d4646a8181d19d7d664e7435a696d23693a"
Sep 07 04:12:21.663505 ip-10-0-132-4 kubenswrapper[2559]: E0907 04:12:21.663487    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bc2883f64f6675d4813675d8beb5d4646a8181d19d7d664e7435a696d23693a\": container with ID starting with 9bc2883f64f6675d4813675d8beb5d4646a8181d19d7d664e7435a696d23693a not found: ID does not exist" containerID="9bc2883f64f6675d4813675d8beb5d4646a8181d19d7d664e7435a696d23693a"
Sep 07 04:12:21.663550 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:21.663513    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bc2883f64f6675d4813675d8beb5d4646a8181d19d7d664e7435a696d23693a"} err="failed to get container status \"9bc2883f64f6675d4813675d8beb5d4646a8181d19d7d664e7435a696d23693a\": rpc error: code = NotFound desc = could not find container \"9bc2883f64f6675d4813675d8beb5d4646a8181d19d7d664e7435a696d23693a\": container with ID starting with 9bc2883f64f6675d4813675d8beb5d4646a8181d19d7d664e7435a696d23693a not found: ID does not exist"
Sep 07 04:12:21.674724 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:21.674703    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-434d57/rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss"]
Sep 07 04:12:21.677756 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:21.677737    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-434d57/rate-test-model-434d57-kserve-5cf69bdb5f-mc2ss"]
Sep 07 04:12:23.180695 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:23.180659    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd06bcbd-773c-49dc-8247-95f0f0078e9e" path="/var/lib/kubelet/pods/dd06bcbd-773c-49dc-8247-95f0f0078e9e/volumes"
Sep 07 04:12:23.602860 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:23.602774    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-f8fdfa-66785f54d6-xxjmd"
Sep 07 04:12:23.603033 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:23.603011    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-f8fdfa-5fff6db5d7-zl7mr"
Sep 07 04:12:35.744321 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:35.744285    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg"]
Sep 07 04:12:35.744904 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:35.744882    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd06bcbd-773c-49dc-8247-95f0f0078e9e" containerName="main"
Sep 07 04:12:35.744968 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:35.744908    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd06bcbd-773c-49dc-8247-95f0f0078e9e" containerName="main"
Sep 07 04:12:35.744968 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:35.744930    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bacc8c6-79f9-44b6-998f-6cef08ea02ec" containerName="istio-proxy"
Sep 07 04:12:35.744968 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:35.744939    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bacc8c6-79f9-44b6-998f-6cef08ea02ec" containerName="istio-proxy"
Sep 07 04:12:35.744968 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:35.744957    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bacc8c6-79f9-44b6-998f-6cef08ea02ec" containerName="istio-proxy"
Sep 07 04:12:35.744968 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:35.744966    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bacc8c6-79f9-44b6-998f-6cef08ea02ec" containerName="istio-proxy"
Sep 07 04:12:35.745146 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:35.745075    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bacc8c6-79f9-44b6-998f-6cef08ea02ec" containerName="istio-proxy"
Sep 07 04:12:35.745146 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:35.745091    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd06bcbd-773c-49dc-8247-95f0f0078e9e" containerName="main"
Sep 07 04:12:35.749881 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:35.749858    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg"
Sep 07 04:12:35.752114 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:35.752094    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-704b16-openshift-default-dockercfg-k2xgb\""
Sep 07 04:12:35.759117 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:35.759093    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg"]
Sep 07 04:12:35.801324 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:35.801293    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a26fe4a2-90a7-4433-9142-4a263ae02a3a-credential-socket\") pod \"e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg\" (UID: \"a26fe4a2-90a7-4433-9142-4a263ae02a3a\") " pod="openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg"
Sep 07 04:12:35.801423 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:35.801327    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a26fe4a2-90a7-4433-9142-4a263ae02a3a-istio-data\") pod \"e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg\" (UID: \"a26fe4a2-90a7-4433-9142-4a263ae02a3a\") " pod="openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg"
Sep 07 04:12:35.801473 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:35.801415    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a26fe4a2-90a7-4433-9142-4a263ae02a3a-workload-socket\") pod \"e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg\" (UID: \"a26fe4a2-90a7-4433-9142-4a263ae02a3a\") " pod="openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg"
Sep 07 04:12:35.801473 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:35.801456    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a26fe4a2-90a7-4433-9142-4a263ae02a3a-istiod-ca-cert\") pod \"e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg\" (UID: \"a26fe4a2-90a7-4433-9142-4a263ae02a3a\") " pod="openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg"
Sep 07 04:12:35.801573 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:35.801475    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrwht\" (UniqueName: \"kubernetes.io/projected/a26fe4a2-90a7-4433-9142-4a263ae02a3a-kube-api-access-zrwht\") pod \"e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg\" (UID: \"a26fe4a2-90a7-4433-9142-4a263ae02a3a\") " pod="openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg"
Sep 07 04:12:35.801613 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:35.801581    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a26fe4a2-90a7-4433-9142-4a263ae02a3a-istio-podinfo\") pod \"e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg\" (UID: \"a26fe4a2-90a7-4433-9142-4a263ae02a3a\") " pod="openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg"
Sep 07 04:12:35.801680 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:35.801656    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a26fe4a2-90a7-4433-9142-4a263ae02a3a-workload-certs\") pod \"e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg\" (UID: \"a26fe4a2-90a7-4433-9142-4a263ae02a3a\") " pod="openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg"
Sep 07 04:12:35.801730 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:35.801683    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a26fe4a2-90a7-4433-9142-4a263ae02a3a-istio-envoy\") pod \"e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg\" (UID: \"a26fe4a2-90a7-4433-9142-4a263ae02a3a\") " pod="openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg"
Sep 07 04:12:35.801730 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:35.801708    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a26fe4a2-90a7-4433-9142-4a263ae02a3a-istio-token\") pod \"e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg\" (UID: \"a26fe4a2-90a7-4433-9142-4a263ae02a3a\") " pod="openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg"
Sep 07 04:12:35.903158 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:35.903127    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a26fe4a2-90a7-4433-9142-4a263ae02a3a-credential-socket\") pod \"e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg\" (UID: \"a26fe4a2-90a7-4433-9142-4a263ae02a3a\") " pod="openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg"
Sep 07 04:12:35.903158 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:35.903162    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a26fe4a2-90a7-4433-9142-4a263ae02a3a-istio-data\") pod \"e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg\" (UID: \"a26fe4a2-90a7-4433-9142-4a263ae02a3a\") " pod="openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg"
Sep 07 04:12:35.903353 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:35.903224    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a26fe4a2-90a7-4433-9142-4a263ae02a3a-workload-socket\") pod \"e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg\" (UID: \"a26fe4a2-90a7-4433-9142-4a263ae02a3a\") " pod="openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg"
Sep 07 04:12:35.903353 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:35.903261    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a26fe4a2-90a7-4433-9142-4a263ae02a3a-istiod-ca-cert\") pod \"e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg\" (UID: \"a26fe4a2-90a7-4433-9142-4a263ae02a3a\") " pod="openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg"
Sep 07 04:12:35.903427 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:35.903374    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrwht\" (UniqueName: \"kubernetes.io/projected/a26fe4a2-90a7-4433-9142-4a263ae02a3a-kube-api-access-zrwht\") pod \"e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg\" (UID: \"a26fe4a2-90a7-4433-9142-4a263ae02a3a\") " pod="openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg"
Sep 07 04:12:35.903478 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:35.903448    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a26fe4a2-90a7-4433-9142-4a263ae02a3a-istio-podinfo\") pod \"e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg\" (UID: \"a26fe4a2-90a7-4433-9142-4a263ae02a3a\") " pod="openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg"
Sep 07 04:12:35.903529 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:35.903490    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a26fe4a2-90a7-4433-9142-4a263ae02a3a-workload-certs\") pod \"e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg\" (UID: \"a26fe4a2-90a7-4433-9142-4a263ae02a3a\") " pod="openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg"
Sep 07 04:12:35.903529 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:35.903516    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a26fe4a2-90a7-4433-9142-4a263ae02a3a-istio-envoy\") pod \"e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg\" (UID: \"a26fe4a2-90a7-4433-9142-4a263ae02a3a\") " pod="openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg"
Sep 07 04:12:35.903616 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:35.903550    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a26fe4a2-90a7-4433-9142-4a263ae02a3a-istio-token\") pod \"e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg\" (UID: \"a26fe4a2-90a7-4433-9142-4a263ae02a3a\") " pod="openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg"
Sep 07 04:12:35.903616 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:35.903555    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a26fe4a2-90a7-4433-9142-4a263ae02a3a-credential-socket\") pod \"e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg\" (UID: \"a26fe4a2-90a7-4433-9142-4a263ae02a3a\") " pod="openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg"
Sep 07 04:12:35.903616 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:35.903579    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a26fe4a2-90a7-4433-9142-4a263ae02a3a-workload-socket\") pod \"e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg\" (UID: \"a26fe4a2-90a7-4433-9142-4a263ae02a3a\") " pod="openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg"
Sep 07 04:12:35.903918 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:35.903887    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a26fe4a2-90a7-4433-9142-4a263ae02a3a-istio-data\") pod \"e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg\" (UID: \"a26fe4a2-90a7-4433-9142-4a263ae02a3a\") " pod="openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg"
Sep 07 04:12:35.904074 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:35.904023    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a26fe4a2-90a7-4433-9142-4a263ae02a3a-workload-certs\") pod \"e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg\" (UID: \"a26fe4a2-90a7-4433-9142-4a263ae02a3a\") " pod="openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg"
Sep 07 04:12:35.904215 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:35.904190    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a26fe4a2-90a7-4433-9142-4a263ae02a3a-istiod-ca-cert\") pod \"e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg\" (UID: \"a26fe4a2-90a7-4433-9142-4a263ae02a3a\") " pod="openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg"
Sep 07 04:12:35.905890 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:35.905870    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a26fe4a2-90a7-4433-9142-4a263ae02a3a-istio-envoy\") pod \"e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg\" (UID: \"a26fe4a2-90a7-4433-9142-4a263ae02a3a\") " pod="openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg"
Sep 07 04:12:35.906029 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:35.906009    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a26fe4a2-90a7-4433-9142-4a263ae02a3a-istio-podinfo\") pod \"e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg\" (UID: \"a26fe4a2-90a7-4433-9142-4a263ae02a3a\") " pod="openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg"
Sep 07 04:12:35.919027 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:35.919002    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a26fe4a2-90a7-4433-9142-4a263ae02a3a-istio-token\") pod \"e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg\" (UID: \"a26fe4a2-90a7-4433-9142-4a263ae02a3a\") " pod="openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg"
Sep 07 04:12:35.919173 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:35.919156    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrwht\" (UniqueName: \"kubernetes.io/projected/a26fe4a2-90a7-4433-9142-4a263ae02a3a-kube-api-access-zrwht\") pod \"e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg\" (UID: \"a26fe4a2-90a7-4433-9142-4a263ae02a3a\") " pod="openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg"
Sep 07 04:12:36.062494 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:36.062435    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg"
Sep 07 04:12:36.336774 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:36.336745    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg"]
Sep 07 04:12:36.337952 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:12:36.337925    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda26fe4a2_90a7_4433_9142_4a263ae02a3a.slice/crio-7471b8608006cb943358d6a6683befa0f5df79331c990843d283bde0376213cb WatchSource:0}: Error finding container 7471b8608006cb943358d6a6683befa0f5df79331c990843d283bde0376213cb: Status 404 returned error can't find the container with id 7471b8608006cb943358d6a6683befa0f5df79331c990843d283bde0376213cb
Sep 07 04:12:36.340253 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:36.340221    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 04:12:36.340314 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:36.340288    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 04:12:36.340349 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:36.340315    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 04:12:36.758483 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:36.758444    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg" event={"ID":"a26fe4a2-90a7-4433-9142-4a263ae02a3a","Type":"ContainerStarted","Data":"0e0b8085ad9e8b15164e234c4dce7e698b2836ba06236f3e1f9391c1a485cd8c"}
Sep 07 04:12:36.758929 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:36.758528    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg" event={"ID":"a26fe4a2-90a7-4433-9142-4a263ae02a3a","Type":"ContainerStarted","Data":"7471b8608006cb943358d6a6683befa0f5df79331c990843d283bde0376213cb"}
Sep 07 04:12:36.777289 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:36.777242    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg" podStartSLOduration=1.777228122 podStartE2EDuration="1.777228122s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:12:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:12:36.774988623 +0000 UTC m=+1460.087464526" watchObservedRunningTime="2026-09-07 04:12:36.777228122 +0000 UTC m=+1460.089704024"
Sep 07 04:12:37.063403 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:37.063324    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg"
Sep 07 04:12:37.068132 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:37.068108    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg"
Sep 07 04:12:37.764066 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:37.764035    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg"
Sep 07 04:12:37.765137 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:37.765113    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg"
Sep 07 04:12:40.495384 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:40.495354    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-704b16-6d5db56675-fzc94"]
Sep 07 04:12:40.495835 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:40.495818    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bacc8c6-79f9-44b6-998f-6cef08ea02ec" containerName="istio-proxy"
Sep 07 04:12:40.498994 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:40.498976    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-704b16-6d5db56675-fzc94"
Sep 07 04:12:40.501200 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:40.501173    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-704b16\""
Sep 07 04:12:40.501297 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:40.501245    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-704b16-dockercfg-j8n6f\""
Sep 07 04:12:40.508978 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:40.508957    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-704b16-6d5db56675-fzc94"]
Sep 07 04:12:40.547399 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:40.547375    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbg97\" (UniqueName: \"kubernetes.io/projected/c78183ad-45e9-40ff-8133-b9ecf70ad8c9-kube-api-access-bbg97\") pod \"payload-processing-e2e-ipp-b-704b16-6d5db56675-fzc94\" (UID: \"c78183ad-45e9-40ff-8133-b9ecf70ad8c9\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-704b16-6d5db56675-fzc94"
Sep 07 04:12:40.547492 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:40.547409    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c78183ad-45e9-40ff-8133-b9ecf70ad8c9-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-704b16-6d5db56675-fzc94\" (UID: \"c78183ad-45e9-40ff-8133-b9ecf70ad8c9\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-704b16-6d5db56675-fzc94"
Sep 07 04:12:40.648217 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:40.648174    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbg97\" (UniqueName: \"kubernetes.io/projected/c78183ad-45e9-40ff-8133-b9ecf70ad8c9-kube-api-access-bbg97\") pod \"payload-processing-e2e-ipp-b-704b16-6d5db56675-fzc94\" (UID: \"c78183ad-45e9-40ff-8133-b9ecf70ad8c9\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-704b16-6d5db56675-fzc94"
Sep 07 04:12:40.648399 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:40.648242    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c78183ad-45e9-40ff-8133-b9ecf70ad8c9-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-704b16-6d5db56675-fzc94\" (UID: \"c78183ad-45e9-40ff-8133-b9ecf70ad8c9\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-704b16-6d5db56675-fzc94"
Sep 07 04:12:40.649135 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:40.649110    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c78183ad-45e9-40ff-8133-b9ecf70ad8c9-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-704b16-6d5db56675-fzc94\" (UID: \"c78183ad-45e9-40ff-8133-b9ecf70ad8c9\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-704b16-6d5db56675-fzc94"
Sep 07 04:12:40.655035 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:40.655012    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbg97\" (UniqueName: \"kubernetes.io/projected/c78183ad-45e9-40ff-8133-b9ecf70ad8c9-kube-api-access-bbg97\") pod \"payload-processing-e2e-ipp-b-704b16-6d5db56675-fzc94\" (UID: \"c78183ad-45e9-40ff-8133-b9ecf70ad8c9\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-704b16-6d5db56675-fzc94"
Sep 07 04:12:40.810081 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:40.809998    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-704b16-6d5db56675-fzc94"
Sep 07 04:12:41.080802 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:41.080770    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-704b16-6d5db56675-fzc94"]
Sep 07 04:12:41.081539 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:12:41.081500    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc78183ad_45e9_40ff_8133_b9ecf70ad8c9.slice/crio-5b7cfa2cbb8760bc1dbae77066426abecc9e67af9aba988a7f892beca6718187 WatchSource:0}: Error finding container 5b7cfa2cbb8760bc1dbae77066426abecc9e67af9aba988a7f892beca6718187: Status 404 returned error can't find the container with id 5b7cfa2cbb8760bc1dbae77066426abecc9e67af9aba988a7f892beca6718187
Sep 07 04:12:41.794116 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:41.794077    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-704b16-6d5db56675-fzc94" event={"ID":"c78183ad-45e9-40ff-8133-b9ecf70ad8c9","Type":"ContainerStarted","Data":"8af1f42d1b423d63858976531eb5674824ab86116126c1bcff72345544f5373b"}
Sep 07 04:12:41.794598 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:41.794142    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-704b16-6d5db56675-fzc94" event={"ID":"c78183ad-45e9-40ff-8133-b9ecf70ad8c9","Type":"ContainerStarted","Data":"5b7cfa2cbb8760bc1dbae77066426abecc9e67af9aba988a7f892beca6718187"}
Sep 07 04:12:41.794598 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:41.794211    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-704b16-6d5db56675-fzc94"
Sep 07 04:12:41.813042 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:41.812988    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-704b16-6d5db56675-fzc94" podStartSLOduration=1.81297156 podStartE2EDuration="1.81297156s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:12:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:12:41.812137149 +0000 UTC m=+1465.124613062" watchObservedRunningTime="2026-09-07 04:12:41.81297156 +0000 UTC m=+1465.125447462"
Sep 07 04:12:52.803161 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:52.803131    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-704b16-6d5db56675-fzc94"
Sep 07 04:12:53.805794 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:53.805748    2559 patch_prober.go:28] interesting pod/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.93:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 07 04:12:53.806182 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:53.805834    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg" podUID="a26fe4a2-90a7-4433-9142-4a263ae02a3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.93:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 07 04:12:54.880608 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:54.880576    2559 generic.go:356] "Generic (PLEG): container finished" podID="a26fe4a2-90a7-4433-9142-4a263ae02a3a" containerID="0e0b8085ad9e8b15164e234c4dce7e698b2836ba06236f3e1f9391c1a485cd8c" exitCode=0
Sep 07 04:12:54.881138 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:54.880661    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg" event={"ID":"a26fe4a2-90a7-4433-9142-4a263ae02a3a","Type":"ContainerDied","Data":"0e0b8085ad9e8b15164e234c4dce7e698b2836ba06236f3e1f9391c1a485cd8c"}
Sep 07 04:12:54.881214 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:54.881189    2559 scope.go:117] "RemoveContainer" containerID="0e0b8085ad9e8b15164e234c4dce7e698b2836ba06236f3e1f9391c1a485cd8c"
Sep 07 04:12:54.882303 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:54.882276    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 04:12:54.882362 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:54.882342    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 04:12:54.882402 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:54.882373    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 07 04:12:55.888058 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:55.888018    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg" event={"ID":"a26fe4a2-90a7-4433-9142-4a263ae02a3a","Type":"ContainerStarted","Data":"9cdf6b9f023ff315103fae562924e73c3c65de1d937e008e3df18b7014a88228"}
Sep 07 04:12:56.062994 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:56.062954    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg"
Sep 07 04:12:56.063241 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:56.063216    2559 patch_prober.go:28] interesting pod/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused" start-of-body=
Sep 07 04:12:56.063325 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:56.063277    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg" podUID="a26fe4a2-90a7-4433-9142-4a263ae02a3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused"
Sep 07 04:12:57.063241 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:57.063200    2559 patch_prober.go:28] interesting pod/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused" start-of-body=
Sep 07 04:12:57.063654 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:57.063256    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg" podUID="a26fe4a2-90a7-4433-9142-4a263ae02a3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused"
Sep 07 04:12:58.063573 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:58.063537    2559 patch_prober.go:28] interesting pod/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused" start-of-body=
Sep 07 04:12:58.063976 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:58.063602    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg" podUID="a26fe4a2-90a7-4433-9142-4a263ae02a3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused"
Sep 07 04:12:59.063147 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:59.063111    2559 patch_prober.go:28] interesting pod/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused" start-of-body=
Sep 07 04:12:59.063332 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:12:59.063163    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg" podUID="a26fe4a2-90a7-4433-9142-4a263ae02a3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused"
Sep 07 04:13:00.063106 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:13:00.063068    2559 patch_prober.go:28] interesting pod/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused" start-of-body=
Sep 07 04:13:00.063505 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:13:00.063128    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg" podUID="a26fe4a2-90a7-4433-9142-4a263ae02a3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused"
Sep 07 04:13:01.147029 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:13:01.146993    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg"
Sep 07 04:13:01.147473 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:13:01.147380    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg"
Sep 07 04:13:01.148157 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:13:01.148138    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg"
Sep 07 04:13:08.750704 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:13:08.750672    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-t4whn_2ccc5fd6-5875-4c48-bb6c-3e3c74b3e6b7/payload-processing/0.log"
Sep 07 04:13:08.868720 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:13:08.868681    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-704b16-6d5db56675-fzc94_c78183ad-45e9-40ff-8133-b9ecf70ad8c9/payload-processing/0.log"
Sep 07 04:13:34.240038 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:13:34.240000    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-f8fdfa-5fff6db5d7-zl7mr_2325c911-97a7-404f-84b6-c97f1a905f27/payload-processing/0.log"
Sep 07 04:13:34.357042 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:13:34.357005    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-t4whn_2ccc5fd6-5875-4c48-bb6c-3e3c74b3e6b7/payload-processing/0.log"
Sep 07 04:13:34.481477 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:13:34.481445    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-704b16-6d5db56675-fzc94_c78183ad-45e9-40ff-8133-b9ecf70ad8c9/payload-processing/0.log"
Sep 07 04:13:39.821417 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:13:39.821337    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-c5ce6a-58f6b88f-x4tqg"]
Sep 07 04:13:39.824977 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:13:39.824960    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-c5ce6a-58f6b88f-x4tqg"
Sep 07 04:13:39.826926 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:13:39.826903    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-c5ce6a-dockercfg-kgkhs\""
Sep 07 04:13:39.826926 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:13:39.826916    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-c5ce6a\""
Sep 07 04:13:39.836500 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:13:39.836477    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-c5ce6a-58f6b88f-x4tqg"]
Sep 07 04:13:39.964922 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:13:39.964892    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2dt9\" (UniqueName: \"kubernetes.io/projected/5125bb40-5ed6-4871-87d8-d424a9d3d7ed-kube-api-access-p2dt9\") pod \"payload-processing-e2e-ipp-cleanup-c5ce6a-58f6b88f-x4tqg\" (UID: \"5125bb40-5ed6-4871-87d8-d424a9d3d7ed\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-c5ce6a-58f6b88f-x4tqg"
Sep 07 04:13:39.965083 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:13:39.965000    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5125bb40-5ed6-4871-87d8-d424a9d3d7ed-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-c5ce6a-58f6b88f-x4tqg\" (UID: \"5125bb40-5ed6-4871-87d8-d424a9d3d7ed\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-c5ce6a-58f6b88f-x4tqg"
Sep 07 04:13:40.065587 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:13:40.065557    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5125bb40-5ed6-4871-87d8-d424a9d3d7ed-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-c5ce6a-58f6b88f-x4tqg\" (UID: \"5125bb40-5ed6-4871-87d8-d424a9d3d7ed\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-c5ce6a-58f6b88f-x4tqg"
Sep 07 04:13:40.065795 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:13:40.065670    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2dt9\" (UniqueName: \"kubernetes.io/projected/5125bb40-5ed6-4871-87d8-d424a9d3d7ed-kube-api-access-p2dt9\") pod \"payload-processing-e2e-ipp-cleanup-c5ce6a-58f6b88f-x4tqg\" (UID: \"5125bb40-5ed6-4871-87d8-d424a9d3d7ed\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-c5ce6a-58f6b88f-x4tqg"
Sep 07 04:13:40.066307 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:13:40.066287    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5125bb40-5ed6-4871-87d8-d424a9d3d7ed-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-c5ce6a-58f6b88f-x4tqg\" (UID: \"5125bb40-5ed6-4871-87d8-d424a9d3d7ed\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-c5ce6a-58f6b88f-x4tqg"
Sep 07 04:13:40.072765 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:13:40.072720    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2dt9\" (UniqueName: \"kubernetes.io/projected/5125bb40-5ed6-4871-87d8-d424a9d3d7ed-kube-api-access-p2dt9\") pod \"payload-processing-e2e-ipp-cleanup-c5ce6a-58f6b88f-x4tqg\" (UID: \"5125bb40-5ed6-4871-87d8-d424a9d3d7ed\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-c5ce6a-58f6b88f-x4tqg"
Sep 07 04:13:40.136348 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:13:40.136328    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-c5ce6a-58f6b88f-x4tqg"
Sep 07 04:13:40.407103 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:13:40.407075    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-c5ce6a-58f6b88f-x4tqg"]
Sep 07 04:13:40.407844 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:13:40.407819    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5125bb40_5ed6_4871_87d8_d424a9d3d7ed.slice/crio-55a8d7bffd4baa0c81981436af9bb0af7d59ca9b50861d9063962496a60a9096 WatchSource:0}: Error finding container 55a8d7bffd4baa0c81981436af9bb0af7d59ca9b50861d9063962496a60a9096: Status 404 returned error can't find the container with id 55a8d7bffd4baa0c81981436af9bb0af7d59ca9b50861d9063962496a60a9096
Sep 07 04:13:41.178801 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:13:41.178766    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-c5ce6a-58f6b88f-x4tqg" event={"ID":"5125bb40-5ed6-4871-87d8-d424a9d3d7ed","Type":"ContainerStarted","Data":"f414ef23085312cacf3343bef3f7dab31b8d54a9ba760e874ab1ca6f6c2b32c2"}
Sep 07 04:13:41.179144 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:13:41.178821    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-c5ce6a-58f6b88f-x4tqg"
Sep 07 04:13:41.179144 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:13:41.178840    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-c5ce6a-58f6b88f-x4tqg" event={"ID":"5125bb40-5ed6-4871-87d8-d424a9d3d7ed","Type":"ContainerStarted","Data":"55a8d7bffd4baa0c81981436af9bb0af7d59ca9b50861d9063962496a60a9096"}
Sep 07 04:13:41.188158 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:13:41.188103    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-c5ce6a-58f6b88f-x4tqg" podStartSLOduration=2.188087923 podStartE2EDuration="2.188087923s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:13:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:13:41.186951973 +0000 UTC m=+1524.499427899" watchObservedRunningTime="2026-09-07 04:13:41.188087923 +0000 UTC m=+1524.500563825"
Sep 07 04:13:52.180770 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:13:52.180732    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-c5ce6a-58f6b88f-x4tqg"
Sep 07 04:14:03.790957 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:03.790907    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c5ce6a-7lmcp"]
Sep 07 04:14:03.796714 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:03.796686    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c5ce6a-7lmcp"
Sep 07 04:14:03.800974 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:03.800917    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 07 04:14:03.801114 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:03.800915    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zs4ff\""
Sep 07 04:14:03.802509 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:03.802483    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c5ce6a-7lmcp"]
Sep 07 04:14:03.963246 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:03.963218    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c26ef40-b84f-4c8a-8613-f3180dd6831f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-c5ce6a-7lmcp\" (UID: \"3c26ef40-b84f-4c8a-8613-f3180dd6831f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c5ce6a-7lmcp"
Sep 07 04:14:04.063749 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:04.063671    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c26ef40-b84f-4c8a-8613-f3180dd6831f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-c5ce6a-7lmcp\" (UID: \"3c26ef40-b84f-4c8a-8613-f3180dd6831f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c5ce6a-7lmcp"
Sep 07 04:14:04.064289 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:04.064266    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c26ef40-b84f-4c8a-8613-f3180dd6831f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-c5ce6a-7lmcp\" (UID: \"3c26ef40-b84f-4c8a-8613-f3180dd6831f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c5ce6a-7lmcp"
Sep 07 04:14:04.110327 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:04.110301    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c5ce6a-7lmcp"
Sep 07 04:14:04.382008 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:04.381986    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c5ce6a-7lmcp"]
Sep 07 04:14:04.383079 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:14:04.383053    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c26ef40_b84f_4c8a_8613_f3180dd6831f.slice/crio-a5e6e41ee104034b7cbb5cc4d908739516c6b62732c8748d3b1549cc734648ba WatchSource:0}: Error finding container a5e6e41ee104034b7cbb5cc4d908739516c6b62732c8748d3b1549cc734648ba: Status 404 returned error can't find the container with id a5e6e41ee104034b7cbb5cc4d908739516c6b62732c8748d3b1549cc734648ba
Sep 07 04:14:05.316568 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:05.316494    2559 generic.go:356] "Generic (PLEG): container finished" podID="3c26ef40-b84f-4c8a-8613-f3180dd6831f" containerID="c83cc19b3d43576b0439d315bf328c7f54a323e9fb0a55c4993a235c99e3f6b8" exitCode=0
Sep 07 04:14:05.316948 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:05.316578    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c5ce6a-7lmcp" event={"ID":"3c26ef40-b84f-4c8a-8613-f3180dd6831f","Type":"ContainerDied","Data":"c83cc19b3d43576b0439d315bf328c7f54a323e9fb0a55c4993a235c99e3f6b8"}
Sep 07 04:14:05.316948 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:05.316649    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c5ce6a-7lmcp" event={"ID":"3c26ef40-b84f-4c8a-8613-f3180dd6831f","Type":"ContainerStarted","Data":"a5e6e41ee104034b7cbb5cc4d908739516c6b62732c8748d3b1549cc734648ba"}
Sep 07 04:14:06.457845 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:06.457824    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c5ce6a-7lmcp"
Sep 07 04:14:06.588393 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:06.588309    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c26ef40-b84f-4c8a-8613-f3180dd6831f-maas-api-service-ca\") pod \"3c26ef40-b84f-4c8a-8613-f3180dd6831f\" (UID: \"3c26ef40-b84f-4c8a-8613-f3180dd6831f\") "
Sep 07 04:14:06.588728 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:06.588698    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c26ef40-b84f-4c8a-8613-f3180dd6831f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3c26ef40-b84f-4c8a-8613-f3180dd6831f" (UID: "3c26ef40-b84f-4c8a-8613-f3180dd6831f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 04:14:06.689321 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:06.689293    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c26ef40-b84f-4c8a-8613-f3180dd6831f-maas-api-service-ca\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:14:07.330482 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:07.330454    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c5ce6a-7lmcp" event={"ID":"3c26ef40-b84f-4c8a-8613-f3180dd6831f","Type":"ContainerDied","Data":"a5e6e41ee104034b7cbb5cc4d908739516c6b62732c8748d3b1549cc734648ba"}
Sep 07 04:14:07.330482 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:07.330468    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c5ce6a-7lmcp"
Sep 07 04:14:07.330716 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:07.330501    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a5e6e41ee104034b7cbb5cc4d908739516c6b62732c8748d3b1549cc734648ba"
Sep 07 04:14:09.602150 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:09.602116    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-c5ce6a-58f6b88f-x4tqg"]
Sep 07 04:14:09.602531 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:09.602355    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-c5ce6a-58f6b88f-x4tqg" podUID="5125bb40-5ed6-4871-87d8-d424a9d3d7ed" containerName="payload-processing" containerID="cri-o://f414ef23085312cacf3343bef3f7dab31b8d54a9ba760e874ab1ca6f6c2b32c2" gracePeriod=30
Sep 07 04:14:09.746852 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:09.746814    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c5ce6a-7lmcp"]
Sep 07 04:14:09.750586 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:09.750561    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-c5ce6a-7lmcp"]
Sep 07 04:14:09.874039 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:09.874013    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-c5ce6a-58f6b88f-x4tqg"
Sep 07 04:14:09.917227 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:09.917199    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2dt9\" (UniqueName: \"kubernetes.io/projected/5125bb40-5ed6-4871-87d8-d424a9d3d7ed-kube-api-access-p2dt9\") pod \"5125bb40-5ed6-4871-87d8-d424a9d3d7ed\" (UID: \"5125bb40-5ed6-4871-87d8-d424a9d3d7ed\") "
Sep 07 04:14:09.917384 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:09.917316    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5125bb40-5ed6-4871-87d8-d424a9d3d7ed-plugins-config-volume\") pod \"5125bb40-5ed6-4871-87d8-d424a9d3d7ed\" (UID: \"5125bb40-5ed6-4871-87d8-d424a9d3d7ed\") "
Sep 07 04:14:09.917637 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:09.917599    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5125bb40-5ed6-4871-87d8-d424a9d3d7ed-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5125bb40-5ed6-4871-87d8-d424a9d3d7ed" (UID: "5125bb40-5ed6-4871-87d8-d424a9d3d7ed"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 04:14:09.919176 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:09.919152    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5125bb40-5ed6-4871-87d8-d424a9d3d7ed-kube-api-access-p2dt9" (OuterVolumeSpecName: "kube-api-access-p2dt9") pod "5125bb40-5ed6-4871-87d8-d424a9d3d7ed" (UID: "5125bb40-5ed6-4871-87d8-d424a9d3d7ed"). InnerVolumeSpecName "kube-api-access-p2dt9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 04:14:10.018917 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:10.018850    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2dt9\" (UniqueName: \"kubernetes.io/projected/5125bb40-5ed6-4871-87d8-d424a9d3d7ed-kube-api-access-p2dt9\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:14:10.018917 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:10.018879    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5125bb40-5ed6-4871-87d8-d424a9d3d7ed-plugins-config-volume\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:14:10.348404 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:10.348327    2559 generic.go:356] "Generic (PLEG): container finished" podID="5125bb40-5ed6-4871-87d8-d424a9d3d7ed" containerID="f414ef23085312cacf3343bef3f7dab31b8d54a9ba760e874ab1ca6f6c2b32c2" exitCode=0
Sep 07 04:14:10.348404 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:10.348379    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-c5ce6a-58f6b88f-x4tqg"
Sep 07 04:14:10.348559 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:10.348415    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-c5ce6a-58f6b88f-x4tqg" event={"ID":"5125bb40-5ed6-4871-87d8-d424a9d3d7ed","Type":"ContainerDied","Data":"f414ef23085312cacf3343bef3f7dab31b8d54a9ba760e874ab1ca6f6c2b32c2"}
Sep 07 04:14:10.348559 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:10.348472    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-c5ce6a-58f6b88f-x4tqg" event={"ID":"5125bb40-5ed6-4871-87d8-d424a9d3d7ed","Type":"ContainerDied","Data":"55a8d7bffd4baa0c81981436af9bb0af7d59ca9b50861d9063962496a60a9096"}
Sep 07 04:14:10.348559 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:10.348497    2559 scope.go:117] "RemoveContainer" containerID="f414ef23085312cacf3343bef3f7dab31b8d54a9ba760e874ab1ca6f6c2b32c2"
Sep 07 04:14:10.358479 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:10.358456    2559 scope.go:117] "RemoveContainer" containerID="f414ef23085312cacf3343bef3f7dab31b8d54a9ba760e874ab1ca6f6c2b32c2"
Sep 07 04:14:10.358761 ip-10-0-132-4 kubenswrapper[2559]: E0907 04:14:10.358743    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f414ef23085312cacf3343bef3f7dab31b8d54a9ba760e874ab1ca6f6c2b32c2\": container with ID starting with f414ef23085312cacf3343bef3f7dab31b8d54a9ba760e874ab1ca6f6c2b32c2 not found: ID does not exist" containerID="f414ef23085312cacf3343bef3f7dab31b8d54a9ba760e874ab1ca6f6c2b32c2"
Sep 07 04:14:10.358828 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:10.358767    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f414ef23085312cacf3343bef3f7dab31b8d54a9ba760e874ab1ca6f6c2b32c2"} err="failed to get container status \"f414ef23085312cacf3343bef3f7dab31b8d54a9ba760e874ab1ca6f6c2b32c2\": rpc error: code = NotFound desc = could not find container \"f414ef23085312cacf3343bef3f7dab31b8d54a9ba760e874ab1ca6f6c2b32c2\": container with ID starting with f414ef23085312cacf3343bef3f7dab31b8d54a9ba760e874ab1ca6f6c2b32c2 not found: ID does not exist"
Sep 07 04:14:10.369609 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:10.369586    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-c5ce6a-58f6b88f-x4tqg"]
Sep 07 04:14:10.371849 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:10.371831    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-c5ce6a-58f6b88f-x4tqg"]
Sep 07 04:14:11.179767 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:11.179735    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c26ef40-b84f-4c8a-8613-f3180dd6831f" path="/var/lib/kubelet/pods/3c26ef40-b84f-4c8a-8613-f3180dd6831f/volumes"
Sep 07 04:14:11.180117 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:11.180087    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5125bb40-5ed6-4871-87d8-d424a9d3d7ed" path="/var/lib/kubelet/pods/5125bb40-5ed6-4871-87d8-d424a9d3d7ed/volumes"
Sep 07 04:14:17.556380 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:17.556347    2559 scope.go:117] "RemoveContainer" containerID="837a73be73d65ce1c0f0b311db40da342adee3aad008ab9c3962c7ffda5e28db"
Sep 07 04:14:20.064946 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:20.064904    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f8fdfa-w5gw4"]
Sep 07 04:14:20.065337 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:20.065321    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5125bb40-5ed6-4871-87d8-d424a9d3d7ed" containerName="payload-processing"
Sep 07 04:14:20.065398 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:20.065338    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5125bb40-5ed6-4871-87d8-d424a9d3d7ed" containerName="payload-processing"
Sep 07 04:14:20.065398 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:20.065353    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c26ef40-b84f-4c8a-8613-f3180dd6831f" containerName="revoke-keys"
Sep 07 04:14:20.065398 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:20.065358    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c26ef40-b84f-4c8a-8613-f3180dd6831f" containerName="revoke-keys"
Sep 07 04:14:20.065506 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:20.065423    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c26ef40-b84f-4c8a-8613-f3180dd6831f" containerName="revoke-keys"
Sep 07 04:14:20.065506 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:20.065432    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5125bb40-5ed6-4871-87d8-d424a9d3d7ed" containerName="payload-processing"
Sep 07 04:14:20.068369 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:20.068350    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f8fdfa-w5gw4"
Sep 07 04:14:20.070262 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:20.070242    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 07 04:14:20.070325 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:20.070242    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zs4ff\""
Sep 07 04:14:20.075306 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:20.075277    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f8fdfa-w5gw4"]
Sep 07 04:14:20.102935 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:20.102905    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8b1500c-e529-4e8b-acf4-9383eea0140a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-f8fdfa-w5gw4\" (UID: \"c8b1500c-e529-4e8b-acf4-9383eea0140a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f8fdfa-w5gw4"
Sep 07 04:14:20.203939 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:20.203911    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8b1500c-e529-4e8b-acf4-9383eea0140a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-f8fdfa-w5gw4\" (UID: \"c8b1500c-e529-4e8b-acf4-9383eea0140a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f8fdfa-w5gw4"
Sep 07 04:14:20.204493 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:20.204476    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8b1500c-e529-4e8b-acf4-9383eea0140a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-f8fdfa-w5gw4\" (UID: \"c8b1500c-e529-4e8b-acf4-9383eea0140a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f8fdfa-w5gw4"
Sep 07 04:14:20.381481 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:20.381452    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f8fdfa-w5gw4"
Sep 07 04:14:20.659028 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:20.658987    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f8fdfa-w5gw4"]
Sep 07 04:14:20.660040 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:14:20.660013    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8b1500c_e529_4e8b_acf4_9383eea0140a.slice/crio-35854c5680e2f58bffcb0e7fb00515ed4bdbeab9c0fc92a40596039b88adff4e WatchSource:0}: Error finding container 35854c5680e2f58bffcb0e7fb00515ed4bdbeab9c0fc92a40596039b88adff4e: Status 404 returned error can't find the container with id 35854c5680e2f58bffcb0e7fb00515ed4bdbeab9c0fc92a40596039b88adff4e
Sep 07 04:14:21.420049 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:21.420022    2559 generic.go:356] "Generic (PLEG): container finished" podID="c8b1500c-e529-4e8b-acf4-9383eea0140a" containerID="397fed8b37c04c3f19a7d88c031d1d02237b0cbf622db42685311cbf8760d3ad" exitCode=0
Sep 07 04:14:21.420412 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:21.420059    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f8fdfa-w5gw4" event={"ID":"c8b1500c-e529-4e8b-acf4-9383eea0140a","Type":"ContainerDied","Data":"397fed8b37c04c3f19a7d88c031d1d02237b0cbf622db42685311cbf8760d3ad"}
Sep 07 04:14:21.420412 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:21.420095    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f8fdfa-w5gw4" event={"ID":"c8b1500c-e529-4e8b-acf4-9383eea0140a","Type":"ContainerStarted","Data":"35854c5680e2f58bffcb0e7fb00515ed4bdbeab9c0fc92a40596039b88adff4e"}
Sep 07 04:14:22.557846 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:22.557825    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f8fdfa-w5gw4"
Sep 07 04:14:22.624894 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:22.624871    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8b1500c-e529-4e8b-acf4-9383eea0140a-maas-api-service-ca\") pod \"c8b1500c-e529-4e8b-acf4-9383eea0140a\" (UID: \"c8b1500c-e529-4e8b-acf4-9383eea0140a\") "
Sep 07 04:14:22.625197 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:22.625175    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8b1500c-e529-4e8b-acf4-9383eea0140a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c8b1500c-e529-4e8b-acf4-9383eea0140a" (UID: "c8b1500c-e529-4e8b-acf4-9383eea0140a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 04:14:22.726442 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:22.726386    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8b1500c-e529-4e8b-acf4-9383eea0140a-maas-api-service-ca\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:14:23.433779 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:23.433745    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f8fdfa-w5gw4" event={"ID":"c8b1500c-e529-4e8b-acf4-9383eea0140a","Type":"ContainerDied","Data":"35854c5680e2f58bffcb0e7fb00515ed4bdbeab9c0fc92a40596039b88adff4e"}
Sep 07 04:14:23.433779 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:23.433779    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f8fdfa-w5gw4"
Sep 07 04:14:23.434037 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:23.433801    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="35854c5680e2f58bffcb0e7fb00515ed4bdbeab9c0fc92a40596039b88adff4e"
Sep 07 04:14:35.570320 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:35.570283    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-f8fdfa-5fff6db5d7-zl7mr"]
Sep 07 04:14:35.570760 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:35.570538    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-f8fdfa-5fff6db5d7-zl7mr" podUID="2325c911-97a7-404f-84b6-c97f1a905f27" containerName="payload-processing" containerID="cri-o://1411cda4f8e725dc46dfaa5abd69d2ed2555081122de02064e28295940d5c8c8" gracePeriod=30
Sep 07 04:14:35.579708 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:35.579677    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-f8fdfa-66785f54d6-xxjmd"]
Sep 07 04:14:35.579977 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:35.579914    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-f8fdfa-66785f54d6-xxjmd" podUID="aecb9294-4d44-4dc4-bd59-f72cb336a2f6" containerName="payload-pre-processing" containerID="cri-o://3f944125959f1167b7e907401388627e36a3601ae09375a776ead699d7227002" gracePeriod=30
Sep 07 04:14:35.704909 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:35.704880    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f8fdfa-w5gw4"]
Sep 07 04:14:35.707647 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:35.707609    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-f8fdfa-w5gw4"]
Sep 07 04:14:35.875148 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:35.875127    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-f8fdfa-5fff6db5d7-zl7mr"
Sep 07 04:14:35.877894 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:35.877874    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-f8fdfa-66785f54d6-xxjmd"
Sep 07 04:14:35.935664 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:35.935612    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aecb9294-4d44-4dc4-bd59-f72cb336a2f6-plugins-config-volume\") pod \"aecb9294-4d44-4dc4-bd59-f72cb336a2f6\" (UID: \"aecb9294-4d44-4dc4-bd59-f72cb336a2f6\") "
Sep 07 04:14:35.935797 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:35.935722    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2325c911-97a7-404f-84b6-c97f1a905f27-plugins-config-volume\") pod \"2325c911-97a7-404f-84b6-c97f1a905f27\" (UID: \"2325c911-97a7-404f-84b6-c97f1a905f27\") "
Sep 07 04:14:35.935797 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:35.935773    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kj8h5\" (UniqueName: \"kubernetes.io/projected/2325c911-97a7-404f-84b6-c97f1a905f27-kube-api-access-kj8h5\") pod \"2325c911-97a7-404f-84b6-c97f1a905f27\" (UID: \"2325c911-97a7-404f-84b6-c97f1a905f27\") "
Sep 07 04:14:35.935916 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:35.935811    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4hqld\" (UniqueName: \"kubernetes.io/projected/aecb9294-4d44-4dc4-bd59-f72cb336a2f6-kube-api-access-4hqld\") pod \"aecb9294-4d44-4dc4-bd59-f72cb336a2f6\" (UID: \"aecb9294-4d44-4dc4-bd59-f72cb336a2f6\") "
Sep 07 04:14:35.935916 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:35.935893    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aecb9294-4d44-4dc4-bd59-f72cb336a2f6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "aecb9294-4d44-4dc4-bd59-f72cb336a2f6" (UID: "aecb9294-4d44-4dc4-bd59-f72cb336a2f6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 04:14:35.936142 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:35.936121    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2325c911-97a7-404f-84b6-c97f1a905f27-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2325c911-97a7-404f-84b6-c97f1a905f27" (UID: "2325c911-97a7-404f-84b6-c97f1a905f27"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 04:14:35.936210 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:35.936151    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aecb9294-4d44-4dc4-bd59-f72cb336a2f6-plugins-config-volume\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:14:35.937854 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:35.937825    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aecb9294-4d44-4dc4-bd59-f72cb336a2f6-kube-api-access-4hqld" (OuterVolumeSpecName: "kube-api-access-4hqld") pod "aecb9294-4d44-4dc4-bd59-f72cb336a2f6" (UID: "aecb9294-4d44-4dc4-bd59-f72cb336a2f6"). InnerVolumeSpecName "kube-api-access-4hqld". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 04:14:35.937955 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:35.937927    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2325c911-97a7-404f-84b6-c97f1a905f27-kube-api-access-kj8h5" (OuterVolumeSpecName: "kube-api-access-kj8h5") pod "2325c911-97a7-404f-84b6-c97f1a905f27" (UID: "2325c911-97a7-404f-84b6-c97f1a905f27"). InnerVolumeSpecName "kube-api-access-kj8h5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 04:14:36.036767 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:36.036738    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2325c911-97a7-404f-84b6-c97f1a905f27-plugins-config-volume\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:14:36.036767 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:36.036765    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kj8h5\" (UniqueName: \"kubernetes.io/projected/2325c911-97a7-404f-84b6-c97f1a905f27-kube-api-access-kj8h5\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:14:36.036900 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:36.036778    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4hqld\" (UniqueName: \"kubernetes.io/projected/aecb9294-4d44-4dc4-bd59-f72cb336a2f6-kube-api-access-4hqld\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:14:36.524091 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:36.524058    2559 generic.go:356] "Generic (PLEG): container finished" podID="aecb9294-4d44-4dc4-bd59-f72cb336a2f6" containerID="3f944125959f1167b7e907401388627e36a3601ae09375a776ead699d7227002" exitCode=0
Sep 07 04:14:36.524238 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:36.524100    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-f8fdfa-66785f54d6-xxjmd"
Sep 07 04:14:36.524238 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:36.524148    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-f8fdfa-66785f54d6-xxjmd" event={"ID":"aecb9294-4d44-4dc4-bd59-f72cb336a2f6","Type":"ContainerDied","Data":"3f944125959f1167b7e907401388627e36a3601ae09375a776ead699d7227002"}
Sep 07 04:14:36.524238 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:36.524208    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-f8fdfa-66785f54d6-xxjmd" event={"ID":"aecb9294-4d44-4dc4-bd59-f72cb336a2f6","Type":"ContainerDied","Data":"6608ea0e2c1ffafe02f1f61148cba4953e40551f5f0a2e9222440df90c100e92"}
Sep 07 04:14:36.524403 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:36.524244    2559 scope.go:117] "RemoveContainer" containerID="3f944125959f1167b7e907401388627e36a3601ae09375a776ead699d7227002"
Sep 07 04:14:36.525976 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:36.525941    2559 generic.go:356] "Generic (PLEG): container finished" podID="2325c911-97a7-404f-84b6-c97f1a905f27" containerID="1411cda4f8e725dc46dfaa5abd69d2ed2555081122de02064e28295940d5c8c8" exitCode=0
Sep 07 04:14:36.526090 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:36.525985    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-f8fdfa-5fff6db5d7-zl7mr"
Sep 07 04:14:36.526090 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:36.525989    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-f8fdfa-5fff6db5d7-zl7mr" event={"ID":"2325c911-97a7-404f-84b6-c97f1a905f27","Type":"ContainerDied","Data":"1411cda4f8e725dc46dfaa5abd69d2ed2555081122de02064e28295940d5c8c8"}
Sep 07 04:14:36.526090 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:36.526022    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-f8fdfa-5fff6db5d7-zl7mr" event={"ID":"2325c911-97a7-404f-84b6-c97f1a905f27","Type":"ContainerDied","Data":"90bd14256ee3a0f32aa3fe49ce12768a9b41a5ac43a01187646e1f6f63b5ce3c"}
Sep 07 04:14:36.534603 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:36.534585    2559 scope.go:117] "RemoveContainer" containerID="3f944125959f1167b7e907401388627e36a3601ae09375a776ead699d7227002"
Sep 07 04:14:36.534926 ip-10-0-132-4 kubenswrapper[2559]: E0907 04:14:36.534900    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f944125959f1167b7e907401388627e36a3601ae09375a776ead699d7227002\": container with ID starting with 3f944125959f1167b7e907401388627e36a3601ae09375a776ead699d7227002 not found: ID does not exist" containerID="3f944125959f1167b7e907401388627e36a3601ae09375a776ead699d7227002"
Sep 07 04:14:36.535008 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:36.534938    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f944125959f1167b7e907401388627e36a3601ae09375a776ead699d7227002"} err="failed to get container status \"3f944125959f1167b7e907401388627e36a3601ae09375a776ead699d7227002\": rpc error: code = NotFound desc = could not find container \"3f944125959f1167b7e907401388627e36a3601ae09375a776ead699d7227002\": container with ID starting with 3f944125959f1167b7e907401388627e36a3601ae09375a776ead699d7227002 not found: ID does not exist"
Sep 07 04:14:36.535008 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:36.534959    2559 scope.go:117] "RemoveContainer" containerID="1411cda4f8e725dc46dfaa5abd69d2ed2555081122de02064e28295940d5c8c8"
Sep 07 04:14:36.543087 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:36.543071    2559 scope.go:117] "RemoveContainer" containerID="1411cda4f8e725dc46dfaa5abd69d2ed2555081122de02064e28295940d5c8c8"
Sep 07 04:14:36.543316 ip-10-0-132-4 kubenswrapper[2559]: E0907 04:14:36.543301    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1411cda4f8e725dc46dfaa5abd69d2ed2555081122de02064e28295940d5c8c8\": container with ID starting with 1411cda4f8e725dc46dfaa5abd69d2ed2555081122de02064e28295940d5c8c8 not found: ID does not exist" containerID="1411cda4f8e725dc46dfaa5abd69d2ed2555081122de02064e28295940d5c8c8"
Sep 07 04:14:36.543364 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:36.543322    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1411cda4f8e725dc46dfaa5abd69d2ed2555081122de02064e28295940d5c8c8"} err="failed to get container status \"1411cda4f8e725dc46dfaa5abd69d2ed2555081122de02064e28295940d5c8c8\": rpc error: code = NotFound desc = could not find container \"1411cda4f8e725dc46dfaa5abd69d2ed2555081122de02064e28295940d5c8c8\": container with ID starting with 1411cda4f8e725dc46dfaa5abd69d2ed2555081122de02064e28295940d5c8c8 not found: ID does not exist"
Sep 07 04:14:36.551375 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:36.551354    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-f8fdfa-66785f54d6-xxjmd"]
Sep 07 04:14:36.555111 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:36.555091    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-f8fdfa-66785f54d6-xxjmd"]
Sep 07 04:14:36.564908 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:36.564886    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-f8fdfa-5fff6db5d7-zl7mr"]
Sep 07 04:14:36.567002 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:36.566985    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-f8fdfa-5fff6db5d7-zl7mr"]
Sep 07 04:14:37.180550 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:37.180518    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2325c911-97a7-404f-84b6-c97f1a905f27" path="/var/lib/kubelet/pods/2325c911-97a7-404f-84b6-c97f1a905f27/volumes"
Sep 07 04:14:37.180934 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:37.180916    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aecb9294-4d44-4dc4-bd59-f72cb336a2f6" path="/var/lib/kubelet/pods/aecb9294-4d44-4dc4-bd59-f72cb336a2f6/volumes"
Sep 07 04:14:37.181241 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:14:37.181227    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8b1500c-e529-4e8b-acf4-9383eea0140a" path="/var/lib/kubelet/pods/c8b1500c-e529-4e8b-acf4-9383eea0140a/volumes"
Sep 07 04:15:00.140745 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:00.140699    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29812575-2tsb4"]
Sep 07 04:15:00.141271 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:00.141117    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aecb9294-4d44-4dc4-bd59-f72cb336a2f6" containerName="payload-pre-processing"
Sep 07 04:15:00.141271 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:00.141131    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="aecb9294-4d44-4dc4-bd59-f72cb336a2f6" containerName="payload-pre-processing"
Sep 07 04:15:00.141271 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:00.141145    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2325c911-97a7-404f-84b6-c97f1a905f27" containerName="payload-processing"
Sep 07 04:15:00.141271 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:00.141151    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2325c911-97a7-404f-84b6-c97f1a905f27" containerName="payload-processing"
Sep 07 04:15:00.141271 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:00.141163    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8b1500c-e529-4e8b-acf4-9383eea0140a" containerName="revoke-keys"
Sep 07 04:15:00.141271 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:00.141169    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8b1500c-e529-4e8b-acf4-9383eea0140a" containerName="revoke-keys"
Sep 07 04:15:00.141271 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:00.141233    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="aecb9294-4d44-4dc4-bd59-f72cb336a2f6" containerName="payload-pre-processing"
Sep 07 04:15:00.141271 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:00.141245    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2325c911-97a7-404f-84b6-c97f1a905f27" containerName="payload-processing"
Sep 07 04:15:00.141271 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:00.141252    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8b1500c-e529-4e8b-acf4-9383eea0140a" containerName="revoke-keys"
Sep 07 04:15:00.144483 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:00.144461    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-434d57-29812575-48tjb"]
Sep 07 04:15:00.144632 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:00.144604    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29812575-2tsb4"
Sep 07 04:15:00.146747 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:00.146726    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zs4ff\""
Sep 07 04:15:00.147891 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:00.147874    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-b8cea6-29812575-5n6cc"]
Sep 07 04:15:00.148001 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:00.147983    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-434d57-29812575-48tjb"
Sep 07 04:15:00.151272 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:00.151243    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-b8cea6-29812575-5n6cc"
Sep 07 04:15:00.153061 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:00.153039    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29812575-2tsb4"]
Sep 07 04:15:00.156136 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:00.156108    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-434d57-29812575-48tjb"]
Sep 07 04:15:00.159890 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:00.159831    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-b8cea6-29812575-5n6cc"]
Sep 07 04:15:00.160333 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:00.160313    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29812575-2tsb4"
Sep 07 04:15:00.169814 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:00.169794    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-434d57-29812575-48tjb"
Sep 07 04:15:00.201802 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:00.201769    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-b8cea6-29812575-5n6cc"
Sep 07 04:15:00.438260 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:00.438237    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29812575-2tsb4"]
Sep 07 04:15:00.439516 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:15:00.439494    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod239c959f_cf1c_4a67_8ba0_c21b07da1248.slice/crio-4b489f50c0eee4026f8ad85cc2d7817c6bb84abde4c6f32f76a4b5bff7589f0a WatchSource:0}: Error finding container 4b489f50c0eee4026f8ad85cc2d7817c6bb84abde4c6f32f76a4b5bff7589f0a: Status 404 returned error can't find the container with id 4b489f50c0eee4026f8ad85cc2d7817c6bb84abde4c6f32f76a4b5bff7589f0a
Sep 07 04:15:00.460019 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:00.459998    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-434d57-29812575-48tjb"]
Sep 07 04:15:00.460658 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:15:00.460614    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7e41df0_6946_4305_baa3_1227205f798f.slice/crio-f0c326d5edebf13668400e9f60d2d8f9cbfce3ce946c5064681886a6f370e352 WatchSource:0}: Error finding container f0c326d5edebf13668400e9f60d2d8f9cbfce3ce946c5064681886a6f370e352: Status 404 returned error can't find the container with id f0c326d5edebf13668400e9f60d2d8f9cbfce3ce946c5064681886a6f370e352
Sep 07 04:15:00.497521 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:00.497500    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-b8cea6-29812575-5n6cc"]
Sep 07 04:15:00.498557 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:15:00.498533    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd288732d_8916_4510_9c11_d037ff9f3c3a.slice/crio-849fef8b7fbcaca237400a5581098a0ee3d494a60ed8190b51db43771e504316 WatchSource:0}: Error finding container 849fef8b7fbcaca237400a5581098a0ee3d494a60ed8190b51db43771e504316: Status 404 returned error can't find the container with id 849fef8b7fbcaca237400a5581098a0ee3d494a60ed8190b51db43771e504316
Sep 07 04:15:00.675113 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:00.675086    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-b8cea6-29812575-5n6cc" event={"ID":"d288732d-8916-4510-9c11-d037ff9f3c3a","Type":"ContainerStarted","Data":"849fef8b7fbcaca237400a5581098a0ee3d494a60ed8190b51db43771e504316"}
Sep 07 04:15:00.676427 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:00.676400    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29812575-2tsb4" event={"ID":"239c959f-cf1c-4a67-8ba0-c21b07da1248","Type":"ContainerStarted","Data":"4b489f50c0eee4026f8ad85cc2d7817c6bb84abde4c6f32f76a4b5bff7589f0a"}
Sep 07 04:15:00.677579 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:00.677557    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-434d57-29812575-48tjb" event={"ID":"d7e41df0-6946-4305-baa3-1227205f798f","Type":"ContainerStarted","Data":"f0c326d5edebf13668400e9f60d2d8f9cbfce3ce946c5064681886a6f370e352"}
Sep 07 04:15:01.685247 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:01.685207    2559 generic.go:356] "Generic (PLEG): container finished" podID="d7e41df0-6946-4305-baa3-1227205f798f" containerID="58696ff385975a127e88654ed2557f868efe87a6dfc651661438179f7bb331da" exitCode=0
Sep 07 04:15:01.685722 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:01.685271    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-434d57-29812575-48tjb" event={"ID":"d7e41df0-6946-4305-baa3-1227205f798f","Type":"ContainerDied","Data":"58696ff385975a127e88654ed2557f868efe87a6dfc651661438179f7bb331da"}
Sep 07 04:15:01.686880 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:01.686857    2559 generic.go:356] "Generic (PLEG): container finished" podID="d288732d-8916-4510-9c11-d037ff9f3c3a" containerID="3d3159af8cbc27e130c0033a0b14c9291b65c4280a27f88430d1b7f5b015d1c0" exitCode=0
Sep 07 04:15:01.686977 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:01.686941    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-b8cea6-29812575-5n6cc" event={"ID":"d288732d-8916-4510-9c11-d037ff9f3c3a","Type":"ContainerDied","Data":"3d3159af8cbc27e130c0033a0b14c9291b65c4280a27f88430d1b7f5b015d1c0"}
Sep 07 04:15:01.688565 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:01.688537    2559 generic.go:356] "Generic (PLEG): container finished" podID="239c959f-cf1c-4a67-8ba0-c21b07da1248" containerID="79d449fbdde11fc96bc2852c5af93d40d8013cda1e36823b0c2602faf8c5e439" exitCode=0
Sep 07 04:15:01.688655 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:01.688566    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29812575-2tsb4" event={"ID":"239c959f-cf1c-4a67-8ba0-c21b07da1248","Type":"ContainerDied","Data":"79d449fbdde11fc96bc2852c5af93d40d8013cda1e36823b0c2602faf8c5e439"}
Sep 07 04:15:02.840600 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:02.840574    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29812575-2tsb4"
Sep 07 04:15:02.886423 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:02.886402    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-b8cea6-29812575-5n6cc"
Sep 07 04:15:02.889749 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:02.889730    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-434d57-29812575-48tjb"
Sep 07 04:15:03.701555 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:03.701525    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-434d57-29812575-48tjb"
Sep 07 04:15:03.701747 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:03.701556    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-434d57-29812575-48tjb" event={"ID":"d7e41df0-6946-4305-baa3-1227205f798f","Type":"ContainerDied","Data":"f0c326d5edebf13668400e9f60d2d8f9cbfce3ce946c5064681886a6f370e352"}
Sep 07 04:15:03.701747 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:03.701607    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f0c326d5edebf13668400e9f60d2d8f9cbfce3ce946c5064681886a6f370e352"
Sep 07 04:15:03.702931 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:03.702909    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-b8cea6-29812575-5n6cc"
Sep 07 04:15:03.703051 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:03.702949    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-b8cea6-29812575-5n6cc" event={"ID":"d288732d-8916-4510-9c11-d037ff9f3c3a","Type":"ContainerDied","Data":"849fef8b7fbcaca237400a5581098a0ee3d494a60ed8190b51db43771e504316"}
Sep 07 04:15:03.703051 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:03.702991    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="849fef8b7fbcaca237400a5581098a0ee3d494a60ed8190b51db43771e504316"
Sep 07 04:15:03.704556 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:03.704536    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29812575-2tsb4" event={"ID":"239c959f-cf1c-4a67-8ba0-c21b07da1248","Type":"ContainerDied","Data":"4b489f50c0eee4026f8ad85cc2d7817c6bb84abde4c6f32f76a4b5bff7589f0a"}
Sep 07 04:15:03.704650 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:03.704571    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4b489f50c0eee4026f8ad85cc2d7817c6bb84abde4c6f32f76a4b5bff7589f0a"
Sep 07 04:15:03.704650 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:03.704540    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29812575-2tsb4"
Sep 07 04:15:30.035529 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:30.035487    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-704b16-7949z"]
Sep 07 04:15:30.035926 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:30.035911    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d288732d-8916-4510-9c11-d037ff9f3c3a" containerName="cleanup"
Sep 07 04:15:30.035984 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:30.035929    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d288732d-8916-4510-9c11-d037ff9f3c3a" containerName="cleanup"
Sep 07 04:15:30.035984 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:30.035952    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7e41df0-6946-4305-baa3-1227205f798f" containerName="cleanup"
Sep 07 04:15:30.035984 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:30.035958    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7e41df0-6946-4305-baa3-1227205f798f" containerName="cleanup"
Sep 07 04:15:30.035984 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:30.035972    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="239c959f-cf1c-4a67-8ba0-c21b07da1248" containerName="cleanup"
Sep 07 04:15:30.035984 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:30.035977    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="239c959f-cf1c-4a67-8ba0-c21b07da1248" containerName="cleanup"
Sep 07 04:15:30.036139 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:30.036049    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="239c959f-cf1c-4a67-8ba0-c21b07da1248" containerName="cleanup"
Sep 07 04:15:30.036139 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:30.036059    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7e41df0-6946-4305-baa3-1227205f798f" containerName="cleanup"
Sep 07 04:15:30.036139 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:30.036067    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d288732d-8916-4510-9c11-d037ff9f3c3a" containerName="cleanup"
Sep 07 04:15:30.038841 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:30.038825    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-704b16-7949z"
Sep 07 04:15:30.040767 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:30.040734    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 07 04:15:30.040883 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:30.040781    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zs4ff\""
Sep 07 04:15:30.045534 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:30.045515    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-704b16-7949z"]
Sep 07 04:15:30.088555 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:30.088520    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f8137e2-8715-4bc6-810d-53a82f8aafcc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-704b16-7949z\" (UID: \"0f8137e2-8715-4bc6-810d-53a82f8aafcc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-704b16-7949z"
Sep 07 04:15:30.189603 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:30.189574    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f8137e2-8715-4bc6-810d-53a82f8aafcc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-704b16-7949z\" (UID: \"0f8137e2-8715-4bc6-810d-53a82f8aafcc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-704b16-7949z"
Sep 07 04:15:30.190160 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:30.190141    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f8137e2-8715-4bc6-810d-53a82f8aafcc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-704b16-7949z\" (UID: \"0f8137e2-8715-4bc6-810d-53a82f8aafcc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-704b16-7949z"
Sep 07 04:15:30.351921 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:30.351840    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-704b16-7949z"
Sep 07 04:15:30.623246 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:30.623221    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-704b16-7949z"]
Sep 07 04:15:30.624401 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:15:30.624373    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f8137e2_8715_4bc6_810d_53a82f8aafcc.slice/crio-680c4df2072c49c9405e012afeb65fee410812e4da68c71ec83f321b42b1b942 WatchSource:0}: Error finding container 680c4df2072c49c9405e012afeb65fee410812e4da68c71ec83f321b42b1b942: Status 404 returned error can't find the container with id 680c4df2072c49c9405e012afeb65fee410812e4da68c71ec83f321b42b1b942
Sep 07 04:15:30.873730 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:30.873665    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-704b16-7949z" event={"ID":"0f8137e2-8715-4bc6-810d-53a82f8aafcc","Type":"ContainerStarted","Data":"680c4df2072c49c9405e012afeb65fee410812e4da68c71ec83f321b42b1b942"}
Sep 07 04:15:31.880777 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:31.880739    2559 generic.go:356] "Generic (PLEG): container finished" podID="0f8137e2-8715-4bc6-810d-53a82f8aafcc" containerID="41cee2351f69a60a314bdeb7e4398298227902e2e859462c57c4614198811c5a" exitCode=0
Sep 07 04:15:31.881206 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:31.880805    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-704b16-7949z" event={"ID":"0f8137e2-8715-4bc6-810d-53a82f8aafcc","Type":"ContainerDied","Data":"41cee2351f69a60a314bdeb7e4398298227902e2e859462c57c4614198811c5a"}
Sep 07 04:15:33.020308 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:33.020277    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-704b16-7949z"
Sep 07 04:15:33.118697 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:33.118652    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f8137e2-8715-4bc6-810d-53a82f8aafcc-maas-api-service-ca\") pod \"0f8137e2-8715-4bc6-810d-53a82f8aafcc\" (UID: \"0f8137e2-8715-4bc6-810d-53a82f8aafcc\") "
Sep 07 04:15:33.119017 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:33.118992    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f8137e2-8715-4bc6-810d-53a82f8aafcc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0f8137e2-8715-4bc6-810d-53a82f8aafcc" (UID: "0f8137e2-8715-4bc6-810d-53a82f8aafcc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 04:15:33.220405 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:33.220367    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f8137e2-8715-4bc6-810d-53a82f8aafcc-maas-api-service-ca\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:15:33.893945 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:33.893913    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-704b16-7949z"
Sep 07 04:15:33.894138 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:33.893962    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-704b16-7949z" event={"ID":"0f8137e2-8715-4bc6-810d-53a82f8aafcc","Type":"ContainerDied","Data":"680c4df2072c49c9405e012afeb65fee410812e4da68c71ec83f321b42b1b942"}
Sep 07 04:15:33.894138 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:33.894003    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="680c4df2072c49c9405e012afeb65fee410812e4da68c71ec83f321b42b1b942"
Sep 07 04:15:40.822054 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:40.822023    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-704b16-6d5db56675-fzc94"]
Sep 07 04:15:40.822539 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:40.822228    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-704b16-6d5db56675-fzc94" podUID="c78183ad-45e9-40ff-8133-b9ecf70ad8c9" containerName="payload-processing" containerID="cri-o://8af1f42d1b423d63858976531eb5674824ab86116126c1bcff72345544f5373b" gracePeriod=30
Sep 07 04:15:40.952600 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:40.952563    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-704b16-7949z"]
Sep 07 04:15:40.955127 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:40.955103    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-704b16-7949z"]
Sep 07 04:15:41.082645 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:41.082570    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-704b16-6d5db56675-fzc94"
Sep 07 04:15:41.179609 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:41.179579    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f8137e2-8715-4bc6-810d-53a82f8aafcc" path="/var/lib/kubelet/pods/0f8137e2-8715-4bc6-810d-53a82f8aafcc/volumes"
Sep 07 04:15:41.189676 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:41.189655    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c78183ad-45e9-40ff-8133-b9ecf70ad8c9-plugins-config-volume\") pod \"c78183ad-45e9-40ff-8133-b9ecf70ad8c9\" (UID: \"c78183ad-45e9-40ff-8133-b9ecf70ad8c9\") "
Sep 07 04:15:41.189741 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:41.189689    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bbg97\" (UniqueName: \"kubernetes.io/projected/c78183ad-45e9-40ff-8133-b9ecf70ad8c9-kube-api-access-bbg97\") pod \"c78183ad-45e9-40ff-8133-b9ecf70ad8c9\" (UID: \"c78183ad-45e9-40ff-8133-b9ecf70ad8c9\") "
Sep 07 04:15:41.190024 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:41.189999    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c78183ad-45e9-40ff-8133-b9ecf70ad8c9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c78183ad-45e9-40ff-8133-b9ecf70ad8c9" (UID: "c78183ad-45e9-40ff-8133-b9ecf70ad8c9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 04:15:41.191745 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:41.191723    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c78183ad-45e9-40ff-8133-b9ecf70ad8c9-kube-api-access-bbg97" (OuterVolumeSpecName: "kube-api-access-bbg97") pod "c78183ad-45e9-40ff-8133-b9ecf70ad8c9" (UID: "c78183ad-45e9-40ff-8133-b9ecf70ad8c9"). InnerVolumeSpecName "kube-api-access-bbg97". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 04:15:41.290252 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:41.290229    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c78183ad-45e9-40ff-8133-b9ecf70ad8c9-plugins-config-volume\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:15:41.290252 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:41.290248    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bbg97\" (UniqueName: \"kubernetes.io/projected/c78183ad-45e9-40ff-8133-b9ecf70ad8c9-kube-api-access-bbg97\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:15:41.941753 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:41.941717    2559 generic.go:356] "Generic (PLEG): container finished" podID="c78183ad-45e9-40ff-8133-b9ecf70ad8c9" containerID="8af1f42d1b423d63858976531eb5674824ab86116126c1bcff72345544f5373b" exitCode=0
Sep 07 04:15:41.942155 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:41.941779    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-704b16-6d5db56675-fzc94"
Sep 07 04:15:41.942155 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:41.941807    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-704b16-6d5db56675-fzc94" event={"ID":"c78183ad-45e9-40ff-8133-b9ecf70ad8c9","Type":"ContainerDied","Data":"8af1f42d1b423d63858976531eb5674824ab86116126c1bcff72345544f5373b"}
Sep 07 04:15:41.942155 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:41.941892    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-704b16-6d5db56675-fzc94" event={"ID":"c78183ad-45e9-40ff-8133-b9ecf70ad8c9","Type":"ContainerDied","Data":"5b7cfa2cbb8760bc1dbae77066426abecc9e67af9aba988a7f892beca6718187"}
Sep 07 04:15:41.942155 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:41.941916    2559 scope.go:117] "RemoveContainer" containerID="8af1f42d1b423d63858976531eb5674824ab86116126c1bcff72345544f5373b"
Sep 07 04:15:41.951865 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:41.951845    2559 scope.go:117] "RemoveContainer" containerID="8af1f42d1b423d63858976531eb5674824ab86116126c1bcff72345544f5373b"
Sep 07 04:15:41.952152 ip-10-0-132-4 kubenswrapper[2559]: E0907 04:15:41.952130    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8af1f42d1b423d63858976531eb5674824ab86116126c1bcff72345544f5373b\": container with ID starting with 8af1f42d1b423d63858976531eb5674824ab86116126c1bcff72345544f5373b not found: ID does not exist" containerID="8af1f42d1b423d63858976531eb5674824ab86116126c1bcff72345544f5373b"
Sep 07 04:15:41.952220 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:41.952161    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8af1f42d1b423d63858976531eb5674824ab86116126c1bcff72345544f5373b"} err="failed to get container status \"8af1f42d1b423d63858976531eb5674824ab86116126c1bcff72345544f5373b\": rpc error: code = NotFound desc = could not find container \"8af1f42d1b423d63858976531eb5674824ab86116126c1bcff72345544f5373b\": container with ID starting with 8af1f42d1b423d63858976531eb5674824ab86116126c1bcff72345544f5373b not found: ID does not exist"
Sep 07 04:15:41.962588 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:41.962561    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-704b16-6d5db56675-fzc94"]
Sep 07 04:15:41.965023 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:41.965001    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-704b16-6d5db56675-fzc94"]
Sep 07 04:15:43.179695 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:43.179662    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c78183ad-45e9-40ff-8133-b9ecf70ad8c9" path="/var/lib/kubelet/pods/c78183ad-45e9-40ff-8133-b9ecf70ad8c9/volumes"
Sep 07 04:15:47.324374 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:47.324339    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg"]
Sep 07 04:15:47.324802 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:47.324584    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg" podUID="a26fe4a2-90a7-4433-9142-4a263ae02a3a" containerName="istio-proxy" containerID="cri-o://9cdf6b9f023ff315103fae562924e73c3c65de1d937e008e3df18b7014a88228" gracePeriod=30
Sep 07 04:15:47.707135 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:47.707096    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-b8cea6-4fwvh"]
Sep 07 04:15:47.707471 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:47.707457    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c78183ad-45e9-40ff-8133-b9ecf70ad8c9" containerName="payload-processing"
Sep 07 04:15:47.707517 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:47.707472    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c78183ad-45e9-40ff-8133-b9ecf70ad8c9" containerName="payload-processing"
Sep 07 04:15:47.707517 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:47.707480    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f8137e2-8715-4bc6-810d-53a82f8aafcc" containerName="revoke-keys"
Sep 07 04:15:47.707517 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:47.707486    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f8137e2-8715-4bc6-810d-53a82f8aafcc" containerName="revoke-keys"
Sep 07 04:15:47.707643 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:47.707559    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f8137e2-8715-4bc6-810d-53a82f8aafcc" containerName="revoke-keys"
Sep 07 04:15:47.707643 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:47.707568    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c78183ad-45e9-40ff-8133-b9ecf70ad8c9" containerName="payload-processing"
Sep 07 04:15:47.712045 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:47.712024    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-b8cea6-4fwvh"
Sep 07 04:15:47.714382 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:47.714358    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 07 04:15:47.714491 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:47.714385    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zs4ff\""
Sep 07 04:15:47.718181 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:47.718157    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-b8cea6-4fwvh"]
Sep 07 04:15:47.845309 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:47.845280    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/41fcc067-1d9b-4004-9eb9-a106d2242ddf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-b8cea6-4fwvh\" (UID: \"41fcc067-1d9b-4004-9eb9-a106d2242ddf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-b8cea6-4fwvh"
Sep 07 04:15:47.946055 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:47.946014    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/41fcc067-1d9b-4004-9eb9-a106d2242ddf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-b8cea6-4fwvh\" (UID: \"41fcc067-1d9b-4004-9eb9-a106d2242ddf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-b8cea6-4fwvh"
Sep 07 04:15:47.946716 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:47.946691    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/41fcc067-1d9b-4004-9eb9-a106d2242ddf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-b8cea6-4fwvh\" (UID: \"41fcc067-1d9b-4004-9eb9-a106d2242ddf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-b8cea6-4fwvh"
Sep 07 04:15:48.023639 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:48.023562    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-b8cea6-4fwvh"
Sep 07 04:15:48.292640 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:48.292597    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-b8cea6-4fwvh"]
Sep 07 04:15:48.294970 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:15:48.294944    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41fcc067_1d9b_4004_9eb9_a106d2242ddf.slice/crio-0807a67c3ef724b54b406f82aeecd7f1a320c7526a580b29ecc03518852f7d09 WatchSource:0}: Error finding container 0807a67c3ef724b54b406f82aeecd7f1a320c7526a580b29ecc03518852f7d09: Status 404 returned error can't find the container with id 0807a67c3ef724b54b406f82aeecd7f1a320c7526a580b29ecc03518852f7d09
Sep 07 04:15:48.986796 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:48.986761    2559 generic.go:356] "Generic (PLEG): container finished" podID="41fcc067-1d9b-4004-9eb9-a106d2242ddf" containerID="e2c98e7fbbddb48e17323db4c1f7e5cce5a7adea2440530b4dae787f178febcb" exitCode=0
Sep 07 04:15:48.987118 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:48.986816    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-b8cea6-4fwvh" event={"ID":"41fcc067-1d9b-4004-9eb9-a106d2242ddf","Type":"ContainerDied","Data":"e2c98e7fbbddb48e17323db4c1f7e5cce5a7adea2440530b4dae787f178febcb"}
Sep 07 04:15:48.987118 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:48.986867    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-b8cea6-4fwvh" event={"ID":"41fcc067-1d9b-4004-9eb9-a106d2242ddf","Type":"ContainerStarted","Data":"0807a67c3ef724b54b406f82aeecd7f1a320c7526a580b29ecc03518852f7d09"}
Sep 07 04:15:50.126841 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:50.126817    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-b8cea6-4fwvh"
Sep 07 04:15:50.265447 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:50.265387    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/41fcc067-1d9b-4004-9eb9-a106d2242ddf-maas-api-service-ca\") pod \"41fcc067-1d9b-4004-9eb9-a106d2242ddf\" (UID: \"41fcc067-1d9b-4004-9eb9-a106d2242ddf\") "
Sep 07 04:15:50.265746 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:50.265723    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41fcc067-1d9b-4004-9eb9-a106d2242ddf-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "41fcc067-1d9b-4004-9eb9-a106d2242ddf" (UID: "41fcc067-1d9b-4004-9eb9-a106d2242ddf"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 04:15:50.367036 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:50.367012    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/41fcc067-1d9b-4004-9eb9-a106d2242ddf-maas-api-service-ca\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:15:51.002701 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:51.002677    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-b8cea6-4fwvh"
Sep 07 04:15:51.002833 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:51.002697    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-b8cea6-4fwvh" event={"ID":"41fcc067-1d9b-4004-9eb9-a106d2242ddf","Type":"ContainerDied","Data":"0807a67c3ef724b54b406f82aeecd7f1a320c7526a580b29ecc03518852f7d09"}
Sep 07 04:15:51.002833 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:51.002757    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0807a67c3ef724b54b406f82aeecd7f1a320c7526a580b29ecc03518852f7d09"
Sep 07 04:15:52.581526 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:52.581504    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg"
Sep 07 04:15:52.688305 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:52.688281    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a26fe4a2-90a7-4433-9142-4a263ae02a3a-istio-token\") pod \"a26fe4a2-90a7-4433-9142-4a263ae02a3a\" (UID: \"a26fe4a2-90a7-4433-9142-4a263ae02a3a\") "
Sep 07 04:15:52.688435 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:52.688314    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a26fe4a2-90a7-4433-9142-4a263ae02a3a-istiod-ca-cert\") pod \"a26fe4a2-90a7-4433-9142-4a263ae02a3a\" (UID: \"a26fe4a2-90a7-4433-9142-4a263ae02a3a\") "
Sep 07 04:15:52.688435 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:52.688339    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a26fe4a2-90a7-4433-9142-4a263ae02a3a-istio-podinfo\") pod \"a26fe4a2-90a7-4433-9142-4a263ae02a3a\" (UID: \"a26fe4a2-90a7-4433-9142-4a263ae02a3a\") "
Sep 07 04:15:52.688435 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:52.688367    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a26fe4a2-90a7-4433-9142-4a263ae02a3a-istio-envoy\") pod \"a26fe4a2-90a7-4433-9142-4a263ae02a3a\" (UID: \"a26fe4a2-90a7-4433-9142-4a263ae02a3a\") "
Sep 07 04:15:52.688588 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:52.688441    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a26fe4a2-90a7-4433-9142-4a263ae02a3a-istio-data\") pod \"a26fe4a2-90a7-4433-9142-4a263ae02a3a\" (UID: \"a26fe4a2-90a7-4433-9142-4a263ae02a3a\") "
Sep 07 04:15:52.688588 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:52.688465    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a26fe4a2-90a7-4433-9142-4a263ae02a3a-workload-certs\") pod \"a26fe4a2-90a7-4433-9142-4a263ae02a3a\" (UID: \"a26fe4a2-90a7-4433-9142-4a263ae02a3a\") "
Sep 07 04:15:52.688588 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:52.688510    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrwht\" (UniqueName: \"kubernetes.io/projected/a26fe4a2-90a7-4433-9142-4a263ae02a3a-kube-api-access-zrwht\") pod \"a26fe4a2-90a7-4433-9142-4a263ae02a3a\" (UID: \"a26fe4a2-90a7-4433-9142-4a263ae02a3a\") "
Sep 07 04:15:52.688588 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:52.688542    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a26fe4a2-90a7-4433-9142-4a263ae02a3a-workload-socket\") pod \"a26fe4a2-90a7-4433-9142-4a263ae02a3a\" (UID: \"a26fe4a2-90a7-4433-9142-4a263ae02a3a\") "
Sep 07 04:15:52.688836 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:52.688592    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a26fe4a2-90a7-4433-9142-4a263ae02a3a-credential-socket\") pod \"a26fe4a2-90a7-4433-9142-4a263ae02a3a\" (UID: \"a26fe4a2-90a7-4433-9142-4a263ae02a3a\") "
Sep 07 04:15:52.688836 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:52.688777    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a26fe4a2-90a7-4433-9142-4a263ae02a3a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a26fe4a2-90a7-4433-9142-4a263ae02a3a" (UID: "a26fe4a2-90a7-4433-9142-4a263ae02a3a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:15:52.688836 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:52.688701    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a26fe4a2-90a7-4433-9142-4a263ae02a3a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a26fe4a2-90a7-4433-9142-4a263ae02a3a" (UID: "a26fe4a2-90a7-4433-9142-4a263ae02a3a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 04:15:52.688836 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:52.688800    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a26fe4a2-90a7-4433-9142-4a263ae02a3a-istio-data" (OuterVolumeSpecName: "istio-data") pod "a26fe4a2-90a7-4433-9142-4a263ae02a3a" (UID: "a26fe4a2-90a7-4433-9142-4a263ae02a3a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:15:52.689130 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:52.689001    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a26fe4a2-90a7-4433-9142-4a263ae02a3a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a26fe4a2-90a7-4433-9142-4a263ae02a3a" (UID: "a26fe4a2-90a7-4433-9142-4a263ae02a3a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:15:52.689130 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:52.689016    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a26fe4a2-90a7-4433-9142-4a263ae02a3a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a26fe4a2-90a7-4433-9142-4a263ae02a3a" (UID: "a26fe4a2-90a7-4433-9142-4a263ae02a3a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:15:52.689130 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:52.689113    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a26fe4a2-90a7-4433-9142-4a263ae02a3a-istiod-ca-cert\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:15:52.689298 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:52.689133    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a26fe4a2-90a7-4433-9142-4a263ae02a3a-istio-data\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:15:52.689298 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:52.689146    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a26fe4a2-90a7-4433-9142-4a263ae02a3a-workload-certs\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:15:52.689298 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:52.689161    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a26fe4a2-90a7-4433-9142-4a263ae02a3a-credential-socket\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:15:52.690602 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:52.690570    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a26fe4a2-90a7-4433-9142-4a263ae02a3a-istio-token" (OuterVolumeSpecName: "istio-token") pod "a26fe4a2-90a7-4433-9142-4a263ae02a3a" (UID: "a26fe4a2-90a7-4433-9142-4a263ae02a3a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 04:15:52.690718 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:52.690616    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a26fe4a2-90a7-4433-9142-4a263ae02a3a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a26fe4a2-90a7-4433-9142-4a263ae02a3a" (UID: "a26fe4a2-90a7-4433-9142-4a263ae02a3a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:15:52.690718 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:52.690641    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a26fe4a2-90a7-4433-9142-4a263ae02a3a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a26fe4a2-90a7-4433-9142-4a263ae02a3a" (UID: "a26fe4a2-90a7-4433-9142-4a263ae02a3a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 04:15:52.690718 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:52.690706    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a26fe4a2-90a7-4433-9142-4a263ae02a3a-kube-api-access-zrwht" (OuterVolumeSpecName: "kube-api-access-zrwht") pod "a26fe4a2-90a7-4433-9142-4a263ae02a3a" (UID: "a26fe4a2-90a7-4433-9142-4a263ae02a3a"). InnerVolumeSpecName "kube-api-access-zrwht". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 04:15:52.790389 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:52.790367    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrwht\" (UniqueName: \"kubernetes.io/projected/a26fe4a2-90a7-4433-9142-4a263ae02a3a-kube-api-access-zrwht\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:15:52.790389 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:52.790387    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a26fe4a2-90a7-4433-9142-4a263ae02a3a-workload-socket\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:15:52.790528 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:52.790396    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a26fe4a2-90a7-4433-9142-4a263ae02a3a-istio-token\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:15:52.790528 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:52.790416    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a26fe4a2-90a7-4433-9142-4a263ae02a3a-istio-podinfo\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:15:52.790528 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:52.790425    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a26fe4a2-90a7-4433-9142-4a263ae02a3a-istio-envoy\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:15:53.016778 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:53.016709    2559 generic.go:356] "Generic (PLEG): container finished" podID="a26fe4a2-90a7-4433-9142-4a263ae02a3a" containerID="9cdf6b9f023ff315103fae562924e73c3c65de1d937e008e3df18b7014a88228" exitCode=0
Sep 07 04:15:53.016898 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:53.016784    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg"
Sep 07 04:15:53.016898 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:53.016796    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg" event={"ID":"a26fe4a2-90a7-4433-9142-4a263ae02a3a","Type":"ContainerDied","Data":"9cdf6b9f023ff315103fae562924e73c3c65de1d937e008e3df18b7014a88228"}
Sep 07 04:15:53.016898 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:53.016855    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg" event={"ID":"a26fe4a2-90a7-4433-9142-4a263ae02a3a","Type":"ContainerDied","Data":"7471b8608006cb943358d6a6683befa0f5df79331c990843d283bde0376213cb"}
Sep 07 04:15:53.016898 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:53.016878    2559 scope.go:117] "RemoveContainer" containerID="9cdf6b9f023ff315103fae562924e73c3c65de1d937e008e3df18b7014a88228"
Sep 07 04:15:53.027040 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:53.027013    2559 scope.go:117] "RemoveContainer" containerID="0e0b8085ad9e8b15164e234c4dce7e698b2836ba06236f3e1f9391c1a485cd8c"
Sep 07 04:15:53.040156 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:53.040137    2559 scope.go:117] "RemoveContainer" containerID="9cdf6b9f023ff315103fae562924e73c3c65de1d937e008e3df18b7014a88228"
Sep 07 04:15:53.040364 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:53.040349    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg"]
Sep 07 04:15:53.040430 ip-10-0-132-4 kubenswrapper[2559]: E0907 04:15:53.040413    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9cdf6b9f023ff315103fae562924e73c3c65de1d937e008e3df18b7014a88228\": container with ID starting with 9cdf6b9f023ff315103fae562924e73c3c65de1d937e008e3df18b7014a88228 not found: ID does not exist" containerID="9cdf6b9f023ff315103fae562924e73c3c65de1d937e008e3df18b7014a88228"
Sep 07 04:15:53.040474 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:53.040439    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cdf6b9f023ff315103fae562924e73c3c65de1d937e008e3df18b7014a88228"} err="failed to get container status \"9cdf6b9f023ff315103fae562924e73c3c65de1d937e008e3df18b7014a88228\": rpc error: code = NotFound desc = could not find container \"9cdf6b9f023ff315103fae562924e73c3c65de1d937e008e3df18b7014a88228\": container with ID starting with 9cdf6b9f023ff315103fae562924e73c3c65de1d937e008e3df18b7014a88228 not found: ID does not exist"
Sep 07 04:15:53.040474 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:53.040459    2559 scope.go:117] "RemoveContainer" containerID="0e0b8085ad9e8b15164e234c4dce7e698b2836ba06236f3e1f9391c1a485cd8c"
Sep 07 04:15:53.040783 ip-10-0-132-4 kubenswrapper[2559]: E0907 04:15:53.040755    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e0b8085ad9e8b15164e234c4dce7e698b2836ba06236f3e1f9391c1a485cd8c\": container with ID starting with 0e0b8085ad9e8b15164e234c4dce7e698b2836ba06236f3e1f9391c1a485cd8c not found: ID does not exist" containerID="0e0b8085ad9e8b15164e234c4dce7e698b2836ba06236f3e1f9391c1a485cd8c"
Sep 07 04:15:53.040856 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:53.040793    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e0b8085ad9e8b15164e234c4dce7e698b2836ba06236f3e1f9391c1a485cd8c"} err="failed to get container status \"0e0b8085ad9e8b15164e234c4dce7e698b2836ba06236f3e1f9391c1a485cd8c\": rpc error: code = NotFound desc = could not find container \"0e0b8085ad9e8b15164e234c4dce7e698b2836ba06236f3e1f9391c1a485cd8c\": container with ID starting with 0e0b8085ad9e8b15164e234c4dce7e698b2836ba06236f3e1f9391c1a485cd8c not found: ID does not exist"
Sep 07 04:15:53.043055 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:53.043035    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg"]
Sep 07 04:15:53.179198 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:53.179175    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a26fe4a2-90a7-4433-9142-4a263ae02a3a" path="/var/lib/kubelet/pods/a26fe4a2-90a7-4433-9142-4a263ae02a3a/volumes"
Sep 07 04:15:58.072374 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:58.072341    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-b8cea6-29812575-5n6cc"]
Sep 07 04:15:58.074801 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:58.074773    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-b8cea6-29812575-5n6cc"]
Sep 07 04:15:58.105995 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:58.105967    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b8cea6-bb446469d-plrnx"]
Sep 07 04:15:58.106279 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:58.106250    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b8cea6-bb446469d-plrnx" podUID="5186ad4d-b681-45df-83a6-914812141a1f" containerName="payload-pre-processing" containerID="cri-o://f350315486154edf015974ef0fd6fd47ed5bb57739a51ea2370897967ca0b844" gracePeriod=30
Sep 07 04:15:58.239276 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:58.239248    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-b8cea6-4fwvh"]
Sep 07 04:15:58.241760 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:58.241739    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-b8cea6-4fwvh"]
Sep 07 04:15:58.357785 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:58.357762    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b8cea6-bb446469d-plrnx"
Sep 07 04:15:58.539733 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:58.539704    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8xv4l\" (UniqueName: \"kubernetes.io/projected/5186ad4d-b681-45df-83a6-914812141a1f-kube-api-access-8xv4l\") pod \"5186ad4d-b681-45df-83a6-914812141a1f\" (UID: \"5186ad4d-b681-45df-83a6-914812141a1f\") "
Sep 07 04:15:58.539895 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:58.539772    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5186ad4d-b681-45df-83a6-914812141a1f-plugins-config-volume\") pod \"5186ad4d-b681-45df-83a6-914812141a1f\" (UID: \"5186ad4d-b681-45df-83a6-914812141a1f\") "
Sep 07 04:15:58.540158 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:58.540132    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5186ad4d-b681-45df-83a6-914812141a1f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5186ad4d-b681-45df-83a6-914812141a1f" (UID: "5186ad4d-b681-45df-83a6-914812141a1f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 04:15:58.541763 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:58.541736    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5186ad4d-b681-45df-83a6-914812141a1f-kube-api-access-8xv4l" (OuterVolumeSpecName: "kube-api-access-8xv4l") pod "5186ad4d-b681-45df-83a6-914812141a1f" (UID: "5186ad4d-b681-45df-83a6-914812141a1f"). InnerVolumeSpecName "kube-api-access-8xv4l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 04:15:58.640812 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:58.640785    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xv4l\" (UniqueName: \"kubernetes.io/projected/5186ad4d-b681-45df-83a6-914812141a1f-kube-api-access-8xv4l\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:15:58.640914 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:58.640821    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5186ad4d-b681-45df-83a6-914812141a1f-plugins-config-volume\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:15:59.057246 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:59.057164    2559 generic.go:356] "Generic (PLEG): container finished" podID="5186ad4d-b681-45df-83a6-914812141a1f" containerID="f350315486154edf015974ef0fd6fd47ed5bb57739a51ea2370897967ca0b844" exitCode=0
Sep 07 04:15:59.057246 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:59.057214    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b8cea6-bb446469d-plrnx"
Sep 07 04:15:59.057427 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:59.057251    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b8cea6-bb446469d-plrnx" event={"ID":"5186ad4d-b681-45df-83a6-914812141a1f","Type":"ContainerDied","Data":"f350315486154edf015974ef0fd6fd47ed5bb57739a51ea2370897967ca0b844"}
Sep 07 04:15:59.057427 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:59.057311    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b8cea6-bb446469d-plrnx" event={"ID":"5186ad4d-b681-45df-83a6-914812141a1f","Type":"ContainerDied","Data":"6a148d8ddcd1fbdf969c674ab0825862cddbb0e9ea7b8400dace1de421e5aaae"}
Sep 07 04:15:59.057427 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:59.057336    2559 scope.go:117] "RemoveContainer" containerID="f350315486154edf015974ef0fd6fd47ed5bb57739a51ea2370897967ca0b844"
Sep 07 04:15:59.067458 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:59.067435    2559 scope.go:117] "RemoveContainer" containerID="f350315486154edf015974ef0fd6fd47ed5bb57739a51ea2370897967ca0b844"
Sep 07 04:15:59.067768 ip-10-0-132-4 kubenswrapper[2559]: E0907 04:15:59.067749    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f350315486154edf015974ef0fd6fd47ed5bb57739a51ea2370897967ca0b844\": container with ID starting with f350315486154edf015974ef0fd6fd47ed5bb57739a51ea2370897967ca0b844 not found: ID does not exist" containerID="f350315486154edf015974ef0fd6fd47ed5bb57739a51ea2370897967ca0b844"
Sep 07 04:15:59.067837 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:59.067777    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f350315486154edf015974ef0fd6fd47ed5bb57739a51ea2370897967ca0b844"} err="failed to get container status \"f350315486154edf015974ef0fd6fd47ed5bb57739a51ea2370897967ca0b844\": rpc error: code = NotFound desc = could not find container \"f350315486154edf015974ef0fd6fd47ed5bb57739a51ea2370897967ca0b844\": container with ID starting with f350315486154edf015974ef0fd6fd47ed5bb57739a51ea2370897967ca0b844 not found: ID does not exist"
Sep 07 04:15:59.077865 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:59.077844    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b8cea6-bb446469d-plrnx"]
Sep 07 04:15:59.083409 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:59.083386    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b8cea6-bb446469d-plrnx"]
Sep 07 04:15:59.178944 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:59.178920    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41fcc067-1d9b-4004-9eb9-a106d2242ddf" path="/var/lib/kubelet/pods/41fcc067-1d9b-4004-9eb9-a106d2242ddf/volumes"
Sep 07 04:15:59.179268 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:59.179255    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5186ad4d-b681-45df-83a6-914812141a1f" path="/var/lib/kubelet/pods/5186ad4d-b681-45df-83a6-914812141a1f/volumes"
Sep 07 04:15:59.179505 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:15:59.179494    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d288732d-8916-4510-9c11-d037ff9f3c3a" path="/var/lib/kubelet/pods/d288732d-8916-4510-9c11-d037ff9f3c3a/volumes"
Sep 07 04:16:05.183462 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:05.183430    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-434d57-8pnjp"]
Sep 07 04:16:05.183946 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:05.183794    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a26fe4a2-90a7-4433-9142-4a263ae02a3a" containerName="istio-proxy"
Sep 07 04:16:05.183946 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:05.183807    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a26fe4a2-90a7-4433-9142-4a263ae02a3a" containerName="istio-proxy"
Sep 07 04:16:05.183946 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:05.183824    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5186ad4d-b681-45df-83a6-914812141a1f" containerName="payload-pre-processing"
Sep 07 04:16:05.183946 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:05.183831    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5186ad4d-b681-45df-83a6-914812141a1f" containerName="payload-pre-processing"
Sep 07 04:16:05.183946 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:05.183842    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41fcc067-1d9b-4004-9eb9-a106d2242ddf" containerName="revoke-keys"
Sep 07 04:16:05.183946 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:05.183847    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="41fcc067-1d9b-4004-9eb9-a106d2242ddf" containerName="revoke-keys"
Sep 07 04:16:05.183946 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:05.183908    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="41fcc067-1d9b-4004-9eb9-a106d2242ddf" containerName="revoke-keys"
Sep 07 04:16:05.183946 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:05.183918    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5186ad4d-b681-45df-83a6-914812141a1f" containerName="payload-pre-processing"
Sep 07 04:16:05.183946 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:05.183925    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a26fe4a2-90a7-4433-9142-4a263ae02a3a" containerName="istio-proxy"
Sep 07 04:16:05.183946 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:05.183931    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a26fe4a2-90a7-4433-9142-4a263ae02a3a" containerName="istio-proxy"
Sep 07 04:16:05.188509 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:05.188492    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-434d57-8pnjp"
Sep 07 04:16:05.190373 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:05.190345    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f342ecf-96be-4fa4-b207-6fd0766c104d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-434d57-8pnjp\" (UID: \"4f342ecf-96be-4fa4-b207-6fd0766c104d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-434d57-8pnjp"
Sep 07 04:16:05.190848 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:05.190822    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 07 04:16:05.191143 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:05.191119    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zs4ff\""
Sep 07 04:16:05.193688 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:05.193665    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-434d57-8pnjp"]
Sep 07 04:16:05.291471 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:05.291447    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f342ecf-96be-4fa4-b207-6fd0766c104d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-434d57-8pnjp\" (UID: \"4f342ecf-96be-4fa4-b207-6fd0766c104d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-434d57-8pnjp"
Sep 07 04:16:05.292088 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:05.292067    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f342ecf-96be-4fa4-b207-6fd0766c104d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-434d57-8pnjp\" (UID: \"4f342ecf-96be-4fa4-b207-6fd0766c104d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-434d57-8pnjp"
Sep 07 04:16:05.500982 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:05.500905    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-434d57-8pnjp"
Sep 07 04:16:05.771347 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:05.771259    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-434d57-8pnjp"]
Sep 07 04:16:05.793276 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:16:05.793246    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f342ecf_96be_4fa4_b207_6fd0766c104d.slice/crio-0c63bd89aaf1a4c95d724a152a9e5d479681bf6449c510a6a3cad5b902bb7322 WatchSource:0}: Error finding container 0c63bd89aaf1a4c95d724a152a9e5d479681bf6449c510a6a3cad5b902bb7322: Status 404 returned error can't find the container with id 0c63bd89aaf1a4c95d724a152a9e5d479681bf6449c510a6a3cad5b902bb7322
Sep 07 04:16:06.105770 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:06.105734    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-434d57-8pnjp" event={"ID":"4f342ecf-96be-4fa4-b207-6fd0766c104d","Type":"ContainerStarted","Data":"e69700dad402b4d3a707abcb5334647772db552eee8d3eeb9123e184b491d5e1"}
Sep 07 04:16:06.105920 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:06.105787    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-434d57-8pnjp" event={"ID":"4f342ecf-96be-4fa4-b207-6fd0766c104d","Type":"ContainerStarted","Data":"0c63bd89aaf1a4c95d724a152a9e5d479681bf6449c510a6a3cad5b902bb7322"}
Sep 07 04:16:06.119611 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:06.119566    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-434d57-8pnjp" podStartSLOduration=1.119552076 podStartE2EDuration="1.119552076s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:16:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:16:06.117900114 +0000 UTC m=+1669.430376041" watchObservedRunningTime="2026-09-07 04:16:06.119552076 +0000 UTC m=+1669.432027977"
Sep 07 04:16:07.113955 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:07.113916    2559 generic.go:356] "Generic (PLEG): container finished" podID="4f342ecf-96be-4fa4-b207-6fd0766c104d" containerID="e69700dad402b4d3a707abcb5334647772db552eee8d3eeb9123e184b491d5e1" exitCode=0
Sep 07 04:16:07.114331 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:07.114014    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-434d57-8pnjp" event={"ID":"4f342ecf-96be-4fa4-b207-6fd0766c104d","Type":"ContainerDied","Data":"e69700dad402b4d3a707abcb5334647772db552eee8d3eeb9123e184b491d5e1"}
Sep 07 04:16:08.249713 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:08.249686    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-434d57-8pnjp"
Sep 07 04:16:08.324371 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:08.324342    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f342ecf-96be-4fa4-b207-6fd0766c104d-maas-api-service-ca\") pod \"4f342ecf-96be-4fa4-b207-6fd0766c104d\" (UID: \"4f342ecf-96be-4fa4-b207-6fd0766c104d\") "
Sep 07 04:16:08.324729 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:08.324704    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f342ecf-96be-4fa4-b207-6fd0766c104d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4f342ecf-96be-4fa4-b207-6fd0766c104d" (UID: "4f342ecf-96be-4fa4-b207-6fd0766c104d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 04:16:08.425508 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:08.425438    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f342ecf-96be-4fa4-b207-6fd0766c104d-maas-api-service-ca\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:16:09.127427 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:09.127398    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-434d57-8pnjp"
Sep 07 04:16:09.127588 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:09.127437    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-434d57-8pnjp" event={"ID":"4f342ecf-96be-4fa4-b207-6fd0766c104d","Type":"ContainerDied","Data":"0c63bd89aaf1a4c95d724a152a9e5d479681bf6449c510a6a3cad5b902bb7322"}
Sep 07 04:16:09.127588 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:09.127482    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0c63bd89aaf1a4c95d724a152a9e5d479681bf6449c510a6a3cad5b902bb7322"
Sep 07 04:16:15.554356 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:15.554321    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-434d57-29812575-48tjb"]
Sep 07 04:16:15.562123 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:15.562092    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-434d57-29812575-48tjb"]
Sep 07 04:16:15.582561 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:15.582463    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-434d57-85f79bfcd7-db8vt"]
Sep 07 04:16:15.582871 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:15.582785    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-434d57-85f79bfcd7-db8vt" podUID="d74bd906-9379-4eaa-8ca9-ae39a8bd2053" containerName="payload-processing" containerID="cri-o://c02f028aa87bf3ec3ff97454c79e367600d9dfd073f2604905798b6e96f69b58" gracePeriod=30
Sep 07 04:16:15.584699 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:15.584667    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-434d57-6fdf76666-mqqph"]
Sep 07 04:16:15.709557 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:15.709532    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-434d57-8pnjp"]
Sep 07 04:16:15.712768 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:15.712744    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-434d57-8pnjp"]
Sep 07 04:16:15.845112 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:15.845089    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-434d57-85f79bfcd7-db8vt"
Sep 07 04:16:15.883336 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:15.883308    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d74bd906-9379-4eaa-8ca9-ae39a8bd2053-plugins-config-volume\") pod \"d74bd906-9379-4eaa-8ca9-ae39a8bd2053\" (UID: \"d74bd906-9379-4eaa-8ca9-ae39a8bd2053\") "
Sep 07 04:16:15.883454 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:15.883370    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m57qw\" (UniqueName: \"kubernetes.io/projected/d74bd906-9379-4eaa-8ca9-ae39a8bd2053-kube-api-access-m57qw\") pod \"d74bd906-9379-4eaa-8ca9-ae39a8bd2053\" (UID: \"d74bd906-9379-4eaa-8ca9-ae39a8bd2053\") "
Sep 07 04:16:15.883754 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:15.883725    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d74bd906-9379-4eaa-8ca9-ae39a8bd2053-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d74bd906-9379-4eaa-8ca9-ae39a8bd2053" (UID: "d74bd906-9379-4eaa-8ca9-ae39a8bd2053"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 04:16:15.885326 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:15.885305    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d74bd906-9379-4eaa-8ca9-ae39a8bd2053-kube-api-access-m57qw" (OuterVolumeSpecName: "kube-api-access-m57qw") pod "d74bd906-9379-4eaa-8ca9-ae39a8bd2053" (UID: "d74bd906-9379-4eaa-8ca9-ae39a8bd2053"). InnerVolumeSpecName "kube-api-access-m57qw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 04:16:15.985014 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:15.984987    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m57qw\" (UniqueName: \"kubernetes.io/projected/d74bd906-9379-4eaa-8ca9-ae39a8bd2053-kube-api-access-m57qw\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:16:15.985014 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:15.985011    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d74bd906-9379-4eaa-8ca9-ae39a8bd2053-plugins-config-volume\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:16:16.174204 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:16.174175    2559 generic.go:356] "Generic (PLEG): container finished" podID="d74bd906-9379-4eaa-8ca9-ae39a8bd2053" containerID="c02f028aa87bf3ec3ff97454c79e367600d9dfd073f2604905798b6e96f69b58" exitCode=0
Sep 07 04:16:16.174330 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:16.174217    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-434d57-85f79bfcd7-db8vt"
Sep 07 04:16:16.174330 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:16.174261    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-434d57-85f79bfcd7-db8vt" event={"ID":"d74bd906-9379-4eaa-8ca9-ae39a8bd2053","Type":"ContainerDied","Data":"c02f028aa87bf3ec3ff97454c79e367600d9dfd073f2604905798b6e96f69b58"}
Sep 07 04:16:16.174330 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:16.174315    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-434d57-85f79bfcd7-db8vt" event={"ID":"d74bd906-9379-4eaa-8ca9-ae39a8bd2053","Type":"ContainerDied","Data":"6be887c850498b650a9ddcb53e6c947548c4b6e3cc6ecce05ef944946620b16a"}
Sep 07 04:16:16.174477 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:16.174343    2559 scope.go:117] "RemoveContainer" containerID="c02f028aa87bf3ec3ff97454c79e367600d9dfd073f2604905798b6e96f69b58"
Sep 07 04:16:16.174657 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:16.174590    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-434d57-6fdf76666-mqqph" podUID="47aa091c-c557-4839-b6ca-f58d896cbe1b" containerName="payload-pre-processing" containerID="cri-o://4cdd9b1fed4243550c2e22c1c092696ad9e0cef45807b29e13cfebcdec7b9a20" gracePeriod=30
Sep 07 04:16:16.185341 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:16.185320    2559 scope.go:117] "RemoveContainer" containerID="c02f028aa87bf3ec3ff97454c79e367600d9dfd073f2604905798b6e96f69b58"
Sep 07 04:16:16.185682 ip-10-0-132-4 kubenswrapper[2559]: E0907 04:16:16.185661    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c02f028aa87bf3ec3ff97454c79e367600d9dfd073f2604905798b6e96f69b58\": container with ID starting with c02f028aa87bf3ec3ff97454c79e367600d9dfd073f2604905798b6e96f69b58 not found: ID does not exist" containerID="c02f028aa87bf3ec3ff97454c79e367600d9dfd073f2604905798b6e96f69b58"
Sep 07 04:16:16.185751 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:16.185692    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c02f028aa87bf3ec3ff97454c79e367600d9dfd073f2604905798b6e96f69b58"} err="failed to get container status \"c02f028aa87bf3ec3ff97454c79e367600d9dfd073f2604905798b6e96f69b58\": rpc error: code = NotFound desc = could not find container \"c02f028aa87bf3ec3ff97454c79e367600d9dfd073f2604905798b6e96f69b58\": container with ID starting with c02f028aa87bf3ec3ff97454c79e367600d9dfd073f2604905798b6e96f69b58 not found: ID does not exist"
Sep 07 04:16:16.209201 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:16.209174    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-434d57-85f79bfcd7-db8vt"]
Sep 07 04:16:16.218883 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:16.218857    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-434d57-85f79bfcd7-db8vt"]
Sep 07 04:16:16.409246 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:16.409223    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-434d57-6fdf76666-mqqph"
Sep 07 04:16:16.488806 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:16.488742    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vstnm\" (UniqueName: \"kubernetes.io/projected/47aa091c-c557-4839-b6ca-f58d896cbe1b-kube-api-access-vstnm\") pod \"47aa091c-c557-4839-b6ca-f58d896cbe1b\" (UID: \"47aa091c-c557-4839-b6ca-f58d896cbe1b\") "
Sep 07 04:16:16.488806 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:16.488798    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47aa091c-c557-4839-b6ca-f58d896cbe1b-plugins-config-volume\") pod \"47aa091c-c557-4839-b6ca-f58d896cbe1b\" (UID: \"47aa091c-c557-4839-b6ca-f58d896cbe1b\") "
Sep 07 04:16:16.489168 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:16.489141    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47aa091c-c557-4839-b6ca-f58d896cbe1b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "47aa091c-c557-4839-b6ca-f58d896cbe1b" (UID: "47aa091c-c557-4839-b6ca-f58d896cbe1b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 04:16:16.490798 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:16.490777    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47aa091c-c557-4839-b6ca-f58d896cbe1b-kube-api-access-vstnm" (OuterVolumeSpecName: "kube-api-access-vstnm") pod "47aa091c-c557-4839-b6ca-f58d896cbe1b" (UID: "47aa091c-c557-4839-b6ca-f58d896cbe1b"). InnerVolumeSpecName "kube-api-access-vstnm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 04:16:16.589615 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:16.589593    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vstnm\" (UniqueName: \"kubernetes.io/projected/47aa091c-c557-4839-b6ca-f58d896cbe1b-kube-api-access-vstnm\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:16:16.589615 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:16.589613    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47aa091c-c557-4839-b6ca-f58d896cbe1b-plugins-config-volume\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:16:17.179696 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:17.179658    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f342ecf-96be-4fa4-b207-6fd0766c104d" path="/var/lib/kubelet/pods/4f342ecf-96be-4fa4-b207-6fd0766c104d/volumes"
Sep 07 04:16:17.180023 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:17.180009    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d74bd906-9379-4eaa-8ca9-ae39a8bd2053" path="/var/lib/kubelet/pods/d74bd906-9379-4eaa-8ca9-ae39a8bd2053/volumes"
Sep 07 04:16:17.180261 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:17.180247    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7e41df0-6946-4305-baa3-1227205f798f" path="/var/lib/kubelet/pods/d7e41df0-6946-4305-baa3-1227205f798f/volumes"
Sep 07 04:16:17.183515 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:17.183490    2559 generic.go:356] "Generic (PLEG): container finished" podID="47aa091c-c557-4839-b6ca-f58d896cbe1b" containerID="4cdd9b1fed4243550c2e22c1c092696ad9e0cef45807b29e13cfebcdec7b9a20" exitCode=0
Sep 07 04:16:17.183662 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:17.183521    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-434d57-6fdf76666-mqqph" event={"ID":"47aa091c-c557-4839-b6ca-f58d896cbe1b","Type":"ContainerDied","Data":"4cdd9b1fed4243550c2e22c1c092696ad9e0cef45807b29e13cfebcdec7b9a20"}
Sep 07 04:16:17.183662 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:17.183550    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-434d57-6fdf76666-mqqph" event={"ID":"47aa091c-c557-4839-b6ca-f58d896cbe1b","Type":"ContainerDied","Data":"4994594626ca2a2951a5a2f3aed5de6a98bda1c2b39c7dc05869ceeff446d6b2"}
Sep 07 04:16:17.183662 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:17.183548    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-434d57-6fdf76666-mqqph"
Sep 07 04:16:17.183662 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:17.183564    2559 scope.go:117] "RemoveContainer" containerID="4cdd9b1fed4243550c2e22c1c092696ad9e0cef45807b29e13cfebcdec7b9a20"
Sep 07 04:16:17.193361 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:17.193342    2559 scope.go:117] "RemoveContainer" containerID="4cdd9b1fed4243550c2e22c1c092696ad9e0cef45807b29e13cfebcdec7b9a20"
Sep 07 04:16:17.193606 ip-10-0-132-4 kubenswrapper[2559]: E0907 04:16:17.193588    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4cdd9b1fed4243550c2e22c1c092696ad9e0cef45807b29e13cfebcdec7b9a20\": container with ID starting with 4cdd9b1fed4243550c2e22c1c092696ad9e0cef45807b29e13cfebcdec7b9a20 not found: ID does not exist" containerID="4cdd9b1fed4243550c2e22c1c092696ad9e0cef45807b29e13cfebcdec7b9a20"
Sep 07 04:16:17.193691 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:17.193629    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cdd9b1fed4243550c2e22c1c092696ad9e0cef45807b29e13cfebcdec7b9a20"} err="failed to get container status \"4cdd9b1fed4243550c2e22c1c092696ad9e0cef45807b29e13cfebcdec7b9a20\": rpc error: code = NotFound desc = could not find container \"4cdd9b1fed4243550c2e22c1c092696ad9e0cef45807b29e13cfebcdec7b9a20\": container with ID starting with 4cdd9b1fed4243550c2e22c1c092696ad9e0cef45807b29e13cfebcdec7b9a20 not found: ID does not exist"
Sep 07 04:16:17.204370 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:17.204350    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-434d57-6fdf76666-mqqph"]
Sep 07 04:16:17.208133 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:17.208113    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-434d57-6fdf76666-mqqph"]
Sep 07 04:16:19.179384 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:19.179349    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47aa091c-c557-4839-b6ca-f58d896cbe1b" path="/var/lib/kubelet/pods/47aa091c-c557-4839-b6ca-f58d896cbe1b/volumes"
Sep 07 04:16:22.222003 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:22.221965    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj"]
Sep 07 04:16:22.222503 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:22.222235    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj" podUID="77a7cd30-a31b-415b-b454-69ff3c05a42e" containerName="istio-proxy" containerID="cri-o://f01abc945030d1f5551793e364c64eddc79fae0498bb1a8d4de9f5785dad97cf" gracePeriod=30
Sep 07 04:16:27.478604 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:27.478580    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj"
Sep 07 04:16:27.578344 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:27.578285    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77a7cd30-a31b-415b-b454-69ff3c05a42e-workload-socket\") pod \"77a7cd30-a31b-415b-b454-69ff3c05a42e\" (UID: \"77a7cd30-a31b-415b-b454-69ff3c05a42e\") "
Sep 07 04:16:27.578344 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:27.578338    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77a7cd30-a31b-415b-b454-69ff3c05a42e-credential-socket\") pod \"77a7cd30-a31b-415b-b454-69ff3c05a42e\" (UID: \"77a7cd30-a31b-415b-b454-69ff3c05a42e\") "
Sep 07 04:16:27.578495 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:27.578357    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77a7cd30-a31b-415b-b454-69ff3c05a42e-istio-token\") pod \"77a7cd30-a31b-415b-b454-69ff3c05a42e\" (UID: \"77a7cd30-a31b-415b-b454-69ff3c05a42e\") "
Sep 07 04:16:27.578495 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:27.578385    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77a7cd30-a31b-415b-b454-69ff3c05a42e-istio-data\") pod \"77a7cd30-a31b-415b-b454-69ff3c05a42e\" (UID: \"77a7cd30-a31b-415b-b454-69ff3c05a42e\") "
Sep 07 04:16:27.578495 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:27.578399    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77a7cd30-a31b-415b-b454-69ff3c05a42e-workload-certs\") pod \"77a7cd30-a31b-415b-b454-69ff3c05a42e\" (UID: \"77a7cd30-a31b-415b-b454-69ff3c05a42e\") "
Sep 07 04:16:27.578495 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:27.578444    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77a7cd30-a31b-415b-b454-69ff3c05a42e-istiod-ca-cert\") pod \"77a7cd30-a31b-415b-b454-69ff3c05a42e\" (UID: \"77a7cd30-a31b-415b-b454-69ff3c05a42e\") "
Sep 07 04:16:27.578729 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:27.578544    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77a7cd30-a31b-415b-b454-69ff3c05a42e-istio-envoy\") pod \"77a7cd30-a31b-415b-b454-69ff3c05a42e\" (UID: \"77a7cd30-a31b-415b-b454-69ff3c05a42e\") "
Sep 07 04:16:27.578729 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:27.578554    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77a7cd30-a31b-415b-b454-69ff3c05a42e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "77a7cd30-a31b-415b-b454-69ff3c05a42e" (UID: "77a7cd30-a31b-415b-b454-69ff3c05a42e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:16:27.578729 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:27.578573    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77a7cd30-a31b-415b-b454-69ff3c05a42e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "77a7cd30-a31b-415b-b454-69ff3c05a42e" (UID: "77a7cd30-a31b-415b-b454-69ff3c05a42e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:16:27.578729 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:27.578586    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mklg7\" (UniqueName: \"kubernetes.io/projected/77a7cd30-a31b-415b-b454-69ff3c05a42e-kube-api-access-mklg7\") pod \"77a7cd30-a31b-415b-b454-69ff3c05a42e\" (UID: \"77a7cd30-a31b-415b-b454-69ff3c05a42e\") "
Sep 07 04:16:27.578729 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:27.578663    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77a7cd30-a31b-415b-b454-69ff3c05a42e-istio-podinfo\") pod \"77a7cd30-a31b-415b-b454-69ff3c05a42e\" (UID: \"77a7cd30-a31b-415b-b454-69ff3c05a42e\") "
Sep 07 04:16:27.578729 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:27.578693    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77a7cd30-a31b-415b-b454-69ff3c05a42e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "77a7cd30-a31b-415b-b454-69ff3c05a42e" (UID: "77a7cd30-a31b-415b-b454-69ff3c05a42e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:16:27.578729 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:27.578714    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77a7cd30-a31b-415b-b454-69ff3c05a42e-istio-data" (OuterVolumeSpecName: "istio-data") pod "77a7cd30-a31b-415b-b454-69ff3c05a42e" (UID: "77a7cd30-a31b-415b-b454-69ff3c05a42e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:16:27.579074 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:27.578787    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77a7cd30-a31b-415b-b454-69ff3c05a42e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "77a7cd30-a31b-415b-b454-69ff3c05a42e" (UID: "77a7cd30-a31b-415b-b454-69ff3c05a42e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 04:16:27.579074 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:27.578967    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77a7cd30-a31b-415b-b454-69ff3c05a42e-istio-data\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:16:27.579074 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:27.578990    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77a7cd30-a31b-415b-b454-69ff3c05a42e-workload-certs\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:16:27.579074 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:27.579009    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77a7cd30-a31b-415b-b454-69ff3c05a42e-istiod-ca-cert\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:16:27.579074 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:27.579024    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77a7cd30-a31b-415b-b454-69ff3c05a42e-workload-socket\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:16:27.579074 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:27.579038    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77a7cd30-a31b-415b-b454-69ff3c05a42e-credential-socket\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:16:27.580469 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:27.580450    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77a7cd30-a31b-415b-b454-69ff3c05a42e-istio-token" (OuterVolumeSpecName: "istio-token") pod "77a7cd30-a31b-415b-b454-69ff3c05a42e" (UID: "77a7cd30-a31b-415b-b454-69ff3c05a42e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 04:16:27.580667 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:27.580647    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77a7cd30-a31b-415b-b454-69ff3c05a42e-kube-api-access-mklg7" (OuterVolumeSpecName: "kube-api-access-mklg7") pod "77a7cd30-a31b-415b-b454-69ff3c05a42e" (UID: "77a7cd30-a31b-415b-b454-69ff3c05a42e"). InnerVolumeSpecName "kube-api-access-mklg7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 04:16:27.580945 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:27.580920    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/77a7cd30-a31b-415b-b454-69ff3c05a42e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "77a7cd30-a31b-415b-b454-69ff3c05a42e" (UID: "77a7cd30-a31b-415b-b454-69ff3c05a42e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 04:16:27.580945 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:27.580918    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77a7cd30-a31b-415b-b454-69ff3c05a42e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "77a7cd30-a31b-415b-b454-69ff3c05a42e" (UID: "77a7cd30-a31b-415b-b454-69ff3c05a42e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:16:27.679505 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:27.679483    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77a7cd30-a31b-415b-b454-69ff3c05a42e-istio-token\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:16:27.679505 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:27.679505    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77a7cd30-a31b-415b-b454-69ff3c05a42e-istio-envoy\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:16:27.679652 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:27.679515    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mklg7\" (UniqueName: \"kubernetes.io/projected/77a7cd30-a31b-415b-b454-69ff3c05a42e-kube-api-access-mklg7\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:16:27.679652 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:27.679526    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77a7cd30-a31b-415b-b454-69ff3c05a42e-istio-podinfo\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:16:28.253573 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:28.253541    2559 generic.go:356] "Generic (PLEG): container finished" podID="77a7cd30-a31b-415b-b454-69ff3c05a42e" containerID="f01abc945030d1f5551793e364c64eddc79fae0498bb1a8d4de9f5785dad97cf" exitCode=0
Sep 07 04:16:28.253740 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:28.253590    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj"
Sep 07 04:16:28.253740 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:28.253647    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj" event={"ID":"77a7cd30-a31b-415b-b454-69ff3c05a42e","Type":"ContainerDied","Data":"f01abc945030d1f5551793e364c64eddc79fae0498bb1a8d4de9f5785dad97cf"}
Sep 07 04:16:28.253740 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:28.253707    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj" event={"ID":"77a7cd30-a31b-415b-b454-69ff3c05a42e","Type":"ContainerDied","Data":"318998482a265e0815f1953319b189c455e2e46bfcda4b9f04b10a6e5d7de098"}
Sep 07 04:16:28.253740 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:28.253737    2559 scope.go:117] "RemoveContainer" containerID="f01abc945030d1f5551793e364c64eddc79fae0498bb1a8d4de9f5785dad97cf"
Sep 07 04:16:28.264520 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:28.264505    2559 scope.go:117] "RemoveContainer" containerID="33c092d4737e7b1d1423752994434341c5a1c7301b7dab838609cc4d27a72b3f"
Sep 07 04:16:28.274017 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:28.273997    2559 scope.go:117] "RemoveContainer" containerID="f01abc945030d1f5551793e364c64eddc79fae0498bb1a8d4de9f5785dad97cf"
Sep 07 04:16:28.274712 ip-10-0-132-4 kubenswrapper[2559]: E0907 04:16:28.274682    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f01abc945030d1f5551793e364c64eddc79fae0498bb1a8d4de9f5785dad97cf\": container with ID starting with f01abc945030d1f5551793e364c64eddc79fae0498bb1a8d4de9f5785dad97cf not found: ID does not exist" containerID="f01abc945030d1f5551793e364c64eddc79fae0498bb1a8d4de9f5785dad97cf"
Sep 07 04:16:28.274823 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:28.274721    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f01abc945030d1f5551793e364c64eddc79fae0498bb1a8d4de9f5785dad97cf"} err="failed to get container status \"f01abc945030d1f5551793e364c64eddc79fae0498bb1a8d4de9f5785dad97cf\": rpc error: code = NotFound desc = could not find container \"f01abc945030d1f5551793e364c64eddc79fae0498bb1a8d4de9f5785dad97cf\": container with ID starting with f01abc945030d1f5551793e364c64eddc79fae0498bb1a8d4de9f5785dad97cf not found: ID does not exist"
Sep 07 04:16:28.274823 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:28.274745    2559 scope.go:117] "RemoveContainer" containerID="33c092d4737e7b1d1423752994434341c5a1c7301b7dab838609cc4d27a72b3f"
Sep 07 04:16:28.275068 ip-10-0-132-4 kubenswrapper[2559]: E0907 04:16:28.275049    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33c092d4737e7b1d1423752994434341c5a1c7301b7dab838609cc4d27a72b3f\": container with ID starting with 33c092d4737e7b1d1423752994434341c5a1c7301b7dab838609cc4d27a72b3f not found: ID does not exist" containerID="33c092d4737e7b1d1423752994434341c5a1c7301b7dab838609cc4d27a72b3f"
Sep 07 04:16:28.275105 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:28.275075    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33c092d4737e7b1d1423752994434341c5a1c7301b7dab838609cc4d27a72b3f"} err="failed to get container status \"33c092d4737e7b1d1423752994434341c5a1c7301b7dab838609cc4d27a72b3f\": rpc error: code = NotFound desc = could not find container \"33c092d4737e7b1d1423752994434341c5a1c7301b7dab838609cc4d27a72b3f\": container with ID starting with 33c092d4737e7b1d1423752994434341c5a1c7301b7dab838609cc4d27a72b3f not found: ID does not exist"
Sep 07 04:16:28.276068 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:28.276048    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj"]
Sep 07 04:16:28.280518 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:28.280494    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj"]
Sep 07 04:16:29.179909 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:16:29.179870    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77a7cd30-a31b-415b-b454-69ff3c05a42e" path="/var/lib/kubelet/pods/77a7cd30-a31b-415b-b454-69ff3c05a42e/volumes"
Sep 07 04:17:17.635148 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:17:17.635111    2559 scope.go:117] "RemoveContainer" containerID="4bcec4e0f5d08f255d68b21c8feb97a8d351b2b2d37132a00c5dc7a493aa7a15"
Sep 07 04:17:17.643723 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:17:17.643706    2559 scope.go:117] "RemoveContainer" containerID="f277e4d4b704aae2394fd00c1b862a37a599bf7a928be93d471e457a9f6f6f24"
Sep 07 04:18:17.671445 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:18:17.671401    2559 scope.go:117] "RemoveContainer" containerID="9aa8f8a60802533028973f136e07c259f65d68e30c17117d732b99bd5befd783"
Sep 07 04:18:17.680087 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:18:17.680068    2559 scope.go:117] "RemoveContainer" containerID="46f6c94a1e36630a775ed43a8cb24b8251e586f57d79c88b6ca5d802133cd76a"
Sep 07 04:20:17.711639 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:20:17.711587    2559 scope.go:117] "RemoveContainer" containerID="c83cc19b3d43576b0439d315bf328c7f54a323e9fb0a55c4993a235c99e3f6b8"
Sep 07 04:20:46.572494 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:20:46.572452    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6"]
Sep 07 04:20:46.572902 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:20:46.572825    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a26fe4a2-90a7-4433-9142-4a263ae02a3a" containerName="istio-proxy"
Sep 07 04:20:46.572902 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:20:46.572837    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a26fe4a2-90a7-4433-9142-4a263ae02a3a" containerName="istio-proxy"
Sep 07 04:20:46.572902 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:20:46.572849    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47aa091c-c557-4839-b6ca-f58d896cbe1b" containerName="payload-pre-processing"
Sep 07 04:20:46.572902 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:20:46.572854    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="47aa091c-c557-4839-b6ca-f58d896cbe1b" containerName="payload-pre-processing"
Sep 07 04:20:46.572902 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:20:46.572861    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f342ecf-96be-4fa4-b207-6fd0766c104d" containerName="revoke-keys"
Sep 07 04:20:46.572902 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:20:46.572867    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f342ecf-96be-4fa4-b207-6fd0766c104d" containerName="revoke-keys"
Sep 07 04:20:46.572902 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:20:46.572877    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77a7cd30-a31b-415b-b454-69ff3c05a42e" containerName="istio-proxy"
Sep 07 04:20:46.572902 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:20:46.572883    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="77a7cd30-a31b-415b-b454-69ff3c05a42e" containerName="istio-proxy"
Sep 07 04:20:46.572902 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:20:46.572890    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d74bd906-9379-4eaa-8ca9-ae39a8bd2053" containerName="payload-processing"
Sep 07 04:20:46.572902 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:20:46.572895    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d74bd906-9379-4eaa-8ca9-ae39a8bd2053" containerName="payload-processing"
Sep 07 04:20:46.572902 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:20:46.572904    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77a7cd30-a31b-415b-b454-69ff3c05a42e" containerName="istio-proxy"
Sep 07 04:20:46.572902 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:20:46.572911    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="77a7cd30-a31b-415b-b454-69ff3c05a42e" containerName="istio-proxy"
Sep 07 04:20:46.573364 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:20:46.572969    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f342ecf-96be-4fa4-b207-6fd0766c104d" containerName="revoke-keys"
Sep 07 04:20:46.573364 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:20:46.572978    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="77a7cd30-a31b-415b-b454-69ff3c05a42e" containerName="istio-proxy"
Sep 07 04:20:46.573364 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:20:46.572985    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="47aa091c-c557-4839-b6ca-f58d896cbe1b" containerName="payload-pre-processing"
Sep 07 04:20:46.573364 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:20:46.572992    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d74bd906-9379-4eaa-8ca9-ae39a8bd2053" containerName="payload-processing"
Sep 07 04:20:46.575989 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:20:46.575965    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6"
Sep 07 04:20:46.578006 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:20:46.577977    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-9444e724-kserve-self-signed-certs\""
Sep 07 04:20:46.583566 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:20:46.583528    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6"]
Sep 07 04:20:46.695486 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:20:46.695462    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45e74a00-faf0-4d6e-bd68-0a18bdba9ca6-home\") pod \"e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6\" (UID: \"45e74a00-faf0-4d6e-bd68-0a18bdba9ca6\") " pod="llm/e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6"
Sep 07 04:20:46.695603 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:20:46.695500    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45e74a00-faf0-4d6e-bd68-0a18bdba9ca6-model-cache\") pod \"e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6\" (UID: \"45e74a00-faf0-4d6e-bd68-0a18bdba9ca6\") " pod="llm/e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6"
Sep 07 04:20:46.695603 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:20:46.695546    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffsnv\" (UniqueName: \"kubernetes.io/projected/45e74a00-faf0-4d6e-bd68-0a18bdba9ca6-kube-api-access-ffsnv\") pod \"e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6\" (UID: \"45e74a00-faf0-4d6e-bd68-0a18bdba9ca6\") " pod="llm/e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6"
Sep 07 04:20:46.695603 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:20:46.695563    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45e74a00-faf0-4d6e-bd68-0a18bdba9ca6-dshm\") pod \"e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6\" (UID: \"45e74a00-faf0-4d6e-bd68-0a18bdba9ca6\") " pod="llm/e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6"
Sep 07 04:20:46.695775 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:20:46.695646    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45e74a00-faf0-4d6e-bd68-0a18bdba9ca6-tmp-dir\") pod \"e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6\" (UID: \"45e74a00-faf0-4d6e-bd68-0a18bdba9ca6\") " pod="llm/e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6"
Sep 07 04:20:46.695775 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:20:46.695683    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45e74a00-faf0-4d6e-bd68-0a18bdba9ca6-tls-certs\") pod \"e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6\" (UID: \"45e74a00-faf0-4d6e-bd68-0a18bdba9ca6\") " pod="llm/e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6"
Sep 07 04:20:46.796434 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:20:46.796401    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45e74a00-faf0-4d6e-bd68-0a18bdba9ca6-home\") pod \"e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6\" (UID: \"45e74a00-faf0-4d6e-bd68-0a18bdba9ca6\") " pod="llm/e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6"
Sep 07 04:20:46.796544 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:20:46.796444    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45e74a00-faf0-4d6e-bd68-0a18bdba9ca6-model-cache\") pod \"e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6\" (UID: \"45e74a00-faf0-4d6e-bd68-0a18bdba9ca6\") " pod="llm/e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6"
Sep 07 04:20:46.796544 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:20:46.796502    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffsnv\" (UniqueName: \"kubernetes.io/projected/45e74a00-faf0-4d6e-bd68-0a18bdba9ca6-kube-api-access-ffsnv\") pod \"e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6\" (UID: \"45e74a00-faf0-4d6e-bd68-0a18bdba9ca6\") " pod="llm/e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6"
Sep 07 04:20:46.796544 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:20:46.796527    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45e74a00-faf0-4d6e-bd68-0a18bdba9ca6-dshm\") pod \"e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6\" (UID: \"45e74a00-faf0-4d6e-bd68-0a18bdba9ca6\") " pod="llm/e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6"
Sep 07 04:20:46.796699 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:20:46.796560    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45e74a00-faf0-4d6e-bd68-0a18bdba9ca6-tmp-dir\") pod \"e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6\" (UID: \"45e74a00-faf0-4d6e-bd68-0a18bdba9ca6\") " pod="llm/e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6"
Sep 07 04:20:46.796699 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:20:46.796584    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45e74a00-faf0-4d6e-bd68-0a18bdba9ca6-tls-certs\") pod \"e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6\" (UID: \"45e74a00-faf0-4d6e-bd68-0a18bdba9ca6\") " pod="llm/e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6"
Sep 07 04:20:46.796942 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:20:46.796906    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45e74a00-faf0-4d6e-bd68-0a18bdba9ca6-home\") pod \"e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6\" (UID: \"45e74a00-faf0-4d6e-bd68-0a18bdba9ca6\") " pod="llm/e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6"
Sep 07 04:20:46.796942 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:20:46.796932    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45e74a00-faf0-4d6e-bd68-0a18bdba9ca6-model-cache\") pod \"e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6\" (UID: \"45e74a00-faf0-4d6e-bd68-0a18bdba9ca6\") " pod="llm/e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6"
Sep 07 04:20:46.797147 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:20:46.796998    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45e74a00-faf0-4d6e-bd68-0a18bdba9ca6-tmp-dir\") pod \"e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6\" (UID: \"45e74a00-faf0-4d6e-bd68-0a18bdba9ca6\") " pod="llm/e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6"
Sep 07 04:20:46.798898 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:20:46.798870    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45e74a00-faf0-4d6e-bd68-0a18bdba9ca6-dshm\") pod \"e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6\" (UID: \"45e74a00-faf0-4d6e-bd68-0a18bdba9ca6\") " pod="llm/e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6"
Sep 07 04:20:46.799094 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:20:46.799078    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45e74a00-faf0-4d6e-bd68-0a18bdba9ca6-tls-certs\") pod \"e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6\" (UID: \"45e74a00-faf0-4d6e-bd68-0a18bdba9ca6\") " pod="llm/e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6"
Sep 07 04:20:46.804031 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:20:46.804002    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffsnv\" (UniqueName: \"kubernetes.io/projected/45e74a00-faf0-4d6e-bd68-0a18bdba9ca6-kube-api-access-ffsnv\") pod \"e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6\" (UID: \"45e74a00-faf0-4d6e-bd68-0a18bdba9ca6\") " pod="llm/e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6"
Sep 07 04:20:46.887734 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:20:46.887708    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6"
Sep 07 04:20:47.157541 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:20:47.157513    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6"]
Sep 07 04:20:47.159122 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:20:47.159093    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod45e74a00_faf0_4d6e_bd68_0a18bdba9ca6.slice/crio-2f9eee3c1d604e20129246191e009063a7b91171dfc35c0f7b512f23885d92b8 WatchSource:0}: Error finding container 2f9eee3c1d604e20129246191e009063a7b91171dfc35c0f7b512f23885d92b8: Status 404 returned error can't find the container with id 2f9eee3c1d604e20129246191e009063a7b91171dfc35c0f7b512f23885d92b8
Sep 07 04:20:47.720869 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:20:47.720834    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6" event={"ID":"45e74a00-faf0-4d6e-bd68-0a18bdba9ca6","Type":"ContainerStarted","Data":"f5243d3c17c3fa4c3b8ad61790b477381ffeefc80ea791389bb6e536e94bf24f"}
Sep 07 04:20:47.721236 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:20:47.720876    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6" event={"ID":"45e74a00-faf0-4d6e-bd68-0a18bdba9ca6","Type":"ContainerStarted","Data":"2f9eee3c1d604e20129246191e009063a7b91171dfc35c0f7b512f23885d92b8"}
Sep 07 04:20:47.736949 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:20:47.736895    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6" podStartSLOduration=1.7368803800000001 podStartE2EDuration="1.73688038s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:20:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:20:47.734910599 +0000 UTC m=+1951.047386501" watchObservedRunningTime="2026-09-07 04:20:47.73688038 +0000 UTC m=+1951.049356282"
Sep 07 04:20:56.887963 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:20:56.887914    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6"
Sep 07 04:20:56.887963 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:20:56.887967    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6"
Sep 07 04:20:56.902319 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:20:56.902269    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6"
Sep 07 04:20:57.790229 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:20:57.790197    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6"
Sep 07 04:21:17.733060 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:21:17.732987    2559 scope.go:117] "RemoveContainer" containerID="3d3159af8cbc27e130c0033a0b14c9291b65c4280a27f88430d1b7f5b015d1c0"
Sep 07 04:21:17.741436 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:21:17.741413    2559 scope.go:117] "RemoveContainer" containerID="58696ff385975a127e88654ed2557f868efe87a6dfc651661438179f7bb331da"
Sep 07 04:21:17.749034 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:21:17.749012    2559 scope.go:117] "RemoveContainer" containerID="397fed8b37c04c3f19a7d88c031d1d02237b0cbf622db42685311cbf8760d3ad"
Sep 07 04:22:10.132691 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:22:10.132653    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6"]
Sep 07 04:22:17.778597 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:22:17.778564    2559 scope.go:117] "RemoveContainer" containerID="41cee2351f69a60a314bdeb7e4398298227902e2e859462c57c4614198811c5a"
Sep 07 04:22:17.789290 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:22:17.789261    2559 scope.go:117] "RemoveContainer" containerID="e2c98e7fbbddb48e17323db4c1f7e5cce5a7adea2440530b4dae787f178febcb"
Sep 07 04:22:17.798090 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:22:17.798069    2559 scope.go:117] "RemoveContainer" containerID="e69700dad402b4d3a707abcb5334647772db552eee8d3eeb9123e184b491d5e1"
Sep 07 04:22:25.152715 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:22:25.152645    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6" podUID="45e74a00-faf0-4d6e-bd68-0a18bdba9ca6" containerName="main" containerID="cri-o://f5243d3c17c3fa4c3b8ad61790b477381ffeefc80ea791389bb6e536e94bf24f" gracePeriod=45
Sep 07 04:22:25.392616 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:22:25.392593    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6"
Sep 07 04:22:25.479830 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:22:25.479755    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45e74a00-faf0-4d6e-bd68-0a18bdba9ca6-tls-certs\") pod \"45e74a00-faf0-4d6e-bd68-0a18bdba9ca6\" (UID: \"45e74a00-faf0-4d6e-bd68-0a18bdba9ca6\") "
Sep 07 04:22:25.479830 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:22:25.479811    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45e74a00-faf0-4d6e-bd68-0a18bdba9ca6-dshm\") pod \"45e74a00-faf0-4d6e-bd68-0a18bdba9ca6\" (UID: \"45e74a00-faf0-4d6e-bd68-0a18bdba9ca6\") "
Sep 07 04:22:25.479830 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:22:25.479831    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45e74a00-faf0-4d6e-bd68-0a18bdba9ca6-tmp-dir\") pod \"45e74a00-faf0-4d6e-bd68-0a18bdba9ca6\" (UID: \"45e74a00-faf0-4d6e-bd68-0a18bdba9ca6\") "
Sep 07 04:22:25.480089 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:22:25.479936    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45e74a00-faf0-4d6e-bd68-0a18bdba9ca6-model-cache\") pod \"45e74a00-faf0-4d6e-bd68-0a18bdba9ca6\" (UID: \"45e74a00-faf0-4d6e-bd68-0a18bdba9ca6\") "
Sep 07 04:22:25.480089 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:22:25.479969    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45e74a00-faf0-4d6e-bd68-0a18bdba9ca6-home\") pod \"45e74a00-faf0-4d6e-bd68-0a18bdba9ca6\" (UID: \"45e74a00-faf0-4d6e-bd68-0a18bdba9ca6\") "
Sep 07 04:22:25.480089 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:22:25.480041    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ffsnv\" (UniqueName: \"kubernetes.io/projected/45e74a00-faf0-4d6e-bd68-0a18bdba9ca6-kube-api-access-ffsnv\") pod \"45e74a00-faf0-4d6e-bd68-0a18bdba9ca6\" (UID: \"45e74a00-faf0-4d6e-bd68-0a18bdba9ca6\") "
Sep 07 04:22:25.480089 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:22:25.480079    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45e74a00-faf0-4d6e-bd68-0a18bdba9ca6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "45e74a00-faf0-4d6e-bd68-0a18bdba9ca6" (UID: "45e74a00-faf0-4d6e-bd68-0a18bdba9ca6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:22:25.480274 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:22:25.480182    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45e74a00-faf0-4d6e-bd68-0a18bdba9ca6-model-cache" (OuterVolumeSpecName: "model-cache") pod "45e74a00-faf0-4d6e-bd68-0a18bdba9ca6" (UID: "45e74a00-faf0-4d6e-bd68-0a18bdba9ca6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:22:25.480332 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:22:25.480286    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45e74a00-faf0-4d6e-bd68-0a18bdba9ca6-home" (OuterVolumeSpecName: "home") pod "45e74a00-faf0-4d6e-bd68-0a18bdba9ca6" (UID: "45e74a00-faf0-4d6e-bd68-0a18bdba9ca6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:22:25.480392 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:22:25.480363    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45e74a00-faf0-4d6e-bd68-0a18bdba9ca6-tmp-dir\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:22:25.480392 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:22:25.480376    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45e74a00-faf0-4d6e-bd68-0a18bdba9ca6-model-cache\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:22:25.480392 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:22:25.480385    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45e74a00-faf0-4d6e-bd68-0a18bdba9ca6-home\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:22:25.481983 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:22:25.481957    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45e74a00-faf0-4d6e-bd68-0a18bdba9ca6-dshm" (OuterVolumeSpecName: "dshm") pod "45e74a00-faf0-4d6e-bd68-0a18bdba9ca6" (UID: "45e74a00-faf0-4d6e-bd68-0a18bdba9ca6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 04:22:25.481983 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:22:25.481969    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45e74a00-faf0-4d6e-bd68-0a18bdba9ca6-kube-api-access-ffsnv" (OuterVolumeSpecName: "kube-api-access-ffsnv") pod "45e74a00-faf0-4d6e-bd68-0a18bdba9ca6" (UID: "45e74a00-faf0-4d6e-bd68-0a18bdba9ca6"). InnerVolumeSpecName "kube-api-access-ffsnv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 04:22:25.482132 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:22:25.482003    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45e74a00-faf0-4d6e-bd68-0a18bdba9ca6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "45e74a00-faf0-4d6e-bd68-0a18bdba9ca6" (UID: "45e74a00-faf0-4d6e-bd68-0a18bdba9ca6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 04:22:25.581100 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:22:25.581073    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45e74a00-faf0-4d6e-bd68-0a18bdba9ca6-tls-certs\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:22:25.581100 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:22:25.581095    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45e74a00-faf0-4d6e-bd68-0a18bdba9ca6-dshm\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:22:25.581242 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:22:25.581104    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ffsnv\" (UniqueName: \"kubernetes.io/projected/45e74a00-faf0-4d6e-bd68-0a18bdba9ca6-kube-api-access-ffsnv\") on node \"ip-10-0-132-4.ec2.internal\" DevicePath \"\""
Sep 07 04:22:26.253506 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:22:26.253465    2559 generic.go:356] "Generic (PLEG): container finished" podID="45e74a00-faf0-4d6e-bd68-0a18bdba9ca6" containerID="f5243d3c17c3fa4c3b8ad61790b477381ffeefc80ea791389bb6e536e94bf24f" exitCode=0
Sep 07 04:22:26.254025 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:22:26.253522    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6"
Sep 07 04:22:26.254025 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:22:26.253564    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6" event={"ID":"45e74a00-faf0-4d6e-bd68-0a18bdba9ca6","Type":"ContainerDied","Data":"f5243d3c17c3fa4c3b8ad61790b477381ffeefc80ea791389bb6e536e94bf24f"}
Sep 07 04:22:26.254025 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:22:26.253635    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6" event={"ID":"45e74a00-faf0-4d6e-bd68-0a18bdba9ca6","Type":"ContainerDied","Data":"2f9eee3c1d604e20129246191e009063a7b91171dfc35c0f7b512f23885d92b8"}
Sep 07 04:22:26.254025 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:22:26.253655    2559 scope.go:117] "RemoveContainer" containerID="f5243d3c17c3fa4c3b8ad61790b477381ffeefc80ea791389bb6e536e94bf24f"
Sep 07 04:22:26.265029 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:22:26.265012    2559 scope.go:117] "RemoveContainer" containerID="f5243d3c17c3fa4c3b8ad61790b477381ffeefc80ea791389bb6e536e94bf24f"
Sep 07 04:22:26.265337 ip-10-0-132-4 kubenswrapper[2559]: E0907 04:22:26.265317    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5243d3c17c3fa4c3b8ad61790b477381ffeefc80ea791389bb6e536e94bf24f\": container with ID starting with f5243d3c17c3fa4c3b8ad61790b477381ffeefc80ea791389bb6e536e94bf24f not found: ID does not exist" containerID="f5243d3c17c3fa4c3b8ad61790b477381ffeefc80ea791389bb6e536e94bf24f"
Sep 07 04:22:26.265398 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:22:26.265349    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5243d3c17c3fa4c3b8ad61790b477381ffeefc80ea791389bb6e536e94bf24f"} err="failed to get container status \"f5243d3c17c3fa4c3b8ad61790b477381ffeefc80ea791389bb6e536e94bf24f\": rpc error: code = NotFound desc = could not find container \"f5243d3c17c3fa4c3b8ad61790b477381ffeefc80ea791389bb6e536e94bf24f\": container with ID starting with f5243d3c17c3fa4c3b8ad61790b477381ffeefc80ea791389bb6e536e94bf24f not found: ID does not exist"
Sep 07 04:22:26.275936 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:22:26.275911    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6"]
Sep 07 04:22:26.278551 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:22:26.278530    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-9444e724-kserve-68dd686d87-lz2q6"]
Sep 07 04:22:27.179418 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:22:27.179385    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45e74a00-faf0-4d6e-bd68-0a18bdba9ca6" path="/var/lib/kubelet/pods/45e74a00-faf0-4d6e-bd68-0a18bdba9ca6/volumes"
Sep 07 04:23:08.577014 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:08.576976    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-72687_97edede6-2df4-4b84-a765-8f310bd79daa/server/0.log"
Sep 07 04:23:08.695376 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:08.695342    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-ldp27_bdbe4393-0cc2-4304-a9ec-77cfccee1a6c/manager/0.log"
Sep 07 04:23:09.055530 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:09.055499    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-756ff4ddd-tknv4_4c508801-72ba-4ba1-9db7-7e9a421fb6b5/manager/0.log"
Sep 07 04:23:09.060891 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:09.060862    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-756ff4ddd-tknv4_4c508801-72ba-4ba1-9db7-7e9a421fb6b5/copy-manifests/0.log"
Sep 07 04:23:09.622734 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:09.622700    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29812560-vkg8j_6123c7fe-42f5-41cc-ae8e-5a54f97be64c/cleanup/0.log"
Sep 07 04:23:09.727582 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:09.727556    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29812575-2tsb4_239c959f-cf1c-4a67-8ba0-c21b07da1248/cleanup/0.log"
Sep 07 04:23:11.637545 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:11.637511    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl_59e537f6-23ed-4c64-9797-b1a466d933a8/istio-proxy/0.log"
Sep 07 04:23:11.755688 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:11.755641    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-qppls_0cf3c1d9-36ef-4334-a238-eb19395532c2/discovery/0.log"
Sep 07 04:23:12.337047 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:12.337015    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-t4whn_2ccc5fd6-5875-4c48-bb6c-3e3c74b3e6b7/payload-processing/0.log"
Sep 07 04:23:12.812462 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:12.812433    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-l7cx5_34023d09-622d-4fe2-b106-a5cd66af1fb9/main/0.log"
Sep 07 04:23:18.681744 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:18.681710    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nrrkw/must-gather-hp8h4"]
Sep 07 04:23:18.682269 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:18.682113    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45e74a00-faf0-4d6e-bd68-0a18bdba9ca6" containerName="main"
Sep 07 04:23:18.682269 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:18.682133    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="45e74a00-faf0-4d6e-bd68-0a18bdba9ca6" containerName="main"
Sep 07 04:23:18.682269 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:18.682248    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="45e74a00-faf0-4d6e-bd68-0a18bdba9ca6" containerName="main"
Sep 07 04:23:18.682269 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:18.682268    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="77a7cd30-a31b-415b-b454-69ff3c05a42e" containerName="istio-proxy"
Sep 07 04:23:18.686445 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:18.686423    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nrrkw/must-gather-hp8h4"
Sep 07 04:23:18.688326 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:18.688291    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nrrkw\"/\"openshift-service-ca.crt\""
Sep 07 04:23:18.688456 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:18.688418    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nrrkw\"/\"kube-root-ca.crt\""
Sep 07 04:23:18.688924 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:18.688908    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-nrrkw\"/\"default-dockercfg-tlzxz\""
Sep 07 04:23:18.693252 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:18.693228    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nrrkw/must-gather-hp8h4"]
Sep 07 04:23:18.816144 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:18.816118    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3b1a9b10-7cbd-47cb-baad-fd495400f124-must-gather-output\") pod \"must-gather-hp8h4\" (UID: \"3b1a9b10-7cbd-47cb-baad-fd495400f124\") " pod="openshift-must-gather-nrrkw/must-gather-hp8h4"
Sep 07 04:23:18.816259 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:18.816154    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kvw6\" (UniqueName: \"kubernetes.io/projected/3b1a9b10-7cbd-47cb-baad-fd495400f124-kube-api-access-2kvw6\") pod \"must-gather-hp8h4\" (UID: \"3b1a9b10-7cbd-47cb-baad-fd495400f124\") " pod="openshift-must-gather-nrrkw/must-gather-hp8h4"
Sep 07 04:23:18.917367 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:18.917341    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3b1a9b10-7cbd-47cb-baad-fd495400f124-must-gather-output\") pod \"must-gather-hp8h4\" (UID: \"3b1a9b10-7cbd-47cb-baad-fd495400f124\") " pod="openshift-must-gather-nrrkw/must-gather-hp8h4"
Sep 07 04:23:18.917482 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:18.917389    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kvw6\" (UniqueName: \"kubernetes.io/projected/3b1a9b10-7cbd-47cb-baad-fd495400f124-kube-api-access-2kvw6\") pod \"must-gather-hp8h4\" (UID: \"3b1a9b10-7cbd-47cb-baad-fd495400f124\") " pod="openshift-must-gather-nrrkw/must-gather-hp8h4"
Sep 07 04:23:18.917701 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:18.917684    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3b1a9b10-7cbd-47cb-baad-fd495400f124-must-gather-output\") pod \"must-gather-hp8h4\" (UID: \"3b1a9b10-7cbd-47cb-baad-fd495400f124\") " pod="openshift-must-gather-nrrkw/must-gather-hp8h4"
Sep 07 04:23:18.924868 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:18.924837    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kvw6\" (UniqueName: \"kubernetes.io/projected/3b1a9b10-7cbd-47cb-baad-fd495400f124-kube-api-access-2kvw6\") pod \"must-gather-hp8h4\" (UID: \"3b1a9b10-7cbd-47cb-baad-fd495400f124\") " pod="openshift-must-gather-nrrkw/must-gather-hp8h4"
Sep 07 04:23:18.996395 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:18.996341    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nrrkw/must-gather-hp8h4"
Sep 07 04:23:19.284246 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:19.283162    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nrrkw/must-gather-hp8h4"]
Sep 07 04:23:19.289228 ip-10-0-132-4 kubenswrapper[2559]: W0907 04:23:19.289188    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3b1a9b10_7cbd_47cb_baad_fd495400f124.slice/crio-7d84a57b1617884930877dfe3c2cce65159af5d87d5cb973ac8c787ce46a9bc5 WatchSource:0}: Error finding container 7d84a57b1617884930877dfe3c2cce65159af5d87d5cb973ac8c787ce46a9bc5: Status 404 returned error can't find the container with id 7d84a57b1617884930877dfe3c2cce65159af5d87d5cb973ac8c787ce46a9bc5
Sep 07 04:23:19.291414 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:19.291392    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 04:23:19.535263 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:19.535174    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nrrkw/must-gather-hp8h4" event={"ID":"3b1a9b10-7cbd-47cb-baad-fd495400f124","Type":"ContainerStarted","Data":"7d84a57b1617884930877dfe3c2cce65159af5d87d5cb973ac8c787ce46a9bc5"}
Sep 07 04:23:20.545655 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:20.545548    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nrrkw/must-gather-hp8h4" event={"ID":"3b1a9b10-7cbd-47cb-baad-fd495400f124","Type":"ContainerStarted","Data":"2ec56fd704475ffe9a2b3cc0bd190ee19ff983c0052b62ab32a880fee216e7ab"}
Sep 07 04:23:20.545655 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:20.545601    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nrrkw/must-gather-hp8h4" event={"ID":"3b1a9b10-7cbd-47cb-baad-fd495400f124","Type":"ContainerStarted","Data":"e6e8f96aa1b98e924f74ba96184cfcd8b2e35bfdf6f5a5ff22578ff95b5ce520"}
Sep 07 04:23:20.562137 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:20.562061    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-nrrkw/must-gather-hp8h4" podStartSLOduration=1.705754852 podStartE2EDuration="2.562040493s" totalImagesPullingTime="856.285641ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 04:23:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:23:20.559049501 +0000 UTC m=+2103.871525420" watchObservedRunningTime="2026-09-07 04:23:20.562040493 +0000 UTC m=+2103.874516399"
Sep 07 04:23:21.667122 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:21.667088    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tdrdx_078e2a74-a77c-42d5-941a-52e2b16a74ed/global-pull-secret-syncer/0.log"
Sep 07 04:23:21.813289 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:21.813254    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jpqvg_02324c56-a65f-4119-89d6-b5d48a9d9609/konnectivity-agent/0.log"
Sep 07 04:23:21.875252 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:21.875203    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-4.ec2.internal_136ee68bc096b03f0cd9fc22ad8e3b3c/haproxy/0.log"
Sep 07 04:23:28.219089 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:28.219056    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5e5065fb-a246-46ec-ad61-d998576a2e8f/alertmanager/0.log"
Sep 07 04:23:28.239368 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:28.239314    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5e5065fb-a246-46ec-ad61-d998576a2e8f/config-reloader/0.log"
Sep 07 04:23:28.259076 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:28.259047    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5e5065fb-a246-46ec-ad61-d998576a2e8f/kube-rbac-proxy-web/0.log"
Sep 07 04:23:28.277908 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:28.277867    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5e5065fb-a246-46ec-ad61-d998576a2e8f/kube-rbac-proxy/0.log"
Sep 07 04:23:28.298963 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:28.298932    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5e5065fb-a246-46ec-ad61-d998576a2e8f/kube-rbac-proxy-metric/0.log"
Sep 07 04:23:28.314548 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:28.314520    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5e5065fb-a246-46ec-ad61-d998576a2e8f/prom-label-proxy/0.log"
Sep 07 04:23:28.334166 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:28.334088    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5e5065fb-a246-46ec-ad61-d998576a2e8f/init-config-reloader/0.log"
Sep 07 04:23:28.461915 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:28.461883    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-777967499f-zrndh_542e46e8-e669-45c2-85d2-d0e3511e474e/metrics-server/0.log"
Sep 07 04:23:28.487104 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:28.487067    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-cktwr_8e82e8af-59f5-41a0-8f77-0fc26d1d9ff7/monitoring-plugin/0.log"
Sep 07 04:23:28.685642 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:28.684674    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rj8z9_81013bd8-76f9-48a7-8486-49319e60f602/node-exporter/0.log"
Sep 07 04:23:28.714827 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:28.714799    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rj8z9_81013bd8-76f9-48a7-8486-49319e60f602/kube-rbac-proxy/0.log"
Sep 07 04:23:28.738113 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:28.738079    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rj8z9_81013bd8-76f9-48a7-8486-49319e60f602/init-textfile/0.log"
Sep 07 04:23:29.137872 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:29.137838    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-69dc9c6899-lmtrw_4bf3ca4a-32ee-45c6-9545-15598acc616d/telemeter-client/0.log"
Sep 07 04:23:29.164375 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:29.164343    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-69dc9c6899-lmtrw_4bf3ca4a-32ee-45c6-9545-15598acc616d/reload/0.log"
Sep 07 04:23:29.189088 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:29.189057    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-69dc9c6899-lmtrw_4bf3ca4a-32ee-45c6-9545-15598acc616d/kube-rbac-proxy/0.log"
Sep 07 04:23:31.527988 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:31.527949    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nrrkw/perf-node-gather-daemonset-xwp79"]
Sep 07 04:23:31.534119 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:31.534090    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nrrkw/perf-node-gather-daemonset-xwp79"
Sep 07 04:23:31.538719 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:31.538694    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nrrkw/perf-node-gather-daemonset-xwp79"]
Sep 07 04:23:31.575213 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:31.575162    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9f5w\" (UniqueName: \"kubernetes.io/projected/ba46bc9f-507b-4ebc-98da-001cbc6a71bd-kube-api-access-f9f5w\") pod \"perf-node-gather-daemonset-xwp79\" (UID: \"ba46bc9f-507b-4ebc-98da-001cbc6a71bd\") " pod="openshift-must-gather-nrrkw/perf-node-gather-daemonset-xwp79"
Sep 07 04:23:31.575530 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:31.575503    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba46bc9f-507b-4ebc-98da-001cbc6a71bd-sys\") pod \"perf-node-gather-daemonset-xwp79\" (UID: \"ba46bc9f-507b-4ebc-98da-001cbc6a71bd\") " pod="openshift-must-gather-nrrkw/perf-node-gather-daemonset-xwp79"
Sep 07 04:23:31.575692 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:31.575548    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ba46bc9f-507b-4ebc-98da-001cbc6a71bd-proc\") pod \"perf-node-gather-daemonset-xwp79\" (UID: \"ba46bc9f-507b-4ebc-98da-001cbc6a71bd\") " pod="openshift-must-gather-nrrkw/perf-node-gather-daemonset-xwp79"
Sep 07 04:23:31.575692 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:31.575583    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ba46bc9f-507b-4ebc-98da-001cbc6a71bd-podres\") pod \"perf-node-gather-daemonset-xwp79\" (UID: \"ba46bc9f-507b-4ebc-98da-001cbc6a71bd\") " pod="openshift-must-gather-nrrkw/perf-node-gather-daemonset-xwp79"
Sep 07 04:23:31.575816 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:31.575701    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ba46bc9f-507b-4ebc-98da-001cbc6a71bd-lib-modules\") pod \"perf-node-gather-daemonset-xwp79\" (UID: \"ba46bc9f-507b-4ebc-98da-001cbc6a71bd\") " pod="openshift-must-gather-nrrkw/perf-node-gather-daemonset-xwp79"
Sep 07 04:23:31.676876 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:31.676840    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9f5w\" (UniqueName: \"kubernetes.io/projected/ba46bc9f-507b-4ebc-98da-001cbc6a71bd-kube-api-access-f9f5w\") pod \"perf-node-gather-daemonset-xwp79\" (UID: \"ba46bc9f-507b-4ebc-98da-001cbc6a71bd\") " pod="openshift-must-gather-nrrkw/perf-node-gather-daemonset-xwp79"
Sep 07 04:23:31.677284 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:31.677257    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba46bc9f-507b-4ebc-98da-001cbc6a71bd-sys\") pod \"perf-node-gather-daemonset-xwp79\" (UID: \"ba46bc9f-507b-4ebc-98da-001cbc6a71bd\") " pod="openshift-must-gather-nrrkw/perf-node-gather-daemonset-xwp79"
Sep 07 04:23:31.677407 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:31.677361    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba46bc9f-507b-4ebc-98da-001cbc6a71bd-sys\") pod \"perf-node-gather-daemonset-xwp79\" (UID: \"ba46bc9f-507b-4ebc-98da-001cbc6a71bd\") " pod="openshift-must-gather-nrrkw/perf-node-gather-daemonset-xwp79"
Sep 07 04:23:31.677474 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:31.677420    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ba46bc9f-507b-4ebc-98da-001cbc6a71bd-proc\") pod \"perf-node-gather-daemonset-xwp79\" (UID: \"ba46bc9f-507b-4ebc-98da-001cbc6a71bd\") " pod="openshift-must-gather-nrrkw/perf-node-gather-daemonset-xwp79"
Sep 07 04:23:31.677551 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:31.677492    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ba46bc9f-507b-4ebc-98da-001cbc6a71bd-proc\") pod \"perf-node-gather-daemonset-xwp79\" (UID: \"ba46bc9f-507b-4ebc-98da-001cbc6a71bd\") " pod="openshift-must-gather-nrrkw/perf-node-gather-daemonset-xwp79"
Sep 07 04:23:31.677615 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:31.677559    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ba46bc9f-507b-4ebc-98da-001cbc6a71bd-podres\") pod \"perf-node-gather-daemonset-xwp79\" (UID: \"ba46bc9f-507b-4ebc-98da-001cbc6a71bd\") " pod="openshift-must-gather-nrrkw/perf-node-gather-daemonset-xwp79"
Sep 07 04:23:31.677691 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:31.677655    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ba46bc9f-507b-4ebc-98da-001cbc6a71bd-lib-modules\") pod \"perf-node-gather-daemonset-xwp79\" (UID: \"ba46bc9f-507b-4ebc-98da-001cbc6a71bd\") " pod="openshift-must-gather-nrrkw/perf-node-gather-daemonset-xwp79"
Sep 07 04:23:31.677792 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:31.677743    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ba46bc9f-507b-4ebc-98da-001cbc6a71bd-podres\") pod \"perf-node-gather-daemonset-xwp79\" (UID: \"ba46bc9f-507b-4ebc-98da-001cbc6a71bd\") " pod="openshift-must-gather-nrrkw/perf-node-gather-daemonset-xwp79"
Sep 07 04:23:31.677917 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:31.677810    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ba46bc9f-507b-4ebc-98da-001cbc6a71bd-lib-modules\") pod \"perf-node-gather-daemonset-xwp79\" (UID: \"ba46bc9f-507b-4ebc-98da-001cbc6a71bd\") " pod="openshift-must-gather-nrrkw/perf-node-gather-daemonset-xwp79"
Sep 07 04:23:31.684636 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:31.684597    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9f5w\" (UniqueName: \"kubernetes.io/projected/ba46bc9f-507b-4ebc-98da-001cbc6a71bd-kube-api-access-f9f5w\") pod \"perf-node-gather-daemonset-xwp79\" (UID: \"ba46bc9f-507b-4ebc-98da-001cbc6a71bd\") " pod="openshift-must-gather-nrrkw/perf-node-gather-daemonset-xwp79"
Sep 07 04:23:31.848300 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:31.848220    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nrrkw/perf-node-gather-daemonset-xwp79"
Sep 07 04:23:31.861349 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:31.861320    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-675775547b-tpgqf_0e155b9e-30ca-4f44-9b1e-2c4086033dff/console/0.log"
Sep 07 04:23:32.133950 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:32.133915    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nrrkw/perf-node-gather-daemonset-xwp79"]
Sep 07 04:23:32.668779 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:32.668738    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nrrkw/perf-node-gather-daemonset-xwp79" event={"ID":"ba46bc9f-507b-4ebc-98da-001cbc6a71bd","Type":"ContainerStarted","Data":"780fa9b9538d815ca4901092153eb30cff6aee2234774f2d533ea633f2c4bc64"}
Sep 07 04:23:32.669267 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:32.668814    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nrrkw/perf-node-gather-daemonset-xwp79" event={"ID":"ba46bc9f-507b-4ebc-98da-001cbc6a71bd","Type":"ContainerStarted","Data":"2ac0761489ea3a05e08770c18c3f5a3c13ccc8018302ac643617feb9b0d6dbbd"}
Sep 07 04:23:32.669739 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:32.669711    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-nrrkw/perf-node-gather-daemonset-xwp79"
Sep 07 04:23:32.688146 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:32.688094    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-nrrkw/perf-node-gather-daemonset-xwp79" podStartSLOduration=1.6880738800000001 podStartE2EDuration="1.68807388s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 04:23:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 04:23:32.683472905 +0000 UTC m=+2115.995948808" watchObservedRunningTime="2026-09-07 04:23:32.68807388 +0000 UTC m=+2116.000549783"
Sep 07 04:23:33.708421 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:33.708390    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pqkmf_402c56f5-8cd6-4a03-a33f-85d0edb2ae3e/dns/0.log"
Sep 07 04:23:33.725584 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:33.725559    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pqkmf_402c56f5-8cd6-4a03-a33f-85d0edb2ae3e/kube-rbac-proxy/0.log"
Sep 07 04:23:33.802819 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:33.802792    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-72b5b_9dc17bd6-5586-49ea-a5d8-85860cad426f/dns-node-resolver/0.log"
Sep 07 04:23:34.346499 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:34.346473    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6bc8b58db7-8h557_82e20ff0-6f2f-44ff-8c2e-93c79ee0893e/registry/0.log"
Sep 07 04:23:34.385820 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:34.385791    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-t7c8n_b0fedcd8-4974-4bf5-af6f-41711c6bbedd/node-ca/0.log"
Sep 07 04:23:35.294575 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:35.294544    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl_59e537f6-23ed-4c64-9797-b1a466d933a8/istio-proxy/0.log"
Sep 07 04:23:35.878564 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:35.878530    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-qppls_0cf3c1d9-36ef-4334-a238-eb19395532c2/discovery/0.log"
Sep 07 04:23:36.036074 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:36.036012    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-t4whn_2ccc5fd6-5875-4c48-bb6c-3e3c74b3e6b7/payload-processing/0.log"
Sep 07 04:23:36.885483 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:36.885449    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7jwg7_ac541457-397f-4ea3-9c7a-2256f9ec8ffb/serve-healthcheck-canary/0.log"
Sep 07 04:23:37.414865 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:37.414837    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6jk9k_cf07a827-6264-48a3-958c-c4102ba7ee5e/kube-rbac-proxy/0.log"
Sep 07 04:23:37.433610 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:37.433582    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6jk9k_cf07a827-6264-48a3-958c-c4102ba7ee5e/exporter/0.log"
Sep 07 04:23:37.453200 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:37.453171    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6jk9k_cf07a827-6264-48a3-958c-c4102ba7ee5e/extractor/0.log"
Sep 07 04:23:38.687225 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:38.687196    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-nrrkw/perf-node-gather-daemonset-xwp79"
Sep 07 04:23:40.002146 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:40.002099    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-72687_97edede6-2df4-4b84-a765-8f310bd79daa/server/0.log"
Sep 07 04:23:40.131051 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:40.131013    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-ldp27_bdbe4393-0cc2-4304-a9ec-77cfccee1a6c/manager/0.log"
Sep 07 04:23:40.372015 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:40.371980    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-756ff4ddd-tknv4_4c508801-72ba-4ba1-9db7-7e9a421fb6b5/manager/0.log"
Sep 07 04:23:40.387265 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:40.387242    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-756ff4ddd-tknv4_4c508801-72ba-4ba1-9db7-7e9a421fb6b5/copy-manifests/0.log"
Sep 07 04:23:41.834882 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:41.834809    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-758b7d97c6-z8pc2_be5b5614-68b9-4aca-ae45-26f7c73403a0/manager/0.log"
Sep 07 04:23:41.855810 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:41.855777    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-s6s5g_e0912204-badd-452e-9631-9b69c23d3546/openshift-lws-operator/0.log"
Sep 07 04:23:42.175960 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:42.175929    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl_59e537f6-23ed-4c64-9797-b1a466d933a8/istio-proxy/0.log"
Sep 07 04:23:42.776500 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:42.776438    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-qppls_0cf3c1d9-36ef-4334-a238-eb19395532c2/discovery/0.log"
Sep 07 04:23:42.902355 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:42.902321    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-t4whn_2ccc5fd6-5875-4c48-bb6c-3e3c74b3e6b7/payload-processing/0.log"
Sep 07 04:23:44.339960 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:44.339928    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl_59e537f6-23ed-4c64-9797-b1a466d933a8/istio-proxy/0.log"
Sep 07 04:23:44.907506 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:44.907471    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-qppls_0cf3c1d9-36ef-4334-a238-eb19395532c2/discovery/0.log"
Sep 07 04:23:45.037862 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:45.037824    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-t4whn_2ccc5fd6-5875-4c48-bb6c-3e3c74b3e6b7/payload-processing/0.log"
Sep 07 04:23:48.239527 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:48.239495    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-9rxpx_9d48a665-e3f4-4f7e-9b28-462f9954f0de/kube-multus/0.log"
Sep 07 04:23:48.259793 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:48.259767    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g7mf6_9a89adb7-9035-489e-8c69-72a65791ba9d/kube-multus-additional-cni-plugins/0.log"
Sep 07 04:23:48.277313 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:48.277288    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g7mf6_9a89adb7-9035-489e-8c69-72a65791ba9d/egress-router-binary-copy/0.log"
Sep 07 04:23:48.294142 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:48.294104    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g7mf6_9a89adb7-9035-489e-8c69-72a65791ba9d/cni-plugins/0.log"
Sep 07 04:23:48.310737 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:48.310712    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g7mf6_9a89adb7-9035-489e-8c69-72a65791ba9d/bond-cni-plugin/0.log"
Sep 07 04:23:48.328955 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:48.328863    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g7mf6_9a89adb7-9035-489e-8c69-72a65791ba9d/routeoverride-cni/0.log"
Sep 07 04:23:48.347140 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:48.347120    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g7mf6_9a89adb7-9035-489e-8c69-72a65791ba9d/whereabouts-cni-bincopy/0.log"
Sep 07 04:23:48.370809 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:48.370788    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g7mf6_9a89adb7-9035-489e-8c69-72a65791ba9d/whereabouts-cni/0.log"
Sep 07 04:23:48.719767 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:48.719741    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7rg9j_64880c7e-cc6b-462f-9d79-b9b6b48d34ca/network-metrics-daemon/0.log"
Sep 07 04:23:48.735602 ip-10-0-132-4 kubenswrapper[2559]: I0907 04:23:48.735573    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7rg9j_64880c7e-cc6b-462f-9d79-b9b6b48d34ca/kube-rbac-proxy/0.log"